Virtual experience providing device, virtual experience providing method and storage medium

Abstract

Provided are a virtual experience providing device, a virtual experience providing method, and a storage medium, which can improve the attraction of users who watch virtual reality images and have a virtual experience, with respect to the objects of advertisements. The virtual experience providing device is a virtual experience providing device that provides users with a service that allows them to have a virtual experience in a virtual reality image obtained based on a virtual world that virtually reproduces the real world or a fictional world. The virtual experience providing device includes: a determination unit that determines an advertisement image included in the virtual reality image based on the attributes of the user who receives the provision of the service; an image generation unit that generates the virtual reality image that includes the advertisement image in a specified advertisement display area; and a display control unit that causes the virtual reality image to be displayed on a display device.

Description

Technical Field

[0001] The invention relates to a virtual experience providing device, a virtual experience providing method and a storage medium. Background Art

[0002] Conventionally, there is an experience device that allows users who are studying travel contents including travel destinations, travel plans, etc. to watch virtual reality images and share virtual travel experiences (for example, Patent Document 1). In addition, there is a technology that displays advertisements corresponding to the attributes of users while watching images and playing games (for example, Patent Document 2).

[0003] [Prior technical literature]

[0004] [Patent Literature]

[0005] [Patent Document 1] Japanese Patent Application Publication No. 2018-155887

[0006] [Patent Document 2] Japanese Patent Application Publication No. 2017-182505 Summary of the invention

[0007] Problems to be solved by the invention

[0008] However, none of the above conventional technologies displays advertisements in virtual reality images for users who are experiencing virtual travel. Therefore, even if advertisements are displayed in virtual reality images, it is difficult to increase the strength of attracting users with respect to the objects of the advertisements.

[0009] The present invention is made in consideration of such a situation, and one of its purposes is to provide a virtual experience providing device, a virtual experience providing method and a storage medium that can improve the attraction of users who have a virtual experience watching virtual reality images with respect to advertising objects.

[0010] Solutions to Solve Problems

[0011] The virtual experience providing device, virtual experience providing method and storage medium of the present invention adopt the following configurations.

[0012] (1) A first embodiment of the present invention is a virtual experience providing device that provides a service for users to have a virtual experience within a virtual reality image, wherein the virtual reality image is obtained based on a virtual world that virtually reproduces the real world or a fictional world, wherein the virtual experience providing device comprises: a determination unit that determines an advertising image to be included in the virtual reality image based on the attributes of the user who receives the provision of the service; an image generation unit that generates the virtual reality image that includes the advertising image in a specified advertising display area; and a display control unit that causes the virtual reality image to be displayed on a display device.

[0013] (2) A second scheme of the present invention, based on the first scheme, further comprises a fee setting unit for setting an advertising fee for displaying the advertising image, wherein the fee setting unit adjusts the advertising fee based on a user's dwelling frequency within the virtual reality image, and the higher the dwelling frequency, the higher the advertising fee is set.

[0014] (3) According to a third scheme of the present invention, based on the second scheme, the virtual reality image is an image that virtually reproduces the real world, and the display control unit excludes an area in the virtual reality image that overlaps with a landscape focus point in the real world from an area for displaying the advertising image.

[0015] (4) According to a fourth aspect of the present invention, in addition to any one of the first to third aspects, the determination unit determines the advertisement image further based on an advertisement display location where the advertisement image is displayed.

[0016] (5) According to a fifth aspect of the present invention, based on the fourth aspect, when accompanying information of the object is included in the virtual reality image, the display control unit causes the accompanying information to be displayed on the display device in priority to the advertisement image.

[0017] (6) A sixth scheme of the present invention is based on any one of the first to fifth schemes, wherein the advertising image is an advertising image that grants the user a first coupon that can be used in the virtual world, and further comprises a first granting unit, and when the user performs a first action during the period of receiving the provision of the service or after the provision of the service is completed, the first granting unit grants the first coupon to the user.

[0018] (7) The seventh scheme of the present invention is based on any one of the first to fifth schemes, wherein the advertising image is an advertising image that grants the user a second coupon that can be used in the real world, and further comprises a second granting unit, and when the user performs a second action during the period of receiving the provision of the service or after the provision of the service is completed, the second granting unit grants the second coupon to the user.

[0019] (8) The eighth scheme of the present invention is a method for providing a virtual experience, which causes a computer to execute the following processing: providing a service that allows a user to have a virtual experience within a virtual reality image, wherein the virtual reality image is obtained based on a virtual world that virtually reproduces the real world or a fictional world; determining an advertising image to be included in the virtual reality image based on the attributes of the user who receives the service; generating the virtual reality image that includes the advertising image in a specified advertising display area; and displaying the virtual reality image on a display device.

[0020] (9) A ninth aspect of the present invention is a storage medium storing a program, wherein the program is used to cause a computer to execute the following processing: providing a service that enables a user to have a virtual experience within a virtual reality image, wherein the virtual reality image is obtained based on a virtual world that virtually reproduces the real world or a fictional world; determining an advertising image to be included in the virtual reality image based on the attributes of the user who receives the service; generating the virtual reality image that includes the advertising image in a specified advertising display area; and displaying the virtual reality image on a display device.

[0021] Effects of the Invention

[0022] According to the above aspect, regarding the target of advertisements, it is possible to increase the attraction of users who watch virtual reality images and have a virtual experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 It is a diagram showing an example of the configuration of the virtual experience providing system 1 according to the first embodiment.

[0024] Figure 2 2 is a perspective view showing the second moving body 210 .

[0025] Figure 3 This is a diagram showing an example of the content of the user list 352 .

[0026] Figure 4 This is a diagram showing an example of the content of advertisement list 354 .

[0027] Figure 5 This is a diagram showing a user P using the virtual experience facility 200 from a bird's-eye view.

[0028] Figure 6 1 is a diagram showing an example of the first virtual reality image GA1 displayed on the display device 232 .

[0029] Figure 7 1 is a diagram showing an example of a local image GA2 that is a basis for generating a first virtual reality image GA1.

[0030] Figure 8 This is a flowchart showing an example of processing of the virtual experience providing device 300 .

[0031] Fig. 9 This is a diagram showing an example of the configuration of a virtual experience providing device 300 according to the second embodiment.

[0032] Fig.10 This is a diagram showing an example of the content of advertisement list 354 in the second embodiment.

[0033] Fig.11 3 is a diagram showing an example of the content of the landscape importance point list 356 .

[0034] Fig.12 It is a diagram showing an example of the content of the accompanying information list 358 .

[0035] Fig.13 3 is a diagram showing an example of the content of the stop frequency list 360 .

[0036] Fig.14 This is a diagram showing an example of the content of the advertisement fee table 362 .

[0037] Fig.15 364 is a diagram showing an example of the content of the coupon list 364 .

[0038] Fig.16 1 is a flowchart showing an example of the process of the virtual experience providing device 300 according to the second embodiment before the user P takes the virtual travel experience.

[0039] Fig.17 1 is a flowchart showing an example of the process of the virtual experience providing device 300 according to the second embodiment when the user P is experiencing a virtual tour.

[0040] Description of reference numerals:

[0041] 1…Virtual experience provision system

[0042] 10…Moving body

[0043] 100… equipment

[0044] 110…communication device

[0045] 120…First moving body

[0046] 130…Camera

[0047] 210…Second moving body

[0048] 211…Matrix

[0049] 212…Control device

[0050] 213…Wheels

[0051] 214…Seating

[0052] 215…First support portion

[0053] 216 ... second supporting portion

[0054] 217…Operation Department

[0055] 217A…Operation parts

[0056] 218…Load sensor

[0057] 220…Driving space

[0058] 230… VR glasses (goggle)

[0059] 232…Display device

[0060] 240…Authentication device

[0061] 300…Virtual experience providing device

[0062] 310…Ministry of Communications

[0063] 320…Advertising Decision Department

[0064] 330…Image Generation Department

[0065] 340…Display control unit

[0066] 350…Storage

[0067] 352…User list

[0068] 354…Advertisement list

[0069] 356…List of landscape highlights

[0070] 358…Attached information list

[0071] 360...Frequency List

[0072] 362…Advertising Fee Schedule

[0073] 364…Coupon List

[0074] 410…Fee Setting Department

[0075] 420…First Endowment Section

[0076] 430…Second granting unit

[0077] 500…Advertising agent terminal

[0078] 600…Communication terminal device

[0079] GA1…the first virtual reality video

[0080] GA2…Local images

[0081] GB1…The first large-scale signboard image

[0082] GB3…The third largest signboard image

[0083] GC1…Advertising video

[0084] NW…Network

[0085] P…user. DETAILED DESCRIPTION

[0086] Hereinafter, embodiments of a virtual experience providing device, a virtual experience providing method, and a storage medium of the present invention will be described with reference to the accompanying drawings. A virtual experience providing system having a virtual experience providing device is, for example, a system that uses the virtual experience providing device to provide virtual experiences such as virtual travel experiences using virtual experience facilities. The virtual experience providing device provides a service for users to experience a virtual world that represents a real world or a fictional world. In the virtual experience providing system, virtual experiences other than virtual travel experiences, such as virtual experiences of a game world that is separated from reality, can be performed.

[0087] <First Embodiment>

[0088] Figure 1 1 is a diagram showing an example of the configuration of a virtual experience providing system 1 according to the first embodiment. The virtual experience providing system 1 includes, for example, travel destination equipment 100 installed at a travel destination, a virtual experience facility 200, and a virtual experience providing device 300. The virtual experience providing system 1 is used, for example, by a user P who takes a virtual trip to a certain travel destination. The virtual experience providing system 1 can communicate with a plurality of advertising client terminals 500 via a network NW.

[0089] Each device 100 at the travel destination includes a communication device 110, a first mobile body 120, and a camera 130. The virtual experience facility 200 includes, for example, a second mobile body 210, a travel space 220 in which the second mobile body 210 travels, a head-mounted display worn by a user P, such as VR (Virtual Reality) glasses 230, an authentication device 240, and a virtual experience providing device 300.

[0090] In the virtual experience facility 200, the user P riding on the second moving body 210 performs a virtual travel experience by wearing VR glasses 230 and traveling in the travel space 220. At the travel destination (local place) that is the object of the virtual travel experience, the first moving body 120 moves in coordination with the movement of the second moving body 210. The first moving body 120 is equipped with a camera 130, and the camera 130 captures images around the first moving body 120. In the virtual experience facility 200, the user P performs a virtual travel experience of traveling at the travel destination while watching virtual reality images. The user P receives the provision of services provided by the virtual experience providing device 300. The user P is an example of a user.

[0091] The virtual reality image viewed by the user P who is experiencing the virtual travel is generated based on the image of the real scenery (hereinafter referred to as the local image) captured by the camera 130 at the travel destination. In the virtual reality image, for example, a large sign is sometimes included when the first moving body 120 moves on the road. In the virtual reality image, an advertising image corresponding to the attribute of the user P is embedded in the large sign and displayed.

[0092] The virtual reality image of the first embodiment is an image of a virtual world obtained based on the real world. The virtual reality image may also be an image of a virtual world obtained based on a fictional world. The image representing the fictional world may be, for example, a fictional image generated by computer graphics or the like, or may be an image that is a mixture of fictional images and real images.

[0093] The advertisement to be included in the virtual reality image is, for example, an advertisement generated based on the advertisement commission information sent from the advertising commission terminal 500. When the virtual reality image displays the advertisement image, the advertising commission that manages the advertising commission terminal 500 pays the advertising fee in response to the request of the manager of the virtual experience providing device 300.

[0094] The communication device 110 is, for example, a wireless communication module for connecting to a network or directly communicating with other terminal devices such as the virtual experience providing device 300 of the virtual experience facility 200. The communication device 110 performs wireless communication based on Wi-Fi, DSRC (Dedicated Short Range Communications), Bluetooth (registered trademark), or other communication standards. The communication device 110 can communicate with the virtual experience facility 200 via the network NW.

[0095] The first moving body 120 is, for example, a small moving body that can travel on a street. The first moving body 120 moves in the same manner as the first moving body 120 based on the travel control information transmitted by the communication device 110. In the street, when the first moving body 120 becomes unable to move or difficult to move, automatic travel control is performed in a manner that avoids the current situation and becomes movable.

[0096] The camera 130 is mounted on the first mobile body 120. The camera 130 captures a local image of the travel destination. The camera 130 outputs the captured local image to the communication device 110. The communication device 110 transmits the output local image to the virtual experience facility 200. In the first embodiment, the camera 130 is mounted on the first mobile body 120, but it may be provided in a manner other than being mounted on the first mobile body 120. For example, it may be mounted on a drone flying near the first mobile body 120.

[0097] When using the virtual experience facility 200, the user P is authenticated by the authentication device 240 when entering the virtual experience facility 200. Then, the user P wears the VR glasses 230, rides on the second moving body 210, and moves in the driving space 220. The VR glasses 230 are provided with a display device 232 that projects an image that the user P can visually recognize.

[0098] The control device of the second mobile body 210 transmits boarding information to the virtual experience providing apparatus 300 when the user P boards the second mobile body 210. The control device transmits movement information corresponding to the movement of the second mobile body 210 to the virtual experience providing apparatus 300. For example, the control device transmits movement start information to the virtual experience providing apparatus 300 when the second mobile body 210 starts moving. In addition, when the second mobile body 210 that is moving stops, the control device transmits stop information to the virtual experience providing apparatus 300.

[0099] Figure 2 2 is a perspective view showing the second moving body 210. Hereinafter, the front-rear direction of the second moving body 210 is referred to as the X direction, the lateral direction is referred to as the Y direction, and the direction orthogonal to the X direction and the Y direction is referred to as the Z direction. The second moving body 210 is a moving body that the user P can ride in the virtual experience facility 200. The second moving body 210 travels in the travel space 220 according to the operation of the user P.

[0100] The second mobile body 210 includes, for example, a base body 211. A control device 212 is housed inside the base body 211. The control device 212 controls the travel direction and travel speed of the second mobile body 210. In addition to the control device 212, a motor, a battery, etc. are housed inside the base body 211. Wheels 213 are respectively assembled on the left and right sides of the base body 211.

[0101] A seat portion 214 is provided on the upper portion of the base 211. The seat portion 214 is in the shape of a cushion for a passenger to sit on. The upper surface of the seat portion 214 is a seat surface that supports the buttocks of the passenger from below. The seat portion 214 is supported by the base 211. The seat portion 214 is supported by the base 211, a first support portion 215 disposed in front of the base 211, and a second support portion 216 disposed in the rear of the base 211. The first support portion 215 and the second support portion 216 support the seat portion 214 so that it can be raised and lowered.

[0102] An operating unit 217 is provided on the side of the seat portion 214. The operating unit 217 includes an operating member 217A for the operator to control the movement of the second mobile body 210. For example, the operating member 217A is an operating member for controlling the travel direction, travel speed, braking action, etc. of the second mobile body 210. The operating unit 217 transmits an operation signal corresponding to the operation of the operating member 217A to the control device 212. The passenger such as the user P can make the second mobile body 210 travel by operating the operating member 217A.

[0103] A load sensor 218 is provided inside the seat portion 214. The load sensor 218 detects the position where the passenger applies weight on the seat portion 214. For example, when the passenger leans forward, the load of the passenger is detected in front of the seat portion 214. The load sensor 218 sends a load signal corresponding to the detected load to the control device 212. The control device 212 drives the second mobile body 210 based on the direction in which the load of the passenger is detected by the load sensor 218. In this way, the passenger can drive (move) the second mobile body 210 regardless of operating the operating member 217A or applying a load in the direction in which the passenger wants to move. The control device 212 controls the driving of the second mobile body 210 based on the operating signal sent by the operating portion 217 and the load signal sent by the load sensor 218.

[0104] The second mobile body 210 of the embodiment is a so-called hands-free second mobile body 210 that can be operated by the weight shift of the rider, and can be operated by the rider operating the operating unit 217, but the operating unit 217 may not be provided. In addition, the second mobile body 210 may also be a straddle-type mobile body that the rider straddles. In addition, the second mobile body 210 may also be a mobile body that the operator rides on the pedals in a standing state. In addition, the second mobile body 210 may also be moved by walking based on the legs instead of wheels.

[0105] The travel space 220 is a space having a size that allows the second mobile body 210 to move, for example, a space having a size of several meters by several meters in bottom area. The travel space 220 is provided in an appropriate place such as a building.

[0106] The VR glasses 230 are images obtained based on the local images transmitted by the communication device 110, and project virtual reality images that remind the user P of a virtual space. The VR glasses 230 include a display device 232 that displays virtual reality images, and a wearing unit that is attached to the head of the user P so that the user P can visually recognize the display device 232, so that the user P wears the VR glasses 230. Instead of the VR glasses 230, MR (Mixed Reality) glasses or AR (Augmented Reality) glasses may be used.

[0107] The authentication device 240 is installed at the entrance of the virtual experience facility 200, for example. The authentication device 240 authenticates the user P using an authentication card held by the user P. When authenticating the user P, the authentication device 240 transmits authentication information to the virtual experience providing device 300. The authentication information includes the ID number of the user P.

[0108] The virtual experience providing device 300 projects images corresponding to the travel of the second moving body 210 on the VR glasses 230. The user P wearing the VR glasses 230 experiences a virtual travel to the travel destination where the first moving body 120 moves through the images projected on the VR glasses 230 and the movement of the second moving body 210.

[0109] The virtual experience providing device 300 includes, for example, a communication unit 310, an advertisement determination unit 320, an image generation unit 330, a display control unit 340, and a storage unit 350. The advertisement determination unit 320, the image generation unit 330, and the display control unit 340 are implemented by, for example, a processor such as a CPU (Central Processing Unit) as hardware executing a program (software). Part or all of the image generation unit 330 and the display control unit 340 may be implemented by hardware (including a circuit unit; circuitry) such as LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), GPU (Graphics Processing Unit), or by the cooperation of software and hardware. The program may be stored in advance in a storage device (a storage device having a non-transitory storage medium) such as an HDD (Hard Disk Drive) or a flash memory, or may be stored in a removable storage medium (a non-transitory storage medium) such as a DVD or CD-ROM and installed in the storage device by mounting the storage medium in a drive device. The storage device is implemented by a HDD (Hard Disc Drive), a DVD, a RAM (Random Access Memory), a flash memory, etc. The storage unit 350 is implemented by the above-mentioned storage device. The storage unit 350 stores a user list 352 including attributes of the user P and the like who use the virtual experience facility 200 and an advertisement list 354 corresponding to the attributes of the user.

[0110] The communication unit 310 is, for example, a wireless communication module for connecting to a network or directly communicating with other terminal devices such as the communication device 110 of each device 100 at the travel destination, the advertising agent terminal 500, etc. The communication unit 310 performs wireless communication based on Wi-Fi, DSRC, Bluetooth (registered trademark), or other communication standards.

[0111] The communication unit 310 receives the local image transmitted by the communication device 110. The communication unit 310 outputs the received local image to the image generation unit 330. The communication unit 310 receives the movement information transmitted by the control device 212. The communication unit 310 outputs the received movement information to the image generation unit 330. The communication unit 310 receives the authentication information transmitted by the authentication device 240. The communication unit 310 outputs the received authentication information to the advertisement determination unit 320.

[0112] The advertisement determination unit 320 refers to the ID number included in the authentication information sent by the communication unit 310 with the user list 352 to determine the attribute of the user P. The advertisement determination unit 320 is an example of a determination unit. The attributes include items such as gender, age, place of residence, occupation, and hobbies. Here, the user list 352 and the advertisement list 354 are described.

[0113] Figure 3 35 is a diagram showing an example of the content of the user list 352. The user list 352 shows the attributes of the user corresponding to the user ID number. For example, the attributes of the user with ID number TR001 include gender male, age 53 years old, residence in Tokyo, occupation company employee, and interest in watching sports games.

[0114] Figure 4 3 is a diagram showing an example of the content of the advertisement list 354. The advertisement list 354 includes multiple lists divided by gender, age, and residential area. In each list, an association is established with the content of the advertisement corresponding to the occupation and interest. For example, when the user's gender is male, the age group is 10 to 19 years old, the place of residence is Tokyo, the occupation is a company employee, and the interest is watching sports games, the determined advertisement image is an image of ○○ sports. The provided advertisement image can be either a moving image or a still image.

[0115] The advertisement images included in the advertisement list 354 are advertisement images generated based on the advertisement entrustment information sent by the advertisement entrusting agency terminal 500. The advertisement images are, for example, advertisements promoting the advertisement entrusting agency. The advertisement determination unit 320 refers to the determined attribute of the user P with reference to the advertisement list 354, and determines the advertisement images included in the virtual reality image. The advertisement determination unit 320 notifies the image generation unit 330 of the advertisement images included in the determined virtual reality image.

[0116] The advertisement determination unit 320 further performs image processing on the local image, and searches for an area that becomes an advertisement display area, such as a large signboard with a poster or the like. When the advertisement determination unit 320 finds a large signboard in the local image, it notifies the image generation unit 330 of the search information. The advertisement display area can be an area with a certain area, and can also be an area other than a large signboard. For example, the advertisement display area can also be a medium or small signboard, billboard, monitor, etc. that is recognized within the range of the user P who is experiencing the virtual travel.

[0117] When the communication unit 310 outputs the movement start information, the image generation unit 330 generates a virtual reality image to be displayed on the display device 232 of the VR glasses 230. The image generation unit 330 generates the virtual reality image based on the local image output by the communication unit 310, the movement information output by the control device 212, and the advertisement image information notified by the advertisement determination unit 320.

[0118] The image generation unit 330 generates a virtual reality image based on the local image output by the communication unit 310 at the timing when the control device of the second mobile body 210 transmits the movement start information. The image generation unit 330 calculates the position of the user P in the virtual reality image based on the movement information transmitted by the control device of the second mobile body 210. For example, when a movement signal that the second mobile body 210 moves forward is transmitted, the image generation unit 330 generates a virtual reality image that the user P sees when moving forward in the virtual reality image. The user P can have a virtual experience of traveling in the scenery projected in the virtual reality image by moving the second mobile body 210 while viewing the virtual reality image.

[0119] When the search information is notified by the advertisement determination unit 320, the image generation unit 330 generates a virtual reality image by embedding the advertisement image obtained based on the advertisement image information notified by the advertisement determination unit 320 on the large sign. The image generation unit 330 notifies the display control unit 340 of the information of the generated virtual reality image.

[0120] The display control unit 340 causes the display device 232 to display a virtual reality image obtained based on the information of the virtual reality image notified by the image generation unit 330. The user P visually recognizes the virtual reality image displayed on the display device 232.

[0121] Next, the procedure for using the virtual experience facility 200 will be described. In the virtual experience facility 200, the user P wears the VR glasses 230 before entering the travel space 220. The VR glasses 230 project a virtual image, and the user P experiences a virtual travel by passing through a virtual door and moving to a desired destination.

[0122] Next, a virtual tunnel is projected on the VR glasses 230. The user P experiences a virtual experience of becoming smaller while passing through the virtual tunnel. After the virtual experience of passing through the virtual tunnel, the user P moves to the driving space 220 and rides on the second moving body 210. The user P rides on the second moving body 210 in the driving space 220 and drives the second moving body 210 while watching the image projected on the VR glasses 230, thereby experiencing a virtual travel experience of becoming a small person and traveling to the destination.

[0123] Figure 5This is a diagram showing a bird's-eye view of a user P using a virtual experience facility 200. The user P wears VR glasses 230 in a travel space 220 and operates an operating element of a second mobile body 210 or leans on a seat in a desired direction to move, thereby moving the second mobile body 210. In the virtual experience facility 200, a virtual travel experience can be performed while the second mobile body 210 moves.

[0124] For example, when the user P applies a load forward on the seat portion, the second moving body 210 moves straight. At this time, an image of the user P facing forward is projected in the VR glasses 230. The image shows the scenery of the destination of the virtual trip and a part of the user P himself. The second moving body 210 travels in the travel space 220 by the action of the user P, but when it is about to hit a wall in the travel space 220, the second moving body 210 guides and corrects the trajectory of the second moving body 210 within a range that the user P does not notice.

[0125] Figure 6 1 is a diagram showing an example of a first virtual reality image GA1 projected on the display device 232. The user P riding on the second moving body 210 takes a virtual travel experience while watching the image projected on the display device 232. The first virtual reality image GA1 displayed on the display device 232 is an image generated based on an image of the scenery of the travel destination captured by the camera 130.

[0126] Figure 7 1 is a diagram showing an example of a local image GA2 that is a basis for generating the first virtual reality image GA1. The content of the first virtual reality image GA1 changes depending on whether or not a large sign is included. The local image GA2 includes images of first to third large sign images GB1 to GB3 as images of large signboards. In the first virtual reality image GA1 in this case, an advertising image GC1 generated by the image generation unit 330 is embedded in an area where a poster or the like is attached in each of the first to third large sign images GB1 to GB3. The first to third large sign images GB1 to GB3 are each embedded with the advertising image GC1 to generate the first virtual reality image GA1. Figure 6 The first virtual reality image GA1 shown in FIG. 1 and the third large-scale signboard image GB1 to GB3 may be the same or different.

[0127] Next, the processing in the virtual experience providing device 300 is described. Figure 8 2 is a flowchart showing an example of the processing of the virtual experience providing device 300. The virtual experience providing device 300 first determines whether the authentication information transmitted by the authentication device 240 is received in the advertisement determination unit 320 (step S101).

[0128] If it is determined that the authentication information has not been received, the virtual experience providing device 300 repeats the process of step S101 until the authentication information is received. If it is determined that the authentication information is received, the advertisement determination unit 320 confirms the ID number of the user P who uses the virtual experience facility 200 based on the authentication information, and starts the virtual travel experience in the virtual experience facility 200 (step S103).

[0129] Next, the image generation unit 330 determines whether the local image transmitted by the communication device 110 of each device 100 at the travel destination and received by the communication unit 310 is received (step S105). If it is determined that the local image is not received, the image generation unit 330 advances the process to step S117. The image generation unit 330 may generate a virtual reality image in another process if a certain period of time has passed without receiving the local image.

[0130] When it is determined that the local image is received, the image generation unit 330 determines whether the local image is an image including a large sign (step S107). When it is determined that the local image is not an image including a large sign, the image generation unit 330 advances the process to step S117. When a certain time has passed since it was determined that the local image is not an image including a large sign, an advertisement display area including an advertisement image may be set in the local image in another process. The advertisement display area may be set, for example, to an area where pixel information changes less, that is, an area where information changes less during display and an area with a large area.

[0131] When the image generation unit 330 determines that the local image is an image including a large sign, the advertisement determination unit 320 refers to the ID number obtained by confirming the authentication information received by the communication unit 310 with the user list 352 stored in the storage unit 350 to determine the attribute of the user P (step S109). Next, the advertisement determination unit 320 determines an advertisement image that is included in the virtual reality image (embedded in a large sign) based on the determined attribute of the user P and the advertisement list 354 stored in the storage unit 350 (step S111). The advertisement determination unit 320 notifies the image generation unit 330 of the advertisement image information obtained based on the determined advertisement image.

[0132] Next, the image generation unit 330 generates a virtual reality image based on the advertisement image notified by the advertisement determination unit 320 and the local image notified by the communication unit 310 (step S113). Here, the image generation unit 330 generates a virtual reality image by embedding the advertisement image in a large sign included in the local image.

[0133] The image generation unit 330 notifies the display control unit 340 of the information of the generated virtual reality image. Next, the display control unit 340 displays the virtual reality image notified by the image generation unit 330 on the display device 232 provided in the VR glasses 230 (step S115). Next, the virtual experience providing device 300 determines whether the user P has ended the virtual experience trip, for example, by getting off the moving body 10 (step S117).

[0134] If it is determined that the user P does not end (but continues) the virtual travel experience, the virtual experience providing device 300 returns the process to step S105 to allow the user P to continue the virtual travel experience. If it is determined that the user P ends the virtual travel experience, the virtual experience providing device 300 directly ends the virtual travel experience. Figure 8 Processing shown.

[0135] The virtual experience providing apparatus 300 of the first embodiment allows the user P who receives the service of the virtual experience providing apparatus 300 to experience a virtual travel while viewing a virtual reality image in which a determined advertisement image is embedded in a predetermined advertisement display area. Therefore, the user P who is experiencing the virtual travel experiences the virtual travel while viewing the advertisement image included in the scenery. Therefore, the sense of disharmony caused by the displayed advertisement is reduced, so that the attraction to users who are experiencing the virtual travel while viewing the virtual reality image can be improved.

[0136] <Second Embodiment>

[0137] Next, a second embodiment will be described. Fig. 9 1 is a diagram showing an example of the configuration of the virtual experience providing device 300 according to the second embodiment. The virtual experience providing device 300 according to the second embodiment includes, for example, a fee setting unit 410, a first granting unit 420, and a second granting unit 430 in addition to the communication unit 310, the advertisement determination unit 320, the image generation unit 330, and the display control unit 340. The fee setting unit 410, the first granting unit 420, and the second granting unit 430 are implemented, for example, by a processor such as a CPU executing a program together with the advertisement determination unit 320, the image generation unit 330, and the display control unit 340. The advertisement determination unit 320, the image generation unit 330, the display control unit 340, the fee setting unit 410, the first granting unit 420, and the second granting unit 430 may also be implemented by the LSI or the like shown in the first embodiment.

[0138] The virtual experience providing device 300 of the second embodiment can also communicate with a communication terminal device 600 held by the experiencer via the network NW. The communication terminal device 600 is, for example, a portable terminal such as a smartphone or a tablet held by the user P. In the communication terminal device 600, an application or a browser for using the service provided by the virtual experience providing system 1 is started to support the service provided by the virtual experience providing system 1.

[0139] In addition to the processing shown in the first embodiment, the advertisement determination unit 320 in the virtual experience providing device 300 determines the location where the first moving body 120 moves based on the local image output by the communication unit 310. The camera 130 in each device 100 at the travel destination is equipped with a GNSS (Global Navigation Satellite System) device for detecting the location of the camera 130.

[0140] When transmitting the local image captured by the camera 130, the communication device 110 attaches the location information of the location detected by the GNSS device to the local image and transmits it to the virtual experience providing device 300. The communication unit 310 determines the place where the local image is captured based on the location information transmitted together with the local image. The place where the local image is captured is the place where the advertisement image is displayed in the virtual reality image (hereinafter referred to as the advertisement display place), so in the following description, the place where the local image is captured is described as the advertisement display place. The advertisement display place can also be pre-set based on the plan of the virtual travel experience, etc.

[0141] The advertisement determination unit 320 refers to the determined attributes of the user P and the advertisement display location determined based on the location information to the advertisement list 354 stored in the storage unit 350, and determines the advertisement image included in the virtual reality image based on the attributes of the user P and the advertisement display location. The advertisement list 354 in the second embodiment is different from the advertisement user list in the first embodiment. The advertisement list 354 in the second embodiment is described below.

[0142] Fig.10 2 is a diagram showing an example of the content of the advertisement list 354 in the second embodiment. The advertisement list 354 is a list in which a plurality of lists classified by gender, generation, and residential area are put together for each advertisement display location. Fig.10 In the example shown, for example, lists are created for advertisement display locations such as "Tokyo", "Kyoto", and "New York". For example, when the advertisement display location is Kyoto, the advertisement image is determined by referring to the list of Kyoto. The advertisement display locations are divided by region, but may be divided by other than region, for example, by separate visited places such as parks and buildings.

[0143] The storage unit 350 stores, in addition to the user list 352 and the advertisement list 354, a landscape importance point list 356, an attached information list 358, a stop frequency list 360, an advertisement fee table 362, and a coupon list 364. Here, the landscape importance point list 356, the attached information list 358, the stop frequency list 360, the advertisement fee table 362, and the coupon list 364 are described.

[0144] Fig.11 3 is a diagram showing an example of the contents of the scenic spot list 356. The scenic spot list 356 includes, for example, points (places) that are designated in advance as having excellent scenery. The scenic spot list 356 includes, for example, gardens, mountains (natural objects), parks, and the like.

[0145] Fig.12 35 is a diagram showing an example of the contents of the attached information list 358. The attached information list 358 includes, for example, a facility having attached information and attached information attached to the facility. For example, when the facility is ○○ Tower, the attached information is the entrance fee of ○○ Tower. Also, for example, when the facility is ○○ Museum, the attached information is the exhibit content of ○○ Museum. The attached information is, for example, information displayed on a large sign included in the local image. A facility is an example of an advertisement. An advertisement may also be an object other than a facility, such as real estate such as a park, natural objects such as a river or a mountain, services such as laundry, etc.

[0146] Fig.13 3 is a diagram showing an example of the content of the stop frequency list 360. The stop frequency list 360 includes places where the frequency of stop by general travelers is high (high frequency) and places where the frequency is medium (medium frequency). For example, the stop frequency list 360 includes ○○ Park, ○○ Tower, etc. as the places with high frequency, and XX Park, XX Public Hall, etc. as the places with medium frequency.

[0147] Fig.14 This is a table showing an example of an advertising fee table 362. The advertising fee table 362 is created for each advertising client. The advertising fee table shows the amount of money that the administrator of the virtual experience providing device 300 charges the advertising client when the advertising image is displayed. The amount of money charged changes according to the frequency of visitors to the place where the advertising image is displayed in the virtual reality image, and the higher the frequency of visitors, the higher the amount of money charged.

[0148] For example, when the advertising client is Company A, the amount charged when the advertising image is displayed in a place with a high stop frequency in the virtual reality image (hereinafter referred to as a high-frequency stop location) is 5 yen. In addition, the amount charged when the advertising image is displayed in a place with a medium stop frequency in the virtual reality image (hereinafter referred to as a medium-frequency stop location) is 4 yen. The amount charged when the advertising image is displayed in a place with a low stop frequency in the virtual reality image (a place other than a high-frequency stop location and a medium-frequency stop location, hereinafter referred to as a low-frequency stop location) is 2 yen. The advertising fee table 362 is prepared for each advertising client.

[0149] Fig.15 364. The coupon list 364 includes information about a coupon distribution target to which the coupon is distributed and a first coupon and a second coupon of the coupon distributed as the coupon distribution target. The first coupon is a coupon that can be used in a virtual reality image. The second coupon is a coupon that can be used in the real world.

[0150] In addition to the processing shown in the first embodiment, the display control unit 340 excludes the scenic spot included in the virtual reality image from the place where the advertisement image is displayed when the virtual reality image is an image representing the real world. For example, the display control unit 340 refers to the position information added to the local image with reference to the prescribed map information to identify the object, and the identified object corresponds to the scenic spot, and determines whether the virtual reality image includes the scenic spot. When the virtual reality image includes the scenic spot, the display control unit 340 excludes the scenic spot from the place where the advertisement image is displayed.

[0151] The display control unit 340 also causes the accompanying information to be displayed on the display device 232 in priority to the advertisement image when the facility having the accompanying information is included in the virtual reality image. For example, the display control unit 340 refers to the location information added to the local image with reference to the prescribed map information to identify the facility, and refers to the identified facility with reference to the accompanying information list 358 to determine whether the virtual reality image includes the facility having the accompanying information. The display control unit 340 refers to the accompanying information list 358 to identify the accompanying information, but may also identify the accompanying information by reading characters displayed on a large signboard or the like included in the local image.

[0152] When the virtual reality image includes a facility having accompanying information, the display control unit 340 does not replace the accompanying information included in the virtual reality image with the advertisement image, and displays the accompanying information on the display device 232 in priority to the advertisement image. When the virtual reality image includes a facility having accompanying information, the display control unit 340 may display the accompanying information instead, and the image generation unit 330 may generate a virtual reality image including the accompanying information.

[0153] When generating an advertising image based on the advertising commission information sent from the advertising commission terminal 500, the fee setting unit 410 sets the advertising fee charged to the advertising commission when displaying the advertising image. The fee setting unit 410 adjusts the advertising fee based on the frequency of stopping in the virtual reality image, and sets the advertising fee higher as the stopping frequency is higher. The fee setting unit 410 creates an advertising fee table 362 based on the set advertising fee and stores it in the storage unit 350. The setting of the advertising fee and the creation of the advertising fee table 362 are performed, for example, before the user P performs a virtual travel experience.

[0154] When the user P is experiencing a virtual travel, the fee setting unit 410 refers to the location information attached to the local image with the prescribed map information to determine the advertisement display location in the virtual reality image when the local image is transmitted. The fee setting unit 410 refers to the determined advertisement display location with the stop frequency list 360 to determine the stop frequency of the advertisement display location. The fee setting unit 410 calculates the advertisement fee based on the determined stop frequency, and after the user P ends the virtual travel experience, generates the advertisement fee information and transmits it to the advertising agent terminal 500.

[0155] When the user P performs the first action displayed in the coupon giving advertisement video, the first giving unit 420 gives the first coupon to the user P. The coupon giving advertisement video is an advertisement video notifying that the first coupon or the second coupon is given to the user when the user P performs the first action or the second action.

[0156] For example, if the advertisement video asks “please stay at ○○ Tower”, the first action is to stay at ○○ Tower in the virtual reality video. For example, the first granting unit 420 grants the first coupon to the user P in the virtual travel experience while the user P is experiencing the virtual travel experience.

[0157] When the user P performs the second action displayed in the advertisement video, the second granting unit 430 grants the second coupon to the user P. For example, when the advertisement video issues a request "Please review ○○ store", the second action is to review ○○ store in the virtual reality image or after the virtual travel experience is completed.

[0158] The second granting unit 430, for example, grants the second coupon to the user P by sending information about the second coupon to the communication terminal device 600 during or after the user P has completed the virtual travel experience. The first action and the second action may not be actions related to the content (requirement) displayed in the advertising video, and may be actions that are prompted to the user in advance before experiencing the virtual travel experience.

[0159] Next, the processing of the virtual experience providing device 300 according to the second embodiment will be described. First, as the processing of the virtual experience providing device 300 according to the second embodiment, the processing before the user P performs the virtual travel experience will be described. Fig.16 1 is a flowchart showing an example of the process of the virtual experience providing device 300 according to the second embodiment before the user P takes the virtual travel experience.

[0160] The virtual experience providing apparatus 300 first determines whether the fee setting unit 410 has received the advertising commission information sent by the advertising commissioning agency terminal 500 (step S201). If it is determined that the fee setting unit 410 has not received the advertising commission information, the virtual experience providing apparatus 300 directly ends the process. Fig.16 Processing shown.

[0161] When the fee setting unit 410 determines that the advertisement request information has been received, Fig.13 The advertisement fee is set based on the stop frequency list 360 shown (step S203). Next, the fee setting unit 410 updates the advertisement fee table 362 stored in the storage unit 350 based on the set advertisement fee (step S205).

[0162] Next, the fee setting unit 410 sends the portion of the advertising fee table 362 corresponding to the set advertising fee to the advertising agent terminal 500 (step S207). Fig.16 Processing shown.

[0163] Next, the processing of the virtual experience providing device 300 according to the second embodiment when the user P is experiencing a virtual tour will be described. Fig.17 1 is a flowchart showing an example of the processing of the virtual experience providing device 300 of the second embodiment when the user P is experiencing a virtual travel. The virtual experience providing device 300 first determines whether the authentication information sent by the authentication device 240 is received in the advertisement determination unit 320 (step S101) in the same way as the virtual experience providing device 300 of the first embodiment, and repeats the processing of step S101 until the authentication information is received, and then proceeds to step S105. Thereafter, until step S109, the same processing as in step S108 is performed. Figure 8 The same processing is performed as the virtual experience providing apparatus 300 of the first embodiment shown.

[0164] After the virtual experience providing device 300 determines the attribute of the user P (step S109), the advertisement determination unit 320 determines the advertisement display location (step S301). Next, the advertisement determination unit 320 refers to the landscape importance point list 356 to determine whether the advertisement display location is a landscape importance point (step S303). If it is determined that the advertisement display location is a landscape importance point, the advertisement determination unit 320 determines not to display the advertisement image at the advertisement display location, and advances the process to step S313.

[0165] If it is determined that the advertisement display location is not a scenic spot, the advertisement determination unit 320 determines whether the local image includes a large sign (step S307). If it is determined that the local image does not include a large sign, the advertisement determination unit 320 determines not to display the advertisement image and advances the process to step S313.

[0166] When it is determined that the local image includes a large sign, the advertisement determination unit 320 refers to the advertisement list 354 based on the attributes of the user P and the advertisement display location, and determines the advertisement image to be displayed in the advertisement display area (step S309). Next, the fee setting unit 410 determines the dwelling frequency of the advertisement display location where the advertisement image is displayed, and refers to the determined dwelling frequency in the advertisement fee table 362 to calculate the advertisement fee (step S311).

[0167] Next, the image generation unit 330 generates a virtual reality image based on the advertisement image notified by the advertisement determination unit 320 and the local image notified by the communication unit 310 (step S313). Here, the image generation unit 330 generates a virtual reality image by embedding the advertisement image in a large sign included in the local image.

[0168] Next, the display control unit 340 determines whether the large sign included in the local image contains the accompanying information of the facility (step S315). When it is determined that the large sign contains the accompanying information, the display control unit 340 gives priority to the accompanying information over the advertising image (step S317). In this case, the display control unit 340 displays the virtual reality image on the display device 232 in a manner that does not display the advertising image but displays the accompanying information in the advertising display area (step S319). When it is determined that the large sign does not contain the accompanying information, the display control unit 340 skips step S317 and displays the virtual reality image that displays the advertising image in the advertising display area on the display device 232 (step S319).

[0169] Next, the first granting unit 420 and the second granting unit 430 determine whether the advertising image is a coupon granting advertising image (step S321). If it is determined that the advertising image is not a coupon granting advertising image, the virtual experience providing device 300 advances the process to step S325. If it is determined that the advertising image is a coupon granting advertising image, the first granting unit 420 determines whether the user P has performed the first action (step S323).

[0170] If it is determined that the user P has performed the first action, the first granting unit 420 grants the first coupon to the user P (step S325). If it is determined that the user P has not performed the first action, the first granting unit 420 directly advances the process to step S117. Next, the second granting unit 430 determines whether the user P has performed the second action (step S327).

[0171] If it is determined that the user P has performed the second action, the second granting unit 430 grants the second coupon to the user P (step S329). If it is determined that the user P has not performed the second action, the second granting unit 430 directly advances the process to step S117. Next, the virtual experience providing device 300 determines whether the user P has ended the virtual travel experience (step 327). If it is determined that the user P has not ended the virtual travel experience, the virtual experience providing device 300 and the user P are notified. Figure 8 Similarly to the first embodiment shown, the process returns to step S105 to allow the user P to continue the virtual travel experience.

[0172] When it is determined that the user P has ended the virtual travel experience, the fee setting unit 410 generates advertising fee information based on the advertisement displayed on the display device 232 during the virtual travel experience and sends it to the advertising agent terminal 500 (step S329). Fig.17 Processing shown.

[0173] The virtual experience providing device 300 of the second embodiment has the same effect as the virtual experience providing device 300 of the first embodiment. The virtual experience providing device 300 of the second embodiment also sets the advertising fee according to the stop frequency when charging the advertising commissioner. Therefore, it is easy to make the advertising fee consistent with the advertising effect.

[0174] In addition, the virtual experience providing device 300 of the second embodiment excludes the landscape emphasis point from the area where the advertisement image is displayed. Therefore, the advertisement image in the area where the proportion of landscape appreciation is high is omitted, so the user P can fully appreciate the landscape, and the user P can be less annoyed by the advertisement image.

[0175] Furthermore, when the accompanying information of a facility is included in the virtual reality image, the virtual experience providing device 300 of the second embodiment displays the accompanying information on the display device 232 prior to the advertisement image. Therefore, important information can be easily conveyed to the user without missing it when experiencing a virtual tour.

[0176] In each of the above-mentioned embodiments, the advertising image is displayed regardless of the conditions when the user P uses the virtual experience facility 200, but the advertising image may not be displayed during the virtual experience when a predetermined condition is satisfied. For example, the advertising image may not be displayed by making the use fee when using the virtual experience facility 200 expensive. Alternatively, for example, when the virtual experience providing device 300 provides a virtual experience of a game, when the user P can receive the recorded data for a fee or free of charge, the advertising image may not be displayed by the user P receiving the recorded data for a fee.

[0177] In the above-mentioned embodiments, the case of providing a virtual travel experience in the virtual experience facility 200 is described, but for example, a virtual reality image may be created when providing a so-called role-playing game using the virtual experience facility 200. In the virtual reality image, the advertisement display area may be arbitrarily set, for example, the image of a sign may be produced at an arbitrary position.

[0178] Although specific embodiments of the present invention have been described above using the embodiments, the present invention is not limited to such embodiments at all, and various modifications and substitutions can be made without departing from the gist of the present invention.

Claims

1. A virtual experience providing device that provides a user with a service that allows a user to have a virtual experience in a virtual reality image, wherein the virtual reality image is obtained based on a virtual world that virtually reproduces a real world or a fictional world, wherein: The virtual experience providing device comprises: a determination unit that determines an advertisement image to be included in the virtual reality image based on an attribute of the user who receives provision of the service; an image generating unit configured to generate the virtual reality image including the advertisement image in a predetermined advertisement display area; A display control unit that causes the virtual reality image to be displayed on a display device; as well as A second granting unit grants, when the user performs a second action, a second coupon usable in the real world to the user.

2. The virtual experience providing device according to claim 1, wherein: further comprising a fee setting unit for setting an advertisement fee for displaying the advertisement image, The fee setting unit adjusts the advertising fee based on a user's stop frequency within the virtual reality image, and sets the advertising fee to be higher as the stop frequency is higher.

3. The virtual experience providing device according to claim 2, wherein: The virtual reality image is an image that virtually reproduces the real world. The display control unit excludes, in the virtual reality image, an area overlapping with the scenery focus point in the real world from an area where the advertisement image is displayed.

4. The virtual experience providing device according to any one of claims 1 to 3, wherein: The determination unit further determines the advertisement image based on an advertisement display location which is a location where the advertisement image is displayed.

5. The virtual experience providing device according to claim 4, wherein: The display control unit causes the display device to display the accompanying information on a priority basis over the advertisement image, when the accompanying information of the object is included in the virtual reality image.

6. The virtual experience providing device according to any one of claims 1 to 3, wherein: The advertising video is an advertising video that provides the user with a first coupon usable in the virtual world, The system further includes a first granting unit configured to grant the first coupon to the user when the user performs a first action while receiving provision of the service or after provision of the service is completed.

7. The virtual experience providing device according to any one of claims 1 to 3, wherein: The advertising image is an advertising image for providing the second coupon to the user, The second granting unit grants the second coupon to the user when the user performs the second action while receiving provision of the service or after provision of the service is completed.

8. A method for providing a virtual experience, wherein: The virtual experience providing method enables a computer to perform the following processing: Providing users with services that allow them to have a virtual experience in a virtual reality image, wherein the virtual reality image is obtained based on a virtual world that virtually reproduces the real world or a fictional world; determining an advertisement image to be included in the virtual reality image based on the attributes of the user receiving the provision of the service; generating the virtual reality image including the advertisement image in a predetermined advertisement display area; Displaying the virtual reality image on a display device; as well as When the user performs a second action, a second coupon usable in the real world is given to the user.

9. A storage medium storing a program, wherein: The program is used to cause the computer to execute the following processing: Providing users with services that allow them to have a virtual experience in a virtual reality image, wherein the virtual reality image is obtained based on a virtual world that virtually reproduces the real world or a fictional world; determining an advertisement image to be included in the virtual reality image based on the attributes of the user receiving the provision of the service; generating the virtual reality image including the advertisement image in a predetermined advertisement display area; Displaying the virtual reality image on a display device; as well as When the user performs a second action, a second coupon usable in the real world is given to the user.

Images