Event providing program, event providing system and event providing method

Abstract

To enable holding an event using augmented reality and to enable performing product sales or service provision in the event.SOLUTION: An event providing program causes a server to implement: an object display function to superimpose a first object being a virtual object on a real space and display it on a display device; an expression control function to control an expression which uses one or more virtual objects including the first object; and an authority acquiring information display function to display information for allowing a user to acquire predetermined authority (authority acquiring information) for the object, the event, or a commodity or a service related to the expression, on the display device.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] At least one embodiment of the present invention relates to an event provision program, an event provision system, and an event provision method. [Background technology]

[0002] US Patent No. 5,999,943 describes a method for using augmented reality with a live event. The method includes a computerized device receiving a data stream corresponding to the live event. The data stream includes live video. The live video includes live objects. The method includes a computerized device receiving input from a user. The input from the user affects the behavior of the virtual objects. The method includes a computerized device presenting the live event augmented with the virtual objects. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Special Publication No. 2014-517566 Summary of the Invention [Problem to be solved by the invention]

[0004] By the way, if an event is held by displaying artists in a live music concert or actors in a stage play as characters or objects superimposed on the real space (AR display), the live event itself can be held in a space extended using augmented reality (hereinafter, "extended space"). Furthermore, if products or services related to the event are provided in conjunction with the event, it becomes possible to sell goods or provide services to event participants in the extended space.

[0005] An object of at least one embodiment of the present invention is to solve the above problem, to enable an event using augmented reality to be held, and to enable sales of goods and provision of services at the event. [Means for solving the problem]

[0006] From a non-limiting perspective, an event provision program according to one embodiment of the present invention is intended to enable a server to realize an object display function of causing a display device to superimpose a first object, which is a virtual object, on real space, and display it thereon; an expression control function of controlling an expression using one or more virtual objects including the first object; and an authority acquisition information display function of causing the display device to display information (hereinafter referred to as "authority acquisition information") for allowing a user to acquire specified authority for products or services related to the object, the event, or the expression.

[0007] From a non-limiting perspective, an event provision system according to one embodiment of the present invention is an event provision system comprising a communication network, a server, and a user terminal, and includes an object display means for superimposing a first object, which is a virtual object, on a real space and displaying it on a display device, an expression control means for controlling an expression using one or more virtual objects including the first object, and an authority acquisition information display means for displaying on the display device a display (hereinafter referred to as "authority acquisition information") for allowing a user to acquire specified authority for products or services related to the object, the event, or the expression.

[0008] From a non-limiting perspective, an event provision program according to one embodiment of the present invention is intended to enable a user terminal to realize an object display function that causes a first object, which is a virtual object, to be superimposed on real space and displayed on a display device, an expression control function that controls an expression using one or more virtual objects including the first object, and an authority acquisition information display function that causes the display device to display a display (hereinafter referred to as "authority acquisition information") for allowing a user to acquire specified authority for products or services related to the object, the event, or the expression.

[0009] From a non-limiting perspective, an event provision method according to one embodiment of the present invention is an event provision method by a computer device, and includes an object display process that causes a display device to display a first object, which is a virtual object, superimposed on real space, an expression control process that controls an expression using one or more virtual objects including the first object, and an authority acquisition information display process that causes the display device to display a display (hereinafter referred to as "authority acquisition information") for allowing a user to obtain specified authority for products or services related to the object, the event, or the expression.

[0010] From a non-limiting perspective, an event provision method according to one embodiment of the present invention is an event provision method by an event provision system having a communication network, a server, and a user terminal, and includes an object display process that causes a display device to display a first object, which is a virtual object, superimposed on real space, an expression control process that controls an expression using one or more virtual objects including the first object, and an authority acquisition information display process that causes the display device to display a display (hereinafter referred to as "authority acquisition information") for allowing a user to obtain specified authority for products or services related to the object, the event, or the expression. Effect of the Invention

[0011] Each embodiment of the present application addresses one or more of the deficiencies. [Brief description of the drawings]

[0012] [Figure 1] 1 is a diagram illustrating an example of a configuration of an event providing system according to at least one of the embodiments of the present invention. [Diagram 2] FIG. 2 is a block diagram showing a configuration of a server corresponding to at least one of the embodiments of the present invention. [Diagram 3] 11 is a flowchart illustrating an example of an event providing process corresponding to at least one of the embodiments of the present invention. [Figure 4] FIG. 2 is a block diagram showing a configuration of a server corresponding to at least one of the embodiments of the present invention. [Diagram 5] 11 is a flowchart illustrating an example of an event providing process corresponding to at least one of the embodiments of the present invention. [Figure 6] FIG. 2 is a block diagram showing a configuration of a server corresponding to at least one of the embodiments of the present invention. [Figure 7] 11 is a flowchart illustrating an example of an event providing process corresponding to at least one of the embodiments of the present invention. [Figure 8] FIG. 2 is a block diagram showing a configuration of a server corresponding to at least one of the embodiments of the present invention. [Figure 9] 11 is a flowchart illustrating an example of an event providing process corresponding to at least one of the embodiments of the present invention. [Figure 10] 1 is a diagram illustrating an example of a configuration of an event providing system according to at least one of the embodiments of the present invention. [Figure 11] 1 is a block diagram showing a configuration of an event providing system according to at least one embodiment of the present invention. [Figure 12] 11 is a flowchart illustrating an example of an event providing process corresponding to at least one of the embodiments of the present invention. [Figure 13] FIG. 2 is a block diagram showing a configuration of a user terminal corresponding to at least one of the embodiments of the present invention. [Figure 14] 11 is a flowchart illustrating an example of an event providing process corresponding to at least one of the embodiments of the present invention. [Figure 15] FIG. 2 is a block diagram showing a configuration of a server corresponding to at least one of the embodiments of the present invention. [Figure 16] 11 is a flowchart illustrating an example of an event providing process corresponding to at least one of the embodiments of the present invention. [Figure 17] 1 is a conceptual diagram showing a display example by a display device according to at least one of the embodiments of the present invention. [Figure 18] 1 is a conceptual diagram showing a display example by a display device according to at least one of the embodiments of the present invention. [Figure 19] 1 is a conceptual diagram showing a display example by a display device according to at least one of the embodiments of the present invention. [Figure 20] 1 is a conceptual diagram showing a display example by a display device according to at least one of the embodiments of the present invention. [Figure 21] 1 is a conceptual diagram showing a display example by a display device according to at least one of the embodiments of the present invention. [Figure 22] 1 is a conceptual diagram showing a display example by a display device according to at least one of the embodiments of the present invention. [Diagram 23] 1 is a conceptual diagram showing a display example by a display device according to at least one of the embodiments of the present invention. [Figure 24] 1 is a conceptual diagram showing a display example by a display device according to at least one of the embodiments of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, examples of embodiments of the present invention will be described with reference to the drawings. Note that the various components in the examples of the embodiments described below can be appropriately combined to the extent that no inconsistencies or the like arise. In addition, the contents described as an example of one embodiment may be omitted in other embodiments. In addition, the contents of operations and processes that are not related to the characteristic parts of each embodiment may be omitted. Furthermore, the order of various processes that make up the various flows and sequences described below is random to the extent that no inconsistencies or the like arise in the processing contents.

[0014] [First embodiment] An overview of the first embodiment of the present invention will be described below. In the following, an event providing program executed in a server will be described as an example of the first embodiment.

[0015] FIG. 1 is a diagram showing an example of the configuration of an event provision system corresponding to at least one of the embodiments of the present invention. The event provision system 100 includes an event provision processing server 10 (server 10) and a user terminal 20 used by a user of the event provision system 100. Each of the user terminals 20A, 20B, and 20C is an example of the user terminal 20. The configuration of the event provision system 100 is not limited to this. For example, the event provision system 100 may be configured such that a single user terminal is used by multiple users. The event provision system 100 may include multiple servers. For example, the event provision system 100 may further include another server 40.

[0016] The event provision system 100 may further include a attendant device 60. The attendant device 60 is used by an attendant SP who attends to a user who visits, for example, a sales tent (see FIG. 21) described later. Specific examples of the attendant device 60 include a server device, a client device, and a user terminal described later.

[0017] The server 10, the user terminal 20, the other server 40, and the respondent device 60 are each communicatively connected to a communication network 30 such as the Internet. The server 10, the user terminal 20, the other server 40, and the respondent device 60 may be connected to each other via the communication network 30 by wired or wireless connections. For example, a plurality of user terminals 20 may be connected to the communication network 30 by performing data communication with a base station managed by a communication carrier via a wireless communication line.

[0018] The event delivery system 100 includes a server 10 and a user terminal 20, and thereby realizes various functions for executing various processes in response to user operations.

[0019] The server 10 includes a processor 11, a memory 12, and a storage device 13. The processor 11 is, for example, a central processing unit such as a CPU (Central Processing Unit) that performs various calculations and control. In addition, when the server 10 includes a GPU (Graphics Processing Unit), some of the various calculations and control may be performed by the GPU. The server 10 executes various information processing by the processor 11 using data read into the memory 12, and stores the obtained processing results in the storage device 13 as necessary.

[0020] The storage device 13 has a function as a storage medium for storing various information. The configuration of the storage device 13 is not particularly limited, but from the viewpoint of reducing the processing load on the user terminal 20, it is preferable that the storage device 13 is configured to be capable of storing all of the various information required for the control performed by the event providing system 100. Examples of such a configuration include an HDD and an SSD. However, the storage device for storing the various information only needs to have a storage area accessible by the server 10, and may be configured to have a dedicated storage area outside the server 10, for example. The server 10 is managed by an administrator of the event providing system 100, and has various functions for providing information on various processes to a plurality of user terminals 20. The server 10 is configured by an information processing device such as a game server capable of rendering AR display data.

[0021] The user terminal 20 is configured by a communication terminal capable of providing information services accompanied by AR display to a user. Examples of such communication terminals include a mobile phone terminal 20A such as a smartphone, and AR glasses 20B and 20C. The communication terminal may be a stationary game device, a portable game device, a personal computer, a gaming PC, a so-called wearable device, or a combination of a plurality of the above-mentioned communication terminals. The configuration of the user terminal that may be included in the event providing system 100 is not limited to these, and may be any configuration that allows the user to visually recognize the AR display.

[0022] The user terminal 20 includes a processor 21, a memory 22, and a storage device 23. The processor 21 is, for example, a central processing unit such as a CPU (Central Processing Unit) that performs various calculations and control. In addition, if the user terminal 20 includes a GPU (Graphics Processing Unit), some of the various calculations and control may be performed by the GPU. The user terminal 20 executes various information processing in the processor 21 using data read into the memory 22, and stores the obtained processing results in the storage device 23 as necessary. The storage device 23 functions as a storage medium that stores various information.

[0023] The user terminal 20 is equipped with hardware and software for connecting to the communication network 30 and executing various processes by communicating with the server 10, the other server 40, or the respondent device 60. Note that each of the multiple user terminals 20 may be configured to be able to communicate directly with each other without going through the server 10, the other server 40, or the respondent device 60.

[0024] The user terminal 20 may have a built-in display device. The display device may be connected to the user terminal 20 wirelessly or by wire. The display device displays images such as still images and videos. The display device may display a game screen. The display device may display the appearance of the attendant SP based on data acquired directly from the attendant device 60 via the communication network 30 or further via the server 10 or the like. The display device may also perform augmented reality (AR) display superimposed on real space. The display device may include, for example, a hologram display device capable of displaying holograms, a projection device that projects an image (including a game screen) onto a screen, etc. In the example of FIG. 1, the touch panel screen of the mobile phone terminal 20A, the AR glasses 20B, and the AR displays of 20C, etc. correspond to the display device.

[0025] The user terminal 20 may have a built-in input device. The input device may be connected to the user terminal 20 wirelessly or via a wire. The input device accepts operation input by a user. In response to the operation input by the user, a processor included in the server 10 or a processor included in the user terminal 20 executes various control processes. Examples of the input device include a touch panel screen included in the mobile phone terminal 20A and a controller CTR connected wirelessly or via a wire to the AR glasses 20B. The camera included in the user terminal 20 may also correspond to the input device. The user performs operation input by making a gesture such as moving a hand in front of the camera (gesture input).

[0026] In addition, the user terminal 20 may be equipped with other output devices such as a speaker. The other output devices output various information to the user. The output information includes, for example, the voice uttered by the attendant SP. The other output devices may output audio information indicating the product the user purchases or the content of the service the user receives. Note that the other output devices are not limited to audio output devices and may output other types of information. In addition, other output devices using haptic technology may output tactile information.

[0027] The other server 40 includes a processor 41, a memory 42, and a storage device 43. The processor 41 is, for example, a central processing unit such as a CPU (Central Processing Unit) that performs various calculations and control. In addition, if the other server 40 includes a GPU (Graphics Processing Unit), some of the various calculations and control may be performed by the GPU. The other server 40 executes various information processing using the data read into the memory 42 with the processor 41, and stores the obtained processing results in the storage device 43 as necessary.

[0028] The storage device 43 has a function as a storage medium for storing various information. The configuration of the storage device 43 is not particularly limited. The storage device for storing various information may have a storage area accessible by the other server 40, and may have a dedicated storage area outside the other server 40, for example. The other server 40 may be managed by an administrator of the event provision system 100 or by another person, and has various functions for providing information on various processes to a plurality of user terminals 20. The other server 40 may be, for example, a server that manages the manufacture and delivery of actual goods. The other server 40 may be a server that manages the distribution of videos related to live events.

[0029] The respondent device 60 includes a processor 61, a memory 62, and a storage device 63. The processor 61 is, for example, a central processing unit such as a CPU (Central Processing Unit) that performs various calculations and control. In addition, if the respondent device 60 includes a GPU (Graphics Processing Unit), some of the various calculations and control may be performed by the GPU. The respondent device 60 executes various information processing in the processor 61 using data read into the memory 62, and stores the obtained processing results in the storage device 63 as necessary. The storage device 63 functions as a storage medium that stores various information.

[0030] The responder device 60 is connected to the communication network 30 and includes hardware and software for communicating with the server 10, the user terminal 20, or the other server 40 to execute various processes.

[0031] The attendant device 60 includes a camera 64 and an input device 65. The camera 64 captures an attendant SP, such as a salesperson at a sales tent (see FIG. 21). The captured image data showing the attendant SP is used by the attendant SP to attend to the user in a cash register area described later when the user purchases a product or the like. The input device 65 accepts operation input by the attendant SP or the like. In response to the operation input by the attendant SP or the like, a processor 61 included in the attendant device 60 executes various control processes. Examples of the input device 65 include a keyboard, a mouse, and a microphone for voice operation. The camera 64 included in the attendant device 60 may also correspond to the input device. In this case, the attendant SP performs operation input by a gesture such as moving his / her hand in front of the camera 64 (gesture input).

[0032] The attendant device 60 includes a display device 66. The display device 66 may be built into the attendant device 60. The display device 66 may be connected to the attendant device 60 wirelessly or by wire. The display device 66 displays images such as still images and videos. The display device 66 displays an image of a user purchasing a product or receiving a service. The display device 66 may display information indicating the contents of the product the user is purchasing or the contents of the service the user is receiving.

[0033] In addition, the attendant device 60 may be equipped with other output devices such as a speaker. The other output devices output information related to a user who uses a sales tent or the like. The information related to a user includes, for example, a voice uttered by a user who purchases a product or receives a service. The other output devices may output audio information indicating the content of the product purchased by the user or the service provided to the user. Note that the other output devices are not limited to audio output devices, and may output other types of information such as smell information, taste information, and tactile information.

[0034] 2 is a block diagram showing a configuration of a server corresponding to at least one of the embodiments of the present invention. Server 10A, which is an example of the configuration of server 10, includes at least an object display unit 101, an expression control unit 102, and an authority acquisition information display unit 103. A processor included in server 10A refers to an event providing program stored (installed) in a storage device, and executes the program to functionally realize object display unit 101, expression control unit 102, and authority acquisition information display unit 103.

[0035] The object display unit 101 has a function of superimposing a first object, which is a virtual object, on a real space and displaying it on the display device. The expression control unit 102 has a function of controlling an expression using one or more virtual objects including the first object. The authority acquisition information display unit 103 has a function of displaying information (authority acquisition information) for allowing a user to acquire a predetermined authority for a product or service related to an object, an event, or an expression on the display device.

[0036] Next, a program execution process in the first embodiment of the present invention will be described below. Fig. 3 is a flowchart showing an example of an event providing process corresponding to at least one of the embodiments of the present invention.

[0037] The object display unit 101 causes a display device to display a first object, which is a virtual object, superimposed on real space (St11). The expression control unit 102 controls an expression using one or more virtual objects including the first object (St12). The authority acquisition information display unit 103 causes the display device to display information (authority acquisition information) for allowing the user to acquire a predetermined authority for a product or service related to the object, event, or expression (St13).

[0038] A virtual object means an object that can be output in a virtual space that is not a real space. For example, a virtual chair or a car expressed by 3D modeling data obtained by scanning the shape of an object such as a chair or a car in a real space corresponds to the virtual object referred to here. In addition, a living thing such as a human, an animal, a plant, or a monster expressed by 3D modeling data also corresponds to the virtual object. A virtual object may be a virtual expression of an imaginary object such as a fairy or a dragon. The dimension of the data for expressing a virtual object is not limited to three dimensions. For example, an object such as the above-mentioned expressed by 2D data also corresponds to the virtual object referred to here.

[0039] The real space refers to a space in the real world. The virtual space that extends the real space refers to a virtual space (AR space) that can be output and superimposed on the real space.

[0040] Displaying a virtual object on a display device means outputting display data for displaying the virtual object to a device (such as the user terminal 20) that has a display device or to the display device. Displaying a virtual object on a display device may also mean outputting a command to display the virtual object to a device (such as the user terminal 20 that can generate or store display data) or to a display device that already has display data.

[0041] Expression means presenting some information to a receiver externally, for example, singing, dancing, playing a role, reciting poetry, playing an instrument, giving a lecture, running, jumping, crying, etc. Controlling an expression using a virtual object may include controlling the action of the object, such as making the object sing, dance, play a role, recite poetry, play an instrument, give a lecture, run, jump, cry, etc. Controlling an expression using a virtual object may also mean conveying some information to a receiver via one or more virtual objects, for example, making five virtual cars run in a circle to represent the Olympic rings.

[0042] An event refers to a place where information is externally presented to a recipient, such as a live music event, a theater event, or a seminar event.

[0043] A product is an item that is the subject of a transaction. A service is something that one entity provides to another entity. Note that either interpretation is acceptable, whether a virtual object, which is in reality data, is interpreted as a product or as the subject of the provision of a service.

[0044] The predetermined authority (hereinafter abbreviated as the predetermined authority) for a product or service related to an object, event, or expression includes, for example, the authority to own, lend, or use this real object in the real space if the product is a real object in the real space. If the product is data, the predetermined authority includes the authority to obtain, copy, modify, or use this data. For a service, the predetermined authority includes the authority to receive the service.

[0045] As non-limiting examples, specific examples of the predetermined rights are given below. ·The right to purchase or borrow actual items (such as figurines) that imitate the virtual characters that appear in the event. ·The right to purchase or borrow actual clothing worn by the virtual characters that appear in the event. ·The right to purchase or borrow actual possessions, such as guitars, carried by the virtual characters that appear in the event. ·The right to purchase or borrow actual items corresponding to the stage props that appear in the event (including both virtual stage props and props in the real world). ·The right to obtain or use data representing the virtual characters that appear in the event, the clothing worn by the characters, or the virtual items carried by the characters. ·The right to add sound effects to the actual items or virtual objects that appear in the event. For example, changing the engine sound of a virtual car. ·The right to purchase or borrow actual items related to the event, such as the official T-shirt or official towel of the event. ·The right to purchase or borrow physical media, such as CDs or DVDs, that contain the music used in the event. ·The right to purchase or be loaned physical media such as CDs or DVDs containing music related to the event or expression (for example, music provided by another artist belonging to the same agency as the event participant, or other music included in a compilation album that includes music used at the event). ·The right to download or stream data containing the above-mentioned music. ·The right to purchase or be loaned merchandise related to objects that appeared in the event or were included in the expression, for example, receiving green peppers delivered if an event participant says "green pepper." ·The right to use data showing the various objects listed above in video games, games with AR displays, etc. ·The right to have the various objects listed above appear in other media related to the event (animation, manga, games, etc.). These are merely examples, and the predetermined authority may be authority other than those mentioned above.

[0046] Information for allowing a user to acquire specific authority (information for acquiring authority) refers to information that allows a user to express an intention to acquire authority when presented with the information, such as information for displaying a purchase button for the authority to purchase an item.

[0047] Displaying the authority acquisition information on a display device means outputting display data for displaying the authority acquisition information to a device (such as the user terminal 20) equipped with a display device or to a display device. Displaying the authority acquisition information on a display device may also mean outputting a command to display the authority acquisition information to a device (such as the user terminal 20 capable of generating or storing display data) or to a display device that already has the display data.

[0048] As one aspect of the first embodiment, an event using augmented reality can be held, and goods and services can be sold at the event.

[0049] [Second embodiment] An overview of the second embodiment of the present invention will be described below. In the following, an event delivery program executed in a server will be described as an example of the second embodiment. The server may be the server 10 included in the event delivery system 100 described in FIG. 1.

[0050] 4 is a block diagram showing a configuration of a server corresponding to at least one of the embodiments of the present invention. Server 10B, which is an example of the configuration of server 10, includes at least object display unit 101, expression control unit 102, and authority acquisition information display unit 103B. The processor included in server 10A refers to an event providing program stored (installed) in a storage device, and executes the program to functionally realize object display unit 101, expression control unit 102, and authority acquisition information display unit 103B.

[0051] The object display unit 101 has a function of superimposing a first object, which is a virtual object, on a real space and displaying it on a display device. The expression control unit 102 has a function of controlling the expression using one or more virtual objects including the first object.

[0052] The authority acquisition information display unit 103B has a function of displaying authority acquisition information on the display device when it acquires input operation information by a user for product information, which is information indicating a product or service displayed on the display device.

[0053] Next, a program execution process in the second embodiment of the present invention will be described below. Fig. 5 is a flowchart showing an example of an event providing process corresponding to at least one of the embodiments of the present invention.

[0054] The object display unit 101 causes a display device to display a first object, which is a virtual object, by superimposing the first object on real space (St21). The expression control unit 102 controls the expression using one or more virtual objects including the first object (St22).

[0055] The authority acquisition information display unit 103B acquires input operation information by the user for the product information, which is information indicating a product or service displayed on the display device (St23). When the authority acquisition information display unit 103B acquires the input operation information, it causes the display device to display information (authority acquisition information) for allowing the user to acquire a predetermined authority for a product or service related to an object, an event, or an expression (St24).

[0056] The meanings of the terms related to steps St21 and St22 and the authority acquisition information are the same as those in the first embodiment, and therefore the description thereof will be omitted.

[0057] The input operation information by the user means operation information input by the user. For example, information input by tapping or swiping a specific area of ​​the touch panel display of the user terminal 20, or information input by voice input, etc., corresponds to the input operation information. In addition, information input by a user using AR glasses through gesture input, etc., corresponds to the input operation information. In addition, information input by a user via various input devices such as a keyboard or a mouse corresponds to the input operation information.

[0058] Product information means information indicating a product or service. For example, if a T-shirt is a product to be purchased, image information indicating the T-shirt displayed by the display device, icon image information indicating the T-shirt, etc., corresponds to product information. For a service that allows streaming playback of a specific song, character string information indicating the title of the song, icon image information, etc., corresponds to product information. Product information may be displayed in AR. AR display means displaying an object by superimposing it on real space, etc. Clothes worn by a virtual character object (including a virtual human) displayed on the display device, the character itself (the product is a 1 / N-sized figure, etc.), goods with a team logo worn by a professional player in a many-to-many battle royal game tournament, a gaming PC used by the professional player in the tournament, etc., may be displayed in AR as product information. AR-displayed accessories worn by a person in real space reflected in the display device also correspond to product information.

[0059] The product information may be displayed in a manner other than AR display. For example, a real stage prop placed at an event venue in the real space may be reflected on a display device such as a touch panel display of a smartphone or AR glasses. The real object reflected on the display device may correspond to product information indicating a related product (e.g., a miniature toy stage prop). For example, a user can tap an area on a touch panel display where the real object is reflected to indicate an intention to purchase a related product. To achieve this, the server 10B or the user terminal 20 may provide a function to set an area of ​​the real object reflected on the display device as an inputtable area so that the user can select an area where the real object reflected on the display device is located and perform input.

[0060] As one aspect of the second embodiment, when a user expresses an intention to acquire authority, for example, by purchasing a product, the authority acquisition information can be displayed. This allows a user who has no intention to acquire authority to concentrate on participating in the event.

[0061] [Third embodiment] An overview of the third embodiment of the present invention will be described below. In the following, an event delivery program executed in a server will be described as an example of the third embodiment. The server may be the server 10 included in the event delivery system 100 described in FIG. 1.

[0062] 6 is a block diagram showing a configuration of a server corresponding to at least one of the embodiments of the present invention. Server 10C, which is an example of the configuration of server 10, includes at least object display unit 101, expression control unit 102, and authority acquisition information display unit 103C. The processor included in server 10A refers to an event providing program stored (installed) in a storage device, and executes the program to functionally realize object display unit 101, expression control unit 102, and authority acquisition information display unit 103C.

[0063] The object display unit 101 has a function of superimposing a first object, which is a virtual object, on a real space and displaying it on a display device. The expression control unit 102 has a function of controlling the expression using one or more virtual objects including the first object.

[0064] The authority acquisition information display unit 103C has a function of displaying, on a display device, information (authority acquisition information) for allowing a user to acquire a predetermined authority for a product or service related to an object, an event, or an expression. The authority acquisition information display unit 103C displays the authority acquisition information in a second area different from the first area in which the first object is displayed by the display device.

[0065] Next, a program execution process according to the third embodiment of the present invention will be described below. Fig. 7 is a flowchart showing an example of an event providing process corresponding to at least one of the embodiments of the present invention.

[0066] The object display unit 101 causes a first object, which is a virtual object, to be superimposed on real space and displayed on the display device (St31). The expression control unit 102 controls the expression using one or more virtual objects including the first object (St32). The authority acquisition information display unit 103C causes the authority acquisition information to be displayed in a second area different from the first area in which the first object is displayed on the display device (St33).

[0067] The terms relating to steps St31 to St33 are similar to those in the first or second embodiment, and therefore will not be described.

[0068] As one aspect of the third embodiment, by separating a first area used at the event from a second area for purchasing products, etc., displays for purchasing products, etc. do not hinder users' participation in the event.

[0069] [Fourth embodiment] An overview of the fourth embodiment of the present invention will be described below. In the following, an event delivery program executed in a server will be described as an example of the fourth embodiment. The server may be the server 10 included in the event delivery system 100 described in FIG. 1.

[0070] 8 is a block diagram showing a configuration of a server corresponding to at least one of the embodiments of the present invention. Server 10D, which is an example of the configuration of server 10, includes at least object display unit 101, expression control unit 102D, and authority acquisition information display unit 103. The processor included in server 10D refers to an event providing program stored (installed) in a storage device, and executes the program to functionally realize object display unit 101, expression control unit 102D, and authority acquisition information display unit 103.

[0071] The object display unit 101 has a function of superimposing a first object, which is a virtual object, on a real space and displaying it on the display device. The expression control unit 102D has a function of controlling an expression using one or more virtual objects including the first object depending on whether or not authority has been acquired. The authority acquisition information display unit 103 has a function of displaying information (authority acquisition information) for allowing a user to acquire a predetermined authority for a product or service related to an object, an event, or an expression on the display device.

[0072] Next, a program execution process in the fourth embodiment of the present invention will be described below. Fig. 9 is a flowchart showing an example of an event providing process corresponding to at least one of the embodiments of the present invention.

[0073] The object display unit 101 displays a first object, which is a virtual object, on the display device by superimposing it on real space (St41). The expression control unit 102D controls the expression using one or more virtual objects including the first object depending on whether or not authority has been acquired (St42). The authority acquisition information display unit 103 displays information (authority acquisition information) for allowing the user to acquire a predetermined authority for a product or service related to an object, an event, or an expression on the display device.

[0074] Controlling a representation using one or more virtual objects including a first object depending on whether or not authority has been acquired means controlling the representation so that at least a part of the representation differs between a user who has acquired authority and a user who has not acquired authority.

[0075] Other terms related to steps St41 to St43 are similar to those in the first to third embodiments, and therefore will not be described.

[0076] As an aspect of the fourth embodiment, different effects can be performed during an event depending on whether or not the user has acquired authority. This allows different users to experience different events even if the event is basically the same, and individualizes the event.

[0077] [Fifth embodiment] An overview of the fifth embodiment of the present invention will be described below. In the following, an event providing system will be described as an example of the fifth embodiment.

[0078] FIG. 10 is a diagram showing an example of the configuration of an event delivery system corresponding to at least one of the embodiments of the present invention. The event delivery system 100A includes an event delivery processing server 10 (server 10) and a user terminal 20 used by a user of the event delivery system 100A. Each of the user terminals 20A, 20B, and 20C is an example of the user terminal 20. The configuration of the event delivery system 100A is not limited to this. For example, the event delivery system 100A may be configured such that multiple users use a single user terminal. The event delivery system 100A may include multiple servers. For example, the event delivery system 100A may further include another server 40.

[0079] The event provision system 100A may further include a attendant device 60. The attendant device 60 is used by an attendant SP who attends to a user who visits a sales tent (see FIG. 21) described later, for example. Specific examples of the attendant device 60 include a server device, a client device, and a user terminal.

[0080] The server 10, the user terminal 20, the other server 40, and the respondent device 60 are each communicatively connected to a communication network 30 such as the Internet. The server 10, the user terminal 20, the other server 40, and the respondent device 60 may be connected to each other via the communication network 30 by wired or wireless connections. For example, a plurality of user terminals 20 may be connected to the communication network 30 by performing data communication with a base station managed by a communication carrier via a wireless communication line.

[0081] The event delivery system 100A includes a server 10 and a user terminal 20, and thereby realizes various functions for executing various processes in response to user operations.

[0082] The server 10 includes a processor 11, a memory 12, and a storage device 13. The processor 11 is, for example, a central processing unit such as a CPU (Central Processing Unit) that performs various calculations and control. In addition, when the server 10 includes a GPU (Graphics Processing Unit), some of the various calculations and control may be performed by the GPU. The server 10 executes various information processing by the processor 11 using data read into the memory 12, and stores the obtained processing results in the storage device 13 as necessary.

[0083] The storage device 13 has a function as a storage medium for storing various information. The configuration of the storage device 13 is not particularly limited, but from the viewpoint of reducing the processing load on the user terminal 20, it is preferable that the storage device 13 is configured to be capable of storing all of the various information required for the control performed by the event providing system 100A. Examples of such a configuration include an HDD and an SSD. However, the storage device for storing the various information only needs to have a storage area accessible by the server 10, and may be configured to have a dedicated storage area outside the server 10, for example. The server 10 is managed by an administrator of the event providing system 100A, and has various functions for providing information on various processes to multiple user terminals 20. The server 10 is configured by an information processing device such as a game server capable of rendering AR display data.

[0084] The user terminal 20 is configured by a communication terminal capable of providing information services accompanied by AR display to a user. Examples of such communication terminals include a mobile phone terminal 20A such as a smartphone, and AR glasses 20B and 20C. The communication terminal may be a stationary game device, a portable game device, a personal computer, a gaming PC, a so-called wearable device, or a combination of a plurality of the above-mentioned communication terminals. The configuration of the user terminal that may be included in the event providing system 100A is not limited to these, and may be any configuration that allows the user to visually recognize the AR display.

[0085] The user terminal 20 includes a processor 21, a memory 22, and a storage device 23. The processor 21 is, for example, a central processing unit such as a CPU (Central Processing Unit) that performs various calculations and control. In addition, if the user terminal 20 includes a GPU (Graphics Processing Unit), some of the various calculations and control may be performed by the GPU. The user terminal 20 executes various information processing in the processor 21 using data read into the memory 22, and stores the obtained processing results in the storage device 23 as necessary. The storage device 23 functions as a storage medium that stores various information.

[0086] The user terminal 20 is equipped with hardware and software for connecting to the communication network 30 and executing various processes by communicating with the server 10, the other server 40, or the respondent device 60. Note that each of the multiple user terminals 20 may be configured to be able to communicate directly with each other without going through the server 10, the other server 40, or the respondent device 60.

[0087] The user terminal 20 may have a built-in display device. The display device may be connected to the user terminal 20 wirelessly or by wire. The display device displays images such as still images and videos. The display device may display a game screen. The display device may display the appearance of the attendant SP based on data acquired directly from the attendant device 60 via the communication network 30 or further via the server 10 or the like. The display device may also perform augmented reality (AR) display superimposed on real space. The display device may include, for example, a hologram display device capable of displaying holograms, and a projection device that projects an image (including a game screen) onto a screen or the like. In the example of FIG. 10, the touch panel screen of the mobile phone terminal 20A and the AR displays of the AR glasses 20B and 20C correspond to the display device.

[0088] The user terminal 20 may have a built-in input device. The input device may be connected to the user terminal 20 wirelessly or via a wire. The input device accepts operation input by a user. In response to the operation input by the user, a processor included in the server 10 or a processor included in the user terminal 20 executes various control processes. Examples of the input device include a touch panel screen included in the mobile phone terminal 20A and a controller CTR connected wirelessly or via a wire to the AR glasses 20B. The camera included in the user terminal 20 may also correspond to the input device. The user performs operation input by making a gesture such as moving a hand in front of the camera (gesture input).

[0089] In addition, the user terminal 20 may be equipped with other output devices such as a speaker. The other output devices output various information to the user. The output information includes, for example, the voice uttered by the attendant SP. The other output devices may output audio information indicating the product the user purchases or the content of the service the user receives. Note that the other output devices are not limited to audio output devices and may output other types of information. In addition, an output device using haptics technology may output other tactile information.

[0090] The other server 40 includes a processor 41, a memory 42, and a storage device 43. The processor 41 is, for example, a central processing unit such as a CPU (Central Processing Unit) that performs various calculations and control. In addition, if the other server 40 includes a GPU (Graphics Processing Unit), some of the various calculations and control may be performed by the GPU. The other server 40 executes various information processing using the data read into the memory 42 with the processor 41, and stores the obtained processing results in the storage device 43 as necessary.

[0091] The storage device 43 has a function as a storage medium for storing various information. The configuration of the storage device 43 is not particularly limited. The storage device for storing various information may have a storage area accessible by the other server 40, and may have a dedicated storage area outside the other server 40, for example. The other server 40 may be managed by an administrator of the event provision system 100A or by another person, and has various functions for providing information on various processes to a plurality of user terminals 20. The other server 40 may be, for example, a server that manages the manufacture and delivery of actual goods. The other server 40 may be a server that manages the distribution of videos related to live events.

[0092] The respondent device 60 includes a processor 61, a memory 62, and a storage device 63. The processor 61 is, for example, a central processing unit such as a CPU (Central Processing Unit) that performs various calculations and control. In addition, if the respondent device 60 includes a GPU (Graphics Processing Unit), some of the various calculations and control may be performed by the GPU. The respondent device 60 executes various information processing in the processor 61 using data read into the memory 62, and stores the obtained processing results in the storage device 63 as necessary. The storage device 63 functions as a storage medium that stores various information.

[0093] The responder device 60 is connected to the communication network 30 and includes hardware and software for communicating with the server 10, the user terminal 20, or the other server 40 to execute various processes.

[0094] The attendant device 60 includes a camera 64 and an input device 65. The camera 64 captures an attendant SP, such as a salesperson at a sales tent (see FIG. 21). The captured image data showing the attendant SP is used by the attendant SP to attend to the user in a cash register area described later when the user purchases a product or the like. The input device 65 accepts operation input by the attendant SP or the like. In response to the operation input by the attendant SP or the like, a processor 61 included in the attendant device 60 executes various control processes. Examples of the input device 65 include a keyboard, a mouse, and a microphone for voice operation. The camera 64 included in the attendant device 60 may also correspond to the input device. In this case, the attendant SP performs operation input by a gesture such as moving his / her hand in front of the camera 64 (gesture input).

[0095] The attendant device 60 includes a display device 66. The display device 66 may be built into the attendant device 60. The display device 66 may be connected to the attendant device 60 wirelessly or by wire. The display device 66 displays images such as still images and videos. The display device 66 displays an image of a user purchasing a product or receiving a service. The display device 66 may display information indicating the contents of the product the user is purchasing or the contents of the service the user is receiving.

[0096] In addition, the attendant device 60 may be equipped with other output devices such as a speaker. The other output devices output information related to a user who uses a sales tent or the like. The information related to a user includes, for example, a voice uttered by a user who purchases a product or receives a service. The other output devices may output audio information indicating the content of the product purchased by the user or the service provided to the user. Note that the other output devices are not limited to audio output devices, and may output other types of information such as smell information, taste information, and tactile information.

[0097] 11 is a block diagram showing a configuration of an event delivery system corresponding to at least one of the embodiments of the present invention. The event delivery system 100A includes at least an object display unit 501, an expression control unit 502, and an authority acquisition information display unit 503. One or more processors included in the event delivery system 100A refer to an event delivery program stored (installed) in one or more storage devices included in the event delivery system 100A, and execute the program to functionally realize the object display unit 501, the expression control unit 502, and the authority acquisition information display unit 503.

[0098] The object display unit 501 has a function of superimposing a first object, which is a virtual object, on a real space and displaying it on the display device. The expression control unit 502 has a function of controlling an expression using one or more virtual objects including the first object. The authority acquisition information display unit 503 has a function of displaying information (authority acquisition information) for allowing a user to acquire a predetermined authority for a product or service related to an object, an event, or an expression on the display device.

[0099] Next, a program execution process in the fifth embodiment of the present invention will be described below. Fig. 12 is a flowchart showing an example of an event providing process corresponding to at least one of the embodiments of the present invention.

[0100] The object display unit 501 causes a display device to display a first object, which is a virtual object, superimposed on real space (St51). The expression control unit 502 controls an expression using one or more virtual objects including the first object (St52). The authority acquisition information display unit 503 causes the display device to display information (authority acquisition information) for allowing the user to acquire a predetermined authority for a product or service related to an object, an event, or an expression (St53).

[0101] A virtual object means an object that can be output in a virtual space that is not a real space. For example, a virtual chair or a car expressed by 3D modeling data obtained by scanning the shape of an object such as a chair or a car in a real space corresponds to the virtual object referred to here. In addition, a living thing such as a human, an animal, a plant, or a monster expressed by 3D modeling data also corresponds to the virtual object. A virtual object may be a virtual expression of an imaginary object such as a fairy or a dragon. The dimension of the data for expressing a virtual object is not limited to three dimensions. For example, an object such as the above-mentioned expressed by 2D data also corresponds to the virtual object referred to here.

[0102] The real space refers to a space in the real world. The virtual space that extends the real space refers to a virtual space (AR space) that can be output and superimposed on the real space.

[0103] Displaying a virtual object on a display device means outputting display data for displaying the virtual object to a device (such as the user terminal 20) that has a display device or to the display device. Displaying a virtual object on a display device may also mean outputting a command to display the virtual object to a device (such as the user terminal 20 that can generate or store display data) or to a display device that already has display data.

[0104] Expression means presenting some information to a receiver externally, for example, singing, dancing, playing a role, reciting poetry, playing an instrument, giving a lecture, running, jumping, crying, etc. Controlling an expression using a virtual object may include controlling the action of the object, such as making the object sing, dance, play a role, recite poetry, play an instrument, give a lecture, run, jump, cry, etc. Controlling an expression using a virtual object may also mean conveying some information to a receiver via one or more virtual objects, for example, making five virtual cars run in a circle to represent the Olympic rings.

[0105] An event refers to a place where information is externally presented to a recipient, such as a live music event, a theater event, or a seminar event.

[0106] A product is an item that is the subject of a transaction. A service is something that one entity provides to another entity. It is acceptable to interpret a virtual object as either a product or a service.

[0107] The predetermined authority (hereinafter abbreviated as the predetermined authority) for a product or service related to an object, event, or expression includes, for example, the authority to own, lend, or use this real object in the real space if the product is a real object in the real space. If the product is data, the predetermined authority includes the authority to obtain, copy, modify, or use this data. For a service, the predetermined authority includes the authority to receive the service.

[0108] As non-limiting examples, specific examples of the predetermined rights are given below. ·The right to purchase or borrow actual items (such as figurines) that imitate the virtual characters that appear in the event. ·The right to purchase or borrow actual clothing worn by the virtual characters that appear in the event. ·The right to purchase or borrow actual possessions, such as guitars, carried by the virtual characters that appear in the event. ·The right to purchase or borrow actual items corresponding to the stage props that appear in the event (including both virtual stage props and props in the real world). ·The right to obtain or use data representing the virtual characters that appear in the event, the clothing worn by the characters, or the virtual items carried by the characters. ·The right to add sound effects to the actual items or virtual objects that appear in the event. For example, changing the engine sound of a virtual car. ·The right to purchase or borrow actual items related to the event, such as the official T-shirt or official towel of the event. ·The right to purchase or borrow physical media, such as CDs or DVDs, that contain the music used in the event. ·The right to purchase or be loaned physical media such as CDs or DVDs containing music related to the event or expression (for example, music provided by another artist belonging to the same agency as the event participant, or other music included in a compilation album that includes music used at the event). ·The right to download or stream data containing the above-mentioned music. ·The right to purchase or be loaned merchandise related to objects that appeared in the event or were included in the expression, for example, receiving green peppers delivered if an event participant says "green pepper." ·The right to use data showing the various objects listed above in video games, games with AR displays, etc. ·The right to have the various objects listed above appear in other media related to the event (animation, manga, games, etc.). These are merely examples, and the predetermined authority may be authority other than those mentioned above.

[0109] Information for allowing a user to acquire specific authority (information for acquiring authority) refers to information that allows a user to express an intention to acquire authority when presented with the information, such as information for displaying a purchase button for the authority to purchase an item.

[0110] Displaying the authority acquisition information on a display device means outputting display data for displaying the authority acquisition information to a device (such as the user terminal 20) equipped with a display device or to a display device. Displaying the authority acquisition information on a display device may also mean outputting a command to display the authority acquisition information to a device (such as the user terminal 20 capable of generating or storing display data) or to a display device that already has the display data.

[0111] As one aspect of the fifth embodiment, an event using augmented reality can be held, and goods and services can be sold at the event.

[0112] [Sixth embodiment] An overview of the sixth embodiment of the present invention will be described below. In the following, an event providing program executed in a user terminal will be described as an example of the sixth embodiment. The user terminal 20Z may be any one of the multiple user terminals 20, 20A to 20C shown in FIG. 1 or FIG. 10.

[0113] 13 is a block diagram showing the configuration of a user terminal corresponding to at least one of the embodiments of the present invention. User terminal 20Z, which is an example of the configuration of user terminal 20, includes at least object display unit 201, expression control unit 202, and authority acquisition information display unit 203. A processor included in user terminal 20Z refers to an event providing program stored (installed) in a storage device and executes the program to functionally realize object display unit 201, expression control unit 202, and authority acquisition information display unit 203.

[0114] The object display unit 201 has a function of superimposing a first object, which is a virtual object, on a real space and displaying it on the display device. The expression control unit 202 has a function of controlling an expression using one or more virtual objects including the first object. The authority acquisition information display unit 203 has a function of displaying information (authority acquisition information) for allowing a user to acquire a predetermined authority for a product or service related to an object, an event, or an expression on the display device.

[0115] Next, a program execution process in the sixth embodiment of the present invention will be described below. Fig. 14 is a flowchart showing an example of an event providing process corresponding to at least one of the embodiments of the present invention.

[0116] The object display unit 201 causes a display device to display a first object, which is a virtual object, superimposed on real space (St61). The expression control unit 202 controls an expression using one or more virtual objects including the first object (St62). The authority acquisition information display unit 203 causes the display device to display information (authority acquisition information) for allowing the user to acquire a predetermined authority for a product or service related to the object, event, or expression (St63).

[0117] A virtual object means an object that can be output in a virtual space that is not a real space. For example, a virtual chair or a car expressed by 3D modeling data obtained by scanning the shape of an object such as a chair or a car in a real space corresponds to the virtual object referred to here. In addition, a living thing such as a human, an animal, a plant, or a monster expressed by 3D modeling data also corresponds to the virtual object. A virtual object may be a virtual expression of an imaginary object such as a fairy or a dragon. The dimension of the data for expressing a virtual object is not limited to three dimensions. For example, an object such as the above-mentioned expressed by 2D data also corresponds to the virtual object referred to here.

[0118] The real space refers to a space in the real world. The virtual space that extends the real space refers to a virtual space (AR space) that can be output and superimposed on the real space.

[0119] Displaying a virtual object on a display device means outputting display data for displaying the virtual object to a device (such as the user terminal 20) that has a display device or to the display device. Displaying a virtual object on a display device may also mean outputting a command to display the virtual object to a device (such as the user terminal 20 that can generate or store display data) or to a display device that already has display data.

[0120] Expression means presenting some information to a receiver externally, for example, singing, dancing, playing a role, reciting poetry, playing an instrument, giving a lecture, running, jumping, crying, etc. Controlling an expression using a virtual object may include controlling the action of the object, such as making the object sing, dance, play a role, recite poetry, play an instrument, give a lecture, run, jump, cry, etc. Controlling an expression using a virtual object may also mean conveying some information to a receiver via one or more virtual objects, for example, making five virtual cars run in a circle to represent the Olympic rings.

[0121] An event refers to a place where information is externally presented to a recipient, such as a live music event, a theater event, or a seminar event.

[0122] A product is an item that is the subject of a transaction. A service is something that one entity provides to another entity. It is acceptable to interpret a virtual object as either a product or a service.

[0123] The predetermined authority (hereinafter abbreviated as the predetermined authority) for a product or service related to an object, event, or expression includes, for example, the authority to own, lend, or use this real object in the real space if the product is a real object in the real space. If the product is data, the predetermined authority includes the authority to obtain, copy, modify, or use this data. For a service, the predetermined authority includes the authority to receive the service.

[0124] As non-limiting examples, specific examples of the predetermined rights are given below. ·The right to purchase or borrow actual items (such as figurines) that imitate the virtual characters that appear in the event. ·The right to purchase or borrow actual clothing worn by the virtual characters that appear in the event. ·The right to purchase or borrow actual possessions, such as guitars, carried by the virtual characters that appear in the event. ·The right to purchase or borrow actual items corresponding to the stage props that appear in the event (including both virtual stage props and props in the real world). ·The right to obtain or use data representing the virtual characters that appear in the event, the clothing worn by the characters, or the virtual items carried by the characters. ·The right to add sound effects to the actual items or virtual objects that appear in the event. For example, changing the engine sound of a virtual car. ·The right to purchase or borrow actual items related to the event, such as the official T-shirt or official towel of the event. ·The right to purchase or borrow physical media, such as CDs or DVDs, that contain the music used in the event. ·The right to purchase or be loaned physical media such as CDs or DVDs containing music related to the event or expression (for example, music provided by another artist belonging to the same agency as the event participant, or other music included in a compilation album that includes music used at the event). ·The right to download or stream data containing the above-mentioned music. ·The right to purchase or be loaned merchandise related to objects that appeared in the event or were included in the expression, for example, receiving green peppers delivered if an event participant says "green pepper." ·The right to use data showing the various objects listed above in video games, games with AR displays, etc. ·The right to have the various objects listed above appear in other media related to the event (animation, manga, games, etc.). These are merely examples, and the predetermined authority may be authority other than those mentioned above.

[0125] Information for allowing a user to acquire specific authority (information for acquiring authority) refers to information that allows a user to express an intention to acquire authority when presented with the information, such as information for displaying a purchase button for the authority to purchase an item.

[0126] Displaying the authority acquisition information on a display device means outputting display data for displaying the authority acquisition information to a device (such as the user terminal 20) equipped with a display device or to a display device. Displaying the authority acquisition information on a display device may also mean outputting a command to display the authority acquisition information to a device (such as the user terminal 20 capable of generating or storing display data) or to a display device that already has the display data.

[0127] As one aspect of the sixth embodiment, an event using augmented reality can be held, and goods and services can be sold at the event.

[0128] [Seventh embodiment] An overview of the seventh embodiment of the present invention will be described below. In the following, an event providing program executed in a server will be described as an example of the seventh embodiment.

[0129] 15 is a block diagram showing a configuration of a server corresponding to at least one of the embodiments of the present invention. A server 10Z, which is an example of the configuration of the server 10, includes an object display unit 101, an expression control unit 102, an authority acquisition information display unit 103, an augmented reality diorama display unit 104, and a recommendation information display unit 105. The processor included in the server 10Z refers to an event providing program stored (installed) in a storage device, and executes the program to functionally realize the object display unit 101, the expression control unit 102, the authority acquisition information display unit 103, the augmented reality diorama display unit 104, and the recommendation information display unit 105.

[0130] The object display unit 101 has a function of superimposing a first object, which is a virtual object, on a real space and displaying it on the display device. The expression control unit 102 has a function of controlling an expression using one or more virtual objects including the first object. The authority acquisition information display unit 103 has a function of displaying information (authority acquisition information) for allowing a user to acquire a predetermined authority for a product or service related to an object, an event, or an expression on the display device.

[0131] The augmented reality diorama display unit 104 has a function of displaying an augmented reality diorama superimposed on a real space on a display device. The recommended information display unit 105 has a function of displaying recommended information indicating a product or service for which the user is recommended to acquire authority, on the display device, according to the content of an expression using one or more virtual objects including a first object, information input by a user, or predetermined stored information.

[0132] A virtual object means an object that can be output in a virtual space that is not a real space. For example, a virtual chair or a car expressed by 3D modeling data obtained by scanning the shape of an object such as a chair or a car in a real space corresponds to the virtual object referred to here. In addition, a living thing such as a human, an animal, a plant, or a monster expressed by 3D modeling data also corresponds to the virtual object. A virtual object may be a virtual expression of an imaginary object such as a fairy or a dragon. The dimension of the data for expressing a virtual object is not limited to three dimensions. For example, an object such as the above-mentioned expressed by 2D data also corresponds to the virtual object referred to here.

[0133] The real space refers to a space in the real world. The virtual space that extends the real space refers to a virtual space (AR space) that can be output and superimposed on the real space.

[0134] Displaying a virtual object on a display device means outputting display data for displaying the virtual object to a device (such as the user terminal 20) that has a display device or to the display device. Displaying a virtual object on a display device may also mean outputting a command to display the virtual object to a device (such as the user terminal 20 that can generate or store display data) or to a display device that already has display data.

[0135] Expression means presenting some information to a receiver externally, for example, singing, dancing, playing a role, reciting poetry, playing an instrument, giving a lecture, running, jumping, crying, etc. Controlling an expression using a virtual object may include controlling the action of the object, such as making the object sing, dance, play a role, recite poetry, play an instrument, give a lecture, run, jump, cry, etc. Controlling an expression using a virtual object may also mean conveying some information to a receiver via one or more virtual objects, for example, making five virtual cars run in a circle to represent the Olympic rings.

[0136] An event refers to a place where information is externally presented to a recipient, such as a live music event, a theater event, or a seminar event.

[0137] A product is an item that is the subject of a transaction. A service is something that one entity provides to another entity. It is acceptable to interpret a virtual object as either a product or a service.

[0138] The predetermined authority (hereinafter abbreviated as the predetermined authority) for a product or service related to an object, event, or expression includes, for example, the authority to own, lend, or use this real object in the real space if the product is a real object in the real space. If the product is data, the predetermined authority includes the authority to obtain, copy, modify, or use this data. For a service, the predetermined authority includes the authority to receive the service.

[0139] As non-limiting examples, specific examples of the predetermined rights are given below. ·The right to purchase or borrow actual items (such as figurines) that imitate the virtual characters that appear in the event. ·The right to purchase or borrow actual clothing worn by the virtual characters that appear in the event. ·The right to purchase or borrow actual possessions, such as guitars, carried by the virtual characters that appear in the event. ·The right to purchase or borrow actual items corresponding to the stage props that appear in the event (including both virtual stage props and props in the real world). ·The right to obtain or use data representing the virtual characters that appear in the event, the clothing worn by the characters, or the virtual items carried by the characters. ·The right to add sound effects to the actual items or virtual objects that appear in the event. For example, changing the engine sound of a virtual car. ·The right to purchase or borrow actual items related to the event, such as the official T-shirt or official towel of the event. ·The right to purchase or borrow physical media, such as CDs or DVDs, that contain the music used in the event. ·The right to purchase or be loaned physical media such as CDs or DVDs containing music related to the event or expression (for example, music provided by another artist belonging to the same agency as the event participant, or other music included in a compilation album that includes music used at the event). ·The right to download or stream data containing the above-mentioned music. ·The right to purchase or be loaned merchandise related to objects that appeared in the event or were included in the expression, for example, receiving green peppers delivered if an event participant says "green pepper." ·The right to use data showing the various objects listed above in video games, games with AR displays, etc. ·The right to have the various objects listed above appear in other media related to the event (animation, manga, games, etc.). These are merely examples, and the predetermined authority may be authority other than those mentioned above.

[0140] Information for allowing a user to acquire specific authority (information for acquiring authority) refers to information that allows a user to express an intention to acquire authority when presented with the information, such as information for displaying a purchase button for the authority to purchase an item.

[0141] Displaying the authority acquisition information on a display device means outputting display data for displaying the authority acquisition information to a device (such as the user terminal 20) equipped with a display device or to a display device. Displaying the authority acquisition information on a display device may also mean outputting a command to display the authority acquisition information to a device (such as the user terminal 20 capable of generating or storing display data) or to a display device that already has the display data.

[0142] The input operation information by the user means operation information input by the user. For example, information input by tapping or swiping a specific area of ​​the touch panel display of the user terminal 20, or information input by voice input, etc., corresponds to the input operation information. In addition, information input by a user using AR glasses through gesture input, etc., corresponds to the input operation information. In addition, information input by a user via various input devices such as a keyboard or a mouse corresponds to the input operation information.

[0143] Product information means information indicating a product or service. For example, if a T-shirt is a product to be purchased, image information indicating the T-shirt displayed by the display device, icon image information indicating the T-shirt, etc., corresponds to product information. For a service that allows streaming playback of a specific song, character string information indicating the title of the song, icon image information, etc., corresponds to product information. Product information may be displayed in AR. AR display means displaying an object by superimposing it on real space, etc. Clothes worn by a virtual character object (including a virtual human) displayed on the display device, the character itself (the product is a 1 / N-sized figure, etc.), goods with a team logo worn by a professional player in a many-to-many battle royal game tournament, a gaming PC used by the professional player in the tournament, etc., may be displayed in AR as product information. AR-displayed accessories worn by a person in real space reflected in the display device also correspond to product information.

[0144] The product information may be displayed in a manner other than AR display. For example, a real stage prop placed at an event venue in the real space may be reflected on a display device such as a touch panel display of a smartphone or AR glasses. The real object reflected on the display device may correspond to product information indicating a related product (such as a miniature toy of a stage prop). For example, a user can tap an area on a touch panel display where the real object is reflected to indicate an intention to purchase a related product. To achieve this, the server 10Z or the user terminal 20 may provide a function to set an area of ​​the real object reflected on the display device as an inputtable area so that the user can select an area where the real object reflected on the display device is located and perform input.

[0145] Controlling a representation using one or more virtual objects including a first object depending on whether or not authority has been acquired means controlling the representation so that at least a part of the representation differs between a user who has acquired authority and a user who has not acquired authority.

[0146] Augmented reality dioramas refer to virtual dioramas that are superimposed on real space and output. For example, cities, roads, railroad tracks, buildings, buildings, baseball and soccer stadiums, shrines and temples, castles, mountains, oceans, rivers, swamps, forests, fields, rice paddies, airports, underground passages, caves, etc., expressed as 3D model data for augmented reality (AR) display, are examples of augmented reality dioramas. Note that an augmented reality diorama does not necessarily have to be based on a modern landscape that actually exists. For example, the streets and buildings of medieval Europe, and fictional streets and buildings that appear in animations and comics, etc., are also included in augmented reality dioramas.

[0147] Displaying an augmented reality diorama on a display device means outputting display data for displaying the augmented reality diorama so as to be superimposed on real space to a device (such as user terminal 20) equipped with a display device or to the display device. Displaying an augmented reality diorama on a display device may also mean outputting a command to a device (such as user terminal 20 capable of generating or storing display data) or to a display device that already has the display data, for displaying the augmented reality diorama so as to be superimposed on real space.

[0148] The input information by the user means input information originating from the user. For example, information input via the user terminal 20 corresponds to the input information by the user. Note that the server 10Z may acquire the input information from the user terminal 20 via the communication network 30.

[0149] In addition, input information acquired by the server 10Z separately without the intervention of the user terminal 20 may be used as the input information by the user. For example, when the server 10Z acquires as log data the behavior history information of the past behavior of an avatar associated with the user or the user himself / herself in an augmented space corresponding to an event such as an augmented reality diorama or a live event, this log data may correspond to the input information by the user. In addition, information related to the user acquired by the server 10Z from an external system such as another server 40 also corresponds to the input information by the user. For example, purchase history information when the user purchases a product using another product sales site, usage history information when the user uses a transportation such as a train, content data posted by the user on a SNS service, text information indicating a statement made via a SNS service, etc. may also be included in the input information by the user referred to here.

[0150] The accumulated information means information accumulated in a storage device accessible from the processing subject (here, the server 10Z). For example, the accumulated information includes attribute information (age, preferences, etc.) of each user, purchase history information, detailed information of the event (performance name, performance date, performance location, performers, organizers, co-organizers, music used, name of the animation program tied up, etc.) stored in the storage device. The accumulated information may be information accumulated according to the progress of the event. For example, the total number of participants in a live event currently being held, how many people are watching which stage, impression information and evaluation information inputted via the user terminal 20, etc. for the live event, estimated value information indicating the degree of excitement of the live event, etc., correspond to the accumulated information. In other words, the accumulated information is various information that is not limited to information related to individual users. The accumulated information may also include various attribute information of virtual objects displayed in AR and various attribute information of augmented reality dioramas.

[0151] Recommendation information refers to information that indicates products or services for which a user is recommended to acquire rights. For example, recommendation information includes title information of a CD that contains a song sung by an artist at a live music event, and link information for accessing a site where the CD can be purchased. In addition, for a live stage play event, URL information of a site for acquiring rights to stream past performances by the theater company that organized the play also corresponds to recommendation information. Types of recommendation information are not limited to these.

[0152] Displaying the recommended information on a display device means outputting display data for displaying the recommended information to a device (such as the user terminal 20) that has a display device or to a display device. Displaying the recommended information on a display device may also mean outputting a command to display the recommended information to a device (such as the user terminal 20 that can generate or store display data) or to a display device that already has the display data.

[0153] Next, a program execution process according to the seventh embodiment of the present invention will be described below with reference to a flowchart of FIG 16, which shows an example of an event providing process according to at least one of the embodiments of the present invention.

[0154] The augmented reality diorama display unit 104 displays an augmented reality diorama superimposed on real space on the display device (St111). The object display unit 101 displays a first object, which is a virtual object, on the display device by superimposing it on real space (St112). The expression control unit 102 controls the expression using one or more virtual objects including the first object (St113). The recommended information display unit 105 displays recommended information indicating a product or service for which the user is recommended to acquire authority on the display device according to the content of the expression using one or more virtual objects including the first object, information input by the user, or predetermined accumulated information (St114). The authority acquisition information display unit 103 acquires input operation information by the user for product information, which is information indicating a product or service displayed on the display device (St115). When the authority acquisition information display unit 103 acquires the input operation information, it displays on the display device information (authority acquisition information) for allowing the user to acquire specified authority for products or services related to the object, event, or expression (St116).

[0155] At least steps St111, St114 and St115 do not have to be provided.

[0156] FIG. 17 is a conceptual diagram showing a display example by a display device corresponding to at least one of the embodiments of the present invention. In the example of this embodiment, the display device DISP is a touch panel display provided in the user terminal 20. However, as described above, the display device DISP may be a display device that is built into another device such as AR glasses or connected to the other device. A captured image captured by a camera (not shown) provided in the user terminal 20 is displayed by the display device DISP. Therefore, a television existing in the real space is reflected in the display device DISP. A first object OBJ1, which is a virtual object, is displayed superimposed on the real space on the display device DISP (step St112). In addition, a second object OBJ2, which is a virtual object, is also displayed superimposed on the real space on the display device DISP. In the example of this embodiment, the first object OBJ1 corresponds to an artist in a music live event, and the second object OBJ2 corresponds to a synthesizer for performance. In FIG. 17, the entire display screen of the display device DISP corresponds to the first area.

[0157] The expression control unit 102 controls the expression using one or more virtual objects including the first object (St113). In the example of this embodiment, the expression control unit 102 controls the expression using the first object OBJ1 and the second object OBJ2. The content of the expression is, for example, holding a live music performance using virtual objects. Under the control of the expression control unit 102, the first object OBJ1 displayed in AR corresponding to an artist sings, dances, and talks. The second object OBJ2 displayed in AR corresponding to a synthesizer emits a sound when played by the first object OBJ1, the artist. Note that the expression is not limited to only visual expressions. Expressions using various information that can be received by the user are possible, such as auditory expressions (such as singing or the sound of an instrument) and tactile expressions (such as vibrations caused by a woofer).

[0158] 18 is a conceptual diagram showing an example of display by a display device corresponding to at least one of the embodiments of the present invention. In this embodiment, the jacket of the first object OBJ1 displayed on the display device DISP is a product that can be purchased by the user. In other words, the jacket corresponds to product information, which is information indicating a product or service displayed on the display device.

[0159] In this embodiment, the user taps on the jacket portion of the first object OBJ1 displayed on the display device DISP, which is a touch panel display. This tap corresponds to input operation information by the user. The user terminal 20 transmits the input operation information to the server 10Z, and the authority acquisition information display unit 103 of the server 10Z acquires the input operation information (St115). Then, the authority acquisition information display unit 103 displays the authority acquisition information R1 and R2 on the display device DISP (St116).

[0160] 18 is information for allowing a user to obtain authority to own a product (jacket) related to a first object OBJ1 corresponding to an artist. Here, the authority acquisition information R1 indicating product information (product title, product price, product image, etc.) when purchasing a jacket, and a Buy button for a user to indicate an intention to purchase correspond to the authority acquisition information. A user can purchase a jacket by tapping the Buy button displayed on the display device DISP, and in the example of this embodiment, the jacket, which is a product, is mailed to the user's home, for example, based on the control of the server 10Z and the other server 40.

[0161] The display mode of the authority acquisition information shown in FIG. 18 is merely an example. The authority acquisition information may be displayed in other modes. For example, the second area is dynamically popped up on the display device DISP, but the first area and the second area may be displayed separately from the beginning. The authority acquisition information is displayed in AR in FIG. 18, but it does not have to be displayed in AR. Also, in FIG. 18, the authority acquisition information is displayed in the second area different from the first area, but the authority acquisition information may be displayed in the first area without providing the second area.

[0162] Furthermore, in FIG. 18, the authority acquisition information is displayed when the server 10Z acquires the input operation information by the user, but the authority acquisition information may be displayed without acquiring the input operation information. For example, the authority acquisition information display unit 103 may display the authority acquisition information when a predetermined condition is satisfied, such as when the music live event progresses and the artist finishes singing the third song. The predetermined condition is not limited to the above example. The predetermined condition may be any condition related to an object, an event, or an expression. For example, the predetermined condition may be a condition such as the number of viewers of the live event being 1000 or more 20 minutes after the start of the live event, or the artist mentioning today's costume during the music live.

[0163] Fig. 19 is a conceptual diagram showing a display example by a display device corresponding to at least one of the embodiments of the present invention. Fig. 19 shows a case where the authority acquisition information is displayed in the first area without providing the second area.

[0164] A user can purchase a synthesizer that appeared at a live music event as a product. Therefore, a second object OBJ2 corresponding to a synthesizer displayed on the display device DISP corresponds to product information. The user taps the displayed second object OBJ2. This tap corresponds to input operation information by the user. The user terminal 20 transmits the input operation information to the server 10Z, and the authority acquisition information display unit 103 of the server 10Z acquires the input operation information (St115). Then, the authority acquisition information display unit 103 displays authority acquisition information R3 on the display device DISP (St116).

[0165] 19 is information for allowing the user to obtain authority to possess a synthesizer, which is a product. That is, the speech bubble popped up above the second object OBJ2 and the information indicating the product information (product title, model number, product price, etc.) displayed in the speech bubble correspond to the authority acquisition information. In the example of this embodiment, the user can purchase a synthesizer by double-tapping the second object OBJ2, and in the example of this embodiment, the synthesizer, which is a product, is mailed to the user's home.

[0166] In the above example, the synthesizer corresponds to a product related to the second object, but is also a product related to the live music event, and can also be interpreted as a product related to the expression in the live music event.

[0167] The product information may be information indicating a predetermined service. For example, when a user taps on the hand of the first object OBJ1 corresponding to an artist, information indicating a service such as "You can shake hands with the artist at a later date" may be displayed on the display device DISP. The content of the service is not limited to handshakes, and various services are possible. For example, the first object OBJ1 may be an avatar used by a person who submits a video to a video sharing site, and the service may be one in which the avatar appears in a predetermined animation program, game, or the like.

[0168] Fig. 20 is a conceptual diagram showing a display example by a display device corresponding to at least one of the embodiments of the present invention. Fig. 20 shows an example (step St111) in which the augmented reality diorama display unit 104 displays the augmented reality diorama ARD1 on the display device DISP. In this example of the present embodiment, a live stage at a live music event is AR-displayed as an augmented reality diorama. A first object OBJ1 is displayed on the display device DISP together with the augmented reality diorama ARD1.

[0169] FIG. 21 is a conceptual diagram showing a display example by a display device corresponding to at least one of the embodiments of the present invention. FIG. 21 shows an example (step St111) of displaying the augmented reality diorama ARD2 in the second area of ​​the display device DISP. The augmented reality diorama display unit 104 may display the augmented reality diorama ARD2 at a timing different from step St111, and may display the augmented reality diorama ARD2 without displaying the first object OBJ1. In the example of this embodiment, in the above-mentioned FIG. 20, when the user taps on the jacket part (information on products, etc.) of the first object OBJ1 displayed on the touch panel display, the display device DISP displays as shown in FIG. 21. When the jacket part (information on products, etc.) of the first object OBJ1 is tapped, a text message or a voice message such as "Please come to the sales tent to purchase products" may be output to the user terminal 20 or the display device under the control of the server 10Z or the user terminal 20.

[0170] In Fig. 20, the user points the tablet terminal, which is the user terminal 20, in the direction of the TV in his / her home. In Fig. 21, the user points the tablet terminal in the opposite direction to the direction of the TV in his / her home. Therefore, a clock hanging on the wall of the user's home, which exists in real space, is reflected in the display device DISP. The augmented reality diorama ARD2 displayed on the display device DISP corresponds to a merchandise tent at a music festival event.

[0171] The authority acquisition information R4 in FIG. 21 is information for allowing the user to acquire authority to possess a product (jacket) related to the first object OBJ1 corresponding to the artist. The pop-up displayed speech bubble and information indicating the product information (product title, product price, product image, etc.) displayed in the speech bubble correspond to the authority acquisition information R4. The authority acquisition information R4 is displayed by the display device DISP together with the augmented reality diorama ARD2. In the example of this embodiment, the user can purchase the jacket by double tapping the speech bubble, and in the example of this embodiment, the product, a synthesizer, is mailed to the user's home.

[0172] The display device DISP further displays a cash register area RR and customer service characters A1 to A5. The cash register area RR and customer service characters A1 to A5 may be controlled by the server 10Z or by the user terminal 20. When the server 10Z controls the cash register area RR and the customer service characters A1 to A5, the server 10Z may further include a cash register area display unit and a customer service character display unit. In this case, the processor included in the server 10Z refers to an event providing program stored (installed) in the storage device and executes the program to functionally realize the cash register area display unit and the customer service character display unit.

[0173] The cash register area display unit has a function of displaying on the display device a virtual cash register area for allowing the user to obtain the authority described above. The customer service character display unit has a function of displaying on the display device one or more customer service characters that serve the user together with the cash register area.

[0174] In the example of FIG. 21, five attendant characters A1 to A5 are arranged in the cash register area RR. The rock festival 2021 is virtually held in the extended space, and the attendant character A1 attends to the user regarding the sale of official goods of the rock festival 2021. The attendant character A2 attends to the user regarding the sale of goods of artists performing on the wind stage, one of the three AR displayable stages of the rock festival 2021. The attendant character A3 attends to the user regarding the sale of goods of artists performing on the sea stage, one of the three AR displayable stages of the rock festival 2021. The attendant character A4 attends to the user regarding the sale of goods of artists performing on the forest stage, one of the three AR displayable stages of the rock festival 2021. The attendant character A5 attends to the user regarding the fan club membership service of all artists appearing in the rock festival 2021. The user can, for example, tap the displayed character to display a list screen (not shown) listing tradable products or services on the display device DISP, and can then trade the desired product or service. Note that the user interface for the above-mentioned transaction is not particularly limited, and can be appropriately designed and implemented by those skilled in the art.

[0175] 22 is a conceptual diagram showing a display example by a display device according to at least one of the embodiments of the present invention. FIG. 22 illustrates a stage play event in which a story of fighting a dragon is performed in an AR space.

[0176] In the example of the present embodiment, the display device DISP is a touch panel display provided in the user terminal 20. However, as described above, the display device DISP may be a display device built into another device such as AR glasses or connected to the other device. A captured image captured by a camera (not shown) provided in the user terminal 20 is displayed by the display device DISP. Therefore, a television existing in the real space is reflected in the display device DISP. A dragon EN, which is a virtual object, is displayed superimposed on the real space on the display device DISP. A first object OBJ1, which is a virtual object, is displayed superimposed on the real space on the display device DISP (step St112). The first object OBJ1 is the protagonist in a play that fights the dragon EN. The augmented reality diorama ARD3 corresponds to the stage of a stage play. In FIG. 22, the entire display screen of the display device DISP corresponds to the first area.

[0177] The expression control unit 102 controls the expression using one or more virtual objects including the first object (St113). In the example of the present embodiment, the expression control unit 102 controls the expression using the first object OBJ1 and the dragon EN. The expression here is a live stage performance using virtual objects. Under the control of the expression control unit 102, the first object OBJ1, which corresponds to the main character and is displayed in AR, fights the dragon EN, which is also displayed in AR. Note that the content of the expression is not limited to only visual. For example, expressions using various information that the user can receive, such as auditory expression (BGM during battle) and tactile expression (vibration when an attack hits an enemy), are possible.

[0178] Fig. 23 is a conceptual diagram showing a display example by a display device corresponding to at least one of the embodiments of the present invention. Explanation of matters similar to those in Fig. 22 will be omitted. In Fig. 23, a second area is provided on the display device DISP. In addition, a recommendation area RE is displayed on the display device DISP.

[0179] First, the recommendation area RE will be described. The recommendation information display unit 105 displays, on the display device, recommendation information indicating products or services for which the user is recommended to acquire authority, according to the contents of the expression using one or more virtual objects including the first object, the input information by the user, or the predetermined stored information (St114). In FIG. 23, this recommendation information is displayed in the recommendation area RE.

[0180] The recommendation area RE shown in Figure 23 displays recommendation information indicating a service that allows the main character, the first object OBJ1, to be equipped with a shield to protect himself from dragon attacks, in accordance with the content of the expression using the first object OBJ1, i.e., "a story about fighting a dragon."

[0181] Also, in response to the character string "theme song" input by the user via the user terminal 20, recommendation information indicating a service for playing a song called "Rising Dragon" sung by artist "Mr. SEJ" as background music in the play is displayed in the recommendation area RE. This recommendation information may be displayed in the form of a musical note-shaped icon, an artist name, artwork including the song name, or the like. However, the display form is not limited to this. In the example of this embodiment, it is assumed that the fictional artist "Mr. SEJ" is a person who sings the ending theme song (a different song from "Rising Dragon") in the animated version of the stage play "AR Quest". Also, performance information (voice cast, production company, theme song, etc.) of the stage play "AR Quest" is stored as accumulated information in a storage device accessible from the server 10Z. Based on this accumulated information, recommendation information indicating a figure that is an official product of artist "Mr. SEJ" involved in the stage play "AR Quest" is displayed in the recommendation area RE.

[0182] Since the recommendation information is information indicating a product or service, it also corresponds to product information, which is information indicating a product or service displayed on a display device. Therefore, when a user taps the recommendation information displayed in the recommendation area RE, the authority acquisition information display unit 103 displays the authority acquisition information R5 and R6 on the display device DISP based on the input operation information related to this tap.

[0183] The authority acquisition information R5 and R6 in FIG. 23 are information for allowing the user to acquire authority to receive a service for playing the song "Rising Dragon" as background music in the movie. In other words, the artwork representing the song and the Buy button for the user to indicate their intention to purchase correspond to the authority acquisition information. The user can view the song by streaming playback by swiping the artwork (authority acquisition information R5) to the Buy button (authority acquisition information R6). Note that the display mode of the authority acquisition information shown in FIG. 23 is merely an example, and other display modes may be adopted.

[0184] Here, the expression control unit 102 has a function of controlling the expression depending on whether or not authority has been acquired. In the example of this embodiment, when a user acquires authority to receive a service to play the song "Rising Dragon" as background music in a play, the server 10Z acquires information indicating that the user has acquired the authority, and the expression control unit 102 switches the background music of the stage "AR Quest" from another song to "Rising Dragon" depending on this information. In addition, the expression control unit 102 controls the action of the first object OBJ1, which is the main character, and makes the main character bow. For example, as in these cases, the expression control unit 102 may change the content of the expression depending on whether or not authority has been acquired. Note that the change in the content of the expression is not limited to a change in background music or a predetermined action by an object. For example, the development of the story may be branched depending on whether or not authority has been acquired. A virtual object that appears in a stage play event may change depending on whether or not authority has been acquired. For example, for a user who has acquired authority to use a shield, the first object OBJ1, which is the main character in the play, is made to hold a shield. For a user who has acquired authority to use a sword, the first object OBJ1, which is the main character in the play, is made to hold a sword. In the case of a live music event, the song (repertoire) sung by the artist may be changed depending on whether or not authority has been acquired. The attributes of a virtual object such as a first object used in the expression may be changed depending on whether or not authority has been acquired. For example, if the first object is an avatar, the "voice quality" that is an attribute of the avatar may be changed. For example, the first object OBJ1 may be made to converse in the voice of voice actor A when the user has not acquired authority, and in the voice of voice actor B when the user has acquired authority. This makes it possible to provide individualized expressions depending on the purchasing behavior of the user while providing a basically uniform expression to the participants of the event.

[0185] The user may obtain authority at a timing other than when the expression is in progress. For example, the user may obtain authority one week before the live event in which the first object OBJ1 is displayed in AR is held. The user purchases a product in advance, and transmits product information of the product that has arrived at the user's home to the server 10Z via the user terminal 20 or the like. There is no particular limitation on the method of transmitting the product information to the server 10Z. For example, the user touches an NFC tag embedded in the product to the user terminal 20, and the user terminal 20 reads data from the product. The processor included in the user terminal 20 generates product information based on this data reading, and transmits this to the server 10Z. Alternatively, the user terminal 20 may read a barcode attached to the product using a barcode reader, generate product information, and transmit this to the server 10Z. Alternatively, the camera included in the user terminal 20 may take a picture of the product, and the user terminal 20 or the server 10Z may perform image recognition on the captured image data to extract the product information. When the product information is transmitted to the server 10Z via the user terminal 20, the expression control unit 102 of the server 10Z can recognize that the user has previously acquired authority. The expression control unit 102 may control the expression depending on whether the user has previously acquired authority.

[0186] (Display of information for obtaining authority and recommendation information according to the progress of expression) Next, the display of authority acquisition information and recommendation information according to the progress of expression will be described. The authority acquisition information display unit 103 has a function of displaying authority acquisition information on a display device in a display mode based on the progress of expression. The recommendation information display unit 105 has a function of displaying recommendation information on a display device in a display mode based on the progress of expression.

[0187] The progression of an expression means, for example, in a live music event, the state of the event changes, such as when an artist finishes singing the first song and starts the second song, when he or she makes a mistake in the lyrics during a song and starts over, when they come back on stage in response to an encore, etc. In a stage play event, it means the state of the event changes, such as when the curtain rises, the actors appear, the story unfolds, the scene changes, etc.

[0188] The display mode means, for example, the timing of display, the display position, the display color, the display size, the display font, the presence or absence of an effect to emphasize the display, the presence or absence of an animation display, whether or not to display in AR, whether to display in text or pictures, whether or not to display in a way that accepts user input, etc. The above are merely examples, and other display modes are also possible.

[0189] 24 is a conceptual diagram showing an example of a display by a display device corresponding to at least one of the embodiments of the present invention. Fig. 24 shows a scene after a first object OBJ1, which is the main character, has defeated a dragon EN.

[0190] In the recommendation area RE shown in Fig. 24, recommendation information is displayed indicating a service for playing the song "VICTORY" sung by the artist "Mr. SEJ" as background music in a play in accordance with the content of the expression using the first object OBJ1, i.e., "a dragon was defeated in a story of fighting a dragon." That is, the authority acquisition information display unit 103 controls the display timing of the recommendation information for the song "VICTORY" triggered by the first object OBJ1, the protagonist, defeating the dragon EN during the progress of the stage play. Also, the authority acquisition information display unit 103 controls the display mode of the recommendation information for the song "VICTORY" so that the text information and the frame are highlighted in bold, triggered by the first object OBJ1, the protagonist, defeating the dragon EN during the progress of the stage play.

[0191] In addition, the authority acquisition information display unit 103 may display the recommendation information on the display device DISP in various display modes triggered by various conditions, such as an artist finishing singing three songs and starting to talk at a live music event, a predetermined number of seconds having passed since the climax scene at a live theater event, or a competing player using a predetermined item at a competitive gaming event.

[0192] The second area shown in FIG. 24 is located at the upper left side of the display device DISP, and the authority acquisition information R7 and R8 are displayed in this second area. The authority acquisition information R7 and R8 are information for allowing the user to acquire authority to receive a service for playing the song "VICTORY" as background music in the play. When the authority acquisition information is displayed, it may prevent the user from immersing himself in the expression performed in the event. Therefore, in the example of this embodiment, the authority acquisition information display unit 103 controls the display mode so that the display position of the authority acquisition information R7 and R8 is moved from the left side of the display device DISP (see FIG. 23) to the upper left side of the display device DISP (see FIG. 24) when the first object OBJ1, the main character, defeats the dragon EN. That is, the authority acquisition information display unit 103 causes the display device to display the authority acquisition information in a display mode based on the progress of the expression.

[0193] The manner in which the display position of the authority acquisition information is changed is not limited to the above manner. For example, the authority acquisition information display unit 103 or the recommended information display unit 105 may display the authority acquisition information (second region) or the recommended information (recommended region RE) on the display device DISP so as to be superimposed on other objects reflected on the display device DISP. The authority acquisition information or the recommended information may be displayed in a non-transparent state. This allows a specific object that is not to be perceived by the user as an expression in an event such as a live music concert or a live theater performance to be hidden by the authority acquisition information (second region) or the recommended information (recommended region RE).

[0194] For example, there is an expression in which the object display unit 101 displays the first object OBJ1 on the display device DISP so that the first object OBJ1 is superimposed on video data (including not only download playback but also data related to streaming playback and live broadcast distribution) taken of a live event such as a live music concert or a live theater concert held in the real space. This expression can be interpreted as a mixed event that mixes an event in the real space with augmented reality. An example of the above-mentioned predetermined object that the user does not want to perceive as an expression is an event staff member placed under the live stage in the real space at a mixed event. The event staff member stands or crouches under the stage and waits to ensure the safety of the audience and the artists.

[0195] As one aspect of the seventh embodiment, an event using augmented reality can be held, and goods and services can be sold at the event.

[0196] As one aspect of the seventh embodiment, when a user expresses an intention to acquire authority, for example, to purchase a product, the authority acquisition information can be displayed. This allows a user who has no intention to acquire authority to concentrate on participating in the event.

[0197] As one aspect of the seventh embodiment, by separating a first area used at the event from a second area for purchasing products, etc., displays for purchasing products, etc. do not hinder users' participation in the event.

[0198] As an aspect of the seventh embodiment, different effects can be performed during an event depending on whether or not the user has acquired authority. This allows different users to experience different events even if the event is basically the same, and individualizes the event.

[0199] As one aspect of the seventh embodiment, the user can express his / her intention to obtain authority in the augmented reality space.

[0200] As one aspect of the seventh embodiment, the authority acquisition information can be displayed in a manner appropriate for the event.

[0201] As one aspect of the seventh embodiment, the venue where the event is held can itself be set up in an augmented reality space, and users can freely take actions such as participating in the event, purchasing goods, or receiving services at the event venue represented by augmented reality.

[0202] As one aspect of the seventh embodiment, suitable products or services can be recommended to a user at an event held in an augmented reality space.

[0203] As one aspect of the seventh embodiment, recommendation information can be displayed in a manner appropriate for an event.

[0204] As described above, each embodiment of the present application solves one or more deficiencies. Note that the effects of each embodiment are non-limiting effects or examples of effects.

[0205] In each of the above-described embodiments, the multiple user terminals 20, 20A to 20C and the server 10 execute the above-described various processes in accordance with various control programs (for example, an event providing program) stored in their own storage devices.

[0206] The configurations of the event provision system 100 and the event provision system 100A are not limited to those described as examples of the above-mentioned embodiments. For example, the server 10 may execute some or all of the processes described as processes executed by the user terminal, or any of the multiple user terminals 20, 20A to 20C may execute some or all of the processes described as processes executed by the server 10. Furthermore, any of the multiple user terminals 20, 20A to 20C may include some or all of the storage unit (storage device) included in the server 10. That is, the event provision system 100 or the event provision system 100A may include some or all of the functions included in either the user terminal or the server of the other one.

[0207] Furthermore, the program may be configured to realize some or all of the functions described as examples of each of the above-mentioned embodiments in a standalone device that does not include a communication network.

[0208] [Note] The above description of the embodiments has been provided so that at least one person having ordinary skill in the art can carry out the invention. [1] An event provision program, On the server, an object display function of superimposing a first object, which is a virtual object, on a real space and displaying the first object on a display device; An expression control function that controls an expression using one or more virtual objects including the first object; an authority acquisition information display function for displaying, on the display device, information for allowing a user to acquire a predetermined authority for a product or service related to the object, the event, or the expression (hereinafter referred to as "authority acquisition information"); An event provision program to make this a reality. [2] The authority acquisition information display function includes a function of displaying the authority acquisition information on the display device when input operation information by a user for product information, which is information indicating the product or service displayed on the display device, is acquired. The event provision program described in [1] in order to make this happen. [3] The authority acquisition information display function includes a function of displaying the authority acquisition information in a second area different from a first area in which the first object is displayed on the display device. The event provision program described in [1] or [2] above in order to realize the above. [4] The expression control function includes a function of controlling the expression depending on whether the authority is acquired or not. An event provision program according to any one of [1] to [3] for realizing the above. [5] The display of the authority acquisition information is performed by superimposing it on a real space. An event provision program according to any one of [1] to [4]. [6] The authority acquisition information display function includes a function of displaying the authority acquisition information on the display device in a display mode based on the progress of the expression. An event provision program according to any one of [1] to [5] for realizing the above. [7] The server, Further realizing an augmented reality diorama display function that displays an augmented reality diorama superimposed on real space on a display device; At least one of the first object and the authority acquisition information is displayed by the display device together with the augmented reality diorama. An event provision program according to any one of [1] to [6]. [8] The server, a recommendation information display function for displaying, on the display device, recommendation information indicating a product or service for which the user is recommended to acquire authorization, according to the content of the expression, the input information by the user, or predetermined stored information; An event provision program according to any one of [1] to [7] for realizing the above. [9] The recommended information display function includes a function of displaying the recommended information on the display device in a display mode based on the progress of the expression. The event provision program described in [8] to make this a reality.

[10] A program for causing a user terminal capable of communicating with a server to realize at least one of the functions that the event providing program according to any one of [1] to [9] causes the server to realize.

[11] A server on which the event providing program according to any one of [1] to [9] is installed.

[12] An event providing system including a communication network, a server, and a user terminal, an object display means for displaying a first object, which is a virtual object, on a display device by superimposing the first object on a real space; An expression control means for controlling an expression using one or more virtual objects including the first object; an authority acquisition information display means for displaying on the display device a display (hereinafter referred to as "authority acquisition information") for allowing a user to acquire a predetermined authority for a product or service related to the object, the event, or the expression; An event delivery system.

[13] An event provision program, On the user terminal, an object display function of superimposing a first object, which is a virtual object, on a real space and displaying the first object on a display device; An expression control function that controls an expression using one or more virtual objects including the first object; an authority acquisition information display function for displaying, on the display device, a display for allowing a user to acquire a predetermined authority for a product or service related to the object, the event, or the expression (hereinafter referred to as "authority acquisition information"); An event provision program to make this a reality.

[14]

[13] A user terminal having the event providing program described in

[13] installed thereon.

[15] An event provision program, A computer device includes: an object display function of superimposing a first object, which is a virtual object, on a real space and displaying the first object on a display device; An expression control function that controls an expression using one or more virtual objects including the first object; an authority acquisition information display function for displaying, on the display device, a display for allowing a user to acquire a predetermined authority for a product or service related to the object, the event, or the expression (hereinafter referred to as "authority acquisition information"); An event provision program to make this a reality.

[16] A method for providing an event by a computer device, comprising: an object display process for displaying a first object, which is a virtual object, on a display device by superimposing the first object on a real space; An expression control process for controlling an expression using one or more virtual objects including the first object; and an authority acquisition information display process for displaying, on the display device, a display for allowing a user to acquire a predetermined authority for a product or service related to the object, the event, or the expression (hereinafter referred to as "authority acquisition information"). How events are delivered.

[17] An event providing method by an event providing system including a communication network, a server, and a user terminal, comprising: an object display process for displaying a first object, which is a virtual object, on a display device by superimposing the first object on a real space; An expression control process for controlling an expression using one or more virtual objects including the first object; and an authority acquisition information display process for displaying, on the display device, a display for allowing a user to acquire a predetermined authority for a product or service related to the object, the event, or the expression (hereinafter referred to as "authority acquisition information"). How events are delivered. [Industrial Applicability]

[0209] According to one embodiment of the present invention, an event providing program, an event providing system, and an event providing method can be provided that can hold an event using augmented reality and can sell goods and provide services at the event. [Explanation of symbols]

[0210] 10, 10A, 10B, 10C, 10D, 10Z Servers 11, 21, 41, 61 processors 12, 22, 42, 62 memory 13, 23, 43, 63 storage device 20, 20A, 20B, 20C, 20Z User terminal 30 Communication Network 40 Other servers 60 Response Device 64 Camera 65 Input Devices 66 Display device 100, 100A Event Supply System 101, 201, 501 Object display section 102, 102D, 202, 502 Expression control section 103, 103B, 103C, 203, 503 Information display section for acquiring authority 104 Augmented reality diorama display unit 105 Recommendation information display section A1~A5 Response Characters ARD1~ARD3 Augmented Reality Diorama CTR Controller DISP display device OBJ1 First object OBJ2 Second object R1~R8 Information for obtaining authority RE Recommendation Area RR Cash register area SP Receptionist

Claims

1. An event provision program, On the server, an object display function of superimposing a first object, which is a virtual object, on a real space and displaying the first object on a display device; An expression control function that controls an expression using one or more virtual objects including the first object; an authority acquisition information display function for displaying, on the display device, information for allowing a user to acquire a predetermined authority for a product or service related to the object, the event, or the expression (hereinafter referred to as "authority acquisition information"); An event provision program to make this a reality.

2. The authority acquisition information display function includes a function of displaying the authority acquisition information on the display device when input operation information by a user for product information, which is information indicating the product or service displayed on the display device, is acquired. The event providing program according to claim 1 for realizing the above.

3. The authority acquisition information display function includes a function of displaying the authority acquisition information in a second area different from a first area in which the first object is displayed on the display device. The event providing program according to claim 1 or 2 for realizing the above.

4. The expression control function includes a function of controlling the expression depending on whether the authority is acquired or not. The event providing program according to any one of claims 1 to 3, for realizing the above.

5. An event providing system including a communication network, a server, and a user terminal, an object display means for displaying a first object, which is a virtual object, on a display device by superimposing the first object on a real space; An expression control means for controlling an expression using one or more virtual objects including the first object; an authority acquisition information display means for displaying on the display device a display (hereinafter referred to as "authority acquisition information") for allowing a user to acquire a predetermined authority for a product or service related to the object, the event, or the expression; An event delivery system.

6. An event provision program, On the user terminal, an object display function of superimposing a first object, which is a virtual object, on a real space and displaying the first object on a display device; An expression control function that controls an expression using one or more virtual objects including the first object; an authority acquisition information display function for displaying, on the display device, a display (hereinafter referred to as "authority acquisition information") for allowing a user to acquire a predetermined authority for a product or service related to the object, the event, or the expression; An event provision program to make this a reality.

7. A method for providing an event by a computer device, comprising: an object display process for displaying a first object, which is a virtual object, on a display device by superimposing the first object on a real space; an expression control process for controlling an expression using one or more virtual objects including the first object; and an authority acquisition information display process for displaying, on the display device, a display for allowing a user to acquire a predetermined authority for a product or service related to the object, the event, or the expression (hereinafter referred to as "authority acquisition information"). How events are delivered.

8. An event providing method by an event providing system including a communication network, a server, and a user terminal, comprising: an object display process for displaying a first object, which is a virtual object, on a display device by superimposing the first object on a real space; an expression control process for controlling an expression using one or more virtual objects including the first object; and an authority acquisition information display process for displaying, on the display device, a display for allowing a user to acquire a predetermined authority for a product or service related to the object, the event, or the expression (hereinafter referred to as "authority acquisition information"). How events are delivered.

Images