Methods, programs, and information processing systems for collecting information on visitor behavior at events.

Abstract

This invention provides a method, program, and information processing system that can collect and centrally manage behavioral information at both physical and virtual event venues. [Solution] The method for collecting information on visitor behavior includes the steps of: acquiring visitor information for each visitor who has come to a physical venue; determining whether a predetermined operation corresponding to a predetermined action at a physical venue or a virtual venue was performed at a physical venue or a virtual venue, based on at least one of the acquisition status of visitor information, the content of the predetermined action indicated by the predetermined operation, and the time when the predetermined operation was performed; and storing in a storage device 2, in association with behavior information related to the predetermined action indicated by the predetermined operation, venue information indicating the determination result of the venue where the predetermined operation was performed, and a visitor ID, when a predetermined operation is performed at a visitor device 3.

Description

Technical Field

[0001] The present invention relates to a method, a program, and an information processing system for collecting information on behavior of visitors at an event.

Background Art

[0002] A technique is known that estimates the degree of visitors' interest in exhibited products and the like by collecting and analyzing behavior information regarding the behavior of visitors at events such as exhibitions. For example, Japanese Patent No. 7381134 describes a method for calculating an index relating to the degree of visitors' interest (interest index) with respect to exhibited items and the like based on behavior information of visitors at an event.

Prior Art Literature

Patent Literature

[0003]

Patent Literature 1

Summary of the Invention

Problem to be Solved by the Invention

[0004] Incidentally, the holding period of general events such as exhibitions is limited to several days. After the holding period ends, facilities installed for the event (such as exhibition booths) are promptly removed from the event venue. Therefore, if a person cannot arrange their schedule during the holding period, they have no choice but to give up going to the event. Furthermore, going to the event also becomes difficult when the event venue is located far away, or when the number of visitors is restricted due to a pandemic or the like.

[0005] On the other hand, techniques for creating 3D models from real objects include LiDAR, which measures spatial depth using laser reflection, and photogrammetry, which reproduces the 3D shape of an object using images taken from multiple directions. By using these techniques, it is possible to create a 3D model of a real event venue and provide a 3D image of a virtual event venue.

[0006] Providing video footage of the event venue eliminates the aforementioned constraints of a physical event venue (duration, travel to the venue, and number of attendees). Therefore, it is conceivable to hold events using a virtual event venue created through video, in addition to a physical venue. This would allow people who have difficulty attending a physical event venue to easily experience the event.

[0007] When holding an event using both physical and virtual venues, it is desirable to collect visitor behavioral information at each of these different types of venues. Furthermore, it is desirable to manage the collected behavioral information uniformly as behavioral information for a single event, rather than managing it individually for each venue. In order to ensure that the behavioral information is uniformly managed and useful, it is desirable to correctly record whether the behavioral information was obtained at the physical or virtual event venue.

[0008] This invention has been made in view of the above circumstances, and its purpose is to provide a method, program, and information processing system that can collect and uniformly manage behavioral information at both physical and virtual event venues. [Means for solving the problem]

[0009] A first aspect of the present invention relates to a method for an information processing system to collect information relating to the behavior of attendees at an event, wherein the physical venue of an event is referred to as the physical venue, the venue in which the content of the event can be experienced through video is referred to as the virtual venue, information that identifies an attendee is referred to as attendee identification information, information relating to the behavior of a single attendee in the physical venue or virtual venue is referred to as behavior information, information indicating that a single attendee has come to the physical venue is referred to as attendance information, a device operated by an attendee is referred to as an attendee device, and the steps are to acquire attendance information for each attendee who has come to the physical venue and the physical venue or virtual venue When a predetermined operation corresponding to a predetermined action at a venue is performed on a visitor's device by a visitor, the process of determining whether the predetermined operation was performed at a physical venue or a virtual venue, based on at least one of the following: the status of acquisition of visitor information concerning the visitor, the content of the predetermined action indicated by the predetermined operation, and the time when the predetermined operation was performed; and when a predetermined operation is performed on a visitor's device by a visitor, the process of associating the action information related to the predetermined action indicated by the predetermined operation, venue information indicating the determination result of the venue where the predetermined operation was performed, and the visitor identification information of the visitor, and storing them in a storage device. The system has the following characteristics: the time period during which the physical venue is open is called the opening time period; the time associated with visitor information during which a visitor was at the physical venue is called the visitor time; the time at which a predetermined operation is performed is called the operation time; and when a predetermined operation is performed on a visitor's visitor device, the process of determining the venue in which the predetermined operation was performed includes determining that the predetermined operation was performed at the physical venue if the visitor's visitor information is acquired and the operation time of the predetermined operation is included in the opening time period that includes the visitor's visitor time associated with the visitor information; and determining that the predetermined operation was performed at a virtual venue if the visitor's visitor information is not acquired or the operation time of the predetermined operation is not included in the opening time period that includes the visitor's visitor time. It is a method.

[0010] A program according to a second aspect of the present invention is a program that includes at least one instruction causing an information processing system to perform a process of collecting information relating to the behavior of visitors at an event, wherein the process performed by the information processing system in accordance with the instruction includes each step of the method according to the first aspect of the present invention.

[0011] An information processing system according to a third aspect of the present invention is an information processing system that collects and performs information processing on information relating to the behavior of visitors at an event, and comprises at least one processor and at least one memory, the memory storing at least one instruction that causes the processor to perform processing, and the at least one processor performs information processing including each step of the method according to the first aspect according to the present invention in accordance with the instruction stored in the at least one memory.

[0012] An information processing system according to a fourth aspect of the present invention is an information processing system for collecting information relating to the behavior of visitors at an event, and is equipped with means for performing each step of the method according to the first aspect described above. [Effects of the Invention]

[0013] According to the present invention, it is possible to provide a method, program, and information processing system that can collect and uniformly manage behavioral information at both physical and virtual event venues. [Brief explanation of the drawing]

[0014] [Figure 1] Figure 1 shows an example of the system configuration according to this embodiment. [Figure 2] Figure 2 shows an example of the configuration of an information processing device. [Figure 3] Figure 3 shows an example of the configuration of a visitor device. [Figure 4] Figure 4 is a diagram illustrating the general process involved in collecting visitor behavior information at a physical venue. [Figure 5] Figure 5 is a flowchart illustrating an example of the process involved in collecting visitor behavior information at a physical venue. [Figure 6] Figures 6A and 6B are flowcharts illustrating an example of the process for acquiring visitor information. [Figure 7] Figure 7 shows an example of a screen displaying a virtual venue. [Figure 8] Figure 8 is a flowchart illustrating an example of the process involved in collecting visitor behavior information in a virtual venue. [Figure 9] Figures 9A and 9B are flowcharts illustrating an example of the process used to determine which venue a predetermined operation has been performed on a visitor device. [Figure 10]FIG. 10 is a flowchart for explaining an example of processing for determining a venue where a predetermined operation has been performed in a visitor device. [Figure 11] FIGS. 11A to 11B are flowcharts for explaining an example of processing for determining a venue where a predetermined operation has been performed in a visitor device. [Figure 12] FIGS. 12A to 12B are flowcharts for explaining an example of processing for determining a venue where a predetermined operation has been performed in a visitor device. [Figure 13] FIG. 13 is a diagram showing an example of a screen displaying a virtual venue. [Figure 14] FIG. 14 is a flowchart for explaining an example of processing related to collection of visitor behavior information in a virtual venue. DESCRIPTION OF EMBODIMENTS

[0015] FIG. 1 is a diagram showing an example of the configuration of a system according to the present embodiment. The system shown in the example of FIG. 1 includes an information processing device 1, a visitor device 3, a video display device 4, an admission confirmation device 51, a participant device 52, and a video providing device 7 that can communicate with each other via a communication network 9 such as the Internet. A system including the information processing device 1 and the visitor device 3 is an example of the information processing system of the present invention. The admission confirmation device 51 is an example of a venue-side device and an admission confirmation device according to the present invention. The participant device 52 is an example of a venue-side device according to the present invention.

[0016] The system shown in Figure 1 is a system for collecting and recording information about the behavior of attendees at events (exhibitions, seminars, etc.). This system processes data to provide a separate venue (which may be referred to as a "virtual venue") where attendees can experience the event content through video, in addition to the physical event venue (which may be referred to as a "physical venue"). The system also determines and records whether a predetermined action by an attendee at the event took place in the physical venue or the virtual venue. This makes it possible to collect and uniformly manage useful information showing what actions attendees took at each venue.

[0017] [Information Processing Device 1] Information processing device 1 receives information about visitors' actions from visitor devices 3, entry confirmation devices 51, participant devices 52, etc., and processes the action information corresponding to the received information to be stored in the storage device 2 described later. Information processing device 1 also determines whether the action related to the action information is an action in a physical venue or a virtual venue, and stores information indicating the determination result in the storage device 2 in association with the action information.

[0018] The information processing device 1, as shown in Figure 2 for example, includes a communication unit 11, a storage unit 12, and a processing unit 13.

[0019] The communication unit 11 communicates with other devices (visitor devices 3, video display devices 4, entry verification devices 51, participant devices 52, etc.) via the communication network 9. The communication unit 11 includes devices (network interface cards, wireless communication modules, etc.) that communicate in accordance with a predetermined communication method (Ethernet®, wireless LAN, etc.). The communication unit 11 may also perform predetermined processing defined in the communication method (encryption, authentication / authorization, retransmission control, queuing, timeout control, etc.).

[0020] The storage unit 12 stores one or more programs 121 containing instructions executed by the processing unit 13, data temporarily stored during processing by the processing unit 13, data used in processing by the processing unit 13, data obtained as a result of processing by the processing unit 13, etc. The storage unit 12 may include, for example, a main memory (RAM, etc.) and a read-only memory (ROM, etc.), and an auxiliary memory (flash memory, SSD, hard disk, memory card, optical disc, etc.). The storage unit 12 may consist of one memory or multiple memory devices. If the storage unit 12 consists of multiple memory devices, each memory device may be connected to the processing unit 13 via a computer bus or other arbitrary communication means.

[0021] The processing unit 13 comprehensively manages the overall operation of the information processing device 1 and performs predetermined information processing. The processing unit 13 includes, for example, one or more processors (CPU (central processing unit), MPU (micro-processing unit), DSP (digital signal processor), GPU (graphics processing unit), NPU (neural network processing unit), etc.) that process according to the instructions of one or more programs 121 stored in the storage unit 12. The processing unit 13 operates as one or more computers by having one or more processors execute the instructions of one or more programs 121 stored in the storage unit 12. The information processing device 1 may have multiple such computers, and at least a part of the processing according to this embodiment may be performed in cooperation with multiple computers.

[0022] The processing unit 13 may include one or more dedicated hardware components (such as an ASIC (application-specific integrated circuit) or FPGA (field-programmable gate array)) configured to implement specific functions. The processing unit 13 may perform all the processing described in this embodiment on a computer, or it may perform some of the processing on a computer and some of the dedicated hardware, or it may perform all of the processing on dedicated hardware.

[0023] The program 121 may be recorded on a computer-readable recording medium (optical disc, memory card, USB memory, or other non-temporary tangible medium), for example. The processing unit 13 may read at least a portion of one or more programs 121 recorded on such a recording medium using a recording medium reading device (such as an optical disc drive) or interface device (such as a USB interface), and write it to the storage unit 12. Alternatively, the processing unit 13 may download at least a portion of one or more programs 121 from an external device connected to the communication network 9 using the communication unit 11 and write it to the storage unit 12. One or more programs 121 may include instructions that cause the processing unit 13 to perform at least a portion of the processing according to this embodiment, which will be described later.

[0024] [Storage device 2] The storage device 2 stores various information used in the processing of the information processing device 1. The information processing device 1 and the storage device 2 are connected via any communication path (LAN, dedicated network, IP network [e.g., the Internet]). The storage device 2 may consist of, for example, a file server, database server, NAS, SAN, or object storage (including cloud storage services) that accepts access from multiple devices, or it may be a dedicated storage device accessible only to the information processing device 1. Alternatively, the storage device 2 may be an internal or external storage device connected to the processing unit 13 of the information processing device 1 via an internal bus or any interface circuit. The storage device 2 may consist of a single device or may be distributed across multiple devices.

[0025] In the example shown in Figure 2, the storage device 2 stores the visitor database 21, the participant database 22, the content management database 23, and the activity record database 24. The storage device 2 also stores multiple content items 25 prepared for visitors by event participants, etc. In the following explanation, databases may be abbreviated as "DB".

[0026] Visitor DB21 contains multiple visitor entries corresponding to multiple visitors. Each visitor entry contains information about a single visitor. Each visitor entry includes, for example, at least some of the following information: • Information that identifies individual visitors (visitor ID) • Date and time when visitor information was registered • Attributes related to visitors

[0027] Visitor information, as attribute information related to visitors, includes at least some of the following information: • Age of visitors • Gender of visitors • Visitor's occupation (field of work) • Visitor's position • The organization (company, department, division, etc.) to which the visitor belongs • The business / industry sector (sector) in which the visitor's organization is involved. • How visitors are involved in the decision to purchase products (e.g., deciding to purchase, recommending products) • Business and industry fields that visitors are interested in • Technological fields that visitors are interested in • Categories of products and services that visitors are interested in

[0028] Participant DB22 contains multiple participant records corresponding to multiple participants attending the event. Each participant record contains information about a single participant (e.g., an exhibitor at a trade show). Each participant record includes, for example, at least some of the following information: • Information that identifies individual participants (Participant ID) • Date and time when participant information was registered. • Participant's name (company name, etc.) • Participant contact information (address, phone number, email address, etc.) • Location of participants at the physical venue (e.g., booth identification number) Attributes related to participants

[0029] As information relating to the participant, participant information includes, for example, at least some of the following information: • The business / industry sector (sector) to which the participant's work belongs. • Technical fields related to the participants' work • Categories of products and services handled by participants

[0030] The content management DB23 contains multiple content information entries related to the content provided to visitors. Each content information entry contains information about a single piece of content. Each content information entry includes, for example, at least some of the following information: • Information that identifies individual content (Content ID) • Information about the content (content name, type, data size, etc.) • Information on products and other items related to the content • One or more participant IDs indicating participants (exhibitors, etc.) related to the content • Location of content storage

[0031] Here, "content storage location" refers to information about the location where the content (content 25 in Figure 2) is stored in the storage device 2, including, for example, the directory and file name where content 25 is stored. The storage location of content 25 is not limited to the storage device 2, but may be another device (such as a data server) connected to the communication network 9.

[0032] The activity log DB24 contains multiple activity records corresponding to multiple visitors. Each activity record contains a record of a specific action taken by a visitor. Each activity record includes, for example, at least part of the following information: • Visitor ID indicating a visitor who performed a specified action • Date and time when the visitor performed the specified action • Participant ID indicating the participant involved in the specified action • Information on products, etc. that were subject to the prescribed action. • Information indicating the venue (physical or virtual) where the specified action will take place (venue information) • Types of actions taken by visitors • Actions taken by visitors

[0033] Here, "types of actions taken by visitors" include, for example, the following: • The participant was registered at an exhibition booth or similar location within the physical venue. (example) The optical code on the admission pass was read by the participant device 52 of the presenter, etc. - Operating designated equipment (such as demonstration units for exhibits) at exhibition booths or other locations within a physical venue. • Receiving explanations from staff or other personnel at a physical venue. • I exchanged business cards with staff members at the physical venue. • Participation in seminars, etc., organized by the participant • Obtaining content from participants (viewing, downloading, emailing, etc.) • Entered reviews or comments on products, etc. • Accessed the webpage for answering the survey. • I answered the survey. • Movement and stay within the event venue

[0034] Furthermore, "the content of the actions taken by visitors" refers to the content of the predetermined actions indicated by "type of action," and includes, for example, the following: • Equipment operated by visitors at the participant's location (exhibition booth, etc.) • Locations where visitors exchanged business cards • Content provided to visitors • Seminars attended by visitors • The content of ratings and comments entered by visitors • Content of visitor responses to the survey (example) Level of interest in the product, desired content for business negotiations, and planned timing of product introduction. • Locations and duration of stay of attendees at the event venue

[0035] Content 25 consists of visitor-oriented content provided by participants (product descriptions, technical explanations, brand introductions, company profiles, etc.), and includes, for example, document files, image files, video files, and URLs for the content. Each piece of Content 25 is assigned a Content ID.

[0036] [Visitor device 3] Visitor device 3 is a device operated by event attendees and may be a device equipped with information and communication functions, such as a smartphone, tablet, personal computer, or laptop computer. Visitor device 3 performs tasks such as transmitting information about the visitor's actions in a physical or virtual venue along with the visitor ID to the information processing device 1, and processing related to viewing and downloading content provided by the information processing device 1.

[0037] Figure 3 shows an example of the configuration of the visitor device 3. The visitor device 3 shown in Figure 3 includes a communication unit 31, an input unit 32, a display unit 33, an imaging unit 34, a sound output unit 35, a sound input unit 36, a position detection unit 37, a storage unit 38, and a processing unit 39.

[0038] The communication unit 31 is an interface for communicating with external devices and is composed of one or more communication modules that support one or more communication methods. The communication unit 31 may include, for example, a mobile communication unit 311, a wireless LAN communication unit 312, a Bluetooth® communication unit 313, and an NFC unit 314, as shown in Figure 3.

[0039] The mobile communication unit 311 connects to a base station via wireless communication and performs data communication via a mobile communication network. For example, it performs communication compliant with communication standards such as 4G (4th Generation) and 5G (5th Generation).

[0040] The wireless LAN communication unit 312 is a communication module that performs wireless communication compliant with standards such as IEEE 802.11. It connects to an access point via wireless communication and communicates with the information processing device 1, etc., via a communication network 9 such as the Internet. The wireless LAN communication unit 312 also performs wireless communication with external devices that support wireless LAN.

[0041] The Bluetooth communication unit 313 performs communication compliant with Bluetooth®, a short-range wireless communication standard, and transmits and receives data with other information communication terminals and peripheral devices (headsets, wearable devices, etc.) in the vicinity. The Bluetooth communication unit 313 can also receive beacon signals from beacon transmitters installed in the physical venue.

[0042] The NFC unit 314 performs contactless short-range wireless communication compliant with the NFC (Near Field Communication) standard. For example, the NFC unit 314 is used for payment processing using contactless communication technology, and for exchanging pairing information with other terminals.

[0043] The communication unit 31 is not limited to the configuration described above, and may include, for example, a wireless communication module that supports other communication methods such as UWB (Ultra Wide Band), or a communication interface for wired communication.

[0044] The input unit 32 accepts various input operations from the user (visitor). The input unit 32 may include, for example, a keyboard, touch panel, mouse, trackpad, stylus, fingerprint sensor, etc. Input events received by the input unit 32 are interpreted by the processing unit 39 and may be used for various processes (information input, branching selection, screen transitions, sending requests to the information processing device 1, etc.) in accordance with the instructions of the program 381.

[0045] The display unit 33 is a device that displays images (moving images, still images, etc.) corresponding to the video signal generated in the processing unit 39, and includes, for example, liquid crystal display devices (LCDs), organic light-emitting diode (OLEDs), electronic paper display devices, projectors, etc. The display unit 33 displays, for example, information provided by the information processing device 1, a user interface generated by the program 381, etc.

[0046] The imaging unit 34 is an image capture device and includes a camera containing an image sensor, such as a CMOS element, and an image processing circuit for processing the image data captured by the image sensor. For example, the imaging unit 34 can read optical codes such as two-dimensional codes (QR codes®, etc.) and barcodes.

[0047] The sound output unit 35 is a device that outputs sound corresponding to the audio signal generated in the processing unit 39, and includes, for example, an audio signal processing circuit, a D / A converter, a speaker, etc.

[0048] The sound input unit 36 ​​is a device that takes sound in and converts it into an audio signal, and includes, for example, a microphone, an A / D converter, an audio signal processing circuit, etc. The sound input unit 36 ​​converts the voice of a visitor into an audio signal (voice data) and inputs it to the processing unit 39.

[0049] The position detection unit 37 acquires signals to determine the geographical location of the visitor device 3 and calculates position information. For example, the position detection unit 37 includes a GNSS receiver that receives positioning signals transmitted from multiple positioning satellites that constitute a GNSS (Global Navigation Satellite System). Based on the multiple positioning signals received by the GNSS receiver, the position detection unit 37 calculates the geographical location (latitude, longitude, altitude, etc.) of the visitor device 3 using the principle of trilateration or the like.

[0050] Alternatively, the location detection unit 37 may acquire location information by referring to a database that links location information with information such as base station information for mobile communications captured by the mobile communication unit 311 and identification information (SSID, MAC address, etc.) of wireless LAN access points acquired by the wireless LAN communication unit 312.

[0051] The storage unit 38 stores a program 381 containing instructions executed by the processing unit 39, data temporarily stored during processing by the processing unit 39, data used for processing, data obtained as a result of processing, etc. The storage unit 38 may include, for example, a main memory (RAM, etc.), a read-only memory (ROM, etc.), and an auxiliary memory (flash memory, SSD, hard disk, memory card, etc.). The storage unit 38 may consist of one or more memory devices.

[0052] The processing unit 39 oversees the overall operation of the visitor device 3 and performs various information processing using the functions of each unit (communication unit 31, input unit 32, display unit 33, imaging unit 34, sound output unit 35, sound input unit 36, and storage unit 38). The processing unit 39 may include, for example, one or more processors (CPU, MPU, DSP, GPU, NPU, etc.) that execute instructions of program 381 stored in storage unit 38. The processing unit 39 operates as one or more computers by having one or more processors execute instructions of one or more programs 381 stored in storage unit 38. Furthermore, the processing unit 39 may include one or more dedicated hardware components (ASIC, FPGA, etc.). The visitor device 3 may perform all the processing described in this embodiment on a computer, or it may perform some of the processing on a computer and dedicated hardware respectively, or it may perform all the processing on dedicated hardware.

[0053] Program 381 may be recorded on a computer-readable recording medium (optical disc, memory card, USB memory, etc.), or it may be read from the recording medium by any means (such as a USB interface) and written to the storage unit 38. Program 381 may also be downloaded from an external device via the communication network 9 or other networks. Program 381 may be configured as a browser application and may include HTML, JavaScript, CSS, etc., that are executed in a browser. Alternatively, Program 381 may be configured as a dedicated application that does not utilize browser functions.

[0054] [Video display device 4] The video display device 4 is a device equipped with a display for displaying video of the virtual venue, and may be, for example, a personal computer, laptop computer, tablet, smartphone, or other device with information and communication functions. The video display device 4 accesses the video providing device 7 (described later) via the communication network 9 and displays video of the virtual venue according to the video data provided by the video providing device 7. The video display device 4 may be a device owned by a visitor to the virtual venue, or a device owned by someone other than a visitor (a device that allows visitors to view video).

[0055] [Entrance confirmation device 51] The entry verification device 51 is operated by the event organizers (event host, staff, etc.) involved in the holding and operation of the event, and is used to verify the entry of visitors into the physical venue. The entry verification device 51 may be a device equipped with information and communication functions, such as a smartphone, tablet, or personal computer. The entry verification device 51 may have at least some of the same configuration as the visitor device 3 (communication unit 31, input unit 32, display unit 33, imaging unit 34, sound output unit 35, sound input unit 36, storage unit 38, processing unit 39). For example, the entry verification device 51 may have an imaging unit for reading an optical code printed on the visitor's entry pass, or an NFC unit for reading an IC tag fixed to the entry pass.

[0056] [Participant device 52] The participant device 52 is a device operated by event participants and may be a device equipped with information and communication functions, such as a smartphone, tablet, personal computer, or laptop computer. The participant device 52 may have at least some of the same configuration as the visitor device 3 (communication unit 31, input unit 32, display unit 33, imaging unit 34, sound output unit 35, sound input unit 36, storage unit 38, processing unit 39). For example, the participant device 52 may have an imaging unit for reading an optical code printed on the visitor's admission pass, or an NFC unit for reading an IC tag fixed to the admission pass.

[0057] [Video output device 7] The video providing device 7 is a device that provides video of the virtual venue to the video display device 4. The video providing device 7 may have at least a part of a configuration similar to that of the information processing device 1 (communication unit 11, storage unit 12, processing unit 13). The video providing device 7 generates a 3D video of the virtual venue based on a 3D model of the physical venue created using, for example, a LiDAR 3D scanner. When the position and line of sight within the virtual venue are specified in the video display device 4 by operation such as a mouse or touch panel, the video providing device 7 generates a 3D video of the virtual venue at the specified position and line of sight based on the 3D model of the physical venue and provides it to the video display device 4.

[0058] Here, we will explain the operation of the system shown in Figure 1, which has the configuration described above. Figure 4 is a diagram illustrating the general process involved in collecting visitor behavior records at a physical venue.

[0059] The event organizers prepare admission passes C1 for attendees to enter the physical venue. Admission pass C1 will have an optical code (such as a QR code or barcode) printed on it containing identification information (attendee ID) assigned to each individual attendee. The admission pass C1 may also have the attendee's name, the event name, the venue name, and the date printed on it.

[0060] Admission pass C1 is distributed, for example, to visitors who have made a prescribed application to attend the event venue. This application may be made, for example, by accessing a designated server that accepts applications using any device (visitor device 3, terminal device provided by the organizer, etc.) and registering prescribed information about the visitor (personal information, etc.) in the server's database. Admission pass C1 may be brought by visitors who print out the electronic data (PDF file, etc.) of the admission pass issued by the server using a printer. Alternatively, the event organizer may distribute admission pass C1 to visitors who have applied in advance at the entrance of the physical venue.

[0061] When event organizers register attendees at the entrance of a physical venue, for example, they read the optical code printed on the attendee's admission pass C1 using an admission verification device 51, and transmit the attendee ID contained in the read optical code from the admission verification device 51 to the information processing device 1. The information processing device 1 acquires the behavioral information, including the attendee ID read from the admission pass C1, and registers it in the behavioral record DB 24. This records in the behavioral record DB 24 that the attendee has entered the event venue.

[0062] On the other hand, event participants (exhibitors at trade shows, etc.) upload content (such as electronic documents in PDF format) to the information processing device 1 using participant device 52, in place of printed materials for the event. In this case, the information processing device 1 stores the content 27 uploaded from participant device 52 in storage device 2. The information processing device 1 also acquires content information indicating the association between content 27 and products, and between content 27 and participants, in response to instructions from participant device 52, and registers it in the content management DB 23.

[0063] Participants will place Panel C2, which will be displayed alongside their products at the event venue, in their own exhibition booth. Panel C2 has an optical code printed on it that is necessary for visitors to the participant's exhibition booth to view or download content (electronic documents, etc.) related to the products displayed there.

[0064] Furthermore, participants use participant device 52 to read the optical code printed on the admission pass C1 of visitors they interact with at exhibition booths, etc., and transmit the visitor ID contained in the read optical code from participant device 52 to information processing device 1. Information processing device 1 acquires behavioral information, including the visitor ID read from admission pass C1, and registers it in behavioral record DB 24. As a result, the behavioral record DB 24 records that a visitor has visited a participant's exhibition booth, etc.

[0065] In this case, the participant device 52 may send an instruction to the information processing device 1 granting permission to the visitor to download the specified content, and the information processing device 1 may acquire the action information granting permission to the visitor to download the specified content based on this instruction and register it in the action record DB 24. This makes it possible for participants to provide appropriate content to visitors while listening to their requests.

[0066] During the event, participants can access and view information regarding visitor activity at their exhibition booths, etc. (number of visitors, number of content downloads, etc.) from the information processing device 1 via participant device 52. This allows participants to understand visitor activity at their exhibition booths and product display areas in real time. After the event ends, participants can also access personal information of visitors who visited their exhibition booths, etc., and personal information of visitors who downloaded content related to their products, etc., from the organizer's server via participant device 52.

[0067] Visitors carry an admission pass C1 with an optical code containing their visitor ID printed on it at the event venue. When a visitor performs an operation to obtain content related to products, etc., they read the optical code printed on their admission pass C1 using the visitor device 3 and access the information processing device 1 based on the information (URI, etc.) contained in the read optical code. For example, the visitor device 3 accesses the information processing device 1 using any browser, and the information processing device 1 operates as a web application server that implements predetermined functions through the browser of the visitor device 3. Based on the information (visitor ID, etc.) from the optical code of the admission pass C1 obtained from the visitor device 3, the information processing device 1 authenticates the visitor operating the visitor device 3 and displays a dedicated screen (web application screen) for the visitor on the visitor device 3.

[0068] When a visitor finds an item of interest at the event venue, they read the optical code on panel C2, which is located near the exhibit, from the web application screen of visitor device 3. Based on the address information (URI, etc.) contained in the read optical code, they access the web application server on information processing device 1. Information processing device 1 generates a web page (a web page about the specific exhibited item) corresponding to the address accessed by visitor device 3 and displays it on visitor device 3.

[0069] Furthermore, when the information processing device 1 receives access from the visitor device 3 that has read the optical code on panel C2, it determines whether the optical code reading operation was performed in the physical venue or the virtual venue. This determination process will be explained later with reference to Figure 9A, etc. If the information processing device 1 determines that the reading operation was performed in the physical venue, it generates behavioral information indicating that the visitor read the optical code on panel C2 corresponding to a specific product, etc., in the physical venue, and registers it in the behavioral record DB 24. The information processing device 1 then grants the visitor whose behavioral information has been recorded permission to download, view, email, etc., content related to that specific product, etc.

[0070] Information processing device 1 displays a list of content that visitors are permitted to download based on their behavioral information on the web application screen of visitor device 3. Visitors view the list of permitted content on the web application screen of visitor device 3 and select the desired content from the list. Visitor device 3 requests the content selected by the visitor from information processing device 1. Information processing device 1 reads the requested content from storage device 2 and provides it to the requesting visitor device 3. For example, information processing device 1 processes the display of the content on the requesting visitor device 3 or processes the download of the content on the requesting visitor device 3. In addition, if a destination email address is specified by visitor device 3, information processing device 1 processes the transfer of the content read from storage device 2 (or information such as its download URL) to the specified email address.

[0071] Figure 5 is a flowchart illustrating an example of the process involved in collecting visitor behavior information at a physical venue. The entry verification device 51 reads the optical code printed on the visitor's entry pass C1 at the entrance of the physical venue, and transmits the visitor ID contained in the read optical code to the information processing device 1 (ST100).

[0072] The visitor ID acquired by the admission verification device 51 is information indicating that the visitor corresponding to this visitor ID has come to the physical venue. Hereinafter, the information indicating that a visitor has come to the physical venue may be referred to as "visitor information". The information processing device 1 receives the visitor ID acquired by the admission verification device 51 as visitor information.

[0073] Attendance information indicating that a visitor has come to the physical venue may be associated with the time the visitor was at the physical venue (time of arrival). For example, the visitor ID, which is attendance information acquired by the entry verification device 51, may be associated with the time the visitor entered the physical venue (time of entry). Hereinafter, attendance information associated with the time of entry may be referred to as "time of entry". For example, if the entry verification device 51 reads the visitor ID from the visitor's admission pass, it may transmit the visitor ID along with the time of reading to the information processing device 1. In this case, the information processing device 1 acquires the time received from the entry verification device 51 along with the visitor ID as the entry time associated with the entry information (visitor ID). Alternatively, if the information processing device 1 receives a visitor ID from the admission confirmation device 51, it may obtain the time of receipt as the admission time associated with the admission information (visitor ID).

[0074] When the information processing device 1 receives a visitor ID acquired as visitor information (entry information) by the entry confirmation device 51, it generates behavioral information indicating that the visitor corresponding to this visitor ID has entered the physical venue and registers it in the behavioral record DB 24 (ST105). The behavioral information may include the time of entry into the physical venue associated with the entry information. This records that the visitor entered the physical venue at a certain time.

[0075] The participant device 52 reads the optical code on the admission pass C1 of a visitor who has visited the participant's exhibition booth or other area at the physical venue, and transmits the visitor ID contained in the read optical code to the information processing device 1 (ST110). The visitor ID acquired by the participant device 52 is also visitor information indicating that the visitor corresponding to this visitor ID has come to the physical venue. The information processing device 1 receives the visitor ID acquired by the participant device 52 as visitor information.

[0076] When the information processing device 1 receives a visitor ID acquired as visitor information by the participant device 52, it generates behavioral information indicating that the visitor corresponding to this visitor ID had contact with a specific participant at the physical venue (by having the optical code of the admission pass C1 read by the participant device 52), and registers this information in the behavioral record DB 24 (ST115). If the visitor information (visitor ID) acquired by the participant device 52 is associated with the time of arrival (time of reading the optical code), the behavioral information may also include the time of arrival. The time of arrival may be the time when the optical code was read by the participant device 52, or it may be the time when the information processing device 1 received the visitor ID (visitor information) from the participant device 52. This records that the visitor had contact with a participant at the physical venue at a certain time.

[0077] Visitor device 3 reads the optical code printed on the visitor's admission pass C1 and accesses the web application server on information processing device 1 based on the address information contained in the read optical code (ST120). Based on the information from the optical code of admission pass C1 obtained from visitor device 3 (visitor ID, etc.), information processing device 1 authenticates the visitor operating visitor device 3 and displays a dedicated screen for the visitor (web application screen) on visitor device 3 (ST125).

[0078] Visitor device 3 reads the optical code on panel C2 displayed with products at the exhibition booth visited by the visitor, and accesses the web application server on information processing device 1 based on the address information (URI, etc.) contained in the read optical code (ST130). Information processing device 1 generates a web page (a web page about the specific product displayed) corresponding to the address accessed by visitor device 3 and displays it on visitor device 3.

[0079] When the information processing device 1 receives access from the visitor device 3 that has read the optical code on panel C2, it determines whether the optical code reading operation was performed in the physical venue or the virtual venue using the determination process described later (Figure 9A, etc.) (ST135).

[0080] When the information processing device 1 determines that a reading operation has been performed at the physical venue, it generates behavioral information indicating that the visitor read the optical code on panel C2 corresponding to a specific product at the physical venue and registers it in the behavioral record DB24 (ST140). The information processing device 1 then grants the visitor whose behavioral information has been recorded permission to download, view, email, etc., content related to that specific product.

[0081] Information processing device 1 displays a list of content that has been permitted to be downloaded, etc., based on behavioral information, on the web application screen of visitor device 3. Visitors select specific content from the available content displayed on the web application screen and input instructions to visitor device 3 requesting that the content be provided in a specified manner (viewing, downloading, email forwarding, etc.). When visitor device 3 receives these instructions from the visitor, it requests information processing device 1 to provide the specific content in the specified manner (ST145). In response to the request from visitor device 3, information processing device 1 executes content provision processing to provide the selected specific content to the visitor in the specified manner. For example, in response to a request from visitor device 3 operated by the visitor, information processing device 1 may perform processes such as displaying the content on visitor device 3, downloading the content to visitor device 3, or forwarding the content to an arbitrary address via email. When information processing device 1 has performed the process of providing content to the visitor in response to a request from visitor device 3, it generates behavioral information indicating that the visitor has received the content and registers it in the behavioral record DB24 (ST150).

[0082] Visitors can also input their evaluations of any product on the web application screen provided by the information processing device 1. When a visitor inputs an evaluation of a product, for example by pressing the "Like" button, the visitor device 3 transmits that evaluation to the information processing device 1 (ST155). When the information processing device 1 receives an evaluation of a product entered by a visitor, it generates behavioral information indicating that the visitor has entered an evaluation of the product, and registers it in the behavioral record DB24 (ST160).

[0083] Furthermore, visitors can answer questionnaires created by participants, event organizers, etc., on the web application screen of the information processing device 1. When the visitor device 3 receives an answer to a questionnaire about a specific product, for example, it sends the answer to the questionnaire to the information processing device 1 (ST165). When the information processing device 1 receives an answer to a questionnaire entered by a visitor, it generates behavioral information indicating that the visitor entered the answer to the questionnaire and registers it in the behavioral record DB24 (ST170).

[0084] Next, we will explain other examples of processes for acquiring visitor information by referring to the flowcharts in Figures 6A to 6D.

[0085] The aforementioned entry verification device 51 and participant device 52 are both devices capable of acquiring information indicating that a visitor has arrived at the physical venue. Devices used by event organizers or participants that are capable of acquiring information indicating that a visitor has arrived at the physical venue may hereafter be referred to as "venue-side devices."

[0086] Figure 6A shows an example in which an IC tag reader 53 installed at a physical venue is used as a venue-side device. The IC tag reader 53 has the function of reading information written on an IC tag and transmitting it to the information processing device 1 via the communication network 9. The IC tag reader 53 may be carried by the event organizers or participants, or it may be installed in the physical venue. When a visitor brings their admission pass close to the IC tag reader 53, the IC tag reader 53 reads the visitor ID written on the IC tag fixed to the admission pass as visitor information and transmits it to the information processing device 1 via the communication network 9 (ST200).

[0087] When the information processing device 1 receives a visitor ID acquired as visitor information by the IC tag reader 53, it generates behavioral information corresponding to the received visitor information (visitor ID) and registers it in the behavioral record DB 24 (ST205). If the visitor information (visitor ID) acquired by the IC tag reader 53 is associated with the time of arrival (the time the IC tag was read), the behavioral information may include this time of arrival. The time of arrival may be the time the IC tag was read by the IC tag reader 53, or it may be the time the information processing device 1 received the visitor ID (visitor information) from the IC tag reader 53. This records that at a certain time, the visitor ID was read from the IC tag of the admission pass by the IC tag reader 53 at the physical venue.

[0088] Figure 6B shows an example of acquiring visitor information using visitor device 3. The visitor device 3 acquires unique information (venue-specific information) that can only be obtained by physically visiting the venue, using predetermined means, and transmits it to the information processing device 1 (ST210). For example, the visitor device 3 may read venue-specific information from an IC tag fixed at a predetermined location in the physical venue using the NFC unit 314 and transmit it to the information processing device 1. Alternatively, the visitor device 3 may read venue-specific information from an optical code posted at a predetermined location within the physical venue that is not displayed in the virtual venue's video using the imaging unit 34 and transmit it to the information processing device 1.

[0089] When the information processing device 1 receives venue-specific information acquired as visitor information by the visitor device 3, it generates behavioral information based on this venue-specific information and a visitor ID already received (for example, a visitor ID received when the web application started running) and registers it in the behavioral record DB 24 (ST205). If the visitor information (venue-specific information) acquired by the visitor device 3 is associated with the time of arrival (the time the venue-specific information was acquired), the behavioral information may include this time of arrival. The time of arrival may be the time the venue-specific information was acquired by the visitor device 3, or it may be the time the information processing device 1 received the venue-specific information (visitor information) from the visitor device 3. This records that the venue-specific information of the physical venue was acquired by the visitor device 3 at a certain time.

[0090] Figure 6C shows an example in which information about wireless LAN equipment 61 (access points, etc.) used for wireless LAN communication in a physical venue is used as venue-specific information. Visitor device 3 accesses the wireless LAN device 61 at the physical venue via the wireless LAN communication unit 312 and obtains information specific to the wireless LAN device 61 (e.g., SSID (Service Set Identifier), MAC address, etc.) as wireless LAN information (ST220). Visitor device 3 transmits the wireless LAN information obtained from the wireless LAN device 61 to the information processing device 1 as venue-specific information (ST225). Visitor device 3 may communicate with the information processing device 1 via the wireless LAN communication unit 312, or it may use other means of communication (e.g., mobile communication unit 311).

[0091] When the information processing device 1 receives wireless LAN information acquired as visitor information by the visitor device 3, it generates activity information based on this wireless LAN information and the visitor ID already received, and registers it in the activity record DB 24 (ST230). If the visitor information (wireless LAN information) acquired by the visitor device 3 is associated with the time of arrival (the time the wireless LAN information was acquired), the activity information may include this time of arrival. The time of arrival may be the time the wireless LAN information was acquired by the visitor device 3, or it may be the time the information processing device 1 received the wireless LAN information (visitor information) from the visitor device 3. This records that the visitor device 3 accessed the wireless LAN device 61 at a certain time in the physical venue.

[0092] Figure 6D shows an example in which a beacon signal transmitted by a beacon transmitter 62 installed at a physical venue is used as venue-specific information. The beacon transmitter 62 transmits a beacon signal to unspecified visitor devices 3 within the physical venue (ST240). The visitor device 3 receives the beacon signal from the beacon transmitter 62 and obtains venue-specific information from the beacon signal (ST245). The visitor device 3 transmits the venue-specific information obtained from the beacon signal to the information processing device 1 (ST250).

[0093] When the information processing device 1 receives venue-specific information obtained from the beacon signal at the visitor device 3, it generates behavioral information based on this venue-specific information and the visitor ID already received, and registers it in the behavioral record DB 24 (ST255). If the visitor information (venue-specific information from the beacon signal) obtained at the visitor device 3 is associated with the time of arrival (time of reception of the beacon signal), the behavioral information may include this time of arrival. The time of arrival may be the time when the beacon signal was received at the visitor device 3, or it may be the time when the information processing device 1 received the venue-specific information (visitor information) from the beacon signal at the visitor device 3. This records that at a certain time, the visitor device 3 received a beacon signal from the beacon transmitter 62 at the physical venue.

[0094] Figure 7 shows an example of the screen of the video display device 4 that displays video of the virtual venue. Screen A in Figure 7 displays a single exhibition booth in a virtual venue. Exhibits are lined up in front of the exhibition booth, and panel A1 is placed next to the exhibits. Panel A1 has a two-dimensional optical code printed on it that can be read by the visitor device 3. The video display device 4 changes the viewpoint position and direction of gaze in the virtual venue when pointer A2 is operated by an input device such as a mouse, and updates the video of the virtual venue in accordance with the changes in viewpoint position and gaze direction.

[0095] Just like in a physical venue, if a visitor to the virtual venue finds an item of interest, they read the optical code on panel A1, which is located near the exhibit, from the web application screen of visitor device 3. Based on the address information (URI, etc.) contained in the read optical code, they access the web application server on information processing device 1. Information processing device 1 generates a web page (a web page about the specific exhibited item) corresponding to the address accessed by visitor device 3 and displays it on visitor device 3.

[0096] Figure 8 is a flowchart illustrating an example of the process involved in collecting visitor behavior information in a virtual venue. The video display device 4 requests video of the virtual venue from the video supply device 7 (ST300), and in response, the video supply device 7 generates video data of the virtual venue based on a 3D model of the physical venue and provides it to the video display device 4 (ST305). Based on the video data provided by the video supply device 7, the video display device 4 displays the video of the virtual venue on the display (ST310). The video display device 4 changes the viewpoint position and direction of gaze in the virtual venue according to the user's (e.g., visitor's) instructions and updates the video of the virtual venue accordingly.

[0097] Visitor device 3 accesses the web application server on information processing device 1 in accordance with the visitor's login operation (ST315). For example, visitor device 3 sends authentication information necessary for login (login ID, password, etc.) to information processing device 1. Information processing device 1 performs authentication processing (verification of login ID and password, etc.) in response to the login request from visitor device 3. Once information processing device 1 has authenticated that the visitor is a specific person through the authentication process, it displays a dedicated screen for that visitor (web application screen) on visitor device 3 (ST320).

[0098] When the information processing device 1 receives access from a visitor device 3 that has read the optical code on panel A1 in the virtual venue (ST325), it determines whether the optical code reading operation was performed in the physical venue or the virtual venue using the determination process described later (Figure 9A, etc.) (ST330).

[0099] When the information processing device 1 determines that a reading operation has been performed in the virtual venue, it generates behavioral information indicating that the visitor read the optical code of panel A1 corresponding to a specific product in the virtual venue and registers it in the behavioral record DB 24 (ST335). The information processing device 1 then grants the visitor whose behavioral information has been recorded permission to download, view, email, etc., content related to that specific product.

[0100] Visitor device 3 requests information processing device 1 to provide specific content in response to visitor instructions entered on the web application screen (ST340). Upon receiving this request, information processing device 1 provides the specific content to visitor device 3 and records behavioral information indicating the provision of content in behavioral record DB24 (ST345).

[0101] Visitor device 3 transmits the evaluation of products, etc., entered on the web application screen to information processing device 1 (ST350). Based on the evaluation received from visitor device 3, information processing device 1 generates visitor behavior information and registers it in behavior record DB24 (ST355).

[0102] Visitor device 3 transmits the questionnaire entered on the web application screen to information processing device 1 (ST360). Based on the questionnaire received from visitor device 3, information processing device 1 generates visitor behavior information and registers it in behavior record DB24 (ST365).

[0103] Next, specific examples of the process for determining the venue where a predetermined operation of the visitor device 3 was performed in step ST130 (Figure 5) and step ST325 (Figure 8) will be explained with reference to the flowcharts in Figures 9A-9B, 10, 11A-11B, and 12A-12B. Note that the processes shown in these flowcharts are repeatedly executed in the information processing device 1.

[0104] The flowchart shown in Figure 9A illustrates an example of a process that determines the venue where a predetermined operation of the visitor device 3 was performed, depending on whether or not visitor information was acquired. The information processing device 1 determines whether a predetermined operation (for example, reading the optical code on a panel displayed at an exhibition booth in the event venue) has been performed on the visitor device 3 (ST400). If the predetermined operation has been performed on the visitor device 3, it transmits information corresponding to that operation to the information processing device 1. For example, the visitor device 3 transmits address information (URI, etc.) contained in the optical code of the panel and requests access to the web page indicated by that address information (for example, a web page about a specific product, etc.). If a predetermined operation has been performed on the visitor device 3 of one visitor (Yes in ST400), the information processing device 1 determines whether visitor information has been acquired for that visitor (ST405). For example, the information processing device 1 searches the behavior information of that visitor registered in the behavior record DB24 and determines whether the behavior information includes behavior information indicating that visitor information has been acquired (for example, behavior information indicating that the visitor entered the physical venue). If attendance information has been obtained for the visitor in question (Yes in ST405), the information processing device 1 determines that the predetermined operation on the visitor device 3 was performed at the physical venue (ST415). On the other hand, if attendance information has not been obtained for the visitor in question (No in ST405), the information processing device 1 determines that the predetermined operation on the visitor device 3 was performed at the virtual venue (ST420). This allows for the collection of visitor behavior information at both the physical and virtual venues, and, depending on the acquisition status of visitor information, to record whether the visitor's behavior, as indicated by the behavioral information, occurred at the physical or virtual venue.

[0105] The flowchart shown in Figure 9B illustrates an example of a process that determines the venue where a predetermined operation was performed, based on whether or not visitor information was acquired and the time (operation time) when the predetermined operation of the visitor device 3 was performed. The flowchart shown in Figure 9B is the same as the flowchart shown in Figure 9A with step ST410 added, and the other steps are the same as the flowchart shown in Figure 9A. If the information processing device 1 determines in step ST405 that visitor information has been acquired, it further determines in step ST410 the relationship between the visitor time associated with this visitor information (the time the visitor was at the physical venue), the time a predetermined operation was performed on the visitor device 3 (operation time), and a predetermined time period during which the physical venue is open (opening time period). That is, the information processing device 1 determines whether the operation time during which the predetermined operation was performed is included in the opening time period that includes the visitor time associated with the visitor information. If the operation time is included in the opening time period that includes the visitor time (Yes in ST410), the information processing device 1 determines that the predetermined operation was performed at the physical venue (ST415). On the other hand, if the operation time is not included in the opening time period that includes the visitor time (No in ST410), the information processing device 1 determines that the predetermined operation was performed at the virtual venue (ST420). As a result, for example, if a visitor arrives at a physical venue during a certain opening time and visitor information is acquired for that visitor, even if that visitor performs a predetermined operation on the visitor device 3 in the virtual venue after the opening time has passed, the operation time of the visitor device 3 is not included in the same opening time as the arrival time associated with the visitor information. Therefore, it is correctly determined that the predetermined operation was performed in the virtual venue. Accordingly, based on the relationship between the arrival time associated with the visitor information, the opening time, and the operation time of the predetermined operation, it is possible to correctly record whether the visitor's actions, as indicated by the behavior information, took place in the physical venue or the virtual venue.

[0106] The flowchart shown in Figure 10 illustrates an example of a process that determines the venue where a predetermined operation of the visitor device 3 was performed, based on the time of entry and exit from the physical venue.

[0107] In this example, an exit confirmation device is used as a venue-side device to confirm the departure of visitors from the physical venue. The exit confirmation device acquires the visitor ID of visitors leaving the physical venue as visitor information and transmits it to the information processing device 1. The exit confirmation device may, for example, read the visitor ID from an optical code printed on the visitor's admission pass at the visitor's exit point in the physical venue, or it may read the visitor ID from an IC tag fixed to the admission pass.

[0108] Furthermore, the visitor ID, which is visitor information acquired by the exit confirmation device, is associated with the time the visitor physically left the venue (exit time). Hereafter, visitor information associated with the exit time may be referred to as "exit information." The exit time may be the time the visitor ID is acquired by the exit confirmation device, or the time the visitor ID (exit information) is received by the information processing device 1.

[0109] When the information processing device 1 receives a visitor ID as exit information from the exit confirmation device, it generates behavioral information based on this visitor ID and exit time, and registers it in the behavioral record DB 24. The behavioral information indicates that the visitor corresponding to the visitor ID has left the physical venue at the exit time.

[0110] The information processing device 1 determines whether a predetermined operation has been performed on the visitor device 3 (ST550). If a predetermined operation has been performed on the visitor device 3 for one visitor (Yes in ST550), the information processing device 1 determines whether admission information has been obtained for that visitor (ST555). For example, the information processing device 1 searches the behavioral information of that visitor registered in the behavioral record DB24 and determines whether the behavioral information includes behavioral information indicating that admission information has been obtained. If admission information has not been obtained for that visitor (No in ST555), the information processing device 1 determines that a predetermined operation on the visitor device 3 has been performed in the virtual venue (ST575).

[0111] On the other hand, if one or more entry information entries have been obtained for a single visitor (Yes in ST555), the information processing device 1 identifies the entry time immediately preceding the time when the predetermined operation of the visitor device 3 was performed from among the one or more entry times associated with the one or more entry information entries. The information processing device 1 then determines, based on the visitor's behavior information, whether or not exit information associated with the exit time included in the period from the previous entry time to the time of the operation (hereinafter sometimes referred to as the "post-entry period") has been obtained (ST560). If exit information associated with the exit time included in the post-entry period has not been obtained (No in ST560), the information processing device 1 determines that the predetermined operation was performed at the physical venue (ST570). On the other hand, if exit information associated with the exit time included in the post-entry period has been obtained (Yes in ST560), the information processing device 1 determines that the predetermined operation was performed at the virtual venue (ST575). As a result, even if a single visitor enters the physical venue more than once and exits it more than once, it is possible to correctly determine whether a predetermined operation was performed at the physical venue, depending on whether the exit time was recorded during the period from the time of the operation to the most recent entry time (post-entry period). Therefore, based on the relationship between the entry time associated with the entry information and the exit time associated with the exit information, it is possible to correctly record whether the visitor's actions indicated by the behavior information took place at the physical venue or the virtual venue.

[0112] Figures 11A and 11B show an example of a process that determines the venue where a predetermined operation of the visitor device 3 was performed, based on real-time acquired entry and exit information. In this example, entry information and exit information are acquired in real time by the entry confirmation device 51 and the exit confirmation device, respectively. In the process shown in the flowchart of Figure 11A, the information processing device 1 determines the status of the visitor (whether or not they are physically in the venue) based on the entry and exit information acquired in real time and stores a flag indicating that status. Specifically, when the information processing device 1 receives entry information acquired for a visitor from the entry confirmation device 51 (Yes in step ST500), it activates the "present" flag for that visitor (ST505). Also, when the information processing device 1 receives exit information acquired for a visitor from the exit confirmation device (Yes in step ST510), it deactivates the "present" flag for that visitor (ST515).

[0113] The flowchart shown in Figure 11B is the same as the flowchart in Figure 10, but with steps ST555 and ST560 replaced by step ST565, and the other steps are the same as in Figure 10. If a predetermined operation is performed on the visitor device 3 of one visitor (Yes in ST550), the information processing device 1 determines that the predetermined operation was performed at the physical venue if the "present status" flag of that visitor is enabled (Yes in ST565) (ST570), and determines that the predetermined operation was performed at the virtual venue if the "present status" flag is disabled (No in ST565) (ST575). If a visitor's "Currently Visiting" flag is enabled at the time of the operation, it means that the exit time is not included in the period between the visitor's most recent entry time into the physical venue and the time of the operation (i.e., exit information is not acquired). Conversely, if a visitor's "Currently Visiting" flag is disabled at the time of the operation, it means that the exit time is included in the period between entry and exit (i.e., exit information is acquired). Therefore, the determination process in step ST565 (Figure 11B) achieves the same processing as in steps ST555 and ST560 (Figure 10). Consequently, even with the processing shown in the flowcharts of Figures 11A and 11B, it is possible to accurately record whether the visitor's actions, as indicated by the behavior information, took place in the physical venue or the virtual venue.

[0114] Figure 12A shows an example of a process that determines the venue in which a predetermined operation of the visitor device 3 was performed, based on information indicating whether or not the visitor device 3 is physically present in the venue. In this example, information indicating whether or not the visitor device 3 is present in the physical venue (hereinafter sometimes referred to as "existence information") is acquired by the visitor device 3. The existence information may also be, for example, location information (information indicating the geographical location of the visitor device 3) acquired by the location detection unit 37 of the visitor device 3.

[0115] The information processing device 1 determines whether a predetermined operation has been performed on the visitor device 3 (ST600). If a predetermined operation has been performed on the visitor device 3 (Yes in ST600), the information processing device 1 receives the location information acquired by the location detection unit 37 of the visitor device 3 (ST605). For example, the visitor device 3 repeatedly acquires location information with its location detection unit 37, and transmits the latest location information to the information processing device 1 when a predetermined operation is performed.

[0116] The information processing device 1 determines whether the visitor device 3 is present at the physical venue based on the location information (existence information) received from the visitor device 3. If the location of the visitor device 3 indicated by the location information is within a predetermined geographical range corresponding to the location of the physical venue, the location information (existence information) acquired by the visitor device 3 is information indicating that the visitor has come to the physical venue, and thus corresponds to visitor information. In this case, the information processing device 1 determines that the visitor device 3 is present at the physical venue (ST610 Yes) and that the predetermined operation was performed at the physical venue (ST615). On the other hand, if the location of the visitor device 3 is not within the predetermined geographical range, the information processing device 1 determines that the visitor device 3 is not present at the physical venue (ST610 No) and that the predetermined operation was performed at the virtual venue (ST620). This makes it possible to accurately record whether the visitor's actions indicated by the action information were performed at the physical venue or the virtual venue based on the existence information (e.g., location information) acquired by the visitor device 3.

[0117] Figure 12B shows an example of a process for determining the venue in which a predetermined operation of visitor device 3 was performed, based on the time when the predetermined operation was performed. In this example, the period during which the physical venue is open (which may be referred to as the "first opening period") and the period during which the virtual venue is open (which may be referred to as the "second opening period") are different. In other words, the first and second opening periods are staggered, and there is no overlapping period (a period during which both the physical and virtual venues are open).

[0118] The information processing device 1 determines whether a predetermined operation was performed on the visitor device 3 (ST700). If a predetermined operation was performed on the visitor device 3 (Yes in ST700), the information processing device 1 determines that the predetermined operation was performed at the physical venue if the time the operation was performed falls within the opening period of the physical venue (Yes in ST705) (ST710), and determines that the predetermined operation was performed at the virtual venue if it does not fall within the opening period of the physical venue (No in ST705) (ST715). This makes it possible to record whether the visitor's actions, as indicated by the behavioral information, took place at the physical venue or the virtual venue, based on when the predetermined operation was performed on the visitor device 3.

[0119] In the example shown in Figure 12B, the venue is determined based on whether the time when the predetermined operation is performed falls within the opening period of the physical venue. However, the venue may also be determined based on whether the time when the predetermined operation is performed falls within the opening period of the virtual venue.

[0120] As described above, according to this embodiment, in an event where a physical venue and a virtual venue coexist, it is possible to determine which venue a predetermined operation performed by a visitor device took place in, based on at least one of the acquisition status of visitor information, the content of the predetermined action indicated by the predetermined operation, and the timing of when the predetermined operation was performed. This makes it possible to appropriately distinguish and collect visitor behavior in the physical venue and the virtual venue, and to manage visitor behavior information in a unified manner for each venue.

[0121] Furthermore, by determining the venue based on the acquisition status of attendance information, it is possible to distinguish between operations performed by attendees who actually visited the physical venue and operations performed by attendees who did not visit the physical venue. In addition, by using the relationship between the arrival time and the operation time, and the relationship between the period after entry based on the entry and exit times and the operation time of the attendee device 3, it is possible to determine whether an operation was performed during the period the attendee was staying at the physical venue, thereby preventing operations performed after exiting from being mistakenly identified as operations performed at the physical venue.

[0122] Furthermore, when the opening periods of the physical venue and the virtual venue differ, the venue can be appropriately identified as either a physical or virtual venue by determining the venue based on the relationship between the timing of the predetermined operation of the visitor device 3 and the opening period of each venue. This allows for the collection and unified management of visitor behavior information for each venue, even when the physical and virtual venues are open during different periods.

[0123] Furthermore, in the embodiment described above, it is possible to determine the venue where a predetermined operation of the visitor device 3 was performed based on multiple criteria. This makes it possible to appropriately collect and uniformly manage visitor behavior information at each venue in an event that combines physical and virtual venues, even when visitors use visitor devices 3 with various configurations.

[0124] Next, a modified example of this embodiment will be described. In the above-described embodiment, the video of the virtual venue is displayed on the video display device 4. However, the present invention is not limited to this example, and the video of the virtual venue may also be displayed on the visitor device 3.

[0125] Figure 13 shows an example of the screen of visitor device 3, which displays video of the virtual venue. The screen B of the visitor device 3 shown in Figure 13 includes a panel B1 with an optical code printed on it, and a pointer B2 that is operated to change the viewpoint position and direction of gaze in the virtual venue, similar to the screen A of the video display device 4 shown in Figure 7.

[0126] In this example, visitor device 3 automatically recognizes the optical code from the video of the virtual venue. Screen B2 in Figure 13 includes a dotted frame B3 representing the recognized optical code. Furthermore, screen B2 includes an input element B4 (button) that is operated when accessing the web page address contained in the recognized optical code. When input element B4 is operated on screen B2, visitor device 3 transmits the address information (URI, etc.) contained in the optical code to information processing device 1, which then accesses the web application server.

[0127] Visitors log in to the visitor device 3 to view the virtual venue's video feed. The visitor device 3 accesses the web application server on the information processing device 1 in accordance with the visitor's login operation (ST800). For example, the visitor device 3 sends the authentication information necessary for login (login ID, password, etc.) to the information processing device 1. The information processing device 1 performs authentication processing (verification of login ID and password, etc.) in response to the login request from the visitor device 3. Once the information processing device 1 has authenticated that the visitor is a specific person through the authentication processing, it requests the video feed of the virtual venue from the video supply device 7 (ST810). In response, the video supply device 7 generates video data of the virtual venue based on a 3D model of the physical venue and provides it to the visitor device 3 (ST815). Based on the video data provided by the video supply device 7, the visitor device 3 displays the video of the virtual venue on the display unit 33, as shown in Figure 13 (ST820). Visitor device 3 changes the viewpoint position and direction of gaze in the virtual venue according to the visitor's instructions, and updates the video of the virtual venue accordingly.

[0128] In this modified example, the information processing device 1 determines whether a predetermined operation performed by the visitor device 3 was performed in the physical venue or the virtual venue, depending on the content of the predetermined action indicated by the predetermined operation. That is, if the predetermined action indicated by the predetermined operation corresponds to an action indicating the use of the virtual venue (hereinafter sometimes referred to as "virtual venue use action"), the information processing device 1 determines that the predetermined operation was performed in the virtual venue. For example, actions related to accessing the server providing the virtual venue (in this example, the video provisioning device 7) or operations on exhibits or objects placed within the virtual venue are considered virtual venue use actions. The action indicated by the login operation in step ST800 corresponds to a virtual venue use action of accessing the video provisioning device 7 to display the video of the virtual venue, so the information processing device 1 determines that the predetermined operation was performed in the virtual venue (ST825). The information processing device 1 then generates action information indicating that the visitor entered the virtual venue (started displaying the video) and registers it in the action record DB24 (ST830).

[0129] When visitor device 3 performs an operation to access an address contained in the optical code of panel B1 in the virtual venue (in the example of Figure 13, this operation is the operation of clicking the button of input element B4), it transmits information about the address contained in the optical code (URI, etc.) to information processing device 1 (ST850). When information processing device 1 receives information about the address contained in the optical code of panel B1 from visitor device 3, which is displaying video of the virtual venue, it determines that an operation on an object (input element B4) placed in the virtual venue constitutes a virtual venue usage action, and therefore determines that an operation was performed on visitor device 3 in the virtual venue (ST855). The information processing device 1 then generates action information indicating that the optical code of panel B1 was read in the virtual venue and registers it in the action record DB24 (ST860).

[0130] The processes in steps ST865 to ST890 involve registering behavioral information in the behavioral record DB24 in response to the operations of the visitor device 3 that has logged into the information processing device 1. These processes are the same as the processes in steps ST340 to ST365 in the flowchart of Figure 8, which have already been explained.

[0131] According to this modified version, when a predetermined operation is performed on the visitor device 3 that displays video of the virtual venue, it can be correctly determined that the operation was performed in the virtual venue. Furthermore, even if a visitor who has displayed the virtual venue on the visitor device 3 visits the physical venue at a different time, or enters the virtual venue via the video provisioning device 7, the system can correctly determine which event venue the visitor visited in each situation and record appropriate behavioral information for each event venue.

[0132] It should be noted that the present invention is not limited to the embodiments described above, but includes various variations.

[0133] The venue determination described in this embodiment (determination of the venue where a predetermined operation of the visitor device 3 was performed) may be a combination of multiple determination criteria, such as determination based on the acquisition status of visitor information, determination based on the relationship between the arrival time or entry / exit time and the operation time, determination based on existence / non-existence information, determination based on virtual venue usage behavior, and determination based on the relationship between the operation timing and the opening period of each venue. In this embodiment, these determination criteria may be used independently of each other, or two or more determination criteria may be used in combination.

[0134] For example, in this embodiment, a determination based on the time elapsed since entry and a determination based on presence / absence information may be combined. This makes it possible to determine that an operation took place in a virtual venue even if exit information is not acquired, when it is confirmed that the visitor device is not present in the physical venue. Furthermore, even if presence / absence information cannot be acquired from the visitor device (for example, when the location information detection function is turned off), venue determination is possible by using a determination based on the time elapsed since entry. In this way, by using a determination based on behavioral information and a determination based on presence / absence information in a complementary manner, it is possible to suppress misdeterminations caused by missing exit records in the physical venue or by the functions of the visitor device, and to perform accurate venue determination.

[0135] Furthermore, in this embodiment, a combination of determination based on opening hours and determination based on virtual venue usage behavior may be used. This makes it possible to identify operations performed within the virtual venue as operations performed within the virtual venue, even if they are performed within the opening hours of the physical venue, if those operations involve the use of the virtual venue. For example, when viewing the virtual venue using a display device installed in the physical venue, or when a visitor accesses the virtual venue from within the physical venue, the venue in which the operation was performed can be appropriately determined.

[0136] In this embodiment, a determination based on presence / absence information may be combined with a determination based on the opening periods of the physical and virtual venues. This allows the operation to be determined to be taking place in the virtual venue even if the visitor device is not present at the physical venue during its opening period. By using both time-based and spatial-based determinations in this way, it is possible to distinguish with high accuracy between remote participation at the virtual venue and on-site participation at the physical venue, even when events are held simultaneously at both the physical and virtual venues.

[0137] Furthermore, in this embodiment, a combination of determination based on the time elapsed since entry and determination based on virtual venue usage behavior may be used. This makes it possible to distinguish and identify operations such as browsing the virtual venue while a visitor is staying at the physical venue from actions taken at the physical venue. Therefore, it becomes possible to manage the actions of the same visitor separately from their actions at the physical venue and actions taken at the virtual venue.

[0138] In this embodiment, a combination of determinations based on the entry and exit history at the physical venue (determination based on entry time and operation time, determination based on the period after entry and operation time), determinations based on presence / absence information acquired by the visitor device 3, and determinations based on the relationship between the operation time and the opening period may be used. This makes it possible to determine the venue where a predetermined operation of the visitor device 3 was performed from multiple different perspectives. By performing venue determination from such multi-layered perspectives, it is possible to perform venue determination more accurately compared to relying on only a single determination criterion.

[0139] The visitor device may be a smartphone, tablet, or personal computer. The display device that shows the video of the virtual venue may be different from or the same as the device that transmits the visitor ID. For example, some visitors may display the video of the virtual venue on a personal computer (video providing device 7) while transmitting their visitor ID and inputting predetermined operations using a smartphone (visitor device 3), while other visitors may display the video of the virtual venue and perform predetermined operations (such as reading an optical code) in the virtual venue using a personal computer (visitor device 3). By combining multiple venue determination criteria in this embodiment, even when visitors visit the event venue (physical venue, virtual venue) using various devices, the event venue where the predetermined operation of the visitor device 3 was performed can be appropriately determined.

[0140] Each function shown in Figure 1 may be consolidated into a single device or distributed across multiple devices. Furthermore, each function may be provided as a cloud service or deployed in an on-premises environment.

[0141] Some of the processing performed by the information processing device 1 in the above-described embodiment may be performed by other devices (visitor device 3, video display device 4, admission confirmation device 51, participant device 52, etc.). For example, some of the processing performed by the information processing device 1 may be performed by the visitor device 3. In this case, a computer system is configured that includes the computer of the information processing device 1 and the computer of the visitor device 3, and it can be said that the processing according to this embodiment is performed by the cooperation of multiple computers in this computer system. The invention described in the original claims of this application is listed below. [1] A method by which an information processing system collects information about the behavior of attendees at an event, The physical venue for the aforementioned event is referred to as the physical venue. A venue where the content of the aforementioned event can be experienced through video is called a virtual venue. The information used to identify the aforementioned visitors is called visitor identification information. Information relating to the actions of a single visitor in the aforementioned physical venue or virtual venue shall be referred to as behavioral information. Information indicating that the aforementioned visitor has come to the physical venue is called visitor information. The device operated by the aforementioned visitor is called the visitor device. A step of acquiring the attendance information of each of the aforementioned attendees who came to the aforementioned physical venue, If a predetermined operation corresponding to a predetermined action in the physical venue or the virtual venue is performed on the visitor device of one of the visitors, The acquisition status of the aforementioned visitor information for that one visitor, The content of the predetermined action indicated by the predetermined operation, The time when the prescribed operation was performed, A step of determining whether the predetermined operation was performed in the physical venue or the virtual venue, depending on at least one of the following: When a predetermined operation is performed on the visitor device of one of the aforementioned visitors, the process involves associating the action information relating to the predetermined action indicated by the predetermined operation, the venue information indicating the determination result of the venue where the predetermined operation was performed, and the visitor identification information of the aforementioned visitor with each other and storing them in a storage device. A method of having. [2] When a predetermined operation is performed on the visitor device of one of the aforementioned visitors, the step of determining the venue in which the predetermined operation was performed is: If the attendance information of the said visitor is obtained, it is determined that the prescribed operation has been performed at the physical venue. If the aforementioned visitor information of the said visitor is not obtained, the determination that the prescribed operation was performed in the virtual venue is included. The method described in [1]. [3] The period during which the aforementioned physical venue is open is called the opening period. The time associated with the aforementioned visitor information, which is the time when the visitor was at the physical venue, is referred to as the time of arrival. The time at which the aforementioned predetermined operation is performed is called the operation time. When a predetermined operation is performed on the visitor device of one of the aforementioned visitors, the step of determining the venue in which the predetermined operation was performed is: If the visit information of the visitor is obtained and the time of the operation of the predetermined operation falls within the opening time period that includes the time of the visit associated with the visit information, then it is determined that the predetermined operation was performed at the physical venue. If the visit information of the visitor in question is not obtained, or if the time of the operation of the predetermined operation is not included in the opening time period that includes the time of the visit associated with the visit information, then it is determined that the predetermined operation was performed in the virtual venue. The method described in [2]. [4] The visitor information associated with the time of entry of the visitor into the physical venue is referred to as the entry information. The attendance information associated with the time of departure of the aforementioned visitor from the physical venue is referred to as departure information. The time at which the aforementioned predetermined operation is performed is called the operation time. When a predetermined operation is performed on the visitor device of one of the aforementioned visitors, the step of determining the venue in which the predetermined operation was performed is: If, among the one or more entry times associated with the one or more entry information obtained for that visitor, the exit information for that visitor is not obtained, and the exit time is included in the post-entry period which is the period from the entry time immediately preceding the operation time to the operation time of the predetermined operation, then it is determined that the predetermined operation was performed at the physical venue. If the departure information of a particular visitor associated with the departure time included in the period after admission is obtained, the determination that the predetermined operation has been performed in the virtual venue includes: The method described in [2]. [5] A device used by the event organizer or participant at the aforementioned physical venue to acquire information indicating that the attendee has arrived at the physical venue is referred to as a venue-side device. The step of acquiring the visitor information includes acquiring the visitor information using at least one of the venue-side equipment and the visitor equipment. The method described in [1]. [6] The venue-side device that acquires information indicating that the visitor has entered the physical venue is called an entry confirmation device. The step of acquiring the aforementioned visitor information includes acquiring the visitor information indicating that the visitor has entered the physical venue using at least one of the admission confirmation device and the visitor device. The method described in [5]. [7] Information indicating whether or not the visitor device is present in the aforementioned physical venue is referred to as existence / non-existence information. The visitor device has a step of acquiring the presence / absence information, The step of acquiring the visitor information includes acquiring the existence information of a visitor, which is acquired by the visitor device of a single visitor and indicates that the visitor device is present at the physical venue, as the visitor information of that single visitor. When a predetermined operation is performed on the visitor device of one of the aforementioned visitors, the step of determining the venue in which the predetermined operation was performed is: If the presence information is obtained indicating that the visitor device of the visitor in question is present at the physical venue, it is determined that the predetermined operation has been performed at the physical venue. If the presence or absence information is obtained indicating that the visitor device of the visitor in question does not exist in the physical venue, the determination is made that the predetermined operation has been performed in the virtual venue. The method described in [1]. [8] The step of determining the venue in which the predetermined operation was performed in the visitor device includes determining that the predetermined operation was performed in the virtual venue if the predetermined action indicated by the predetermined operation corresponds to a virtual venue usage action indicating the use of the virtual venue. The method described in [1]. [9] At least some of the aforementioned virtual venue usage behaviors, Actions related to accessing the server providing the virtual venue, or This refers to operations performed on exhibits or objects placed within the virtual venue. The method described in [8].

[10] The period during which the physical venue is open and the period during which the virtual venue is open are different. The step of determining the venue where the predetermined operation was performed in the visitor device is as follows: If the time when the prescribed operation is performed falls within the opening period of the physical venue, it is determined that the prescribed operation was performed at the physical venue; if the time when the prescribed operation is performed does not fall within the opening period of the physical venue, it is determined that the prescribed operation was performed at the virtual venue. Or, This includes determining that the predetermined operation was performed at the virtual venue if the time the predetermined operation was performed falls within the opening period of the virtual venue, and determining that the predetermined operation was performed at the physical venue if the time the predetermined operation was performed does not fall within the opening period of the virtual venue. The method described in [1].

[11] A program comprising at least one instruction that causes an information processing system to perform a process of collecting information about the behavior of attendees at an event, The processing performed by the information processing system in accordance with the aforementioned instructions includes each step of the method described in any one of items [1] to

[10] , program.

[12] An information processing system that collects and processes information about the behavior of attendees at an event, At least one processor, Having at least one memory, The memory stores at least one instruction that causes the processor to perform processing. The at least one processor performs the information processing, which includes each step of the method according to any one of [1] to

[10] , in accordance with the instructions stored in the at least one memory. Information processing system.

[13] An information processing system that collects information about the behavior of attendees at an event, The system comprises means for carrying out each step of the method described in any one of the items [1] to

[10] , Information processing system. [Explanation of Symbols]

[0142] 1...Information processing device, 11...Communication unit, 12...Storage unit, 121...Program, 13...Processing unit, 2...Storage device, 21...Visitor DB, 22...Participant DB, 23...Content management DB, 24...Activity record DB, 25...Content, 3...Visitor device, 31...Communication unit, 311...Mobile communication unit, 312...Wireless LAN communication unit, 313...Bluetooth communication unit, 314...NFC unit, 32...Input unit, 33...Display unit, 34...Imaging unit, 35...Sound output unit, 36...Sound input unit, 37...Location detection unit, 38...Storage unit, 381...Program, 39...Processing unit, 4...Video display device, 51...Entry confirmation device, 52...Participant device, 53...IC tag reader, 61...Wireless LAN device, 62...Beacon transmitter, 7...Video provision device, 9...Communication network

Claims

1. A method by which an information processing system collects information about the behavior of attendees at an event, The physical venue for the aforementioned event is referred to as the physical venue. A venue where the content of the aforementioned event can be experienced through video is called a virtual venue. The information used to identify the aforementioned visitors is called visitor identification information. Information relating to the actions of a single visitor in the aforementioned physical venue or virtual venue shall be referred to as behavioral information. Information indicating that the aforementioned visitor has come to the physical venue is called visitor information. The device operated by the aforementioned visitor is called the visitor device. A step of acquiring the attendance information of each of the aforementioned attendees who came to the aforementioned physical venue, If a predetermined operation corresponding to a predetermined action in the physical venue or the virtual venue is performed on the visitor device of one of the visitors, The acquisition status of the aforementioned visitor information for that one visitor, The content of the predetermined action indicated by the predetermined operation, The time when the prescribed operation was performed, A step of determining whether the predetermined operation was performed in the physical venue or the virtual venue, depending on at least one of the following: When a predetermined operation is performed on the visitor device of one of the aforementioned visitors, the process includes associating the action information relating to the predetermined action indicated by the predetermined operation, the venue information indicating the determination result of the venue where the predetermined operation was performed, and the visitor identification information of the aforementioned visitor with each other and storing them in a storage device, The period during which the aforementioned physical venue is open is called the opening period. The time associated with the aforementioned visitor information, which is the time when the visitor was at the physical venue, is referred to as the time of arrival. The time at which the aforementioned predetermined operation is performed is called the operation time. When a predetermined operation is performed on the visitor device of one of the aforementioned visitors, the step of determining the venue in which the predetermined operation was performed is: If the visit information of the visitor is obtained and the time of the operation of the predetermined operation falls within the opening time period that includes the time of the visit associated with the visit information, then it is determined that the predetermined operation was performed at the physical venue. If the visit information of the visitor in question is not obtained, or if the time of the operation of the predetermined operation is not included in the opening time period that includes the time of the visit associated with the visit information, then it is determined that the predetermined operation was performed in the virtual venue. method.

2. When a predetermined operation is performed on the visitor device of one of the visitors, the step of determining the venue in which the predetermined operation was performed is: Even if the visit information of a particular visitor is obtained and the time of the operation of the predetermined operation falls within the opening time period that includes the time of the visit associated with the visit information, if the predetermined action indicated by the predetermined operation corresponds to a virtual venue usage action indicating the use of the virtual venue, the determination that the predetermined operation was performed in the virtual venue takes precedence over the determination based on the opening time period. The method according to claim 1.

3. At least some of the aforementioned virtual venue usage behaviors, Actions related to accessing the server providing the virtual venue, or This refers to operations performed on exhibits or objects placed within the virtual venue. The method according to claim 2.

4. A method by which an information processing system collects information about the behavior of attendees at an event, The physical venue for the aforementioned event is referred to as the physical venue. A venue where the content of the aforementioned event can be experienced through video is called a virtual venue. The information used to identify the aforementioned visitors is called visitor identification information. Information relating to the actions of a single visitor in the aforementioned physical venue or virtual venue shall be referred to as behavioral information. Information indicating that the aforementioned visitor has come to the physical venue is called visitor information. The device operated by the aforementioned visitor is called the visitor device. A step of acquiring the attendance information of each of the aforementioned attendees who came to the aforementioned physical venue, If a predetermined operation corresponding to a predetermined action in the physical venue or the virtual venue is performed on the visitor device of one of the visitors, The acquisition status of the aforementioned visitor information for that one visitor, The content of the predetermined action indicated by the predetermined operation, The time when the prescribed operation was performed, A step of determining whether the predetermined operation was performed in the physical venue or the virtual venue, depending on at least one of the following: When a predetermined operation is performed on the visitor device of one of the aforementioned visitors, the process includes associating the action information relating to the predetermined action indicated by the predetermined operation, the venue information indicating the determination result of the venue where the predetermined operation was performed, and the visitor identification information of the aforementioned visitor with each other and storing them in a storage device, The visitor information associated with the time of entry of the visitor into the physical venue is referred to as the entry information. The attendance information associated with the time of departure of the aforementioned visitor from the physical venue is referred to as departure information. The time at which the aforementioned predetermined operation is performed is called the operation time. When a predetermined operation is performed on the visitor device of one of the aforementioned visitors, the step of determining the venue in which the predetermined operation was performed is: If one or more pieces of entry information are obtained for a single visitor, and if, among the one or more entry times associated with the one or more pieces of entry information, no exit information for that visitor is obtained that is associated with the exit time included in the post-entry period, which is the period from the entry time immediately preceding the operation time to the operation time of the predetermined operation, then it is determined that the predetermined operation was performed at the physical venue. If one or more pieces of entry information are obtained for a single visitor, and if the exit information for that visitor is associated with the exit time included in the post-entry period, then it is determined that the predetermined operation has been performed in the virtual venue. If the aforementioned entry information of the visitor is not obtained, the system includes determining that the prescribed operation was performed in the virtual venue. method.

5. Information indicating whether or not the visitor device is present in the aforementioned physical venue is referred to as existence / non-existence information. The visitor device has a step of acquiring the presence / absence information, The step of acquiring the visitor information includes acquiring the existence information of a visitor, which is acquired by the visitor device of a single visitor and indicates that the visitor device is present at the physical venue, as the visitor information of that single visitor. When a predetermined operation is performed on the visitor device of one of the aforementioned visitors, the step of determining the venue in which the predetermined operation was performed is: If one or more pieces of entry information are obtained for a particular visitor, and even if the exit information for that visitor associated with the exit time included in the post-entry period is not obtained, if the existence information indicating that the visitor device for that visitor is not present in the physical venue is obtained, then the determination that the predetermined operation was performed in the virtual venue takes precedence over the determination based on the post-entry period. The method according to claim 4.

6. A method by which an information processing system collects information about the behavior of attendees at an event, The physical venue for the aforementioned event is referred to as the physical venue. A venue where the content of the aforementioned event can be experienced through video is called a virtual venue. The information used to identify the aforementioned visitors is called visitor identification information. Information relating to the actions of a single visitor in the aforementioned physical venue or virtual venue shall be referred to as behavioral information. Information indicating that the aforementioned visitor has come to the physical venue is called visitor information. The device operated by the aforementioned visitor is called the visitor device. A step of acquiring the attendance information of each of the aforementioned attendees who came to the aforementioned physical venue, If a predetermined operation corresponding to a predetermined action in the physical venue or the virtual venue is performed on the visitor device of one of the visitors, The acquisition status of the aforementioned visitor information for that one visitor, The content of the predetermined action indicated by the predetermined operation, The time when the prescribed operation was performed, A step of determining whether the predetermined operation was performed in the physical venue or the virtual venue, depending on at least one of the following: When a predetermined operation is performed on the visitor device of one of the aforementioned visitors, the process includes associating the action information relating to the predetermined action indicated by the predetermined operation, the venue information indicating the determination result of the venue where the predetermined operation was performed, and the visitor identification information of the aforementioned visitor with each other and storing them in a storage device, The period during which the physical venue is open and the period during which the virtual venue is open are different. The step of determining the venue where the predetermined operation was performed in the visitor device is as follows: If the time when the prescribed operation is performed falls within the opening period of the physical venue, it is determined that the prescribed operation was performed at the physical venue; if the time when the prescribed operation is performed does not fall within the opening period of the physical venue, it is determined that the prescribed operation was performed at the virtual venue. Or, This includes determining that the predetermined operation was performed at the virtual venue if the time the predetermined operation was performed falls within the opening period of the virtual venue, and determining that the predetermined operation was performed at the physical venue if the time the predetermined operation was performed does not fall within the opening period of the virtual venue. method.

7. Information indicating whether or not the visitor device is present in the aforementioned physical venue is referred to as existence / non-existence information. The visitor device has a step of acquiring the presence / absence information, The step of acquiring the visitor information includes acquiring the existence information of a visitor, which is acquired by the visitor device of a single visitor and indicates that the visitor device is present at the physical venue, as the visitor information of that single visitor. When a predetermined operation is performed on the visitor device of one of the aforementioned visitors, the step of determining the venue in which the predetermined operation was performed is: Even if the time during which the prescribed operation is performed falls within the opening period of the physical venue, if the existence information indicating that the visitor device of the visitor in question does not exist in the physical venue is obtained, the determination that the prescribed operation was performed in the virtual venue takes precedence over the determination based on the opening period of the physical venue. The method according to claim 6.

8. A device used by the event organizer or participant at the aforementioned physical venue to acquire information indicating that the attendee has arrived at the physical venue is referred to as a venue-side device. The step of acquiring the visitor information includes acquiring the visitor information using at least one of the venue-side equipment and the visitor equipment. The method according to any one of claims 1 to 7.

9. The venue-side device that acquires information indicating that the visitor has entered the physical venue is called an entry confirmation device. The step of acquiring the aforementioned visitor information includes acquiring the aforementioned visitor information indicating that the visitor has entered the physical venue using at least one of the aforementioned entry confirmation device and the aforementioned visitor device. The method according to claim 8.

10. A program comprising at least one instruction that causes an information processing system to perform a process of collecting information about the behavior of attendees at an event, The processing performed by the information processing system in accordance with the aforementioned instruction includes each step of the method described in any one of claims 1 to 7. program.

11. An information processing system that collects and processes information about the behavior of attendees at an event, At least one processor, Having at least one memory, The memory stores at least one instruction that causes the processor to perform processing. The at least one processor performs the information processing, which includes each step of the method according to any one of claims 1 to 7, in accordance with the instructions stored in the at least one memory. Information processing system.

12. An information processing system that collects information about the behavior of attendees at an event, The method comprises means for performing each step of the method described in any one of claims 1 to 7. Information processing system.

Images