Method, system and related device for live interaction based on mobile terminal
By binding mobile terminals with seat numbers, the system achieves automatic binding and rich interactive effects, solving the problems of high workload and cost in binding glow sticks in existing technologies.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HANGZHOU TAOPIAOPIAO FILM & TELEVISION CULTURE CO LTD
- Filing Date
- 2022-10-20
- Publication Date
- 2026-05-12
AI Technical Summary
In existing on-site interactive technologies, binding glow sticks to seats is labor-intensive, costly, and offers limited interactive effects.
By establishing a binding relationship between the mobile terminal's terminal identifier and the seat number carried in the ticketing information, it serves as an information exchange bridge between the central control server and the mobile terminal, generating an interaction scheme and pushing data instruction sets to realize the automatic binding and interactive operation of the mobile terminal.
It reduces the workload of binding, improves the efficiency of binding and interaction, reduces equipment costs, and enriches the interactive effects.
Smart Images

Figure CN115802515B_ABST
Abstract
Description
Technical Field
[0001] This document relates to the field of information processing technology, and in particular to a method, system and related apparatus for on-site interaction based on a mobile terminal. Background Technology
[0002] Interactive technology solutions are commonly used in interactive venues such as concerts, fan meetings, and various parties, and typically use variable light glow sticks for interactive displays.
[0003] Specifically, the variable-light glow sticks receive data instructions from the central control system and display different colors or flashing frequencies according to the data instructions, thereby displaying different interactive effects at the interactive site, such as heart-shaped patterns, concert artist names, etc.
[0004] However, current interactive technology solutions require manual binding of glow sticks to seats, which is labor-intensive, and glow sticks are expensive with limited interactive effects. Summary of the Invention
[0005] The purpose of one or more embodiments of this specification is to provide a method, system, and related apparatus for on-site interaction based on a mobile terminal, so as to reduce the workload of binding, improve the efficiency of binding and interaction, reduce the cost of interactive equipment, and enrich the interactive effect.
[0006] To solve the above-mentioned technical problems, one or more embodiments of this specification are implemented as follows:
[0007] Firstly, a method for on-site interaction based on a mobile terminal is proposed, which is applied to the central control server of an on-site interaction system. The method includes:
[0008] Receive multiple binding information, where each binding information is determined by the binding relationship established between the mobile terminal and the seat number carried in the ticketing information;
[0009] Obtain seating layout information within the interactive space and select a matching interactive strategy from a pre-set interactive strategy library;
[0010] An interaction scheme is generated based on the seat layout information and the selected interaction strategy, wherein the interaction scheme includes a data instruction set corresponding to each seat;
[0011] Based on the multiple binding information, the corresponding seat number is found for each data instruction set in the interaction scheme, and the data instruction set is pushed to the mobile terminal corresponding to the terminal identifier that is bound to the seat number, so that the mobile terminal can execute the corresponding interactive operation according to the received data instruction set when the data instruction time arrives.
[0012] Secondly, a method for on-site interaction based on a mobile terminal is proposed, which is applied to the mobile terminal of an on-site interaction system. The method includes:
[0013] Determine the terminal identifier used to uniquely identify the mobile terminal;
[0014] Establish a binding relationship between the terminal identifier and the seat number carried in the ticketing information;
[0015] The binding information determined based on the binding relationship is uploaded to the central control server so that the central control server can generate an interaction plan based on the obtained seat layout information and the selected interaction strategy, and find the corresponding seat number for each data instruction set in the interaction plan based on the binding information, and push the data instruction set to the mobile terminal corresponding to the terminal identifier that has a binding relationship with the seat number.
[0016] Based on the received data instruction set, execute the corresponding interactive operation when the data instruction time arrives.
[0017] Thirdly, a mobile terminal-based on-site interactive system is proposed, comprising: a central control server and multiple mobile terminals distributed on seats within the interactive venue; wherein,
[0018] The mobile terminal is used to determine a terminal identifier that identifies the uniqueness of the mobile terminal, establish a binding relationship between the terminal identifier and the seat number carried in the ticketing information, and upload the binding information determined based on the binding relationship to the central control server.
[0019] The central control server is used to receive multiple binding information, obtain seat layout information in the interactive venue, select a matching interactive strategy from the preset interactive strategy library, generate an interactive scheme based on the seat layout information and the selected interactive strategy, find the corresponding seat number for each data instruction set in the interactive scheme based on the multiple binding information, and push the data instruction set to the mobile terminal corresponding to the terminal identifier that is bound to the seat number.
[0020] The mobile terminal is also used to execute the corresponding interactive operation of the data instruction when the data instruction time arrives, based on the received data instruction set.
[0021] Fourthly, a central control server is proposed, including:
[0022] The receiving module is used to receive multiple binding information, wherein each binding information is determined by the binding relationship established between the mobile terminal and the seat number carried in the ticketing information;
[0023] The acquisition module is used to acquire seating layout information within the interactive venue and select a matching interactive strategy from a preset interactive strategy library.
[0024] A generation module is used to generate an interaction scheme based on the seat layout information and the selected interaction strategy, wherein the interaction scheme includes a data instruction set corresponding to each seat;
[0025] The sending module is used to find the corresponding seat number for each data instruction set in the interaction scheme based on the multiple binding information, and push the data instruction set to the mobile terminal corresponding to the terminal identifier that is bound to the seat number, so that the mobile terminal can execute the corresponding interactive operation according to the received data instruction set when the data instruction time arrives.
[0026] Fifthly, a mobile terminal is proposed, including:
[0027] The determination module is used to determine the terminal identifier used to identify the uniqueness of the mobile terminal.
[0028] A module is established to create a binding relationship between the terminal identifier and the seat number carried in the ticketing information;
[0029] The sending module is used to upload the binding information determined based on the binding relationship to the central control server, so that the central control server can generate an interaction scheme based on the acquired seat layout information and the selected interaction strategy, and find the corresponding seat number for each data instruction set in the interaction scheme based on the binding information, and push the data instruction set to the mobile terminal corresponding to the terminal identifier that has a binding relationship with the seat number.
[0030] The execution module is used to execute the corresponding interactive operation based on the received data instruction set when the data instruction time arrives.
[0031] Sixthly, an electronic device is proposed, comprising:
[0032] Processor; and
[0033] A memory configured to store computer-executable instructions, which, when executed, cause the processor to perform either the method for on-site interaction based on a mobile terminal as described in the first aspect or the method for on-site interaction based on a mobile terminal as described in the second aspect.
[0034] In a seventh aspect, a computer-readable storage medium is provided, the computer-readable storage medium storing one or more programs, which, when executed by an electronic device including multiple applications, cause the electronic device to perform the method for on-site interaction based on a mobile terminal as described in the first aspect or the method for on-site interaction based on a mobile terminal as described in the second aspect.
[0035] As can be seen from the technical solutions provided by one or more embodiments in the above specification, a mobile terminal is used as an interactive device that emits light. The binding relationship established between the seat number carried in the ticketing information and the terminal identifier of the mobile terminal serves as an information exchange bridge between the mobile terminal and the central control server. After the central control server generates an interactive scheme based on the acquired seat layout information and the selected interactive strategy, it sends the data instruction set for each seat in the interactive scheme to the mobile terminal corresponding to the terminal identifier bound to the seat number, according to the binding information determined by the binding relationship. Thus, the mobile terminal can execute the corresponding interactive operation based on the data instruction set when the data instruction time arrives. Therefore, on-site interaction is achieved through the light-emitting function of the mobile terminal, without the need for manual seat binding. The binding between the seat and the mobile terminal as an interactive device can be achieved solely through ticketing information, reducing the binding workload, improving binding and interaction efficiency, and lowering the cost of interactive equipment. Furthermore, the mobile terminal also has an interface display function, which can enrich the interactive effect. Attached Figure Description
[0036] To more clearly illustrate the technical solutions in one or more embodiments or prior art of this specification, the accompanying drawings used in the description of one or more embodiments or prior art will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments recorded in this specification. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0037] Figure 1 This is a schematic diagram of the on-site interactive system provided in the embodiments of this specification.
[0038] Figure 2 This is one of the schematic diagrams illustrating the steps of a method for on-site interaction based on a mobile terminal, as provided in the embodiments of this specification.
[0039] Figure 3 This is the second schematic diagram of the steps of a method for on-site interaction based on a mobile terminal provided in the embodiments of this specification.
[0040] Figure 4 This is a schematic diagram of the live concert interaction process provided in the embodiments of this specification.
[0041] Figure 5This is a schematic diagram of the structure of the central control server provided in the embodiments of this specification.
[0042] Figure 6 This is a schematic diagram of the structure of the mobile terminal provided in the embodiments of this specification.
[0043] Figure 7 This is a schematic diagram of the structure of an electronic device provided in one embodiment of this specification. Detailed Implementation
[0044] To enable those skilled in the art to better understand the technical solutions in this specification, the technical solutions in one or more embodiments of this specification will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described one or more embodiments are only some embodiments of this specification, and not all embodiments. All other embodiments obtained by those skilled in the art based on one or more embodiments of this specification without creative effort should fall within the protection scope of this document.
[0045] Given that current interactive technologies require manual binding of glow sticks to seats, resulting in significant workload, high cost of glow sticks, and limited interactive effects, this specification proposes a mobile terminal-based on-site interaction solution. The main concept is to use a mobile terminal as the light-emitting interactive device. A binding relationship is established between the seat number carried in the ticketing information and the mobile terminal's identifier, serving as an information exchange bridge between the mobile terminal and the central control server. After the central control server generates an interactive plan based on the acquired seat layout information and the selected interactive strategy, it sends the data command set for each seat in the interactive plan to the mobile terminal corresponding to the terminal identifier bound to the seat number, according to the binding information determined by the binding relationship. Thus, the mobile terminal can execute the corresponding interactive operation based on the data command set when the data command time arrives. Therefore, on-site interaction is achieved through the light-emitting function of the mobile terminal, eliminating the need for manual seat binding. Binding between seats and the mobile terminal as the interactive device can be achieved solely through ticketing information, reducing the binding workload, improving binding and interaction efficiency, and lowering the cost of interactive equipment. Furthermore, the mobile terminal also has an interface display function, enriching the interactive experience.
[0046] Reference Figure 1 The diagram shown is a structural schematic of the on-site interactive system provided in an embodiment of this specification. This on-site interactive system may include: a central control server 102 and multiple mobile terminals 104 distributed across different seats within the interactive area. It should be understood that... Figure 1The diagram only shows the connection between the central control server 102 and the mobile terminal 104, without specifying the exact location of the mobile terminal 104. In a real-world scenario, the mobile terminals 104 are distributed across each seat in the interactive space, and the different seat layouts result in different locations for the multiple mobile terminals 104. The central control server 102 can be any device capable of providing computing services, responding to service requests, and processing data, such as a cloud server, cloud host, virtual data center, or conventional server. The central control server 102 mainly consists of a processor, hard drive, memory, and system bus, similar to a general computer architecture. The mobile terminal 104 can be a smartphone, tablet, or other intelligent electronic device with light-emitting capabilities and data processing abilities.
[0047] Mobile terminal 104 can determine a terminal identifier used to identify the uniqueness of mobile terminal 104, establish a binding relationship between the terminal identifier and the seat number carried in the ticketing information, and upload the binding information determined based on the binding relationship to the central control server.
[0048] In the embodiments of this specification, the terminal identifier of the mobile terminal 104 can be the MAC address or SIM card identifier of the mobile terminal. Optionally, in the embodiments of this specification, the mobile terminal 104 is preferably a portable mobile phone or tablet with communication functions; in this case, the terminal identifier of the mobile terminal 104 can be the SIM card number.
[0049] It should be understood that, in the embodiments of this specification, the ticketing information is readily available to the mobile terminal 104. For example, the ticketing information can be obtained by purchasing tickets online through a user account, by scanning electronic tickets, by purchasing paper tickets offline, or by being transferred by other users.
[0050] When establishing the binding relationship between the terminal identifier and the seat number carried in the ticketing information, the mobile terminal 104 can determine that the electronic ticket was purchased by a user account created with the terminal identifier, extract the seat number from the ticketing information of the electronic ticket, and establish the binding relationship between the terminal identifier and the seat number. In other words, the mobile terminal 104 can use an installed application to purchase electronic tickets within the application using a user account registered with the terminal identifier (e.g., through group buying of electronic tickets via an app), or transfer electronic tickets purchased by a user account registered with the terminal identifier to the application (e.g., transfer purchased electronic tickets to an electronic ticket wallet). Since the electronic ticket is within the application of the mobile terminal 104, the identification or reading function within the application can be conveniently used to extract the seat number from the ticketing information of the electronic ticket, and then establish the binding relationship between the terminal identifier and the seat number, that is, bind the mobile terminal 104 to the seat corresponding to the seat number on the ticketing information of the purchased ticket.
[0051] For users purchasing multiple tickets (electronic or paper) using a mobile device (104), by default, only one seat can be bound to the mobile device. Other tickets can be transferred or linked to other users' mobile devices. See the following two binding methods for details:
[0052] Method 1:
[0053] Mobile terminal 104a can transfer excess electronic tickets to multiple other users. Each other user can use their own mobile terminal 104b to scan the ticket barcode of the electronic ticket purchased by mobile terminal 104a. In fact, the ticket barcode can be carried on the electronic ticket itself, or it can be generated based on the electronic ticket. In this embodiment, the ticket barcode can be a two-dimensional barcode or a three-dimensional barcode. After other users scan the ticket barcode using mobile terminal 104b, they can obtain the ticket information corresponding to the ticket barcode, extract the seat number from the ticket information, and establish a binding relationship between the terminal identifier and the seat number.
[0054] Method 2:
[0055] Mobile terminal 104a can transfer excess tickets to multiple other users. Other users can search for seats in the interactive venue that correspond to the seat numbers in the ticket information. Generally, each seat has a seat barcode. Other users can use mobile terminal 104b to scan the seat barcode to obtain the seat number corresponding to the seat barcode, thereby establishing a binding relationship between the terminal identifier and the seat number.
[0056] Method 3:
[0057] Mobile terminal 104a can transfer excess electronic tickets to other users' mobile terminals 104b, so that mobile terminal 104b can extract seat numbers from the received electronic tickets and establish a binding relationship between the terminal identifier and the seat number.
[0058] In the embodiments of this specification, after establishing the binding relationship between the terminal identifier and the seat number, the binding information can be determined from these binding relationships, for example, terminal identifier - seat number; that is, each binding relationship can determine one piece of binding information. Subsequently, any mobile terminal 104 that has established a binding relationship in the interactive venue can upload the binding information determined based on the binding relationship to the central control server 102.
[0059] The central control server 102 receives binding information from multiple mobile terminals and can cache it on a local storage device. Simultaneously, the central control server 102 can also obtain seating layout information within the interactive area, thus knowing the seat number of each seat, its location within the interactive area, and the overall layout. Furthermore, the central control server 102 selects a matching interactive strategy from a preset interactive strategy library, generates an interactive scheme containing data instruction sets corresponding to each seat based on the seating layout information and the selected interactive strategy, and then, based on the previously received binding information, finds the corresponding seat number for each data instruction set in the interactive scheme and pushes the data instruction set to the mobile terminal 104 corresponding to the terminal identifier bound to the seat number.
[0060] In the embodiments of this specification, the central control server 102 may be configured with a preset interactive strategy library by default. This preset interactive strategy library maintains various interactive strategies, including: a seating dot matrix strategy based on time-series control, a seating dot matrix strategy based on the target person's body posture control, and a seating dot matrix strategy based on beat control, etc. According to the dot matrix strategy, the audience group can perform overall interaction, that is, adjacent audience members may receive different instructions and signals, so different colors or patterns are displayed on their mobile terminals. Among them, each type of interactive strategy can maintain multiple seating dot matrix patterns, which may include: various preset patterns (such as heart patterns), brand names, personal names, etc. Among them, the seating dot matrix strategy based on time-series control means that the selected seating dot matrix pattern is controlled by time, and the dot matrix pattern changes as time changes. For example, the heart pattern displayed in a specific area of the interactive venue changes to a star pattern. Seating layout strategies based on target person's body posture control refer to seat layout patterns that change in response to the target person's body posture. For example, the entire interactive space might change its illuminated color in sync with the singer's hand gestures. Seating layout strategies based on beat control refer to seat layout patterns that change in sync with the music beat. For example, a specific area of the interactive space might display a singer's name as a heart shape.
[0061] Optionally, when the central control server 102 selects a matching interactive strategy from the preset interactive strategy library, it can specifically determine the interactive requirements used to characterize the performance effect according to the performance process; based on the interactive requirements, it selects at least one interactive strategy that matches the interactive requirements from the preset interactive strategy library; wherein, the selected at least one interactive strategy may include: a seating matrix strategy based on time-series control and / or a seating matrix strategy based on the target person's body posture control.
[0062] In fact, in the embodiments of this specification, in addition to being determined according to the performance process, the interactive requirements can also be flexibly customized according to the individual needs of the performers and the objective environment such as the venue facilities to meet the desired performance effect. The determined interactive requirements may include one or more requirement conditions; requirement conditions may include, for example, achieving full-venue lighting and flashing; or achieving flashing in a specific area; or achieving alternating lighting of heart-shaped patterns and singer name patterns in a specific area. Considering that there may be multiple requirement conditions in the determined interactive requirements, multiple interactive strategies can be matched based on these conditions. For example, a seating matrix strategy based on timing control and a seating matrix strategy based on the target person's body posture control can be matched simultaneously.
[0063] Optionally, when the central control server 102 generates an interaction scheme based on the seat layout information and the selected interaction strategy, it can generate a seat matrix data stream corresponding to the seat layout information based on the seat matrix strategy in the selected interaction strategy; then, it can parse and transform the seat matrix data stream to obtain the data instructions corresponding to each seat in each frame; and then, it can merge the data instructions of all frames for each seat to obtain the instruction dataset for that seat. In fact, when generating the interaction scheme, it is also possible to consider setting a fixed interaction strategy for the entire program, or setting different interaction strategies for each program unit. For example, when singing the first song, a seat matrix strategy based on timing control can be used to generate the interaction scheme for that program unit; when singing the second song, a seat matrix strategy based on target person's body posture control can be used to generate the interaction scheme for that program unit. Alternatively, a seat matrix strategy based on timing control can be set to generate the interaction scheme for each program unit throughout the entire program.
[0064] Based on the received data instruction set, the mobile terminal 104 executes the corresponding interactive operation when the data instruction time arrives. It should be understood that not every data instruction's interactive operation is a simple action like lighting up or flashing; it could also be sending control instructions to the central control server 102, such as the sending of acquisition instructions discussed below.
[0065] In fact, multiple camera devices can be set up in the interactive space, especially around the stage, to capture images of the target person on stage in real time. When the central control server 102 responds to the interactive operation corresponding to the data instruction executed by the mobile terminal 104, triggering a collection instruction (i.e., the interactive operation executed by the mobile terminal 104 is sending a collection instruction to the central control server 102), it captures the location image of the target person in the interactive space and extracts the target person's body posture from the location image; according to the direction pointed to by the target person's body posture in the interactive space, it sends a data instruction to the mobile terminal that is bound to the seat number of the seat covered by that direction, so as to instruct the mobile terminal that is bound to the seat number of the seat covered by that direction to execute the interactive operation corresponding to the data instruction.
[0066] For example, if the singer, as the target, makes a gesture of swinging their arms from side to side in the center of the stage, when the arm swings to the left, the mobile terminal in the seat area to the left of the singer lights up (or flashes); when the arm swings to the right, the mobile terminal in the seat area to the right of the singer lights up (or flashes). Thus, the live lighting interacts based on the singer's body posture.
[0067] In fact, in the embodiments of this specification, since the fluorescent device used is a mobile terminal, it is possible not only to use multiple seats in the interactive seating layout to work together to achieve various interactive seat dot matrix patterns, but also to achieve personalized interaction with a mobile terminal on a single seat. For example, personalized advertisements, lyrics prompts and other information can be pushed to the mobile terminal through broadcast, multicast or unicast, so that they can be displayed on the mobile terminal's display interface.
[0068] It should be understood that mobile terminals can be smart electronic devices such as mobile phones and tablets. Therefore, they can utilize their flashlight function, flashlight, or light-emitting screen to achieve light-emitting functions such as lighting up, flashing, or switching between different colors.
[0069] Therefore, through the above technical solution, a mobile terminal is used as an interactive device that emits light. The binding relationship established between the seat number carried in the ticketing information and the terminal identifier of the mobile terminal serves as an information exchange bridge between the mobile terminal and the central control server. After the central control server generates an interactive plan based on the acquired seat layout information and the selected interactive strategy, it sends the data instruction set for each seat in the interactive plan to the mobile terminal corresponding to the terminal identifier bound to the seat number, according to the binding information determined by the binding relationship. In this way, the mobile terminal can execute the corresponding interactive operation according to the data instruction set when the data instruction time arrives. Thus, on-site interaction is achieved through the light-emitting function of the mobile terminal, eliminating the need for manual seat binding. The binding between the seat and the mobile terminal as an interactive device can be achieved solely through ticketing information, reducing the binding workload, improving binding and interaction efficiency, and lowering the cost of interactive equipment. Furthermore, the mobile terminal also has an interface display function, which can enrich the interactive effect.
[0070] Reference Figure 2 The diagram illustrates the steps of a method for on-site interaction based on a mobile terminal, as provided in an embodiment of this specification. This method is applied to the central control server of an on-site interaction system and may include the following steps:
[0071] Step 202: Receive multiple binding information, wherein each binding information is determined by the binding relationship established between the mobile terminal and the seat number carried in the ticketing information.
[0072] The binding relationship can be established by the mobile terminal purchasing e-tickets based on a user account created with the terminal identifier, wherein the e-ticket information carries a seat number. Alternatively, the binding relationship can be established by the mobile terminal scanning the ticket barcode of an e-ticket purchased by another mobile terminal, wherein the ticket information corresponding to the ticket barcode carries a seat number; or, the binding relationship can be established by the mobile terminal scanning the seat barcode corresponding to the purchased ticket information, wherein the seat barcode carries a seat number; or, the binding relationship can be established by another mobile terminal transferring e-tickets to the mobile terminal, wherein the ticket information corresponding to the e-ticket carries a seat number.
[0073] Step 204: Obtain the seating layout information in the interactive venue and select a matching interactive strategy from the preset interactive strategy library.
[0074] Optionally, when selecting a matching interactive strategy from a preset interactive strategy library, interactive requirements for characterizing the performance effect can be determined according to the performance process; based on the interactive requirements, at least one interactive strategy matching the interactive requirements can be selected from the preset interactive strategy library; wherein, the interactive strategy includes: a seating matrix strategy based on time-series control and / or a seating matrix strategy based on the target person's body posture control.
[0075] Step 206: Generate an interaction scheme based on the seat layout information and the selected interaction strategy, wherein the interaction scheme includes a data instruction set corresponding to each seat.
[0076] Optionally, an interaction scheme can be generated based on the seat layout information and the selected interaction strategy. This can be achieved by generating a seat matrix data stream corresponding to the seat layout information based on the seat matrix strategy in the selected interaction strategy; parsing and transforming the seat matrix data stream to obtain the data instructions corresponding to each seat in each frame; and merging the data instructions of all frames for each seat to obtain the instruction dataset for that seat.
[0077] Step 208: Based on the multiple binding information, find the corresponding seat number for each data instruction set in the interaction scheme, and push the data instruction set to the mobile terminal corresponding to the terminal identifier that is bound to the seat number, so that the mobile terminal can execute the corresponding interactive operation according to the received data instruction set when the data instruction time arrives.
[0078] Optionally, when the mobile terminal executes the interactive operation corresponding to the corresponding data instruction, the central control server can also respond to the acquisition instruction triggered by the mobile terminal executing the interactive operation corresponding to the corresponding data instruction, acquire a location image of the target person in the interactive location, and extract the target person's body posture from the location image; according to the direction pointed to by the target person's body posture in the interactive location, send a data instruction to the mobile terminal that is bound to the seat number of the seat covered by that direction, so as to instruct the mobile terminal that is bound to the seat number of the seat covered by that direction to execute the interactive operation corresponding to the data instruction.
[0079] Reference Figure 3 The diagram illustrates a method for on-site interaction based on a mobile terminal, as provided in an embodiment of this specification. The method, applied to a mobile terminal in an on-site interaction system, may include:
[0080] Step 302: Determine the terminal identifier used to identify the uniqueness of the mobile terminal.
[0081] Step 304: Establish the binding relationship between the terminal identifier and the seat number carried in the ticketing information.
[0082] Optionally, by establishing a binding relationship between the terminal identifier and the seat number carried in the ticketing information, it is possible to determine the electronic ticket purchased by the user account created with the terminal identifier, extract the seat number from the ticketing information of the electronic ticket, and establish a binding relationship between the terminal identifier and the seat number.
[0083] Furthermore, it is also possible to scan the ticket barcode of an e-ticket purchased from another mobile terminal, obtain the ticket information corresponding to the ticket barcode, extract the seat number from the ticket information, and establish a binding relationship between the terminal identifier and the seat number; or, scan the seat barcode on the seat corresponding to the ticket information of a purchased ticket, obtain the seat number corresponding to the seat barcode, and establish a binding relationship between the terminal identifier and the seat number; or, receive e-tickets transferred from other mobile terminals, extract the seat number from the ticket information of the e-ticket, and establish a binding relationship between the terminal identifier and the seat number.
[0084] Step 306: Upload the binding information determined based on the binding relationship to the central control server so that the central control server can generate an interaction scheme based on the acquired seat layout information and the selected interaction strategy, and find the corresponding seat number for each data instruction set in the interaction scheme based on the binding information, and push the data instruction set to the mobile terminal corresponding to the terminal identifier that has a binding relationship with the seat number.
[0085] Step 308: Based on the received data instruction set, execute the corresponding interactive operation when the data instruction time arrives.
[0086] Reference Figure 4 The diagram shown is a schematic diagram of the live concert interaction process provided in the embodiments of this specification.
[0087] In this concert's interactive solution, a mobile phone is used as an interactive light-emitting device to exchange information with a central control server, enabling on-site interaction. Figure 4 This example uses only two mobile phones (phone A and phone B). In reality, many more mobile phones can participate, but these are not all shown here. For the interaction and communication methods between other mobile phones and the central control server, please refer to [the relevant documentation / reference]. Figure 4 This can be achieved using a mobile phone.
[0088] Step 402: Mobile phone A confirms the purchase of 2 concert e-tickets.
[0089] These two concert e-tickets can be purchased using mobile phone A with the user's account and stored in mobile phone A's e-ticket wallet. Each concert e-ticket records information such as the concert time, location, and seat number.
[0090] Step 404: Establish a binding relationship between mobile phone A and one of the concert e-tickets.
[0091] Specifically, mobile phone A reads the seat number M1 of one of the concert e-tickets and binds mobile phone number A with seat number M1, thereby establishing a binding relationship between mobile phone A and seat M1.
[0092] Step 406: Mobile phone A transfers another concert e-ticket to mobile phone B.
[0093] The concert e-ticket can contain a ticket barcode or seat barcode associated with the seat number. Mobile phone A can show the ticket barcode or seat barcode carried in another concert e-ticket to mobile phone B, so that mobile phone B can obtain the other concert e-ticket.
[0094] Step 408: Establish a binding relationship between mobile phone b and another concert e-ticket.
[0095] Mobile phone B can obtain another electronic concert ticket by scanning the ticket barcode or seat barcode displayed on mobile phone A, and then read the seat number M2 recorded therein. Mobile phone B's mobile phone number B is then bound to seat number M2, thus establishing a binding relationship between mobile phone B and seat M2.
[0096] Step 410: Mobile phone A and mobile phone B respectively upload their established binding relationships to the central control server.
[0097] Step 412: The central control server generates an interaction plan based on the seating layout and the selected interaction strategy.
[0098] The central control server can internally be configured with a ticketing module, a strategy module, an instruction control module, and an interaction module. Specifically, the ticketing module can obtain the seating layout of interactive venues and data on sold seats. The strategy module can then provide pluggable interaction strategies, meaning these strategies can be flexibly added or removed. The strategy module can select a matching interaction strategy based on interaction needs and generate a seat dot matrix pattern data stream based on the seating layout. This data stream is then pushed to the instruction control module, which parses it into time-distributed data instructions for each frame. Each frame's data instructions are then converted into data instructions for each seat, and all frames' data instructions for the corresponding seat are merged to obtain the data instruction set for each seat.
[0099] Step 414: The central control server pushes the data instruction set for each seat in the interactive solution to the mobile phone bound to that seat.
[0100] The central control server pushes the data instruction set of seat m1 to mobile phone a bound to seat m1. At the same time, the central control server pushes the data instruction set of seat m2 to mobile phone b bound to seat m2.
[0101] Step 416: Mobile phone a and mobile phone b receive their respective data instruction sets and execute them.
[0102] The data instruction set can be a real-time instruction, meaning it is executed as soon as it is received. Alternatively, it can be a pre-stored instruction, meaning that after receiving its respective data instruction set, phone A or phone B waits for the instruction time to expire or for a triggered action to occur before executing it.
[0103] Reference Figure 5 As shown, this is a central control server provided in an embodiment of this specification. The central control server 500 may include:
[0104] The receiving module 502 is used to receive multiple binding information, wherein each binding information is determined by the binding relationship established between the mobile terminal and the seat number carried in the ticketing information based on the terminal identifier;
[0105] The acquisition module 504 is used to acquire seating layout information in the interactive venue and select a matching interactive strategy from the preset interactive strategy library.
[0106] The generation module 506 is used to generate an interaction scheme based on the seat layout information and the selected interaction strategy, wherein the interaction scheme includes a data instruction set corresponding to each seat;
[0107] The sending module 508 is used to find the corresponding seat number for each data instruction set in the interaction scheme based on the multiple binding information, and push the data instruction set to the mobile terminal corresponding to the terminal identifier that is bound to the seat number, so that the mobile terminal can execute the corresponding interactive operation according to the received data instruction set when the data instruction time arrives.
[0108] Optionally, as an embodiment, the binding relationship is established by the mobile terminal purchasing electronic tickets based on a user account created with a terminal identifier, wherein the ticket information of the electronic ticket carries a seat number; or, the binding relationship is established by the mobile terminal scanning the ticket barcode of an electronic ticket purchased by another mobile terminal, wherein the ticket information corresponding to the ticket barcode carries a seat number; or, the binding relationship is established by the mobile terminal scanning the seat barcode on the seat corresponding to the ticket information of a purchased ticket, wherein the seat barcode carries a seat number; or, the binding relationship is established by another mobile terminal transferring electronic tickets to the mobile terminal, wherein the ticket information corresponding to the electronic ticket carries a seat number.
[0109] In another specific implementation of the embodiments of this specification, when the acquisition module 504 selects a matching interaction strategy from the preset interaction strategy library, it is specifically used to determine the interaction requirements for characterizing the effect of the performance according to the performance process; based on the interaction requirements, it selects at least one interaction strategy that matches the interaction requirements from the preset interaction strategy library; wherein, the interaction strategy includes: a seating matrix strategy based on timing control and / or a seating matrix strategy based on the target person's body posture control.
[0110] In another specific implementation of the embodiments of this specification, it further includes: a collection module is used to collect a location image of the target person in the interactive location in response to a collection command triggered by the mobile terminal executing an interactive operation corresponding to a corresponding data command, and extract the target person's body posture from the location image; and a sending module 508 is further used to send a data command to a mobile terminal that is bound to the seat number of the seat covered by the target person's body posture in the interactive location, according to the direction pointed to by the target person's body posture in the interactive location, so as to instruct the mobile terminal that is bound to the seat number of the seat covered by the location to execute the interactive operation corresponding to the data command.
[0111] Reference Figure 6 As shown, a mobile terminal 600 provided in an embodiment of this specification may include:
[0112] The determining module 602 is used to determine the terminal identifier used to identify the uniqueness of the mobile terminal;
[0113] Module 604 is used to establish a binding relationship between the terminal identifier and the seat number carried in the ticketing information;
[0114] The sending module 606 is used to upload the binding information determined based on the binding relationship to the central control server, so that the central control server can generate an interaction scheme based on the acquired seat layout information and the selected interaction strategy, and find the corresponding seat number for each data instruction set in the interaction scheme based on the binding information, and push the data instruction set to the mobile terminal corresponding to the terminal identifier that has a binding relationship with the seat number.
[0115] The execution module 608 is used to execute the interactive operation corresponding to the received data instruction when the data instruction time arrives.
[0116] It should be understood that, in addition to the functional modules mentioned above, it also includes various functional modules that are currently available in mobile terminals, which will not be elaborated here.
[0117] Optionally, as an embodiment, when the module 604 establishes the binding relationship between the terminal identifier and the seat number carried in the ticketing information, it is specifically used to determine the electronic ticket purchased by the user account created with the terminal identifier, extract the seat number from the ticketing information of the electronic ticket, and establish the binding relationship between the terminal identifier and the seat number.
[0118] In one specific implementation of an embodiment of this specification, when the establishment module 604 establishes the binding relationship between the terminal identifier and the seat number carried in the ticketing information, it is specifically used to scan the ticket barcode of an electronic ticket purchased by another mobile terminal, obtain the ticketing information corresponding to the ticket barcode, extract the seat number from the ticketing information, and establish the binding relationship between the terminal identifier and the seat number; or, scan the seat barcode on the seat corresponding to the ticketing information of a purchased ticket, obtain the seat number corresponding to the seat barcode, and establish the binding relationship between the terminal identifier and the seat number; or, receive electronic tickets transferred from other mobile terminals, extract the seat number from the ticketing information of the electronic tickets, and establish the binding relationship between the terminal identifier and the seat number.
[0119] The above technical solution uses a mobile terminal as an interactive device that emits light. A binding relationship is established between the seat number carried in the ticketing information and the mobile terminal's identifier, serving as an information exchange bridge between the mobile terminal and the central control server. After the central control server generates an interaction plan based on the acquired seat layout information and the selected interaction strategy, it sends the data command set for each seat in the interaction plan to the mobile terminal corresponding to the terminal identifier bound to the seat number, according to the binding information determined by the binding relationship. Thus, the mobile terminal can execute the corresponding interactive operation based on the data command set when the data command time arrives. Therefore, on-site interaction is achieved through the mobile terminal's light-emitting function, eliminating the need for manual seat binding. Seats can be bound to the mobile terminal as an interactive device solely through ticketing information, reducing binding workload, improving binding and interaction efficiency, and lowering the cost of interactive equipment. Furthermore, the mobile terminal also has an interface display function, enriching the interactive experience.
[0120] Figure 7 This is a schematic diagram of the structure of an electronic device according to one embodiment of this specification. Please refer to it. Figure 7 At the hardware level, the electronic device includes a processor, and optionally also includes an internal bus, a network interface, and memory. The memory may include main memory, such as high-speed random-access memory (RAM), or non-volatile memory, such as at least one disk drive. Of course, the electronic device may also include other hardware required for other business operations.
[0121] The processor, network interface, and memory can be interconnected via an internal bus, which can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus, or an EISA (Extended Industry Standard Architecture) bus, etc. This bus can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 7 The symbol is represented by a single double-headed arrow, but this does not mean that there is only one bus or one type of bus.
[0122] Memory is used to store programs. Specifically, programs may include program code, which includes computer operation instructions. Memory may include main memory and non-volatile memory, and provides instructions and data to the processor.
[0123] The processor reads the corresponding computer program from non-volatile memory into main memory and then executes it, logically forming a device (central control server or mobile terminal) for on-site interaction based on the mobile terminal. The processor executes the program stored in memory and specifically performs the following operations:
[0124] The system receives multiple binding information entries, each of which is determined by a binding relationship established between the mobile terminal and the seat number carried in the ticketing information. It then acquires seat layout information within the interactive venue and selects a matching interactive strategy from a preset interactive strategy library. Based on the seat layout information and the selected interactive strategy, it generates an interactive scheme, whereby the interactive scheme includes a data instruction set corresponding to each seat. Based on the multiple binding information entries, it searches for the corresponding seat number for each data instruction set in the interactive scheme and pushes the data instruction set to the mobile terminal corresponding to the found terminal identifier that has a binding relationship with the seat number. This allows the mobile terminal to execute the corresponding interactive operation based on the received data instruction set when the data instruction time arrives. Alternatively,
[0125] A terminal identifier is determined to identify the uniqueness of the mobile terminal; a binding relationship is established between the terminal identifier and the seat number carried in the ticketing information; the binding information determined based on the binding relationship is uploaded to the central control server, so that the central control server can generate an interaction scheme based on the acquired seat layout information and the selected interaction strategy, and based on the binding information, find the corresponding seat number for each data instruction set in the interaction scheme, and push the data instruction set to the mobile terminal corresponding to the terminal identifier that is bound to the seat number; according to the received data instruction set, when the data instruction time arrives, the corresponding interactive operation is executed.
[0126] The above is as described in this instruction manual. Figure 2 The method performed by the apparatus disclosed in embodiment 3 can be applied to a processor or implemented by a processor. The processor may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be completed by integrated logic circuits in the processor's hardware or by instructions in software form. The processor can be a general-purpose processor, including a Central Processing Unit (CPU), a Network Processor (NP), etc.; it can also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in one or more embodiments of this specification. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in one or more embodiments of this specification can be directly embodied in the execution of a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software module can reside in a mature storage medium in the field, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, or registers. This storage medium is located in memory, and the processor reads information from the memory and, in conjunction with its hardware, completes the steps of the above method.
[0127] The electronic device can also perform Figure 2 Alternatively, method 3 can be used to implement the corresponding device. Figure 2 The functions of the embodiments shown in Figure 3 or 4 are not described again in this specification.
[0128] Of course, in addition to the software implementation, the electronic devices in the embodiments of this specification do not exclude other implementation methods, such as logic devices or a combination of hardware and software, etc. That is to say, the execution subject of the following processing flow is not limited to each logic unit, but can also be hardware or logic devices.
[0129] This specification also provides an embodiment of a computer-readable storage medium that stores one or more programs, the programs including instructions that, when executed by a portable electronic device including multiple applications, enable the portable electronic device to perform... Figure 2 Or the method of the embodiment shown in Figure 3, and specifically used to perform the following methods:
[0130] The system receives multiple binding information entries, each of which is determined by a binding relationship established between the mobile terminal and the seat number carried in the ticketing information. It then acquires seat layout information within the interactive venue and selects a matching interactive strategy from a preset interactive strategy library. Based on the seat layout information and the selected interactive strategy, it generates an interactive scheme, whereby the interactive scheme includes a data instruction set corresponding to each seat. Based on the multiple binding information entries, it searches for the corresponding seat number for each data instruction set in the interactive scheme and pushes the data instruction set to the mobile terminal corresponding to the found terminal identifier that has a binding relationship with the seat number. This allows the mobile terminal to execute the corresponding interactive operation based on the received data instruction set when the data instruction time arrives. Alternatively,
[0131] A terminal identifier is determined to identify the uniqueness of the mobile terminal; a binding relationship is established between the terminal identifier and the seat number carried in the ticketing information; the binding information determined based on the binding relationship is uploaded to the central control server, so that the central control server can generate an interaction scheme based on the acquired seat layout information and the selected interaction strategy, and based on the binding information, find the corresponding seat number for each data instruction set in the interaction scheme, and push the data instruction set to the mobile terminal corresponding to the terminal identifier that is bound to the seat number; according to the received data instruction set, when the data instruction time arrives, the corresponding interactive operation is executed.
[0132] In summary, the above description is merely a preferred embodiment of this specification and is not intended to limit the scope of protection of this specification. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this specification should be included within the scope of protection of this specification.
[0133] The systems, apparatuses, modules, or units described in one or more of the above embodiments may be implemented by a computer chip or entity, or by a product having a certain function. A typical implementation device is a computer. Specifically, a computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or any combination of these devices.
[0134] Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.
[0135] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.
[0136] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the system embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions in the method embodiments.
[0137] The foregoing has described specific embodiments of this specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims may be performed in a different order than that shown in the embodiments and may still achieve the desired result. Furthermore, the processes depicted in the drawings do not necessarily require the specific or sequential order shown to achieve the desired result. In some embodiments, multitasking and parallel processing are possible or may be advantageous.
Claims
1. A method for on-site interaction based on a mobile terminal, applied to the central control server of an on-site interaction system, the method comprising: Receive multiple binding information, wherein each binding information is determined by the binding relationship established between the mobile terminal and the seat number carried in the ticket information based on the terminal identifier. The mobile terminal extracts the seat number from the electronic ticket purchased from the user account created with the terminal identifier of the mobile terminal or transferred from other mobile terminals, and establishes a binding relationship between the extracted seat number and the terminal identifier of the mobile terminal. Obtain seating layout information within the interactive space, and select a matching seating dot pattern from a preset interactive strategy library that controls the change of the seating dot pattern. Based on the selected seat dot matrix strategy, a seat dot matrix data stream is generated that can be parsed into data instructions for each frame distributed over time, corresponding to the seat layout information. The seat dot matrix data stream is parsed into data instructions for each frame distributed over time. The data instructions for each frame are converted into data instructions for each seat. The data instructions for all frames of the corresponding seat are merged to obtain the instruction dataset for each seat. Based on the multiple binding information, the corresponding seat number is found for each data instruction set, and the data instruction set is pushed to the mobile terminal corresponding to the terminal identifier that is bound to the seat number. This allows the mobile terminal to execute the corresponding interactive operation according to the data instruction set when the data instruction time arrives.
2. The method as described in claim 1, wherein selecting a matching seat dot pattern controllably changing seat dot pattern from a preset interaction strategy library, specifically includes: Determine the interactive requirements for representing the effect of the performance based on the performance process; Based on the interaction requirements, at least one seat dot pattern controllable change seat dot pattern matching the interaction requirements is selected from the preset interaction strategy library. The seating array strategy includes: a timing-based seating array strategy and / or a seating array strategy based on the target person's body posture control.
3. A method for on-site interaction based on a mobile terminal, applied to a mobile terminal of an on-site interaction system, the method comprising: Determine the terminal identifier used to uniquely identify the mobile terminal; Extract seat numbers from electronic tickets purchased from user accounts created with the terminal identifier of the mobile terminal or transferred from other mobile terminals, and establish a binding relationship between the extracted seat numbers and the terminal identifier of the mobile terminal; The binding information determined based on the binding relationship is uploaded to the central control server so that the central control server can obtain the seat layout information in the interactive venue, select the matching seat dot matrix pattern controllable change seat dot matrix strategy from the preset interactive strategy library, generate a seat dot matrix data stream that can be parsed into data instructions for each frame distributed by time based on the selected seat dot matrix strategy, parse the seat dot matrix data stream into data instructions for each frame distributed by time, convert the data instructions for each frame into data instructions for each seat, merge the data instructions for all frames of the corresponding seat to obtain the instruction dataset for each seat, and find the corresponding seat number for each data instruction set based on the binding information, and push the data instruction set to the mobile terminal corresponding to the terminal identifier that has a binding relationship with the seat number; Based on the received data instruction set, execute the corresponding interactive operation when the data instruction time arrives.
4. A mobile terminal-based on-site interactive system, comprising: A central control server and multiple mobile terminals distributed across seats within the interactive area; among them, The mobile terminal is used to determine a terminal identifier that identifies the uniqueness of the mobile terminal, extract seat numbers from electronic tickets purchased by user accounts created with the terminal identifier of the mobile terminal or transferred from other mobile terminals, establish a binding relationship between the extracted seat numbers and the terminal identifier of the mobile terminal, and upload the binding information determined based on the binding relationship to the central control server. The central control server is used to receive multiple binding information, obtain seat layout information in the interactive venue, and select a matching seat dot matrix strategy from the preset interactive strategy library. Based on the selected seat dot matrix strategy, it generates a seat dot matrix data stream that can be parsed into data instructions for each frame distributed over time. The seat dot matrix data stream is parsed into data instructions for each frame distributed over time. The data instructions for each frame are converted into data instructions for each seat. The data instructions for all frames of the corresponding seat are merged to obtain the instruction dataset for each seat. Based on the multiple binding information, the corresponding seat number is found for each data instruction set, and the data instruction set is pushed to the mobile terminal corresponding to the terminal identifier that is bound to the seat number. The mobile terminal is also used to execute the corresponding interactive operation of the data instruction when the data instruction time arrives, based on the received data instruction set.
5. A central control server, comprising: The receiving module is used to receive multiple binding information, wherein each binding information is determined by the binding relationship established between the mobile terminal and the seat number carried in the ticketing information based on the terminal identifier. The mobile terminal extracts the seat number from the electronic ticket purchased from the user account created with the terminal identifier of the mobile terminal or transferred from other mobile terminals, and establishes a binding relationship between the extracted seat number and the terminal identifier of the mobile terminal. The acquisition module is used to acquire seat layout information in the interactive venue and select a matching seat dot pattern controllable change seat dot pattern from the preset interactive strategy library. The generation module is used to generate a seat matrix data stream that can be parsed into data instructions for each frame distributed over time, based on the selected seat matrix strategy. The module parses the seat matrix data stream into data instructions for each frame distributed over time, converts the data instructions for each frame into data instructions for each seat, and merges the data instructions for all frames of the corresponding seat to obtain the instruction dataset for each seat. The sending module is used to find the corresponding seat number for each data instruction set based on the multiple binding information, and push the data instruction set to the mobile terminal corresponding to the terminal identifier that is bound to the seat number, so that the mobile terminal can perform the corresponding interactive operation according to the received data instruction set when the data instruction time arrives.
6. A mobile terminal, comprising: The determination module is used to determine the terminal identifier used to identify the uniqueness of the mobile terminal. A module is established to extract seat numbers from electronic tickets purchased from user accounts created with the terminal identifier of the mobile terminal or transferred from other mobile terminals, and to establish a binding relationship between the extracted seat numbers and the terminal identifier of the mobile terminal. The sending module is used to upload the binding information determined based on the binding relationship to the central control server, so that the central control server can obtain the seat layout information in the interactive venue, select the matching seat dot matrix pattern controllable change seat dot matrix strategy from the preset interactive strategy library, generate a seat dot matrix data stream that can be parsed into data instructions for each frame distributed by time based on the selected seat dot matrix strategy, parse the seat dot matrix data stream into data instructions for each frame distributed by time, convert the data instructions for each frame into data instructions for each seat, merge the data instructions for all frames of the corresponding seat to obtain the instruction dataset for each seat, and find the corresponding seat number for each data instruction set based on the binding information, and push the data instruction set to the mobile terminal corresponding to the terminal identifier that has a binding relationship with the seat number; The execution module is used to execute the corresponding interactive operation based on the received data instruction set when the data instruction time arrives.
7. A computer-readable storage medium storing one or more programs, which, when executed by an electronic device including a plurality of applications, cause the electronic device to perform the method for on-site interaction based on a mobile terminal as described in claim 1 or 2, or the method for on-site interaction based on a mobile terminal as described in claim 3.