A method for seamlessly customizing script-based tourism products
By dividing the tourism process into different plot points and dynamically customizing offline plots, the problem of personalized and real-time adjustments in the existing technology is solved, and the travel experience and time utilization rate are improved.
Patent Information
- Application Number
- CN202311279129.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-10-06
- Publication Date
- 2025-04-08
AI Technical Summary
The existing technology cannot achieve truly personalized tourism product customization, especially during the travel process, which cannot make dynamic adjustments based on the actual situation of the user in real time, resulting in poor travel experience.
By dividing the actual offline scenes into different plot points and deploying corresponding offline plots at these points, a travel script is generated. During the travel process, based on user behavior data and environmental factors, unexecuted offline plots are dynamically customized to achieve real-time personalized matching of tourism products.
It realizes dynamic customization without any emotion during travel, meets personalized needs, improves time utilization and game experience, and avoids the impact of emergency events.
Smart Images

Figure CN119784454A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of automatic scheme generation, and more specifically, to a method for seamlessly customizing script-based tourism products. Background Art
[0002] A travel guide in the usual sense mainly includes how to get there, where to stay, what to do, what to eat, how to arrange time, etc. after determining the destination. In more detail, it can also include various precautions, such as how to improve time utilization (for example, when popular places such as popular attractions, popular restaurants, popular hotels, etc. are less crowded), how to have a smooth trip (for example, whether tickets are needed, whether tickets can be booked, when are the attractions open, etc.).
[0003] Although tourists post travel notes and guides on various social platforms and tourism information platforms, the information is scattered and requires a lot of manual review and sorting work according to their own needs. On the other hand, tourism product platforms, including online platforms and various offline travel companies, all sell travel plans with different contents, which can meet the individual needs of roughly classified categories, but can basically only provide a small number of pre-made plans, and the so-called personalized customization services can only provide basic projects such as transportation, hotels, attractions, and restaurants. In fact, they only help customers book tickets, book cars, and reserve seats. The so-called personalized customization is actually just a choice among the options provided by the platform.
[0004] In the prior art, Chinese invention patent application No. 201810879832.3 discloses a method for generating tourism information, comprising: obtaining a user portrait of a user, wherein the user portrait includes user characteristics of the user; generating tourism information for the user based on the user characteristics, wherein the tourism information includes at least one of the following: tourism content recommended to the user, and corresponding reasons for the recommendation.
[0005] According to another aspect of the embodiment of the invention patent application, a method for generating tourism information is also provided, including: detecting an operation, wherein the operation object is tourism; in response to the operation, obtaining a user portrait of a user corresponding to the operation, wherein the user portrait includes user characteristics of the user; based on the user characteristics, generating tourism information for the user, wherein the tourism information includes at least one of the following: tourism content recommended to the user, and corresponding reasons for the recommendation; pushing tourism information to the user.
[0006] In the embodiment of the invention patent application, a method of automatically generating travel information based on a user portrait is adopted. After obtaining the user portrait of the user, the client generates travel information for the user based on the user characteristics included in the user portrait, wherein the user portrait includes the user characteristics of the user, and the travel information includes at least one of the following: travel content recommended to the user, and the corresponding reason for the recommendation.
[0007] In the above process, travel information can be generated according to the user characteristics included in the user portrait, without the need to manually write travel information, thereby improving the efficiency of generating travel information. In addition, since the user portrait can well reflect the user characteristics, the use of the user portrait can generate travel information that better meets the user's needs, thereby improving the user's experience of using the software.
[0008] It can be seen that the solution provided by the invention patent application can achieve the purpose of automatically generating tourism information, thereby improving the efficiency of generating tourism information, and further solving the technical problems that the related technology cannot automatically generate tourism information, resulting in low efficiency of tourism information generation and lack of personalization of tourism information.
[0009] However, the essence of the invention patent application is conditional screening, which has a coarse screening granularity and cannot achieve the "personalization" in conventional perception. Its automatic generation of tourism information is actually a pre-made plan suitable for a large group of people, and is actually the process and result of customers choosing from several options.
[0010] In the prior art, Chinese invention patent application No. 202210377392.8 discloses a hotspot-based tourism product matching method, which includes: obtaining news information that meets the tourism theme from a news information set within a preset time period through a classification model; obtaining the popularity parameter of the tourism theme based on at least the number of news information belonging to the same tourism theme and at least one interaction parameter of the news information; pushing a media file package containing at least one news information and related tourism product information to the corresponding user at least according to the tourism theme; and pushing relevant tourism product information to the user at least based on the status parameter of the user reading the news information in the media file package.
[0011] The invention patent application can label and store news inside and outside the site, making it convenient for the OTA platform to use it for promotion scenarios on demand, facilitating attention to more real-time tourism hotspot trends, timely push cultural and tourism activities, and increase the purchase rate of tourism products.
[0012] However, although the invention patent application can provide tourism products that are more interesting to users based on real-time hot spots, it is actually also the process and result of customers choosing from several options.
[0013] Furthermore, the above-mentioned existing technologies also have the disadvantage of being unable to truly achieve "personalization", that is, after the travel information and travel products are generated, they are all customized before the trip, and it is usually difficult to modify them after the trip, especially in real time during the trip; if modifications are made, they all involve modifications to basic items, such as transportation, hotels, attractions, restaurants, etc., and manual confirmation is required from both parties.
[0014] At the same time, the existing technology is still missing an important "personalization" link, that is, how to play. The main reason is that it is impossible to recommend "how to play" to customers based on generating "what to play". Because "recommendation" and "personalization" are somewhat contradictory, once the "recommendation" is formed, it is difficult for customers to perform sufficient "personalization", especially real-time "personalization" modification.
[0015] Moreover, due to the lack of "recommendations" on "how to play", once a modification occurs, the entire itinerary will be modified. Whether it is the modification process or the experience of playing, it will form a strong sense of separation and a physical feeling of an unsmooth journey. Summary of the invention
[0016] The purpose of the present invention is to overcome the shortcomings of the prior art and provide a method for seamlessly customizing script-based tourism products. In addition to customization before travel, dynamic customization can be performed during the travel process based on the actual progress of each user and global factors, thereby achieving real-time "personalized" matching of tourism products to meet the needs of each user. On the basis of recommending "how to play" based on the script, "personalization" is guaranteed; at the same time, through dynamic customization of "personalized" matching, the user's requirements for various precautions during the play process are met, and the user is guided to play more smoothly with higher time utilization through plot modification.
[0017] The technical solution of the present invention is as follows:
[0018] A method for seamlessly customizing script-based tourism products, which uses different locations of offline actual scenes as different plot points, and deploys corresponding offline plots at the plot points. The tourism script covers several plot points, and connects the offline plots corresponding to the plot points to generate a tourism script.
[0019] The method comprises a pre-selection stage, a dynamic customization stage;
[0020] Pre-selection stage: before traveling, the user selects a travel script, analyzes the travel script, and obtains the itinerary information contained in the travel script; the itinerary information includes but is not limited to transportation, accommodation, entertainment items, attractions, and travel routes;
[0021] Dynamic customization stage: users travel based on travel scripts, and execute corresponding offline plots in plot points and between plot points contained in the travel scripts; identify the behavior data of users at plot points, between plot points and / or between users and plot points; when the offline plots not executed by users are related to the behavior data, based on the impact of the behavior data on the offline plots not executed by users, the offline plots not executed by users are adaptively modified based on the behavior data, and the corresponding offline plots not executed by users are updated, including but not limited to the plot points corresponding to the offline plots not executed by users or the offline plots between plot points, so as to complete the dynamic customization of the unexecuted part of the travel script.
[0022] As a preferred embodiment, when executing the travel script, the user performs online and offline synchronous games, correspondingly including online and offline parts;
[0023] Online part: Create online virtual scenes corresponding to offline actual scenes, identify users, objects, and facilities in offline actual scenes, and display them as online players, objects, and facilities in online virtual scenes; set up game plots based on virtual scenes, and deploy game plots corresponding to offline plot points and offline plots;
[0024] Offline part: the user enters the plot point, and the user is identified and located at the plot point; based on the user's location, the current plot for the user is activated at the location set at the plot point; based on the user's completion results for the current plot at the plot point, the user's next plot is determined.
[0025] The beneficial effects of the present invention are as follows:
[0026] The method for seamlessly customizing script-based tourism products described in the present invention uses different locations of offline actual scenes as different plot points, and deploys corresponding offline plots at the plot points. The tourism script covers several plot points, and the offline plots corresponding to the plot points are connected in series to generate a tourism script, thereby realizing the customization of script-based tourism products before travel, i.e., the pre-selection stage. During the user's travel, the user travels based on the tourism script, and executes the corresponding offline plots between the plot points and the plot points contained in the tourism script; the offline plots not executed by the user are adaptively modified based on the behavior data, and the corresponding offline plots not executed by the user are updated, thereby completing the dynamic customization of the unexecuted part of the tourism script.
[0027] In the present invention, after the user selects a travel script in the pre-selection stage, the corresponding offline plot is not obtained in advance; within a set time before the user executes the offline plot, the corresponding offline plot is output to the user in advance through interaction; then, without the user noticing, the corresponding offline plot that the user has not executed is updated, thereby completing the dynamic customization of the unexecuted part of the travel script. Furthermore, the present invention also combines the environmental factors in the actual scene (including the real-time status of facilities and items, real-time events, etc.), the behavioral data of the current user and the behavioral data of other users, and adapts the offline plots of the current user and other users that have not been executed based on the behavioral data. Not only can the offline plots of the unexecuted part be adapted to the environmental factors in the actual scene, but also the modification of the offline plots can guide users to play more smoothly with higher time utilization; and the travel scripts of different users can form mutual influences. From the overall point of view, the travel scripts of a large number of users are the plot backgrounds of each other (forming mutual influence), and cross-script fusion interaction is carried out to form a plot network together. With the addition of new users, the withdrawal of original users, and the execution of the travel scripts of all users, the plot network is automatically advanced. Correspondingly, the offline plots of each user that have not been executed are also adapted, and finally the diversified "personalized" dynamic customization is realized. The customization scheme of the prior art is only equivalent to the "user selects the travel script before traveling" recorded in the pre-selection stage of the present invention. Under the technical guidance of the prior art, no matter how detailed the screening conditions are set, the diversified "personalized" dynamic customization described in the present invention cannot be realized.
[0028] In the present invention, a large language model for generating travel scripts is also constructed to realize the generation of a new version of offline plots that have not been executed by relevant users based on the user's behavior data and environmental factors in the actual scene, which is used to replace the previous version of offline plots that have not been executed by the user; wherein, the difference between the new version of offline plots and the previous version of offline plots is the adaptive modification performed by the present invention. In the present invention, the adaptive modification of offline plots is continuously performed following the behavior of the current user, the actual completion of the offline plots by the current user, the behavior of other users, and the actual completion of the offline plots by other users. When the manual background adjusts part of the content of the offline plots that have not been executed by the user, the present invention also uses a large language model to generate a new version of offline plots that have not been executed by the user based on the content of the adjusted part. Similarly, the difference from the previous version of offline plots is the adaptive modification of the unexecuted offline plots before and / or after the content of the adjusted part.
[0029] The present invention obtains the behavioral data of all users during the travel process, the environmental factors in the actual scene, and the historical events within the monitoring range, which is equivalent to knowing what the user has done in the past, what he has encountered in the past, what he will encounter in the future, what happened in the actual scene in the past, and what will happen in the actual scene in the future. This information is used as the basis for modifying the offline plots that the user has not executed, and automatically writes corresponding narrations, or narrates the roles played by the staff to guide the user to complete the unfinished part of the current offline plot and connect with the next offline plot. On the one hand, the present invention realizes real-time "recommendations" and "how to play" to users on the spot; on the other hand, it realizes updating the corresponding offline plots that the user has not executed without the user's feeling, and completing the dynamic customization of the unexecuted part of the travel script; on the other hand, when an emergency event occurs at a plot point, through dynamic customization and narration, that is, combined with the deletion and guidance of the travel script, it ensures that the user can avoid emergency events, ensure the user's safety, and travel smoothly.
[0030] In the present invention, when the user executes the travel script, the online and offline synchronous games are carried out, and the online part and the offline part are constructed in consistency to realize the synchronous association of virtual and real scenes. The user can synchronously affect the advancement of the online game plot by playing a game-style tour based on the offline plot in the offline actual scene; when the user plays the online game, the game plot can also be advanced in the virtual scene, thereby affecting the offline plot of the user in the offline part. Furthermore, the present invention produces an online virtual scene corresponding to the offline actual scene, designs the game plot, and synchronizes the behavior and data of the offline part with the offline part, which not only makes the online game experience closer to the actual offline situation, but also in the offline part, the user promotes the offline plot by performing actual behavior in the actual scene, which correspondingly affects the advancement of the online game plot, including the consistency of the data and game progress between the user and the online player.
[0031] The present invention can enable users to have greater motivation and curiosity when touring or playing games in the offline part through the correspondence between the online part and the offline part, and can carry out truly immersive touring in the actual scenario of deploying the offline plot. Users not only obtain information monotonously at scenic spots or display points, but also can complete the advancement of the online game plot offline through the progress of the offline plot, thereby realizing the mutual influence between the online part and the offline part.
[0032] The implementation of the present invention can achieve the synchronization of offline actual scenes and online games. Users can visit the actual scenes offline to indirectly advance the progress of online games, or they can play games online to directly determine the user's offline plot and corresponding role attributes.
[0033] The present invention can change the way of sightseeing in the actual scene, allowing users to really play in the actual scene, increasing the user's stay time in the actual scene, effectively increasing consumption, and also generating cultural accumulation for the actual scene. At the same time, the present invention also uses the plot to promote the distribution area of tourists, reducing queuing and congestion, while greatly improving the capacity and experience effect of the actual scene.
[0034] In the present invention, walking navigation is performed for users at offline plot points. Based on the identification and positioning of users, guidance is provided to users through guidance devices deployed in the user's surrounding environment. During the navigation process, users can get rid of handheld terminal devices. Furthermore, there are no problems of poor accuracy and real-time performance caused by the inherent defects of the existing technologies, such as satellite navigation, navigation based on RSSI positioning, navigation based on connection device positioning, and other technical solutions, the performance impact of hardware related to handheld terminal devices, and many environmental interference factors. The present invention obtains the physical properties of users in the channel by deploying sensors of corresponding types that cover the channel, identifies and locates users, and can build a pure intranet to achieve navigation, thereby avoiding data security risks in data interaction using public communication platforms. The present invention can be implemented in any scenario where sensors can be deployed, and has strong versatility.
[0035] The present invention utilizes a peer-to-peer computing system for collaborative computing, performs non-specific feature recognition and location recognition on all users in offline actual scenarios, so as to complete identity recognition and positioning, and realizes the discovery of the completion results of the user's current link plot in the actual scenario and the behavioral results of the user's offline behavior; in the described peer-to-peer computing system, there is no primary and secondary relationship between all node devices, and there is no fixed connection path between node devices. Node devices only receive the calculation results of other node devices and send out the result data of their own calculations. The discovery of events and / or the response of corresponding guidance devices do not rely on a single node device for identification and control, but are jointly confirmed through collaborative computing by multiple node devices in the peer-to-peer computing system. Furthermore, the present invention does not rely on single-point identification of users, and distributes all computing functions in the peer-to-peer computing system, thereby reducing the software and hardware requirements of single-point computing, having high execution efficiency, and greatly improving anti-attack capabilities; the information is relatively symmetrical between node devices, and can be immune to the problem of illegal data tampering. Even if a single node device is physically cracked and the data it sends is tampered with, because the calculation of the peer-to-peer computing system is a complex calculation with ultra-high redundancy and ultra-multi-dimensional verification, the tampering of the data sent by a single node device does not affect the calculation results of the peer-to-peer computing system, and the fault and the tampered node device can be quickly located to ensure the credibility of the calculation results of the peer-to-peer computing system. Furthermore, it can resolve the contradiction between data sharing and information security between departments.
[0036] The present invention can determine each unique user as itself without the need for specific features or obtaining specific identity information, thereby realizing non-specific feature recognition. The present invention performs user identification, identity confirmation or event monitoring by means of non-specific feature recognition, and not only has a high recognition result accuracy, but also has accurate location recognition. The present invention can perform user identification and identity confirmation without relying on specific features, while protecting privacy, and can also solve problems such as transportation, education, medical convenience, epidemic prevention, people's livelihood services, emergency response, community services, market behavior, safe production, and civilized behavior.
[0037] The present invention adopts non-specific feature recognition, which can effectively prevent the risk caused by the theft or imitation of specific features, greatly improving security. The present invention adopts a non-contact passive method to identify the user's identity without feeling, greatly improving the convenience of execution. Based on the peer-to-peer computing system, the present invention can easily layout the coverage at the level of hundreds of meters or hundreds of kilometers, and is applicable to various levels of geographical range.
[0038] In the present invention, the peer-to-peer computing system does not directly control the guidance device alone; the response execution of the guidance device (i.e., presenting navigation information) is controlled based on the calculation results obtained by collaborative computing, with high response efficiency, avoiding illegal responses such as false execution or non-execution due to network attacks. To avoid hijacking, the present invention can also use multiple node devices to collaboratively control the guidance device, further improving the immunity to hijacking attacks. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] Figure 1 is a schematic diagram of the structure of a display device and a light-transmitting layer;
[0040] Figure 2 It is a schematic diagram of the installation effect of the display device;
[0041] In the figure: 10 is a display device, and 20 is a light-transmitting layer. DETAILED DESCRIPTION
[0042] The present invention is further described in detail below with reference to the accompanying drawings and embodiments.
[0043] In order to solve the shortcomings of the prior art such as rough customization conditions, insufficient personalization of plans, and inability to make real-time modifications based on actual conditions after travel, the present invention provides a method for seamlessly customizing script-based tourism products. A tourism script is pre-selected before travel, and during the travel, based on the actual situation of each user and global factors, user-free dynamic customization is performed, thereby achieving real-time "personalized" matching of tourism products to meet the needs of each user, and ensuring "personalization" on the basis of recommending "how to play" based on the script; at the same time, through dynamic customization of "personalized" matching, the user's requirements for various precautions during the play process are met, and the user is guided to play more smoothly with higher time utilization through plot modification.
[0044] The method of the non-intuitive customized script-based tourism product described in the present invention uses different locations of the actual offline scene as different plot points, and deploys corresponding offline plots at the plot points. The tourism script covers several plot points, and the offline plots corresponding to the plot points are connected in series to generate a tourism script. In the specific implementation, each plot point can deploy multiple offline plots, and the offline plots between the plot points can be directly formed into a plot coherence, or it can be a transition between the plot points to the plot points by connecting the two offline plots that do not directly form a plot continuity, including but not limited to transitioning by executing the connecting plot between the plot points, or transitioning by explaining the transition plot (users do not need to execute). It can also be implemented as follows: each plot point does not deploy a certain offline plot, but based on the actual scene corresponding to the plot point, and the offline plots of other users at the plot point, the offline plot of the current user at the plot point is formulated. For example, for user a, the offline plot of user a includes riding a roller coaster to identify several words or images set along the way, and telling the NPC (NPC for user a) in exchange for corresponding information; for user b, the offline plot of user b includes exchanging information with the NPC (NPC for user b) riding the roller coaster. Among them, user a obtains the travel script before user b; in the travel script of user a, it is not pre-defined whether the NPC is a real NPC or another user; in the travel script of user b, it is not pre-defined whether the object of information interaction is a real NPC or another user (nor is it pre-defined whether the offline plots performed by other users are performed, for example, if user a is determined to be the NPC of user b, and the location of user a is a roller coaster, then the travel script of user b will guide user b to the roller coaster, if user c is determined to be the NPC of user b, and the location of user c is a Ferris wheel, then the travel script of user b will guide user b to the Ferris wheel). After user b obtains the travel script, if the travel scripts of user a and user b intersect in time and space, they are NPCs of each other in the intersecting time and space, and each performs their own offline plot. That is, the plot point deploys an exclusive offline plot for the current user, and the exclusive offline plot is generated according to the actual scene, the exclusive offline plots of other users that have been deployed, and the plot requirements of the current user.
[0045] The present invention comprises a pre-selection stage and a dynamic customization stage.
[0046] Pre-selection stage: the user selects a travel script before traveling, parses the travel script, and obtains the itinerary information contained in the travel script; the itinerary information includes but is not limited to transportation, accommodation and meals, attractions, attractions, and travel routes. In this embodiment, the itinerary information is similar to the tourism products of the prior art, and is different from the tourism products of the prior art. In this embodiment, the itinerary information may not be limited to the specific time except for operating transportation (such as airplanes, trains, buses, ferries, etc. real-name pre-purchased tickets), and other time arrangements can be dynamically customized in the dynamic customization stage. Of course, the implementation of the present invention is not simply customized for the user end, but all service providers involved in the travel script participate in dynamic customization, especially attractions, projects, hotels, and activity transportation tools (such as online car-hailing). On the basis of the timetable without changing major service providers (such as trains, airplanes, buses, ferries, etc., important livelihood service providers that cannot easily coordinate time), global operations are performed to achieve the optimal deployment of algorithms and computing power. If the user chooses self-driving or other autonomous travel methods, it can also start from the departure, that is, the start of the trip, according to demand, and enter the dynamic customization stage.
[0047] Dynamic customization stage: that is, during the trip, the user travels based on the travel script, and executes the corresponding offline plots between the plot points and between the plot points contained in the travel script; identifies the behavior data of the user at the plot points, between the plot points and the plot points, and / or between the user and the plot points; when the offline plots that the user has not executed are related to the behavior data, based on the influence of the behavior data on the offline plots that the user has not executed, the offline plots that the user has not executed are adaptively modified based on the behavior data, and the corresponding offline plots that the user has not executed are updated, including but not limited to the plot points corresponding to the offline plots that the user has not executed or the offline plots between the plot points, to complete the dynamic customization of the unexecuted part of the travel script. Unlike online games, the setting of offline plots is mainly based on not excessively restricting the user's behavior and execution results, and thus no longer strictly limits the triggers like online games, that is, strictly limits the player's behavior and results, but is based on the actual behavior completed by the user and the actual execution results, and adjusts the unexecuted offline plots to avoid users from being unable to smoothly enter the next plot point, affecting the game experience.
[0048] The adaptive modification is specifically, based on the offline plots that have not been executed in the travel script corresponding to the user, on the basis of the offline plots that have not been executed by the user, according to the user's behavior data at the plot points, between plot points and / or between the user and the plot points, the user's completion of the current offline plot, emergency events, the location of the occurrence of emergency events, and the corresponding processing solutions, part of the content is rewritten to obtain a new version of the travel script that the user has not executed with part of the content rewritten, so that in the new version of the travel script that the user has not executed with part of the content rewritten, according to the user's behavior data, the completion of the current offline plot, emergency events, the location of the occurrence of emergency events, and the corresponding processing solutions The corresponding processing scheme has adapted plot content; or, based on the user's behavior data at the plot point, between the plot point and the plot point, and / or between the user and the plot point, the offline plot that has not been executed in the user's corresponding travel script, the emergency event, the location of the emergency event, and the corresponding processing scheme, all the offline plots that have not been executed in the user's corresponding travel script are rewritten, and a new version of the travel script that has not been executed by the user is obtained, so that in the new version of the travel script that has not been executed by the user, there is adapted plot content for the user's behavior data, the completion status of the current offline plot, the emergency event, the location of the emergency event, and the corresponding processing scheme. In the present invention, part of the content is rewritten based on the offline plot that has not been executed by the user, or all the offline plots that have not been executed by the user are rewritten with reference to the offline plot that has not been executed by the user. The corresponding new version of the travel script that has not been executed by the user is all preset plot content that does not belong to the script database. The rewriting of part of the content and the rewriting of all the content do not directly quote, intercept, or apply the preset plot content in the script database, that is, they are newly generated plot content. In special cases, there is a new version of the travel script that has not been executed by the user. For the user's behavior data, the completion of the current offline plot, the emergency event, the location of the emergency event, and the corresponding treatment plan, there is a possibility that the adapted plot content is the same or similar to the preset plot content in the script database, but in fact, the newly generated corresponding treatment plan The plot content is not directly selected from the script database to quote, intercept, and apply the preset plot content. In the present invention, the offline plot that has not been executed by the user is adaptively modified, and when a new version of the travel script that has not been executed by the user is generated, the preset plot content in the script database is not searched, matched, etc. Operations. In specific implementation, the preset plot content in the script database is only used to generate travel scripts and as a sample for training the plot generation model (for example, a large language model for generating a new version of the travel script), and does not directly participate in the generation of the new version of the travel script.
[0049] In specific implementation, the behavioral data includes but is not limited to the user's location information, posture data, action data, language data, and gaze point; collecting as much behavioral data of the user as possible is more conducive to accurately judging the behavioral results corresponding to the user's behavioral data, and then, it is conducive to more accurately judging the user's execution results of offline plots, and finally, improving the adaptability of modifying unexecuted offline plots.
[0050] The "personalization" of the present invention is also reflected in timely adjustment of offline plots based on the user's travel status, so that the updated offline plots are more suitable for the user's travel status. Specifically, the present invention further identifies user-related data, and reflects the user's travel status through user-related data, and the user-related data includes but is not limited to clothing, decorations, children or pets carried, supplies carried for travel, and props for executing offline plots. User-related data can assist in judging the user's travel status and needs. For example, skirts are not suitable for offline plots with greater exercise, carrying children or pets is not suitable for offline plots with higher intensity, and props can be used to appropriately increase the offline plots of prop application, etc. The present invention can keep the travel script timely adapted to the user's travel status, which is different from the prior art, that is, the prior art does not know the user's travel status, and cannot modify the travel product in time after the user travels, and then requires the user to actively select the travel status to adapt the travel product; the implementation of the present invention does not require the user to actively adapt the travel script, but the travel script actively adapts to the user's travel status for adaptive modification.
[0051] One of the purposes of the present invention is to achieve that when the offline plot that has not been executed by the user is updated, it will not be perceived or noticed by the user, and to avoid the user being spoiled first and then having the bad experience of broken expectations. In the pre-selection stage described in the present invention, after the user selects the travel script, the corresponding offline plot is not obtained in advance; in the dynamic customization stage, the corresponding offline plot is output to the user in advance through interaction within a set time before the user executes the offline plot; further, when the corresponding offline plot that has not been executed by the user is updated, the corresponding offline plot that has not been executed by the user is updated without the user noticing, thereby completing the dynamic customization of the unexecuted part of the travel script.
[0052] When the user is executing an offline plot, and based on the behavior data that has occurred and the user's completion of the current offline plot, the update content of the next offline plot can be determined, then the user is still executing the current offline plot and the next offline plot is updated. Based on the user's completion of the current offline plot, the guide words that connect with the next offline plot are automatically written, and the user is guided to complete the unfinished part of the current offline plot through narration or the role played by the staff, and connect with the next offline plot. In fact, using guide words to guide the user to complete the unfinished part of the current offline plot is also regarded as the dynamic customization of the unexecuted part of the current offline plot that the user is executing by the present invention, such as skipping certain plots of the unexecuted part of the current offline plot, or guiding the user to execute certain plots different from the unexecuted part of the current offline plot, etc.
[0053] The present invention considers that environmental factors in actual scenes (including the real-time status of facilities and items, events occurring in real time, etc.) and the behavior data of other users may affect the behavior data of the current user, thereby affecting the execution result of the offline plot by the current user, and finally affecting the modification of the offline plot that has not been executed. In this embodiment, the environmental factors in the actual scene are also detected, and the environmental factors, the behavior data of the current user and the behavior data of other users are combined. If the offline plot that the current user and other users have not executed is related to the environmental factors, the behavior data of the current user and the behavior data of other users, based on the influence of the environmental factors, the behavior data of the current user and the behavior data of other users on the offline plot that the current user and other users have not executed, the offline plot that the current user and other users have not executed is adaptively modified based on the behavior data, and the corresponding offline plot that the current user and other users have not executed is updated. Wherein, the environmental factors include but are not limited to the real-time status of plot points, devices and items between plot points and / or between users and plot points; for example, whether the device is busy, whether other users cause changes in the working status of the device, whether the item is damaged, and so on. Therefore, the present invention can not only make adaptive modifications to the offline plots of the unexecuted parts corresponding to the environmental factors in the actual scene, and guide users to play more smoothly with higher time utilization through the modification of offline plots; moreover, the travel scripts of different users can form mutual influences. From the overall point of view, the travel scripts of a large number of users are the plot backgrounds of each other (forming mutual influences), and cross-script fusion and interaction are carried out to form a plot network together. With the addition of new users, the withdrawal of original users, and the execution of travel scripts of all users, the plot network is automatically advanced. Correspondingly, the offline plots of each user's unexecuted parts are also adaptively modified, and finally a variety of "personalized" dynamic customization is realized. The customization scheme of the prior art is only equivalent to the "user selects a travel script before traveling" recorded in the pre-selection stage of the present invention. Under the technical guidance of the prior art, no matter how detailed the screening conditions are set, the diverse "personalized" dynamic customization described in the present invention cannot be realized.
[0054] The present invention also constructs a large language model for generating travel scripts, so as to realize the generation of a new version of offline plots that have not been executed by relevant users (the relevant users include the current user and other related users that can be affected by the user's behavior data, user association data, and environmental factors in the actual scene. When the travel script for a certain user is dynamically customized, the user itself is the current user. Then, when the travel scripts for all users are dynamically customized at the same time, all users are each other's background, just like everyone in the real world is carrying out daily activities at the same time. The historical activities between some people will have an impact in the future. The present invention is implemented in the fields of tourism, games, etc., and can naturally narrow the scope of users' activities and behaviors, making it easier to judge the impact) to replace the previous version of offline plots that have not been executed by the user; wherein, the difference between the new version of offline plots and the previous version of offline plots is the adaptive modification performed by the present invention. In the present invention, the adaptive modification of offline plots is continuously carried out following the behavior of the current user, the actual completion of the offline plots by the current user, the behavior of other users, and the actual completion of the offline plots by other users.
[0055] When considering the impact of the user's behavior data on the offline plot that has not been executed, specifically, the user's behavior data is parsed, a semantic text describing the meaning of the behavior data is generated, the semantic text and the travel script are input into the large language model, and a new version of the offline plot that the user has not executed is generated to replace the previous version of the offline plot that the user has not executed.
[0056] When considering the impact of the current user's behavior data, other users' behavior data, and environmental factors on offline plots that have not been executed by all relevant users, specifically, the current user's behavior data, other users' behavior data, and environmental factors in the actual scene are parsed to generate semantic text that describes the meaning of the current user's behavior data, the meaning of other users' behavior data, and the meaning of environmental factors in the actual scene. The semantic text and the current user's travel script and other users' travel scripts are input into the large language model to generate a new version of the offline plot that has not been executed by the current user to replace the previous version of the offline plot that has not been executed by the current user; the new version of the offline plot that has not been executed by the current user includes story descriptions of other users and environmental factors that the current user is about to see; among them, if the same other users and environmental factors are used as story descriptions of offline plots that have not been executed by different users, then in the offline plots that have not been executed by different users, the travel scripts of different users are matched respectively to form corresponding description content.
[0057] Based on the large language model, the present invention can also adjust key nodes through the manual background, and then use the large language model to perform global automatic modification, which can be used as one of the auxiliary means. Specifically, the manual background makes partial adjustments to the offline plots that have not been executed by the user, and based on the large language model, generates a new version of the offline plot that has not been executed by the user corresponding to the content of the adjusted part. The new version of the offline plot that has not been executed by the user includes the content of the adjusted part, and the unexecuted part of the offline plot before the content of the adjusted part, or the unexecuted part of the offline plot after the content of the adjusted part. Among them, the difference from the previous version of the offline plot is the adaptive modification made to the unexecuted offline plot before and / or after the content of the adjusted part.
[0058] The large language model can also be used to modify the travel scripts that have completed the pre-selection stage but have not yet been executed by the user. That is, after the user selects the travel script, as the number of new users increases, the travel script increases accordingly. The previously selected travel script, as the background of the later selected travel script, is reflected in the later selected travel script. The increase of the later selected travel script also affects the previously selected travel script. The previously selected travel script is adaptively modified. The modifications involved can be automatically written based on the large language model to generate a new travel script to replace the original travel script. Based on this, all previously selected travel scripts are continuously updated until the corresponding user travels and enters the dynamic customization stage, or the later selected travel script does not affect the previously selected travel script (the previously selected travel script remains updateable. When the later selected travel script affects the previously selected travel script, the previously selected travel script is updated again).
[0059] The large language model can also be used to automatically write the guide words that connect the previous and subsequent offline plots. Through narration or the roles played by the staff, the user is guided to complete the unfinished part of the current offline plot and connect it with the next offline plot.
[0060] As another auxiliary means for dynamically customizing the unexecuted part of the travel script, in the present invention, a more explicit trigger mechanism can be set, specifically, an update rule for triggering the update of the offline plot that the user has not executed is set, and when the user's behavior data and the execution result of the offline plot trigger the update rule, the offline plot that the user has not executed is adapted to the update rule and modified accordingly. The update rule can be implemented as a set play requirement. After being triggered, the unexecuted offline plot is adaptively modified according to the acquired play requirement, or a new offline plot is automatically generated by a large language model. The present invention is different from the game plot of the prior art in which multiple parallel branch plots are pre-set. In the travel script of the present invention, parallel branch offline plots are not pre-set. If the offline plot that the user has not executed is not modified, the corresponding offline plot is still executed according to the original travel script; and when the offline plot that the user has not executed is modified, after the travel script is updated, the user executes the corresponding offline plot according to the new travel script. In the whole process, the original travel script or the new travel script does not set parallel branch offline plots, but is determined by the latest calculation, or a new offline plot is automatically generated by a large language model.
[0061] After automatically generating a new version of the offline plot and guide words based on the large language model, obtain the behavioral data of the user executing the new version of the offline plot and the guidance of the guide words, parse the behavioral data, and generate semantic text describing the meaning of the behavioral data as a training sample for the optimization training of the large language model.
[0062] The present invention also obtains the behavioral data of all users during the trip, the environmental factors in the actual scene, and the historical events within the monitoring range (including the events that occurred during the user's trip, and the events that occurred in the daily activities before the trip), which is equivalent to knowing what the user did in the past, what he encountered in the past, what he will encounter in the future, what happened in the actual scene in the past, and what will happen in the actual scene in the future. The information is used as the basis for modifying the offline plot that the user has not executed, and automatically writes a corresponding narration explanation, or narrates the role played by the staff to guide the user to complete the unfinished part of the current offline plot and connect with the next offline plot. On the one hand, the present invention realizes the real-time "recommendation" and "how to play" to the user on the spot; on the other hand, it realizes the update of the corresponding offline plot that the user has not executed without the user's feeling, and completes the dynamic customization of the unexecuted part of the travel script; on the other hand, when an emergency event occurs at the plot point, through dynamic customization and narration, that is, combined with the deletion and guidance of the travel script, it ensures that the user can avoid the emergency event, ensure the user's safety, and travel smoothly.
[0063] In specific implementation, the present invention deploys a peer computing system, the monitoring scope of which covers the areas corresponding to plot points, plot points and plot points, and / or users to plot points, and is used to identify events in the said areas. In the dynamic customization stage, the peer computing system is used for collaborative computing to identify historical events within the monitoring scope, and the historical events include but are not limited to plot points within the monitoring scope, plot points and plot points, users to plot points, and events that occurred at plot points, plot points and plot points, and / or users to plot points; when the offline plot that the user has not executed is related to the behavior data and historical events, based on the influence of the behavior data combined with the historical events on the offline plot that the user has not executed, the offline plot that the user has not executed is adaptively modified based on the behavior data combined with the historical events, and the corresponding offline plot that the user has not executed is updated.
[0064] Furthermore, the monitoring scope of the peer computing system also covers the areas corresponding to the user's daily activities. Based on the user's authorization, the peer computing system is used for collaborative computing to identify events occurring in the user's daily activities. Correspondingly, the historical events also include events occurring in the user's daily activities. When the travel script is related to historical events, in the dynamic customization stage, before the user travels based on the travel script, the travel script is adaptively modified based on the historical events based on the impact of historical events on the travel script to generate a new travel script.
[0065] Based on this, for the current user, the identified historical events are what the current user did and encountered in the past; at the same time, the historical events of other users and what happened in the actual scene in the past are also identified. If the travel scripts of other users and the current user will intersect in the future and serve as each other's background, the historical events of other users are what the current user will encounter in the future; for the events corresponding to the actual scene in which the current user and other users will interact in the future, they are what will happen in the actual scene in the future.
[0066] The present invention can also modify the offline plots that have not been executed by the user to adapt to emergency events through the dynamic customization stage, so that when the user executes the offline plot, he or she can naturally avoid the place where the emergency event occurs; or guide the user to avoid the place where the emergency event occurs by automatically writing guiding words. Specifically, when the plot points corresponding to the offline plots that have not been executed by the user, the events between the plot points, and the events between the user and the plot points are emergency events, when the offline plots that have not been executed by the user are adaptively modified, the updated offline plots that have not been executed by the user delete the plot points corresponding to the location where the emergency event is located, as well as the corresponding part of the offline plots. Alternatively, based on the emergency event, guide words that connect with the next offline plot are automatically written, and the user is guided to avoid the emergency event through narration or the role played by the staff.
[0067] In order to meet the needs of different users for travel scripts of different styles, in the present invention, several different script styles are pre-set (such as martial arts, science fiction, adventure, fantasy, sports, fairy tales and other different script styles), and several different offline plots are set corresponding to different script styles and deployed at corresponding plot points. Then, the obtained travel script will select offline plots of corresponding styles corresponding to different script styles and connect them in series. According to the implementation requirements, the same travel script can contain offline plots of different script styles to increase the user's diversified experience.
[0068] In order to provide users with travel scripts that are closer to their potential needs or potential preferences for simple selection in the pre-selection stage, in this embodiment, the monitoring range of the peer-to-peer computing system also covers the area corresponding to the user's daily activities. Based on the user's authorization, the peer-to-peer computing system is used for collaborative computing to identify events that occur in the user's daily activities, and / or obtain the user's preference information, which is obtained by parsing, including but not limited to parsing the user's reading content, game content, and information browsing content. Based on the preference information, the user's potential needs or potential preferences are inferred, and multiple travel scripts with different script styles are pre-generated for users to make simple selections. Specifically, in the pre-selection stage, combined with the events that occur in the user's daily activities and / or the user's preference information, at least one script style, transportation, accommodation and meals plan, play items, play attractions, and travel routes are predicted and selected, and several default scripts are generated accordingly, and are sorted and listed according to the degree of matching for users to make simple selections. The user selects the default script as the pre-selected travel script, or edits the default script, determines and generates the pre-selected travel script, and the pre-selection stage is completed.
[0069] In this embodiment, the pre-selection stage provides different selection methods for users to select travel scripts. One selection method is to perform preliminary screening and then select through customized conditions. Specifically, several travel scenes (such as single-person travel, couple travel, parent-child travel, family travel, friend travel, etc.) are set, and different plot points are deployed for different travel scenes; in the pre-selection stage, after the user selects the customized conditions, at least one travel script is generated, and the customized conditions include but are not limited to travel scenes, transportation, food and accommodation plans, and play items; when generating a travel script, selection reference information is also output, and the selection reference information includes but is not limited to transportation, food and accommodation plans, play items, types of play attractions, prices and optional time; after the user selects the travel script based on the selection reference information, the pre-selection is completed.
[0070] Another selection method is to first determine the tourist attractions, then screen them through customized conditions, and finally select them. Specifically, in the pre-selection stage, the user first selects the tourist attractions, and then generates at least one travel script based on the plot points corresponding to the tourist attractions and the deployed offline plots, combined with the customized conditions selected by the user. This selection method is an extended application of the aforementioned selection method, and further, the process of initial screening and selection through customized conditions is consistent with the aforementioned selection method.
[0071] In the present invention, when the user executes the travel script, the online and offline parts are synchronized, and the online and offline parts are connected to achieve mutual influence between the offline and online parts. Then, the user can perform offline plots in the actual offline scene, which correspondingly affects the game plot of the online part, and can also perform game plots through online players in the online virtual scene, which correspondingly affects the offline plot of the offline part; and the synchronization between online and offline also includes the synchronous association between the role attributes of the virtual role played by the online virtual player and the role attributes corresponding to the virtual role associated with the offline user. On the one hand, the present invention can enhance the user's experience and immersion in the actual offline scene, and on the other hand, it can enhance the authenticity of the online game and improve the playability; and the combination of offline behavior and online games can enhance the user's sense of substitution in the actual offline scene, which is more conducive to immersive tours.
[0072] Specifically, the present invention mainly includes an online part and an offline part; the online part can be constructed according to the concept and implementation method of the game software to obtain a virtual part that is the same or similar to the game software; the offline part is based on the data of the online part, and the relevant data of the online part is associated with the actual scene and the user respectively, and the offline behavior is simulated as the operation of the game software. In the actual scene, the content of the virtual part is completed through real action behavior.
[0073] The online part is specifically: producing an online virtual scene corresponding to the offline actual scene, identifying users, objects, and facilities in the offline actual scene, and displaying them as online players, objects, and facilities in the online virtual scene, and setting the game plot based on the virtual scene. In this embodiment, objects and facilities that may exist in the actual scene can be preset in advance. When an object or facility appears in the offline actual scene, the virtual scene can be correspondingly added in time. For users, the online players pre-established by the user can be read, and when the user appears in the actual scene, the corresponding online players are added to the virtual scene. In specific implementation, the corresponding game plot is set according to the virtual scene produced corresponding to different actual scenes. For example, for historical sites, the game plot can be set according to real historical events; for science and technology venues, the game plot can be set according to venue equipment; for popular science venues, the game plot can be set according to popular science content, and so on. The online part of the present invention can be understood as a virtual game (i.e., game software) built based on the actual offline scene.
[0074] The offline part is specifically as follows: deploy offline plots in offline actual scenes, and deploy offline plots corresponding to game plots; users enter offline actual scenes, and identify and locate users in actual scenes; based on the user's location, activate the current link plot for the user at the location set in the offline plot; determine the user's next link plot according to the user's completion result of the current link plot in the actual scene. In specific implementation, the user is also a participant in the virtual game, but in the actual scene, the user needs to transmit and obtain information externally for any information acquisition, and can inform the user through an interactive screen or a terminal device associated with the user, including plot activation, message notification, data viewing, etc. The activation of the corresponding link plot can be executed by the staff at the corresponding location. According to the user's location and itinerary, tasks are assigned to the corresponding staff to assist in the guidance and advancement of the offline plot. Specifically, at the location set in the offline plot, the staff plays the story role for the user's current link plot; the staff receives the role-playing task and the user's photo or feature description in real time, where the role-playing task is for the user's current link plot.
[0075] In the present invention, the same user is given different identities for different other users through narration and roles played by staff. For example, in the story line of user a, player group A is described as a foreign merchant, and in the story line of user b, player group A is described as an organization with a special mission, and the relevant users in the story line of user b need to avoid player group A. Furthermore, multiple story lines and multiple mission lines with multiple story backgrounds cooperate with each other, serve as each other's background, and serve as interactive roles, thereby increasing the richness of the game content.
[0076] The present invention connects the online part with the offline part, and the user's offline behavior can affect the corresponding online players. The online players associated with the user play virtual games, which also affect the user's various offline attributes or characteristics, including the next link of the plot, so that offline behavior is equivalent to online games, and online games are equivalent to offline behavior. With the implementation of the present invention, the online part and the offline part influence each other, and the online and offline parts are no longer separated, so that the online game has high authenticity and the offline behavior has high immersion.
[0077] In the present invention, in addition to the synchronous influence of the game plot and the offline plot, the online part and the offline part also include the synchronous influence of the information related to the role that the user and the online player need to have as the role participating in the game plot and the offline plot. Specifically, in the online part, a virtual role is also set, and the role attributes are set corresponding to the virtual role, and the online player selects the virtual role to play; in the offline part, the user corresponds to the online player and forms an association with the virtual role. That is, the online player selects the virtual role to play, and the offline user obtains the role attributes of the corresponding virtual role to form the effect corresponding to the role attribute offline, such as life value, attack power, defense power, skills, equipment, etc., and all offline users interact based on their respective role attributes. At the same time, according to the completion result of the user for the current link plot in the actual scene, the influence on the role attributes corresponding to the virtual role associated with the user is determined, the role attributes are modified according to the preset rules, and the role attributes of the virtual role played by the online player are modified in association; or, the online player plays an online game, and the role attributes of the virtual role played by the online player are modified based on the process of the online game. For example, when an offline user or online player completes an upgrade, accumulates experience points, or directly purchases equipment or experience levels, the corresponding character attributes are improved, which in turn has a corresponding impact on the character attributes of the online player and offline user.
[0078] Furthermore, users can also influence the role attributes of the virtual characters associated with the users through offline behaviors outside the actual scenes, and modify the role attributes according to preset rules. For example, when a user eats in an associated restaurant, different meals can lead to different role attribute enhancements, and when exercising in an associated stadium, different sports can lead to different role attribute enhancements. In this way, offline behaviors can influence online role attributes in a more comprehensive way, thereby increasing the interactivity between online and offline.
[0079] In order to achieve the corresponding improvement of the character attributes more accurately, in the present invention, the offline behavior of the user is identified, the behavior results of the offline behavior are obtained, and the behavior results are converted into corresponding character attributes according to preset rules. For example, what dishes the user ate and how much he ate, the character attributes are improved proportionally based on the actual food intake.
[0080] In order to expand the scope of application of the present invention, that is, within a story line, the user can extend the offline plot, character attributes, virtual items, etc. in the current actual scene to the next actual scene. Specifically, the offline plot contains different story lines, and the character attributes corresponding to the virtual character associated with the user are used in different story lines or converted according to preset rules or by a conversion model obtained by machine learning.
[0081] In the present invention, the determination of the next segment of the user's plot is also combined with the environmental conditions, the conditions and needs of other online players and offline users; specifically, the environmental factors in the actual scene are detected, and the next segment of the current user's plot is determined in combination with the completion results of the current user in the actual scene for the current segment, the completion results of other offline users in the actual scene for the segment plot for other users, the completion results of other online players for the game plot in the virtual scene, and the environmental factors in the actual scene. In the present invention, when all users in the offline actual scene are performing their own offline plots, there is a real-time and dynamic influence between the users. That is, for the current user, the real-time situation of other users' offline behaviors may have an impact on the current user's future segment plots. Furthermore, in the present invention, the determination of the next segment of the current user's plot takes into account the conditions and needs of other users in the actual scene that can affect the current user.
[0082] In order to improve the richness, diversity and personalization of the offline plots that each user participates in, the present invention determines the user's current plot based on the user's route in the plot point and the completion of the historical plots on the route. The present invention is not independent for each plot activated by the user in the actual scene, but with the coherence of the plots of each link, the accumulation of completion status, etc., each current plot is comprehensively determined to more realistically reflect the user's sense of participation in the offline plot.
[0083] In order to ensure the continuity between the offline part and the offline part, the present invention can form fault tolerance. Specifically, if the offline user does not enter the actual scene or does not perform the offline plot during the game plot, the corresponding online player enters the hosting state and automatically performs periodic tasks, or the online player is controlled by the online game system to maintain synchronization with other online players. Since the present invention connects the online part and the offline part, when the offline user does not perform the offline plot normally, it automatically switches to the online player online to perform the game plot in the virtual game to ensure that other users related to the current user can proceed smoothly.
[0084] In the present invention, relevant background information (which can be obtained synchronously through the push of the travel script) is also pushed to new users who have not performed offline behavior (such as other users who have not entered the plot point) to ensure that the new user can more quickly understand and connect the offline plot in the actual scene (in fact, it is also the offline plot of the travel script of other users). In addition, the present invention takes into account the optimal experience of new users reading background stories. Specifically, according to the new user's itinerary (the time required to reach the actual scene) and reading speed, the amount of content that the new user can read before arriving at the actual scene is inferred, and the plot richness of the pushed background story is adjusted to adapt to the amount of content that the new user can read. For new users with ample time and fast reading, the pushed background story has a richer plot, otherwise, the plot is simpler. The user experience achieved is that when the user arrives at the actual scene, it is appropriate to just connect to the offline plot in the actual scene, including the situation of all users in the actual scene.
[0085] In order to reduce the number of staff, or reduce the work intensity of the staff, so that the entire offline plot can be executed more efficiently, and at the same time enhance the user's sense of participation, in the present invention, users play roles in a time-limited task manner. Specifically, by issuing task plots to users, users execute the plots of other roles according to the task plots, and combine them with the different story line plots or link plots contained in the offline plot, and guide other users who interact with them to the corresponding positions; or, corresponding to other users who are about to arrive at their location, adjust the current link plots of the other users corresponding to the location, and guide the other users to the corresponding locations, so as to drive the distribution of users at various sightseeing nodes, reduce queuing and congestion, greatly improve the capacity of the actual scene, and enhance the user experience.
[0086] In order to achieve the best experience for the distribution of users at each sightseeing node in the actual offline scene (the best experience is related to the offline plot, such as a quiet plot has a better experience with fewer people, and a large interactive plot has a better experience with more people), and to minimize the length of queues at entertainment and consumption facilities, specifically, according to the congestion level of the actual offline scene, the density of route demand, the occupancy and distribution of entertainment and consumption facilities, combined with the schedule of each user for the offline plot, the offline plot is dynamically adjusted, including adding or deleting segments or adjusting the difficulty, so that the number of users at each location in the actual scene matches the offline plot.
[0087] Furthermore, the interaction process and results between users and staff, and between users are added to the offline plot. After automatic or semi-automatic review, the offline plot is adjusted, and all users in the actual scene determine the future plot based on the latest offline plot. The present invention is also based on the latest offline plot. If different users will meet at the location set in the offline plot in the future plot, the plot is automatically or semi-automatically edited for the corresponding different users to obtain a matching connection plot, and the future plots of the corresponding different users are connected using the connection plot. Combined with the aforementioned release of task plots to users, users execute the plots of other roles according to the task plots, which can realize interaction between users and promote offline plots without the participation of staff, and the authenticity of the plot experience is stronger.
[0088] As an extension, in the present invention, the interactive process between users and staff, and between users, including action flow and creative dialogue, is also recorded on blockchain as the basis for copyright sharing; the game content, literary works, and film and television works generated according to the action flow and creative dialogue are set according to the content ratio and importance weight to share the copyright of the relevant parties. If the offline behavior of users based on offline plots in actual scenarios is used as material to create corresponding copyright-related works, then the interactive process between users and staff, and between users, is recorded on blockchain, which can be conducive to determining and obtaining evidence of copyright proportions and ensuring data security.
[0089] In order to enhance the fun and promote the user's involvement by increasing competition, in the present invention, different sects or groups related to the game plot are set in the online part, and different game plots are set for different sects or groups related to the game plot; in the offline part, the user selects the sect or group related to the game plot to which he belongs, and the points are calculated according to the preset rules based on the user's completion results of each link of the plot in the actual scene, and the different sects or groups related to the game plot, individual users, and virtual characters are ranked.
[0090] In order to increase the sense of immersion, in the present invention, the user's action is recognized, the user's action is combined with the current link plot, and the audio-visual effect is displayed through the AR application of AR glasses or terminal equipment. In addition, the audio-visual effect displayed by the AR application of AR glasses or terminal equipment is superimposed on the actual scene to generate a video or a full three-dimensional scene, which can be posted by users on social media. Furthermore, a link is generated for the corresponding generated video or full three-dimensional scene, and the link is set corresponding to the web article of the current link plot, and the corresponding video or full three-dimensional scene is displayed on the web page or VR device using the link to enhance the experience of the web article and assist the experience of the web article through audio-visual effects.
[0091] In order to increase the richness of virtual scenes and actual scenes, make users more involved, and promote users' in-depth understanding of actual scenes, in the present invention, users design props and costumes according to the plot background, actual scenes or virtual scenes. After review or voting, corresponding physical objects are set in the offline actual scenes, and corresponding virtual objects are set in the online virtual scenes. Users can fully understand the current actual scenes through understanding the plot background, interaction between users, and participation in offline plots or game plots, and then design real props and costumes for offline use, or virtual props and costumes for online use. After review or voting, the same props and costumes are set online or offline accordingly as a supplement to the actual scenes and virtual scenes.
[0092] In order to enhance the offline immersive experience, the interaction between online players and offline users, as well as the interaction between offline users, can be displayed through the sound and light equipment set in the actual scene. In the present invention, the audio-visual effects displayed by the sound and light equipment are related to the character attributes, offline plots or game plots. Furthermore, the position and actions of online players can also be synchronously displayed and presented through sound and light equipment, display equipment, audio equipment, robots and other equipment deployed in the actual scene, so as to interact with offline users.
[0093] In the present invention, walking navigation is performed for users at offline plot points. In order to solve the shortcomings of the navigation technology in the prior art, such as poor versatility, accuracy and real-time performance, and reliance on handheld terminal devices, in this embodiment, based on the identification and positioning of the user, guidance is provided to the user through a guidance device deployed in the user's surrounding environment. During the navigation process, the user can get rid of the handheld terminal device, thereby achieving high accuracy and high real-time performance. The present invention obtains the physical properties of the user in the channel by deploying sensors of corresponding types that cover the channel, identifies and locates the user, and can build a pure intranet to achieve navigation, thereby avoiding the data security risks of using a public communication platform for data interaction; the present invention can be implemented in any scenario where sensors can be deployed, and has strong versatility.
[0094] Specifically, by identifying (or locking) and locating the user, based on the user's navigation needs (which may include a starting location, multiple passing locations, and route requirements, such as fewer people, shortest path, fewer turns, etc.), without calculating and generating path information, based on the situation of all users within the collection range, when the navigation needs are met, the user's next action is calculated and output one by one, and the user is gradually guided to the destination. When navigating, the user's navigation needs are first obtained, and the user's location information is obtained in real time; then, based on the navigation needs and the user's real-time location information, the user's next navigation information is calculated; the navigation information is presented by the guidance device at the corresponding position of the user's real-time location information, for guiding the user. The present invention guides the user in stages, and usually can present navigation information to the user at a location where a route selection is required (not a complete route information selection, in fact, the present invention does not generate complete route information, but means that if a fork in the road is encountered, the user needs to select one of them) to guide the user to select an appropriate direction of travel; and so on, until the navigation is completed.
[0095] In this embodiment, the guidance device can be implemented as a visual information display device or an audio playback device or a combination of the two. When implemented specifically, it can be selected according to the implementation scenario and performance requirements; wherein the visual information display device is a projection device (projected on the ground or wall), a dedicated display device (set on the ground or wall), a multi-purpose display device (such as a billboard, a light box, a sign, an outdoor display screen, etc.), etc. or a combination thereof; the audio playback device is a dedicated playback device, a multi-purpose playback device (such as an advertising terminal with a sound playback function, a background music playback device, an information broadcasting device, etc. or a combination thereof). When there are multiple users and navigation information needs to be presented to multiple users at the same time, different types of guidance devices can choose a presentation method suitable for their own functional characteristics, such as a projection device can simultaneously display the visual navigation information for each user, and an audio playback device can play the audio navigation information for each user one by one.
[0096] In order to improve the user experience and provide advance guidance to users so that they can move without stopping, the present invention also obtains the user's travel direction data, travel speed data, and posture action data, and uses preset conditions (such as preset judgment criteria) or a prediction model pre-trained by machine learning to predict the user's next action, including the user's travel direction and travel speed; for example, if the posture action data of the user is "looking around", the travel speed will usually slow down or stop; if the posture action data of the user is "looking straight ahead" and the travel speed data is "walking fast", the travel speed will usually remain or may increase, etc. Furthermore, the guidance device that matches the predicted user's next direction of travel and speed presents the user's next navigation information; for example, for a user whose travel speed is predicted to slow down or stop, the presentation time of the user's next navigation information can be delayed or not displayed until the user moves to the location where the navigation information needs to be presented, and the idle time can be used to present other content, including navigation information for other users, or other types of content; for a user whose travel speed is predicted to remain or increase, the presentation time of the user's next navigation information can be maintained or advanced accordingly. Therefore, the presentation of navigation information is dynamically and actively adjusted, rather than just relying on the positioning of the user.
[0097] Among them, the prediction of the user's moving speed can also be carried out through auxiliary means, specifically, the user's height data, leg length data, and step frequency data are obtained to calculate the user's moving speed; if the prediction of the user's next action is inaccurate, the measured moving speed will replace the predicted moving speed.
[0098] If the prediction of the user's next action is inaccurate, the guidance device presenting the user's next navigation information is corrected based on the user's real-time travel direction data and travel speed data, and the density of people around the user, environmental information, travel direction data, travel speed data, and posture action data of people around the user are used as training samples and added to the sample library for further training and adjustment of the prediction model to improve the accuracy of the prediction model. In order to further improve the accuracy of the prediction model, in the present invention, a prediction model for individuals can be established for different users, and after the user is identified, the associated prediction model is used to predict the user's next action.
[0099] When the guidance device is implemented as a visual information display device, it is used to display visual navigation information; in order to improve the user's experience in obtaining visual navigation information, in the present invention, the user's real-time travel direction data and travel speed data are obtained, and the visual information display device follows the user's travel direction and travel speed, and is maintained at a certain distance from the user in the user's travel direction to display the user's next visual navigation information; that is, the display of the visual navigation information follows the user's travel direction and travel speed and is displayed in a position in front of the user that is convenient for the user to watch, and the display effect is a moving display in the same direction and speed as the user.
[0100] Alternatively, based on the user's navigation needs and the user's real-time location information, the peer-to-peer computing system provided by the present invention is used for collaborative computing to obtain a visual information display device that matches the position where each user needs to display visual navigation information in the next step; and relative to the user's real-time location information and real-time travel speed, the visual information display device is kept at a certain distance from the user to display the user's next visual navigation information. The peer-to-peer computing system provided by the present invention is based on collaborative computing, can perform non-specific feature recognition on the user, and determine the user's real-time location, travel direction, and travel speed. At the same time, based on the results of collaborative computing, the visual information display device that needs to display visual navigation information can display the corresponding visual navigation information.
[0101] Among them, the distance between the visual information display device that displays the visual navigation information and the user is calculated based on the user's height and stride length.
[0102] When the guidance device is implemented as an audio playback device, it is used to play audio navigation information; in order to improve the user's experience in obtaining audio navigation information, in the present invention, the user's real-time location information and travel speed data are obtained, and the audio playback device follows the user's location and travel speed, and keeps the sound field covering the user's position to play the audio navigation information for the user's next step; that is, the playback of the audio navigation information follows the user's travel direction and travel speed, and is played in the sound field that is aligned with and covers the user's position, and the playback effect is to move and play in the same direction and speed as the user.
[0103] Alternatively, based on the user's navigation needs and the user's real-time location information, the peer-to-peer computing system provided by the present invention is used for collaborative computing to obtain an audio playback device that matches the location where each user needs to play audio navigation information in the next step; and relative to the user's real-time location information and real-time travel speed, the audio playback device that maintains the sound field covering the user's location plays the user's next audio navigation information. The peer-to-peer computing system provided by the present invention is based on collaborative computing, can perform non-specific feature recognition on the user, and determine the user's real-time location, travel direction, and travel speed. At the same time, based on the results of collaborative computing, the audio playback device that needs to play audio navigation information can play the corresponding audio navigation information.
[0104] Among them, the audio playback device is arranged above the channel and is provided with a downward-facing sound-collecting cover, which is used to limit the sound field of the audio playback device to a certain range, such as ensuring that the sound can be clearly transmitted to the space required for one person walking below and diffuse to the surrounding area as little as possible; or, a super-directional speaker with a pan-tilt head is used to adjust the emission angle according to the travel direction and speed of the user who needs to listen to the audio navigation information, so as to ensure that the super-directional speaker is aimed at the user.
[0105] In order to avoid the influence of satellite positioning, electronic maps, and other communication equipment, the present invention gets rid of the dependence on handheld terminal devices. By deploying corresponding types of sensors in the channel and covering the channel, the physical attributes of users in the channel (physical space, sound, appearance, body temperature, smell and other elements) are obtained, and the user's navigation needs are obtained through a human-computer interaction device associated with the user (which can be implemented as a fixed or mobile device and only needs to be used to submit navigation needs). Through collaborative computing through the peer computing system provided by the present invention, the next step of navigation information for each user is obtained.
[0106] In specific implementation, the human-computer interaction device can be omitted, and the navigation needs can be inferred from the user's travel script. The travel script includes a determined destination or an inferred destination, and the determined destination or the inferred destination is the final destination or the next of multiple consecutive destinations. In the implementation of the present invention, when the peer-to-peer computing system covers the scope of the user's navigation needs, the user goes out, that is, starts from the starting position, and is immediately subjected to real-time calculations of various states and needs by the peer-to-peer computing system. The various needs include calculations of navigation needs. The peer-to-peer computing system can guide the user from the road to the indoor step by step, and then guide the user to the destination (or the next of multiple consecutive destinations) step by step in the indoor step by step in various calculations performed according to laws, regulations, and user agreements.
[0107] In the present invention, a camouflage screen is set in the actual scene to dynamically switch and display virtual data according to the user's travel script, and the virtual data includes but is not limited to environmental scenes adapted to the travel script, virtual props, virtual images (which can be used as NPCs, tour guides, staff, etc.), interactive information, etc. The camouflage screen can perfectly integrate with the actual scene environment to achieve a camouflage effect for users to experience without feeling, and solve the shortcomings of the prior art such as poor interactive effect, electronic equipment destroying the visual integrity of the actual scene, and affecting the user's play experience.
[0108] Among them, virtual data is combined with a large language model and drawing AI to automatically generate specific content of virtual data based on the latest offline plot that the user has not executed. If it is image information (such as environmental scenes, virtual props, virtual images, etc.), it is drawn and displayed in combination with the large language model and drawing AI. If it is interactive information (such as text information, voice information, etc.), it is automatically generated using a large language model and displayed or played.
[0109] Specifically, when using a disguised screen to display virtual data, the user's identity is identified and the user's location information is obtained, which can be implemented on the user's way to the plot point or in the actual scene corresponding to the plot point to achieve real-time tracking of the user. The present invention displays virtual data through a disguised screen (the virtual data is actually displayed through the display device of the disguised screen). When implemented specifically, virtual data is used for interaction, and image information, text information, and voice information can be input and output through the display device; or, the user's action information and expression information are obtained through an image acquisition device, and the user's voice information is obtained through an audio acquisition device. In the present invention, based on the user's location information, virtual data is displayed through a disguised screen at a corresponding position or a display area of a disguised screen, so that virtual data corresponds to the user, avoiding the situation where the user cannot execute offline plots or interactions due to the loss of virtual data.
[0110] In the present invention, in order to achieve a non-perceptible experience for the user, the display device is implemented as a camouflage effect, that is, the installation effect of a camouflage screen. Specifically, Figure 1 , Figure 2As shown, the camouflage screen includes a display device 10 and a light-transmitting layer 20. The light-transmitting layer 20 is arranged to cover the outer side of the display device 10. The surface material of the light-transmitting layer 20 is set to a certain degree of texture corresponding to the installation environment of the display device 10 (according to the installation environment corresponding to the installation position of the display device 10, the surface material of the light-transmitting layer 20 is manufactured to a corresponding smooth or rough texture) or shape; when the display device 10 does not display virtual data, the display device 10 corresponds to the installation environment and displays a corresponding or identical image, which is presented in combination with the light-transmitting layer 20 to simulate elements in the installation environment or objects matching the installation environment, such as rocks, walls, stone tablets, etc. If necessary, plants can be added for decoration to achieve a camouflage effect that perfectly blends with the environment of the actual scene, thereby preventing the display device 10 from affecting the user's gaming experience. When the display device 10 needs to display an environmental scene, the environmental scene is spread over the display area of the camouflage screen to simulate the scene required for the offline plot; when the display device 10 needs to display virtual props, virtual images, interactive information, etc. in addition to the environmental scene, the virtual props, virtual images, and interactive information are superimposed on an image corresponding to or the same as the installation environment, or the image corresponding to or the same as the installation environment is hidden and switched to displaying virtual props, virtual images, and interactive information.
[0111] In order to satisfy the requirement of virtual data to follow the user's real-time location information, in the present invention, camouflage screens are arranged in a continuous manner, and virtual data is displayed through the corresponding display area of the camouflage screen or the camouflage screen based on the user's real-time location information, so as to achieve virtual data following. In specific implementation, the camouflage screen can be implemented as a continuous and uninterrupted display device, that is, the display area is continuous and uninterrupted. When virtual data needs to be displayed, virtual data is displayed in the corresponding display area based on the user's real-time location information; it can also be implemented as a camouflage screen set at intervals. When virtual data needs to be displayed, virtual data is displayed on the corresponding display device based on the user's real-time location information.
[0112] When virtual data is required to follow the user in real time, in order to make the virtual data as consistent as possible with the user's play rhythm, the present invention further obtains the user's action information, expression information, and demeanor information through an image acquisition device, and uses a prediction model pre-trained through machine learning to predict the user's next action, including staying, playing, resting, accelerating walking, decelerating walking or running, so as to generate display control instructions, control the display position of the virtual data, and pre-display the virtual data in the display area or display device corresponding to the display position, so as to achieve the virtual data keeping up with the user's play rhythm, keeping it as consistent as possible with the user's play rhythm, or maintaining a certain amount of advance time and displaying it at the next position that the user is about to arrive.
[0113] If the prediction of the user's next action is inaccurate, the display control command will be corrected based on the user's real-time action information, and the surrounding personnel density, environmental information, game content, interactive content, user's action information, expression information, and demeanor information will be used as training samples and added to the sample library for further training and adjustment of the prediction model to improve the accuracy of the prediction model.
[0114] In the present invention, the travel script, offline plot or guiding words are used to drive users to execute the corresponding plot, drive narration or staff to guide users, and on the other hand, control the execution device required for the plot (i.e., the travel script, offline plot or guiding words record or guide the user to form the plot) (in the present invention, including but not limited to guidance equipment, display device of camouflage screen, or functional equipment for recording travel scripts, offline plots, and guiding words. According to different implementation requirements, it can also be various controllable mechanical equipment with different functions such as car transporters, entertainment machinery and equipment, fire-fighting equipment, etc.), and the corresponding execution device executes the corresponding response or operation according to the plot, that is, parses the travel script, offline plot or guiding words, obtains the control instructions of the corresponding execution device, and controls the execution device based on the control instructions.
[0115] In specific implementation, the traditional single-point identification method can be used to identify the target (the target includes the user, other fixed or mobile objects other than the user, such as the user's self-driving vehicle, road public transportation, etc.) at the set position to achieve the purpose of identity confirmation, associating location information, and identifying behavior and action; the collaborative computing based on the peer computing system provided by the present invention can also be used to perform non-specific feature identity recognition and location recognition. The peer computing system of the present invention is based on collaborative computing, does not rely on single-point identification, and distributes all computing functions in the peer computing system, reduces the software and hardware requirements of single-point computing, has high execution efficiency, and greatly improves the anti-attack capability; the information is relatively symmetrical between the node devices, and can be immune to the problem of illegal data tampering. Even if a single node device is physically cracked and the data it sends is tampered with, because the operation of the peer computing system is a complex calculation with super-high redundancy and super-multi-dimensional verification, the tampering of the data sent by a single node device does not affect the calculation results of the peer computing system, and can quickly locate the fault and the tampered node device, ensuring the credibility of the calculation results of the peer computing system, and then, it can solve the contradiction between data sharing and information security between departments.
[0116] The result data transmitted between node devices can be the processing result of information rather than the information itself, so the collected original data (i.e., perception data) does not need to be stored. The node device only receives the calculation results output by other node devices and sends out its own calculation results. The amount of information contained in a single calculation result is not enough to restore any event and target information. The calculation results on the entire peer-to-peer computing system, the elements of the multi-dimensional data matrix, and the correspondence between the physical space and facilities must be jointly calculated to obtain a definite result. Collaborative computing is less dependent on the information transmitted by a few node devices, and can fundamentally change the nature of traditional information technology that is sensitive to single-point security.
[0117] In the present invention, the acquisition of the identity information and location information of the target can be obtained by collaborative calculation through the peer computing system provided by the present invention. Specifically, the peer computing system is used to perform non-specific feature recognition and location recognition on the target. The "non-specific feature recognition" is different from the usual "recognition" in a strict conceptual definition. The usual "recognition" means to determine the concreteness of the target or the specific identity information of the target, such as who it is (including the name, specific information indicating the identity of the target), what it is (such as a car, a person, etc.). The "recognition" in the "non-specific feature recognition" of the present invention means to determine each unique target (i.e., the target, other fixed or moving objects other than the target) as itself; that is, for a certain object to be recognized, its existence is unique. After the present invention realizes "non-specific feature recognition", it is determined that the object to be recognized (i.e., the target that has not been recognized or confirmed) is itself, rather than other objects to be recognized. The result of "non-specific feature recognition" does not need to determine the specific features of the object to be recognized, and does not need to determine the identity information or concreteness of the object to be recognized. For example, a person is considered as the object to be confirmed A, and an object is considered as the object to be confirmed B. After the "non-specific feature recognition" is realized, it is not necessary to identify the object to be confirmed A as a person and its specific identity, nor is it necessary to identify the object to be confirmed B as an object and its specific object; instead, it is necessary to determine that the object to be confirmed A is the object to be confirmed A itself, and the object to be confirmed B is the object to be confirmed B itself. Then, corresponding services or controls can be provided for the object to be confirmed A or the object to be confirmed B.
[0118] The peer-to-peer computing system includes multiple node devices, and there is no primary-secondary relationship between all node devices, forming a decentralized network and computing architecture. Different from the traditional information-based single-point convergence computing mode, there is no fixed, preset path relationship in the direction of data transmission between the node devices of the present invention. In the peer-to-peer computing system described in the present invention, for a certain node device, the collected original data is processed to obtain result data, and the result data is propagated to other node devices; other node devices that receive the result data use the result data as one of the collected original data, and the result data of other node devices is affected by the result data. For the convenience of expression, the aforementioned "a certain node device" is referred to as the "current node device" and the "other node devices" are referred to as "subsequent node devices". One of the effects is that the result data calculated by the subsequent node device is not completely determined by the original data collected by itself, but is jointly determined with the result data output by the current node device; wherein, the result data output by the current node device may change the data processing model and parameters used by the subsequent node device to calculate the result data, thereby affecting the result data of the subsequent node device. For example, if the result data output by the current node device is correlated with the original data collected by the subsequent node device, it is necessary to consider the impact of the result data output by the current node device on the accuracy of the result data of the subsequent node device; specifically, for the perception of a specific target, if the result data obtained by calculation is only based on the original data collected by the subsequent node device, it can only reflect the real-time (including real-time location and time) single-point result judgment of the target within the perception range of the subsequent node device; and the result data output by the current node device reflects the direct perception data and result judgment about the target at other locations and other times, or other indirectly related perception data and result judgment, which helps to improve the accuracy and comprehensiveness of the result data of the subsequent node devices, including superposition calculations of the same dimension and correlation references of different dimensions.
[0119] Since there is no master-slave relationship between the node devices in the peer-to-peer computing system, point-to-point transmission can be performed between the node devices. Therefore, for the calculation result corresponding to a certain perception data of a certain target reflected in the result data output by a certain node device, the information is relatively symmetrical in other node devices that receive the result data; other node devices use the received result data as input, combine the perception data of their own sensors, and calculate their own result data. Their own result data naturally covers the received result data and the information reflected by their own sensors, and transmits it to other node devices in the next layer. Therefore, for a certain perception data of a certain target, the information is relatively symmetrical in all node devices, which can be immune to the influence of the calculation process and calculation results of a single node device being tampered with and forged, which leads to the result data. At the same time, it also becomes a means to discover faulty or tampered node devices and node devices with non-compliant performance, fundamentally solving the fundamental hidden dangers of traditional information technology, that is, false information, forged information, and erroneous information caused by information asymmetry, which then become the entry point for fraud and network attacks, and complex comprehensive applications have poor accuracy, too long time consumption, poor credibility, and poor adaptability. Therefore, it can truly become the information infrastructure for comprehensive management of larger areas and the infrastructure of the digital economy. The present invention is different from the blockchain technology that still uses each node to independently calculate, determine the results, and pay attention to the technical solution of original data storage. The present invention focuses on peer-to-peer collaborative computing between node devices. Through peer-to-peer collaborative computing, each node device can adjust its own data processing model (i.e., the algorithm for calculating the result data) and parameters when processing data. The adjustment is the feedback of all node devices on their own adjustments, thereby turning the calculations of all node devices into a whole. Each node device no longer completes the calculation independently, but all node devices complete the calculation together. After the data processing model of the node device is adjusted, it is an objective adjustment that will affect the next data processing.
[0120] The node device is provided with a data acquisition device (in specific implementation, it may include one or more of an image acquisition device, an audio acquisition device, a temperature measurement device, a vibration frequency sensing device, a laser radar, a chemical sensor, and an electromagnetic induction device), and a computing module. The data acquisition device includes at least one type of sensor for collecting perception data of different corresponding types. The computing module calculates and obtains the result data based on the data processing model. Node devices set at different collection positions (i.e., located at different physical installation positions) collect at least one point sample of the target, and the point sample is the perception data of the corresponding sensor type. Based on this, without the need to obtain the identity information of the target, multiple node devices in the peer computing system perform collaborative calculations to determine each unique target as itself, realize non-specific feature recognition, and perform position recognition on the target; and realize the discovery of the completion results of the user's current link plot in the actual scene and the behavioral results of the user's offline behavior.
[0121] When the result data of the collaborative computing can determine an event, the event discovery is completed. In this embodiment, the discovery of events by the peer computing system includes the discovery of the target's completion results for the current link plot in the actual scene, the behavioral results of the target's offline behavior, etc.
[0122] Specifically, a certain node device is taken as the current node device, and combined with the data transmission of its preceding node device and subsequent node device (the preceding node device and subsequent node device in the present invention are only used to describe the relationship between the current node device and the current node device in the current calculation and data transmission process, and do not mean that there is a necessary relationship between them and the priority relationship), correspondingly, the current node device receives the result data output by other node devices (including the preceding node device), and the subsequent node device receives the result data output by other node devices (including the current node device). For the current node device, the collected perception data is combined with the result data from other node devices (including the preceding node device), the result data of the current node device is calculated, and sent to other node devices (including the subsequent node device). Similarly, the working process of the subsequent node device is the same as that of the current node device, and the preceding node device also receives the result data of the preceding node device of the preceding node device, and performs the same working process as the current node device; that is, the node devices in the peer computing system perform the same working process. Furthermore, the node devices in the peer computing system perform collaborative computing with the collection of perception data and the calculation of result data. Among them, the result data output by a certain node device is only received by the subsequent layer of node devices and used as input. The result data of the subsequent layer of node devices will cover the result data of the previous layer of node devices (including the aforementioned certain node device).
[0123] In a peer-to-peer computing system, all events are processed synchronously, and it is not necessary to explicitly generate interim result outputs such as what event was discovered and what the specific content of the event is. In a peer-to-peer computing system, only the perception of the sensor and the response of the corresponding execution device (in the present invention, including but not limited to the guidance device and the display device of the camouflage screen) are clear, and other intermediate processes are processed simultaneously by collaborative computing. That is, during the operation of the present invention, the intermediate process of event discovery is imperceptible. As the collaborative computing proceeds, the result data of the node device is obtained, and the corresponding execution device automatically responds and executes.
[0124] In order to ensure that the data source and the calculation process are further credible, in the present invention, all node devices encrypt the result data obtained by their calculations based on the encryption consensus mechanism to obtain the encryption result, and then send the encryption result to other node devices. The encryption consensus mechanism includes one or more consensus mechanisms, and different consensus mechanisms correspond to changes in the encryption algorithm structure and parameters of the node device.
[0125] Node devices communicate with each other using standard-sized data packets (i.e., result data or calculation results). In the present invention, the node devices of the peer-to-peer computing system are similar to human neurons. Each neuron does not transmit specific data that directly describes external events. Similarly, the node devices do not output raw data, but process the raw data obtained by the connected sensors and data acquisition devices into standard-sized data packets (i.e., result data or calculation results, similar to the nerve impulses of neurons) according to their own data processing models (similar to the biological characteristics of nerve cells). The amount of information contained in a single data packet is not enough to restore any event and target information. The calculation results, multi-dimensional data matrix elements, and physical space and facility correspondences on the entire peer-to-peer computing system must be jointly calculated to obtain a definite result. The collaborative calculation is not very dependent on the data output by a few node devices, and the collaborative calculation simultaneously processes the needs received or initiated by all node devices. It is a collaborative verification calculation of super-multi-dimensional related information, which can fundamentally change the nature of traditional information technology that is sensitive to single-point security.
[0126] In order to ensure the integrity of data and the effective execution of collaborative computing, in the present invention, the peer computing system deploys a QoS mechanism, and the QoS mechanism is to give priority to ensuring the transmission quality of the result data between node devices.
[0127] In the specific implementation, the networking mode of the peer computing system is one or a combination of 4G mode, 5G mode or MESH mode, so as to adapt to different application scenarios, comprehensively implement feasibility, cost considerations and other factors, and realize the optimal solution. Among them, the MESH mode is based on the LTE standard, and communicates at the physical layer of the LTE standard; it carries data with a customized frame structure and interacts with a dedicated wireless communication protocol. The frame structure is customized to be suitable for the calculation of the peer computing system, and the proprietary wireless communication protocol developed for the calculation of the urban agglomeration peer computing system is adopted, which can further improve its security and reliability. In addition, the wireless algorithm fully adapts to the multipath channel environment based on the consensus mechanism control required for the calculation of the peer computing system. The communication distance in the city is 100 meters-10 kilometers, and the omnidirectional antenna is used in the field. Under the condition of efficient transmission of 120 kilometers, it can also achieve efficient transmission at a distance of 120 kilometers. In this embodiment, the communication distance of the Mesh network is: the distance between node devices indoors is 50-150 meters, the distance between node devices outdoors is 50 meters-120 kilometers, and the number of node devices that can be accessed by each node is 65535. In addition, when networking in 4G mode or 5G mode, there is no limit on the communication distance, and the number of accessible node devices depends on the computing power of the computing chip and the communication delay.
[0128] In a peer-to-peer computing system, for a certain point sample of an object to be identified, the result data transmitted from the node device that collects the point sample to other node devices can enable subsequent node devices to adjust their perceptual attention according to the characteristics of the point sample (it is not necessary to include the characteristics of the point sample in the result data, but the characteristics of the point sample participate in the calculation of the previous node device, so that when the result data of the previous node device is used as the input of the data processing model of the subsequent node device, the data processing model of the subsequent node device can achieve the effect of adjusting the perceptual attention in the calculation); or, report the characteristics of the point sample for subsequent node devices to adjust their perceptual attention (directly express the characteristics of the point sample in the result data). If other subsequent node devices do not detect the characteristics of the point sample, but it can be determined from the characteristics of other point samples that the characteristics of the point sample that cannot be detected still belong to the object to be identified, then the characteristics of the point sample that cannot be detected will continue to be expressed in the result data of the current node device and transmitted to other node devices. For example, the previous node device senses the color of the object A to be identified, and the current node device does not sense the color of the object A to be identified. However, it can be determined from the perception data of other node devices that there is an object A to be identified in addition to other objects to be identified. Then the color of the object A to be identified that has not been sensed is still expressed in the result data of the current node device.
[0129] In this embodiment, the method for reporting the characteristics of the point sample for subsequent node devices to adjust perceptual attention is: adjusting the parameters of the data processing model of the subsequent node device according to the characteristics of the point sample provided by the previous node device, so that the subsequent node device improves the computing power for identifying the characteristics of the point sample; or, the subsequent node device uses the perceptual attention model to match the characteristics of the received point sample to adjust the computing power.
[0130] Among them, the above-mentioned "features" have a different meaning from the "feature recognition" in the prior art. The "feature recognition" in the prior art usually refers to information that can determine the identity of the target, while the "feature" of the present invention represents a kind of perceived perception data belonging to the object to be identified, such as coordinates, colors on the object to be identified, etc. The "non-specific feature recognition" of the object to be identified cannot be directly completed by the "features" perceived only at a single point.
[0131] In this embodiment, the method for reporting the characteristics of the point sample for subsequent node devices to adjust perceptual attention is: adjusting the parameters of the data processing model of the subsequent node device according to the result data expressing the characteristics of the point sample provided by the previous node device (in the present invention, the characteristics of the point sample itself are usually not provided, but the characteristics of the point sample are expressed in the result data), or the characteristics of the point sample (that is, the characteristics of the point sample itself), so that the subsequent node device improves the computing power for identifying the characteristics of the point sample; or, the subsequent node device uses the perceptual attention model to match the characteristics of the received point sample or the result data expressing the characteristics of the point sample to adjust the computing power.
[0132] When a node device processes the result data output by several previous node devices, based on the data processing model, when the objects to be identified described by several previous node devices can be determined as the same target through some common point sample features, the point sample features and other information described by each node device are merged into the same target. For example, point sample features in physical spaces that are almost completely overlapped at the same time can be determined to be the same target.
[0133] When the result data received by the node device indicates that the flag used by the current node device to identify the object to be identified before the current node device receives the result data is different from the flag used by other node devices to identify the object to be identified, and the flags assigned by other node devices to the object to be identified are updated, the flag used by the current node device to identify the object to be identified before the current node device receives the result data is converted. Specifically, the method for converting the flag used by the current node device to identify the object to be identified before the current node device receives the result data is:
[0134] The mark used by the current node device to identify the object to be identified before the current reception of result data is replaced with the latest mark assigned to the object to be identified by other node devices; this is a relatively simple implementation method provided by the present invention.
[0135] Alternatively, record the conversion relationship between the flag used by the current node device to identify the object to be identified before the current node device receives the result data and the flag assigned to the object to be identified by other node devices after the update, and perform the conversion when it is necessary to reference the current node device's current reception result data; this is a relatively complex implementation method provided by the present invention.
[0136] Alternatively, the node device deploys a conversion model to perform corresponding conversions on the flags of multiple objects to be identified based on the input original data or result data; this is a more complex implementation method provided by the present invention.
[0137] In the present invention, in order to improve the effectiveness of "non-specific feature recognition", for one or more point samples collected successively by node devices at different collection positions, if the feature values of one or more point samples at different collection positions respectively meet the preset similarity conditions or are determined by a specific model to have a correlation reaching a threshold, and are unique at each collection position, then it is determined that the point samples at different collection positions are associated.
[0138] On the other hand, for one or more point samples collected simultaneously by node devices at different collection positions, if the node devices at different collection positions collect the same spatial field, when there is only one object to be identified in the spatial field, or the collected point sample can correctly point to one of the multiple objects to be identified, then for a certain object to be identified, one or more point samples collected by node devices at different collection positions are related.
[0139] In the present invention, the data acquisition device of the node equipment includes one or several combinations of an image acquisition device, an electromagnetic induction device, a temperature measurement device, a vibration frequency sensing device and a laser radar. The data collected by the above devices (i.e., one or several combinations of the image acquisition device, the electromagnetic induction device, the temperature measurement device, and the vibration frequency sensing device) and the three-dimensional point cloud collected by the laser radar or the point cloud generated according to the images collected by multiple image acquisition devices are jointly calculated to obtain three-dimensional points with data; the image color, contour, line, reflectivity, motion trend, electromagnetic characteristics, temperature, temperature change trend, vibration frequency, and vibration frequency change trend based on two-dimensional perception are used as additional attributes of the corresponding three-dimensional points to form a three-dimensional point cloud with attributes; combined with electromagnetic induction, temperature law, vibration frequency change characteristics, motion correlation (different motion correlations presented by different materials such as ropes and cloth), and reflectivity, the correspondence between each area of the three-dimensional point cloud with attributes and each part or associated parts of the 3D appearance of the object to be identified is determined. This embodiment uses the attributes of the attributed three-dimensional point cloud and their correlation to determine the relationship between each point, the correspondence between each area to which each related point belongs and each part or associated part of the 3D appearance of the object to be identified, so as to more accurately determine the point sample features belonging to the object to be identified and improve the efficiency and accuracy of "non-specific feature recognition".
[0140] The present invention can also obtain the identity information of the object to be identified when necessary during the "non-specific feature identification" process. Specifically, when it is determined that the identity information of the object to be identified needs to be obtained, the identity information acquisition command is triggered, and the identity information acquisition command is used as one of the inputs to participate in the calculation of the result data of the node device, and the node device in the peer computing system that is connected to the barrier-free data collection conditions that can obtain the identity information of the object to be identified responds to the corresponding result data, thereby achieving the acquisition of the identity information of the object to be identified. The acquisition of identity information is also the result of collaborative computing, that is, the acquisition of identity information is triggered by the judgment that the identity information needs to be obtained, rather than an additional trigger through a specific request command. Based on the present invention, if the permission calculation is triggered by a request command, in most cases, it can be completed without obtaining the identity information. In a few cases where it is found that the permission calculation cannot be completed without obtaining the identity information, the judgment that the identity information needs to be obtained is generated according to the implementation requirements. For example, through collaborative computing, it can be known that the identity information of a person exists in the code scanning registration system of several locations, the express pickup registration system of several locations, or the consumption registration system of several locations, and the person is authorized in advance or the query authority is obtained in accordance with the law. Then the peer computing system can drive the node devices connected to these systems in a barrier-free data collection manner, and the relevant information obtained is sent to the peer computing system through each node device to obtain information comparison and provide accurate identity information. Based on this, the present invention can also minimize the possibility of tampering with a system to counterfeit identity.
[0141] Specifically, the peer computing system verifies the authenticity of the identity information of the object to be identified, and then determines its authority; wherein, the node device that can obtain the identity information in the peer computing system may not provide the identity information (it may also provide the identity information according to the implementation requirements), and only expresses the verification result in the result data of the node device according to the verification requirement for the authenticity of the identity information in the received result data. That is, in the present invention, when the node device that can obtain the identity information does not provide the identity information, only expresses the verification result in the result data of the node device according to the verification requirement for the authenticity of the identity information in the received result data.
[0142] When a node device in a peer computing system that can obtain identity information does not provide the identity information, the information source device that drives the identity information is used to establish an encrypted file transmission channel with an input terminal of the node device that needs to obtain the identity information, or to establish an encrypted information transmission channel in other network communication modes; and the identity information is used as one of the inputs of the node device.
[0143] When necessary, in order to meet the needs of other traditional computing modes for raw data, such as the storage of evidence required for traditional evidence, in this embodiment, the node setting can increase the setting of data storage devices for storing the raw data sensed by the sensor.
[0144] During specific implementation, the node device may also be provided with leakage protection and other functions in its power supply device. The node device may also provide various communication interfaces, including optical fiber interfaces, wireless communication interfaces, etc.; it may also provide data interfaces for external storage devices. The node device may be powered by solar energy or city electricity. The node device, if implemented outdoors, may be installed on poles such as street lamps (without the need for a cross arm, mounted on the main pole, or integrated into a lampshade); in pole-free areas, if implemented indoors, it may be wall-mounted or integrated into a suspended ceiling.
[0145] When the present invention is implemented indoors or outdoors, the node devices, as artificial intelligence facilities installed in public spaces, can serve as digital economic infrastructure for urban agglomerations, providing 24-hour uninterrupted seamless coverage. Through collaborative computing across node devices, vehicle identification at any location in the coverage area can be nearly 100% accurate, and the accuracy of location identification is related to the accuracy of the sensor.
[0146] In the architecture of the peer-to-peer computing network of the present invention, all node devices are of the same type and function, and each node device performs real-time and dynamic adjustments to its own data processing model according to the consensus mechanism of the peer-to-peer computing system. The raw data collected by the data acquisition device (including sensors, cameras, etc.) connected to each node device are processed and encrypted by the node device according to its own data processing model to generate byte-level processing and encryption results (i.e., result data), which will be sent to other node devices (the calculation and encryption results output by other node devices received by the current node device at the same time are also one of the raw data collected by the current node device). Therefore, the effect of the raw data perceived by each sensor will be propagated among the peer-to-peer massive node devices according to the power level. If each node device sends its own result data to 100 surrounding node devices, after four units of time, hundreds of millions of node devices will be affected by the events perceived by the sensor. Under this computing model, information is relatively symmetrical and immune to tampering and forgery, which fundamentally solves the fundamental hidden dangers of traditional information technology, namely, false information, forged information, and erroneous information caused by information asymmetry, which then becomes the entry point for fraud and cyber attacks, as well as complex and comprehensive application problems such as long cycle, poor accuracy, and poor adaptability. It truly becomes an information infrastructure for comprehensive management of larger regions and an infrastructure for the digital economy.
[0147] The present invention utilizes the collaborative computing of a peer computing system. When the result data of the collaborative computing can determine a certain event, the discovery of the event is completed. In this embodiment, the discovery of the event by the peer computing system includes the content of the event, the location where the event occurred, and the corresponding response disposal. In a peer computing system, all events are processed synchronously, and it is not necessary to clearly generate interim result outputs such as what event was discovered and what the specific content of the event is. In a peer computing system, only the perception of the sensor and the response of the corresponding execution device are clear, and the other intermediate processes are all processed by collaborative computing at the same time. That is, during the operation of the present invention, the intermediate process of event discovery is imperceptible. As the collaborative computing proceeds, the result data of the node device is obtained, and the corresponding execution device automatically responds and executes.
[0148] In the present invention, each guiding device and display device is used as an execution device, and each of them joins the peer computing system through one or more node devices. To avoid hijacking, the present invention can use multiple node devices to collaboratively control the execution device to further improve the immunity to hijacking attacks. The human-computer interaction device associated with the user is connected to the node device as an access device to submit information interaction service requirements to the peer computing system. In the present invention, information interaction service requirements, display control instructions, and execution control instructions can be regarded as a request command. The response to the request command includes "demand-execution", "request-response" or other different situations. When the result data calculated by one or more node devices in the peer computing system matches the request command, the result corresponding to the request command is represented in the result data output by one or more node devices, according to the preset conditions or the output of the pre-deployed program or the data processing model deployed on the node device. If it is determined based on collaborative computing that the current node device needs to respond to the request command, the current node device will send instructions to the execution device connected to the current node device according to the calculated result data to control the execution device to complete the response action; that is, the "demand-execution" situation. For example, in the present invention, if the display device needs to display virtual data based on collaborative calculation, the current node device will send a display control instruction to the display device connected to the current node device according to the calculated result data to control the display device to display the virtual data. The same applies to the guidance device.
[0149] Based on the collaborative computing of the peer computing system, the execution device can be used as one of the node devices. As the collaborative computing proceeds, when the result data obtained by the execution device can perform related operations corresponding to the request command, the execution device completes the response to the request command. In the present invention, virtual data is represented by result data; the display device receives the result data output by the connected node device, and if a specific element in the result data indicates that the display device needs to display virtual data;
[0150] Alternatively, the result data is used as one of the inputs of the data processing model of the node device, and calculation determines that the corresponding display device needs to display the virtual data, and then the display device displays the corresponding virtual data.
[0151] When the display device is required to display virtual data, the display device combines the result data output by other node devices, calculates its own result data, and controls the display device to display the corresponding virtual data through the obtained result data. In the present invention, the display device does not need to first determine whether it needs to respond, but combines the result data output by other node devices with the perception data collected by its own sensors, inputs its own data processing model, and the output result data is whether the display device displays virtual data.
[0152] In the present invention, the result data obtained by calculation includes the optimal solution of all situations obtained by collaborative calculation based on all users in the display area and the external environment at the current moment; virtual data is displayed through the display device. In the present invention, the results of the calculation of various types of information by the peer computing system are reflected in the result data. All display devices, as one of the node devices, when participating in the collaborative calculation of the peer computing system, their output includes the optimal solution of all situations; furthermore, the display control instructions of all display devices are the optimal solution instructions output by the node devices connected thereto after the collaborative calculation. The present invention does not have the traditional generation instructions and sending instructions, that is, to avoid the security vulnerabilities existing in the generation instructions and sending instructions, making the display device a risk point.
[0153] In this embodiment, the display device is a node device connected to the execution components of specific functions, and the execution feedback information of the execution components of the display device is fed back to the display device respectively to participate in the calculation of subsequent result data of the display device.
[0154] In the present invention, since the display device can be used as one of the node devices, the display device responds and executes based on the calculation results obtained by the collaborative calculation, and the response efficiency is high, avoiding illegal responses such as false execution or non-execution due to network attacks. To avoid hijacking, the present invention can also use multiple node devices to collaboratively control the display device, further improving the immunity to hijacking attacks.
[0155] In the present invention, the functional equipment, guidance equipment and display device for recording travel scripts, offline plots and guide words are the same; when the various scenarios based on the present invention are implemented, the same applies to various controllable mechanical equipment with different functions, such as car transporters, entertainment mechanical equipment, fire-fighting equipment, etc.
[0156] In the present invention, the node device is a data converter or includes a data converter, which converts the various types of sensory data collected into the parameters of the data processing model deployed by itself; further, the peer computing system is a conversion system composed of all data converters, and all input information (including the sensory data collected by each node device, the result data transmitted between the node devices, etc.) are used as the input of the conversion system, and the output of the conversion system is the control instruction of the execution component (actually the result data obtained by a certain node device calculation, and the result data is responded to by the execution component to complete the corresponding response action). Based on this, the data converter on the execution device is equivalent to the neuron of the execution component, and the specific control instruction is generated by the entire conversion system, rather than by a certain execution device as a node device or a certain node device connected to the execution device, so it can be immune to various intrusions and hijackings of existing hackers; at the same time, the conversion system takes all the sensory data and the output of the data converter in the entire monitoring range as input, and the output obtained by conversion includes the control instructions of the execution device and the execution component, which is like using a God's perspective to control the execution device and the execution component within the monitoring range, which can greatly reduce the probability of errors and accidents.
[0157] In the present invention, the data acquisition device, computing unit and data processing model of the data converter are collaboratively designed. As a result, there may be differences in hardware and software between different data converters, especially software differences, that is, different data converters have different data processing models and different model parameters, resulting in different data converters generating different outputs for the same input. Therefore, in the present invention, the data processing model is made to learn to utilize the hardware-specific analog properties of the node device, wherein the data processing model does not need to know the specific hardware-specific analog properties, such as the internal connection method of the node device and the function through which the input and output of the node device are related. Based on this, the present invention provides a behavioral model for simulating backpropagation to obtain gradients to achieve a complete deep learning process, as follows:
[0158] Behavior mode 1: output perturbation, specifically: first, load a random output perturbation vector (composed of random small perturbations) for the output corresponding to each data converter of the data system; then, based on one or a small number of samples, measure the change of the global loss function (if the output of the data converter does not obtain the expected output value (i.e., the result data of the node device), then construct the loss function of the output value and the true value) after using the output perturbation vector; finally, according to the improvement of the loss function, the effect brought by the output perturbation vector is permanently loaded into the output of the data converter in proportion to the scale. The behavior mode based on output perturbation is roughly consistent with back propagation, that is, it roughly follows the gradient.
[0159] Behavior mode 2: input perturbation, specifically: first, generate a random input perturbation vector and perform perturbations on the input of each data converter; then, observe the change of the loss function under a small batch of samples; finally, calculate how to change the output of the data converter to follow the gradient. The behavior mode based on input perturbation is exactly the same as back propagation, that is, it completely follows the gradient.
[0160] In the present invention, a large number of loss functions are used to define the local objectives of different data rotators in the conversion system, and then the conversion system is divided into a large number of small conversion subsystems, and then the behavior pattern of the output disturbance or the input disturbance is used to learn the data processing model of the conversion subsystem.
[0161] In the present invention, a peer-to-peer computing system, i.e., a conversion system, utilizes different types of data acquisition devices (sensors) to collect different types of perception data, i.e., multimodal perception data, in real time, and converts and obtains result data corresponding to the collected perception data (i.e., different types of perception data collected for objects within the monitoring range, and corresponding data outputs, such as control instructions that need to be issued to the execution device, interactive information that needs to be output for specific personnel (travel scripts are also regarded as a type of interactive information), and other processing schemes, and the result data corresponding to the collected perception data includes but is not limited to control instructions, interactive information, etc.).
[0162] The various types of sensory data collected as described above (since the present invention is implemented in the real world, and the real world operates based on various statutory and man-made constraints, in the specific implementation, the sensory data also includes but is not limited to laws and regulations, implementation standards, specifications, and custom constraints, and thus, the result data obtained by calculation can conform to the operating rules of the real world) and the result data corresponding to the collected sensory data are converted into data. Then, the entire peer-to-peer computing system, that is, the conversion system, is a multimodal real-time large model synchronized with reality, which generates travel scripts, controls execution devices, and other effects by outputting data results. Furthermore, the travel script can be obtained by converting the obtained result data using data converters ubiquitously deployed in the monitoring range (which can fully cover the actual scene).
[0163] In a peer-to-peer computing system, the result data obtained and output by the node device can be implemented as a state corresponding to the perceived data (i.e., the original data), which can be represented by a state value. Therefore, the node device does not need to store and send the original data. In this embodiment, the data or elements in the multidimensional matrix are related to the installation location, attributes, etc. of each node device. Therefore, when the result data is transmitted, what is actually transmitted is the transcoding result after multiple sets of parameter transcoding. The so-called multidimensional matrix is actually a combination of multiple sets of parameters. For example, the path of a certain target is from abcd, and the physical position of the abcd node device is fixed, so the sequence of abcd can be expressed by a character or a similar concept when multiple sets of parameters are transcoded and transmitted.
[0164] Based on the technical characteristics of the peer-to-peer computing system, it can be applied to various scenarios that provide targeted services or control for a certain target or event. Based on this, since the result data transmitted between node devices is the result of information processing, rather than the information itself, the collected original data (i.e., perception data) can be stored without storage. The node device only receives the calculation results output by other node devices and sends out its own calculation results. The amount of information contained in a single calculation result is not enough to restore any event and target information. The calculation results on the entire peer-to-peer computing system, the multi-dimensional data matrix elements, and the corresponding relationship between physical space and facilities must be jointly calculated to obtain a definite result. Collaborative computing is less dependent on the information transmitted by a few node devices, which can fundamentally change the nature of traditional informationization that is sensitive to single-point security.
[0165] In the present invention, since the result data output by each node device reflects the state evolution of the result data output by the previous node device, based on the result data received by the current node device, the behavior, attribute, state or event of the target when it is perceived by each previous node device can be inferred. For example, when it is necessary to find the position of target a 15 minutes ago, the position corresponding to the node device where target a is perceived can be obtained at the current moment, and the position of target a can be inferred; then, according to the transmission path of the result data, it can be inferred to 15 minutes ago, and the position of target a 15 minutes ago can be inferred (determined by the node device where target a is perceived); then, the node device does not need to store the original data about target a, that is, based on the present invention, it is not necessary to identify the original data to realize the search for target a, but it is possible to first infer the node device where target a is perceived, and if necessary, obtain the original data about target a at the time when it needs to be searched from the storage device connected to the node device.
[0166] Based on this, the present invention can obtain the target's itinerary through the result data of the accumulated status. If necessary, it can backtrack based on the data results to determine the target's position at a certain time, and find out the completion results of the target for the current link plot in the actual scene and the behavioral results of the target's offline behavior.
[0167] In the present invention, the guiding device receives the result data output by other node devices. The principle is: when the corresponding guiding device needs to present navigation information, if the result data calculated by one or more node devices can determine the guiding device that needs to present navigation information, the corresponding guiding device is added to the node list for transmitting the current result data, and the one or more node devices directly transmit the result data to the guiding device or the node device connected to the guiding device, wherein, according to the preset conditions or algorithm output, model output, the corresponding guiding device is added to the node list for transmitting the result data. Alternatively, the guiding device receives the result data output by other node devices in a layer-by-layer transmission manner. In the process of collaborative calculation of the peer computing system, the node device will also calculate the node list that needs to receive the result data when calculating the result data each time. According to the current result data, one or more guiding devices that need to be added are clearly known and will be added to the node list. The guiding device or the node device connected to the guiding device is directly used as the subsequent node device of the next layer to directly receive the current result data, so as to achieve transcending the normal layer-by-layer transmission and turn the peer computing system into a three-dimensional architecture. For example, the result data of the current node device can clearly know that it needs to be presented to the public security. If the normal layer-by-layer transmission method is used, the result data of the current node device needs at least one or more layers of transmission to be transmitted to the node device corresponding to the public security. If the node device corresponding to the public security is added to the node list, the node device corresponding to the public security can directly receive the result data of the current node device when transmitting at the next layer, which will greatly shorten the processing time and improve the response capability. The present invention adopts a peer-to-peer computing system, so this temporary construction is precisely the advantage of the present invention. The traditional information-based layer-by-layer convergence architecture cannot withstand the complex computing requirements brought about by this temporary network construction.
[0168] In order to save the resource usage of the guidance device, improve the operating efficiency of the guidance device, and enable the guidance device to meet the usage needs of more users, in the present invention, when the result data of the collaborative calculation determines that the travel directions and travel speeds of multiple users are consistent, the distance between the users meets the peer distance standard, and only one of the multiple users submits a navigation requirement or the navigation requirements submitted by multiple users are the same, the multiple users are grouped into a navigation user group. Furthermore, when providing guidance, only one or several of the navigation user group need to be guided to complete the guidance of the entire navigation user group.
[0169] In the present invention, for the selection of the user who provides guidance in the navigation user group, specifically, among the users in the navigation user group, based on the result data of the collaborative calculation, if it is determined that the vision and / or hearing of some users are disturbed by other users, the visual navigation information and / or audio navigation information are displayed preferentially to the user who submitted the navigation request or the frontmost user whose next navigation information of the corresponding user has the correct direction of travel; if the vision and hearing of the user who submitted the navigation request are both disturbed by other users, the visual navigation information or audio navigation information is displayed to other users whose vision or hearing is not disturbed. For example, when two users walk side by side, there is no visual interference between them, but there is auditory interference; when four users walk in a row of two, the front row users cause visual interference to the back row users, but no auditory interference, and there is auditory interference between users in the same row; in specific implementation, the type and presentation method of navigation information can be selected according to the situation determined by the collaborative calculation.
[0170] If the vision and hearing of all users are not disturbed by other users, visual navigation information is displayed to each user and audio navigation information is played to meet the usage needs of each user.
[0171] The above embodiments are only used to illustrate the present invention, and are not used to limit the present invention. As long as they are based on the technical essence of the present invention, changes and modifications to the above embodiments will fall within the scope of the claims of the present invention.
Claims
1. A method for seamlessly customizing script-based tourism products, characterized in that: Different locations of offline actual scenes are used as different plot points, and corresponding offline plots are deployed at the plot points. The travel script covers several plot points, and the offline plots corresponding to the plot points are connected in series to generate a travel script. The method comprises a pre-selection stage, a dynamic customization stage; Pre-selection stage: before traveling, the user selects a travel script, analyzes the travel script, and obtains the itinerary information contained in the travel script; the itinerary information includes but is not limited to transportation, accommodation, entertainment items, attractions, and travel routes; Dynamic customization stage: users travel based on travel scripts and execute corresponding offline plots between plot points and plot points contained in the travel scripts; Identify the user's behavior data at a plot point, between plot points, and / or between a user and a plot point; When the offline plot that the user has not executed is related to the behavior data, based on the influence of the behavior data on the offline plot that the user has not executed, the offline plot that the user has not executed is adaptively modified based on the behavior data, and the corresponding offline plot that the user has not executed is updated, including but not limited to the plot points corresponding to the offline plot that the user has not executed or the offline plots between plot points, thereby completing the dynamic customization of the unexecuted part of the travel script.
2. The method for seamlessly customizing script-based tourism products according to claim 1, characterized in that: Detect environmental factors in actual scenarios, combine the environmental factors, the behavior data of the current user and the behavior data of other users, if the offline plots not executed by the current user or other users are related to the environmental factors, the behavior data of the current user and the behavior data of other users, based on the influence of the environmental factors, the behavior data of the current user and the behavior data of other users on the offline plots not executed by the current user or other users, adaptively modify the offline plots not executed by the current user or other users based on the behavior data, and update the corresponding offline plots not executed by the current user or other users; the environmental factors include but are not limited to the real-time status of plot points, devices and objects between plot points and / or between users and plot points.
3. The method for seamlessly customizing script-based tourism products according to claim 1 or 2, characterized in that: The behavior data include but are not limited to the user's location information, posture data, movement data, language data, and gaze point; It also identifies user-related data, including but not limited to clothing, decorations, children or pets carried, supplies carried for travel, and props used to perform offline plots.
4. The method for seamlessly customizing script-based tourism products according to claim 1 or 2, characterized in that: Build a big language model for generating travel scripts; parse the user's behavior data, generate semantic text that describes the meaning of the behavior data, input the semantic text and the travel script into the big language model, generate a new version of the offline plot that the user has not executed, and replace the previous version of the offline plot that the user has not executed; Alternatively, the behavior data of the current user, the behavior data of other users, and the environmental factors in the actual scenario are parsed to generate semantic text that describes the meaning of the behavior data of the current user, the meaning of the behavior data of other users, and the meaning of the environmental factors in the actual scenario; the semantic text and the travel script of the current user and the travel script of other users are input into the large language model to generate a new version of the offline plot that the current user has not executed, replacing the previous version of the offline plot that the current user has not executed; the new version of the offline plot that the current user has not executed includes the story descriptions of other users and environmental factors that the current user is about to see; wherein, if the same other users and environmental factors are respectively used as story descriptions of offline plots that have not been executed by different users, then in the offline plots that have not been executed by different users, the travel scripts of different users are matched respectively to form corresponding description content.
5. The method for seamlessly customizing script-based tourism products according to claim 4, characterized in that: The manual backend partially adjusts the offline plot that has not been executed by the user, and based on the large language model, generates a new version of the offline plot that has not been executed by the user corresponding to the content of the adjusted part, wherein the new version of the offline plot that has not been executed by the user includes the content of the adjusted part, and the unexecuted part of the offline plot before the content of the adjusted part, or the unexecuted part of the offline plot after the content of the adjusted part.
6. The method for seamlessly customizing script-based tourism products according to claim 1, characterized in that: In the pre-selection stage, after users select a travel script, they do not obtain the corresponding offline plot in advance; In the dynamic customization stage, the corresponding offline plot is output to the user in advance through interaction within a predetermined time before the user executes the offline plot; then, when the corresponding offline plot that the user has not executed is updated, the corresponding offline plot that the user has not executed is updated without the user noticing, thereby completing the dynamic customization of the unexecuted part of the travel script.
7. The method for seamlessly customizing script-based tourism products according to claim 6, characterized in that: When the user is executing the current offline plot and the next offline plot is updated, the guide words for connecting with the next offline plot are automatically written based on the user's completion of the current offline plot. Through narration or the role played by the staff, the user is guided to complete the unfinished part of the current offline plot and connect with the next offline plot.
8. The method for seamlessly customizing script-based tourism products according to claim 1, characterized in that: Set the update rules that trigger the update of offline plots that the user has not executed. When the user's behavior data and the execution results of the offline plots trigger the update rules, the offline plots that the user has not executed will be adapted to the update rules and modified accordingly.
9. The method for seamlessly customizing script-based tourism products according to claim 1, characterized in that: Deploy a peer-to-peer computing system, wherein the monitoring range of the peer-to-peer computing system covers the plot points, the areas between the plot points and / or the areas between the user and the plot points; In the dynamic customization stage, a peer computing system is used for collaborative computing to identify historical events within the monitoring scope, including but not limited to plot points within the monitoring scope, between plot points, between users and plot points, and events that occurred at plot points, between plot points and plot points, and / or between users and plot points; When the offline plot that the user has not executed is related to the behavioral data and historical events, based on the influence of the behavioral data combined with the historical events on the offline plot that the user has not executed, the offline plot that the user has not executed is adaptively modified based on the behavioral data combined with the historical events, and the corresponding offline plot that the user has not executed is updated.
10. The method for seamlessly customizing script-based tourism products according to claim 9, characterized in that: The monitoring scope of the peer-to-peer computing system also covers the areas corresponding to the user's daily activities. Based on the user's authorization, the peer-to-peer computing system is used for collaborative computing to identify events occurring in the user's daily activities. Correspondingly, the historical events also include events occurring in the user's daily activities. When the travel script is related to historical events, in the dynamic customization stage, before the user travels based on the travel script, the travel script is adaptively modified based on the historical events based on the impact of historical events on the travel script to generate a new travel script.
11. The method for seamlessly customizing script-based tourism products according to claim 9, characterized in that: When the plot points corresponding to the offline plots not executed by the user, the events between the plot points, and the events occurring between the user and the plot points are emergency events, when the offline plots not executed by the user are adaptively modified, the updated offline plots not executed by the user delete the plot points corresponding to the location of the emergency event and the corresponding part of the offline plots.
12. The method for seamlessly customizing script-based tourism products according to claim 9, characterized in that: Pre-set several different script styles, set several different offline plots corresponding to different script styles, and deploy them at corresponding plot points; The monitoring scope of the peer-to-peer computing system also covers the area corresponding to the user's daily activities. Based on the user's authorization, the peer-to-peer computing system is used for collaborative computing to identify events occurring in the user's daily activities and / or obtain the user's preference information, which is obtained by analyzing, including but not limited to, analyzing the user's reading content, game content, and information browsing content; In the pre-selection stage, based on the events that occur in the user's daily activities and / or the user's preference information, at least one script style, transportation, accommodation plan, attractions, and travel route are predicted and selected, and several default scripts are generated accordingly, and sorted and listed according to the degree of matching; The user selects the default script as the pre-selected travel script, or edits the default script to determine and generate the pre-selected travel script.
13. The method for seamlessly customizing script-based tourism products according to claim 1, characterized in that: Several travel scenarios are set up, and different plot points are deployed corresponding to different travel scenarios; in the pre-selection stage, after the user selects the customized conditions, at least one travel script is generated, and the customized conditions include but are not limited to travel scenarios, transportation, food and accommodation plans, and entertainment items; when generating the travel script, selection reference information is also output, and the selection reference information is not limited to transportation, food and accommodation plans, entertainment items, types of entertainment attractions, prices and optional time; after the user selects the travel script, the pre-selection is completed.
14. The method for seamlessly customizing script-based tourism products according to claim 13, characterized in that: In the pre-selection stage, the user first selects the tourist attractions, and then generates at least one travel script based on the plot points corresponding to the tourist attractions and the deployed offline plots, combined with the customized conditions selected by the user.
15. The method for seamlessly customizing script-based tourism products according to claim 1, characterized in that: When users execute the travel script, they play the game online and offline simultaneously, which includes online and offline parts; Online part: Create online virtual scenes corresponding to offline actual scenes, identify users, objects, and facilities in offline actual scenes, and display them as online players, objects, and facilities in online virtual scenes; set up game plots based on virtual scenes, and deploy game plots corresponding to offline plot points and offline plots; Offline part: When a user enters a plot point, the user is identified and located at the plot point; Based on the user's location, activate the current segment plot for the user at the location set by the plot point; The next part of the plot for the user is determined according to the completion result of the user for the current part of the plot in the plot point.
16. The method for seamlessly customizing script-based tourism products according to claim 15, characterized in that: Detect environmental factors in the plot point, combine the current user's completion results for the current plot point, other offline users' completion results for other users' plot points, other online players' completion results for the game plot in the virtual scene, and environmental factors in the plot point, and determine the next plot point for the current user; The current plot of the user is determined based on the user's route in the plot point and the completion of the user's historical plots on the route.
17. The method for seamlessly customizing script-based tourism products according to claim 16, characterized in that: In the online part, virtual characters are set, and character attributes are set for the corresponding virtual characters. Online players select virtual characters to play; in the offline part, users correspond to online players and form associations with virtual characters; According to the completion result of the user for the current plot in the plot point, the impact on the role attributes of the virtual character associated with the user is determined, the role attributes are modified according to preset rules, and the role attributes of the virtual character played by the online player are modified in an associated manner; or, when the online player plays an online game, the role attributes of the virtual character played by the online player are modified based on the process of the online game.
18. The method for seamlessly customizing script-based tourism products according to claim 17, characterized in that: Users can also influence the character attributes corresponding to the virtual character associated with the user through offline behaviors outside of the plot points, and modify the character attributes according to preset rules; Identify the offline behavior of the user, obtain the behavior result of the offline behavior, and convert the behavior result into corresponding role attributes according to preset rules.
19. The method for seamlessly customizing script-based tourism products according to claim 15, characterized in that: At the location of the offline plot setting, the staff plays the role of the story for the user's current segment plot; the staff receives the role-playing task and the user's photo or feature description in real time, wherein the role-playing task is the user's current segment plot; Through voice-over commentary and the roles played by staff, the same user is given different identities for different other users; By issuing task plots to users, the users perform actions in coordination with other characters' plots according to the task plots, and combining them with different story lines or link plots contained in the offline plots, other users who interact with them are guided to the corresponding locations; or, in response to other users who are about to arrive at their location, the current link plots of the other users corresponding to the location are adjusted to guide the other users to the corresponding locations; The interaction process and results between users and staff, and between users, are added to the offline plot. After automatic or semi-automatic review, the offline plot is adjusted. All users in the plot point determine the future plot based on the latest offline plot. Based on the latest offline plot, if different users will meet in the future plot at the location set in the offline plot, automatic or semi-automatic plot editing will be performed for the corresponding different users to obtain matching connecting plots, and the corresponding future plots of the different users will be connected using the connecting plots.
20. The method for seamlessly customizing script-based tourism products according to claim 19, characterized in that: According to the congestion level of offline plot points, the density of route demand, the occupancy and distribution of entertainment and consumption facilities, and combined with the offline plot schedule of each user, the offline plot is dynamically adjusted, including adding or deleting plot segments or adjusting the difficulty, so that the number of users at each location in the plot point matches the offline plot.
21. The method for seamlessly customizing script-based tourism products according to claim 15, characterized in that: Navigate the user on foot at offline plot points, as follows: Obtaining the user's navigation needs and the user's location information; calculating the user's next navigation information based on the navigation needs and the user's real-time location information; specifically, obtaining the user's travel direction data, travel speed data, and posture action data, using a prediction model pre-trained under preset conditions or through machine learning to predict the user's next action, including the user's travel direction and travel speed, and presenting the user's next navigation information on a guidance device at a location that matches the predicted user's next travel direction and travel speed; The navigation information is presented by a guidance device at a location corresponding to the user's real-time location information, and is used to guide the user.
22. The method for seamlessly customizing script-based tourism products according to claim 21, characterized in that: Obtain the user's height data, leg length data, and step frequency data to calculate the user's walking speed; if the prediction of the user's next action is inaccurate, the measured walking speed will replace the predicted walking speed; Based on the user's real-time direction and speed data, the guidance device that presents the user's next navigation information is corrected, and the density of people around the user, environmental information, and the direction, speed, and posture data of people around the user are used as training samples and added to the sample library for further training and adjustment of the prediction model.
23. The method for seamlessly customizing script-based tourism products according to claim 21, characterized in that: The guidance device includes a visual information display device and / or an audio playback device; The visual information display device is used to display visual navigation information; it obtains the user's real-time moving direction data and moving speed data, follows the user's moving direction and moving speed, and maintains the visual information display device at a certain distance from the user in the user's moving direction to display the user's next visual navigation information; Alternatively, based on the navigation needs of the user and the real-time location information of the user, a visual information display device matching the location where each user needs to display visual navigation information in the next step is obtained; and relative to the real-time location information and real-time travel speed of the user, the visual information display device is kept at a certain distance from the user to display the visual navigation information for the user's next step; The audio playback device is used to play the audio navigation information; obtain the user's real-time location information and travel speed data, follow the user's location and travel speed, keep the audio playback device at the user's location covered by the sound field, and play the user's next audio navigation information; Alternatively, based on the navigation needs of the user and the real-time location information of the user, an audio playback device matching the location where each user needs to play the audio navigation information next is obtained; And relative to the user's real-time location information and real-time travel speed, the audio playback device maintains the sound field covering the user's position and plays the user's next audio navigation information.
24. The method for seamlessly customizing script-based tourism products according to claim 21, characterized in that: By deploying corresponding types of sensors in the channel and covering the channel, the physical attributes of users in the channel are obtained, the navigation needs of users are obtained through human-computer interaction devices associated with the users, and the next step navigation information for each user is obtained.
25. The method for seamlessly customizing script-based tourism products according to any one of claims 7 to 24, characterized in that: The peer-to-peer computing system performs non-specific feature recognition and location recognition on a target, wherein the target includes a user and other fixed or mobile objects other than the user; The peer-to-peer computing system includes multiple node devices, and there is no primary-secondary relationship between all node devices; the node devices are provided with data acquisition devices and computing modules, and the data acquisition devices include at least one type of sensor for collecting perception data of different corresponding types; the node devices arranged at different collection positions collect at least one point sample of the target, and the point sample is the perception data of the corresponding sensor type; For a certain node device, the collected perception data is processed to obtain result data, and the result data is transmitted to other node devices; other node devices that receive the result data use the result data as one of the collected original data, and influence the result data of other node devices through the result data; based on this, without the need to obtain the identity information of the target, multiple node devices in the peer computing system perform collaborative computing, determine each unique target as itself, realize non-specific feature recognition, and perform location recognition on the target to obtain the location information of the target; It also enables the discovery of the user's completion results of the current plot in the actual scenario and the behavioral results of the user's offline behavior.
26. The method for seamlessly customizing script-based tourism products according to claim 25, characterized in that: The current node device receives the result data output by other node devices; for the current node device, the collected perception data is combined with the result data from other node devices, the result data of the current node device is calculated and sent to other node devices; The node devices in the peer-to-peer computing system perform collaborative computing as the perception data is collected and the result data is calculated.
Citation Information
Patent Citations
Tourism information generation method and device, storage medium and processor
CN110807147A
Hotspot-based tourism product matching method, system and equipment and storage medium
CN114881722A