A virtual-real fusion information interaction system and method based on space calculation

Abstract

The application discloses a kind of virtual-real fusion information interaction system and method based on space calculation, including space digitization module generates the high-precision point cloud map and semantic map of target physical space and uploads cloud end;Cloud platform stores map, edits and distributes binding virtual professional content;User terminal realizes space orientation, augmented reality AR rendering and natural interaction;Game module creates interactive task;Artificial intelligence AI module provides personalized guide and exchange;Privacy protection module encrypts the evidence of ability proof data and stores it in evidence.It belongs to the technical field of computer vision, human-computer interaction and information service, and the structure can anchor virtual professional content on real coordinates through space calculation technology, and present to users with the help of AR equipment, combined with game task and AI guide, realize situational exploration, ability verification, social connection New generation of job-seeking experience.

Description

Technical Field

[0001] This invention relates to the fields of computer vision, human-computer interaction and information services, and in particular to the application of spatial computing technology in information services. Background Technology

[0002] With the deepening of digital transformation, offline physical spaces such as exhibition halls, shopping malls, schools, and job fairs are gradually becoming important places for information exchange.

[0003] However, traditional information presentation methods mainly rely on two-dimensional physical media (such as display boards, brochures, and roll-up banners), which face the following technical bottlenecks when dealing with high-concurrency user groups and massive amounts of dynamic information: (1) Inefficient information distribution: The information carrying capacity of physical media is fixed and cannot be dynamically adapted according to individual user differences.

[0004] Within a limited time and space, users can only passively receive static information that is identical to everyone else, making it difficult to efficiently obtain content that matches their needs.

[0005] (2) Insufficient interaction depth: The relationship between users and information is one-way browsing, lacking a two-way interaction mechanism.

[0006] The system is unable to convert user browsing behavior (such as dwell time and focus of attention) into structured data that can be analyzed and fed back, which prevents information push from being dynamically optimized.

[0007] (3) Limited space utilization: The value of physical space is mainly reflected in its geographical and social attributes, while the programmability and updability of information are lacking.

[0008] It is difficult to quickly adjust information content to adapt to changing needs when in the same space at different times and when facing different groups of people.

[0009] (4) Lack of ability verification: In some specific scenarios (such as job fairs and educational training), users’ ability demonstrations rely on static materials submitted after the fact (such as resumes and certificates), lacking real-time behavioral data that can be reliably stored as verification basis.

[0010] Taking offline job fairs in the human resources field as an example, the aforementioned technological bottlenecks are particularly prominent: job seekers, faced with hundreds of companies, can only skim through the exhibition boards; companies cannot know which job seekers are interested in them; and the initial intentions of both parties cannot be effectively recorded and verified on-site. This makes the traditional form of job fairs inefficient and unable to meet the needs of modern human resources services.

[0011] Therefore, how to achieve personalized information distribution, in-depth interaction, and reliable collection and storage of user behavior data under concurrent access by multiple users while maintaining the social attributes and authentic experience of physical space is a technical problem that urgently needs to be solved in this field. Summary of the Invention

[0012] The purpose of this invention is to provide a virtual-real fusion information interaction system and method based on spatial computing, which can anchor virtual professional content to real coordinates through spatial computing technology and present it to users with the help of AR devices. Combined with gamified tasks and AI guidance, it realizes a new generation of job search experience with contextualized exploration, ability verification and social connection. Moreover, it has a simple structure and is easy to use, so as to solve the problems mentioned in the background technology.

[0013] To achieve the above objectives, the present invention provides the following technical solution: A virtual-real fusion information interaction system based on spatial computing includes a spatial digitization module, a cloud-based spatial computing and content management platform, a user terminal, a gamified task and capability verification module, an AI intelligent agent guidance and matching module, and a privacy protection and data storage module. The spatial digitization module generates high-precision point cloud maps and semantic maps of the target physical space and uploads them to the cloud. The cloud platform stores the maps, edits and binds virtual professional content, and distributes it. The user terminal realizes spatial positioning, AR rendering, and natural interaction. The gamification module creates interactive tasks. The AI ​​module provides personalized guidance and communication. The privacy protection module encrypts and stores capability verification data.

[0014] By adopting the above technical solutions and integrating six core modules, a virtual-real fusion information interaction framework based on spatial computing is built, realizing full-process support from the digitization of target physical space and virtual occupational content management to immersive user interaction, task verification, personalized guidance and data security storage, providing a complete and systematic technical carrier for occupational information exploration.

[0015] As a further aspect of the present invention: the spatial digitization module for performing three-dimensional scanning of the target physical space and identifying feature points, planes and semantic regions is deployed on a mobile scanning terminal and in the cloud. The spatial digitization module generates the high-precision point cloud map and semantic map, and uploads the map to the cloud spatial database.

[0016] By adopting the above technical solutions, the deployment location of the spatial digitization module is clarified, and its core processes of 3D scanning, feature recognition, map generation and uploading are standardized. This ensures that the generated high-precision point cloud map and semantic map can be stably uploaded to the cloud spatial database, providing accurate basic data support for the spatial positioning and AR rendering of the entire system.

[0017] As a further aspect of the present invention: the cloud-based spatial computing and content management platform includes: a spatial database that stores point cloud maps, semantic tags, and coordinate system information of the scanned space; a virtual content editor that allows administrators and enterprise customers to drag, place, and bind various virtual professional content objects on the digital twin model; and a content persistence storage and distribution engine that stores virtual scenes and their binding relationships with spatial coordinates, and distributes virtual content data streams in real time upon user request.

[0018] By adopting the above technical solutions, the internal composition and functions of each component of the cloud-based spatial computing and content management platform are refined, enabling the storage of spatial map data, convenient editing and binding of virtual professional content, and persistent storage and real-time distribution of virtual scenes, thus ensuring the cloud's core control and content supply capabilities over the entire system.

[0019] As a further aspect of the present invention: the user terminal is an AR device with spatial awareness capabilities, and has built-in: a local synchronous positioning and mapping (SLAM) module for real-time capture of environmental features and matching with cloud maps to achieve centimeter-level indoor positioning; an AR rendering engine that calls and renders virtual content based on the user's position and viewpoint, and overlays it onto the corresponding coordinates in the real world; and a natural human-computer interaction interface that supports interaction with virtual content through gesture recognition, voice commands, gaze tracking, and other means.

[0020] By adopting the above technical solutions, the device type and built-in core components of the user terminal are clearly defined, enabling centimeter-level precise positioning of users in physical space, accurate overlay rendering of virtual content and real environment, and natural and convenient multi-mode interaction between users and virtual content, thus ensuring the implementation of the user's immersive exploration experience.

[0021] As a further aspect of the present invention: the gamified task and ability verification module is deployed in the cloud and is used to create and manage interactive tasks bound to virtual content. The interactive tasks include timed knowledge quizzes in front of a company's virtual booth and mini-project challenges in simulated work scenarios in specific areas. After the user completes the task, the result data is encrypted and uploaded.

[0022] By adopting the above technical solutions, the deployment locations of gamified tasks and ability verification modules are clarified, the creation, management, and processing of task result data of interactive tasks are standardized, the user's enthusiasm for exploration is enhanced through diversified interactive tasks, and the standardized collection and encrypted uploading of user ability-related data are achieved.

[0023] As a further aspect of the present invention: the AI ​​intelligent agent navigation and matching module includes: a personal job search AI assistant, which generates a virtual image based on user profiles and historical behavior, and provides personalized exploration path suggestions and key content introductions; and a corporate virtual recruiter, which is an AI-driven virtual character that answers preset questions, conducts preliminary exchanges, and collects user intentions.

[0024] By adopting the above technical solutions, the internal composition of the AI ​​intelligent agent guidance and matching module is refined. Through the collaborative effect of personal job search AI assistant and corporate virtual recruiter, personalized exploration guidance is provided to users. At the same time, an initial communication bridge is built between users and enterprises, realizing the personalization and precision of career exploration.

[0025] This invention also discloses a spatial computing-based virtual-real fusion information interaction method according to the above-mentioned spatial computing-based virtual-real fusion information interaction system, comprising the following steps: S1: Perform 3D scanning and semantic annotation of the target physical space, generate a point cloud map with semantic labels, and store it in the cloud; S2: Bind at least one virtual information object to specific coordinates of the point cloud map according to semantic tags to generate virtual-real fusion scene data; S3: In response to the user terminal's entry request, capture the feature information of the user's environment in real time, match it with the point cloud map, and determine the user's precise location and orientation; S4: Based on the location and orientation, retrieve the corresponding virtual information object from the cloud and render and overlay it onto the user terminal's real environment view; S5: Capture the user's interaction instructions with the virtual information object, generate and execute the associated enhanced interaction task, and collect the user's behavioral data generated during the interaction; S6: Encrypt and store the behavioral data to generate a verifiable digital certificate, and upload it to the cloud for verification by the authorized party.

[0026] By adopting the above technical solutions, a complete occupational information exploration method based on the aforementioned system is provided. Through the orderly connection of six steps, the entire process from spatial digitization and virtual scene construction to user entry positioning, immersive rendering, contextualized interaction, and data closed-loop accumulation is realized, ensuring that the system functions can be effectively executed.

[0027] As a further aspect of the present invention: in S1, a mobile device equipped with a scanning component is used to perform a three-dimensional scan of the target physical space, and the semantic tags include the identification information corresponding to the entrance area, information desk, corridor, rest area and industry zone.

[0028] By adopting the above technical solution, the specific implementation methods of the spatial digitization steps in the method are refined, the scanning device types and the specific coverage of semantic tags are clarified, the operability of spatial scanning and the practicality of semantic maps are ensured, and accurate spatial identification support is provided for subsequent virtual content binding.

[0029] As a further aspect of the present invention: when the virtual information object in S2 is applied to a human resources service scenario, it includes career-related content such as 3D corporate logo, job information display board, interactive challenge task points, and virtual interviewer role.

[0030] By adopting the above technical solutions, the core content of the virtual scene editing steps in the method is refined, the specific types of enterprise virtual content are clarified, the richness and relevance of virtual scenes are ensured, and users are provided with a comprehensive and intuitive display of professional information, thereby enhancing the exploration experience.

[0031] As a further aspect of the present invention: In step S6, the user's capability proof data is encrypted and stored using blockchain or trusted computing technology to generate an immutable digital capability certificate. The capability proof data includes challenge task scores, completion time, and interaction behavior records, which can be viewed and verified by interested enterprise users after authorization.

[0032] By adopting the above technical solutions, the specific implementation methods of data closure and value accumulation steps in the method are refined, the technical means of data encryption and notarization, the specific scope of capability proof data and data usage rights are clarified, user data security is guaranteed, and the verifiability and authority of capability proof are achieved at the same time.

[0033] Compared with the prior art, the beneficial effects of the present invention are: This invention transforms physical space into a programmable digital twin model through a spatial digitization module, and combines it with a cloud-based content management platform to achieve precise binding between virtual information and physical coordinates. Compared with traditional physical media, the information carrying capacity per unit space is liberated from the area limitation of physical display boards, achieving an exponential increase. At the same time, through the intelligent navigation module, exploration paths are recommended in real time based on user profiles, realizing multi-user concurrent and personalized distribution of spatial information, solving the technical problem of information being uniform for everyone in the traditional model. This invention binds users' natural interactive behaviors (such as gaze, gestures, and voice) to preset interactive tasks through an interaction enhancement module, transforming the user's exploration process into quantifiable and analyzable structured behavioral data. This data can not only be used to optimize recommendation strategies in real time, but also provide data support for subsequent accurate matching and scenario iteration, realizing a technological leap from one-way browsing to two-way interaction and then to data closure. This invention uses a data storage module, combined with blockchain or trusted computing technology, to encrypt and store the capability proof data generated by users during interaction, generating tamper-proof and verifiable digital credentials. This mechanism upgrades the demonstration of users' capabilities from traditional subjective statements to credible storage of objective behavioral data, solving the technical bottlenecks of difficult capability verification and low data credibility in offline scenarios. Because the virtual content is loosely coupled with the physical coordinates, this invention supports the rapid switching of virtual content in the same physical space at different times and for different groups of people. For example, the same convention center can be used for a job fair in the morning and switched to a product launch in the afternoon without changing the physical layout, which greatly improves the efficiency of space utilization and the flexibility of scene deployment.

[0034] Other features and advantages of the present invention will be disclosed in detail in the following detailed description and accompanying drawings. Attached Figure Description

[0035] Figure 1 This is a schematic diagram of the overall structure of a virtual-real fusion information interaction system based on spatial computing in an embodiment of the present invention. Detailed Implementation

[0036] The technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments.

[0037] Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0038] In this embodiment of the invention, a virtual-real fusion information interaction system and method based on spatial computing is described below. Figure 1 As shown, it includes: 1. Spatial digitization module: Deployed on mobile scanning terminals or in the cloud.

[0039] It is used to perform 3D scanning of target physical spaces, identify their feature points, planes and semantic regions, such as entrance areas, information desks, corridors and rest areas, generate high-precision spatial point cloud maps and semantic maps, and upload the maps to cloud spatial databases.

[0040] 2. Cloud-based spatial computing and content management platform: Spatial database: Stores point cloud maps, semantic labels, and coordinate system information for all scanned spaces.

[0041] Virtual Content Editor: Allows administrators or enterprise clients to drag, place, and bind various virtual professional content objects, such as 3D company logos, information boards, interactive challenge task points, and virtual NPC locations, on the digital twin model of the space.

[0042] Content persistent storage and distribution engine: Stores the edited virtual scene and its binding relationship with spatial coordinates, and distributes the corresponding virtual content data stream in real time when the user requests it.

[0043] 3. User terminal: AR devices with spatial awareness capabilities, including but not limited to AR glasses, smartphones or tablets with depth cameras.

[0044] Its built-in features include: Local SLAM and spatial positioning module: Captures surrounding environmental features in real time and matches them with spatial maps downloaded from the cloud to achieve indoor positioning with centimeter-level accuracy, determining the user's exact location and orientation in space.

[0045] AR rendering engine: Based on the user's position and perspective, it calls and renders corresponding virtual content from the cloud, accurately and stably overlaying the virtual content onto the corresponding coordinates in the real world.

[0046] Natural human-computer interaction interface: Supports interaction with virtual content through gesture recognition, voice commands, gaze tracking and other methods.

[0047] 4. Gamified tasks and ability verification module: Deployed in the cloud.

[0048] Used for creating and managing interactive tasks tied to virtual content, such as: A timed knowledge quiz is triggered in front of the company's virtual booth.

[0049] In a specific area, launch a mini-project challenge that simulates a work scenario (such as writing a piece of code or designing a sketch).

[0050] After the user completes the task, the result data is uploaded in encrypted form.

[0051] 5. AI-powered intelligent agent navigation and matching module: Personal job search AI assistant: Based on user profiles and historical behavior, a virtual avatar is generated to provide users with personalized exploration path suggestions and key information in an AR view.

[0052] Virtual recruiters: AI-driven virtual characters that answer pre-set questions, conduct initial conversations, and collect user interest.

[0053] 6. Privacy Protection and Data Storage Module: Based on blockchain or trusted computing technology, the module encrypts and stores verifiable capability proof data generated by users during the exploration process, such as challenge task scores and completion times, generating tamper-proof digital capability credentials that users can display to potential companies after authorization.

[0054] See Figure 1 In one feasible embodiment, the specific implementation of each module is as follows, which together realize the immersive exploration function of occupational information.

[0055] 1. Spatial Digitization Module: This module is deployed on mobile scanning terminals and in the cloud. In actual use, the mobile scanning terminal performs a comprehensive 3D scan of the target physical space, such as corporate office areas and professional experience areas. During the scanning process, it automatically identifies feature points, planes, and various semantic regions within the space. Based on the information obtained from the scan, it generates high-precision point cloud maps and semantic maps. After generation, the two types of maps are simultaneously uploaded to the cloud spatial database, providing accurate basic spatial data support for subsequent functions such as spatial positioning and AR rendering, ensuring the accurate correspondence between virtual content and real space.

[0056] 2. Cloud-based Spatial Computing and Content Management Platform: This platform is the core control and content supply center of the entire system, comprising three core components. The spatial database stores point cloud maps, semantic tags, and coordinate system information for all scanned physical spaces, enabling centralized management and rapid retrieval of spatial data. The virtual content editor provides administrators and enterprise clients with a user-friendly interface, allowing them to bind various virtual professional content objects to digital maps through simple drag-and-drop operations on the system's digital twin model, achieving personalized editing of virtual scenes. The persistent content storage and distribution engine stores the edited virtual scenes and their binding relationships with spatial coordinates. When a user initiates an exploration request, the corresponding virtual content data stream is distributed to the user's terminal in real time, ensuring a smooth user experience.

[0057] 3. User Terminal: This terminal uses an AR device with spatial awareness capabilities, and has three core functional components built-in, serving as the direct carrier for users to achieve immersive exploration. The local synchronous positioning and mapping (SLAM) and spatial positioning modules can capture the feature information of the user's physical environment in real time and quickly match it with maps in the cloud spatial database, achieving centimeter-level indoor positioning and ensuring the accuracy of user location recognition. The AR rendering engine, based on the user's location information and current perspective obtained from the positioning, calls up virtual content distributed from the cloud and accurately overlays and renders the virtual content onto the corresponding coordinates in the real world, achieving a seamless integration of virtual content and the real environment. The natural human-computer interaction interface supports multiple interaction methods. Users can interact with virtual content through natural methods such as gesture recognition, voice commands, and gaze tracking, such as viewing job details and triggering interactive tasks.

[0058] 4. Gamified Tasks and Ability Verification Module: This module is deployed in the cloud and is mainly used to create and manage various interactive tasks bound to virtual content. The types of interactive tasks include timed knowledge quizzes in front of a company's virtual booth and mini-project challenges in simulated work scenarios in specific areas. The gamified design enhances users' enthusiasm for exploration. When users complete the corresponding interactive tasks, the system will automatically record the task results data, encrypt them, and upload them to the cloud to provide data support for subsequent user ability verification.

[0059] 5. AI Intelligent Agent Navigation and Matching Module: This module utilizes the collaborative efforts of two AI roles to achieve personalized navigation and career matching functions. The personal job-seeking AI assistant generates a unique virtual avatar based on the user's registered personal information, interests, and historical exploration behavior. It also provides users with personalized exploration path suggestions, highlighting career content that the user may be interested in, thus improving exploration efficiency. The virtual corporate recruiter is an AI-driven virtual character with built-in preset questions and response logic related to companies. It can answer users' questions about company recruitment, career requirements, and other related matters in real time, while also engaging in initial communication with users to collect their job-seeking intentions, laying the foundation for accurate matching between companies and users in the future.

[0060] 6. Privacy Protection and Data Storage Module: This module runs throughout the entire system. Its core function is to securely protect and encrypt the ability verification data generated by users during exploration. This is achieved through blockchain or trusted computing technologies, generating immutable digital ability credentials. Ability verification data mainly includes user scores for completing interactive tasks, task completion times, and various interactive behavior records. Viewing permissions for this data are controlled by the user, who can authorize interested companies to view it. This ensures both user data privacy and the authority and verifiability of user ability verification.

[0061] This invention also provides a virtual-real fusion information interaction method based on spatial computing, comprising the following steps: S1: Spatial Digitization: Using scanning equipment to perform three-dimensional scanning of the target physical space and construct a cloud-based digital map with semantic labels.

[0062] S2: Virtual Scene Editing: On the cloud platform, the enterprise's virtual content is bound to specific coordinates and semantic areas of the digital map to form a complete career exploration virtual scene. The virtual content includes information, tasks, and roles.

[0063] S3: User Entry and Spatial Positioning: When a user enters the physical space wearing an AR device, the device activates local SLAM to capture environmental features in real time and upload them to the cloud.

[0064] The cloud determines the user's location through feature matching and sends out virtual scene data packets related to that location.

[0065] S4: Immersive Rendering and Presentation: The AR rendering engine on the user terminal accurately overlays and renders the received virtual content onto the corresponding position in the real environment according to the user's perspective. The user can view an augmented world that integrates rich professional information through AR devices.

[0066] S5: Contextualized Interaction and Exploration: Users move through physical space and explore virtual content in different areas.

[0067] Interact with virtual objects in a natural way: view details, accept and complete gamified challenges, and converse with an AI virtual recruiter.

[0068] S6: Data closed loop and value accumulation: The system records the user's anonymous exploration behavior, interaction data and task completion results throughout the entire process.

[0069] After processing and analysis, this data can be used to optimize personalized recommendations for users (AI assistant), and with user authorization, it can be used to create a dynamic and verifiable capability exploration profile, serving as a powerful supplement to traditional resumes.

[0070] In one feasible embodiment, the specific implementation of each step is as follows: S1: Implementation of spatial digitalization.

[0071] Using mobile devices equipped with scanning components, a comprehensive 3D scan of the target physical space is performed. During the scanning process, various areas within the space are identified simultaneously, and corresponding semantic tags are added to these areas. These semantic tags include identification information for the entrance area, information desk, corridor, rest area, and industry zones. Based on the scan data and semantic tags, a cloud-based digital map with semantic tags is constructed, completing the digital transformation of the target physical space and providing a precise spatial foundation for the subsequent construction of virtual scenes.

[0072] S2: Virtual scene editing and implementation.

[0073] Administrators or enterprise clients can use the virtual content editor of the cloud-based spatial computing and content management platform to bind various types of enterprise virtual content to specific coordinates and semantic regions of the digital map built in S1, thus forming a complete virtual scenario for career exploration.

[0074] Specifically, the virtual content for enterprises includes 3D enterprise logos, information display boards, interactive challenge task points, virtual NPC locations, and enterprise-related information data, ensuring that the virtual scene can comprehensively and intuitively display enterprise and professional information.

[0075] S3: User entry and spatial positioning implementation.

[0076] When a user wears an AR device with spatial awareness capabilities and enters a digitized physical space, the AR device automatically activates its local SLAM component to capture the feature information of the current environment in real time. The captured feature information is then uploaded to a cloud-based spatial computing and content management platform. The cloud platform quickly matches the user's uploaded environmental features with the spatial map in its database to accurately determine the user's current location. Subsequently, the virtual scene data package corresponding to that location is sent to the user's terminal, completing the user's entry and spatial positioning, ensuring that the user can see the virtual content at the corresponding location.

[0077] S4: Immersive rendering and presentation implementation.

[0078] After the user terminal receives the virtual scene data packet sent from the cloud, the AR rendering engine calls up the virtual content in the data packet according to the user's current location information and viewing angle, and accurately overlays and renders the virtual content on the corresponding coordinates in the real world, realizing the seamless integration of virtual content and real environment. Users can intuitively see virtual professional information, company displays and other content through AR devices.

[0079] S5: Contextualized Interaction and Exploration Implementation.

[0080] In an immersive virtual environment, users can freely move and explore various virtual contents. They can also interact with the virtual contents through the natural human-computer interaction interface built into the user terminal, using natural interaction methods such as gesture recognition, voice commands, and gaze tracking. For example, they can click on information panels to view job details, communicate with virtual recruiters from companies, and participate in gamified interactive tasks, thus achieving contextualized career exploration and gaining a deeper understanding of job-related information.

[0081] S6: Implementation of data closed loop and value accumulation.

[0082] During user exploration and interaction, the system records user behavior data and the completion results of interactive tasks in real time, uploading this data to a cloud platform. Based on this data, the cloud platform optimizes personalized recommendations for users, providing more accurate guidance for their subsequent exploration. Simultaneously, through blockchain or trusted computing technology, the system encrypts and stores user capability verification data, generating tamper-proof digital capability credentials. The capability verification data specifically includes the user's score for completing challenge tasks, completion time, and various interactive behavior records. Users can authorize potential companies to view this digital capability credential, achieving closed-loop utilization and value accumulation of data, while providing reliable capability references for users seeking employment and companies recruiting.

[0083] In one feasible embodiment, an intelligent navigation module is also included, deployed in the cloud, configured to generate personalized exploration paths based on user profiles and historical behavior data, and provide users with real-time navigation and content recommendations through virtual avatars.

[0084] In one feasible embodiment, the following is included: A city deployed the system of this invention at a large-scale job fair held at the convention center.

[0085] 1. Pre-meeting arrangements: Staff used a mobile robot equipped with LiDAR and RGB cameras to scan the entire hall of the convention center.

[0086] A high-precision digital map is generated in the cloud and divided into semantic areas such as Internet technology zone, financial and commercial zone, and intelligent manufacturing zone.

[0087] Technology Company A used a cloud-based content editor to place its 3D logo, an interactive virtual product showcase, and an entry icon for an algorithm challenge at the corresponding coordinates of its booth in the Internet Technology Zone. Simultaneously, an AI virtual recruiter, "Xiao A," was also positioned in that area.

[0088] 2. User experience during the meeting: Job seeker Xiao Wang entered the lobby wearing lightweight AR glasses. The glasses were activated and instantly located him. In his field of vision, clear virtual road signs and zone indicators appeared in the previously empty corridor.

[0089] His personal AI assistant appeared in the corner of his field of vision and gave a voice prompt: "We have detected that your background is software development. We recommend that you explore the Internet Technology Zone first. There are currently 12 highly matching companies, 3 of which have technical challenges."

[0090] As Xiao Wang walked towards the Internet Technology Zone, he saw Company A's cool 3D logo floating above its actual booth from afar. Upon approaching, he triggered an algorithm challenge by gazing at it. A programming interface appeared inside his glasses, and he used the connected Bluetooth keyboard to complete a basic algorithm problem within 5 minutes.

[0091] Upon completion, the system will display: "Challenge successful! You have obtained the A Company Tech Rising Star Digital Badge, which has been saved to your encrypted file. Would you like to initiate a conversation with A Company's virtual recruiter?" Xiao Wang chose "yes" and had a few minutes of Q&A with the AI ​​virtual recruiter, Xiao A, about the job culture.

[0092] Throughout the process, all of Xiao Wang's interactions and challenge results were anonymously recorded and stored in the blockchain sidechain after being hashed and encrypted, generating a unique and verifiable credential ID.

[0093] 3. Post-meeting follow-up value: Company A received a data report in the background showing the duration of stay at its virtual booth, the number of people interacting, the challenge completion rate, and the leaderboard, which far exceeded the effect of collecting paper resumes at traditional booths.

[0094] After the job fair, Xiao Wang can see a complete exploration log in his job search portal, including all the digital badges and challenge tokens he has acquired.

[0095] When submitting his resume to companies he likes, he can optionally attach these credential IDs, which the companies can quickly verify through an official link.

[0096] This invention provides a virtual-real fusion information interaction system and method based on spatial computing, which can anchor virtual professional content to real coordinates through spatial computing technology and present it to users with the help of AR devices. Combined with gamified tasks and AI guidance, it realizes a new generation of job search experience with contextualized exploration, ability verification and social connection.

[0097] It will be apparent to those skilled in the art that the present invention is not limited to the details of the exemplary embodiments described above, and that the invention can be implemented in other specific forms without departing from its spirit or essential characteristics. Therefore, the embodiments should be considered in all respects as exemplary and non-limiting, and the scope of the invention is defined by the appended claims rather than the foregoing description. Thus, all variations falling within the meaning and scope of equivalents of the claims are intended to be included within the present invention. No reference numerals in the claims should be construed as limiting the scope of the claims.

[0098] Furthermore, it should be understood that although this specification describes embodiments, not every embodiment contains only one independent technical solution. This narrative style is merely for clarity. Those skilled in the art should consider the specification as a whole, and the technical solutions in each embodiment can also be appropriately combined to form other embodiments that can be understood by those skilled in the art.

Claims

1. A virtual-real fusion information interaction system based on spatial computing, characterized in that, The system includes a spatial digitization module, a cloud-based spatial computing and content management platform, a user terminal, a gamified task and capability verification module, an AI intelligent agent guidance and matching module, and a privacy protection and data storage module. The spatial digitization module generates high-precision point cloud maps and semantic maps of the target physical space and uploads them to the cloud. The cloud platform stores the maps, edits and binds virtual occupation content, and distributes it. The user terminal realizes spatial positioning, AR rendering, and natural interaction. The gamification module creates interactive tasks. The AI ​​module provides personalized guidance and communication. The privacy protection module encrypts and stores capability verification data.

2. The virtual-real fusion information interaction system based on spatial computing according to claim 1, characterized in that, The spatial digitization module, used for 3D scanning of the target physical space and identifying feature points, planes, and semantic regions, is deployed on a mobile scanning terminal and in the cloud. The spatial digitization module generates the high-precision point cloud map and semantic map, and uploads the map to the cloud spatial database.

3. The virtual-real fusion information interaction system based on spatial computing according to claim 1, characterized in that, The cloud-based spatial computing and content management platform includes: a spatial database that stores point cloud maps, semantic tags, and coordinate system information of the scanned space; a virtual content editor configured to allow administrators and enterprise customers to configure and bind various virtual professional content objects on the digital twin model; and a content persistence storage and distribution engine that stores virtual scenes and their binding relationships with spatial coordinates, and distributes virtual content data streams in real time upon user request.

4. A virtual-real fusion information interaction system based on spatial computing according to claim 1, characterized in that, The user terminal is an AR device with spatial awareness capabilities, which includes: a local synchronous positioning and map building SLAM and spatial positioning module that captures environmental features in real time and matches them with cloud maps to achieve centimeter-level indoor positioning; and an AR rendering engine that calls and renders virtual content based on the user's position and viewpoint, and overlays it onto the corresponding coordinates in the real world. It supports a natural human-computer interaction interface that allows interaction with virtual content through gesture recognition, voice commands, and gaze tracking.

5. A virtual-real fusion information interaction system based on spatial computing according to claim 1, characterized in that, The gamified task and ability verification module is deployed in the cloud and is used to create and manage interactive tasks bound to virtual content. These interactive tasks include timed knowledge quizzes in front of a company's virtual booth and mini-project challenges in simulated work scenarios in specific areas. After a user completes a task, the result data is encrypted and uploaded.

6. A virtual-real fusion information interaction system based on spatial computing according to claim 1, characterized in that, The AI ​​intelligent agent navigation and matching module includes: a personal job search AI assistant, which generates a virtual image based on user profiles and historical behavior, and provides personalized exploration path suggestions and key content introductions; and a corporate virtual recruiter, an AI-driven virtual character that answers preset questions, conducts initial communication, and collects user intentions.

7. A virtual-real fusion information interaction method based on spatial computing, applied to a virtual-real fusion information interaction system based on spatial computing according to claim 1, characterized in that, Includes the following steps: S1: Perform 3D scanning and semantic annotation of the target physical space, generate a point cloud map with semantic labels, and store it in the cloud; S2: Bind at least one virtual information object to specific coordinates of the point cloud map according to semantic tags to generate virtual-real fusion scene data; S3: In response to the user terminal's entry request, capture the feature information of the user's environment in real time, match it with the point cloud map, and determine the user's precise location and orientation; S4: Based on the location and orientation, retrieve the corresponding virtual information object from the cloud and render and overlay it onto the user terminal's real environment view; S5: Capture the user's interaction instructions with the virtual information object, generate and execute the associated enhanced interaction task, and collect the user's behavioral data generated during the interaction; S6: Encrypt and store the behavioral data to generate a verifiable digital certificate, and upload it to the cloud for verification by the authorized party.

8. The virtual-real fusion information interaction method based on spatial computing according to claim 7, characterized in that, In step S1, a mobile device equipped with a scanning component is used to perform a three-dimensional scan of the target physical space. The semantic tags include the identification information corresponding to the entrance area, information desk, corridor, rest area, and industry zones.

9. A virtual-real fusion information interaction method based on spatial computing according to claim 7, characterized in that, The virtual information objects in S2, when applied to human resources service scenarios, include career-related content such as 3D company logos, job information display boards, interactive challenge task points, and virtual interviewer roles.

10. A virtual-real fusion information interaction method based on spatial computing according to claim 7, characterized in that, In step S6, the user's capability proof data is encrypted and stored using blockchain or trusted computing technology to generate an immutable digital capability certificate. The capability proof data includes challenge task scores, completion time, and interaction behavior records, which can be viewed and verified by interested enterprise users after authorization.

Images