A method of visualizing information display

Abstract

The present application relates to a kind of visual information display method, first, the three-dimensional global model of modeling area (i.e. real world) is constructed, then the position and perspective of user in modeling area and three-dimensional global model (by information display device) are synchronized, then information display device displays the local part of corresponding three-dimensional global model, i.e. it can be realized that three-dimensional object model and corresponding real object form a certain degree of overlap, and the visual information associated with three-dimensional object model and real object form associated presentation.The present application is actually synchronized with reality and virtual, using the position and perspective of synchronization, display synchronized picture.Due to the display, the three-dimensional object model of corresponding real object in three-dimensional global model is set to transparent, i.e. not seen in synchronous display, further not to form the occlusion of real object, in display effect, i.e. it can be realized that visual information follows the display of real object.

Description

Technical Field

[0001] This invention relates to the field of information display technology, and more specifically, to a method for displaying visual information. Background Technology

[0002] To enable users to experience sensations beyond the real world, existing technologies offer augmented reality (AR) technology. The process involves first collecting data from the real scene using cameras and sensors, then transmitting the data to a processor for analysis and reconstruction. Next, the AR headset or smart mobile device uses cameras, gyroscopes, sensors, and other accessories to update the user's spatial position changes in the real environment in real time, thereby determining the relative positions of the virtual and real scenes. This allows for the alignment of coordinate systems and the fusion calculation of the virtual and real scenes, ultimately presenting a composite image to the user.

[0003] Specifically, augmented reality (AR) systems utilize optoelectronic display technology, interactive technology, computer graphics technology, and visualization technology to construct three-dimensional virtual objects. When a user interacts with the AR system, sensing technology identifies markers and then accurately "places" the virtual objects in the real environment. The user sees the virtual objects blend seamlessly with the real environment through a display device, perceptually confirming that the virtual objects are part of the surrounding real environment. Based on this, the hardware used includes computers or mobile devices, cameras, tracking and sensing systems, displays, computer networks, and markers; the software includes applications, network services, and content servers. Augmented reality systems have three key characteristics: virtual-real fusion, real-time interaction, and three-dimensional registration.

[0004] Augmented reality systems can be categorized into two types based on their tracking methods: one is marker-based tracking, where the camera captures specific objects and the software retrieves the corresponding information. These markers are typically two-dimensional cards, often black and white squares. The other is markerless tracking, commonly used in mobile smart terminals, which utilizes geostationary base station or GPS data. Regardless of the type, both require high-speed data networks and efficient processors to quickly and accurately process the data, resulting in a more natural blend of reality and virtuality and a more user-friendly human-computer interaction.

[0005] Based on existing augmented reality technologies, including their workflows and working principles, it is known that the foundation of augmented reality technology is the need to identify the real world, then obtain and load corresponding virtual objects. This requires high-speed data networks and efficient processors to process the relevant data quickly and accurately. Not only is the implementation cost high, but the technical means of implementation are also complex and difficult, and it usually cannot achieve the desired usage effect.

[0006] The industry has long hoped to achieve target retrieval and display of relevant attributes using head-mounted glasses, but this has been impossible due to technological limitations. The reasons are twofold: firstly, the cost of obtaining high-definition images for head-mounted glasses cameras is high (including hardware selection and limitations on the miniaturization design of the glasses); secondly, the difficulty of sending high-definition images to a server for accurate identification is significant (including the requirements for large-scale data communication, server computing power, and high latency in communication and data processing, hindering accurate tracking and display). Furthermore, the acquired images may not possess identifiable features, thus preventing target retrieval and attribute display due to the inability to identify the target.

[0007] On the other hand, online works, especially text-based works, lack contextual experience when reading; correspondingly, when visiting scenic spots or browsing 3D models, if a scene feels similar to a part of the content or plot of a text-based work, existing technology lacks the means to connect and annotate the scene with the content or plot. Summary of the Invention

[0008] The purpose of this invention is to overcome the shortcomings of the prior art and provide a method for displaying visual information. It adopts a completely different technical approach from augmented reality technology, and achieves the usage effects that augmented reality technology cannot achieve with lower cost and simpler technical means.

[0009] The technical solution of the present invention is as follows:

[0010] A method for displaying visual information involves performing 3D modeling on real objects within a modeling area to construct a 3D global model; the 3D global model includes 3D object models corresponding to the real objects; and the 3D object models are set with associated visual information.

[0011] Within the modeling area, users observe real objects through the transparent display screen of the bound information display device; after the 3D global model sets the 3D object model to transparent, it is displayed through the transparent display screen of the information display device; when the 3D object model and the corresponding real object overlap to a certain extent in the transparent display screen, the visualization information associated with the 3D object model and the real object are presented in a related manner.

[0012] The system acquires the spatial position information and orientation of the information display device within the modeling area in real time; based on the orientation of the information display device, it calculates and obtains the orientation of the transparent display screen; combining the display parameters of the transparent display screen, the aforementioned spatial position information, and the orientation of the transparent display screen, it determines the display range of the three-dimensional global model to be displayed and displays it on the transparent display screen.

[0013] Preferably, based on the spatial position information of the information display device within the modeling area, the corresponding visual point in the 3D global model is obtained; based on the orientation of the transparent display screen, the corresponding viewing angle in the 3D global model is obtained; combining the aforementioned visual point and viewing angle, the corresponding local part of the 3D global model to be displayed is calculated; the display parameters of the transparent display screen include size and resolution; based on the resolution of the transparent display screen, the display ratio of the local part of the 3D global model is determined; and then, the display is cropped according to the size of the transparent display screen, which is the display range.

[0014] As a preferred approach, a corresponding spatial coordinate system is established between the modeling area and the 3D global model; the spatial position information of the information display device within the modeling area, including horizontal and vertical position information, is obtained, thereby obtaining the spatial coordinates of the information display device within the modeling area; based on the correspondence between the spatial coordinate systems of the modeling area and the 3D global model, the corresponding visual point in the 3D global model is obtained.

[0015] Preferably, the information display device is equipped with several identification marks for visual recognition. For a monitoring image containing the information display device, the orientation of the information display device is calculated based on the identification marks in the monitoring image and the known three-dimensional appearance dimensions of the information display device, thereby obtaining the orientation of the transparent display screen.

[0016] As a preferred method, monitoring images are acquired using monitoring equipment, and the spatial coordinates of the road surface and facade within the monitoring images are calibrated. Based on the installation location and angle of the monitoring equipment, the spatial coordinates of the identification signs in the monitoring images are calculated using geometric perspective methods. Based on the three-dimensional appearance dimensions of the information display equipment, the orientation of the information display equipment is calculated.

[0017] As a preferred option, a two-dimensional dot matrix is ​​set within the modeling area. The information display device captures the two-dimensional dot matrix through a camera. Using the perspective distortion, size, and spatial position information of the two-dimensional dot matrix, the attitude and spatial position information of the information display device are calculated, thereby obtaining the orientation of the transparent display screen.

[0018] As a preferred option, the three-dimensional motion data of the information display device is also acquired in real time through sensors, including acceleration sensing data, angular velocity sensing data, attitude sensing data, and height sensing data, and the spatial position information of the information display device and the orientation of the transparent display screen are calculated in real time.

[0019] Preferably, the information display device is wearable glasses, including a transparent display screen in the form of lenses, an inward-facing camera facing the user's eyes, and an outward-facing camera facing forward of the line of sight. The inward-facing camera acquires the interpupillary distance between the user's eyes and the visual distance between the eyes and the transparent display screen. Combined with the real-life images acquired by the outward-facing camera, the lens parameters when the user's eyes are regarded as cameras are calculated. The real-life images and lens parameters are sent to a 3D engine that constructs and manages a 3D global model. The 3D engine corresponds to the real-life images and lens parameters and displays a part of the corresponding 3D global model on the transparent display screen, so as to achieve a certain degree of overlap between the 3D object model and the corresponding real object, and to establish a connection between the visualization information associated with the 3D object model and the real object.

[0020] Preferably, the information display device also includes a light emitter facing the human eye, with the light emitter and the inward-facing camera positioned relatively fixed. The light emitter emits light towards the human eye, and the emitted light is emitted by at least one light source at a fixed distance. The inward-facing camera acquires the reflected image of the human eye, which is the image formed by the light on the retina of the human eye. The gaze point is determined by the reflected image, and then the position where the gaze rests on the transparent display screen is obtained, corresponding to the real object where the gaze rests. Corresponding to the real object where the gaze rests, the corresponding visual information is presented. Alternatively, the three-dimensional object model at the position where the gaze rests on the transparent display screen can be used as the operation object, and the user can operate on it.

[0021] Preferably, the real objects include fixed objects and moving objects, and the 3D object models include 3D fixed models corresponding to fixed objects and 3D moving models corresponding to moving objects. The position of the 3D moving model in the 3D global model is adjusted in real time to follow the real position of the moving object in the modeling area, and the visualization information is displayed on the transparent display screen to follow the fixed objects and moving objects.

[0022] Preferably, based on the plot of the work, the plot corresponding to each set location is pre-marked in the three-dimensional global model; when the user observes the set location in the modeling area, the corresponding plot is displayed; the user uploads additional information, which is presented in the set location in the three-dimensional global model and an access link is generated; for the user, the location of the content in the work corresponding to the set location is provided to the user with the access link.

[0023] Preferably, when a user views a work online and adds an access link to at least one location of the 3D global model in the selected content, or when a user observes or browses the 3D global model in the modeling area and marks at least one piece of content in the work at a selected location; then, the access link is provided to the user at the location of the selected content or the marked content in the work.

[0024] Users can access a partial view of the 3D global model at a specific location by visiting a link, and if additional information is included, they can also view the additional information.

[0025] Preferably, the additional information is a combination of actions, videos, or photos of a 3D character model created by the user based on the plot corresponding to the set location. The 3D character model, video, or photo is composited into the 3D global model with the set location as the background. When the user views the work online, they can obtain an access link in the work corresponding to the plot of the set location, and access the 3D character model, video, or photo composited in the 3D global model through the access link.

[0026] Preferably, the works include written works or film and television works; when a user reads a written work or watches a film or television work online, the user is provided with a corresponding access link in the work corresponding to the plot at the set location.

[0027] This invention utilizes a peer-to-peer computing system to perform non-specific feature recognition and location recognition of targets, wherein the targets include real objects and information display devices within the modeling area;

[0028] The peer-to-peer computing system includes multiple node devices, and there is no hierarchy among the node devices. Each node device is equipped with a data acquisition device and a computing module. The data acquisition device includes at least one type of sensor, including an image acquisition device, for collecting different types of sensing data. Node devices located at different acquisition positions collect at least one point sample of the target, and the point sample is sensing data of the corresponding sensor type.

[0029] For a given node device, the collected sensing data is processed to obtain result data, which is then propagated to other node devices. Other node devices that receive the result data use it as one of the original data collected, and the result data influences the result data of other node devices. Based on this, without needing to obtain the target's identity information, multiple node devices in the peer-to-peer computing system perform collaborative computing to determine that each unique target is itself, achieving non-specific feature recognition and target location identification.

[0030] The beneficial effects of this invention are as follows:

[0031] The visualization information display method described in this invention first constructs a three-dimensional global model of the modeling area (i.e., the real world). Then, it synchronizes the user's position and perspective within the modeling area and the three-dimensional global model (reflected through an information display device). The information display device then displays a portion of the corresponding three-dimensional global model, thus achieving a certain degree of overlap between the three-dimensional object model and the corresponding real object, and establishing a connection between the visualization information associated with the three-dimensional object model and the real object. This invention essentially synchronizes reality and virtuality, using synchronized positions and perspectives to display synchronized visuals. Because the three-dimensional object model corresponding to the real object in the three-dimensional global model is set to transparent during display—meaning it is not seen during synchronized display—it does not obstruct the real object. Therefore, in terms of display effect, the visualization information follows the real object. Furthermore, when the visualization information is implemented as special effects, the added embellishments and lighting effects on the three-dimensional object model can be superimposed on the real target, enhancing the immersive experience.

[0032] Compared to traditional augmented reality technologies, this invention eliminates the time consumption of identifying targets, calculating image appearance methods and positions, and then displaying them. Furthermore, this invention utilizes a 3D engine to construct a 3D global model, and the 3D engine adds any form of visualization information (in this invention, visualization information can be implemented as data information, added visual effects, images, videos, textures, etc.) to the 3D object model in near real-time. Therefore, this invention does not have a visual delay problem, solving the shortcomings of traditional augmented reality technologies, such as delays in target identification and delays in adding effects leading to detachment.

[0033] The technical solution of this invention adopts a completely different technical approach from augmented reality technology. By utilizing synchronization technology and display strategies, it can achieve the effect of augmented reality, and the implementation method is simpler, the implementation cost is lower, and the display effect is better.

[0034] This invention utilizes a peer-to-peer computing system for collaborative computation, performing non-specific feature identification and location recognition on users to achieve identity verification and positioning. In this peer-to-peer computing system, there is no hierarchy among the node devices, and no fixed connection paths exist between them. Each node device only receives the computation results from other node devices and sends out its own computational results. The detection of events and / or the response of corresponding execution devices (including information display devices in this invention) do not rely on a single node device for identification and control, but rather on collaborative computation and joint confirmation by multiple node devices within the peer-to-peer computing system. Without requiring specific features or specific identity information, each unique target can be identified as itself, achieving non-specific feature identification. This invention performs target identification, identity verification, or event monitoring through non-specific feature identification, resulting in high accuracy and precise location recognition. This invention can perform target identification and identity verification without relying on specific features, protecting privacy while simultaneously addressing issues related to transportation, education, medical convenience, epidemic prevention, public services, emergency response, community services, market behavior, production safety, and civilized behavior.

[0035] This invention employs non-specific feature recognition, effectively preventing risks caused by theft or counterfeiting of specific features, thus significantly enhancing security. It utilizes a non-contact, passive method for seamless target identification, greatly improving ease of execution. Based on the aforementioned peer-to-peer computing system, this invention can be easily deployed across coverage areas ranging from hundreds of meters to hundreds of kilometers, making it suitable for various geographical scales. Attached Figure Description

[0036] Figure 1 This is a schematic diagram of the structure of wearable glasses;

[0037] Figure 2 This is a schematic diagram of the inside of wearable glasses;

[0038] Figure 3 This is a side view diagram of wearable glasses;

[0039] Figure 4 This is a schematic diagram of the structure of wearable glasses with a transparent display screen that is a double-curved display screen;

[0040] Figure 5 yes Figure 4 A side view illustration of wearable glasses;

[0041] Figure 6 This is a schematic diagram of a wearable glasses device with an opaque display screen.

[0042] Figure 7 yes Figure 6 A side view illustration of wearable glasses;

[0043] In the diagram: 10 is a transparent display screen in the form of a lens, 11 is an outward-facing camera, 12 is an inward-facing camera, 13 is a light emitter, 14 is an identification mark, 15 is an opaque display screen, and 16 is a viewfinder camera. Detailed Implementation

[0044] The present invention will be further described in detail below with reference to the accompanying drawings and embodiments.

[0045] To address the shortcomings of existing technologies, particularly augmented reality (AR) technology, such as high hardware and software requirements, high implementation costs, complex and difficult implementation methods, and unsatisfactory results, this invention provides a method for displaying visual information. Based on a synchronized display approach, it synchronizes the user's position and perspective in the real world and the virtual model. Then, it displays a portion of the corresponding 3D global model by making the 3D object model transparent, thereby enhancing the display of real objects using visual information. This invention, with a completely different technical approach, achieves superior results compared to augmented reality technology.

[0046] In this invention, a three-dimensional model of the real world is first constructed, including at least real objects that require simulated augmented reality display effects. Specifically, three-dimensional modeling is performed on the real objects within the modeling area (i.e., the real world) to construct a three-dimensional global model. The three-dimensional global model includes three-dimensional object models corresponding to the real objects. In specific implementations, the modeling area may include buildings, fixed or mobile facilities or equipment, etc., all of which are correspondingly three-dimensional modeled to form part of the three-dimensional global model, i.e., the three-dimensional object models. The three-dimensional modeling, the three-dimensional global model, and the three-dimensional object models are formed by using a three-dimensional engine for modeling, rendering, and other processes to create image-data-based three-dimensional models.

[0047] In this invention, the three-dimensional object model is associated with visual information, which is the object to be displayed in this invention. When displaying the three-dimensional global model, the visual information is presented in the three-dimensional global model in association with the three-dimensional object model, such as displaying it according to preset conditions such as the set presentation effect and position relative to the three-dimensional object model. In specific implementation, the visual information can be any form of visual content related to the three-dimensional object model, including data information in text form or a combination of text and graphics, visual effects in image form (dynamic or static), pictures, videos, textures, etc., and can be set to any form of content related to the real object to be displayed according to implementation requirements.

[0048] In this invention, a user observes a real object within a modeling area through a transparent display screen of a bound information display device. The 3D global model, after partially or completely transparent, displays the 3D object model through the transparent display screen. When the 3D object model overlaps with the corresponding real object to a certain extent in the transparent display screen, the associated visual information of the 3D object model is presented in conjunction with the real object. The difference between this invention and augmented reality (AR) technology lies in the fact that this invention actually establishes a virtual user or virtual device within the 3D global model corresponding to the user or bound information display device. The user or bound information display device and the virtual user or virtual device are synchronized in terms of their position and viewpoint within the modeling area and the 3D global model (actually, the angle between the information display device's position and the transparent display screen). This results in the display screen showing a portion of the 3D global model corresponding to the position and viewpoint. Because the 3D object model is transparent, it appears as if the 3D object model does not exist in the image, but in reality, the 3D object model overlaps with the corresponding real object in real time, thus creating the illusion that the visual information follows the real object in the display effect. Augmented reality technology, on the other hand, relies on the recognition of the real world, including calculating the relative position of the device and the captured object with the device as a reference, and displaying corresponding information based on the recognition results.

[0049] In practice, real objects include fixed objects and moving objects (including facilities or equipment in motion, as well as users within the modeling area). The 3D object model includes a 3D fixed model corresponding to the fixed object and a 3D moving model corresponding to the moving object. The position of the 3D moving model in the 3D global model is adjusted in real time according to the real position of the moving object within the modeling area. Visual information is displayed on a transparent display screen to follow the fixed object and the moving object.

[0050] Because this invention displays 3D object models transparently, there is no need to consider visual simulation effects. This saves (especially the computational power required to obtain highly realistic models) the computational overhead of modeling and rendering 3D object models, allowing implementation with simple virtual objects. For example, fixed objects can achieve uniqueness and definite location information, while active objects (such as users) can achieve uniqueness and real-time location identification.

[0051] In practice, this invention can be viewed as an overlap between the 3D global model and the modeling area in the real and virtual worlds. When a user enters the modeling area, the virtual user moves synchronously within the 3D global model. While the user observes real objects within the modeling area through an information display device, the virtual device simultaneously observes the 3D global model from the same position and perspective. Since observation within the 3D global model is actually presented through display, the user's perspective within the modeling area corresponds to a local display of the 3D global model. Therefore, the user's movement and observation within the modeling area are synchronously reflected in the 3D global model by a virtual user or virtual device. This can be understood as assuming a computer displays the 3D global model (in this assumption, the 3D global model does not set the 3D object model to transparent), allowing movement and observation from a first-person perspective. Correspondingly, the computer's monitor displays a local portion of the 3D global model. However, in this invention, the hypothetical computer is not required; instead, the display is directly achieved through a transparent display screen.

[0052] In this invention, the spatial position information and posture of the information display device within the modeling area are acquired in real time. Based on the posture of the information display device, and with preset appearance parameters of the information display device, the orientation of the transparent display screen can be calculated. Combining the display parameters of the transparent display screen (used to determine the display ratio so that the 3D object model and the real object are as equal in size as possible in terms of display effect), the aforementioned spatial position information, and the orientation of the transparent display screen, the display range of the 3D global model to be displayed is determined and displayed on the transparent display screen. Specifically, based on the spatial position information of the information display device within the modeling area, the corresponding visual point in the 3D global model is acquired (i.e., if a virtual device is set, a visual point is formed for the virtual device at the height mentioned above in the 3D global model); based on the orientation of the transparent display screen, the corresponding viewing angle in the 3D global model is acquired (i.e., if a virtual device is set, a viewing angle is formed for the virtual device at the orientation mentioned above in the 3D global model); combining the aforementioned visual point and viewing angle (i.e., if a virtual device is set, a first-person viewing angle is formed for the corresponding visual point and viewing angle), the corresponding local part of the 3D global model to be displayed is calculated. The display parameters of the transparent display screen include size and resolution. Based on the resolution of the transparent display screen, the display ratio of a local part of the 3D global model is determined. Then, the display area is cropped according to the size of the transparent display screen. In specific implementation, the information display device can preset the 3D global model and only receive the display parameters when displaying it. For the real-time position of the moving object, only the corresponding parameters (such as the ID of the 3D moving model, real-time spatial position information, etc.) are received, and the position of the 3D moving model can be adjusted. Therefore, the communication requirements and computing power requirements can be greatly reduced. Alternatively, the information display device can be used as the monitor of the aforementioned hypothetical computer, receiving the image data corresponding to a local part of the 3D global model.

[0053] In this invention, the determination of spatial location information specifically involves establishing a corresponding spatial coordinate system between the modeling area and the three-dimensional global model; obtaining the spatial location information of the information display device within the modeling area, including horizontal and vertical location information, and then obtaining the spatial coordinates of the information display device within the modeling area; and obtaining the corresponding visual point in the three-dimensional global model based on the correspondence between the spatial coordinate systems of the modeling area and the three-dimensional global model.

[0054] In this embodiment, the information display device is equipped with several identification marks 14 for visual recognition. For a monitoring image containing the information display device, the orientation of the information display device is calculated based on the identification marks 14 in the monitoring image and the known three-dimensional appearance dimensions of the information display device, thereby obtaining the orientation of the transparent display screen.

[0055] In this embodiment, for determining spatial location information, a monitoring device (which can be implemented as an image acquisition device, such as a camera) that is fixedly set within the modeling area and forms a full coverage of the modeling area is used to acquire monitoring images, and the spatial coordinates (i.e., coordinates in the geographic coordinate system) of the road surface and the facade within the monitoring images of the monitoring device are calibrated; based on the installation position and angle of the monitoring device, the spatial coordinates of the identification mark 14 in the monitoring image are calculated using a geometric perspective method.

[0056] As an auxiliary means to determine the spatial location and orientation of the information display device, in this embodiment, a two-dimensional dot matrix (such as an LED light array or an infrared light array that can be captured by the camera of the information display device) can also be set within the modeling area, and the spatial coordinates (i.e., coordinates in the geographic coordinate system) of the two-dimensional dot matrix can be pre-calibrated. The information display device captures the two-dimensional dot matrix through the camera, and uses the perspective distortion, size, and spatial location information of the two-dimensional dot matrix, as well as the spatial location information of the set position of the two-dimensional dot matrix, to calculate the orientation and spatial location information of the information display device, thereby obtaining the orientation of the transparent display screen. In specific implementation, when there are enough two-dimensional dot matrices, or when the set positions correspond to the real objects to be observed, seamless use by the user can be achieved, without the user needing to specifically determine the spatial location and orientation of the information display device.

[0057] As another auxiliary means to determine the spatial position and attitude of an information display device, this embodiment can also acquire the three-dimensional motion data of the information display device in real time through sensors, including acceleration sensing data, angular velocity sensing data, attitude sensing data, and height sensing data, and calculate the spatial position information of the information display device and the orientation of the transparent display screen in real time. In specific implementation, the spatial position and attitude of the information display device can be acquired in real time through a nine-axis gyroscope or a ten-axis gyroscope.

[0058] The information display device can be implemented as a mobile smart device (such as a smartphone or tablet) or wearable glasses (including helmet-mounted devices and head-mounted devices). In this embodiment, the information display device is wearable glasses, such as... Figure 1 , Figure 2 , Figure 3As shown, the device includes a transparent display screen 10 in the form of a lens (in this embodiment, it is a flat panel display screen), an inward-facing camera 12 facing the user's eyes, and an outward-facing camera 11 facing forward of the line of sight. The inward-facing camera 12 acquires the interpupillary distance of the user's eyes and the visual distance between the eyes and the transparent display screen. The information display device also includes a light emitter 13 facing the user's eyes. The light emitted by the light emitter 13 towards the user's eyes is light that can be captured by the inward-facing camera 12 and is not irritating to the user's eyes, such as invisible infrared light. The positions of the light emitter 13 and the inward-facing camera 12 are relatively fixed. The light emitter 13 emits light towards the user's eyes, and the emitted light is emitted by at least one light source at a fixed distance. The inward-facing camera 12 acquires the reflected image of the user's eyes, that is, the reflected image composed of multiple reflective points in different parts of the user's eyes. The reflected image is the image formed by light on the retina of the user's eyes. Depending on the implementation requirements, a single light source can be selected to emit a single light to produce multiple reflective points in different parts of the user's eyes, or multiple light sources can be selected to emit multiple light to produce multiple light-emitting points.

[0059] The inward-facing camera 12 acquires an image containing the human eye and reflective points, namely, the human eye image and the reflective image. Since the positions of the light emitter 13 and the inward-facing camera 12 are relatively fixed, the interpupillary distance of the user's eyes, the visual distance between the eyes and the transparent display screen, and the gaze point of the user's eyes can be calculated and determined based on the reflective image and the positions of multiple reflective points reflected by the human eye, combined with the human eye image.

[0060] The interpupillary distance of the user's eyes, the visual distance between the eyes and the transparent display screen, and the real-time footage captured by the outward-facing camera 11 are combined. Treating the user's eyes as two cameras, the lens parameters are calculated. The real-time footage and lens parameters are sent to the 3D engine that constructs and manages the 3D global model. The 3D engine, based on the real-time image and lens parameters, displays a portion of the corresponding 3D global model on the transparent display screen. This achieves a certain degree of overlap between the 3D object model and the corresponding real object, and establishes a connection between the visualization information associated with the 3D object model and the real object. Specifically, the lens parameters determine the display ratio of the portion of the 3D global model on the transparent display screen, ensuring that the 3D object model and the real object are as equal in size as possible in the display effect. The real-time footage captured by the outward-facing camera 11 is used to determine the position and viewing angle, thereby determining the portion of the corresponding 3D global model to be displayed. Then, based on the display parameters of the transparent display screen, the display range of the 3D global model to be displayed is determined.

[0061] Based on the user's gaze points, combined with the interpupillary distance and the visual distance between the eyes and the transparent display screen, the position where the gaze rests on the transparent display screen is calculated. This, combined with a local view of the real-time displayed 3D global model, allows for the identification of the actual object where the gaze rests. Once the actual object is determined, further operations can be performed according to implementation requirements. These operations include presenting corresponding visualization information based on the object; or using the 3D object model at the gaze's resting position on the transparent display screen as the manipulation object, allowing the user to manipulate it through other means, such as bound operating devices or recognizable gestures, to modify the visualization information.

[0062] As another embodiment, such as Figure 4 , Figure 5 As shown, the transparent display screen 10 in the form of lenses for wearable glasses can also be configured as a dual-curved display screen corresponding to each eye, with the curvature of the curved surface approximating the curvature of the human eyeball. When displaying the three-dimensional global model, different parts of the three-dimensional global model are displayed for each eye. Specifically, this can be calculated based on the interpupillary distance of the user's eyes and the visual distance between the eyes and the transparent display screen 10. The calculation principle is consistent with the visual principle of human eyes, that is, when the left and right eyes are used separately, the images seen are different. When using both eyes, the different images seen by each eye constitute the corresponding stereoscopic vision. In this embodiment, the distance between the human eye and the transparent display screen 10 is closer (compared to a flat panel display screen), thus creating an effect that simulates the principle of human eyes.

[0063] As another embodiment, such as Figure 6 , Figure 7 As shown, the wearable glasses use an opaque display screen 15 instead of the transparent display screen 10 in other embodiments. The opaque display screen is configured as a dual-curved inner display screen corresponding to each eye, and the curvature of the curved surface is close to the curvature of the human eyeball. Viewfinder cameras 16 are positioned on the outer side of the opaque display screen, corresponding to the eyeballs. The images captured by the viewfinder cameras 16 are displayed on the dual-curved inner display screen of the opaque display screen 15. Based on the same principle as the transparent display screen 10 implemented as a dual-curved display screen, the different images seen by each eye constitute corresponding stereoscopic vision, and the corresponding parts of the three-dimensional global model are displayed on the dual-curved inner display screen of the opaque display screen 15.

[0064] Based on the aforementioned 3D global model, this invention can be further extended in its applications. In this embodiment, based on the plot of the work (such as involving a modeling area, including descriptions of buildings, scenic spots, etc. corresponding to the modeling area), the plot corresponding to each set location is pre-marked in the 3D global model; when the user observes the set location in the modeling area, the corresponding plot is displayed. After obtaining the plot, the user can upload additional information according to their wishes. The additional information is presented in the set location in the 3D global model and an access link is generated; for the user, the location of the content in the work corresponding to the set location provides the user with the access link. The additional information is associated with the current user's identity information and can be made invisible to other users or visible to other users. In this embodiment, the additional information is a combination of actions, videos, or photos of a 3D character model created by the user based on the plot corresponding to the set location. The 3D character model, video, or photo is composited into the 3D global model with the corresponding set location as the background; when the user views the work via the network, they obtain an access link in the work corresponding to the plot of the set location, and access the 3D character model, video, or photo composited in the 3D global model through the access link. In this invention, lighting and light field data of the set location associated with the additional information are also collected and sent to the 3D engine to make the virtual lighting effect of the additional information consistent with the real lighting effect of the modeling area; that is, the 3D character model, video or photo forms a virtual lighting effect based on the collected light field data to simulate the real lighting effect, so that the visual effect of the additional information in the 3D global model is consistent with the real scene of the modeling area.

[0065] On the other hand, when a user views a work online, and the user feels that part or more of the work's content is similar to or matches one or more scenes in the modeling area or the 3D global model, an access link to at least one location in the 3D global model (i.e., the modeling area or one or more scenes in the 3D global model perceived by the user) can be added to the selected content (i.e., the part or more of the work perceived by the user; for a text work, it would be the relevant text; for a film or television work, it would be the relevant clip). Alternatively, the user can observe the 3D global model in the modeling area or browse the 3D global model via a computer or information display device (in this case, instead of synchronizing the visual point with the user's position in the modeling area, the user can freely browse the 3D global model, and the visual point is independent of the user's physical position), and mark at least one piece of content (i.e., part or more of the work perceived by the user) in the selected location (i.e., the modeling area or one or more scenes in the 3D global model perceived by the user). Then, at the location of the selected or marked content in the work, the aforementioned access link is provided to the user. The user obtains a partial view of the 3D global model corresponding to a certain location through the access link, and if it contains additional information, the user also views the additional information.

[0066] In practice, the work can be in the form of a written work or a film / television work, or any other work that users can access via the internet. When a user reads a written work or watches a film / television work online, a corresponding access link is provided to the user in the plot corresponding to the designated location within the work. The user can then access the additional information through the access link. The access link can be displayed automatically to the user or can be actively requested by the user. For example, in a written work, the access link can be displayed after the relevant section of content; in a film / television work, the access link can be displayed near the progress bar, or displayed as a bullet screen, or indicated by a vibration notification on the user's handheld device, etc.

[0067] In practical implementation, traditional single-point identification methods can be used to identify users at designated locations to confirm their identities and associate location information. Alternatively, the peer-to-peer computing system provided by this invention can be used for non-specific feature-based identity recognition. The peer-to-peer computing system of this invention is based on collaborative computing, does not rely on single-point identification, and distributes computational functions throughout the entire system, reducing the hardware and software requirements of single-point computation, resulting in high execution efficiency and significantly improved anti-attack capabilities. The system maintains a relatively symmetrical information state among node devices, making it immune to illegal data tampering. Even if a single node device is physically compromised and its data is altered, the tampering does not affect the overall computation results because the entire peer-to-peer computing system involves highly redundant and complex calculations and multi-dimensional verification. Furthermore, it allows for rapid location of faulty and tampered node devices, ensuring the reliability of the overall system's computation results. This, in turn, resolves the conflict between data sharing and information security between departments.

[0068] The result data transmitted between node devices can be the processing result of information rather than the information itself. Therefore, the raw data collected (i.e., perceived data) does not need to be stored. Node devices only receive the calculation results output by other node devices and send out their own calculation results. The amount of information contained in a single calculation result is insufficient to reconstruct any event or target information. A definite result can only be obtained by joint calculation of the calculation results of the entire peer-to-peer computing system, multi-dimensional data matrix elements, and physical space and facility correspondence. The collaborative calculation has less dependence on the information transmitted by a few node devices, thus fundamentally changing the nature of traditional information technology's single-point security sensitivity.

[0069] In this invention, the acquisition of the identity information and location information of the target (including real objects within the modeling area and information display devices) can be achieved through collaborative computing using the peer-to-peer computing system provided by this invention. Specifically, this invention utilizes the peer-to-peer computing system to perform non-specific feature recognition and location recognition of the target, namely, real objects (including users) and information display devices within the target modeling area. The term "non-specific feature recognition" differs from the common understanding of "recognition" in a strict conceptual definition. Commonly, "recognition" refers to determining the concrete form or specific identity information of the target, such as who it is (including name, specific information indicating the target's identity), or what it is (e.g., a car, a person). However, the "recognition" in this invention refers to identifying each unique target (i.e., a user) as itself; that is, for a given object to be identified, its existence is unique. After implementing "non-specific feature recognition," this invention determines that the object to be identified (i.e., the target that has not been identified or confirmed) is itself, and not other objects to be identified. The result of "non-specific feature recognition" does not require determining the specific characteristics of the object to be identified, nor does it require determining the identity information or concrete form of the object to be identified. For example, if a person is considered object A to be verified, and an object is considered object B to be verified, then after implementing "non-specific feature recognition," it is not necessary to identify whether object A is a person or what their specific identity is, nor is it necessary to identify whether object B is an object or what kind of object it is; rather, it is necessary to determine that object A is object A itself, and object B is object B itself. Then, corresponding services or controls can be provided for object A or object B.

[0070] The peer-to-peer computing system comprises multiple node devices, all without a hierarchy, forming a decentralized network and computing architecture. Unlike traditional single-point aggregation computing models, the data transmission direction between node devices in this invention does not have a fixed, predetermined path relationship. In the peer-to-peer computing system described in this invention, a particular node device processes the collected raw data to obtain result data, and then propagates the result data to other node devices. Other node devices that receive the result data use it as one of their collected raw data sets, thus influencing the result data of other node devices. For ease of description, the aforementioned "particular node device" is referred to as the "current node device," and the "other node devices" are referred to as "subsequent node devices." One aspect of this influence is that the result data obtained by subsequent node devices is not entirely determined by their own collected raw data, but rather by the result data output by the current node device. Specifically, the result data output by the current node device may alter the data processing model and parameters used by subsequent node devices to calculate the result data, thereby affecting the result data of subsequent node devices. For example, if the output data of the current node device is correlated with the raw data collected by subsequent node devices, it is necessary to consider the impact of the output data of the current node device on the accuracy of the output data of the subsequent node devices. Specifically, for the perception of a specific target, if the result data is calculated based solely on the raw data collected by subsequent node devices, it can only reflect the real-time (including real-time location and time) single-point result judgment of the target within the perception range of the subsequent node devices. However, the output data of the current node device reflects the direct perception data and result judgment of the target at other locations and at other times, or other indirectly related perception data and result judgments, which helps to improve the accuracy and comprehensiveness of the result data of the subsequent node devices, including superimposed calculations of the same dimension and correlation references of different dimensions.

[0071] Because there is no master-slave relationship between nodes in a peer-to-peer computing system, point-to-point transmission is possible. Therefore, for a given calculation result corresponding to a specific perceived data point of a target, as reflected in the output data of one node, the information is relatively symmetrical among other nodes receiving that result data. Other nodes use the received result data as input, combining it with their own sensor data to calculate their own result data. Their own result data naturally encompasses both the received result data and the information reflected by their own sensors, and is transmitted to other nodes in the next layer. Thus, for a specific perceived data point of a target, information is relatively symmetrical across all nodes. This prevents the impact of tampering or falsification of the calculation process and results of a single node on the result data. It also serves as a means to detect faulty, tampered, or non-compliant node devices. This fundamentally solves the inherent hidden dangers of traditional information technology, namely, the false, falsified, and erroneous information caused by information asymmetry, which becomes a point of entry for fraud and cyberattacks. It also addresses the problems of poor accuracy, excessive time consumption, low credibility, and poor responsiveness in complex integrated applications. Therefore, it can truly become the information infrastructure for comprehensive management of large areas and the infrastructure for the digital economy. Unlike blockchain technology, which relies on independent computation by each node to determine the result and emphasizes the preservation of original data, this invention focuses on peer-to-peer collaborative computation among node devices. Through this collaborative computation, each node device can adjust its own data processing model (i.e., the algorithm for calculating the result data) and parameters when processing data. This adjustment is a feedback mechanism from all node devices, transforming the computation of all node devices into a unified whole. Instead of individual nodes performing calculations independently, all node devices collaboratively complete the computation. The adjustments to the node device's data processing model are objectively real and will impact subsequent data processing iterations.

[0072] Node devices are equipped with data acquisition devices (in specific implementations, these may include one or more of the following: image acquisition devices, audio acquisition devices, temperature measurement devices, vibration frequency sensing devices, lidar, chemical sensors, and electromagnetic induction devices) and a computing module. The data acquisition devices include various types of sensors, including image acquisition devices and audio acquisition devices, used to collect different types of corresponding sensor data. The computing module calculates the result data based on a data processing model. Node devices located at different acquisition positions (i.e., at different physical installation locations) collect at least one point sample of the target; the point sample is sensor data corresponding to the sensor type. Based on this, without needing to obtain the target's identity information, multiple node devices in the peer-to-peer computing system perform collaborative computation to determine that each unique target is itself, achieving non-specific feature recognition; furthermore, it achieves target location recognition, thereby obtaining spatial location information.

[0073] Specifically, taking a given node device as the current node device, and considering the data transmission between its preceding and subsequent node devices (in this invention, "preceding node device" and "subsequent node device" only describe their sequential relationship with the current node device in the current calculation and data transmission process, and do not imply any necessary sequential or priority relationship between them), the current node device receives the result data output by other node devices (including preceding node devices), and subsequent node devices receive the result data output by other node devices (including the current node device). For the current node device, the collected sensing data is combined with the result data from other node devices (including preceding node devices) to calculate the result data of the current node device, and this result data is sent to other node devices (including subsequent node devices). Similarly, the working process of subsequent node devices is the same as that of the current node device, and preceding node devices also receive the result data from the preceding node devices of their predecessors and perform the same working process as the current node device; that is, the node devices in the peer-to-peer computing system perform the same working process. Furthermore, the node devices in the peer-to-peer computing system perform collaborative calculations as sensing data is collected and result data is calculated. In this process, the output data of a certain node device is only received and used as input by the subsequent layer of node devices, and the output data of the subsequent layer of node devices will cover the output data of the preceding layer of node devices (including the aforementioned node device).

[0074] In a peer-to-peer computing system, all events are processed synchronously, and it is not necessarily necessary to explicitly produce staged results such as what event was discovered or what the specific content of the event is. In a peer-to-peer computing system, only the sensor's perception and the corresponding execution device (in this invention, including the information display device) are explicitly responded to. All other intermediate processes are processed simultaneously through collaborative computing. That is, during the operation of this invention, the intermediate process of event discovery is imperceptible. As collaborative computing proceeds and the node device obtains the result data, the corresponding execution device automatically responds and executes.

[0075] To further ensure the trustworthiness of the data source and computation process, in this invention, all node devices encrypt their computational results based on an encrypted consensus mechanism, obtaining encrypted results, which are then sent to other node devices. The encrypted consensus mechanism includes one or more consensus mechanisms, with different mechanisms corresponding to changes in the encryption algorithm structure and parameters of the node devices.

[0076] Node devices communicate using standard-sized data packets (i.e., result data or calculation results). In this invention, the node devices in the peer-to-peer computing system are similar to human neurons. Just as each neuron does not transmit specific data directly describing external events, the node devices do not output raw data. Instead, they process the raw data acquired by connected sensors and data acquisition devices into standard-sized data packets (i.e., result data or calculation results, similar to nerve impulses in neurons) based on their own data processing models (similar to the biological characteristics of nerve cells). The information contained in a single data packet is insufficient to reconstruct any event or target information. A definite result can only be obtained through collaborative computation involving the calculation results across the entire peer-to-peer computing system, multi-dimensional data matrix elements, and the correspondence between physical space and facilities. Collaborative computation has little dependence on the data output by a few node devices, and it simultaneously processes all requests received or initiated by all node devices. It is a collaborative verification computation of highly multi-dimensional related information, thus fundamentally changing the traditional single-point security sensitivity of information systems.

[0077] To ensure data integrity and the effective execution of collaborative computing, this invention deploys a QoS mechanism in the peer-to-peer computing system. The QoS mechanism prioritizes ensuring the transmission quality of result data between node devices.

[0078] In practical implementation, the peer-to-peer computing system can be networked using one or more combinations of 4G, 5G, or MESH modes to suit different application scenarios. The optimal solution is achieved by considering factors such as feasibility and cost. The MESH mode is based on the LTE standard, communicating at the LTE physical layer. Data is carried by a customized frame structure, and interaction is performed using a dedicated wireless communication protocol. Customizing the frame structure to suit peer-to-peer computing and employing a proprietary wireless communication protocol developed for urban cluster peer-to-peer computing further enhances its security and reliability. Furthermore, the wireless algorithm is fully adapted to the multipath channel environment controlled by a consensus mechanism required for peer-to-peer computing, achieving communication distances of 100 meters to 10 kilometers within cities and 120 kilometers in the field using omnidirectional antennas. In this embodiment, the Mesh network communication distance is 50-150 meters between indoor nodes and 50 meters to 120 kilometers between outdoor nodes, with each node capable of connecting to 65,535 nodes. In addition, when networking in 4G and 5G modes, there is no limit to the communication distance, and the number of node devices that can be connected depends on the computing power of the computing chip and the communication latency.

[0079] In a peer-to-peer computing system, for a specific point sample of an object to be identified, the result data transmitted from the node device that collected the point sample to other node devices allows subsequent node devices to adjust their perceptual attention based on the features of that point sample (it is not necessary for the result data to contain the features of that point sample, but rather that the features of that point sample participate in the computation of the preceding node device, so that the result data of the preceding node device can be used as input to the data processing model of the subsequent node device, allowing the subsequent node device's data processing model to achieve the effect of adjusting perceptual attention during computation); or, the features of that point sample can be reported for subsequent node devices to adjust their perceptual attention (the features of that point sample are directly described in the result data). If other subsequent node devices do not detect the features of that point sample, but can determine from the features of other point samples that the undetected features of that point sample still belong to the object to be identified, then the features of that undetected point sample are continued to be described in the result data of the current node device and transmitted to other node devices. For example, if a preceding node device senses the color of an object A to be identified, but the current node device does not sense the color of the object A to be identified, but it can be determined from the sensing data of other node devices that there is another object A to be identified besides other objects to be identified, then the color of the object A to be identified that has not been sensed will still be represented in the result data of the current node device.

[0080] In this embodiment, the method for reporting the features of the point sample for subsequent node devices to adjust the perceptual attention is as follows: adjusting the parameters of the data processing model of the subsequent node device based on the features of the point sample provided by the preceding node device, so that the subsequent node device can improve the computing power of the point sample to identify its features; or, the subsequent node device uses the perceptual attention model to match the features of the received point sample to adjust the computing power.

[0081] The “feature” mentioned above has a different meaning from the “feature recognition” in the prior art. The “feature recognition” in the prior art usually refers to information that can determine the identity of a target, while the “feature” in this invention represents a kind of perceived data belonging to the object to be identified, such as coordinates, colors belonging to the object to be identified, etc. The “non-specific feature recognition” of the object to be identified cannot be directly completed by the “feature” perceived by a single point.

[0082] In this embodiment, the method for reporting the features of the point sample for subsequent node devices to adjust the perceptual attention is as follows: based on the result data expressing the features of the point sample provided by the preceding node device (in this invention, the features of the point sample are usually not provided themselves, but expressed in the result data), or the features of the point sample (i.e. the features of the point sample itself), the parameters of the data processing model of the subsequent node device are adjusted so that the subsequent node device can improve the computing power of the point sample to identify its features; or, the subsequent node device uses the perceptual attention model to match the features of the received point sample or the result data expressing the features of the point sample to adjust the computing power.

[0083] When a node device processes the output data from several preceding node devices, based on the data processing model, if the objects to be identified described by several preceding node devices can be determined to be the same target through certain common point sample features, the point sample features and other information described by each node device are merged into the same target. For example, point sample features in physical space that almost completely overlap at the same time can be determined to be the same target.

[0084] When the result data received by a node device indicates that the flag used by the current node device to identify the object to be identified before the current reception of result data is different from the flags used by other node devices to identify the object to be identified, and the flags assigned to the object by other node devices have been updated, then the flag used by the current node device to identify the object to be identified before the current reception of result data is converted. Specifically, the method for converting the flag used by the current node device to identify the object to be identified before the current reception of result data is as follows:

[0085] The flag used by the current node device to identify the object to be identified before the current reception of result data is replaced with the latest flag assigned to the object by other node devices; this is a simpler implementation of the present invention.

[0086] Alternatively, the conversion relationship between the flag used by the current node device to identify the object to be identified before the current receiving result data and the updated flag assigned to the object by other node devices can be recorded, and the conversion can be performed when the current node device's current receiving result data needs to be referenced; this is a relatively complex implementation method provided by the present invention.

[0087] Alternatively, the node device can deploy a conversion model to perform corresponding conversions on the labels of multiple objects to be identified based on the input raw data or result data; this is a more complex implementation provided by the present invention.

[0088] In this invention, in order to improve the effectiveness of "non-specific feature recognition", for one or more point samples collected successively by node devices at different collection locations, if the feature values ​​of one or more point samples at different collection locations meet the preset similarity conditions or are determined by a specific model to have a correlation threshold, and are unique at each collection location, then it is determined that the point samples at different collection locations are correlated.

[0089] On the other hand, for one or more point samples collected simultaneously by node devices at different collection locations, if the node devices at different collection locations collect data on the same spatial field, and there is only one object to be identified in the spatial field, or the collected point sample can correctly point to one of the multiple objects to be identified, then for a certain object to be identified, one or more point samples collected by node devices at different collection locations are correlated.

[0090] In this invention, the data acquisition device of the node device includes one or more combinations of an image acquisition device, an electromagnetic induction device, a temperature measurement device, and a vibration frequency sensing device, and a lidar. The data acquired by the aforementioned devices (i.e., one or more combinations of the image acquisition device, electromagnetic induction device, temperature measurement device, and vibration frequency sensing device) and the three-dimensional point cloud acquired by the lidar, or the point cloud generated from images acquired by multiple image acquisition devices, are jointly calculated to obtain three-dimensional points with data. The image color, contour, lines, reflectivity, motion trend, electromagnetic characteristics, temperature, temperature change trend, vibration frequency, and vibration frequency change trend based on two-dimensional perception are used as additional attributes of the corresponding three-dimensional points to constitute an attributed three-dimensional point cloud. Combining electromagnetic induction, temperature patterns, vibration frequency change characteristics, motion correlation (different motion correlations exhibited by different materials such as ropes and fabrics), and reflectivity, the correspondence between each region of the attributed three-dimensional point cloud and each part or related part of the 3D appearance of the object to be identified is determined. This embodiment utilizes the attributes and correlations of attributed 3D point clouds to determine the relationships between points, the correspondence between the regions to which each related point belongs and each part or related part of the 3D appearance of the object to be identified, and can more accurately determine the point sample features belonging to the object to be identified, thereby improving the efficiency and accuracy of "non-specific feature recognition".

[0091] In the process of "non-specific feature recognition," this invention can also acquire the identity information of the object to be identified when necessary. Specifically, when it is determined that the identity information of the object to be identified needs to be acquired, an identity information acquisition command is triggered. This command is used as one of the inputs in the calculation of the result data of the node device. By driving the node device in the peer-to-peer computing system, which is connected to the barrier-free data collection conditions capable of obtaining the identity information of the object to be identified, to respond with the corresponding result data, the identity information of the object to be identified is acquired. The acquisition of identity information is also the result of collaborative computing; that is, the acquisition of identity information is triggered by the determination that it needs to be acquired, rather than by an additional triggering through a specific request command. Based on this invention, if permission calculation is triggered by a request command, in most cases it can be completed without acquiring identity information. Only in a few cases, when it is found that permission calculation cannot be completed without acquiring identity information, will the determination that it is necessary to acquire identity information be generated according to implementation requirements. For example, if collaborative computing reveals that a person's identity information exists in several location-based QR code registration systems, package pickup registration systems, or consumer registration systems, and prior authorization from the person or legal access to these systems is obtained, then the peer-to-peer computing system can drive node devices connected to these systems via barrier-free data collection. The obtained information is then sent to the peer-to-peer computing system through each node device for information comparison and to provide accurate identity information. Based on this, the present invention can also minimize the possibility of identity tampering with a system.

[0092] Specifically, the peer-to-peer computing system determines the permissions of an object by verifying the authenticity of its identity information. In this system, node devices capable of acquiring identity information may not provide the identity information (or may provide it depending on implementation requirements), but instead express the verification result in their own result data based solely on the verification requirements for the authenticity of the identity information within the received result data. That is, in this invention, even when a node device capable of acquiring identity information does not provide it, the verification result is expressed in its own result data based solely on the verification requirements for the authenticity of the identity information within the received result data.

[0093] When a node device in a peer-to-peer computing system that can obtain identity information does not provide identity information, the information source device that drives the provision of identity information establishes an encrypted file transmission channel with the input terminal of the node device that needs to obtain identity information, or establishes an encrypted information transmission channel using other network communication modes; and uses the identity information as one of the inputs of the node device.

[0094] When necessary, in order to meet the needs of other traditional computing modes for raw data, such as the need for evidence preservation in traditional evidence presentation, in this embodiment, the node settings can be equipped with a data storage device for storing the raw data sensed by the sensor.

[0095] In practical implementation, the node device can also be equipped with leakage protection and other functions in its power supply. The node device can also provide various communication interfaces, including fiber optic interfaces and wireless communication interfaces; it can also provide a data interface for connecting external storage devices. The node device can be powered by solar energy or mains power. When implemented outdoors, the node device can be installed on poles such as streetlights (without crossarms, mounted on the main pole, or integrated into the lampshade); in pole-less areas, if implemented indoors, it can be wall-mounted or integrated into the ceiling.

[0096] When this invention is implemented indoors and outdoors, the node devices, as artificial intelligence facilities installed in public spaces, can serve as digital economic infrastructure for urban clusters, providing 24 / 7 seamless coverage. Through collaborative computing across node devices, near 100% accuracy in identifying targets at any location within the coverage area can be achieved, with location identification accuracy being related to sensor accuracy.

[0097] In this peer-to-peer computing architecture, all node devices are of the same type and function. Each node device dynamically adjusts its data processing model in real time according to the consensus mechanism of the entire peer-to-peer computing system. The raw data collected by the data acquisition devices (including sensors, cameras, etc.) connected to each node device is processed and encrypted by the node device according to its own data processing model, generating byte-level processing and encryption results (i.e., result data). This result data is then sent to other node devices (the computation and encryption results output by other node devices simultaneously received by the current node device are also considered part of the raw data collected by the current node device). Therefore, the effect of the raw data sensed by each sensor will propagate exponentially among a massive number of peer-to-peer node devices. If each node device sends its result data to 100 surrounding node devices, after four units of time, hundreds of millions of node devices will be affected by the event sensed by that sensor. In this computing model, information is relatively symmetrical and immune to tampering and forgery. It fundamentally solves the inherent hidden dangers of traditional information technology, namely, the false, forged, and erroneous information caused by information asymmetry, which in turn become entry points for fraud and cyberattacks, as well as the problems of long cycles, poor accuracy, and poor adaptability in complex and integrated applications. In turn, it truly becomes an information infrastructure for comprehensive management of large areas and a digital economy infrastructure.

[0098] This invention utilizes the collaborative computing of a peer-to-peer computing system. When the results of this collaborative computing can identify an event, the event is detected. In this embodiment, the event detection by the peer-to-peer computing system includes the event's content, its location, and the corresponding response. In a peer-to-peer computing system, all events are processed synchronously; it is not necessary to explicitly produce staged outputs such as what event was detected or its specific content. In a peer-to-peer computing system, only the sensor's perception and the corresponding execution device's response are explicitly defined. All other intermediate processes are handled simultaneously by collaborative computing. That is, during the operation of this invention, the intermediate process of event detection is imperceptible; it is achieved as collaborative computing progresses, the node devices acquire their result data, and the corresponding execution devices automatically respond and execute.

[0099] In this invention, each information display device acts as an execution device, joining the peer-to-peer computing system through one or more node devices. To prevent hijacking, this invention can use multiple node devices to collaboratively control the information display device, further enhancing immunity to hijacking attacks. The human-computer interaction device associated with the user connects to the node devices as an access device, submitting information interaction service requests to the peer-to-peer computing system. In this invention, information interaction service requests, display control commands, and execution control commands can be considered as request commands. Responses to request commands include various scenarios such as "request-execution," "request-response," or others. When the result data calculated by one or more node devices in the peer-to-peer computing system matches the request command, the result corresponding to the request command is represented in the result data output by one or more node devices, according to preset conditions, a pre-deployed program, or a data processing model deployed on the node device. If, based on collaborative computing, it is determined that the current node device needs to respond to the request command, the current node device will send instructions to the execution device connected to it according to the calculated result data, controlling the execution device to complete the response action; this is the "request-execution" scenario. In this invention, if the information display device needs to display a local part of the three-dimensional global model based on collaborative computing, the current node device will send a display control command to the information display device connected to the current node device according to the calculated result data, and control the information display device to complete the display of the local part of the three-dimensional global model.

[0100] Based on peer-to-peer computing, the execution device can act as one of the node devices. As collaborative computing progresses, when the result data obtained by the execution device can correspond to the request command and perform the relevant operation, the execution device completes the response to the request command. In this invention, the local representation of the three-dimensional global model is transformed into result data; the information display device receives the result data output by the connected node device. If a specific element in the result data indicates that the information display device needs to display a local part of the three-dimensional global model;

[0101] Alternatively, the resulting data can be used as one of the inputs to the data processing model of the node device to calculate and determine the corresponding information display device that needs to display a part of the three-dimensional global model, and then the information display device will display the corresponding part of the three-dimensional global model.

[0102] When an information display device needs to display a portion of a 3D global model, it combines the result data received from other node devices to calculate its own result data. Based on this result data, the information display device controls the display of the corresponding portion of the 3D global model. In this invention, the information display device does not need to first determine whether it needs to respond. Instead, it combines the result data received from other node devices with the perception data collected by its own sensors, inputs this data into its own data processing model, and the output result data determines whether the information display device displays a portion of the 3D global model, and which portion of the 3D global model to display.

[0103] In this invention, the calculated results include the optimal solutions for all scenarios obtained through collaborative computation between all users within the display area and the external environment at the current moment; local parts of the 3D global model are displayed through information display devices. In this invention, the results of various information calculations in the peer-to-peer computing system are presented as result data. All information display devices, as node devices, contribute the optimal solutions for all scenarios during collaborative computation within the peer-to-peer computing system. Furthermore, the display control commands for all information display devices are the optimal solution commands output by the node devices connected to them after collaborative computation. This invention eliminates the traditional generation and sending commands to avoid security vulnerabilities that could make information display devices a risk point.

[0104] In this embodiment, the information display device is a node device that connects to the execution components of a specific function. The execution feedback information of the execution components of the information display device is fed back to the information display device and participates in the calculation of the subsequent result data of the information display device.

[0105] In this invention, since the information display device can serve as one of the node devices, its response execution is based on the computational results obtained through collaborative computing, resulting in high response efficiency and avoiding illegal responses such as false execution or failure to execute when required due to network attacks. To prevent hijacking, this invention can also use multiple node devices to collaboratively control the information display device, further enhancing its immunity to hijacking attacks.

[0106] In a peer-to-peer computing system, the result data calculated and output by node devices can be implemented as a state corresponding to the perceived data (i.e., the raw data), which can be represented using state values. Therefore, node devices do not need to store and transmit the raw data. In this embodiment, the data or elements in the multidimensional matrix are related to the installation location, attributes, etc., of each node device. Therefore, when transmitting the result data, what is actually transmitted is the transcoded result after transcoding multiple sets of parameters. A multidimensional matrix is ​​actually a combination of multiple sets of parameters. For example, if the path to a target is from abcd, and the physical locations of the abcd node devices are fixed, then the sequence abcd can be expressed using a single character or a similar concept during multi-parameter transcoding and transmission.

[0107] Based on the technical characteristics of peer-to-peer computing, it can be applied to various application scenarios that provide targeted services or control for a specific target or event. Since the data transmitted between node devices is the result of information processing, rather than the information itself, the raw data collected (i.e., perceived data) does not need to be stored. Node devices only receive the computation results output by other node devices and send out their own computation results. The information contained in a single computation result is insufficient to reconstruct any event or target information; a definite result can only be obtained through collaborative computation involving the computation results across the entire peer-to-peer computing system, multi-dimensional data matrix elements, and the correspondence between physical space and facilities. Collaborative computation has less dependence on the information transmitted by a few node devices, thus fundamentally changing the traditional single-point security sensitivity of information systems.

[0108] In this invention, since the output data of each node device reflects the state evolution of the output data of the preceding node devices, the behavior, attributes, state, or events of the target when it was perceived by the preceding node devices can be inferred based on the output data received by the current node device. For example, when it is necessary to find the location of target 'a' 15 minutes ago, the location of the node device that perceived target 'a' can be obtained at the current moment, thus inferring the location of target 'a'. Then, based on the transmission path of the output data, it can be inferred back to 15 minutes ago to estimate the location of target 'a' 15 minutes ago (determined by the node device that perceived target 'a'). Furthermore, the node device does not need to store the original data about target 'a'. That is, based on this invention, it is not necessary to identify the original data to find target 'a', but rather to first infer the node device that perceived target 'a', and if necessary, obtain the original data about target 'a' at the time when it needs to be found from the storage device connected to the node device.

[0109] In this invention, the information display device receives the result data output by other node devices. The principle is as follows: when a corresponding information display device needs to display a part of the three-dimensional global model, if the result data calculated by one or more node devices can determine the information display device that needs to display the part of the three-dimensional global model, then the corresponding information display device is added to the node list for transmitting the current result data. The one or more node devices directly transmit the result data to the information display device or the node device connected to the information display device. The corresponding information display device is added to the node list for transmitting result data based on preset conditions or algorithm output and model output.

[0110] Alternatively, the information display device receives the result data output by other node devices in a layer-by-layer transmission manner. During the collaborative computing process of the peer-to-peer computing system, each node device calculates a list of nodes that need to receive the result data. Based on the current result data, it clearly knows which one or more execution devices (including the information display device) need to be added, and these are added to the node list. The execution device or the node device connected to it is directly used as the next-layer node device to directly receive the current result data, thus achieving cross-layer transmission and transforming the peer-to-peer computing system into a three-dimensional architecture. For example, if the result data of the current node device clearly indicates that evidence needs to be presented, according to the normal layer-by-layer transmission method, the result data of the current node device would require at least one or more layers of transmission to reach the corresponding node device. However, if the corresponding node device is added to the node list, it can directly receive the result data of the current node device in the next layer of transmission, thereby greatly shortening the processing time and improving responsiveness. This invention adopts a peer-to-peer computing system; therefore, this temporary construction is precisely the advantage of this invention. Traditional layer-by-layer information aggregation architectures cannot withstand the complex computing demands brought about by such a temporary network construction.

[0111] The above embodiments are merely illustrative of the present invention and are not intended to limit the invention. Any changes or modifications to the above embodiments based on the technical essence of the present invention will fall within the scope of the claims of the present invention.

Claims

1. A method for displaying visual information, characterized in that, A 3D global model is constructed by performing 3D modeling on real objects within the modeling area; the 3D global model contains 3D object models corresponding to the real objects; the 3D object models are set with associated visualization information; Within the modeling area, users observe real objects through the transparent display screen of the bound information display device; The 3D global model sets the 3D object model to transparent and then displays it through the transparent display screen of the information display device; When a 3D object model overlaps with its corresponding real object to a certain extent in a transparent display screen, the visual information associated with the 3D object model is presented in a related manner with the real object. The peer-to-peer computing system is used to perform non-specific feature recognition and location recognition of targets, including real objects and information display devices within the modeling area. The peer-to-peer computing system includes multiple node devices, and there is no hierarchy among the node devices. Each node device is equipped with a data acquisition device and a computing module. The data acquisition device includes at least one type of sensor, including an image acquisition device, for collecting different types of sensing data. Node devices located at different acquisition positions collect at least one point sample of the target, and the point sample is sensing data of the corresponding sensor type. For a given node device, the collected sensing data is processed to obtain result data, which is then propagated to other node devices. Other node devices receiving the result data use it as one of the original collected data, influencing the result data of other node devices. Based on this, without needing to obtain the target's identity information, multiple node devices in the peer-to-peer computing system perform collaborative computation to determine each unique target as itself, achieving non-specific feature recognition and target location identification. In a peer-to-peer computing system, for a specific point sample of a target, the resulting data transmitted from the node device that collected the point sample to other node devices allows subsequent node devices to adjust their perceptual attention based on the features of that point sample, or report the features of that point sample for subsequent node devices to adjust their perceptual attention. If other subsequent node devices do not detect the features of that point sample, but can determine from the features of other point samples that the undetected features still belong to the target, then the undetected features of that point sample are continued to be represented in the result data of the current node device and transmitted to other node devices.

2. The method for displaying visualized information according to claim 1, characterized in that, Real-time acquisition of the spatial location information and attitude of the information display device within the modeling area; The orientation of the transparent display screen is calculated based on the posture of the information display device. By combining the display parameters of the transparent display screen, the aforementioned spatial location information, and the orientation of the transparent display screen, the display range of the three-dimensional global model to be displayed is determined and then displayed on the transparent display screen.

3. The method for displaying visualized information according to claim 2, characterized in that, Based on the spatial location information of the information display device within the modeling area, obtain the corresponding visual point in the three-dimensional global model; Based on the orientation of the transparent display screen, the corresponding viewpoint in the 3D global model is obtained; combining the aforementioned visual point and viewpoint, the corresponding local part of the 3D global model to be displayed is calculated; the display parameters of the transparent display screen include size and resolution; based on the resolution of the transparent display screen, the display ratio of the local part of the 3D global model is determined; then, the 3D global model is cropped and displayed according to the size of the transparent display screen, which is the display range.

4. The method for displaying visualized information according to claim 3, characterized in that, Establish a corresponding spatial coordinate system between the modeling area and the 3D global model; obtain the spatial position information of the information display device within the modeling area, including horizontal and vertical position information, and then obtain the spatial coordinates of the information display device within the modeling area; based on the correspondence between the spatial coordinate systems of the modeling area and the 3D global model, obtain the corresponding visual point in the 3D global model.

5. The method for displaying visualized information according to claim 4, characterized in that, The information display device is equipped with several identification marks for visual recognition. For a monitoring image containing the information display device, the orientation of the information display device is calculated based on the identification marks in the monitoring image and the known three-dimensional appearance dimensions of the information display device, thereby obtaining the orientation of the transparent display screen.

6. The method for displaying visualized information according to claim 5, characterized in that, The monitoring equipment acquires monitoring images, and the spatial coordinates of the road surface and facade within the monitoring images are calibrated. Based on the installation location and angle of the monitoring equipment, the spatial coordinates of the identification signs in the monitoring images are calculated using geometric perspective methods. Based on the three-dimensional appearance dimensions of the information display equipment, the orientation of the information display equipment is calculated.

7. The method for displaying visualized information according to claim 4, characterized in that, A two-dimensional dot matrix is ​​set within the modeling area. The information display device captures the two-dimensional dot matrix through a camera. Using the perspective distortion, size, and spatial position information of the two-dimensional dot matrix, the attitude and spatial position information of the information display device are calculated, thereby obtaining the orientation of the transparent display screen.

8. The method for displaying visualized information according to claim 2, characterized in that, It also acquires real-time three-dimensional motion data of the information display device through sensors, including acceleration sensing data, angular velocity sensing data, attitude sensing data, and height sensing data, and calculates the spatial position information of the information display device and the orientation of the transparent display screen in real time.

9. The method for displaying visualized information according to claim 1, characterized in that, The information display device is a wearable pair of glasses, including a transparent display screen in the form of lenses, an inward-facing camera facing the user's eyes, and an outward-facing camera facing forward of the line of sight. The inward-facing camera acquires the interpupillary distance of the user's eyes and the visual distance between the eyes and the transparent display screen. Combined with the real-life images acquired by the outward-facing camera, the lens parameters are calculated when the user's eyes are regarded as the camera. The real-life images and lens parameters are sent to a 3D engine that constructs and manages a 3D global model. The 3D engine, based on the real-life images and lens parameters, displays a portion of the corresponding 3D global model on the transparent display screen, achieving a certain degree of overlap between the 3D object model and the corresponding real object, and establishing a connection between the visualized information associated with the 3D object model and the real object.

10. The method for displaying visualized information according to claim 9, characterized in that, The information display device also includes a light emitter facing the human eye, with the light emitter and the inward-facing camera positioned relatively fixed. The light emitter emits light towards the human eye, and the emitted light is emitted by at least one light source at a fixed distance. The inward-facing camera acquires the reflected image of the human eye, which is the image formed by the light on the retina of the human eye. The gaze point is determined by the reflected image, and then the position where the gaze rests on the transparent display screen is determined, and the corresponding real object where the gaze rests is acquired. Corresponding to the real object where the gaze rests, the corresponding visual information is presented; or, the three-dimensional object model at the position where the gaze rests on the transparent display screen is used as the operation object, and the user operates on it.

11. The method for displaying visualized information according to claim 1, characterized in that, The real objects include fixed objects and moving objects. The 3D object model includes a 3D fixed model corresponding to the fixed object and a 3D moving model corresponding to the moving object. The position of the 3D moving model in the 3D global model is adjusted in real time to follow the real position of the moving object in the modeling area. The visualization information follows the display of fixed objects and moving objects on the transparent display screen.

12. The method for displaying visualized information according to claim 1, characterized in that, Based on the plot of the work, the plot corresponding to each set location is pre-marked in the 3D global model; when the user observes the set location in the modeling area, the corresponding plot is displayed; the user uploads additional information, which is presented in the set location in the 3D global model and an access link is generated; for the user, the access link is provided to the user at the location of the content in the work corresponding to the set location.

13. The method for displaying visualized information according to claim 12, characterized in that, When a user views a work online and adds an access link to at least one location of the 3D global model in the selected content, or when a user observes or browses the 3D global model in the modeling area and marks at least one piece of content in the work at a selected location; then, the access link is provided to the user at the location of the selected content or the marked content in the work. Users can access a local view of a specific 3D global model by visiting a link, and if additional information is included, they can also view that additional information.

14. The method for displaying visualized information according to claim 13, characterized in that, The additional information refers to the user's creation of a 3D character model's action combination, video, or photo based on the plot corresponding to the set location. The 3D character model, video, or photo is composited into the 3D global model with the set location as the background. When the user views the work online, they can obtain an access link in the work corresponding to the plot of the set location and access the 3D character model, video, or photo composited in the 3D global model through the access link.

15. The method for displaying visualized information according to claim 14, characterized in that, The works mentioned include written works or film and television works; when users read written works or watch film and television works online, the corresponding access links are provided to users for the plot corresponding to the set position in the works.

16. The method for displaying visualized information according to claim 1, characterized in that, The current node device receives the result data output by other node devices; for the current node device, it combines the collected sensing data with the result data from other node devices to calculate the result data of the current node device, and then sends it to other node devices; In a peer-to-peer computing system, node devices perform collaborative computing as they collect sensing data and calculate result data.

17. The method for displaying visualized information according to claim 1, characterized in that, The method for reporting the features of the point sample to subsequent node devices for adjusting the perceptual attention is as follows: based on the result data expressing the features of the point sample provided by the preceding node device, or the features of the point sample, adjust the parameters of the data processing model of the subsequent node device so that the subsequent node device can improve the computing power of the subsequent node device to identify the features of the point sample; or, the subsequent node device uses the perceptual attention model to match the features of the received point sample or the result data expressing the features of the point sample to adjust the computing power.

18. The method for displaying visualized information according to claim 17, characterized in that, When a node device processes the output data of several preceding node devices, based on the data processing model, if the target described by several preceding node devices can be identified as the same target through certain common point sample features, the point sample features and other information described by each node device are merged into the same target.

19. The method for displaying visualized information according to claim 18, characterized in that, If the result data received by a node device indicates that the flag used by the current node device to identify the target before the current receipt of result data is different from the flag used by other node devices to identify the target, and the flags assigned to the target by other node devices have been updated, then the flag used by the current node device to identify the target before the current receipt of result data is converted.

20. The method for displaying visualized information according to claim 19, characterized in that, The method for converting the flag used to identify the target by the current node device before the current reception of result data is as follows: Replace the flag used by the current node device to identify the target before the current reception of result data with the latest flag assigned to the target by other node devices; Alternatively, record the conversion relationship between the flag used by the current node device to identify the target before the current reception of result data and the updated flags assigned to the target by other node devices, and perform the conversion when it is necessary to reference the result data received by the current node device in the current reception. Alternatively, node devices can deploy transformation models to perform corresponding transformations on the labels of multiple targets based on the input raw data or result data.

21. The method for displaying visualized information according to claim 1, characterized in that, For one or more point samples collected sequentially by node devices at different collection locations, if the feature values ​​of one or more point samples at different collection locations meet the preset similarity conditions or are determined by a specific model to have a correlation threshold, and are unique at each collection location, then it is determined that the point samples at different collection locations are correlated.

22. The method for displaying visualized information according to claim 1, characterized in that, If node devices at different acquisition locations collect one or more point samples simultaneously, and if the node devices at different acquisition locations collect samples from the same spatial field, and there is only one target in the spatial field, or the collected point sample can correctly point to one of the multiple targets, then for a certain target, the one or more point samples collected by node devices at different acquisition locations are correlated.

23. The method for displaying visualized information according to claim 22, characterized in that, The data acquisition device of the node equipment includes several or all of the following: image acquisition device, electromagnetic induction device, temperature measurement device, vibration frequency sensing device, and lidar. It jointly calculates the data acquired by the image acquisition device, electromagnetic induction device, temperature measurement device, or vibration frequency sensing device with the 3D point cloud acquired by the lidar to obtain 3D points with data. Alternatively, it jointly calculates the point cloud generated from images acquired by multiple image acquisition devices with the data acquired by the electromagnetic induction device, temperature measurement device, vibration frequency sensing device, or lidar to obtain 3D points with data. It uses image color, contour, lines, reflectivity, motion trend, electromagnetic characteristics, temperature, temperature change trend, vibration frequency, and vibration frequency change trend based on 2D perception as additional attributes of the corresponding 3D points to construct an attributed 3D point cloud. Combining electromagnetic induction, temperature patterns, vibration frequency change characteristics, motion correlation, and reflectivity, it determines the correspondence between each region of the attributed 3D point cloud and each part or related part of the target's 3D appearance.

24. The method for displaying visualized information according to claim 1, characterized in that, When it is necessary to obtain the target's identity information, an identity information acquisition command is triggered. The identity information acquisition command is used as one of the inputs to participate in the calculation of the result data of the node device. By driving the node device in the peer-to-peer computing system that is connected to the barrier-free data acquisition conditions that can obtain the target's identity information, the corresponding result data is responded to, thereby realizing the acquisition of the target's identity information.

25. The method for displaying visualized information according to claim 24, characterized in that, Peer-to-peer computing systems determine a target's permissions by verifying the authenticity of the target's identity information. In this system, the node devices that can obtain identity information do not provide the identity information itself, but only express the verification results in the result data of the node device based on the verification requirements for the authenticity of the identity information in the received result data.

26. The method for displaying visualized information according to claim 25, characterized in that, In a peer-to-peer computing system, node devices capable of acquiring identity information do not provide identity information. Instead, the information source device that drives the provision of identity information establishes an encrypted information transmission channel with the node device input terminal that needs to acquire identity information, or establishes an encrypted information transmission channel using other network communication modes, and uses the identity information as one of the inputs to the node device.

27. The method for displaying visualized information according to claim 1, characterized in that, The data acquisition device includes one or more of the following: image acquisition device, audio acquisition device, temperature measurement device, vibration frequency sensing device, lidar, chemical sensor, and electromagnetic induction device.

Images