Live management of real world via persistent virtual world system

Abstract

A method of live management of events in the real world by a persistent virtual world system includes providing a database with structured data in a memory of a server, the database storing the persistent virtual world system, the persistent virtual world system including a virtual copy of a real world element; synchronizing the virtual copies with corresponding real-world elements by using a plurality of connection elements connected to the server via a network, the connection elements comprising a sensing mechanism configured to capture data from the real-world elements; events in the real world are managed through a synchronized persistent virtual world system. Event management includes monitoring activities in the real world through a persistent virtual world system; detecting an event; checking whether the event belongs to one or more predetermined analysis requirement parameters; defining a time range of the event; storing the event in a memory; recreating the event; the event is analyzed.

Description

[0001] This application is a divisional application of the following application:

[0002] Application number of the original application: 202010440497.4

[0003] Filing date of original application: May 22, 2020,

[0004] Title of the invention of the original application: Live management of the real world via a persistent virtual world system Technical Field

[0005] The present disclosure relates generally to computer systems, and more particularly to a system and method that enables live management of the real world via a persistent virtual world system. Background Art

[0006] A virtual world is a simulated environment that provides a graphical and physical representation of a real or imaginary world in which users can interact with each other or other elements through avatars. Virtual worlds are used, for example, to create video games, animated films, or to train pilots in flight simulations. In all of these applications, programs are used to render features that interact, move, and change based on user input or programmed / learned behavior.

[0007] Objects in virtual worlds may follow rules related to gravity, terrain, movement, physics, and kinematics, which may or may not be based on real-world elements. Therefore, current technology exists for creating virtual copies of real-world items. However, these virtual copies typically do not contain all the data for the real-world elements and the context around them. Furthermore, the copies are typically not synchronized with their real-world counterparts to reflect changes made in the real world. This limits the use of virtual worlds for important applications such as the management of buildings, factories, and cities, and for the ability to identify anomalies in those environments. For example, in order to track an accident that may have occurred on a road, in a factory, in a home, etc., it is typically necessary to flip through hours of footage to determine the correct moment when the accident occurred.

[0008] Therefore, there is a need for improvements in the way virtual copies of real-world elements are generated and synchronized. Summary of the invention

[0009] This Summary is provided to introduce some concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.

[0010] One or more of the shortcomings described in the background technology are solved by the system and method of the present disclosure, which enables events occurring in the real world to be managed via a persistent virtual world system stored in a memory of a server. In the present disclosure, the term "event" refers to an activity occurring in the real world that can be simulated in real time via a persistent virtual world system. Events can be determined by computer logic under multiple criteria that can be defined within value thresholds. Events can be classified into normal events and abnormal events. Normal events involve activities that fall within predetermined standard parameter values, while abnormal events refer to events that fall outside predetermined parameter values.

[0011] The system of the present disclosure includes a server system, the server system includes one or more server computers, each server computer includes a memory and at least one processor, the server system includes a database with structured data, the database stores a persistent virtual world system including virtual copies of real world elements; and a plurality of connection elements connected to the server via a network, each connection element includes a communication circuit and one or more sensing mechanisms, the one or more sensing mechanisms are configured to capture data from one or more real world elements, so as to enable synchronization between the real world and the persistent virtual world system. The server system is configured to synchronize the persistent virtual world system and the real world elements using the dynamic data and static data captured by the connection elements, and through the synchronized persistent virtual world system, it is possible to achieve live management of events in the real world.

[0012] According to an embodiment, the connected element is one or more mobile phones, laptops, wearable computers, mobile game consoles, head mounted displays, see-through devices, smart contact lenses, surveillance cameras, vehicles, traffic lights, buildings, streets, train tracks, household appliances, or any other device that can be connected to a network. According to one embodiment, the plurality of sensing mechanisms mounted on the connected element include one or more temperature sensors, proximity sensors, inertial sensors, infrared sensors, pollution sensors (e.g., gas sensors), pressure sensors, light sensors, ultrasonic sensors, smoke sensors, touch sensors, color sensors, humidity sensors, water sensors, electrical sensors, or combinations thereof.

[0013] In some embodiments, management of events in the real world includes one or more of the following steps: monitoring activities in the real world through the persistent virtual world system; detecting the event, wherein the event is limited to a predetermined parameter value compared to an actual value of the activity in the real world; checking whether the event falls within one or more predetermined analysis requirement parameters; wherein the checking includes, in a negative case where the event falls outside of the one or more predetermined analysis requirement parameters, continuing to monitor the activity in the real world, and in a positive case where the event falls within the one or more predetermined analysis requirement parameters, continuing the following processing: limiting the time range of the event; storing the event in the memory; recreating the event; and analyzing the event.

[0014] In various embodiments, monitoring of events may be performed by multiple sensing mechanisms on multiple connected elements connected to a server via a network, and may include passive observation of activities occurring in the real world.

[0015] Detecting an event may be performed by comparing an actual value of an activity occurring in the real world with a predetermined standard value range associated with the event. In other embodiments, detecting an event further comprises classifying the event as a normal or abnormal event.

[0016] Recreating the event can be performed by generating event data points including data collected over the duration of the event, generating simulation data corresponding to the duration of the event, or a combination thereof. In some embodiments, the reconstruction of the event also includes replaying events and experiences related to the event in a digital reality (e.g., augmented reality, or virtual reality, or a combination thereof).

[0017] Analysis of events can be performed by applying statistical and / or logical algorithms to describe, compress and evaluate the events. Analysis of events can be performed automatically by artificial intelligence algorithms, or can involve human interaction.

[0018] According to one embodiment, recreating an event in digital reality can provide an event analyzer with a context-rich 3D image and experience of the event, which may be helpful during event analysis. In some embodiments, events can be viewed and analyzed from different perspectives. In other embodiments, recreating an event can also provide other types of experiences created during the generation of event data points, including simulations of audio data, tactile data, motion data, connected elements or system data (such as vehicle telemetry, drone telemetry), text data (e.g., subtitles, comments, annotations, etc.).

[0019] According to one embodiment, the management of events also includes manipulating events through artificial intelligence algorithms or user input. As a result of the analysis of the event, the operation of the event can be performed. The operation of the event can trigger one or more actions on one or more real world elements through corresponding virtual copies of one or more real world elements in the persistent virtual world system. In some embodiments, the operation of the event may be affected by whether the event is a normal event or an abnormal event.

[0020] According to one embodiment, the management of events includes sharing the stored events with one or more users through a network through a server system or one or more other servers. The sharing of events can be performed to perform further analysis of the events, further operations, or a combination thereof.

[0021] According to one embodiment, the occurrence of an event has an impact on the context around the event, and triggering other events in the real world through the persistent virtual world system includes interactions between one or more real world elements within the affected context. This impact on the context of the event can trigger further operations of the real world elements, which can provide further data for analyzing the event.

[0022] In some embodiments, a persistent virtual world system includes a virtual 3D infrastructure including one or more virtual counterparts, purely virtual objects, virtual pathways, and digital reality applications, or a combination thereof, enabling spatial organization, behavior, computation, and logical interaction between and with elements of the real world through corresponding virtual counterparts of elements of the real world. Virtual pathways of the virtual 3D infrastructure may be used to define and delimit paths of real objects through their virtual counterparts, purely virtual objects, or digital reality applications.

[0023] According to one embodiment, the data used to synchronize the virtual copy with the corresponding real-world element includes the captureable data of the real-world element. The data includes, for example, one or more of 3D image data, 3D geometry, 3D entities, 3D perception data, 3D dynamic objects, video data, audio data, priority data, chemical composition, waste production data, text data, time data, position data, orientation data, speed data, temperature data, humidity data, pollution data, lighting data, volume data, flow data, chromaticity data, power consumption data, bandwidth data, and mass data. In some embodiments, static data includes data that is unlikely to change, such as the location, position, and orientation of static objects, such as buildings and interior elements, memorials, parks, natural structures, etc. In other embodiments, dynamic data includes data that is updated periodically, which means that it can change asynchronously over time as new information becomes available. For example, dynamic data may include the position and orientation of a moving object (such as a vehicle), or other data that changes over time, such as temperature, pressure, humidity, etc.

[0024] In some embodiments, the data used to synchronize the virtual copy also includes contextual data, which can be classified into micro-contexts that directly affect real-world elements, and macro-contexts derived from multiple micro-contexts. In further embodiments, the micro-contexts also include 3D image data, 3D geometry, 3D entities, 3D dynamic objects, video data, audio data, text data, time data, metadata, priority data, security data, location data, lighting data, temperature data, quality of service (QOS), and service contexts of the environment that directly surrounds and affects the target real-world element. In further embodiments, the macro-context also includes overall information of the system, including the current efficiency of the manufacturing plant, air quality, climate change levels, company efficiency, city efficiency, national efficiency, and global efficiency.

[0025] In some embodiments, the persistent virtual world system is composed of layers, where the outer layer includes the inner layer. The outer layer can represent higher-level entities, and the inner layer can represent lower-level layers, deeper entities. For example, the outer layer can represent a country, which can be composed of several cities, each of which represents the inner layer of the country. On the other hand, each city can include several districts, each district represents the inner layer of the city. The district can include several blocks, each block represents the inner layer of the district. Each block can include several houses, shops, and factories, for example, each of these elements represents the inner layer of the block. Finally, each of these inner layer elements of the block can also include a connection element with a sensing mechanism, which is configured to obtain real-time data to enrich and update the virtual copy.

[0026] In some embodiments, event management may be implemented by layers. For example, a human or AI administrator at the district level may be responsible for monitoring the district, and may be responsible for analyzing events therein to generate one or more operational instructions derived from the event analysis. In other examples, a human or AI administrator at the city level may be responsible for monitoring the city, and may be responsible for analyzing events therein to generate one or more operational instructions derived from the event analysis.

[0027] According to an embodiment, a method for implementing live management of events in the real world through a persistent virtual world system includes the following steps: providing a database with structured data in a memory of a server system, the database storing a persistent virtual world system, the persistent virtual world system including virtual copies of real-world elements; synchronizing the virtual copies with corresponding real-world elements using dynamic data and static data from a plurality of connected elements connected to the server via a network, the connected elements including a sensing mechanism configured to capture dynamic data from the real-world elements; and managing events in the real world through the synchronized persistent virtual world system.

[0028] According to an embodiment, a method for on-site management of events includes one or more of the following steps: a step of monitoring activities in the real world through a persistent virtual world system; detecting events, wherein the events are limited to predetermined parameter values ​​compared with actual values ​​of the activities in the real world; checking whether the events fall within one or more predetermined analysis requirement parameters; wherein the checking includes, in the negative case that the event falls outside the one or more predetermined analysis requirement parameters, continuing to monitor the activities in the real world, and in the positive case that the event falls within the one or more predetermined analysis requirement parameters, continuing the following processing: limiting the time range of the event; storing the event in a memory; recreating the event; analyzing the event.

[0029] According to one embodiment, a non-transitory computer-readable medium storing a program is configured to cause one or more processors to perform the following steps, including: providing a database with structured data, the database storing a persistent virtual world system including virtual copies of real-world elements; synchronizing the virtual copies with corresponding real-world elements using dynamic and static data obtained from multiple connected elements connected to a server via a network, the connected elements including sensing mechanisms, the sensing mechanisms being configured to capture dynamic data from the real-world elements; and managing events in the real world through the synchronized persistent virtual world system.

[0030] According to one embodiment, instructions recorded in a non-transitory computer-readable medium that enable management of events cause a processor to perform processing, including: monitoring activities in the real world through a persistent virtual world system; detecting events, wherein the events are limited to predetermined parameter values ​​compared to actual values ​​of the activities in the real world; checking whether the events fall within one or more predetermined analysis requirement parameters; wherein the checking step includes, in the negative case that the event falls outside the one or more predetermined analysis requirement parameters, continuing to monitor the activities in the real world, and in the positive case that the event falls within the one or more predetermined analysis requirement parameters, continuing the following processing: limiting the time range of the event; storing the event in a memory; recreating the event; and analyzing the event.

[0031] The above summary does not include an exhaustive list of all aspects of the present disclosure. It is contemplated that the present disclosure includes all systems and methods that can be practiced from all suitable combinations of the various aspects summarized above, as well as those disclosed in the following detailed description and those specifically pointed out in the claims filed with the present application. Such combinations have specific advantages that are not specifically stated in the above summary. Other features and advantages will become apparent from the accompanying drawings and the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The foregoing aspects and many of the attendant advantages will be more readily appreciated as the same become better understood with reference to the following detailed description when taken in conjunction with the accompanying drawings.

[0033] Figure 1 depicts a schematic representation of a system capable of live management of events in the real world through a persistent virtual world in accordance with an embodiment;

[0034] Figure 2 depicts a schematic representation of a detailed description of the capture of data for enriching and synchronizing a persistent virtual world system according to an embodiment;

[0035] Figure 3 depicts a schematic representation of the layers of a persistent virtual world system according to an embodiment;

[0036] Figure 4 A schematic representation of the system is described that details the relationship of the server to the connected elements of the real world;

[0037] Figure 5 depicts a schematic representation of a connection element according to an embodiment;

[0038] Figure 6 A block diagram depicting a method for enabling live management of events in the real world through a persistent virtual world according to an embodiment;

[0039] Figure 7 A block diagram detailing further steps of a method according to an embodiment enabling management of events in the real world by a persistent virtual world system is depicted. DETAILED DESCRIPTION

[0040] In the following description, reference is made to the accompanying drawings which illustrate various embodiments by way of example. In addition, various embodiments will be described below by reference to several examples. It should be understood that the embodiments may include changes in design and structure without departing from the scope of the claimed subject matter.

[0041] Figure 1 A schematic representation of a system 100 that enables real-time management of events in the real world through a persistent virtual world is depicted according to an embodiment. The system 100 includes static data 102 and dynamic data 104, which can be captured from elements of the real world through sensing mechanisms implemented on a connected element 106. The connected element 106 transmits the static data 102 and the dynamic data 104 via a network 108, for example in real time, to a server 110 storing a persistent virtual world system 112. Although a single server is mentioned herein, it should be understood that the persistent virtual world system 112 or other features described herein can be implemented or performed by a server system including one or more server computers.

[0042] In the present disclosure, the term "persistence" is used to characterize the state of a system that can continue to exist without the continued execution of a process or a network connection. For example, the term "persistence" can be used to characterize a virtual world system, wherein the virtual world system and all virtual copies, purely virtual objects, and digital reality applications included therein continue to exist after the process used to create the virtual copies, purely virtual objects, and digital reality applications stops, without relying on the user's connection to the virtual world system. Therefore, the virtual world system is saved in a non-volatile storage location, such as in the server 110. In this way, even if the user is not connected to the server, the virtual copies, purely virtual objects, and digital reality applications can interact and collaborate with each other when configured to achieve a specific goal.

[0043] In the present disclosure, the term "event" refers to an activity that occurs in the real world, which can be simulated in real time via a persistent virtual world system. Events can be determined by computer logic under multiple criteria that can be limited within a value threshold. Events can be classified into ordinary events and abnormal events. Ordinary events refer to activities that fall within a predetermined standard parameter value, while abnormal events refer to events that exceed a predetermined parameter value. For example, ordinary events can be mobile traffic, payment transactions, or sports, while abnormal events can refer to car accidents, potential ID / currency theft during payment transactions, or fouls / accidents during games. Due to the synchronization of real-world elements with their respective virtual copies, events can be updated in real time in a persistent virtual world system, which can serve during event management. In some embodiments, events are generated by artificial intelligence algorithms, user input, or a combination thereof. In other embodiments, events can be further affected by natural events, such as weather, force majeure events (e.g., earthquakes, lightning, floods, etc.), etc.

[0044] According to an embodiment, the data obtained from the connected elements includes capturable data of each real-world element, including one or more of 3D image data, 3D geometry, 3D entities, 3D dynamic objects, video data, audio data, priority data, chemical composition, waste production data, text data, time data, position data, orientation data, speed data, temperature data, humidity data, pollution data, lighting data, volume data, traffic data, chromaticity data, power consumption data, bandwidth data, telemetry data (e.g., vehicle telemetry data and equipment telemetry data), and massive data, etc.

[0045] In some embodiments, static data 102 includes data that is unlikely to change, such as the location, position, and orientation of static objects, such as buildings and interior elements, monuments, parks, natural structures, etc. In other embodiments, dynamic data 104 includes data that is updated periodically, meaning that it can change asynchronously over time as new information becomes available. For example, dynamic data 104 can include the location and orientation of a moving object (e.g., a vehicle), or other data that can change over time, such as temperature, pressure, humidity, etc.

[0046] In some embodiments, the network 108 may be, for example, a cellular network, and may employ various technologies, including Enhanced Data Rates for Global Evolution (EDGE), General Packet Radio Service (GPRS), Global System for Mobile Communications (GSM), Internet Protocol Multimedia Subsystem (IMS), Universal Mobile Telecommunications System (UMTS), etc., as well as any other suitable wireless media, such as WiMAX (WiMAX), Long Term Evolution (LTE) network, Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA) and Wireless Fidelity (WiFi), satellite, Mobile Ad Hoc Network (MANET), etc.

[0047] In an embodiment, to reduce hardware and network requirements, help reduce network latency, and improve the general digital reality experience, the system can be connected via a network including a combination of millimeter wave (mmW) or mmW and Sub 6GHz communication systems, such as via a fifth generation wireless system communication (5G). In other embodiments, the system can be connected via a wireless local area network (Wi-Fi), providing data at, for example, 60GHz. The communication system provided can allow low (e.g., about 1 to about 5 milliseconds) end-to-end (E2E) latency and high (e.g., 1-10) Gbps downlink speeds to endpoints in the field, consistent with the parameters necessary to execute typical highly interactive digital reality applications. This results in high-quality, low-latency, real-time digital application content streaming. In other embodiments, the system can be connected via a fourth generation wireless system communication (4G) communication, can be supported by a 4G communication system, or can include other wired or wireless communication systems.

[0048] In other embodiments, a global navigation satellite system (GNSS) (collectively referred to as a plurality of satellite-based navigation systems, such as GPS, BDS, Glonass, QZSS, Galileo, and IRNSS) may be used to achieve positioning of the device. Using signals from a sufficient number of satellites and techniques such as triangulation and trilateration, the GNSS can calculate the position, velocity, altitude, and time of the device. In a preferred embodiment, the external positioning system is enhanced by an assisted GNSS (AGNSS) through the architecture of an existing cellular communication network, wherein the existing architecture includes 5G. In other embodiments, the AGNSS tracking system is also supported by a 4G cellular communication network. In indoor embodiments, the GNSS is further enhanced by a radio wireless local area network such as Wi-Fi, preferably, but not limited to, providing 60GHz data. In alternative embodiments, the GNSS is enhanced by other technologies known in the art, such as differential GPS (DGPS), satellite-based augmentation systems (SBAS), and real-time kinematics (RTK) systems. In some embodiments, tracking of the device is achieved by a combination of AGNSS and inertial sensors in the device.

[0049] Figure 2 A schematic representation of a system 200 detailing the capture of data for enriching and synchronizing a persistent virtual world system is shown, according to an embodiment. Figure 2 Some elements of Figure 1 Elements of the invention are similar, and thus similar or identical reference numerals may be used to describe those elements.

[0050] System 200 includes a server 110 connected via a network 108 to a plurality of connected elements 106 that capture data 202 via various sensing mechanisms. The plurality of sensing mechanisms installed on the connected elements 106 capture sensory data 202 from themselves and from a context associated with each connected element 106 (including any real-world elements). Thus, each real-world element may or may not be a connected element 106. For example, a building may be both a connected element 106 and a real-world element, while a tree may represent only a real-world element and not a connected element 106 because, for example, a device that is not configured to capture or transmit data 202 may be connected to the tree. Data 202 is transmitted (e.g., in real time) to a persistent virtual world system 112 stored in server 110.

[0051] The plurality of connected elements 106 may include one or more mobile phones, laptops, wearable computers, personal computers, mobile game consoles, head mounted displays, see-through devices, surveillance cameras, vehicles, traffic lights, buildings and other structures, streets, train tracks, household appliances, or any other devices that may be connected via the network 108. According to an embodiment, the plurality of sensing mechanisms mounted on the connected elements 106 include one or more temperature sensors, proximity sensors, inertial sensors, infrared sensors, pollution sensors (e.g., gas sensors), pressure sensors, light sensors, ultrasonic sensors, smoke sensors, touch sensors, color sensors, humidity sensors, water sensors, electrical sensors, or combinations thereof.

[0052] although Figure 2 One server 110 is shown, but it is understood that more than one server 110 at one or more locations may be used to service a complex system including multiple connected elements 106 located in different locations. Thus, multiple connected elements 106 may be connected to one or more servers 110 depending on the location of the connected elements 106 at a particular point in time. Figure 2 As shown, multiple connection elements 106 may be connected to a server 110 and may also be connected to each other via a network 108 at the same time.

[0053] The sensory data 202 includes the data that can be captured for each real-world element, including 3D image data, 3D geometry, 3D entities, 3D dynamic objects, 3D avatars of users, objects and buildings, video data, audio data, priority data, chemical composition, waste generation data, text data, time data, location data, orientation data, speed data, temperature data, humidity data, pollution data, lighting data, volume data, flow data, color data, power consumption data, bandwidth data, mass data, or any other data that can be captured by a sensing mechanism. In addition to the data that directly corresponds to each real-world element, multiple sensing mechanisms also capture context data from the surrounding environment, which context data can be classified into micro-context 204 and macro-context 206.

[0054] As used in this disclosure, the term "real world element" refers to an element found in the real world that has physical properties that can be sensed by a sensing mechanism. Real world elements can be moving or static entities found in the real world, including humans, vehicles, buildings, objects, amusement places, natural formations, streets, and any other elements that can be found in the real world. The real world element data captured by the sensing mechanism of the connection element 106 can be extracted from 3D image data, 3D geometry, video data, audio data, temperature data, mass data, radiation data, tactile data, motion data, or any other captureable data that can be obtained by a sensing mechanism. In this way, the real world element itself can include a sensing mechanism and can capture data 202 itself. Therefore, for the perception of other connection elements 106, other connection elements 106 can also be classified as elements of the real world.

[0055] The term "context" or "context data" as used in this disclosure refers to data related to the direct or indirect environment of a specific real-world element, which can be categorized into "micro-context" and "macro-context".

[0056] The term "micro-context" refers to the context that directly surrounds a real-world element, such as a person, an object, or a condition that can directly affect a real-world element. The micro-context 204 may include data of the environment that directly surrounds and affects the target real-world element, such as 3D image data, 3D geometry, 3D entities, 3D dynamic objects, video data, audio data, text data, time data, metadata, priority data, security data, location data, lighting data, temperature data, and quality of service (QOS), etc. In an embodiment, the micro-context 204 also includes service context, which refers to the actual applications used by one or more users in the vicinity. As each application consumes bandwidth, the service context can provide the system 200 with valuable context information needed to evaluate providing network signals to each connected element 106.

[0057] The term "macro-context" refers to an indirect or more distant context surrounding a real-world element. A macro-context can be derived by the server 110 from multiple micro-contexts 204, thereby producing a more comprehensive information of the system, such as the current efficiency of a manufacturing plant, air quality, climate change levels, company efficiency, city efficiency, national efficiency, etc. Macro-context can be considered and calculated at different levels including a local level (e.g., an office or manufacturing plant), a neighborhood level, a city level, a national level, or even a planetary level. Therefore, the same real-world element data and micro-context data can derive different types of macro-contexts 206.

[0058] Figure 3 A schematic representation of the layers of the persistent virtual world system 112 is shown, according to an embodiment. Figure 3 Some elements of Figure 1-2 Elements of the invention are similar, and thus similar or identical reference numerals may be used to describe those elements.

[0059] In some embodiments, the persistent virtual world system 112 stored in the server 110 is composed of layers 302, wherein the outer layer defines a broad geographic area, the inner layer defines a smaller geographic area within the outer layer, and wherein event management is implemented by the layers. The outer layer can represent a higher-level entity, and the inner layer can represent a lower-level entity. For example, the outer layer can represent a country 304, which can be composed of several cities 306, each city 306 representing an inner layer of the country 304. On the other hand, each city 306 can include several districts 308, each district 308 representing an inner layer of the city 306. These districts can include several blocks 310, each block 310 representing an inner layer of the district 308. Each block can include several houses 312, stores 314, factories 316 and others 318, each of which represents an inner layer of the block 310. Finally, each of these inner layer elements of the block 310 can also include a connection element 106 with a sensing mechanism, which is configured to obtain real-time data that enriches and updates the virtual copy of the persistent virtual world system 112.

[0060] Figure 4 A schematic representation of system 400 is depicted, detailing the relationship of the server to connected elements of the real world. Figure 4 Some elements of Figure 1-3 Elements of the invention are similar, and thus similar or identical reference numerals may be used to describe those elements.

[0061] The system 400 of the present disclosure includes at least one server 110 and a plurality of connected elements 106 connected to the at least one server 110 via a network 108. The server 110 includes a memory 402 and at least one processor 404. The memory 402 stores a database having structured data, the database storing a persistent virtual world system 112, the persistent virtual world system 112 including a plurality of virtual copies 406 corresponding to respective real world elements, such as virtual copies 406A, B, and C. The virtual copies 406 are communicatively connected to the real world elements through sensing mechanisms attached to a plurality of devices connected to the server 110 via the network 108. The sensing mechanisms provide data 202 to the virtual copies 406, enabling synchronization of the real world and the persistent virtual world system 112. The at least one processor 404 is configured to enable live management of events in the real world through the synchronized persistent virtual world system 112.

[0062] Some virtual copies 406, i.e., virtual copies 406 of real-world elements that do not include any sensing mechanism (i.e., natural structures, vehicles that cannot be connected to the network, buildings that are not connected to the network, new elements that have not yet been connected to at least one server 110, etc.), may appear only graphically in the persistent virtual world system 112 and may be visually updated only via optical sensors (e.g., cameras or scanners) attached to other connected elements 106.

[0063] In some embodiments, the virtual replica includes one or more of 3D world and building data (e.g., SLAM or derived mapping-based data) that can be used to model 3D structures for digital reality applications; 3D geometry data; 3D point cloud data; or geographic information system data representing properties of real-world structures.

[0064] In some embodiments, the persistent virtual world system 112 includes a virtual 3D infrastructure that includes one or more virtual counterparts 406, purely virtual objects, virtual channels, and digital reality applications, or a combination thereof, enabling spatial organization, behavior, computation, and logical interaction between each other and elements of the real world through their respective virtual counterparts. Virtual channels of the virtual 3D infrastructure can be used to define and delimit paths of real objects through their virtual counterparts, purely virtual objects, or digital reality applications. For example, virtual channels can be used to delimit the flight path of a drone or aircraft by serving the flight path as a virtual channel that can be accessed and processed through the corresponding virtual counterpart.

[0065] At least one server 110 may provide computing resources sufficient to execute heavy-load applications, such as serving, distributing, computing, streaming, and / or rendering digital content from one or more digital reality applications for interaction with a user. In a preferred embodiment, the computing environment of server 110 runs on an abstracted, virtualized infrastructure that shares resources such as CPU, memory, and storage between applications, such as in a cloud server. Using a cloud computing network, access to computing power, computer infrastructure (e.g., through so-called infrastructure as a service, or IaaS), applications, and business processes can be delivered as a service to users on demand.

[0066] According to an embodiment, the memory 402 also includes a replica editor 408, which may include software and hardware configured to enable a user to model and edit a virtual replica 406 of a real-world entity. The replica editor 408 may be, for example, computer-aided drawing (CAD) software that may store data and instructions necessary to enter and edit the virtual replica 406. The replica editor 408 may enable entry of explicit data and instructions 410 related to each digital replica, which may involve data and instructions describing the shape, location, position and orientation, or other attributes, as well as the intended function and impact of each virtual replica 406 and the persistent virtual world system 112 as a whole.

[0067] "Explicit data" here refers to data that may not be obtained by a sensing mechanism, but may need to be digitally entered through the copy editor 408, such as priority data, building materials, wall thickness, electrical equipment and circuits, water pipes, fire extinguishers, emergency exits, window positions, machine performance parameters, machine sensors and valve positions, etc. "Priority data" as used here refers to a hierarchical classification of real-world entities. For example, certain vehicles (e.g., ambulances) or people (e.g., the president, government officials, police, etc.) may have higher priorities, which can affect decisions made based on data inferences. The term "instructions" used here refers to code (e.g., binary code) configured to be executed by a processor. In the context of a virtual copy 406, instructions may refer to code that represents the behavior of a real-world element.

[0068] The modeling techniques used to convert real-world entities into virtual copies 406 using explicit data and instructions 410 and make them available in the persistent virtual world system 112 can be based on readily available CAD models of real-world entities. For example, a machine owner can provide an administrator of the persistent virtual world system 112, or can input an existing digital CAD model of its machine himself. Similarly, a building owner can provide a building information model (BIM) with building details to be stored in the persistent virtual world system 112, which may include information that may not be visible or readily available via sensing mechanisms. In these embodiments, the owners of these real-world entities can be responsible for adding virtual copies to the persistent virtual world system 112, which can be achieved, for example, through an incentive system or through legal requirements. In some embodiments, administrators of the persistent virtual world system 112, or even government officials, can collaborate with the owners of the real-world entities to input real-world entities into the persistent virtual world system 112, and thus achieve faster and more thorough creation of the persistent virtual world system 112.

[0069] In other embodiments, radar imaging, such as synthetic aperture radar, real aperture radar, light detection and ranging (LIDAR), inverse aperture radar, monopulse radar, and other types of imaging techniques may be used to map and model real world entities prior to integrating them into the persistent virtual world system 112. Utilization of these additional techniques may be particularly useful in situations where the original model of a structure is not available, or where there is missing information or a need to add additional information to a virtual world entity that is not provided by the CAD model.

[0070] Independent of the modeling technology used to create the virtual copies 406, the information of each virtual copy 406 should provide sufficient details about each corresponding real-world element so that a highly accurate virtual copy 406 of each real-world element is available. The virtual copies 406 are then enriched and updated by the data 202. Thus, the virtual copies 406 include data 412 and instructions 414 for describing the realistic appearance and behavior of each real-world element, unless virtual copies 406 of non-connected elements are involved, which may only provide their respective realistic appearances and have no data and instructions about their functionality.

[0071] As about Figure 2As depicted, data 202 may also include contextual data, such as micro-context 204 including micro-contexts A, B, and C, and macro-context 206. This same data is then transmitted to persistent virtual world system 112 to become virtual micro-environments 416 including virtual micro-environments A, B, and C, respectively, and virtual macro-environment 418, which are updated in real time based on data 202 obtained through the sensing mechanism of connected element 106. Virtual micro-context 416 and virtual macro-context 418 also include data 412 and instructions 414, which are used to describe the corresponding real-world appearance and behavior.

[0072] Figure 5 A schematic representation of a system 500 is depicted, depicting a schematic representation of connected elements, according to an embodiment. Figure 5 Some elements of Figure 1-4 Elements of the invention are similar, and thus similar or identical reference numerals may be used to describe those elements.

[0073] The connection element 106 may include operational components such as an input / output (I / O) module 502; a power supply 504; a memory 506; a sensing mechanism 508 and a transceiver 510 forming a tracking module 512; and communication circuits such as a network interface 514, all operably connected to a processor 516.

[0074] The I / O module 502 is implemented as computing hardware and software configured to interact with a user and provide user input data to one or more other system components. For example, the I / O module 502 can be configured to interact with a user, generate user input data based on the interaction, and provide the user input data to the processor 516 before transmitting it to other processing systems (e.g., servers) via a network. In another example, the I / O module 502 is implemented as an external computing pointing device (e.g., a touch screen, a mouse, a 3D control, a joystick, a game pad, etc.) and / or a text input device (e.g., a keyboard, a dictation tool, etc.) that is configured to interact with other connected elements 106. In other embodiments, the I / O module 502 may provide different, additional, or less functionality than that described above.

[0075] The power supply 504 is implemented as computing hardware and software configured to provide power to the connection element 106. In one embodiment, the power supply 504 can be a battery. The power supply 504 can be built into the device or can be removed from the device, and can be rechargeable or non-rechargeable. In one embodiment, the device can be repowered by replacing one power supply 504 with another power supply 504. In another embodiment, the power supply 504 can be recharged by a cable attached to a charging source, such as a universal serial bus ("USB") FireWire, Ethernet, Thunderbolt interface or headphone cable attached to a personal computer. In another embodiment, the power supply 504 can be recharged by inductive charging, wherein an electromagnetic field is used to transfer energy from the inductive charger to the power supply 504 when the inductive charger and the power supply 504 are very close, but do not need to be inserted into each other by a cable. In another embodiment, a docking station can be used to facilitate charging.

[0076] The memory 506 may be implemented as computing hardware and software suitable for storing application instructions and storing data captured by a plurality of sensing mechanisms. The memory 506 may be of any suitable type capable of storing information accessible by the processor 516, including computer-readable media, or other media storing data that can be read with the aid of an electronic device, such as a hard drive, a memory card, a flash drive, ROM, RAM, a DVD or other optical disk, and other writable and read-only memories. In addition to permanent memory, the memory 506 may also include temporary memory.

[0077] The sensing mechanism can be implemented as computing hardware and software suitable for obtaining various data from the real world and determining / tracking the position and orientation of the connection element 106. The sensing mechanism may include, but is not limited to, one or more temperature sensors, proximity sensors, inertial sensors, infrared sensors, pollution sensors (e.g., gas sensors), pressure sensors, light sensors, ultrasonic sensors, smoke sensors, touch sensors, color sensors, humidity sensors, water sensors, electrical sensors, or combinations thereof. In particular, the sensing mechanism includes one or more inertial measurement units (IMUs), accelerometers, and gyroscopes. The IMU is configured to measure and report the velocity, acceleration, angular momentum, translational velocity, rotational velocity, and other telemetry metadata of the connection element 106 by using a combination of accelerometers and gyroscopes. The accelerometer within the IMU and / or the accelerometer configured separately from the IMU can be configured to measure the acceleration of the interactive device, including the acceleration caused by the earth's gravitational field. In one embodiment, the accelerometer includes a three-axis accelerometer capable of measuring acceleration in three orthogonal directions.

[0078] The transceiver 510 may be implemented as computing hardware and software configured to enable the device to receive radio waves from an antenna and send data back to the antenna. In some embodiments, a mmW transceiver may be used, which may be configured to receive mmW wave signals from an antenna and send data back to the antenna when interacting with immersive content. The transceiver 510 may be a two-way communication transceiver 510.

[0079] According to an embodiment, the transceiver 510 can realize direct communication between computing devices via a distributed ledger-based communications pipeline connected to a network. The communication pipeline based on the distributed ledger can allow information to be stored in a safe and accurate manner by using cryptography, sampling password "keys" and cryptographic signatures, so that direct communication can be performed between the connection elements 106 through a decentralized network. The situation where direct communication between the connection elements 106 may be required, and the situation where the bypass processing is performed by the server, may include emergency situations, where a decision may need to be made in a very short period of time. For example, in the case of autonomous driving where two vehicles are about to collide, it may be necessary to enable direct communication between the two vehicles to produce a faster response that can prevent the collision. In other embodiments, the distributed ledger can also be used between the server and the connection element 106, where the server can be responsible for verifying the data before distributing the data to each connection element 106. In a further embodiment, the distributed ledger can utilize certain connection elements 106 that are closer to the server, closer to the antenna, or both, so that these connection elements 106 are assigned as a central structure to verify and distribute data.

[0080] In an embodiment, the tracking module 512 may be implemented by combining the capabilities of an IMU, accelerometer, and gyroscope with the position tracking provided by the transceiver 510, and the precise tracking, low latency, and high QOS capabilities provided by the mmW-based antenna may enable sub-centimeter or sub-millimeter position and orientation tracking, which may improve accuracy when tracking the real-time position and orientation of the connected element 106. In an alternative embodiment, the sensing mechanism and the transceiver 510 may be coupled together in a single tracking module device.

[0081] The network interface 514 may be implemented as computing software and hardware to communicatively connect to a network, receive computer readable program instructions sent by a server or by other connected elements 106 from the network, and forward the computer readable program instructions for storage in the memory 506 for execution by the processor 516 .

[0082] The processor 516 can be implemented as computing hardware and software configured to receive and process data. For example, the processor 516 can be configured to provide imaging requests, receive imaging data, process imaging data into environment or other data, process user input data and / or imaging data to generate user interaction data, perform machine learning training and inference based on edge (on the device), provide server requests, receive server responses, and / or provide user interaction data, environment data and content object data to one or more other system components. For example, the processor 516 can receive user input data from the I / O module 502, and can implement the application stored in the memory 506 respectively. In other examples, the processor 516 can receive data captured from the real world from the sensing mechanism, or can receive the accurate position and orientation of the connection element 106 through the tracking module 512, and can prepare some data for further processing before sending the data to the server. As an example, the processor 516 can implement some steps required during data preparation, including analog or digital signal processing algorithms, such as raw data reduction or filtering of the data before sending the data to the server.

[0083] Figure 6 A block diagram of a method 600 according to an embodiment is shown, which enables real-time management of events in the real world through a persistent virtual world. The method 600 can be implemented by a system, for example, Figure 1-5 The system shown.

[0084] The method 600 begins at blocks 602 and 604, providing a database with structured data in a memory of a server, the database storing a persistent virtual world system including virtual copies of real world elements. The method 600 continues at step 606 by synchronizing the virtual copies with corresponding real world elements using a plurality of connected elements connected to the server via a network, the connected elements including a sensing mechanism configured to capture data from the real world elements. The method continues at step 608, managing events in the real world through the synchronized persistent virtual world system, and ends the process at step 610.

[0085] Figure 7 Shown according to Figure 6 The method 700 of the embodiment described above is a block diagram of the method 700, which describes in detail the other steps of the method 600, and the method 600 can manage events in the real world through the persistent virtual world system. The method 700 can be implemented by the system, for example, Figure 1-5 The system shown.

[0086] In steps 702 and 704, the management of events in the real world begins by monitoring activities in the real world through the persistent virtual world system. The management of events in the real world can be performed by connecting multiple connection elements connected to at least one server via a network (e.g., connecting to at least one server 110 via network 108). Figure 1 The monitoring of events may be performed by multiple sensing mechanisms on the connected elements 106 of the vehicle, and may include passive observation of all activities occurring in the real world. For example, the monitoring of events may refer to traffic behavior in a particular highway. For example, the monitoring may be performed by a combination of cameras installed in various areas of the highway, speed sensors on the sides of the highway, motion sensors, and by geographic location and directional tracking of each vehicle.

[0087] Method 700 can continue to frame 706, detect event, wherein event is limited to the predetermined parameter value compared with the actual value of activity in real world.In another embodiment, detect event also comprises classifying event as common event or abnormal event.For example, actual value can refer to the actual speed of each vehicle in highway or the average speed of all traffic in highway, and predetermined standard value range can refer to the expected speed range of each vehicle in highway or the expected average speed range of traffic.If the actual value of comparison falls within the predetermined standard value range, then event can be classified as common event.On the other hand, if the actual value of comparison falls outside the predetermined standard value range, then event can be classified as abnormal event, for example when vehicle is travelling at extremely high speed, or when automobile accident has occurred.

[0088] Method 700 continues in step 708 by checking whether the event falls within one or more predetermined analysis requirement parameters. Checking whether the event falls within one or more predetermined analysis requirement parameters refers to comparing the actual value of the detected event with a range of predetermined analysis requirement parameter values, which are defined as triggering analysis of the event. In some embodiments, an event is determined to be worthy of analysis depending on risk factors that may be associated with the event, such as risk to the safety or integrity of others, risk of contamination, risk of material damage, etc. Therefore, events worthy of analysis can be linked to key control points related to one or more activities being monitored. Examples of events worthy of analysis can be, for example, financial card payments, machine operations for critical processes, or the behavior of one or more vehicles in a crowded highway; the behavior of aircraft, water vehicles, or land vehicles; factory operations; and entertainment activities, such as video games, film production, sports activities, television, theater or music performances, etc.

[0089] If the method 700 determines that the event is not worth analyzing, the method 700 can loop back to step 704 to continue monitoring the real world. If the method 700 determines that the event is worth analyzing, the method 700 continues to step 710 to limit the time range of the event to identify the start and end time of the event, so as to further store the event in the memory of at least one server, as shown in step 712.

[0090] In step 714, method 700 continues by recreating the event. Recreating the event can be performed by generating event data points, which include data collected during the duration of the event worth analyzing. In some embodiments, recreating the event also includes generating simulation data corresponding to the duration of the event. In some embodiments, recreating the event also includes replaying events and experiences related to the event in digital reality (e.g., augmented reality, or virtual reality, or a combination thereof).

[0091] In step 716, the method can continue by analyzing the events, which can be performed by applying statistical and / or logical algorithms to describe, compress and evaluate the events. The analysis of the events can also be performed automatically by artificial intelligence algorithms, or can involve human interaction. The method 700 can end in step 718.

[0092] According to an embodiment, recreating an event in digital reality can provide an event analyzer with a context-rich 3D image and experience of the event, which may be helpful during event analysis. In some embodiments, the event can be reviewed and analyzed from different perspectives. For example, a car accident event can be reviewed and analyzed in virtual reality from the perspective of any one of two or more vehicles involved in a judicial investigation in order to determine the level of responsibility of each party involved. In other embodiments, recreating an event can also provide other types of experiences created during the generation of event data points, including simulations using audio data, tactile data, motion data, connection elements or system data (such as vehicle telemetry, drone telemetry), text data (e.g., subtitles, comments, annotations, etc.), etc.

[0093] According to one embodiment, the management of events also includes manipulating events through artificial intelligence algorithms or user input. As a result of the analysis of the events, the operation of the events can be performed. The operation of the events can trigger one or more actions on one or more real-world elements through corresponding virtual copies of one or more real-world elements in the persistent virtual world system. In some embodiments, the operation of the event may be affected by whether the event is a normal event or an abnormal event. Preferably, for high-risk events, the analysis is automatically performed by an artificial intelligence algorithm, and the artificial intelligence algorithm can determine at a relatively high speed the type of operation that may be required to correct the event or reduce the risk of the event. For example, in the case of a car accident, the artificial intelligence algorithm can determine that all cars in the area around the accident should slow down or stop to prevent further damage.

[0094] According to an embodiment, the management of events also includes sharing the stored events with other users through one or more other servers. The sharing of events can be performed in order to perform further analysis of the events, further operations, or a combination thereof.

[0095] According to an embodiment, the occurrence of an event has an impact on the context around the event, triggering other events in the real world through a persistent virtual world system, which includes interactions between one or more real world elements within the affected context. This impact on the event context can trigger further operations of the real world elements, which can provide further data for analyzing the event.

[0096] According to an embodiment, generating an event data point over the duration of an event refers to identifying data corresponding to an event. In a further embodiment, the event data point also includes contextual information. For example, during a car accident, the corresponding data point may refer to actual footage, which may be converted into a media stream to be replayed to an event analyzer for subsequent analysis. The data point may also include information about the speed, position, orientation, and route of the vehicle. In addition, in the current example, the contextual information that may be included in the data point may include the weather conditions in which the accident occurred, the condition of the traffic lights, other vehicles in the area, pedestrians or animals walking, or any other factors that may have an impact on the accident. The event data point may also include other data points that may be helpful during the event analysis, such as audio data, tactile data, motion data, text data, etc. All of these data points can be used to provide a context-rich replay of the event, which can then be analyzed by the event analyzer.

[0097] In some embodiments, the event can be replayed to the user as a digital reality experience, wherein the digital reality includes one or more of augmented reality, virtual reality, mixed reality, or a combination thereof. Therefore, in order to review the event, the event analyzer is able to view a context-rich 3D replay of the event in the digital reality through the user device, which can provide the event analyzer with further information that can help during the analysis. The event can be viewed from different perspectives, such as the perspective of any one of two or more vehicles involved. For example, investigating the cause of a car accident is usually very time-consuming. The police have to analyze the video from different angles, obtain a lot of evidence from witnesses, etc. However, being able to view and experience events in digital reality, such as virtual reality, may help speed up the efficiency of the investigation. In other embodiments, the replay of the event can also provide other types of experiences, including simulations of audio data, tactile data, motion data, text data (e.g., subtitles, comments, annotations, etc.), etc. Further perceptual experiences can be generated during the creation of event data points.

[0098] In some embodiments, management can be implemented through layers, such as reference Figure 3 Layer 302 of the description. For example, a human or AI administrator at the district level may be responsible for monitoring the district and may be responsible for analyzing events therein. In other examples, a human or AI administrator at the city level may be responsible for monitoring the city and may be responsible for analyzing events therein.

[0099] Although certain embodiments have been described and shown in the accompanying drawings, it should be understood that such embodiments are merely illustrative and not restrictive, and the invention is not limited to the specific structures and arrangements shown and described, as various other modifications may occur to those skilled in the art. Therefore, this description should be considered illustrative rather than limiting.

Claims

1. A system, characterized in that: include: a server system comprising one or more server computers, each server computer comprising a memory and at least one processor, the server system comprising a database having structured data, the database storing a persistent virtual world system comprising virtual copies of real world elements; and a plurality of connected elements connected to the server via a network, each connected element comprising communication circuitry and one or more sensing mechanisms configured to capture data from one or more of the real-world elements, wherein the server system is configured to synchronize the persistent virtual world system and the real world elements using static data and dynamic data captured by the connection elements, and enable management of events in the real world through the synchronized persistent virtual world system, and Wherein, it is necessary to analyze the event, and the server system is further configured as follows: storing the event in a memory; recreating the event by generating event data points comprising data collected over a duration of the event, or generating simulated data corresponding to the duration of the event, or a combination thereof; and The events are analyzed by analyzing data points and / or simulated data.

2. The system according to claim 1, characterized in that The management of the event further includes one or more of the following: Monitoring activities in the real world through the persistent virtual world system; detecting the event, wherein the event is confined to a predetermined parameter value compared to an actual value of the activity in the real world; checking whether the event falls within one or more predetermined analysis requirement parameters, wherein the checking comprises, in a negative case that the event falls outside the one or more predetermined analysis requirement parameters, continuing to monitor the activity in the real world, and in a positive case that the event falls within the one or more predetermined analysis requirement parameters, continuing the following processing: Limit the time frame of the events described; storing the event in the memory; re-create said event; and Analyze the event.

3. The system according to claim 2, characterized in that Detecting the event also includes classifying the event as a normal event or an abnormal event.

4. The system according to claim 1, characterized in that The management of the event also includes operating the event through an artificial intelligence algorithm.

5. The system according to claim 1, characterized in that The managing of the events includes sharing the stored events with one or more users.

6. The system according to claim 1, wherein: The event has an impact on the context around the event, and triggering other events in the real world through the persistent virtual world system includes interactions between one or more real world elements within the affected context.

7. The system according to claim 1, characterized in that The events are generated by artificial intelligence algorithms, user input, or a combination thereof, and wherein the events may be further influenced by natural events.

8. The system of claim 1, wherein: The persistent virtual world system is composed of layers including an outer layer and an inner layer, wherein the outer layer defines a broad geographical area and the inner layer defines a smaller geographical area within the outer layer, and wherein the management of the events is implemented by the layers.

9. The system according to claim 1, characterized in that The events involve data generated during a financial transaction; the behavior of an aircraft, watercraft, or land vehicle; machine or factory operation; or recreational activity; or a combination thereof.

10. A method, characterized in that include: providing a database having structured data in a memory of a server system, the database storing a persistent virtual world system including virtual copies of real world elements; synchronizing the virtual replica with corresponding real-world elements using dynamic data and static data from a plurality of connected elements connected to the server system via a network, the connected elements including a sensing mechanism configured to capture the dynamic data from the real-world elements; and providing management of events in the real world through a synchronized persistent virtual world system, and Among them, it is necessary to analyze the events, and the management of events includes: storing the event in a memory; recreating the event by generating event data points comprising data collected over a duration of the event, or generating simulated data corresponding to the duration of the event, or a combination thereof; and The events are analyzed by analyzing data points and / or simulated data.

11. The method according to claim 10, characterized in that The management of the real-world events further includes one or more of the following: Monitoring activities in the real world through the persistent virtual world system; detecting the event, wherein the event is confined to a predetermined parameter value compared to an actual value of the activity in the real world; checking whether the event falls within one or more predetermined analysis requirement parameters, wherein the checking comprises, in a negative case that the event falls outside the one or more predetermined analysis requirement parameters, continuing to monitor the activity in the real world, and in a positive case that the event falls within the one or more predetermined analysis requirement parameters, continuing the following processing: Limit the time frame of the events described; storing the event in the memory; re-create said event; and Analyze the event.

12. The method according to claim 11, characterized in that Detecting the event also includes classifying the event as a normal event or an abnormal event.

13. The method according to claim 10, characterized in that Management of the event also includes operating the event through artificial intelligence algorithms.

14. The method according to claim 10, characterized in that The management of the events includes sharing the stored events with one or more users.

15. The method according to claim 10, characterized in that The event has an impact on the context around the event, and triggering other events in the real world through the persistent virtual world system includes interactions between one or more real world elements within the affected context.

16. The method according to claim 10, characterized in that The events are generated by artificial intelligence algorithms, user input, or a combination thereof, and wherein the events may be further influenced by natural events.

17. The method of claim 10, wherein the persistent virtual world system is composed of layers including an outer layer and an inner layer, wherein the outer layer defines a broad geographic area and the inner layer defines a smaller geographic area within the outer layer, and wherein the management of the events is implemented by the layers.

18. A non-transitory computer-readable medium storing a program, characterized in that: The program is configured to cause one or more processors to perform steps, the steps comprising: providing a database having structured data, the database storing a persistent virtual world system including virtual copies of real world elements; synchronizing the virtual replica with the corresponding real-world element using dynamic data and static data from a plurality of connected elements connected to a server via a network, the connected elements including a sensing mechanism configured to capture the dynamic data from the real-world element; Providing management of events in the real world includes manipulation of events, wherein the manipulation of events triggers one or more actions on one or more real world elements through corresponding virtual copies of the one or more real world elements through the synchronized persistent virtual world system, and Among them, it is necessary to analyze the events, and the management of events includes: storing the event in a memory; recreating the event by generating event data points comprising data collected over a duration of the event, or generating simulated data corresponding to the duration of the event, or a combination thereof; and The events are analyzed by analyzing data points and / or simulated data.

Images