Real-time data acquisition and recording system viewer

Abstract

SOLUTION: A data acquisition and recording system (DARS) and viewer for mobile assets that includes a data encoder, onboard data manager, and a local memory module. DARS processes video data from a 360 degree camera and stores a compressed record of the data at least once per second in the local memory module. DARS runs in near real-time mode, storing a full record comprising five minutes of data to a remote memory module every five minutes, and in real-time mode, streaming video data to the remote memory module by uploading a record of data at least once per second and up to once every tenth of a second.EFFECT: Remotely located users can view video, audio, and data in various view modes through a web browser or virtual reality device, which provides for quicker emergency response, validate the effectiveness of repairs and rerouting, and monitor crew performance and safety.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application is a continuation, to the extent permitted by law, of U.S. Provisional Application No. 10 / 199,094 filed on May 16, 2016. Filed May 16, 2016, claiming priority to Patent Application No. 62 / 337,225 Claiming priority to U.S. Provisional Application No. 62 / 337,227, filed May 16, 2016 This application claims priority to U.S. Provisional Application No. 62 / 337,228, filed May 2017. This application claims priority to U.S. Nonprovisional Application No. 15 / 595,650, filed on January 15, and a continuation thereof, the contents of which are incorporated herein by reference in their entirety.

[0002] This disclosure provides a comprehensive analysis of real-time data acquisition and recording systems used on high-value moving assets. The present invention relates to a system and method for viewing video, images and data. [Background technology]

[0003] Locomotives, aircraft, mass transit systems, mining equipment, transportable medical equipment, cargo, ships, military High-value moving assets such as chartered vessels typically have on-board data acquisition and recording “black box” systems. Event data recorder and / or "event recorder" systems are employed. Data acquisition and recording systems such as flight data recorders (FDRs) are used for incident investigation, crew investigation, and Various systems used for operational evaluation, fuel consumption analysis, maintenance planning, and predictive diagnostics Typical data acquisition and recording systems include digital and analog It has inputs and pressure switches and pressure transducers, and can be used with various on-board sensor devices. The data recorded includes speed, distance traveled, location, fuel level, Engine revolutions per minute (RPM), fluid levels, driver controls, pressure, current and forecast This can include parameters such as the weather and ambient conditions that are measured. In addition to operational data, video and audio event / data recording capabilities are also available on many of these same mobile assets. Typically, after an incident involving assets occurs and an investigation is required, data records are When the data recorder is retrieved, the data is extracted from the data recorder. Situations may arise where the coder cannot recover or the data is unavailable for other reasons. In such circumstances, physical access to the data acquisition and recording system or its data may be lost. Events captured by data collection and recording systems, whether or not available And data such as motion data, video data, and audio data is needed quickly. Summary of the Invention [Means for solving the problem]

[0004] This disclosure generally relates to real-time data acquisition and recording systems used on high-value moving assets. The teachings herein relate to a real-time data acquisition and recording system on high-value moving assets. Data recorded by the system, such as event and action data, video data, and audio data The present invention can provide real-time or near real-time access to the 1. A method for processing, storing, and transmitting data from at least one mobile asset, comprising: The installation uses a multimedia management system onboard the mobile asset to provide at least one 36 0 degree camera, at least one fixed camera and at least one microphone receiving data based on at least one data signal from at least one of the The data is received by a data recorder mounted on the mobile asset, and the data recorder The data encoder of the reader is used to create a record containing a bitstream based on that data. and using the data recorder's on-board data manager to At least one of the data and the record is stored in at least one of the data recorders. and storing the information at a configurable first predetermined frequency in a local memory component.

[0005] One implementation of the method described herein for displaying data from at least one moving asset. using a web server to provide designated multimedia data and and receiving a request including the specified view mode, and using the web server: The at least one mobile asset is transferred to a remote memory component. and receiving a designated multimedia signal from the at least one mobile asset using a display device. and displaying the media data in the specified view.

[0006] One implementation of the real-time data acquisition and recording system described herein comprises at least One 360-degree camera, at least one fixed camera and at least one microphone and a multimedia management system onboard the mobile asset, At least one 360-degree camera, at least one fixed camera and at least one data based on at least one data signal from at least one of the microphones and at least one local memory component. The multimedia management system includes a data manager, an onboard data encoder, and a data recorder on board the mobile asset configured to receive data from the A data encoding configured to encode a record containing a bitstream based on and at least one of the data and the record is stored in at least one local a memory component configured to store on-board data at a configurable first predetermined frequency; Includes Tamamanager.

[0007] Variations on these and other aspects of the disclosure are described in further detail below. [Brief explanation of the drawings]

[0008] This description will be made with reference to the accompanying drawings, several of which are designated by like reference numerals. 1 shows similar parts. [Figure 1] 1 illustrates a field installation of an exemplary real-time data acquisition and recording system in accordance with an implementation of the present disclosure. [Figure 2] 1 is a flow diagram illustrating a process for recording video data, audio data, and / or information from a mobile asset according to an implementation of the present disclosure. [Figure 3] 1 is a flow diagram illustrating a process for displaying recorded video data, audio data, and / or information from a mobile asset according to an implementation of the present disclosure. [Figure 4] 1 illustrates an exemplary fisheye view of a 360-degree camera of a real-time data acquisition and recording system, in accordance with an implementation of the present disclosure. [Figure 5] 1 illustrates an exemplary panoramic view of a 360-degree camera of a real-time data acquisition and recording system, in accordance with an implementation of the present disclosure. [Figure 6] FIG. 1 illustrates an exemplary quad view of a 360-degree camera of a real-time data acquisition and recording system, in accordance with an implementation of the present disclosure. [Figure 7] 1 illustrates an exemplary dewarped view of a 360-degree camera of a real-time data acquisition and recording system, in accordance with an implementation of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0009] The real-time data acquisition and recording system described herein is intended to provide asset owners, operators, and researchers with Provide remotely located users, such as inspectors, with event and operational data, video data, and other information related to high-value assets. Real-time or near-real-time access to a wide range of data, including computer and audio data This data acquisition and recording system provides data related to the asset via a data recorder. and record data before, during and after an accident, and establish a remote data repository and remote Streaming data to users on the ground. The data can be in real time or near real time. real-time data streaming to a remote data repository, at least in the event of an accident or emergency. This allows for the use of information up to the time of occurrence, allowing for requests to download specified data, The purpose and use of special applications to locate and transfer files and view that data , need to locate and download the "black box" to investigate an accident involving the asset. This would essentially eliminate the need for a data recorder on the asset. The disclosed system provides a system for recording before, during and after an accident while retaining typical recording capabilities. The ability to stream data to remote data repositories and remote end users after delivery In most situations, the data has already been acquired and stored in a remote data repository. Since the information is stored, the information recorded in the data recorder becomes redundant and unnecessary.

[0010] Before the system disclosed here, after an incident occurred and an investigation was required, Data was extracted from the "black box" or "event recorder." The data file containing the time segments was downloaded from the "black box." had to be extracted and viewed by a user with their own software. The user can gain physical or remote access to the asset and access it from the "black box." Select the desired data to download and download the file containing the desired information to the computing device. and download the desired data to a computer using a custom application that runs on that computer. The system of the present disclosure requires that the user find the appropriate file containing the data. This eliminates the need for the user to perform these steps, allowing the user to A remote user can simply use a common web browser to navigate to the When you access a popular web browser, the browser will display the Navigate users to desired data and monitor the performance of that asset in real-time or near real-time. The efficiency and safety of use can be monitored and analyzed.

[0011] Remote users, such as asset owners, operators, and / or inspectors, can access the assets they select. A common web browser to navigate to relevant live and / or historical desired data Access and view the operational efficiency and safety of your assets in real-time or near real-time and analysis. The ability to view operations in real time or near real time This allows for rapid assessment and adjustment of behavior. System information and / or data can facilitate triage of the situation and provide useful information to first responders. During normal operation, for example, real-time information and / or data Data can be used to audit crew performance and aid network-wide situational awareness. Cut.

[0012] The disclosed system may be used as part of a data acquisition and recording system within, on, or after a moving asset. Before the system of the present disclosure, a 360-degree camera was used. "Network Box" and / or "Event Recorder" located in, on, or near the mobile asset. There was no 360-degree camera nearby. The system disclosed here is a data acquisition and recording system. As part of the system, we will use 360-degree cameras and add the ability to record with these cameras. In addition, the mobile assets are held by the company before, during, and after an incident involving the mobile assets occurs. 360-degree views of the factory, on or near moving assets, stored in a remote data repository ), and can be provided to remote users and researchers. The ability to view in real-time or near real-time allows for rapid assessment and adjustment of occupant behavior. Owners, operators and investigators can assess operational efficiency, people safety, vehicles and infrastructure. The mobile assets can be analyzed and analyzed, and accident investigations or inspections can be carried out. The ability to view 360-degree footage from a remote location allows for rapid assessment and adjustment of occupant behavior. In the event of an accident, for example, 360-degree video footage can make it easier to triage the situation and During normal operation, for example, Use 360-degree video to audit crew operations and aid network-wide situational awareness 360-degree and fixed cameras provide a complete picture of the situation. This allows law enforcement and / or railway police, critical infrastructure inspections, railway crossings, Real-time monitoring of shutdowns, truck work progress, and crew audits in the cab and yard Surveillance footage can be provided for remote monitoring.

[0013] Previous systems required dedicated software applications or other external video playback applications. To view a video file using the application, the user selects a time segment containing The data acquisition and recording system of this disclosure requires downloading the video file. , using virtual reality devices and / or via a standard web client It provides 360-degree video and image information and audio information that can be displayed to remote users. This eliminates the need to download and use an external application to view the video. Furthermore, users in remote locations can access virtual reality devices and web browsers. You can watch 360-degree videos in various modes through standard web clients such as You can download and use an external application to watch the video. Traditional video systems require dedicated accessories that users must purchase separately. can only be viewed using application software or other external video playback applications. You need to download a video file that contains a time segment of data that cannot be There was.

[0014] The data includes video and images from cameras located at various locations within, on or near the asset. information, audio information from microphones located at various locations within, on or near the asset; 360-degree cameras provide a 360-degree spherical field of view and / or is a camera that provides a 360-degree hemispherical view. The 360-degree camera can be installed inside, on, or When used in the vicinity, it uses its 360-degree camera to capture images as part of DARS. This provides the ability to use and record information within and after an incident, before, during, and after the incident. 360-degree views of production or nearby locations to remote data repositories, remote users, and may be made available to investigators.

[0015] FIG. 1 illustrates an exemplary real-time data acquisition and recording system in which aspects of the present disclosure can be implemented. 1A and 1B show field installation of a first embodiment of a Data Acquisition System (DARS) 100. 100 receives real-time information, video information, from a data recorder 108 on a mobile asset 130. , a system for delivering audio information to remote end users via a data center 132 The data recorder 108 is installed in a vehicle or mobile asset 130 and is connected to a wireless gateway. via any combination of wired and / or wireless data links, such as a router / router (not shown) The data recorder 108 communicates with any number of different sources of information. The second module 110 includes an on-board data manager 112 and a data encoder 114. In an embodiment, the data recorder 108 is a removable storage device (not shown) without crash protection. The exemplary crash-protected memory module 110 may also include, for example, Shock-resistant event recorder memory module that complies with Federal Railroad regulations and Federal Railroad administrative regulations. Crash survivable memory unit (CSM) that complies with the regulations of the Japan Civil Aviation Bureau memory unit), a crash-protected memory module that complies with the applicable Code of Federal Regulations, or It may be any other suitable hardened memory device known in the art. Wired and / or wireless Data links include discrete signal input, standard or proprietary Ethernet, serial The communication may include any one or a combination of wired and wireless connections.

[0016] The data recorder 108 may include a wide variety of software applications that may vary widely based on the asset mix. From the source, video data, audio data, and other data and In this implementation, the data recorder 108 collects information from within the asset 130, the asset 130 and the 360-degree camera 102 and the fixed camera 106 located nearby. The data is received from the video management system 104, which continuously records video data and audio data. The video management system 104 then stores the video and audio data in a crash-protected memory module. 110 and also in a removable storage device without crash protection in the second embodiment. Different versions of the video can be produced using different bit rates or spatial resolutions. These versions include thumbnails, 5 minute low resolution segments, and 5 minute The video is divided into segments of variable length, such as minute-long high-resolution segments.

[0017] The data encoder 114 encodes at least a minimum set of data typically specified by regulatory authorities. The data encoder 114 encodes the video and audio data into the video management system 1. 04 for efficient real-time transmission and duplication to a remote data repository 120. To facilitate production, the data is compressed, i.e., encoded, and time synchronized. The data encoder 114 responds to on-demand requests by a remotely located user 134. or in response to observing a particular operating condition on the asset 130, to the on-board data manager 112, which then and voice data via a remote data manager 118 in a data center 130. The data manager 112 and the remote data repository 120 The managers 118 collaborate to manage this data replication process. A remote data manager 118 can manage the replication of data from multiple assets. The video and audio data stored in the remote data repository 120 is transmitted to a remote user. 134 is available through the web server 122 for access.

[0018] The onboard data manager 112 also sends data to a queue repository (not shown). The data manager 112 uses the video management system 104 to configure the crash-protected memory module. 110 and stored in a removable storage device without any crash protection according to the second embodiment. Monitors the video and audio data being transmitted and determines whether it is in near real-time mode or real-time mode. In near real-time mode, the onboard data manager 112 determines whether the data A code including video data, audio data, and other data and information received from the encoder 114. The encryption data, as well as the collision-protected memory module 110 and any Storing all event information in a non-collision protected removable storage device in a queue repository After 5 minutes of coded data is stored in the queue repository, the onboard data manager 11 2 transmits the five minutes of coded data to Data Center 1 via wireless data link 116. 32 via a remote data manager 118 in a remote data repository 120 . In real-time mode, the onboard data manager 112 receives data from the data encoder 114. Encoded data including transmitted video data, audio data, other data and information, as well as all All event information is transmitted to the remote data center 132 via wireless data link 116. The data is stored in a remote data repository 120 via the on-board data manager 118. The data manager 112 and the remote data manager 118 may communicate via various wireless communication links. An example of a wireless data link 116 is a wireless local area network (WLAN). Wireless LAN (WLAN), Wireless Metropolitan Area Network (WMAN), Wireless Wide Area Network Wireless Network (WWAN), private wireless system, mobile phone network, or data recorder Any other means for transmitting data from the data processor 108 to the remote data manager 118 in this example. The process of remotely transmitting and retrieving video and audio data from assets 130 includes: requires a wireless data connection between the asset 130 and the data center 132. If wireless connectivity is unavailable, this data is stored in a collision-protected memory module until wireless connectivity is restored. module 110 and stored on a removable storage device without any crash protection according to the second embodiment. Once wireless connectivity is restored, video, audio, and other additional data acquisition will begin. Processing resumes.

[0019] In parallel with the data recording, the data recorder 108 continuously transmits the data to a remote data repository 120. This replication process can be performed in real-time or near real-time mode. In real-time mode, data is read from the remote data link every second. In near real-time mode, data is replicated to the remote data repository 120 every 5 minutes. The frequency of use in near real-time mode is configurable. In real-time mode, the rate used is to send data to the remote data repository every 0.10 seconds. It can be scaled to support high resolution data by replicating it to 120. To improve the efficiency of this data replication process, near real-time modeling is required under most conditions. This code is used during normal operation.

[0020] The real-time mode may be based on events occurring at the asset 130 or at the data center 1 32. A typical request for real-time mode to be initiated is when a remotely located user 134 It starts when a web client 126 requests real-time information. Common reasons for real-time mode origination are operator initiated emergency stop requests, emergency Braking, sudden acceleration or deceleration on any axis, or loss of input power to the data recorder 108 The detection of events or incidents such as loss of data. During migration, all data that has not yet been replicated to the remote data repository 120 is transferred to the remote data repository 120. The data is then copied and stored in the data repository 120, and the replication activity begins. The transition from mode to real-time mode typically occurs in less than 5 seconds. After a period of time has elapsed, either a predetermined period of inactivity or the user 134 has left the asset 130 When real-time information is no longer desired, the data recorder 108 may be configured to operate as a near real-time monitor. The predetermined time required to initiate this transition is configurable, typically 10 minutes. It is set.

[0021] When the data recorder 108 is in real-time mode, the onboard data manager 112: The data is continuously being sent to the remote data manager 118 in an attempt to empty its queue. The crash-protected memory module 110 and the removable memory module without any crash protection according to the second embodiment The data is stored in a storage device and simultaneously transmitted to the remote data manager 118 .

[0022] Video data, audio data, and other data and information to be copied from the data recorder 108 Upon receiving the data, the remote data manager 118 stores the data in the remote data center 130. The data is stored in a remote data repository 120. The remote data repository 120 may be, for example, a cloud storage The data may be stored in a data storage device based on the network, or in another suitable remote data storage device. The data decoder (not shown) then retrieves the most recently replicated data from the remote data repository 120. The process of decoding the data by a remote event detector (not shown) and transmitting the decoded data to a remote event detector (not shown) is started. The remote data manager 118 stores the vehicle event information in a remote data repository 120. When the remote event detector receives the decoded data, it processes the decoded data and The decoded information is then passed to the remote event detector to determine if the event of interest was found in the data. and used by the data processor to identify events, incidents, or The remote event detector detects other predetermined conditions. When a target event is detected from the stored decoded data, the event information and supporting data are sent remotely. The data is stored in the data repository 120.

[0023] In response to an on-demand request from a user 134, video data, audio data, and all Any other data or information made available to the user 134 and / or on the asset 130 In response to certain operating conditions being observed by the on-board data manager 112, The video data stored in the remote data repository 120 is transmitted to the data, voice data, and any other data or information that is accessible to the user 134. The assets 134 are available on the web server 122 at the time of purchase. A remote user 134 can video data stored in a remote data repository 120 associated with one or more assets; The voice data and any other data or information can be transmitted using standard web clients such as web browsers. Client 126, or in this implementation, a bar that can display thumbnail images of the selected camera. The web client can be accessed using a virtual reality device 128. 126 communicates over the network 124 using common web standard protocols and technologies. and transmits to the web server 122 requests from the user 134 for video, audio and / or other information. The network 124 may be, for example, the Internet. Network 124 is a local area network (LAN), metropolitan area network (MEN), Network (MAN), Wide Area Network (WAN), Virtual Private Network This allows data from a VPN, a mobile phone network, or a web server 122 to be transmitted to this In some examples, it may be other means of transmitting to the web client 126. The server 122 requests the desired data from the remote data repository 120. The server 122 then processes the requested data for playback and real-time playback of standard and 360-degree videos. The web client 126 then sends the video to the web client 126, which provides a video display. It plays data, audio data, and any other data or information to the user 134 . A user 134 can interact with the 360-degree video data for viewing and analysis purposes. The user 134 also transmits the video data, audio data, and any other data or information to the The virtual reality device 128 can be used to download the game using a virtual reality client 126. This allows users to interact with 360-degree video data for viewing and analysis purposes.

[0024] The web client 126 provides playback of 360-degree video in a variety of different modes. The user 134 can then use the software to For example, the application can display a fisheye view as shown in Figure 4, a power view as shown in Figure 5, panoramic view, double panoramic view (not shown), quad view as shown in Figure 6, You can select the mode in which you want to present the video playback, such as the dewarped view shown in Figure 7. Cut.

[0025] FIG. 2 illustrates a system for transmitting video data, audio data, and / or audio data from an asset 130 according to one implementation of the present disclosure. 2 is a flow diagram illustrating a process 200 for recording information. 360-degree cameras 102 and fixed cameras located within 30, on and near assets 130 106. The video management system The system 104 may display the video data, audio data, and / or information in the form of, for example, still images, subtitles, or other formats. Industry standard formats such as snapshots, still image sequences, or compressed video formats The collision-protected memory module 110 and the second embodiment can be implemented using any combination of the above. The data is stored in a removable storage device 204 that does not have crash protection. A record containing a structured series of bits used to organize and record signaling information 206. In near real-time mode, the video management system 104 generates a video code. The image data is stored in the crash-protected memory module 110 and the non-crash-protected removable memory module 110 of the second embodiment. While storing the image in the storage device, the image may be stored in a remote data repository 120, 208 as thumbnails or very short images. It sends only limited video data, such as low-resolution video segments.

[0026] In another embodiment, the encoded records are then sorted into a series of records in chronological order, starting with The data is sent to the on-board data manager 112, which sequentially combines the data into record blocks containing up to five minutes of data. A provisional record block contains less than 5 minutes of data, and a full record block contains 5 minutes of data. Each record block contains the full data, including data integrity checks. Contains all the data necessary to fully decode the signal being recorded. A block must begin with a start record and end with an end record.

[0027] All of the encoded signal data is stored in the collision-protected memory module 110 and the second embodiment. To ensure that data is stored on a removable storage device that does not have any crash protection, If the reader 108 loses power, the on-board data manager 112 uses a crash-protected memory module 110 and the second embodiment of the removable storage device without collision protection, Store at a predetermined frequency, which may be configurable and / or variable. The lock is saved at least once per second, but may be saved as often as once per tenth of a second. The frequency at which provisional record blocks are saved depends on the sampling rate of each signal. Each provisional record block contains the full set of records since the last full record block. When recording each intermediate record block, the data recorder 108 It is possible to alternate between two temporary storage locations within the collision-protected memory module 110. This allows the data to be recorded when the data is stored in the collision protection memory module 110. If the drive 108 loses power, it can prevent corruption or loss of data for more than one second. Each time a new provisional record block is stored in a temporary collision-safe memory location, Overwrite any existing previously stored provisional record block in place.

[0028] In this implementation, every 5 minutes, if the data recorder 108 is in near real-time mode, The onboard data manager 112 generates a full record block containing the last five minutes of encoded signal data. The lock is used to lock the record segments of the collision-protected memory module 110 and the collisions of the second embodiment. Five minutes of video data, audio data, and / or information stored in a removable storage device without shock protection a copy of the full record block containing the information to the remote data manager 118 to The data is stored in the data repository 120 and is retained for a predetermined retention period, e.g., two years. The crash-protected memory module 110 and the non-crash-protected removable memory module of the second embodiment are The storage device stores the record segments of the latest record block for a specified storage period. In this implementation, during this period the data recorder 108 is connected to the collision protection memory module 11. 0 must store motion or video data, including an additional 24-hour buffer. This is the federal government regulation period after which this segment is overwritten.

[0029] FIG. 3 illustrates the process of accessing data from an asset 130 via a web browser or virtual reality device. 3 is a flow diagram illustrating a process 300 for viewing data and / or information when an event occurs. or a remotely located authorized user 134 via the web client 126 to When a segment of video data stored in memory module 110 is requested, the on-board data In response to the event, the manager 112 determines whether the bandwidth of the wireless data link 116 is provided. If the camera is connected to a network, it will begin transmitting video data off-board in real time at the best available resolution. A remotely located user 134 makes a request to the web server 122 via the network 124. The specified video is displayed in the specified view mode 302 via the web client 126 that communicates the The web server 122 initiates a request for video and / or audio data. requesting specified video and / or audio data from the data repository 120 and and / or audio data via the network 124 to the web client 126, 304 The web client 126 sends the business information specified by the user 134, 306 to the The user 134 can then view the video and / or audio data in a menu mode. , download the specified video and / or audio data and use it in a virtual reality device 128. In another implementation, in real-time mode, Every so often a thumbnail is sent, followed by a short segment of low-res video and a short segment of high-res video. A short segment of audio is sent.

[0030] For ease of explanation, processes 200 and 300 are shown as a series of steps: However, steps according to the present disclosure may be performed in various orders and / or in parallel. Additionally, steps according to the present disclosure may be used in combination with other methods not shown and described herein. Furthermore, all steps shown may be performed in conjunction with other steps as disclosed. It is not required to practice the method according to the subject matter.

[0031] Although the present disclosure has been described in connection with particular embodiments, the present disclosure is not limited to the disclosed embodiments. On the contrary, it is intended to cover various modifications and equivalent arrangements included within the scope of the appended claims. The scope of this Agreement is intended to include all modifications and equivalents permitted by law. It should be given the broadest interpretation to encompass the construction.

Claims

1. 1. A method for displaying data to a user located remotely from at least one mobile asset, comprising: storing the 360-degree field of view video data captured by the 360-degree camera and the audio data related to the at least one moving asset in a remote data repository using a remote data manager of the system for processing, storing, and transferring data related to the at least one moving asset; receiving, using a web server remote from the at least one mobile asset, a first request including a specified 360-degree field of view of video and audio data and a second request for a specified view mode of the 360-degree field of view of video and audio data to be displayed to the remotely located user; receiving video and audio data for the specified 360-degree field of view of the at least one mobile asset from a remote data repository using a web server remote from the at least one mobile asset; using a display device remote from the at least one mobile asset to display the specified 360-degree field of view video and audio data of the at least one mobile asset in the specified view mode requested by the remotely located user; A method for providing the above.

2. the first request includes video data and audio data of a specified 360-degree field of view of the at least one mobile asset and is either initiated by the remotely located user or initiated by an accident occurring on the at least one mobile asset; the second request being the designated view mode initiated by the remotely located user; The method of claim 1.

3. The accident is at least one of an emergency stop request initiated by an operator of the mobile asset, an emergency braking operation, a sudden acceleration of the mobile asset in any axis, a sudden deceleration of the mobile asset in any axis, and a loss of input power to a data recorder onboard the mobile asset. The method of claim 2.

4. the first request and the second request are received by the web server via one of a wireless network connection and a wired network connection; The method of claim 1.

5. receiving commands for the first request and the second request from the remotely located user using a web client; sending the commands for the first request and the second request to the web server using the web client; The method of claim 2 further comprising:

6. the display device is one of a web client and a virtual reality device; The method of claim 1.

7. the designated view captured by the 360-degree camera is any one of a fisheye view, a dewarped view, a panoramic view, a double panoramic view, and a quad view; The method of claim 1.

Images