Real-time data acquisition and recording system viewer

A real-time data acquisition system for high-value mobile assets streams data to remote repositories, enabling immediate access and analysis through web browsers or virtual reality devices, addressing the limitations of traditional systems by allowing instant data retrieval without physical interaction.

JP2024164236AActive Publication Date: 2024-11-26WI TRONIX LLC
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2024146822
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2017-05-15
Filing Date
2024-08-28
Publication Date
2024-11-26
Estimated Expiration
2037-05-16

AI Technical Summary

Technical Problem

Existing data acquisition and recording systems for high-value mobile assets require physical retrieval and analysis of data recorders, which can be impractical or impossible in certain situations, leading to delayed access to critical operational and incident data.

Method used

Implementing a real-time data acquisition and recording system with a 360-degree camera, fixed cameras, and microphones that stream data to a remote repository, allowing real-time or near-real-time access and display through a web browser or virtual reality device, eliminating the need for physical retrieval of data recorders.

Benefits of technology

Enables rapid access to operational and incident data, facilitating immediate analysis and response, reducing the need for physical interaction with on-board recorders and ensuring data availability before, during, and after incidents.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024164236000001_ABST
    Figure 2024164236000001_ABST
Patent Text Reader

Abstract

SOLUTION: A data acquisition and recording system (DARS) and viewer for mobile assets that includes a data encoder, onboard data manager, and a local memory module. DARS processes video data from a 360 degree camera and stores a compressed record of the data at least once per second in the local memory module. DARS runs in near real-time mode, storing a full record comprising five minutes of data to a remote memory module every five minutes, and in real-time mode, streaming video data to the remote memory module by uploading a record of data at least once per second and up to once every tenth of a second.EFFECT: Remotely located users can view video, audio, and data in various view modes through a web browser or virtual reality device, which provides for quicker emergency response, validate the effectiveness of repairs and rerouting, and monitor crew performance and safety.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application is a continuation, to the extent permitted by law, of U.S. Provisional Application No. 2016-0021626 filed on May 16, 2016. Filed May 16, 2016, claiming priority to Application No. 62 / 337,225 Filed on May 16, 2016, claiming priority to U.S. Provisional Application No. 62 / 337,227. This application claims priority to U.S. Provisional Application No. 62 / 337,228, filed May 2017. This application claims priority to U.S. Nonprovisional Application No. 15 / 595,650, filed on May 15, and a continuation thereof, the contents of which are incorporated herein by reference in their entirety.

[0002] This disclosure provides a detailed analysis of the data collected from a real-time data acquisition and recording system used on high-value moving assets. The present invention relates to a system and method for viewing video, images and data. [Background technology]

[0003] Locomotives, aircraft, mass transit systems, mining equipment, transportable medical equipment, cargo, ships, military High-value moving assets such as chartered ships typically use on-board data acquisition and recording “black box” systems. Event Data Recorder and / or "Event Recorder" systems are employed. Data acquisition and recording systems such as flight data recorders and flight Various systems used for operational evaluation, fuel consumption analysis, maintenance planning, and predictive diagnostics Typical data acquisition and recording systems include digital and analog With inputs as well as pressure switches and pressure transducers, it can be used with a variety of on-board sensor devices. The data recorded includes speed, distance traveled, location, fuel level, Engine revolutions per minute (RPM), fluid levels, driver controls, pressure, current and forecast These can include parameters such as the weather and ambient conditions that are measured. In addition to operational data, video and audio event / data recording capabilities are also available on many of these same mobile assets. Typically, data records are created after an incident involving assets occurs and an investigation is required. When the data recorder is retrieved, the data is extracted from the data recorder. Situations may arise where the coder cannot recover or the data is otherwise unavailable. In such circumstances, physical access to the data capture and recording system or its data may be lost. Events captured by data collection and recording systems, whether or not available And data such as motion data, video data, and audio data is needed quickly. Summary of the Invention [Means for solving the problem]

[0004] This disclosure generally relates to a real-time data acquisition and recording system for use with high-value moving assets. The teachings herein relate to a real-time data acquisition and recording system on high-value moving assets. Data recorded by the system, such as event and action data, video data, and audio data The present invention can provide real-time or near real-time access to the A method for processing, storing, and transmitting data from at least one mobile asset, comprising: The installation uses an on-board multimedia management system on a mobile asset to provide at least one 36 0 degree camera, at least one fixed camera and at least one microphone receiving data based on at least one data signal from at least one of the The data is received by a data recorder mounted on the mobile asset, and the data recorder is The data encoder of the reader is used to create a recorder that contains a bitstream based on that data. and using the data recorder's on-board data manager to At least one of the data and the record is stored in at least one of the data recorders. and storing the first predetermined frequency in a local memory component.

[0005] One implementation of the method for displaying data from at least one moving asset described herein. using a web server to transmit designated multimedia data and and receiving a request including the specified view mode, and using the web server: The at least one mobile asset is then transferred to a remote memory component. and displaying a designated multimedia signal of the at least one mobile asset using a display device. and displaying the media data in the specified view.

[0006] One implementation of the real-time data acquisition and recording system described herein comprises at least One 360-degree camera, at least one fixed camera and at least one microphone and a multimedia management system on board the mobile asset, At least one 360-degree camera, at least one fixed camera and at least one data based on at least one data signal from at least one of the microphones and at least one local memory component. The on-board data manager and data encoder are included in the multimedia management system. a data recorder on board the mobile asset configured to receive data from the A data encoding set to encode a record containing a bitstream based on and at least one of the data and the record is stored in at least one local The on-board data is configured to be stored at a first predetermined frequency configurable in the memory component. Includes Tamaneja.

[0007] Variations on these and other aspects of the disclosure are described in further detail below. [Brief description of the drawings]

[0008] The present description will be made with reference to the accompanying drawings, several of which are designated by like reference numerals and in which: 1 shows similar parts. [Figure 1] FIG. 1 illustrates a field installation of an exemplary real-time data acquisition and recording system in accordance with an implementation of the present disclosure. [Diagram 2] 1 is a flow diagram illustrating a process for recording video data, audio data, and / or information from a moving asset according to an implementation of the present disclosure. [Diagram 3] 1 is a flow diagram illustrating a process for displaying recorded video data, audio data, and / or information from a mobile asset according to an implementation of the present disclosure. [Figure 4] FIG. 1 illustrates an example fisheye view of a 360-degree camera of a real-time data capture and recording system in accordance with an implementation of the present disclosure. [Diagram 5] FIG. 1 illustrates an exemplary panoramic view of a 360-degree camera of a real-time data capture and recording system in accordance with an implementation of the present disclosure. [Figure 6] FIG. 1 illustrates an example quad view of a 360-degree camera of a real-time data capture and recording system in accordance with an implementation of the present disclosure. [Figure 7] 1 illustrates an example dewarped view of a 360-degree camera of a real-time data capture and recording system in accordance with an implementation of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] The real-time data acquisition and recording system described herein provides asset owners, operators, and researchers with Provide remote users, such as inspectors, with event and operational data, video data, and other information related to high-value assets. Real-time or near real-time access to a wide range of data, including text, audio, and video. This data acquisition and recording system provides the data related to the asset through the data recorder. and record the data before, during and after an accident occurs, and establish a remote data repository and a remote Stream data to users on the ground. The data can be in real-time or near real-time. real-time streaming to a remote data repository, at least in the event of an accident or emergency. This allows the use of information up to the time of occurrence, and allows the download of specific data, The location and transfer of files, the use and purpose of special applications to view that data, , and need to locate and download the "black box" to investigate an accident involving the asset. This would essentially eliminate the need for a data recorder on the asset, eliminating the need to communicate with the data recorder on the asset. The disclosed system provides the ability to record information before, during and after an accident while retaining typical recording capabilities. The ability to post-mortem stream data to remote data repositories and remote end users In most situations, the data has already been captured and stored in a remote data repository. Since the information is stored, the information recorded in the data recorder becomes redundant and unnecessary.

[0010] Prior to the system disclosed here, after an incident occurred and an investigation was required, Data was extracted from the "black box" or "event recorder." The data files containing the time segments were downloaded from the "black box." had to be extracted and viewed by a user with their own software. The user can gain physical or remote access to the asset and access it from the “black box.” Select the desired data to be downloaded and download the file containing the desired information to a computing device. and use custom applications that run on that computing device to The user must find the appropriate file that contains the data. This eliminates the need for the user to perform these steps and allows the user to simply navigate to the desired data. A remote user can simply use a common web browser to navigate to the When you access a popular web browser, the browser will display the Navigate users to desired data and monitor the performance of their assets in real-time or near real-time The efficacy and safety of use can be monitored and analyzed.

[0011] Remote users, such as asset owners, operators, and / or investigators, can view and analyze the assets they select. A common web browser to navigate to relevant live and / or historical desired data Access and view the operational efficiency and safety of your assets in real-time or near real-time The ability to view operations in real-time or near real-time allows This allows for rapid evaluation and adjustment of behavior. System information and / or data can facilitate triage of situations and provide useful information to first responders. During normal operation, for example, real-time information and / or data The data can be used to audit crew performance and aid network-wide situational awareness. Cut.

[0012] The disclosed system may be used as part of a data acquisition and recording system within, on, or after a moving asset. Prior to the system of this disclosure, a 360-degree camera was used. The “Clockbox” and / or “Event Recorder” may be located in, on, or near the moving asset. There was no 360-degree camera nearby. The system disclosed here is a data acquisition and recording system. As part of the system, we will use 360-degree cameras and pursue the ability to record with these cameras. In addition, the Company has the right to use the Mobile Assets before, during, and after an incident involving the Mobile Assets occurs. 360° views of the inside of the plant, on or near the moving asset, stored in a remote data repository ) and provide remote users and researchers with operational and / or 360° video feeds. The ability to view in real-time or near real-time allows for rapid assessment and adjustment of occupant behavior. Owners, operators and investigators can assess operational efficiency, people safety, vehicles and infrastructure. The mobile assets can be analyzed and analyzed, and accidents can be investigated or inspected. The ability to view 360-degree footage from a single window will allow for rapid assessment and adjustment of occupant behavior. In the event of an accident, for example, 360-degree video footage can make it easier to triage the situation and During normal operation, for example, Use 360-degree video footage to audit crew operations and aid network-wide situational awareness 360° and fixed cameras provide a complete picture of the situation. This allows law enforcement and / or railway police, critical infrastructure inspections, railway crossings, Real-time monitoring of outages, truck work progress, and crew audits in the cab and yard Surveillance footage can be provided for remote monitoring.

[0013] Previous systems required dedicated software applications or other external video playback apps. To view a video file using the application, the user must select a time segment The video files had to be downloaded. The data acquisition and recording system of this disclosure , using a virtual reality device and / or via a standard web client Provides 360-degree video and image information, as well as audio information, that can be displayed to remote users. This eliminates the need to download and use an external application to view the video. In addition, users in remote locations can use virtual reality devices and web browsers to You can watch 360-degree videos in a variety of modes through standard web clients such as This allows you to download and use external applications to watch videos. Traditional video systems require dedicated accessories that users must purchase separately. Can only be viewed using the Video Playback Application Software or other external video playback applications. You need to download a video file that contains a time segment of data that cannot be There was.

[0014] The data includes video and imagery from cameras located at various locations within, on or near the asset. information, audio information from microphones located at various locations within, on or near the asset; 360 degree cameras provide a 360 degree spherical field of view and / or is a camera that provides a 360 degree hemispherical view. The 360 ​​degree camera can be placed inside, on or off the asset. When used in the vicinity, it uses its 360-degree camera to capture images as part of DARS. This provides the ability to use and record information before, during, and after an incident occurs, within and among assets. 360° view of production or nearby areas to remote data repositories, remote users, and may be made available to investigators.

[0015] FIG. 1 illustrates an exemplary real-time data acquisition and recording system in which aspects of the present disclosure can be implemented. 1A and 1B each illustrate a field installation of a first embodiment of a DARS system 100. 100 receives real-time information, video information, from a data recorder 108 on a mobile asset 130 , a system for delivering voice information to remote end users via a data center 132 The data recorder 108 is installed in a vehicle or mobile asset 130 and is connected to a wireless gateway via any combination of wired and / or wireless data links, such as a router (not shown) The data recorder 108 communicates with any number of different information sources. The second module 110 includes an on-board data manager 112, and a data encoder 114. In an embodiment, the data recorder 108 is a removable storage device (not shown) without crash protection. The exemplary crash-protected memory module 110 may also include, for example, Shock-resistant event recorder memory modules that comply with Federal Railroad Regulations and Federal Railroad Administration Regulations Crash survivable memory unit that complies with the regulations of the Japanese Civil Aviation Bureau memory unit), a crash-protected memory module that complies with the applicable Code of Federal Regulations, or It may be any other suitable hardened memory device known in the art. Wired and / or wireless Data links include discrete signal input, standard or proprietary Ethernet, serial The present invention may include any one or combination of wired and wireless connections.

[0016] The data recorder 108 can be used with a wide variety of software that can vary widely based on the composition of the assets. From the satellite, video data, audio data, and other data and In this implementation, the data recorder 108 collects information about the asset 130, the asset 130 and the 360-degree camera 102 and the fixed camera 106 disposed in the vicinity thereof. The data is received from a video management system 104 that continuously records video data and audio data. The video management system 104 then stores the video and audio data in a crash-proof memory module 110 and also in a removable storage device without crash protection in the second embodiment. Different versions of a video can be produced using different bit rates or spatial resolutions. These versions are generated as thumbnails, 5 minute low resolution segments, and 5 minute The video is divided into segments of variable length, such as 1-minute high resolution segments.

[0017] The data encoder 114 encodes a minimum set of data typically specified by a regulatory agency. The data encoder 114 encodes the video and audio data into the video management system 1. 04 for efficient real-time transmission and duplication to a remote data repository 120. To facilitate ease of production, the data is compressed, i.e., encoded, and it is time synchronized. The data encoder 114 responds to on-demand requests by a remotely located user 134. or in response to observing a particular operating condition on the asset 130, The on-board data manager 112 then transfers the encoded image to the on-board data manager 112. and voice data is transmitted remotely via a remote data manager 118 in a data center 130. The on-board data manager 112 and the remote data repository 120 The manager 118 cooperates with the remote server 112 in the data center 132 to manage the data replication process. A remote data manager 118 can manage the replication of data from multiple assets. The video and audio data stored in the remote data repository 120 is transmitted to a remote user. 134 is available through the web server 122 to which it has access.

[0018] The on-board data manager 112 also sends the data to a queue repository (not shown). The data manager 112 uses the video management system 104 to 110 and the second embodiment, which is stored in a removable storage device without any crash protection. Monitors the video and audio data being transmitted and determines whether it is in near real-time mode or real-time mode. In near real-time mode, the on-board data manager 112 determines whether the data entry A code including video data, audio data, and other data and information received from the encoder 114. The encryption data, as well as the collision-protected memory module 110 and any Storing all event information in a non-collision-protected removable storage device in a queue repository After five minutes of coded data is stored in the queue repository, the onboard data manager 11 2 transmits the five minutes of encoded data to data center 1 via wireless data link 116. 32 via a remote data manager 118 in a remote data repository 120 . In real-time mode, the on-board data manager 112 receives data from the data encoder 114. Encoded data including transmitted video data, audio data, other data and information, as well as all All event information is transmitted to the remote data center 132 via wireless data link 116. The data is stored in a remote data repository 120 via the on-board data manager 118. The data manager 112 and the remote data manager 118 may communicate via various wireless communication links. An example of the wireless data link 116 is a wireless local area network (WLAN). Wireless LAN (WLAN), Wireless Metropolitan Area Network (WMAN), Wireless Wide Area Network (WWAN) Wireless Wide Area Network (WWAN), private wireless systems, mobile phone networks, or data recorders Any other means for transmitting data from the data processor 108 to the remote data manager 118 in this example. The process of remotely transmitting and retrieving video and audio data from the asset 130 includes: In order to use the wireless data connection between the asset 130 and the data center 132, If wireless connectivity is unavailable, this data is stored in a collision-protected memory module until wireless connectivity is restored. The module 110 and the removable storage device without any crash protection according to the second embodiment When wireless connectivity is restored, video, audio, and other additional data acquisition will begin. Processing resumes.

[0019] In parallel with the data recording, the data recorder 108 serially transmits the data to a remote data repository 120. The replication process can be performed in real-time or near real-time mode. In real-time mode, data is read from the remote data link every second. In near real-time mode, data is replicated to the remote data repository 120 every 5 minutes. The frequency of use in near real-time mode is configurable. In real-time mode, the rate at which data is sent to the remote data repository is 0.10 seconds. It can be scaled to support high resolution data by replicating it to 120x the original resolution. To increase the efficiency of this data replication process, near real-time modeling is required under most conditions. This code is used during normal operation.

[0020] The real-time mode may be based on events occurring at the asset 130 or at the data center 1 32 based on a request initiated by the data center 132. A typical request for the real-time mode to be initiated is when a remotely located user 134 It begins with a request for real-time information from a web client 126. Common reasons for real-time mode origination are operator initiated emergency stop requests, emergency Braking operations, sudden acceleration or deceleration on any axis, or loss of input power to the data recorder 108 The detection of events or incidents such as loss of data. During migration, all data that has not yet been replicated to the remote data repository 120 is The data is then copied and stored in the data repository 120, and the copying activity begins. The transition from mode to real-time mode typically occurs in less than 5 seconds. After a period of time has elapsed, either a predefined period of inactivity or the user 134 has left the asset 130 When real-time information is no longer desired, the data recorder 108 may be configured to operate in a near real-time mode. The predetermined time required to initiate this transition is configurable, typically 10 minutes. It is set.

[0021] When the data recorder 108 is in real-time mode, the on-board data manager 112: The data is continually being collided with in an attempt to empty the queue to the remote data manager 118. The impact protection memory module 110 and the removable memory module without any impact protection according to the second embodiment The data is then stored in the memory device and the data is simultaneously transmitted to the remote data manager 118.

[0022] Video data, audio data, and other data or information to be copied from the data recorder 108 Upon receiving the data, the remote data manager 118 stores the data in the remote data center 130. The remote data repository 120 stores the data. The remote data repository 120 may be, for example, a cloud The data may be stored in a data storage device based on the The recently replicated data is then sent to a data decoder (not shown) from the remote data repository 120. The process of decoding the data by a remote event detector (not shown) and transmitting the decoded data to a remote event detector (not shown) is started. The remote data manager 118 stores the vehicle event information in a remote data repository 120. When the remote event detector receives the decoded data, it processes the decoded data and The decoded information is then passed to the remote event detector to determine whether the event of interest was found in the data. may be used by the data processor to report events, incidents, or The remote event detector detects other predetermined conditions that have previously been recorded in the remote data repository 120. When a target event is detected from the decoded data stored in the memory, the event information and supporting data are sent to the The data is stored in the data repository 120.

[0023] In response to an on-demand request from a user 134, video data, audio data, and all other data are Any other data or information may be made available to the user 134 and / or on the asset 130. In response to certain operating conditions being observed by the on-board data manager 112, The image data stored in the remote data repository 120 is transmitted to the The data, voice data, and any other data or information may be made accessible to the user 134. The assets 132 are available on the web server 122 at any time. A remote user 134 can access a specified asset 134. video data stored in a remote data repository 120 associated with one or more assets; The voice data, and any other data or information, can be transmitted using standard web clients such as a web browser. or in this implementation, a bar that can display thumbnail images of the selected camera. The web client can be accessed using a virtual reality device 128. 126 communicates over the network 124 using common Web standard protocols and technologies. The web server 122 receives user 134 requests for video, audio and / or other information. The network 124 may be, for example, the Internet. Network 124 is a local area network (LAN), metropolitan area network (MEN), Network (MAN), Wide Area Network (WAN), Virtual Private Network This data is sent from a VPN, a mobile phone network, or a web server 122. In some examples, the web server 126 may use other means to transmit the web request to the web client 126. The server 122 requests the desired data from the remote data repository 120. The server 122 transmits the requested data to the server 122 for playback and real-time playback of standard and 360-degree videos. The web client 126 then transmits the image to the web client 126, which provides a real-time display of the image. It plays data, audio data, and any other data or information to the user 134 . A user 134 can interact with the 360 ​​degree video data for viewing and analysis purposes. The user 134 also transmits the video data, audio data, and any other data or information to the web browser. The virtual reality device 128 can be used to download the content using a virtual client 126. Users can then interact with the 360-degree video data for viewing and analysis purposes.

[0024] The web client 126 provides playback of 360 degree video in a variety of different modes. The user 134 may use the software application to For example, the software application can display the fisheye view shown in Figure 4, the power panoramic view, double panoramic view (not shown), quad view as shown in FIG. You can choose the mode in which you want to present the video playback, such as the dewarped view as shown in Figure 7. Cut.

[0025] FIG. 2 illustrates an example of a system for capturing video data, audio data, and / or audio from an asset 130, according to one implementation of the present disclosure. 2 is a flow diagram showing a process 200 for recording information. 30, 360 degree cameras 102 and fixed cameras positioned on and near assets 130. 106. The video management system receives data signals from various input components 202, such as The system 104 may convert the video data, audio data, and / or information into, for example, still images, subtitles, or other images. Industry standard formats such as snapshots, still image sequences, or compressed video formats The collision-protected memory module 110 and the second embodiment can be implemented using any combination of the above. The data is stored in a removable storage device 204 that does not have collision protection. A record containing a structured series of bits used to organize and record signal information 206. In near real-time mode, the video management system 104 creates a video code. The image data is stored in a crash-protected memory module 110 and a removable non-crash-protected memory module 112 of the second embodiment. While storing the image in the storage device, the image may be stored in a remote data repository 120, 208 as a thumbnail or a very short image. The 3G network only transmits limited video data, such as low-resolution video segments.

[0026] In another embodiment, the encoded records are then sorted into a sequence of records in chronological order, starting with The data is then sent to the on-board data manager 112, which sequentially combines the data into a record block containing up to 5 minutes of data. A provisional record block contains less than 5 minutes of data, and a full record block contains 5 minutes of data. Each record block contains a full data set, including data integrity checks. Contains all the data necessary to completely decode the signal being recorded. A check must begin with a start record and end with an end record.

[0027] All of the encoded signal data is stored in the collision-protected memory module 110 and the second embodiment. In order to ensure that the data is stored on a removable storage device that does not have the crash protection of the data recorder, If the reader 108 loses power, the on-board data manager 112 uses a crash-protected memory module 110 and the second embodiment of the collision-free removable storage device, the temporary record block is stored in the The provisional record is stored at a predetermined frequency. The predetermined frequency may be configurable and / or variable. The lock is saved at least once per second, but may be saved as often as once per tenth of a second. The frequency at which the provisional record blocks are saved depends on the sampling rate of each signal. Each provisional record block contains the full set of records since the last full record block. When recording each intermediate record block, the data recorder 108 It is possible to alternate between two temporary storage locations in the crash-protected memory module 110. This allows the data to be recorded when the data is stored in the collision-protected memory module 110. Even if the data logger 108 loses power, data corruption or loss for more than one second can be prevented. Each time a new provisional record block is stored in a temporary collision-safe memory location, Overwrite any existing previously stored provisional record block in place.

[0028] In this implementation, every 5 minutes, if the data recorder 108 is in near real-time mode, The on-board data manager 112 generates a full record block that contains the last 5 minutes of encoded signal data. The lock is a collision protection memory module 110 record segment and a collision protection memory module 120 of the second embodiment. Five minutes of video data, audio data, and / or information stored in a removable storage device without shock protection 2. Send a copy of the full record block containing the information to the remote data manager 118 to The data is stored in the data repository 120 and archived for a predetermined retention period, e.g., two years. The impact-protected memory module 110 and the impact-free removable memory module of the second embodiment are The storage device stores the record segment of the latest record block for a specified storage period. In this implementation, during this period the data recorder 108 is connected to the collision-protected memory module 11. 0, motion or video data must be stored with an additional 24-hour buffer. This is the Federal Government regulatory period after which this segment is overwritten.

[0029] FIG. 3 illustrates the process of downloading data from an asset 130 via a web browser or a virtual reality device. FIG. 3 is a flow diagram showing a process 300 for viewing data and / or information when an event occurs. or a remotely located authorized user 134 may access the collision protection system via the web client 126. When a segment of video data stored in memory module 110 is requested, In response to the event, the data manager 112 determines whether the bandwidth of the wireless data link 116 is provided. Once the camera is connected, it will begin transmitting video data off-board in real time at the best resolution available. A remotely located user 134 makes a request to the web server 122 via the network 124. The specified video is displayed in the specified view mode 302 via the web client 126 that communicates the The web server 122 initiates requests for video and / or audio data. 10. Requesting specific video and / or audio data from the data repository 120; and / or audio data via the network 124 to the web client 126, 304 The web client 126 transmits the business object specified by the user 134, 306 to the The video and / or audio data is displayed in a menu mode, allowing the user 134 to , download the specified video and / or audio data and use it in a virtual reality device In another implementation, in real-time mode, the first A thumbnail is sent every so often, followed by a short segment of low-res video and then a second segment of high-res video. A short segment of the message is sent.

[0030] For ease of explanation, processes 200 and 300 are shown as a series of steps: However, steps according to the present disclosure may be performed in various orders and / or in parallel. Additionally, steps according to the present disclosure may be used in a variety of ways not shown and described herein. In addition, all steps shown may be performed in conjunction with other steps as disclosed. It is not required to practice the methods in accordance with the disclosed subject matter.

[0031] Although the present disclosure has been described in connection with particular embodiments, the present disclosure is not limited to the disclosed embodiments. On the contrary, the present invention is intended to cover various modifications and equivalent arrangements included within the scope of the appended claims. The scope of this Agreement is intended to include all modifications and equivalents permitted by law. The broadest interpretation should be given to encompass all such constructions.

Claims

1. 1. A method for displaying data from at least one moving asset, comprising: receiving a request, using a web server, the request including specified multimedia data and a specified view mode for at least one mobile asset; receiving the designated multimedia data for the at least one mobile asset from a remote memory component using the web server; displaying the selected multimedia data of the at least one mobile asset in the selected view using a display device; A method for providing the above.

2. the request is either initiated by a remote user or initiated by an incident occurring on the at least one mobile asset; The method of claim 1.

3. The accident is at least one of an emergency stop request initiated by an operator of the mobile asset, an emergency braking operation, a sudden acceleration of the mobile asset in any axis, a sudden deceleration of the mobile asset in any axis, and a loss of input power to a data recorder onboard the mobile asset. The method of claim 2.

4. the request is received by the web server via one of a wireless network connection and a wired network connection; The method of claim 1.

5. receiving a command for said request from said user using a web client; sending the command to the web server in response to the request using the web client; The method of claim 2 , further comprising:

6. the display device being one of a web client and a virtual reality device; The method of claim 1.

7. The specified view is any one of a fisheye view, a dewarped view, a panoramic view, a double panoramic view, and a quad view. The method of claim 1.

8. 1. A system for processing, storing, and transmitting data from at least one moving asset, comprising: At least one of at least one 360-degree camera, at least one fixed camera, and at least one microphone; a multimedia management system on board the mobile asset configured to receive video and audio data based on at least one data signal from the at least one of the at least one 360 ​​degree camera, the at least one fixed camera, and the at least one microphone; a data recorder on board the mobile asset, the data recorder including at least one local memory component, an onboard data manager, and a data encoder, the data recorder being configured to receive the video and audio data from the multimedia management system; Equipped with the data encoder is configured to encode the video and audio data into encoded data based on the video and audio data; the on-board data manager appends the encoded data to a temporary data segment; a remote data manager, the on-board data manager configured to store the provisional data segments in the at least one local memory component at a configurable first predetermined frequency, and autonomously replicating the encoded data to a remote data repository via a wireless data link at a second predetermined frequency, the second predetermined frequency being configurable in a range of 0.1 seconds to 1 second when the replication process is in real-time mode and in a range of 0.1 seconds to 5 minutes when the replication process is in near real-time mode; Further equipped with the configurable second predetermined frequency is varied in response to at least one of a request by a remote user and an event occurring on the mobile asset; a remote data manager, remote from the mobile asset, configured to receive the records from the on-board data manager over a wireless data link at a second predetermined frequency, the second predetermined frequency being configurable within a range of 0.1 seconds to 1 second; a remote data repository, remote from the mobile asset, configured to receive the records from the remote data manager; Further equipped with a web client having a display device; a web server in wireless communication with the web client and configured to receive a request including specified multimedia data and a specified view related to the at least one mobile asset; a web server in wireless communication with the remote data repository and configured to receive selected multimedia data relating to the at least one mobile asset; a display device configured to display, using the display device, the specified multimedia data relating to the at least one mobile asset in the specified view; Further comprising: system.

9. a virtual reality device configured to receive and display the specified multimedia data relating to the at least one moving asset in the specified view; The system of claim 8 further comprising:

10. The specified view is any one of a fisheye view, a dewarped view, a panoramic view, a double panoramic view, and a quad view. The system of claim 8.

Citation Information

Patent Citations

  • Transmission device for image photographing

    JP2008027097A

  • Imaging system, terminal device, server device and imaging method

    JP2010233161A

  • Vehicle situation management system and vehicle situation management method

    JP2012190072A

  • Electronic apparatus, information system, and program

    JP2013073611A