Remote visualization method and device, electronic equipment and storage medium

Abstract

The invention discloses a remote visualization method and device, electronic equipment and a storage medium. The method comprises the steps that communication connection with a server side is established by accessing a browser, and the server side is provided with a visualization platform and stores an automatic driving data packet in advance; a live broadcast page which is live broadcast through the visual platform and returned by the server side is received, the live broadcast page is a mirror image picture of the server side, and operation of a user is transmitted to the server side in real time so as to simulate the operation of the user at the server side; and viewing the automatic driving data packet through the live broadcast page to realize remote visualization. According to the invention, the checking speed of the automatic driving data packet is improved, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the technical field of autonomous driving data development, and in particular to a remote visualization method, device, electronic device, and storage medium. Background Art

[0002] During the test operation of the autonomous driving vehicle, the camera, radar and other sensing devices will continuously collect surrounding information. If the autonomous driving vehicle encounters a problem during operation, the collected data packets will be uploaded to the server. The tester will use the autonomous driving data packets on the visualization platform to reproduce the vehicle operation scene to find the problem. And under normal circumstances, the data packets collected during the above autonomous driving process are very large, ranging from a few hundred KB to tens of GB.

[0003] In the related technology, if you want to view the data packet, not only is the process of downloading the data packet slow, but the parsing process is also very long, which causes the entire process of reading the autonomous driving data packet to be very stuck, affecting the work efficiency of the tester. Summary of the invention

[0004] The embodiments of the present application provide a remote visualization method, device, electronic device, and storage medium to increase the viewing speed of autonomous driving data packets and enhance the user experience.

[0005] The present application embodiment adopts the following technical solutions:

[0006] In a first aspect, an embodiment of the present application provides a remote visualization method, which is applied to a client and includes:

[0007] Establishing a communication connection with a server by accessing a browser, wherein the server is deployed with a visualization platform and the server pre-stores an autonomous driving data packet;

[0008] Receiving a live broadcast page returned by the server through the visualization platform, wherein the live broadcast page is a mirror image of the server, and transmitting the user's operation to the server in real time to simulate the user's operation on the server;

[0009] The autonomous driving data packet is viewed through the live broadcast page to achieve remote visualization.

[0010] In some embodiments, the method further comprises:

[0011] When a new user establishes a communication connection with the server by accessing the browser, a new live broadcast page returned by the server through the live broadcast of the visualization platform is received. The server includes multiple servers for responding to the communication connections selected by different clients.

[0012] In some embodiments, the method further comprises:

[0013] When multiple users simultaneously establish a communication connection with the server by accessing the browser, each user receives a live broadcast page on a different browser page returned by the server through the live broadcast of the visualization platform. The browser page includes multiple live broadcast pages for returning different users.

[0014] In some embodiments, establishing a communication connection with the server by accessing the browser includes:

[0015] The access browser establishes a connection with the public server through Websocket;

[0016] The visualization platform is deployed on a private server, and is connected to a public server via an http protocol, so that a browser is connected to the private server.

[0017] In some embodiments, the receiving a live page returned by the server through the visualization platform, the live page being a mirror image of the server, includes:

[0018] Based on the WebRTC remote mirroring operation technology, a live broadcast page returned by the server through the live broadcast of the visualization platform is received on the browser.

[0019] In a second aspect, an embodiment of the present application further provides a remote visualization method, which is applied to a server, and the method includes:

[0020] Deploy a visualization platform and save autonomous driving data packages in advance;

[0021] Establishing a communication connection with the client, and returning a live page to the client through the visualization platform, wherein the live page is a mirror image of the server;

[0022] In response to an operation on the live broadcast page, the autonomous driving data packet is viewed through the live broadcast page.

[0023] In some embodiments, the method further comprises:

[0024] When a communication connection is established with a new client, a new live broadcast page is created and live broadcast is broadcast to the new client via the visualization platform;

[0025] and / or,

[0026] When multiple user terminals establish communication connections at the same time, corresponding live broadcast pages are established respectively and broadcast live to multiple user terminals through the visualization platform.

[0027] In a third aspect, an embodiment of the present application further provides a remote visualization device, wherein the device comprises:

[0028] An establishment module is used to establish a communication connection with a server by accessing a browser, wherein the server is deployed with a visualization platform and the server pre-stores an autonomous driving data packet;

[0029] A receiving module, used for receiving a live broadcast page returned by the server through the visualization platform, wherein the live broadcast page is a mirror image of the server, and transmits the user's operation to the server in real time to simulate the user's operation on the server;

[0030] A viewing module is used to view the autonomous driving data packet through the live broadcast page to achieve remote visualization.

[0031] In a fourth aspect, an embodiment of the present application further provides an electronic device, comprising: a processor; and a memory arranged to store computer executable instructions, wherein the executable instructions, when executed, cause the processor to perform the above method.

[0032] In a fifth aspect, an embodiment of the present application further provides a computer-readable storage medium, which stores one or more programs. When the one or more programs are executed by an electronic device including multiple application programs, the electronic device executes the above method.

[0033] At least one of the above-mentioned technical solutions adopted in the embodiments of the present application can achieve the following beneficial effects: establishing a communication connection with the server by accessing the browser, the server is deployed with a visualization platform and the server pre-saves the autonomous driving data packet. The client can establish a communication connection with the server by accessing the browser. Receive the live broadcast page returned by the server through the visualization platform, the live broadcast page is a mirror image of the server, and the user's operation is transmitted to the server in real time to simulate the user's operation on the server to view the live broadcast through the client in the live broadcast page of the real-time live broadcast. View the autonomous driving data packet through the live broadcast page to achieve remote visualization. The autonomous driving data packet is saved on the server and viewed locally on the server, which can greatly improve the speed of reading the data packet and improve the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0035] Figure 1 This is a schematic diagram of the remote visualization method flow in the embodiment of the present application (client);

[0036] Figure 2 This is a schematic diagram of the structure of a remote visualization device in an embodiment of the present application;

[0037] Figure 3 This is a flow chart of the remote visualization method in the embodiment of the present application (server side);

[0038] Figure 4 A schematic diagram of a browser remote mirroring operation technology in an embodiment of the present application;

[0039] Figure 5 This is a schematic diagram of a live broadcast screen in an embodiment of the present application;

[0040] Figure 6 A schematic diagram of visually viewing an autonomous driving data packet stored on a server in an embodiment of the present application;

[0041] Figure 7 This is a schematic diagram of the structure of an electronic device in an embodiment of the present application. DETAILED DESCRIPTION

[0042] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in combination with the specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application.

[0043] In related technologies, platforms such as foxglove are usually used as tools for remote visualization. For the program FoxgloveStudio, it can support basically all native ROS content. At the same time, it can be used in a browser and as a desktop application on Linux, Windows, and macOS. All pre-recorded data sources, whether they are loaded locally or from a remote URL, will be pre-loaded into Foxglove Studio. This allows the data in the entire file process to be visualized and analyzed at one time. However, since you select the URL to open the file in the data source dialog box and enter the URL of the remote file, you need to download it. If it is local, you need to be able to directly access the server or open the local file through the data source dialog box, and it cannot support multiple people accessing at the same time.

[0044] The technical solutions provided by various embodiments of the present application are described in detail below in conjunction with the accompanying drawings.

[0045] The present application embodiment provides a remote visualization method, such as Figure 1As shown, a schematic flow chart of a remote visualization method in an embodiment of the present application is provided, and the method at least includes the following steps S110 to S130:

[0046] Step S110, establishing a communication connection with a server by accessing a browser, wherein the server is deployed with a visualization platform and the server pre-saves an autonomous driving data packet.

[0047] The tester can access the browser through the client and establish a communication connection with the server by accessing the corresponding target address. The tester can directly run the browser on the client to achieve communication with the server. It should be noted that when accessing the browser and establishing communication here, there is no need to select the URL to open the file, nor is there any need to download the autonomous driving data package.

[0048] The visualization platform needs to be deployed on the server side, and the visualization platform can be a tool or plug-in that technicians in this field can run on the server side after compiling the code. This is not specifically limited in the embodiments of the present application. Technicians in this field can choose the corresponding programming language for code compilation according to the actual scenario.

[0049] The autonomous driving data package is also pre-stored on the server side, so that the access to the visualization platform is local access. The autonomous driving data package does not need to be downloaded or copied repeatedly, but only needs to be saved on the server side. Since there is no display device on the server side itself, it is necessary to access and visualize it through the browser in the client side.

[0050] Step S120, receiving a live broadcast page returned by the server through the visualization platform, wherein the live broadcast page is a mirror image of the server, and transmits the user's operation to the server in real time to simulate the user's operation on the server.

[0051] Since a communication connection is established with the server, the live page returned by the server can be received, and the live page is a mirror image of the server broadcast live through the visualization platform. In this way, the live page received by the client displays the image on the server in real time. In addition, the autonomous driving data package can be played (viewed) on the server, so there is no need to download or copy it separately.

[0052] Step S130: View the autonomous driving data packet through the live broadcast page to achieve remote visualization.

[0053] The client can view the autonomous driving data packet through the live broadcast page, and can use the autonomous driving data packet to reproduce the vehicle operation situation in a scene to find problems, thereby realizing remote visualization.

[0054] In this way, the client can access the server remotely and view the saved autonomous driving data packets in real time through the live broadcast page. In addition, if there is a problem with the autonomous driving vehicle during operation, the collected data packets will be asynchronously uploaded to the server, so the client can also view the autonomous driving data packets in time.

[0055] Through the above method, the client establishes a communication connection with the server by accessing the browser. The server is deployed with a visualization platform and the server pre-stores the autonomous driving data packet. The client receives the live page returned by the server through the visualization platform. The live page is a mirror image of the server, and transmits the user's operation to the server in real time to simulate the user's operation on the server. Thus, the autonomous driving data packet is viewed through the live page to achieve remote visualization.

[0056] Through the above method, repeated downloading and parsing of the autonomous driving data packet is avoided, and the live broadcast page returned by the server is broadcast live through the visualization platform, and the autonomous driving data packet is viewed through the live broadcast page. Since the visualization platform of the entire process is deployed on the server, the autonomous driving data packet is also saved locally, which can greatly improve the speed of reading the autonomous driving data packet, making it convenient for testers to view the autonomous driving data packet and use the autonomous driving data packet to reproduce the vehicle operation scenario to find problems.

[0057] In one embodiment of the present application, the method also includes: when a new user establishes a communication connection with the server by accessing a browser, receiving a newly created live broadcast page returned by the server through the live broadcast of the visualization platform, and the server includes multiple servers for responding to communication connections selected by different clients.

[0058] In order to meet the viewing needs of different users, when a new user establishes a communication connection with the server by accessing the browser, the client will receive the newly created live page returned by the server through the live broadcast of the visualization platform. Since the server includes multiple servers that can respond to the communication connections selected by different clients, when another user also opens a browser to access the website, a new page will be broadcast live to the corresponding user on the server selected by the user.

[0059] In one embodiment of the present application, the method also includes: when multiple users simultaneously establish a communication connection with the server by accessing the browser, each user receives a live broadcast page on a different browser page returned by the server through the live broadcast of the visualization platform, and the browser page includes multiple live broadcast pages for returning different users.

[0060] In order to meet the needs of multiple users to view at the same time, when multiple users establish a communication connection with the server by accessing the browser at the same time, each user on the client side receives the live page on a different browser page returned by the server through the live broadcast of the visualization platform, and the browser page includes multiple pages for returning the live pages of different users. This enables multiple users to operate on one server at the same time, and each user operates a browser page on the server without affecting each other.

[0061] In one embodiment of the present application, establishing a communication connection with the server by accessing the browser includes: accessing the browser to establish a connection with a public server through Websocket; deploying the visualization platform on a privatized server, and establishing a connection with the public server through the http protocol, so that the browser establishes a connection with the privatized server.

[0062] By accessing the browser, you can establish a communication connection with the server, which makes it easier to use WebRTC remote mirroring technology later. Figure 4 As shown, a schematic diagram of establishing a communication connection between a client access browser and a server is shown.

[0063] For example, the user-side browser A establishes a connection with the public service B through websocket. The visualization platform is deployed on the privatized server C and establishes a connection with the public service B through http. At this time, the user-side browser A and the privatized server C have established a connection.

[0064] In one embodiment of the present application, the receiving of the live page returned by the server through the live broadcast of the visualization platform, the live page being a mirror image of the server, and transmitting the user's operations to the server in real time to simulate the user's operations on the server, includes: based on WebRTC remote mirroring operation technology, receiving the live page returned by the server through the live broadcast of the visualization platform on the browser.

[0065] like Figure 5 As shown, it is the mirror image of the server seen by the client, and the client receives the live page returned by the server through the live broadcast of the visualization platform on the browser. Specifically, the visualization platform of the server is remotely broadcast to the browser of the user by using the WebRTC remote mirroring operation technology. The user clicks on the screen, and the user's operation is transmitted to the server in real time through the data channel. The user's operation is simulated on the server to realize the function of remote visualization data packet.

[0066] like Figure 6As shown, by using WebRTC remote mirroring technology, users can freely choose to visualize (play) the autonomous driving data packets stored on the server.

[0067] like Figure 3 As shown, a remote visualization method is also provided in an embodiment of the present application, wherein the method is applied to a server and includes:

[0068] Step S310: deploy a visualization platform and save the autonomous driving data package in advance.

[0069] The visualization platform deployed on the server side is a tool or plug-in that is run on the server side after the technical personnel in this field compiles the code. It is not specifically limited in the embodiments of the present application. The technical personnel in this field can select the corresponding programming language for code compilation according to the actual scenario.

[0070] At the same time, the server needs to pre-save the autonomous driving data packet. The autonomous driving data packet does not need to be downloaded or copied on the server, and supports viewing and playback.

[0071] Step S320, establish a communication connection with the client, and return a live page to the client through the visualization platform, wherein the live page is a mirror image of the server.

[0072] After the server establishes a communication connection with the client, the live page can be broadcast to the client through the visualization platform. The visualization platform broadcasts the live page to the client, and since the live page is a mirror image of the server, the client can receive the live page.

[0073] The server can open a new live broadcast page for each newly created client and broadcast live to the newly created client.

[0074] Step S330, in response to the operation on the live broadcast page, the autonomous driving data packet is viewed through the live broadcast page.

[0075] The server responds to operations on the live broadcast page, including but not limited to transmitting the user's mouse activities and keyboard operation activities to the server, so that the content of the autonomous driving data packet can be viewed through the live broadcast page, and the autonomous driving data packet can be used to reproduce the vehicle operation scene to find problems.

[0076] In one embodiment of the present application, the method also includes: when establishing a communication connection with a new client, creating a new live broadcast page and broadcasting it live to the new client through the visualization platform; and / or, when multiple user terminals establish communication connections at the same time, respectively establishing corresponding live broadcast pages and broadcasting it live to multiple user terminals through the visualization platform.

[0077] In order to support the access of the newly established client, when the server establishes a communication connection with the new client, a new live page will be created on the server, and the newly created live page will be broadcast live to the new client through the visualization platform. Similarly, whenever a new client establishes a connection, the client's access can be supported.

[0078] In order to be compatible with simultaneous access by multiple clients, when multiple clients establish communication connections at the same time, the server will establish corresponding live broadcast pages (open different web pages) and broadcast live to multiple clients through the visualization platform. In this way, the server supports multiple users to operate on one server at the same time, and each user operates a browser page on the server without affecting each other.

[0079] The present application embodiment also provides a remote visualization device 200, such as Figure 2 As shown, a schematic diagram of the structure of a remote visualization device in an embodiment of the present application is provided, wherein the remote visualization device 200 at least includes: an establishment module 210, a receiving module 220, and a viewing module 230, wherein:

[0080] In one embodiment of the present application, the establishment module 210 is specifically used to: establish a communication connection with a server by accessing a browser, the server is deployed with a visualization platform and the server pre-saves an autonomous driving data packet.

[0081] The tester can access the browser through the client and establish a communication connection with the server by accessing the corresponding target address. The tester can directly run the browser on the client to achieve communication with the server.

[0082] The visualization platform needs to be deployed on the server side, and the visualization platform can be a tool or plug-in that technicians in this field can run on the server side after compiling the code. This is not specifically limited in the embodiments of the present application. Technicians in this field can choose the corresponding programming language for code compilation according to the actual scenario.

[0083] The autonomous driving data package is also pre-stored on the server side, so that the access to the visualization platform is local access. The autonomous driving data package does not need to be downloaded or copied repeatedly, but only needs to be saved on the server side.

[0084] In one embodiment of the present application, the receiving module 220 is specifically used to: receive a live broadcast page returned by the server through the visualization platform, the live broadcast page is a mirror image of the server, and transmits the user's operations to the server in real time to simulate the user's operations on the server.

[0085] Since a communication connection is established with the server, the live page returned by the server can be received, and the live page is a mirror image of the server broadcast live through the visualization platform. In this way, the live page received by the client displays the image on the server in real time. In addition, the autonomous driving data package can be played (viewed) on the server, so there is no need to download or copy it separately.

[0086] In one embodiment of the present application, the viewing module 230 is specifically used to: view the autonomous driving data packet through the live broadcast page to achieve remote visualization.

[0087] The client can view the autonomous driving data packet through the live broadcast page, and can use the autonomous driving data packet to reproduce the vehicle operation situation in a scene to find problems, thereby realizing remote visualization.

[0088] In this way, the client can access the server remotely and view the saved autonomous driving data packets in real time through the live broadcast page. In addition, if there is a problem with the autonomous driving vehicle during operation, the collected data packets will be asynchronously uploaded to the server, so the client can also view the autonomous driving data packets in time.

[0089] In one embodiment of the present application, it also includes: a multi-user access module for

[0090] When a new user establishes a communication connection with the server by accessing the browser, a new live broadcast page returned by the server through the live broadcast of the visualization platform is received. The server includes multiple servers for responding to the communication connections selected by different clients.

[0091] In one embodiment of the present application, the multi-user access module is also used

[0092] When multiple users simultaneously establish a communication connection with the server by accessing the browser, each user receives a live broadcast page on a different browser page returned by the server through the live broadcast of the visualization platform. The browser page includes multiple live broadcast pages for returning different users.

[0093] In one embodiment of the present application, the establishment module 210 is also used to

[0094] The access browser establishes a connection with the public server through Websocket;

[0095] The visualization platform is deployed on a private server, and is connected to a public server via an http protocol, so that a browser is connected to the private server.

[0096] In one embodiment of the present application, the receiving module 220 is further used to

[0097] Based on the WebRTC remote mirroring operation technology, a live broadcast page returned by the server through the live broadcast of the visualization platform is received on the browser.

[0098] It can be understood that the above remote visualization device can implement each step of the remote visualization method provided in the above embodiments, and the relevant explanations about the remote visualization method are applicable to the remote visualization device, which will not be repeated here.

[0099] Figure 7 This is a schematic diagram of the structure of an electronic device according to an embodiment of the present application. Figure 7 At the hardware level, the electronic device includes a processor, and optionally also includes an internal bus, a network interface, and a memory. The memory may include a memory, such as a high-speed random access memory (RAM), and may also include a non-volatile memory (non-volatile memory), such as at least one disk storage. Of course, the electronic device may also include hardware required for other services.

[0100] The processor, network interface and memory can be interconnected through an internal bus, which can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 7 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0101] The memory is used to store the program. Specifically, the program may include a program code, and the program code includes a computer operation instruction. The memory may include a memory and a non-volatile memory, and provides instructions and data to the processor.

[0102] The processor reads the corresponding computer program from the non-volatile memory into the memory and then runs it, forming a remote visualization device at the logical level. The processor executes the program stored in the memory and is specifically used to perform the following operations:

[0103] Establishing a communication connection with a server by accessing a browser, wherein the server is deployed with a visualization platform and the server pre-stores an autonomous driving data packet;

[0104] Receiving a live broadcast page returned by the server through the visualization platform, wherein the live broadcast page is a mirror image of the server, and transmitting the user's operation to the server in real time to simulate the user's operation on the server;

[0105] The autonomous driving data packet is viewed through the live broadcast page to achieve remote visualization.

[0106] or,

[0107] Deploy a visualization platform and save autonomous driving data packages in advance;

[0108] Establishing a communication connection with the client, and returning a live page to the client through the visualization platform, wherein the live page is a mirror image of the server;

[0109] In response to an operation on the live broadcast page, the autonomous driving data packet is viewed through the live broadcast page.

[0110] The above application Figure 1 or Figure 3 The method performed by the remote visualization device disclosed in the illustrated embodiment can be applied to a processor or implemented by a processor. The processor may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in the processor or an instruction in the form of software. The above processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiments of the present application can be directly embodied as a hardware decoding processor for execution, or a combination of hardware and software modules in the decoding processor for execution. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

[0111] The electronic device may also perform Figure 1 or Figure 3 A method for executing a remote visualization device in a remote visualization device, and realizing a remote visualization device in Figure 1 or Figure 3 The functions of the illustrated embodiment will not be described in detail in the embodiments of the present application.

[0112] The present application also provides a computer-readable storage medium, which stores one or more programs, wherein the one or more programs include instructions, which, when executed by an electronic device including multiple application programs, enable the electronic device to execute Figure 1 or Figure 3 The method performed by the remote visualization device in the illustrated embodiment is specifically used to perform:

[0113] Establishing a communication connection with a server by accessing a browser, wherein the server is deployed with a visualization platform and the server pre-stores an autonomous driving data packet;

[0114] Receiving a live broadcast page returned by the server through the visualization platform, wherein the live broadcast page is a mirror image of the server, and transmitting the user's operation to the server in real time to simulate the user's operation on the server;

[0115] The autonomous driving data packet is viewed through the live broadcast page to achieve remote visualization.

[0116] or,

[0117] Deploy a visualization platform and save autonomous driving data packages in advance;

[0118] Establishing a communication connection with the client, and returning a live page to the client through the visualization platform, wherein the live page is a mirror image of the server;

[0119] In response to an operation on the live broadcast page, the autonomous driving data packet is viewed through the live broadcast page.

[0120] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0121] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0122] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0123] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0124] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0125] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0126] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0127] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0128] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0129] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A remote visualization method, wherein: Applied to a client, the method comprises: Establishing a communication connection with a server by accessing a browser, wherein the server is deployed with a visualization platform and the server pre-stores an autonomous driving data packet; Receiving a live broadcast page returned by the server through the visualization platform, wherein the live broadcast page is a mirror image of the server, and transmitting the user's operation to the server in real time to simulate the user's operation on the server; The autonomous driving data packet is viewed through the live broadcast page to achieve remote visualization.

2. The method of claim 1, wherein: The method further comprises: When a new user establishes a communication connection with the server by accessing the browser, a new live broadcast page returned by the server through the live broadcast of the visualization platform is received. The server includes multiple servers for responding to the communication connections selected by different clients.

3. The method of claim 2, wherein: The method further comprises: When multiple users simultaneously establish a communication connection with the server by accessing the browser, each user receives a live broadcast page on a different browser page returned by the server through the live broadcast of the visualization platform. The browser page includes multiple live broadcast pages for returning different users.

4. The method of claim 1, wherein: The step of establishing a communication connection with the server by accessing the browser includes: The access browser establishes a connection with the public server through Websocket; The visualization platform is deployed on a private server, and is connected to a public server via an http protocol, so that a browser is connected to the private server.

5. The method of claim 4, wherein: The receiving a live broadcast page returned by the server through the visualization platform, wherein the live broadcast page is a mirror image of the server, includes: Based on the WebRTC remote mirroring operation technology, a live broadcast page returned by the server through the live broadcast of the visualization platform is received on the browser.

6. A remote visualization method, wherein: Applied to the server, the method includes: Deploy a visualization platform and save autonomous driving data packages in advance; Establishing a communication connection with the client, and returning a live page to the client through the visualization platform, wherein the live page is a mirror image of the server; In response to an operation on the live broadcast page, the autonomous driving data packet is viewed through the live broadcast page.

7. The method of claim 6, wherein: The method further comprises: When a communication connection is established with a new client, a new live broadcast page is created and live broadcast is broadcast to the new client via the visualization platform; and / or, When multiple user terminals establish communication connections at the same time, corresponding live broadcast pages are established respectively and broadcast live to multiple user terminals through the visualization platform.

8. A remote visualization device, wherein: The device comprises: An establishment module is used to establish a communication connection with a server by accessing a browser, wherein the server is deployed with a visualization platform and the server pre-stores an autonomous driving data packet; A receiving module, used for receiving a live broadcast page returned by the server through the visualization platform, wherein the live broadcast page is a mirror image of the server; A viewing module is used to view the autonomous driving data packet through the live broadcast page to achieve remote visualization.

9. An electronic device, comprising: processor; as well as A memory arranged to store computer executable instructions, which, when executed, cause the processor to perform the method of any one of claims 1 to 5, and / or any one of claims 6 to 7.

10. A computer-readable storage medium storing one or more programs, which, when executed by an electronic device including a plurality of application programs, enables the electronic device to execute any of the methods of claims 1 to 5 and / or any of the methods of claims 6 to 7.

Images