A method, device and electronic device for visualizing real-scene trajectory

Abstract

The present application relates to a method, device and electronic device for visualizing the real scene of a trajectory, which is used to solve the problem that the existing memory parking solution cannot meet the user's needs for obtaining or tracing back the real scene information of the target trajectory. The method includes receiving a display signal for displaying a real scene image corresponding to a specified position in the target trajectory, and then based on the display signal, obtaining the real scene image corresponding to the specified position, and then placing the real scene image corresponding to the specified position in a first display area for visualization. Based on the above method, the user can be provided with a real scene image of any position in the target trajectory, as well as a scaled and rotated image of the real scene image, thereby effectively preventing the user from forgetting the actual scene position of the target trajectory after creating the target trajectory. Based on this, it is also convenient for the user to trace the real scene images of each position point of the established target trajectory, and a 360° panoramic real scene image can also be provided, thereby achieving the effect of improving the user experience.

Description

Technical Field

[0001] The present application relates to the field of autonomous driving technology, and in particular to a method, device and electronic device for visualizing real-scene trajectory. Background Art

[0002] With the development of autonomous driving, existing memory parking solutions can realize automatic parking through recorded parking routes (or target trajectories). However, in practical applications, users also hope to obtain or trace back the real scene information of the recorded target trajectory. In view of this, existing memory parking solutions cannot meet the needs of users to obtain or trace back the real scene information of the target trajectory. Summary of the invention

[0003] The present application provides a method, device and electronic device for visualizing the real scene of a trajectory, which are used to provide users with a real scene image of any position in a target trajectory, as well as a scaled and rotated image of the real scene image, thereby effectively preventing the user from forgetting the actual scene position of the target trajectory after creating the target trajectory. Based on this, it is also convenient for the user to trace the real scene images of various position points of the established target trajectory, and can also provide a 360° panoramic real scene image, thereby achieving the effect of improving the user experience.

[0004] In a first aspect, the present application provides a method for visualizing a trajectory scene, the method comprising:

[0005] receiving a display signal for displaying a real scene image corresponding to a specified position in a target trajectory;

[0006] Based on the display signal, acquiring a real scene image corresponding to the designated position;

[0007] The real scene image corresponding to the designated position is placed in the first display area for visualization.

[0008] Through the above-mentioned method, the problem that the current memory parking solution is difficult to provide real-view information of the target trajectory is solved, so that the user can obtain or trace the real-view image of any position in the target trajectory.

[0009] In one possible design, obtaining the real-scene image corresponding to the specified location includes: determining whether the real-scene image corresponding to the specified location is obtained from a local storage space; if so, obtaining the real-scene image corresponding to the specified location from the local storage space; if not, obtaining the real-scene image corresponding to the specified location from an external storage space.

[0010] Through the above method, a mechanism for storing and transmitting the real-scene image of the target trajectory is provided, so that when a display signal for displaying the real-scene image corresponding to the specified position in the target trajectory is received, the real-scene image corresponding to the specified position can be obtained, thereby realizing the tracing of the real-scene image at any position in the target trajectory, meeting the user's display needs and improving the user's usage experience.

[0011] In one possible design, obtaining the real-scene image corresponding to the designated position from the external storage space includes: sending an acquisition signal for obtaining the real-scene image corresponding to the target trajectory to the external storage space; within a specified time period after sending the acquisition signal, determining whether to obtain the real-scene image corresponding to the target trajectory from the external storage space; if so, sending a reception success signal to the external storage space, and obtaining the real-scene image corresponding to the designated position based on the real-scene image corresponding to the target trajectory; if not, sending a reception failure signal to the external storage space, so that the external storage space resends the real-scene image corresponding to the target trajectory based on the reception failure signal.

[0012] By acquiring the real scene images corresponding to the target trajectory from the external storage space, the real scene images are stored in the local storage space. Then, after receiving a display signal for displaying the real scene images corresponding to the specified position in the target trajectory, the corresponding real scene images are acquired from the local storage space, and the real scene images are placed in the first display area for visualization.

[0013] In one possible design, after placing the real-scene image corresponding to the designated position in the first display area for visualization, the method further includes: in response to receiving a first request signal for scaling the real-scene image of the first display area, scaling the real-scene image of the first display area based on the scaling ratio in the first request signal; and in response to receiving a second request signal for rotating the real-scene image of the first display area, rotating the real-scene image of the first display area based on the rotation angle in the second request signal.

[0014] The above method can provide users with real-life images that better meet their actual needs, that is, users can rotate the 3D real-life images at any angle according to their own needs, thereby obtaining a more realistic real-life scene and improving the user's actual experience.

[0015] In one possible design, the method also includes: in response to receiving a successful creation signal of the real-scene image corresponding to the target trajectory, obtaining the real-scene image corresponding to the target trajectory from an external storage space; determining whether the real-scene image corresponding to the target trajectory is obtained from the external storage space within a specified time period; if so, saving the real-scene image corresponding to the target trajectory in a local storage space, and sending a successful reception signal to the external storage space; if not, sending a reception failure signal to the external storage space, so that the external storage space resends the real-scene image corresponding to the target trajectory based on the reception failure signal.

[0016] Through the above method, a method for creating a real-scene image corresponding to a target trajectory is proposed, that is, upon receiving a successful creation signal of the real-scene image corresponding to the target trajectory, the real-scene image corresponding to the target trajectory is obtained from an external storage space, and the obtained real-scene image corresponding to the target trajectory is saved to a local storage space.

[0017] In one possible design, the external storage space resends the real-scene image corresponding to the target trajectory based on the signal of failed reception, including: the external storage space resends the real-scene image corresponding to the target trajectory based on the signal of failed reception; in response to the number of retransmissions of the external storage space being less than a preset threshold and the external storage space not receiving the signal of successful reception, the external storage space repeatedly sends the real-scene image corresponding to the target trajectory.

[0018] The above retransmission mechanism can effectively ensure the stable transmission of images, that is, when the local storage space of the vehicle does not contain the corresponding image, the corresponding image can be obtained from the parking controller for the user to preview, thereby improving the user experience. In addition, the setting of the upper limit of the number of retransmission mechanisms can ensure the delay of the image transmission process, avoid the transmission falling into an endless loop, and invalidly occupy the transmission resources.

[0019] In a possible design, the target trajectory is placed in a second display area for visualization; the second display area includes at least a first sub-display identifier, a second sub-display identifier and a third sub-display identifier; the first sub-display identifier is used to represent the starting position of the target trajectory; the second sub-display identifier is used to represent the target parking space position of the target trajectory; and the third sub-display identifier is used to represent the ending position of the target trajectory.

[0020] Through the above method, the starting position, target parking space position and end position of the target trajectory are marked accordingly, so that the user can more easily and accurately obtain the real-life images of the starting position, target parking space position and end position of the target trajectory, thereby effectively improving the user experience.

[0021] In a second aspect, the present application provides a device for visualizing a real scene of a trajectory, the device comprising:

[0022] A receiving module receives a display signal for displaying a real scene image corresponding to a specified position in a target trajectory;

[0023] An acquisition module, based on the display signal, acquires a real scene image corresponding to the designated position;

[0024] The display module places the real scene image corresponding to the designated position in the first display area for visualization.

[0025] In a possible design, the real-scene image corresponding to the designated position is obtained, and the acquisition module is specifically used to: determine whether the real-scene image corresponding to the designated position is obtained from the local storage space; if so, obtain the real-scene image corresponding to the designated position from the local storage space; if not, obtain the real-scene image corresponding to the designated position from the external storage space.

[0026] In a possible design, the real-scene image corresponding to the designated position is obtained from the external storage space, and the acquisition module is specifically used to: send an acquisition signal for obtaining the real-scene image corresponding to the target trajectory to the external storage space; within a specified time period after sending the acquisition signal, determine whether to obtain the real-scene image corresponding to the target trajectory from the external storage space; if so, send a reception success signal to the external storage space, and obtain the real-scene image corresponding to the designated position based on the real-scene image corresponding to the target trajectory; if not, send a reception failure signal to the external storage space, so that the external storage space resends the real-scene image corresponding to the target trajectory based on the reception failure signal.

[0027] In one possible design, after placing the real-scene image corresponding to the designated position in the first display area for visualization, the device is further used to: in response to receiving a first request signal for scaling the real-scene image of the first display area, scale the real-scene image of the first display area based on the scaling ratio in the first request signal; and in response to receiving a second request signal for rotating the real-scene image of the first display area, rotate the real-scene image of the first display area based on the rotation angle in the second request signal.

[0028] In one possible design, the device is also used to: in response to receiving a successful creation signal of the real-scene image corresponding to the target trajectory, obtain the real-scene image corresponding to the target trajectory from an external storage space; determine whether the real-scene image corresponding to the target trajectory is obtained from the external storage space within a specified time period; if so, save the real-scene image corresponding to the target trajectory in a local storage space, and send a successful reception signal to the external storage space; if not, send a reception failure signal to the external storage space, so that the external storage space resends the real-scene image corresponding to the target trajectory based on the reception failure signal.

[0029] In one possible design, the external storage space resends the real-scene image corresponding to the target trajectory based on the signal of failed reception, and the acquisition module is specifically used for or the device is also used for: the external storage space resends the real-scene image corresponding to the target trajectory based on the signal of failed reception; in response to the number of retransmissions of the external storage space being less than a preset threshold and the external storage space not receiving the signal of successful reception, the external storage space repeatedly sends the real-scene image corresponding to the target trajectory.

[0030] In a possible design, the target trajectory is placed in a second display area for visualization; the second display area includes at least a first sub-display identifier, a second sub-display identifier and a third sub-display identifier; the first sub-display identifier is used to represent the starting position of the target trajectory; the second sub-display identifier is used to represent the target parking space position of the target trajectory; and the third sub-display identifier is used to represent the ending position of the target trajectory.

[0031] In a third aspect, the present application provides an electronic device, the electronic device comprising:

[0032] Memory, used to store computer programs;

[0033] The processor is used to implement the above-mentioned method steps for visualizing a real scene of a trajectory when executing the computer program stored in the memory.

[0034] In a fourth aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the computer program implements the above-mentioned method steps for visualizing a trajectory real scene.

[0035] For each aspect from the second to the fourth aspect and the technical effects that may be achieved by each aspect, please refer to the above description of the technical effects that can be achieved by the first aspect or various possible schemes in the first aspect, and no further details will be given here. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 A first schematic diagram of a possible application scenario provided by the present application;

[0037] Figure 2 A flowchart of a method for visualizing a real-life trajectory provided in this application;

[0038] Figure 3 A second schematic diagram of a possible application scenario provided by the present application;

[0039] Figure 4 A third schematic diagram of a possible application scenario provided by the present application;

[0040] Figure 5 A schematic diagram of a device for visualizing a real-life trajectory provided in this application;

[0041] Figure 6 A schematic diagram of the structure of an electronic device provided in this application. DETAILED DESCRIPTION

[0042] In order to make the purpose, technical solution and advantages of the present application more clear, the present application will be further described in detail below in conjunction with the accompanying drawings. The specific operation method in the method embodiment can also be applied to the device embodiment or the system embodiment.

[0043] In the description of this application, "multiple" is understood to be "at least two". "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent three situations: A exists alone, A and B exist at the same time, and B exists alone. A is connected to B, which can represent two situations: A is directly connected to B and A is connected to B through C. In addition, in the description of this application, words such as "first" and "second" are only used for the purpose of distinguishing descriptions, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying order.

[0044] The solution provided by the embodiment of the present application involves autonomous driving, memory parking, and self-learning mapping technology. Specifically, the embodiment of the present application is applied to vehicle equipment, such as IHU (Infotainment Head Unit), to obtain the real-scene image corresponding to the specified position based on the received display signal for displaying the real-scene image corresponding to the specified position in the target trajectory, and place the obtained real-scene image in the first display area for visualization. In addition, the real-scene image corresponding to the specified position is first obtained from the local storage space. If it is not obtained from the local storage space, the real-scene image corresponding to the specified position is obtained from the external storage space.

[0045] The following is a brief introduction to the design concept of the embodiments of the present application.

[0046] At present, although the memory parking solution can realize the function of automatic parking based on the target trajectory, it cannot meet the user's needs to obtain or trace back the real scene information of the target trajectory. Furthermore, when using the memory parking function, the user not only wants to view the target trajectory of the memory parking, but also wants to view the real scene image of any position in the target trajectory.

[0047] In order to solve the problem that the current memory parking solution is difficult to provide real-scene information of the target trajectory, the user can obtain or trace the real-scene image of any position in the target trajectory.

[0048] The embodiment of the present application provides a method for visualizing a real scene of a trajectory, in which real scene images corresponding to a target trajectory are obtained from an external storage space, and the real scene images are stored in a local storage space. Then, after receiving a display signal for displaying a real scene image corresponding to a specified position in the target trajectory, the corresponding real scene image is obtained from the local storage space, and the real scene image is placed in a first display area for visualization.

[0049] That is to say, in the embodiment of the present application, a mechanism for storing and transmitting real-scene images of the target trajectory is used, so that when a display signal for displaying the real-scene image corresponding to a specified position in the target trajectory is received, the real-scene image corresponding to the specified position can be obtained, thereby achieving the tracing of the real-scene image of any position in the target trajectory, meeting the user's display needs, and improving the user's usage experience.

[0050] In addition, the embodiment of the present application also takes into account the situation where there is no real-scene image corresponding to the specified location in the local storage space. In this case, the real-scene image of the specified location will be obtained from the external storage space, and then the real-scene image of any location in the target trajectory can be traced back to meet the user's display needs and improve the user's experience.

[0051] In addition, in an embodiment of the present application, a method for creating a real-scene image corresponding to a target trajectory can also be proposed, that is, after receiving a successful creation signal of the real-scene image corresponding to the target trajectory, the real-scene image corresponding to the target trajectory is obtained from an external storage space, and the obtained real-scene image corresponding to the target trajectory is saved to a local storage space.

[0052] The following briefly introduces the application scenarios to which the technical solutions of the embodiments of the present application can be applied. It should be noted that the application scenarios introduced below are only used to illustrate the embodiments of the present application and are not limited. In the specific implementation process, the technical solutions provided by the embodiments of the present application can be flexibly applied according to actual needs.

[0053] The solution provided in the embodiments of the present application can be applied to most intelligent driving scenarios, especially to automatic parking scenarios.

[0054] like Figure 1 As shown, it is a schematic diagram of an application scenario provided by an embodiment of the present application. In this scenario, a vehicle computer and a parking controller may be included.

[0055] The parking controller is used to obtain and save the real-life image corresponding to the target trajectory, and transmit the saved real-life image corresponding to the target trajectory to the vehicle computer through the driving recorder and the gateway.

[0056] The vehicle computer is used to receive the real-scene image corresponding to the target trajectory transmitted by the parking controller, and save the received real-scene image corresponding to the target trajectory in the local storage space of the vehicle computer.

[0057] It is worth noting that, for the vehicle computer, the storage space of the vehicle computer itself is the local storage space, while the storage space of the parking controller is the external storage space.

[0058] In practical applications, the vehicle computer may be an IHU, and the parking controller may be an ASM (Automatic Storage Management). Hereinafter, the real scene image corresponding to the target trajectory is referred to as a map.

[0059] Among them, ASM will be used to create maps. Specifically, in response to ASM receiving a start instruction to create a map, real-time image acquisition of the vehicle's driving process based on the target trajectory will be performed based on the vehicle's surround view camera. In the process of real-time acquisition of real-scene images corresponding to each position of the target trajectory, ASM will cache these real-scene images until the vehicle reaches the end position of the target trajectory.

[0060] Exemplarily, the time of creating the map is closely related to the map creation event selected by the user. The real scene image is a top view of the vehicle and a four-way stitched top view, that is, the real scene image at any position is a 3D (3Dimension) real scene image, which provides the user with a 360° surround view function centered on his position.

[0061] Optionally, when ASM is saving the real-life images corresponding to each position of the target trajectory, ASM will also make corresponding annotations for the starting position, target parking space position and ending position of the target trajectory, and establish an association relationship between the corresponding annotation information and the starting position, the target parking space position and the ending position, and then save the association relationship to the local storage space.

[0062] The following describes the method provided by the exemplary embodiment of the present application in combination with the application scenario described above and with reference to the accompanying drawings. It should be noted that the above application scenario is only shown to facilitate understanding of the spirit and principles of the present application, and the implementation of the present application is not limited in this regard.

[0063] See also Figure 2 As shown, it is a schematic diagram of the process flow of the method for visualizing the real scene of the trajectory provided by the embodiment of the present application. The specific implementation process of the method is as follows:

[0064] Step 201: receiving a display signal for displaying a real scene image corresponding to a specified position in a target trajectory;

[0065] Step 202: Based on the display signal, obtain a real scene image corresponding to the designated position;

[0066] Step 203: placing the real scene image corresponding to the designated position in the first display area for visualization.

[0067] When executing step 201, it is also necessary to obtain the real-scene image corresponding to the target trajectory. Specifically, in response to receiving the successful creation signal of the real-scene image corresponding to the target trajectory, the vehicle computer obtains the real-scene image corresponding to the target trajectory from the external storage space, and then determines whether the real-scene image corresponding to the target trajectory is obtained from the external storage space within a specified time period: if so, the real-scene image corresponding to the target trajectory is saved in the local storage space, and a successful reception signal is sent to the external storage space; if not, a reception failure signal is sent to the external storage space, so that the external storage space resends the real-scene image corresponding to the target trajectory based on the reception failure signal.

[0068] It is worth noting that the above-mentioned local storage space is the internal storage space of the vehicle computer itself, and the above-mentioned external storage space is the internal storage space of the parking controller itself.

[0069] For the parking controller, if the parking controller receives a reception failure signal sent by the vehicle computer, the parking controller will resend the real scene image corresponding to the target track to the vehicle computer. Specifically, if the current number of retransmissions is less than the preset threshold, and the parking controller does not receive a reception success signal sent by the vehicle computer, the parking controller will repeatedly send the real scene image corresponding to the target track. Generally speaking, the number of retransmissions is set to 3 times.

[0070] The above retransmission mechanism can effectively ensure the stable transmission of images, that is, when the local storage space of the vehicle does not contain the corresponding image, the corresponding image can be obtained from the parking controller for the user to preview, thereby improving the user experience. In addition, the setting of the upper limit of the number of retransmission mechanisms can ensure the delay of the image transmission process, avoid the transmission falling into an endless loop, and invalidly occupy the transmission resources.

[0071] In an embodiment of the present application, the vehicle computer first receives a display signal for displaying a real-scene image corresponding to a specified position in a target trajectory, and then, based on the display signal, determines whether to obtain a real-scene image corresponding to the specified position from a local storage space: if so, obtain the real-scene image corresponding to the specified position from the local storage space; if not, obtain the real-scene image corresponding to the specified position from the parking controller.

[0072] Specifically, if a real-scene image corresponding to a specified position is to be obtained from a parking controller, the vehicle computer first needs to send an acquisition signal to the parking controller for acquiring a real-scene image corresponding to a target trajectory, and within a specified period of time after sending the acquisition signal, determine whether a real-scene image corresponding to the target trajectory is acquired from the parking controller: if so, a reception success signal is sent to the parking controller, and based on the real-scene image corresponding to the target trajectory, the real-scene image corresponding to the specified position is acquired; if not, a reception failure signal is sent to the parking controller, so that the parking controller resends the real-scene image corresponding to the target trajectory based on the reception failure signal.

[0073] For the parking controller, if the parking controller receives a reception failure signal sent by the vehicle computer, the parking controller will resend the real scene image corresponding to the target track to the vehicle computer. Specifically, if the current number of retransmissions is less than the preset threshold, and the parking controller does not receive a reception success signal sent by the vehicle computer, the parking controller will repeatedly send the real scene image corresponding to the target track. Generally speaking, the number of retransmissions is set to 3 times.

[0074] The above retransmission mechanism can effectively ensure the stable transmission of images, that is, when the local storage space of the vehicle does not contain the corresponding image, the corresponding image can be obtained from the parking controller for the user to preview, thereby improving the user experience. In addition, the setting of the upper limit of the number of retransmission mechanisms can ensure the delay of the image transmission process, avoid the transmission falling into an endless loop, and invalidly occupy the transmission resources.

[0075] Furthermore, in an embodiment of the present application, after the real-scene image corresponding to the specified position is placed in the first display area of ​​the vehicle computer for visual display: if a first request signal for scaling the real-scene image of the first display area is received, the real-scene image of the first display area is scaled based on the scaling ratio in the first request signal; if a second request signal for rotating the real-scene image of the first display area is received, the real-scene image of the first display area is rotated based on the rotation angle in the second request signal.

[0076] In this way, a 360° surround view of the real scene can be provided to the user, that is, the user can rotate the 3D real scene view at any angle according to his or her needs, thereby obtaining a more realistic real scene and improving the user's actual experience.

[0077] To sum up, through the trajectory real scene visualization method provided by the present application, the user can be provided with a real scene image of any position in the target trajectory. Furthermore, the user can be provided with the zoom and rotation functions of the real scene image, which effectively prevents the user from forgetting the actual scene position of the target trajectory after creating the target trajectory. Based on this, the user can easily trace the real scene images of each position point of the established target trajectory, and can also provide a 360° panoramic real scene map, thereby achieving the effect of improving the user experience.

[0078] To facilitate those skilled in the art to better understand the technical solution provided in the embodiment of the present application, the technical solution provided in the embodiment of the present application is described in detail below in conjunction with the interaction process between the IHU and the ASM.

[0079] like Figure 3 As shown, in some application scenarios, ASM will send the real-scene image corresponding to the created target trajectory to IHU.

[0080] exist Figure 3 In the process, if ASM determines that the map is created successfully, it will notify IHU to receive the corresponding map signal, that is, ASM sends a map reception signal to IHU. Then, ASM will send all the map images to IHU. If IHU receives all the map images sent by ASM, IHU will reply ASM with a map reception success signal; if IHU does not receive all the map images sent by ASM, IHU will reply ASM with a map reception failure signal. For ASM, if it does not receive the map reception success signal sent by IHU after a period of time, it will retransmit.

[0081] Furthermore, in an embodiment of the present application, a mechanism for repeating transmission three times can be set for ASM, that is, if ASM does not receive a successful map reception signal sent by IHU after three retransmissions, then ASM stops the retransmission operation.

[0082] It is worth mentioning that if ASM receives a successful map reception signal from IHU, ASM will delete the internally stored map, that is, delete the map image successfully transmitted to IHU.

[0083] like Figure 4 As shown, in some application scenarios, the IHU is used to receive a display signal, and based on the display signal, obtain a corresponding map image from a local storage space or an ASM (external storage space) for visual display.

[0084] exist Figure 4In the IHU, the IHU will provide a display area for the user to preview the target trajectory. For example, when the user clicks the image "preview" button on the IHU or any position (track point) in the target trajectory, the IHU will receive a display signal for the corresponding map image.

[0085] In some embodiments, in response to the IHU receiving the display signal, the IHU will first obtain the corresponding image from its own local storage space, and after obtaining the corresponding image, display the image in the display area of ​​the IHU for user preview.

[0086] In some embodiments, in response to the IHU receiving the display signal, if the IHU has not obtained the corresponding image from the local storage space, it will apply to the ASM to obtain the corresponding image. Figure 3 As shown, the IHU will send a map acquisition signal to the ASM, so that the ASM will send a map reception signal to the IHU after receiving the map acquisition signal. After receiving the map reception signal, the IHU will start to receive the map images sent by the ASM until all are successfully received, and then the IHU will send a map reception success signal to the ASM. In addition, if the IHU does not receive all successfully, then the IHU will send a map reception failure signal to the ASM. For the ASM, if it does not receive the map reception success signal sent by the IHU after a period of time, it will retransmit.

[0087] Furthermore, in an embodiment of the present application, a mechanism for repeating transmission three times can be set for ASM, that is, if ASM does not receive a successful map reception signal sent by IHU after three retransmissions, then ASM stops the retransmission operation.

[0088] It is worth mentioning that if ASM receives a successful map reception signal from IHU, ASM will delete the internally stored map, that is, delete the map image successfully transmitted to IHU.

[0089] It should be noted that Figure 3 and Figure 4 The method provided in the embodiment of the present application is not limited to Figure 3 and Figure 4 The application scenarios shown can also be used in other possible application scenarios, and the embodiments of the present application are not limited thereto. Figure 3 and Figure 4 The functions that can be implemented by each device in the application scenario shown will be described in the subsequent method embodiments, and will not be described in detail here.

[0090] Based on the same inventive concept, the present application also provides a device for visualizing the real scene of a trajectory, which is used to obtain and trace back the real scene information of the target trajectory, solves the problem that the existing automatic parking solution cannot meet the user's demand for obtaining or tracing back the real scene information of the target trajectory, and effectively improves the user's actual experience, see Figure 5 , the device comprises:

[0091] A receiving module 501 receives a display signal for displaying a real scene image corresponding to a specified position in a target track;

[0092] An acquisition module 502 is configured to acquire a real scene image corresponding to the designated position based on the display signal;

[0093] The display module 503 places the real scene image corresponding to the designated position in the first display area for visualization.

[0094] In a possible design, the real-scene image corresponding to the specified position is obtained, and the acquisition module 502 is specifically used to: determine whether the real-scene image corresponding to the specified position is obtained from the local storage space; if so, obtain the real-scene image corresponding to the specified position from the local storage space; if not, obtain the real-scene image corresponding to the specified position from the external storage space.

[0095] In one possible design, the real-scene image corresponding to the designated position is obtained from the external storage space, and the acquisition module 502 is specifically used to: send an acquisition signal for obtaining the real-scene image corresponding to the target trajectory to the external storage space; within a specified time period after sending the acquisition signal, determine whether to obtain the real-scene image corresponding to the target trajectory from the external storage space; if so, send a reception success signal to the external storage space, and obtain the real-scene image corresponding to the designated position based on the real-scene image corresponding to the target trajectory; if not, send a reception failure signal to the external storage space, so that the external storage space resends the real-scene image corresponding to the target trajectory based on the reception failure signal.

[0096] In one possible design, after placing the real-scene image corresponding to the designated position in the first display area for visualization, the device is further used to: in response to receiving a first request signal for scaling the real-scene image of the first display area, scale the real-scene image of the first display area based on the scaling ratio in the first request signal; and in response to receiving a second request signal for rotating the real-scene image of the first display area, rotate the real-scene image of the first display area based on the rotation angle in the second request signal.

[0097] In one possible design, the device is also used to: in response to receiving a successful creation signal of the real-scene image corresponding to the target trajectory, obtain the real-scene image corresponding to the target trajectory from an external storage space; determine whether the real-scene image corresponding to the target trajectory is obtained from the external storage space within a specified time period; if so, save the real-scene image corresponding to the target trajectory in a local storage space, and send a successful reception signal to the external storage space; if not, send a reception failure signal to the external storage space, so that the external storage space resends the real-scene image corresponding to the target trajectory based on the reception failure signal.

[0098] In one possible design, the external storage space resends the real-scene image corresponding to the target trajectory based on the signal of failed reception, and the acquisition module 502 is specifically used for or the device is also used for: the external storage space resends the real-scene image corresponding to the target trajectory based on the signal of failed reception; in response to the number of retransmissions of the external storage space being less than a preset threshold and the external storage space not receiving the signal of successful reception, the external storage space repeatedly sends the real-scene image corresponding to the target trajectory.

[0099] In a possible design, the target trajectory is placed in a second display area for visualization; the second display area includes at least a first sub-display identifier, a second sub-display identifier and a third sub-display identifier; the first sub-display identifier is used to represent the starting position of the target trajectory; the second sub-display identifier is used to represent the target parking space position of the target trajectory; and the third sub-display identifier is used to represent the ending position of the target trajectory.

[0100] Based on the above device, the user can be provided with a real-life image of any position in the target trajectory. Furthermore, the user can be provided with the function of scaling and rotating the real-life image, which effectively prevents the user from forgetting the actual scene position of the target trajectory after creating the target trajectory. Based on this, it is convenient for the user to trace the real-life image of each position point of the established target trajectory, and a 360° panoramic real-life image can also be provided, thereby achieving the effect of improving the user experience.

[0101] Based on the same inventive concept, an electronic device is also provided in the embodiment of the present application, and the electronic device can realize the function of the aforementioned trajectory real scene visualization device, referring to Figure 6 , the electronic device comprises:

[0102] At least one processor 601, and a memory 602 connected to the at least one processor 601. The specific connection medium between the processor 601 and the memory 602 is not limited in the embodiment of the present application. Figure 6In the example, the processor 601 and the memory 602 are connected via a bus 600. Figure 6 The connection between other components is shown by bold lines, and is not intended to be limiting. The bus 600 can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 6 Only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus. Alternatively, the processor 601 can also be called a controller, and there is no limitation on the name.

[0103] In the embodiment of the present application, the memory 602 stores instructions that can be executed by at least one processor 601. The at least one processor 601 can execute the method for visualizing the track scene discussed above by executing the instructions stored in the memory 602. The processor 601 can implement Figure 5 The functions of each module in the device shown.

[0104] Among them, the processor 601 is the control center of the device, and can use various interfaces and lines to connect the various parts of the entire control device. By running or executing instructions stored in the memory 602 and calling the data stored in the memory 602, the various functions of the device and processing data, the device / system can be monitored as a whole.

[0105] In one possible design, the processor 601 may include one or more processing units, and the processor 601 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 601. In some embodiments, the processor 601 and the memory 602 may be implemented on the same chip, and in some embodiments, they may also be implemented separately on separate chips.

[0106] Processor 601 can be a general-purpose processor, such as a central processing unit (CPU), a digital signal processor, an application-specific integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, and can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application. A general-purpose processor can be a microprocessor or any conventional processor, etc. The steps of the visualization method of the trajectory real scene disclosed in the embodiments of the present application can be directly embodied as a hardware processor execution, or a combination of hardware and software modules in the processor.

[0107] The memory 602 is a non-volatile computer-readable storage medium that can be used to store non-volatile software programs, non-volatile computer executable programs and modules. The memory 602 may include at least one type of storage medium, such as a flash memory, a hard disk, a multimedia card, a card-type memory, a random access memory (Random Access Memory, RAM), a static random access memory (Static Random Access Memory, SRAM), a programmable read-only memory (Programmable Read Only Memory, PROM), a read-only memory (Read Only Memory, ROM), an electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, EEPROM), a magnetic memory, a disk, an optical disk, etc. The memory 602 is any other medium that can be used to carry or store a desired program code in the form of an instruction or data structure and can be accessed by a computer, but is not limited thereto. The memory 602 in the embodiment of the present application can also be a circuit or any other device / system that can realize a storage function, for storing program instructions and / or data.

[0108] By programming the processor 601, the code corresponding to the method for visualizing the real scene of the trajectory introduced in the above embodiment can be fixed into the chip, so that the chip can execute the real scene of the trajectory during operation. Figure 2 The steps of the method for visualizing the real scene of the trajectory in the embodiment shown are as follows: How to design and program the processor 601 is a technique known to those skilled in the art and will not be described in detail here.

[0109] Based on the same inventive concept, an embodiment of the present application further provides a storage medium, which stores computer instructions. When the computer instructions are executed on a computer, the computer executes the method for visualizing the trajectory real scene discussed above.

[0110] In some possible implementations, various aspects of the method for visualizing a real scene of a trajectory provided in the present application may also be implemented in the form of a program product, which includes a program code. When the program product is run on an apparatus, the program code is used to enable the control device to execute the steps of the method for visualizing a real scene of a trajectory according to various exemplary implementations of the present application described above in this specification.

[0111] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, devices / systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0112] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0113] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0114] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0115] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A method for visualizing a real scene of a trajectory, characterized in that: The method comprises: receiving a display signal for displaying a real scene image corresponding to a specified position in a target trajectory; Based on the display signal, determining whether a real scene image corresponding to the designated position is acquired from the local storage space; If yes, obtaining the real scene image corresponding to the specified location from the local storage space; If not, sending an acquisition signal for acquiring a real scene image corresponding to the target trajectory to an external storage space; Within a specified period of time after sending the acquisition signal, determining whether to acquire a real scene image corresponding to the target trajectory from the external storage space; If yes, a signal indicating successful reception is sent to the external storage space, and based on the real scene image corresponding to the target trajectory, a real scene image corresponding to the designated position is obtained; If not, sending a reception failure signal to the external storage space, so that the external storage space resends the real scene image corresponding to the target trajectory based on the reception failure signal; The real scene image corresponding to the designated position is placed in the first display area for visualization.

2. The method according to claim 1, characterized in that After placing the real scene image corresponding to the designated position in the first display area for visualization, the method further includes: In response to receiving a first request signal for scaling the real scene image of the first display area, scaling the real scene image of the first display area based on a scaling ratio in the first request signal; In response to receiving a second request signal for rotating the real scene image in the first display area, the real scene image in the first display area is rotated based on a rotation angle in the second request signal.

3. The method according to claim 1, characterized in that The method further comprises: In response to receiving a successful creation signal of the real scene image corresponding to the target trajectory, acquiring the real scene image corresponding to the target trajectory from an external storage space; Determining whether to obtain the real scene image corresponding to the target trajectory from the external storage space within a specified period of time; If yes, the real scene image corresponding to the target trajectory is saved in the local storage space, and a signal of successful reception is sent to the external storage space; If not, a reception failure signal is sent to the external storage space, so that the external storage space resends the real scene image corresponding to the target track based on the reception failure signal.

4. The method according to claim 1 or 3, characterized in that The external storage space resends the real scene image corresponding to the target track based on the failed reception signal, including: The external storage space resends the real scene image corresponding to the target track based on the signal of failed reception; In response to the retransmission times of the external storage space being less than a preset threshold and the external storage space not receiving the reception success signal, the external storage space repeatedly sends the real scene image corresponding to the target track.

5. The method according to claim 1, characterized in that The target trajectory is placed in the second display area for visualization; The second display area at least includes a first sub-display identifier, a second sub-display identifier and a third sub-display identifier; The first sub-display mark is used to represent the starting position of the target track; The second sub-display mark is used to represent the target parking space position of the target trajectory; The third sub-display mark is used to indicate the end position of the target track.

6. A device for visualizing a real scene of a trajectory, characterized in that: The device comprises: A receiving module receives a display signal for displaying a real scene image corresponding to a specified position in a target trajectory; An acquisition module, based on the display signal, determines whether a real scene image corresponding to the designated position is acquired from a local storage space; If yes, obtaining the real scene image corresponding to the specified location from the local storage space; If not, sending an acquisition signal for acquiring a real scene image corresponding to the target trajectory to an external storage space; Within a specified period of time after sending the acquisition signal, determining whether to acquire a real scene image corresponding to the target trajectory from the external storage space; If yes, a signal indicating successful reception is sent to the external storage space, and based on the real scene image corresponding to the target trajectory, a real scene image corresponding to the designated position is obtained; If not, sending a reception failure signal to the external storage space, so that the external storage space resends the real scene image corresponding to the target trajectory based on the reception failure signal; The display module places the real scene image corresponding to the designated position in the first display area for visualization.

7. An electronic device, characterized in that: include: Memory, used to store computer programs; A processor, configured to implement the method steps of any one of claims 1 to 5 when executing the computer program stored in the memory.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method steps described in any one of claims 1 to 5 are implemented.

Images