Movement track playback method and apparatus, electronic device and storage medium

Abstract

An movement track playback method, executed by an electronic device. The method comprises: acquiring a three-dimensional virtual scene, and determining a real movement track of a real object (201); mapping the real movement track into the three-dimensional virtual scene so as to obtain a virtual movement track (202); in the three-dimensional virtual scene, setting a virtual object corresponding to the real object, and setting a virtual lens corresponding to the virtual object, a preset relative position relationship being maintained between the virtual lens and the virtual object (203); controlling the virtual object to move according to the virtual movement track, and controlling the virtual lens to acquire a picture of the virtual object moving according to the virtual movement track (204); and displaying the picture (205).

Description

Action trajectory playback method, device, electronic device and storage medium

[0001] Related applications

[0002] This application claims priority to Chinese patent application number 2023112443832, filed on September 25, 2023, entitled “Trajectory playback method, device, electronic device and storage medium,” the entire text of which is hereby incorporated by reference. Technical Field

[0003] The present application relates to the technical field of electronic map data processing, and in particular to a method, device, electronic device and storage medium for replaying an action trajectory. Background Art

[0004] With the development and widespread adoption of sensor technology, the Global Navigation Satellite System (GNSS) has become a fundamental capability in devices such as cars, mobile phones, and watches. After recording user trajectories using GNSS, related devices or applications can provide dynamic playback capabilities.

[0005] Action trajectory playback refers to continuously updating the user trajectory and the map status of the display area at appropriate time intervals until the end of the user trajectory.

[0006] However, current action trajectory playback usually plays the movement of the target object on a simple map interface, which cannot accurately restore the user's navigation scene during the actual action.

[0007] Summary of the Invention

[0008] Embodiments of the present application provide a method, device, electronic device, and storage medium for replaying an action trajectory.

[0009] In one aspect, an embodiment of the present application provides a method for replaying an action trajectory, which is executed by an electronic device and includes:

[0010] Acquire a three-dimensional virtual scene and determine the real movement trajectory of real objects;

[0011] Mapping the real motion trajectory into the three-dimensional virtual scene to obtain a virtual motion trajectory;

[0012] Setting a virtual object corresponding to the real object and a virtual lens corresponding to the virtual object in the three-dimensional virtual scene, wherein a preset relative position relationship is maintained between the virtual lens and the virtual object;

[0013] controlling the virtual object to move along the virtual motion trajectory, and controlling the virtual camera to capture images of the virtual object moving along the virtual motion trajectory; and

[0014] The screen is displayed.

[0015] On the other hand, an embodiment of the present application further provides an action trajectory playback device, comprising:

[0016] An acquisition unit, used to acquire a three-dimensional virtual scene and determine the real movement trajectory of a real object;

[0017] A mapping unit, configured to map the real motion trajectory into the three-dimensional virtual scene to obtain a virtual motion trajectory;

[0018] A setting unit, configured to set a virtual object corresponding to the real object and a virtual lens corresponding to the virtual object in the three-dimensional virtual scene, wherein a preset relative position relationship is maintained between the virtual lens and the virtual object;

[0019] a control unit, configured to control the virtual object to move along the virtual motion trajectory, and control the virtual camera to capture images of the virtual object moving along the virtual motion trajectory; and

[0020] The display unit is used to display the picture.

[0021] On the other hand, an embodiment of the present application further provides an electronic device, comprising a memory storing multiple instructions; the processor loads instructions from the memory to execute the steps in any one of the action trajectory playback methods provided in the embodiments of the present application.

[0022] On the other hand, an embodiment of the present application further provides a computer-readable storage medium, which stores a plurality of instructions, and the instructions are suitable for loading by a processor to execute the steps in any one of the action trajectory playback methods provided in the embodiment of the present application.

[0023] On the other hand, an embodiment of the present application further provides a computer program product, including a computer program / instruction, which, when executed by a processor, implements the steps of any action trajectory playback method provided in the embodiment of the present application.

[0024] The details of one or more embodiments of the present application are set forth in the accompanying drawings and the description below. Other features, objects, and advantages of the present application will become apparent from the description, drawings, and claims. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the conventional technology, the following briefly introduces the drawings required for use in the embodiments or the conventional technology descriptions. Obviously, the drawings described below are merely embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the disclosed drawings without any creative work.

[0026] FIG1 is a schematic diagram of a scenario of an action trajectory playback method provided by an embodiment of the present application;

[0027] FIG2 is a schematic diagram of a flow chart of a method for replaying an action trajectory according to an embodiment of the present application;

[0028] FIG3 is a schematic diagram of the relative positional relationship between a vehicle and a virtual lens in a side view of the vehicle provided by an embodiment of the present application;

[0029] FIG4 is a schematic diagram of the relative positional relationship between a virtual lens and a vehicle in a rear view of the vehicle provided in an embodiment of the present application;

[0030] FIG5 is a schematic diagram of the pitch angle range of a virtual lens provided in an embodiment of the present application;

[0031] FIG6 is a schematic diagram of a road section where a virtual object moves along when entering an intersection, according to an embodiment of the present application;

[0032] FIG7 is a schematic diagram of a flow chart of an action trajectory playback method provided in an embodiment of the present application applied in an electronic device;

[0033] FIG8 is a flow chart of a method for acquiring driving data according to an embodiment of the present application;

[0034] FIG9 is a flowchart of a specific implementation of the electronic device performing motion trajectory playback according to an embodiment of the present application;

[0035] FIG10 is a playback screen of the first segment of the track to be played back provided in an embodiment of the present application;

[0036] FIG11 is a playback screen of the second segment of the track to be played back provided in an embodiment of the present application;

[0037] FIG12 is a playback screen of the third segment of the track to be played back provided in an embodiment of the present application;

[0038] FIG13 is a playback screen of the fourth track segment in the track to be played back provided in an embodiment of the present application;

[0039] FIG14 is a playback screen of a vehicle passing through an intersection provided by an embodiment of the present application;

[0040] FIG15 is a playback screen of a vehicle turning at an intersection provided by an embodiment of the present application;

[0041] FIG16 is a playback screen of a vehicle about to pass a special building provided by an embodiment of the present application;

[0042] FIG17 is a playback screen provided by an embodiment of the present application when a vehicle is passing a special building;

[0043] FIG18 is a playback screen provided by an embodiment of the present application after a vehicle passes through a special building;

[0044] FIG19 is a schematic structural diagram of an action trajectory playback device provided in an embodiment of the present application;

[0045] FIG20 is a schematic structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0046] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0047] Embodiments of the present application provide a method, device, electronic device, and storage medium for replaying an action trajectory.

[0048] The motion trajectory playback device can be integrated into an electronic device, such as a terminal or a server. The terminal can be an in-vehicle terminal, an intelligent voice interaction device, a mobile phone, a tablet computer, a smart Bluetooth device, a laptop computer, or a personal computer (PC); the server can be a single server or a server cluster consisting of multiple servers.

[0049] In some embodiments, the motion trajectory playback device can also be integrated into multiple electronic devices. For example, the motion trajectory playback device can be integrated into multiple servers, and the motion trajectory playback method of the present application can be implemented by multiple servers. In some embodiments, the terminal can also be used as a server to implement some or all of the server's functions.

[0050] For example, referring to FIG. 1 , the electronic device 100 may perform the following steps: Acquire a three-dimensional virtual scene and determine the real motion trajectory of a real object. Map the real motion trajectory into the three-dimensional virtual scene to obtain a virtual motion trajectory. Set a virtual object corresponding to the real object and a virtual lens corresponding to the virtual object in the three-dimensional virtual scene, with the virtual lens and the virtual object maintaining a preset relative positional relationship. Control the virtual object to move according to the virtual motion trajectory, and control the virtual lens to capture footage of the virtual object moving according to the virtual motion trajectory. Display the footage.

[0051] It can be understood that in the specific implementation of this application, driving data, positioning information, location information and other related data are involved. When the following embodiments of this application are applied to specific products or technologies, permission or consent is required, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions.

[0052] It should be noted that the serial numbers of the following embodiments are not intended to limit the preferred order of the embodiments.

[0053] In this embodiment, a method for replaying an action trajectory involving map navigation is provided. As shown in FIG2 , the specific process of the method for replaying an action trajectory may be as follows:

[0054] 201. Obtain a three-dimensional virtual scene and determine the real movement trajectory of the real object.

[0055] A three-dimensional virtual scene refers to a virtual environment with a sense of three-dimensionality and realism generated through computer technology and graphics algorithms. This virtual environment can simulate a real-world scene or be an imaginary fictional scene. In this embodiment, the three-dimensional virtual scene can be a scene simulated based on a real-world geographic map. In this three-dimensional virtual scene, the Earth's surface features, topography, buildings, roads, and other elements can be displayed in three dimensions. In this three-dimensional virtual scene, users can observe different regions and landforms by rotating, zooming, and moving the perspective, thereby better understanding the Earth's geographical environment. The three-dimensional virtual scene can be created based on data such as satellite remote sensing data, topographic mapping data, and building data. This data is integrated into a geographic information system and rendered using three-dimensional visualization technology to create a three-dimensional virtual scene.

[0056] The real object may be an object in the real world whose real movement trajectory needs to be replayed. In this embodiment, the real object may be an object that can move and act on its own. The real object may also carry a positioning device or a positioning system to achieve the recording of the real movement trajectory. For example, the real object may include but is not limited to: vehicles, mobile terminals, aircraft, trains, ships, mobile robots, etc.

[0057] The actual movement trajectory can be determined using driving data. Driving data refers to various data generated by a real object during its movement. For example, driving data includes, but is not limited to, actual movement trajectory data, movement speed, acceleration, timestamp, mileage, weather information, and other data. As an example, taking a vehicle as an example, the collection of driving data can be carried out through on-board sensors, a global positioning system (GPS), on-board equipment, or a mobile phone application. The actual movement trajectory data is data that records the actual movement trajectory. It can be discrete points in the actual movement trajectory, or it can be parameters that express a mathematical expression that fits the actual movement trajectory.

[0058] The real-world trajectory refers to the route taken by a real object in the real world over a period of time. It records the location coordinates of the real object at different times (hereinafter referred to as location points), forming a trajectory dataset. Taking a vehicle as an example, the real-world trajectory can be recorded and acquired in real time through on-board equipment, GPS systems, or mobile devices. Each location point can include information such as longitude, latitude, altitude, and timestamp. By connecting these location points in chronological order, the real-world trajectory of the vehicle over a period of time can be restored.

[0059] In some embodiments, the data used to render the three-dimensional virtual scene and the driving data of real objects can be pre-collected and stored locally on the electronic device, or stored in a cloud server that is communicatively connected to the electronic device. When the electronic device needs to replay the movement trajectory, it can retrieve the data used to render the three-dimensional virtual scene and the driving data from the local or cloud server, and after rendering the data used to render the three-dimensional virtual scene, the three-dimensional virtual scene can be obtained.

[0060] 202. Map the real action trajectory into the three-dimensional virtual scene to obtain a virtual action trajectory.

[0061] Among them, the specific implementation method of mapping the real action trajectory in the three-dimensional virtual scene may include: matching each position coordinate in the trajectory data with the corresponding position in the three-dimensional virtual scene to obtain the mapping coordinates corresponding to each of the above position coordinates in the three-dimensional virtual scene, and then drawing the virtual action trajectory in the three-dimensional virtual scene based on the obtained mapping coordinates.

[0062] It is understandable that, since the three-dimensional virtual scene is built in proportion to the real world, each position point in the form trajectory obtained in the real world can find a matching position in the three-dimensional virtual scene.

[0063] In some embodiments, before mapping the real motion trajectory into the three-dimensional virtual scene to obtain the virtual motion trajectory, the formal trajectory may be preprocessed, wherein the preprocessing may include removing outliers, smoothing the trajectory, converting the coordinate system, etc., so as to ensure the accuracy and stability of the data.

[0064] 203. Set a virtual object corresponding to the real object and a virtual lens corresponding to the virtual object in the three-dimensional virtual scene, and maintain a preset relative position relationship between the virtual lens and the virtual object.

[0065] The virtual lens may refer to a virtual camera that simulates the viewing angle of the human eye or a camera in a 3D virtual scene. By adjusting properties such as the position, orientation, and field of view of the virtual lens, different viewing effects and perspectives can be achieved. Optionally, virtual lens settings may include the virtual lens's pitch angle, orientation, and position, among others.

[0066] In some embodiments, a virtual object can be constructed based on information about a real object. For example, the virtual object's properties, such as color, texture, shape, and size, can be adjusted based on the real object's appearance and features to more closely resemble the real object. Alternatively, a specific image marker, such as an image marker with a direction, can be set in the 3D virtual scene to represent the real object.

[0067] The virtual lens and the virtual object can maintain a preset relative position relationship, wherein the preset relative position relationship can be that the virtual lens is located above and behind the virtual object, so that the virtual lens can capture images of the virtual object and the direction of movement of the virtual object. For example, taking a virtual vehicle as an example, as shown in FIG3 , FIG3 shows the relative position relationship between the vehicle and the virtual lens in a side view of the vehicle. It can be seen that in the side view of the vehicle, the virtual lens can be located above and behind the vehicle, and the horizontal distance between the virtual lens and the rear end of the vehicle can be X, and the vertical distance between the virtual lens and the rear end of the vehicle can be Y. Optionally, the values ​​of X and Y can be customized according to actual needs and are not limited here.

[0068] Optionally, as shown in Figure 4, Figure 4 shows the relative position relationship between the virtual lens and the vehicle in the rear view of the vehicle. It can be seen that in the rear view of the vehicle, the virtual lens can be located in the middle of the vehicle (such as position B in Figure 4). In addition, the virtual lens can also be located on the left side of the vehicle (such as position A in Figure 4) or on the right side of the vehicle (such as position C in Figure 4), which is not limited here.

[0069] It is understandable that during the movement of the virtual object, the virtual lens and the virtual object still maintain a preset relative position relationship. That is, the virtual lens will move with the virtual object during the movement of the virtual object, and the relative position relationship between the two remains unchanged during the movement.

[0070] 204. Control the virtual object to move along the virtual movement trajectory, and control the virtual camera to capture images of the virtual object moving along the virtual movement trajectory.

[0071] In step 204, controlling the virtual object to move along the virtual movement trajectory and controlling the virtual camera to capture images of the virtual object moving along the virtual movement trajectory include:

[0072] S1. Obtaining the position information of the virtual object in the virtual action trajectory.

[0073] The location information may be the coordinates of the virtual object's current position in the virtual motion trajectory. The location coordinates may be represented by longitude and latitude. Since the virtual motion trajectory is composed of multiple connected locations, in some embodiments, it is possible to detect which location point in the virtual motion trajectory matches the virtual object's current location, and then use the coordinates of the matching location point as the virtual object's current location information. For example, the virtual object's location information may be compared with multiple locations in the virtual motion trajectory, and the location point closest to the location information may be found as the matching location point.

[0074] S2. Control the virtual object to move along a virtual movement trajectory based on the position information, and control the virtual lens to capture images of the virtual object moving along the virtual movement trajectory.

[0075] In step S2, specific implementations of controlling the virtual object to move along the virtual motion trajectory based on the position information may include:

[0076] A1. Determine the remaining trajectory length of the virtual object based on the position information. The remaining trajectory length is the length of the virtual object's unmoved trajectory in the virtual action trajectory.

[0077] Among them, after determining the position information of the virtual object, a position point matching the position information can be found in the virtual action trajectory, and then the multiple position points between the matching position point and the end point of the virtual action trajectory can be traversed in sequence in the virtual action trajectory to obtain the remaining trajectory. Then, based on the position coordinates of each of the multiple position points between the matching position point and the end point of the virtual action trajectory, the distance calculation can be performed to obtain the remaining trajectory length.

[0078] A2. Determine the target movement speed of the virtual object based on the remaining trajectory length. The remaining trajectory length is negatively correlated with the target movement speed.

[0079] The target movement speed may be a movement speed that the virtual object needs to maintain when moving in the three-dimensional virtual scene.

[0080] It is understandable that since the action trajectory playback process is also the action process of the virtual object in the three-dimensional virtual scene, the action speed of the virtual object can also be the playback speed of the action trajectory playback. The faster the action speed, the faster the playback speed of the action trajectory playback.

[0081] In some embodiments, the current movement speed of the virtual object may be increased as the remaining trajectory length decreases, thereby obtaining a target movement speed. Alternatively, the movement speed of the virtual object may be increased by a preset speed each time the remaining trajectory length decreases by a preset length, thereby obtaining a target movement speed.

[0082] A3. Based on the target movement speed, control the virtual object to move along the virtual movement trajectory.

[0083] As an example, after the target motion speed is determined, the virtual object may be controlled to move at the target motion speed along the virtual motion trajectory.

[0084] In this embodiment, the target movement speed of the virtual object is determined based on the remaining trajectory length. The remaining trajectory length is negatively correlated with the target movement speed. Based on the target movement speed, the virtual object is controlled to move according to the virtual movement trajectory. The closer the virtual object is to the end point of the virtual movement trajectory, the faster the movement speed, that is, the faster the playback speed, thereby avoiding visual fatigue for the user.

[0085] In step S2, the specific implementation of controlling the virtual object to move according to the virtual motion trajectory based on the position information may further include:

[0086] The target virtual lens angle of the virtual lens is determined according to the remaining track length. The remaining track length is positively correlated with the target virtual lens angle. The target virtual lens angle is the pitch angle of the virtual lens, and the range of the target virtual lens angle is -90 degrees to 0 degrees.

[0087] As shown in Figure 5, the virtual camera's pitch angle can be β, where -90° ≤ β ≤ 0°. As shown in Figure 5, when the virtual camera's pitch angle β is smaller, the image captured by the virtual camera more closely resembles viewing the vehicle from a bird's-eye view, resulting in simpler objects in the 3D virtual scene. When the virtual camera's pitch angle β is larger, the image captured by the virtual camera more closely resembles viewing the vehicle from a level view, resulting in more detailed objects, allowing users to experience a more immersive and realistic scene during the action trajectory playback.

[0088] In some implementations, when the remaining trajectory length decreases, the current pitch angle corresponding to the virtual lens may also be reduced, thereby obtaining a target pitch angle.

[0089] Based on the target virtual lens angle, the virtual lens is controlled to capture images of the virtual object moving along the virtual action trajectory.

[0090] As an example, after determining the target virtual lens angle, the current pitch angle of the virtual lens may be adjusted to the target virtual lens angle, and then the virtual lens may be controlled to capture images of the virtual object moving along the virtual motion trajectory.

[0091] In this embodiment, by adjusting the pitch angle of the virtual lens to a smaller value as the motion trajectory playback approaches the end, the image captured by the virtual lens can gradually transition from detailed display to simple display, thereby avoiding visual fatigue of the user.

[0092] In step S2, the specific implementation of controlling the virtual lens based on the position information to capture the image of the virtual object moving along the virtual motion trajectory may also include:

[0093] According to the remaining trajectory length, the target map scale corresponding to the virtual lens is determined, and the target map scale is positively correlated with the remaining trajectory length.

[0094] Map scale refers to the ratio of the length of a line segment on the map to the horizontal projection of the corresponding line segment in the field. It indicates the degree of reduction of the map image and is also known as scale. Generally speaking, the larger the map scale, the smaller the error and the higher the measurement accuracy on the map.

[0095] Based on the target map scale, the virtual camera is controlled to capture images of the virtual object moving along the virtual action trajectory.

[0096] In some implementations, when the remaining trajectory length decreases, the current map scale corresponding to the virtual lens may also be reduced, thereby obtaining a target map scale.

[0097] As an example, after determining the target map scale, the target map scale corresponding to the virtual lens can be adjusted to the target map scale by adjusting the focal length of the virtual lens, and then the virtual lens is controlled to capture the image of the virtual object moving along the virtual action trajectory.

[0098] It can be understood that the smaller the focal length, the wider the field of view, the wider the framing range; the more images that can be captured, but the smaller the proportion of the scenery in the picture. The larger the focal length, the narrower the field of view, the narrower the framing range; the fewer images that can be captured, but the larger the proportion of the scenery in the picture.

[0099] In this embodiment, by adjusting the map scale corresponding to the virtual lens to a smaller scale as the action trajectory playback approaches the end, the image captured by the virtual lens can be continuously enlarged in the field of view, thereby avoiding visual fatigue of the user.

[0100] In some embodiments, the above-mentioned control of the movement speed of the virtual object, the pitch angle of the virtual lens, and the map scale corresponding to the virtual lens is performed simultaneously based on the remaining trajectory length. Since the movement speed of the virtual object increases as the remaining trajectory length decreases during the playback of the movement trajectory, the pitch angle and the map scale are reduced simultaneously when the remaining trajectory length becomes smaller. This allows the image sense captured by the virtual lens to be better displayed in accordance with the movement speed, avoiding the user from continuously watching a picture with a small field of view and a large pitch angle at a fast playback speed, which may cause dizziness.

[0101] In some embodiments, the virtual action trajectory includes multiple control nodes. In step S2, the specific implementation of controlling the virtual object to move according to the virtual action trajectory based on the position information and controlling the virtual lens to capture the picture of the virtual object moving according to the virtual action trajectory may include: when it is determined that the virtual object reaches the control node based on the position information, obtaining the control strategy corresponding to the control node.

[0102] Among them, the control node can be a location point pre-marked in the virtual action trajectory, so the control node can also be represented by longitude and latitude. For example, the position of the real object when encountering a special event can be marked in the real action trajectory of the real world, and then the position is mapped to the virtual action trajectory to obtain the control node. Optionally, special events include arriving at an intersection, arriving at a designated building, entering a designated road section, etc., wherein special events can be customized according to actual needs and are not limited here. Among them, for each special event, a set of control strategies can be set for the special event in advance, and then the control strategy corresponding to the special event can be bound to the control node corresponding to the special event, thereby establishing an association between multiple control nodes and multiple control strategies.

[0103] Based on the control strategy corresponding to the control node, the virtual object is controlled to move along the virtual movement trajectory, and the virtual lens is controlled to capture the images of the virtual object moving along the virtual movement trajectory.

[0104] The method of controlling the virtual object to move along the virtual movement trajectory based on the control strategy corresponding to the control node and controlling the virtual lens to capture images of the virtual object moving along the virtual movement trajectory includes:

[0105] B1. Get the type of the control node.

[0106] Wherein, each control node may carry a type tag for characterizing which type the control node belongs to, and the type of the control node may be determined for each control node by identifying the type tag of the control node. Optionally, in this embodiment, the types of control nodes may include ordinary control nodes, camera movement control nodes, etc. Wherein, a camera movement control node may refer to a node that needs to perform camera movement operations in a virtual action trajectory, and an ordinary control node may refer to a node that does not need to perform camera movement operations in a virtual action trajectory (for example, the lens direction corresponding to the ordinary control node is fixed to the route direction of the virtual object's action path). The camera movement control node may include a camera movement start node and a camera movement end node. When the virtual object reaches the camera movement start node, the camera movement operation begins to be executed, and when the virtual object reaches the camera movement end node, the camera movement operation stops being executed.

[0107] The camera movement operation may refer to an operation of adjusting the camera direction, for example, gradually adjusting the camera direction from a virtual object to a building in a three-dimensional virtual scene.

[0108] B2. When the control node is a common control node, obtain the control parameters corresponding to the common control node. The control parameters include the movement speed of the virtual object, the virtual lens angle of the virtual lens, and the map scale corresponding to the virtual lens. The target virtual lens angle is the pitch angle of the virtual lens, and the range of the target virtual lens angle is -90 degrees to 0 degrees.

[0109] There may be multiple common control nodes, and each of the multiple common control nodes may be pre-bound with a set of control parameters. For example, the control parameters and the mapping relationship between the control parameters and the common control nodes may be pre-stored in a preset parameter database. After determining the common control node currently reached by the virtual object, the control parameters corresponding to the common control node may be extracted from the preset parameter database.

[0110] In some embodiments, the common control nodes include a first control node, a second control node, and a third control node, wherein the first control node, the second control node, and the third control node divide the virtual motion trajectory into a first sub-trajectory, a second sub-trajectory, a third sub-trajectory, and a fourth sub-trajectory. The first sub-trajectory is the trajectory between the first control node and the starting point of the virtual motion trajectory. The second sub-trajectory is the trajectory between the first control node and the second control node. The third sub-trajectory is the trajectory between the second control node and the third control node. The fourth sub-trajectory is the trajectory between the third control node and the end point of the virtual motion trajectory.

[0111] Optionally, a ratio of the track lengths of the first sub-track, the second sub-track, the third sub-track, and the fourth sub-track is 2:1:2:5.

[0112] It is understood that the number of common control nodes, in addition to three in the above embodiment, can also be other numbers, such as two, four, five, etc., and is not limited here. Different numbers of common control nodes can divide the virtual motion trajectory into a corresponding number of sub-trajectories. For example, two common control nodes can divide the virtual motion trajectory into three sub-trajectories, and five common control nodes can divide the virtual motion trajectory into six sub-trajectories. The ratio between the trajectory lengths of the multiple sub-trajectories can be set according to actual needs and is not limited here.

[0113] In some embodiments, the control parameters corresponding to the first control node include a first movement speed, a first virtual lens angle, and a first map scale. The control parameters corresponding to the second control node include a second movement speed, a second virtual lens angle, and a second map scale. The control parameters corresponding to the third control node include a third movement speed, a third virtual lens angle, and a third map scale. The first movement speed is less than the second movement speed, and the second movement speed is less than the third movement speed. The first virtual lens angle is greater than or equal to the second virtual lens angle, and the second virtual lens angle is greater than the third virtual lens angle. The first map scale is greater than the second map scale, and the second map scale is greater than the third map scale.

[0114] In some embodiments, the starting point of the virtual motion trajectory corresponds to initial control parameters, where the initial control parameters include an initial motion speed, an initial virtual camera angle, and an initial map scale. The initial motion speed is less than or equal to the first motion speed, the initial virtual camera angle is greater than the first virtual camera angle, and the initial map scale is greater than the first map scale.

[0115] For example, taking a virtual motion trajectory representing a real motion trajectory of 50 kilometers as an example, the initial motion speed may be 500 m / s, the first motion speed may be 500 m / s, the second motion speed may be 2000 m / s, and the third motion speed may be 5000 m / s.

[0116] Optionally, the initial map scale can be 1:10, where the map scale of 1:10 can mean that every 1 unit length on the map represents 10 meters of length on the actual ground, the first map scale can be 1:20, the second map scale can be 1:50, and the third map scale can be 1:100.

[0117] Optionally, the initial virtual lens angle may be -10°, the first virtual lens angle may be -20°, the second virtual lens angle may be -30° or -20°, and the third virtual lens angle may be -90°.

[0118] It is understandable that when the virtual lens angle of the virtual lens is 90°, the image captured by the virtual lens is equivalent to an image of a three-dimensional virtual scene viewed from above, that is, a two-dimensional plane image.

[0119] In some implementations, to ensure that the playback duration of each sub-track is within an appropriate range, a specific playback duration can be set for each sub-track. For example, the playback duration of the first sub-track can be set between 3 and 12 seconds; the playback duration of the second sub-track can be set between 2 and 8 seconds; the playback duration of the third sub-track can be set between 1 and 5 seconds; and the playback duration of the fourth sub-track can be set between 1 and 5 seconds.

[0120] B3. Based on the movement speed, control the virtual object to move along the virtual movement trajectory.

[0121] B4. Based on the virtual lens angle and the map scale, control the virtual lens to capture images of the virtual object moving along the virtual action trajectory.

[0122] In this embodiment, the virtual action trajectory is segmented, and in the first half of the action trajectory playback, the captured field of view is controlled to be more immersive, and the action speed is relatively slow, which can improve the user's viewing experience; in the second half, the action speed is accelerated, and a larger field of view and more concise picture is captured, which can avoid visual fatigue of the user.

[0123] In some embodiments, based on the control strategy corresponding to the control node, controlling the virtual object to move along the virtual movement trajectory and controlling the virtual camera to capture images of the virtual object moving along the virtual movement trajectory include:

[0124] C1. Get the type of the control node.

[0125] C2. When the control node is a camera movement control node, determine the camera movement object corresponding to the camera movement control node.

[0126] The camera object may be an object that is pre-marked in the three-dimensional virtual scene and needs to be subjected to a camera operation. For example, the camera object may be a building, an intersection, a landscape, etc. in the three-dimensional virtual scene.

[0127] In some embodiments, each camera movement control node can be pre-bound to a camera movement object. Therefore, after determining the camera movement control node, the corresponding camera movement object can be filtered based on the camera movement control node. For example, when a vehicle is navigating in the real world, the user can mark a building as a camera movement object in the navigation system when passing by it. The navigation system can then automatically use the location of the building in the real-world trajectory as the camera movement location point, and then map the camera movement location point to the three-dimensional virtual scene to obtain the camera movement control node. The camera movement object can then be obtained by mapping the building in the navigation system to the three-dimensional virtual scene.

[0128] C3. Get the lens direction corresponding to the camera object.

[0129] Different camera movement objects are pre-associated with different lens directions. Therefore, after the camera movement object is determined, the lens direction corresponding to the camera movement object can be selected from a plurality of preset lens directions as the lens direction.

[0130] As an implementation method, obtaining the lens orientation corresponding to the camera object includes:

[0131] When it is detected that the camera object is an intersection in a three-dimensional virtual scene, the movement direction of the virtual object is determined as the camera direction.

[0132] As another implementation, obtaining the lens orientation corresponding to the camera object includes:

[0133] When it is detected that the camera object is a target building in the three-dimensional virtual scene, the direction from the position of the virtual object to the position of the target building in the ground coordinate system of the three-dimensional virtual scene is determined as the camera direction.

[0134] The virtual motion trajectory further includes a plurality of common control nodes, which divide the virtual motion trajectory into a plurality of sub-trajectories. Each of the plurality of sub-trajectories corresponds to a reference priority. Before obtaining the lens direction corresponding to the camera object in step C3, the following steps are further included:

[0135] Among multiple sub-tracks, the sub-track where the camera control node is located is selected as the target sub-track.

[0136] For example, the first sub-trace, the second sub-trace, the third sub-trace, and the fourth sub-trace in the above embodiment are used as an example for description. As shown in Table 1, each sub-trace is pre-assigned a reference priority:

[0137] Table 1

[0138] For example, when it is detected that the sub-track where the camera control node where the virtual object arrives is located is the first sub-track, the first sub-track may be used as the target sub-track.

[0139] Get the reference priority corresponding to the target sub-track and the priority of the camera object.

[0140] Using the above example, the reference priority N1 corresponding to the first sub-track can be found from Table 1. Different camera movement objects are pre-associated with different priorities, and the priority of the current camera movement object is M as an example.

[0141] Compare the camera object's priority to the reference priority.

[0142] Continuing with the above example, the priority M of the current camera movement object may be compared with the reference priority N1 to determine whether the priority M of the current camera movement object is greater than or equal to the reference priority N1.

[0143] When the priority of the camera object is greater than or equal to the reference priority, the step of obtaining the lens orientation corresponding to the camera object is performed.

[0144] Continuing with the above example, if the current camera object's priority M is greater than or equal to the reference priority N1, the subsequent step of obtaining the lens orientation corresponding to the camera object can be performed to continue the camera operation for the camera object. If the current camera object's priority M is less than the reference priority N1, the camera operation for the camera object can be canceled.

[0145] Among them, the corresponding reference priority of the sub-trajectory is positively correlated with the distance from the sub-trajectory to the starting point of the virtual action trajectory.

[0146] Continuing with the example in Table 1 above, in Table 1, reference priority N1 is greater than reference priority N2, which is greater than reference priority N3, which is greater than reference priority N4. In other words, for the same camera movement object, the later in the motion trajectory playback, the harder it is to trigger a camera movement.

[0147] Taking into account that at the back end of the action trajectory playback, the frequency of entering the arrival mirror control node will become significantly higher due to the faster movement speed of the virtual object, thereby affecting the user's viewing experience of the playback, in this embodiment, by prioritizing the mirror movement objects and setting reference priorities for the sub-trajectories of different segments in the virtual action trajectory, it is decided whether to execute the mirror movement operation by comparing the priority with the reference priority, thereby ensuring that the number of mirror movement operations triggered in each sub-trajectory is within an appropriate range, avoiding affecting the user's viewing experience.

[0148] Optionally, for each sub-track, an upper limit for the number of camera movement triggers corresponding to the sub-track can be set. When the track is revisited, if the number of camera movement operations triggered by the virtual object in the sub-track segment reaches the upper limit, the camera movement operation will not be performed.

[0149] Optionally, in the virtual action trajectory, if the trajectory length between the current camera movement control node and the previous camera movement control node does not exceed the specified trajectory length, the current camera movement control node does not trigger the camera movement operation.

[0150] Optionally, in the virtual action trajectory, if the interval between the current camera movement control node and the previous camera movement control node does not exceed the specified duration, the current camera movement control node does not trigger the camera movement operation.

[0151] C4. Based on the lens direction, control the virtual lens to capture images of the virtual object moving along the virtual action trajectory.

[0152] For example, taking a virtual object as a vehicle, the default initial lens orientation of the virtual camera is the direction of the vehicle's current path. When the camera detects that the camera object is an intersection in a three-dimensional virtual scene, the vehicle's direction of movement can be determined as the lens orientation. As the vehicle passes through the intersection, the virtual camera gradually switches from the initial virtual lens orientation to the lens orientation. When the vehicle exits the intersection, the virtual camera's orientation is switched back to the initial lens orientation. The vehicle's direction of movement can be considered the vehicle's head orientation. It is understood that this route orientation is road-related and unrelated to the vehicle's direction of movement.

[0153] As an example, as shown in Figure 6, in the virtual movement trajectory, when the virtual object is 200 meters away from the intersection in the virtual movement trajectory (the start node of the camera movement), the camera direction can be switched to the movement direction of the virtual object. When the virtual object is 200 meters away from the intersection in the virtual movement trajectory (the end node of the camera movement), the camera direction can be switched to the initial lens direction.

[0154] In some embodiments, each camera control node in the virtual motion trajectory can be pre-associated with a set of control parameters. When a virtual object reaches a camera control node, in addition to controlling the virtual camera's orientation using the camera control node's corresponding control parameters, the virtual camera and the virtual object's motion speed can also be controlled using the corresponding control parameters. For example, when a virtual object enters an intersection, the virtual camera's map scale can be adjusted to 1:1, and the virtual camera angle can be adjusted to -20°.

[0155] 205. Display the picture.

[0156] As can be seen, in this embodiment, a 3D virtual scene is acquired, and the real-world trajectory of a real object is determined. The real-world trajectory is then mapped into the 3D virtual scene to obtain a virtual trajectory. Next, a virtual object corresponding to the real object and a virtual lens corresponding to the virtual object are set in the 3D virtual scene, with a preset relative positional relationship maintained between the virtual lens and the virtual object. The virtual object is then controlled to move along the virtual trajectory, and the virtual lens is controlled to capture footage of the virtual object moving along the virtual trajectory, which is then displayed. Because the preset relative positional relationship between the virtual lens and the virtual object is maintained in the 3D virtual scene, the virtual lens can follow the virtual object in real time as it moves along the virtual trajectory, capturing footage of the virtual object's surroundings during the movement. Since this footage is captured within the 3D virtual scene, the captured footage can be presented in 3D, making the map elements in the 3D virtual scene more detailed and rich, accurately reproducing the real-world trajectory. Furthermore, this allows users to immerse themselves in the real-world action process and truly experience it, improving the user experience when viewing the replay of the action trajectory.

[0157] The method described in the above embodiment will be further described below.

[0158] In this embodiment, an electronic device is taken as an example to describe the method of the embodiment of the present application in detail.

[0159] As shown in FIG7 , a specific process of an action trajectory playback method is as follows:

[0160] 701. The electronic device obtains a three-dimensional virtual scene and determines a real movement trajectory of a real object.

[0161] For example, the method for obtaining driving data may be as shown in FIG8 :

[0162] During real-world vehicle navigation, after navigation begins, a positioning callback can be detected. This detection involves setting a callback function or delegate when using location services. This function or delegate is automatically called to update the location information when the positioning result changes, effectively obtaining the vehicle's positioning information in real time. Positioning information can include longitude, latitude, altitude, and more. The accuracy of positioning information can be customized, for example, to six decimal places.

[0163] When it is determined that the positioning adsorption point is received, that is, when the instruction to record the current positioning information is received, the current positioning information is recorded in the navigation track file.

[0164] In addition, the induced callback can be detected at the same time, that is, whether a navigation event is hit, wherein the navigation event can be a pre-set event, such as reaching an intersection, passing a special building, etc. When it is determined that a navigation event is hit, the event information is recorded in the navigation event file. Optionally, the event information can include

[0165] Afterwards, it can be determined whether navigation has ended. If so, the navigation event file and navigation trajectory file are stored in the cloud. Then, navigation information is obtained based on the navigation event file and navigation trajectory file. The navigation information of this navigation is stored in the background to obtain driving data and end navigation. The navigation information may include the starting point, destination, speed, positioning information, data accuracy, etc. of this navigation. If navigation has not ended, the process returns to the step of detecting the positioning callback.

[0166] Among them, the driving data obtained above can be used not only for action trajectory playback, but also for other scenarios, such as augmented reality (AR) human-computer interaction, which is not limited here.

[0167] 702. The electronic device maps the real motion trajectory into the three-dimensional virtual scene to obtain a virtual motion trajectory.

[0168] 703. The electronic device sets a virtual object corresponding to the real object and a virtual lens corresponding to the virtual object in the three-dimensional virtual scene, and maintains a preset relative position relationship between the virtual lens and the virtual object.

[0169] 704. The electronic device obtains position information of the virtual object in the virtual motion trajectory.

[0170] 705. The electronic device controls the virtual object to move along a virtual movement trajectory based on the position information, and controls the virtual lens to capture images of the virtual object moving along the virtual movement trajectory.

[0171] Controlling the virtual object to move along a virtual motion trajectory based on the position information may include: determining a remaining trajectory length of the virtual object based on the position information, where the remaining trajectory length is the length of the virtual object's unmoved trajectory within the virtual motion trajectory; determining a target motion speed of the virtual object based on the remaining trajectory length, where the remaining trajectory length is negatively correlated with the target motion speed; and controlling the virtual object to move along the virtual motion trajectory based on the target motion speed.

[0172] Controlling the virtual camera based on the position information to capture footage of the virtual object moving along the virtual motion trajectory further includes determining a target virtual camera angle of the virtual camera based on the remaining trajectory length, wherein the remaining trajectory length is positively correlated with the target virtual camera angle, the target virtual camera angle being a pitch angle of the virtual camera, and the target virtual camera angle ranges from -90 degrees to 0 degrees. Based on the target virtual camera angle, the virtual camera is controlled to capture footage of the virtual object moving along the virtual motion trajectory.

[0173] Controlling the virtual camera based on the position information to capture footage of the virtual object moving along the virtual motion trajectory includes: determining a target map scale corresponding to the virtual camera based on the remaining trajectory length, wherein the target map scale is positively correlated with the remaining trajectory length. Based on the target map scale, controlling the virtual camera to capture footage of the virtual object moving along the virtual motion trajectory.

[0174] In some embodiments, the virtual motion trajectory includes multiple control nodes, and controlling the virtual object to move along the virtual motion trajectory based on the position information and controlling the virtual camera to capture images of the virtual object moving along the virtual motion trajectory includes: upon determining, based on the position information, that the virtual object has reached a control node, obtaining a control policy corresponding to the control node. Based on the control policy corresponding to the control node, controlling the virtual object to move along the virtual motion trajectory and controlling the virtual camera to capture images of the virtual object moving along the virtual motion trajectory.

[0175] The method includes: obtaining the type of the control node. If the control node is a standard control node, obtaining control parameters corresponding to the standard control node includes: the movement speed of the virtual object, the virtual lens angle of the virtual lens, and the map scale corresponding to the virtual lens. The target virtual lens angle is the pitch angle of the virtual lens, and the target virtual lens angle ranges from -90 degrees to 0 degrees. Based on the movement speed, the virtual object is controlled to move along the virtual movement trajectory. Based on the virtual lens angle and map scale, the virtual lens is controlled to capture images of the virtual object moving along the virtual movement trajectory.

[0176] The common control nodes include a first control node, a second control node, and a third control node. The first control node, the second control node, and the third control node divide the virtual motion trajectory into a first sub-trajectory, a second sub-trajectory, a third sub-trajectory, and a fourth sub-trajectory. The first sub-trajectory is the trajectory between the first control node and the starting point of the virtual motion trajectory. The second sub-trajectory is the trajectory between the first control node and the second control node. The third sub-trajectory is the trajectory between the second control node and the third control node. The fourth sub-trajectory is the trajectory between the third control node and the end point of the virtual motion trajectory. The trajectory length ratios of the first sub-trajectory, the second sub-trajectory, the third sub-trajectory, and the fourth sub-trajectory are 2:1:2:5.

[0177] The control parameters corresponding to the first control node include a first movement speed, a first virtual lens angle, and a first map scale. The control parameters corresponding to the second control node include a second movement speed, a second virtual lens angle, and a second map scale. The control parameters corresponding to the third control node include a third movement speed, a third virtual lens angle, and a third map scale. The first movement speed is less than the second movement speed, and the second movement speed is less than the third movement speed. The first virtual lens angle is greater than or equal to the second virtual lens angle, and the second virtual lens angle is greater than the third virtual lens angle. The first map scale is greater than the second map scale, and the second map scale is greater than the third map scale.

[0178] The method includes controlling a virtual object to move along a virtual motion trajectory based on a control strategy corresponding to a control node, and controlling a virtual camera to capture footage of the virtual object moving along the virtual motion trajectory. The method includes obtaining the type of the control node. If the control node is a camera movement control node, determining the camera movement object corresponding to the camera movement control node. Obtaining the camera orientation corresponding to the camera movement object. Based on the camera orientation, controlling the virtual camera to capture footage of the virtual object moving along the virtual motion trajectory.

[0179] Wherein, obtaining the lens orientation corresponding to the camera object includes: when the camera object is detected to be an intersection in the three-dimensional virtual scene, determining the movement direction of the virtual object as the lens orientation. Wherein, obtaining the lens orientation corresponding to the camera object includes: when the camera object is detected to be a target building in the three-dimensional virtual scene, determining the direction from the position of the virtual object to the position of the target building in the ground coordinate system of the three-dimensional virtual scene as the lens orientation.

[0180] Among them, the virtual action trajectory also includes multiple common control nodes, and the multiple common control nodes divide the virtual action trajectory into multiple sub-trajectories. Each of the multiple sub-trajectories corresponds to a reference priority. Before obtaining the lens direction corresponding to the camera movement object, it also includes: among the multiple sub-trajectories, the sub-trajectory where the camera movement control node is located is screened out as the target sub-trajectory.

[0181] Obtain a reference priority for the target sub-track and the priority of the camera object. Compare the camera object's priority with the reference priority. If the camera object's priority is greater than or equal to the reference priority, perform the step of obtaining the camera orientation corresponding to the camera object. The reference priority of the sub-track is positively correlated with the distance from the sub-track to the starting point of the virtual action track.

[0182] 706. Electronic device display screen.

[0183] For example, in combination with the above steps 701 to 706, the specific implementation process of the electronic device performing action trajectory playback can be shown in FIG9 :

[0184] After starting the action track playback, read the navigation track points, navigation events and configure the camera parameters, wherein the navigation track points can be read from the above navigation track file, the navigation events can be read from the above navigation event file, and the camera parameters can be customized by the user. The camera parameters can be equivalent to the above control parameters.

[0185] Then, segmented tracks are generated according to the configured camera movement parameters, such as the first sub-track and the second sub-track mentioned above.

[0186] Next, the segmented navigation route drawing callback is executed, that is, whether a navigation event is triggered during the trajectory drawing process is detected, and when triggered, the segmented camera perspective is set, and the navigation event perspective is restored through the segmented camera perspective.

[0187] At the same time, the coordinates of the vehicle are updated and the orientation of the displayed map is updated, wherein the orientation of the map may correspond to the orientation of the lens in the above embodiment.

[0188] Then, it can be determined whether the navigation route is drawn. If so, the action track playback is ended. If not, the process returns to the step of executing the detection route drawing callback.

[0189] As a more specific example, the trajectory to be replayed can be divided into four segments (such as the first segment, the second segment, the third segment, and the fourth segment). Optionally, the navigation distance interval supported by the action trajectory playback can be 0 to 50 kilometers, the total playback time of the action trajectory playback can be controlled between 7 seconds and 30 seconds, and the action trajectory playback speed (such as the movement speed of the virtual object mentioned above) can be divided into slow, medium, and fast, where slow is 500m / s, medium is 2000m / s, and fast is 5000m / s.

[0190] For the first segment of the trajectory to be replayed, it can be 0 to 20% of the trajectory to be replayed. In the first segment, the playback speed of the action trajectory can be slow, and the playback time interval is 3 seconds to 12 seconds. In addition, the screen of the first segment during playback can be as shown in Figure 10, in which the map scale is 18 levels (such as each unit length on the map represents 10 meters of length on the actual ground), the map pitch angle is 80°, and the map direction is the route direction of the vehicle's current action road. Among them, the map pitch angle can correspond to the virtual lens angle in the above embodiment, and the map pitch angle a can have the following relationship with the virtual lens angle β in the above embodiment: a = (90° + β). For example, a map pitch angle of 0° corresponds to a virtual lens angle of -90°, a map pitch angle of 90° corresponds to a virtual lens angle of 0°, and a map pitch angle of 70° corresponds to a virtual lens angle of -20°.

[0191] For the second segment of the trajectory to be replayed, which can be 20% to 30% of the trajectory to be replayed, the action trajectory playback speed in the second segment can be slow, and the playback duration range is 2 seconds to 8 seconds. In addition, the screen of the second segment during playback can be as shown in Figure 11. In this screen, the map scale is 17 levels (for example, each unit length on the map represents 20 meters on the actual ground), the map pitch angle is 70°, and the map orientation is the route orientation of the vehicle's current route. It can be seen that compared to the first segment, the content displayed in the screen of the second segment is more concise.

[0192] For the third segment of the trajectory to be replayed, it can be 30% to 50% of the trajectory to be replayed. In the third segment, the action trajectory playback speed can be medium speed, and the playback duration range is 1 second to 5 seconds. In addition, the screen of the third segment during playback can be as shown in Figure 12. In this screen, the map scale is 16 levels (such as each unit length on the map represents 50 meters of actual ground length), the map pitch angle is 70°, and the map direction is the route direction of the vehicle's current action road. It can be seen that compared with the second segment, the content displayed in the screen in the third segment is simpler, and the buildings in the screen are not as detailed as in the second segment.

[0193] For the fourth segment of the trajectory to be replayed, it can be 50% to 100% of the trajectory to be replayed. In the fourth segment, the action trajectory playback speed can be block speed, and the playback duration range is 1 second to 5 seconds. In addition, the screen of the fourth segment during playback can be as shown in Figure 13, in which the map scale is 15 levels (for example, each unit length on the map represents 100 meters on the actual ground) and the map pitch angle is 0°. Optionally, the vehicle speed and current mileage can also be displayed in the playback screen.

[0194] As an example, when replaying a scene of a vehicle passing through an intersection (e.g., exiting an intersection), the playback screen may be as shown in FIG14 . In this screen, the map scale is 21 levels (e.g., each unit length on the map represents 1 meter on the ground), and the map pitch angle is 80°. Appropriate camera movement can be used to adjust the map orientation to reflect the vehicle's frontal orientation. Optionally, as shown in FIG14 , the playback screen may also display corresponding weather elements based on the weather information obtained from the driving data, such as displaying a rainy weather element on the map.

[0195] Optionally, as shown in FIG15 , when replaying a video of a vehicle turning at an intersection, the camera direction may be adjusted to face the corner of the intersection in order to observe the vehicle's turning process.

[0196] In some embodiments, when the vehicle is replaying a feature building that requires camera movement, the map scale and map pitch angle can be kept unchanged, and the camera direction can be kept consistent with the direction of the vehicle's current position pointing to the location of the special building. For example, as shown in Figure 16, when the vehicle is about to pass the special building, the special building in the displayed playback picture can be in the front left of the vehicle; as shown in Figure 17, when the vehicle is passing the special building, the special building in the displayed playback picture is on the left side of the vehicle; as shown in Figure 18, after the vehicle passes the special building, the special building in the displayed playback picture is on the left rear of the vehicle, so that the effect of looking around the special building can be achieved by displaying the above series of pictures.

[0197] Among them, when the vehicle starts to pass through a special building, it can start the mirror movement operation and automatically end the mirror movement operation after a specified time (such as 2 seconds).

[0198] It is understandable that, in addition to the above-mentioned camera movement methods, other camera movement methods can also be used for the camera movement object, such as a virtual camera circling a special building, etc., which is not limited here.

[0199] As can be seen, in this embodiment, by using a three-dimensional virtual scene for immersive motion trajectory playback, the display of map elements is more detailed and rich. The trajectory is segmented and strategically controlled, with the playback speed and duration of each segment dynamically configured and calculated. Furthermore, the map scale, pitch angle, and orientation are dynamically adjusted based on the road section along which the vehicle is traveling. For example, the first half of the playback displays more camera effects for a more immersive field of view, while the playback speed is relatively slow, improving the user's viewing experience. The second half of the playback is accelerated to avoid visual fatigue. Furthermore, special virtual camera perspectives are set for key navigation scenes, such as intersections and special landmarks, allowing users to see the details of these landmarks and recreate a realistic navigation scene. This solves the problem in related technologies where motion trajectory playback has a fixed map scale, pitch angle, and orientation, and tends to play the vehicle's movements in a two-dimensional plane, failing to focus on the details of surrounding map elements during navigation and failing to better recreate the user's real navigation scene, resulting in a poor user experience. This improves the user experience of viewing motion trajectory playback.

[0200] To better implement the above method, the present application also provides a motion trajectory playback device. The motion trajectory playback device can be integrated into an electronic device, such as a terminal or a server. The terminal can be a mobile phone, tablet computer, smart Bluetooth device, laptop computer, personal computer, etc. The server can be a single server or a server cluster consisting of multiple servers.

[0201] For example, in this embodiment, the method of the embodiment of the present application will be described in detail by taking the action trajectory playback device as an example in which the action trajectory playback device is specifically integrated into the action trajectory playback.

[0202] For example, as shown in FIG19 , the motion trajectory playback device may include an acquisition unit 1901 , a mapping unit 1902 , a setting unit 1903 , a control unit 1904 , and a display unit 1905 , as follows:

[0203] The acquisition unit 1901 is used to acquire a three-dimensional virtual scene and determine the real movement trajectory of the real object;

[0204] A mapping unit 1902 is configured to map the real motion trajectory onto the three-dimensional virtual scene to obtain a virtual motion trajectory;

[0205] A setting unit 1903 is configured to set a virtual object corresponding to the real object and a virtual lens corresponding to the virtual object in the three-dimensional virtual scene, wherein a preset relative position relationship is maintained between the virtual lens and the virtual object;

[0206] The control unit 1904 is configured to control the virtual object to move along the virtual movement trajectory, and control the virtual camera to capture images of the virtual object moving along the virtual movement trajectory.

[0207] The display unit 1905 is used to display the above screen.

[0208] In some embodiments, the control unit 1904 includes:

[0209] A position acquisition subunit, configured to acquire position information of the virtual object in the virtual motion trajectory;

[0210] The control subunit is used to control the virtual object to move along the virtual movement track based on the position information, and control the virtual lens to capture the image of the virtual object moving along the virtual movement track.

[0211] In some embodiments, the control subunit is specifically configured to:

[0212] determining a remaining trajectory length of the virtual object based on the position information, wherein the remaining trajectory length is a length of the virtual object in the virtual motion trajectory where the virtual object has not moved;

[0213] The target movement speed of the virtual object is determined according to the remaining trajectory length, and the remaining trajectory length is negatively correlated with the target movement speed.

[0214] Based on the target movement speed, the virtual object is controlled to move along the virtual movement trajectory.

[0215] In some embodiments, the control subunit is further configured to:

[0216] The target virtual lens angle of the virtual lens is determined based on the remaining trajectory length. The remaining trajectory length is positively correlated with the target virtual lens angle. The target virtual lens angle is the pitch angle of the virtual lens, and the range of the target virtual lens angle is -90 degrees to 0 degrees.

[0217] Based on the target virtual lens angle, the virtual lens is controlled to capture images of the virtual object moving along the virtual motion trajectory.

[0218] In some embodiments, the control subunit is further configured to:

[0219] Determining a target map scale corresponding to the virtual lens according to the remaining trajectory length, wherein the target map scale is positively correlated with the remaining trajectory length;

[0220] Based on the target map scale, the virtual camera is controlled to capture images of the virtual object moving along the virtual motion trajectory.

[0221] In some embodiments, the virtual motion trajectory includes multiple control nodes and control subunits, including:

[0222] a strategy acquisition module, configured to acquire a control strategy corresponding to the control node when it is determined, based on the location information, that the virtual object has reached the control node;

[0223] The control module is used to control the virtual object to move along the virtual movement track based on the control strategy corresponding to the control node, and control the virtual lens to capture the image of the virtual object moving along the virtual movement track.

[0224] In some embodiments, the control module comprises:

[0225] A type acquisition submodule is used to obtain the type of the above control node;

[0226] a parameter acquisition submodule, for acquiring control parameters corresponding to the common control node when the control node is a common control node, wherein the control parameters include the movement speed of the virtual object, the virtual lens angle of the virtual lens, and the map scale corresponding to the virtual lens; the target virtual lens angle is the pitch angle of the virtual lens, and the range of the target virtual lens angle is -90 degrees to 0 degrees;

[0227] A speed control submodule, configured to control the virtual object to move along the virtual motion trajectory based on the motion speed;

[0228] The first virtual lens control submodule is used to control the virtual lens to capture images of the virtual object moving along the virtual movement trajectory based on the virtual lens angle and the map scale.

[0229] In some embodiments, the common control node includes a first control node, a second control node, and a third control node, wherein the first control node, the second control node, and the third control node divide the virtual motion trajectory into a first sub-trajectory, a second sub-trajectory, a third sub-trajectory, and a fourth sub-trajectory;

[0230] The first sub-trajectory is a trajectory between the first control node and the starting point of the virtual action trajectory;

[0231] The second sub-trace is a trace between the first control node and the second control node;

[0232] The third sub-trace is a trace between the second control node and the third control node;

[0233] The fourth sub-trajectory is a trajectory between the third control node and the end point of the virtual action trajectory;

[0234] The ratio of the track lengths of the first sub-track, the second sub-track, the third sub-track, and the fourth sub-track is 2:1:2:5.

[0235] In some embodiments, the control parameters corresponding to the first control node include a first action speed, a first virtual camera angle, and a first map scale;

[0236] The control parameters corresponding to the second control node include a second action speed, a second virtual camera angle, and a second map scale;

[0237] The control parameters corresponding to the third control node include a third action speed, a third virtual camera angle, and a third map scale;

[0238] The first movement speed is less than the second movement speed, and the second movement speed is less than the third movement speed;

[0239] The first virtual lens angle is greater than or equal to the second virtual lens angle, and the second virtual lens angle is greater than the third virtual lens angle;

[0240] The first map scale is larger than the second map scale, and the second map scale is larger than the third map scale.

[0241] In some embodiments, the control module comprises:

[0242] A type acquisition submodule is used to obtain the type of the above control node;

[0243] An object determination submodule, for determining a camera movement object corresponding to the camera movement control node when the control node is a camera movement control node;

[0244] The orientation acquisition submodule is used to obtain the lens orientation corresponding to the above-mentioned lens movement object;

[0245] The second virtual lens control submodule is configured to control the virtual lens to capture images of the virtual object moving along the virtual motion trajectory based on the lens orientation.

[0246] In some embodiments, the direction acquisition submodule is specifically configured to:

[0247] When it is detected that the camera object is an intersection in the three-dimensional virtual scene, the movement direction of the virtual object is determined as the camera direction.

[0248] In some embodiments, the direction acquisition submodule is specifically configured to:

[0249] When it is detected that the camera object is a target building in the three-dimensional virtual scene, the direction from the position of the virtual object to the position of the target building in the ground coordinate system of the three-dimensional virtual scene is determined as the camera orientation.

[0250] In some embodiments, the virtual motion trajectory further includes a plurality of common control nodes, the plurality of common control nodes dividing the virtual motion trajectory into a plurality of sub-trajectories, each of the plurality of sub-trajectories corresponding to a reference priority, and the apparatus further includes:

[0251] a screening unit, configured to screen out, from the plurality of sub-trajectories, the sub-trajectory where the camera movement control node is located as a target sub-trajectory;

[0252] A priority obtaining unit 1901 is configured to obtain a reference priority corresponding to the target sub-track and a priority of the camera movement object;

[0253] a priority comparison unit, configured to compare the priority of the camera movement object with the reference priority;

[0254] An execution unit is used to execute the step of obtaining the lens orientation corresponding to the camera movement object when the priority of the camera movement object is greater than or equal to the reference priority.

[0255] In some embodiments, the reference priority corresponding to the sub-trajectory is positively correlated with the distance from the sub-trajectory to the starting point of the virtual action trajectory.

[0256] In specific implementation, the above units can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same or several entities. The specific implementation of the above units can be found in the previous method embodiments and will not be repeated here.

[0257] The present application also provides an electronic device, which may be a terminal, a server, or the like. The terminal may be a mobile phone, a tablet computer, a smart Bluetooth device, a laptop computer, a personal computer, or the like; the server may be a single server or a server cluster consisting of multiple servers, or the like.

[0258] In some embodiments, the motion trajectory playback device may also be integrated into multiple electronic devices. For example, the motion trajectory playback device may be integrated into multiple servers, and the motion trajectory playback method of the present application may be implemented by the multiple servers.

[0259] In this embodiment, the electronic device will be described in detail. For example, as shown in FIG20 , it shows a schematic diagram of the structure of the electronic device involved in the embodiment of the present application. Specifically:

[0260] The electronic device may include components such as one or more processing core processors 2001, one or more computer-readable storage media memories 2002, a power supply 2003, an input module 2004, and a communication module 2005. It will be understood by those skilled in the art that the electronic device structure shown in FIG20 does not limit the electronic device and may include more or fewer components than shown, or combine certain components, or arrange the components differently.

[0261] Processor 2001 is the control center of the electronic device, connecting all components of the electronic device using various interfaces and circuits. By running or executing software programs and / or modules stored in memory 2002 and accessing data stored in memory 2002, it performs various functions of the electronic device and processes data, thereby monitoring the entire electronic device. In some embodiments, processor 2001 may include one or more processing cores. In some embodiments, processor 2001 may integrate an application processor and a modem processor, where the application processor primarily handles the operating system, user interface, and application programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor may not be integrated into processor 2001.

[0262] The memory 2002 can be used to store software programs and modules. The processor 2001 executes various functional applications and data processing by running the software programs and modules stored in the memory 2002. The memory 2002 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 2002 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage device. Accordingly, the memory 2002 may also include a memory controller to provide the processor 2001 with access to the memory 2002.

[0263] The electronic device also includes a power supply 2003 for supplying power to various components. In some embodiments, the power supply 2003 can be logically connected to the processor 2001 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The power supply 2003 can also include one or more DC or AC power supplies, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and other arbitrary components.

[0264] The electronic device may further include an input module 2004, which may be configured to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls.

[0265] The electronic device may further include a communication module 2005. In some embodiments, the communication module 2005 may include a wireless module. The electronic device may perform short-range wireless transmission via the wireless module of the communication module 2005, thereby providing the user with wireless broadband Internet access. For example, the communication module 2005 may be used to help the user send and receive emails, browse web pages, and access streaming media.

[0266] Although not shown, the electronic device may further include a display unit, etc., which will not be described in detail herein. Specifically, in this embodiment, the processor 2001 in the electronic device loads the executable files corresponding to the processes of one or more application programs into the memory 2002 according to the following instructions, and the processor 2001 runs the application programs stored in the memory 2002 to implement various functions.

[0267] The specific implementation of the above operations can be found in the previous embodiments and will not be repeated here.

[0268] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be accomplished by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0269] To this end, an embodiment of the present application provides a computer-readable storage medium, which stores multiple instructions. The instructions can be loaded by a processor to execute the steps in any action trajectory playback method provided in the embodiment of the present application.

[0270] The storage medium may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0271] According to one aspect of the present application, a computer program product or computer program is provided, the computer program product or computer program including computer instructions stored in a computer-readable storage medium. A processor of an electronic device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the electronic device to perform the method provided in the above embodiments.

[0272] Since the instructions stored in the storage medium can execute the steps of any action trajectory playback method provided in the embodiments of the present application, the beneficial effects that can be achieved by any action trajectory playback method provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0273] The technical features of the above embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0274] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present invention. It should be noted that a person skilled in the art could make various modifications and improvements without departing from the spirit of the present application, all of which fall within the scope of protection of the present application. Therefore, the scope of protection of the present patent application shall be determined by the appended claims.

Claims

1. A method for replaying an action track, executed by an electronic device, the method comprising: Obtain a three-dimensional virtual scene and determine the real movement trajectory of real objects; Mapping the real action trajectory in the three-dimensional virtual scene to obtain a virtual action trajectory; Setting a virtual object corresponding to the real object in the three-dimensional virtual scene, and setting a virtual lens corresponding to the virtual object, wherein a preset relative position relationship is maintained between the virtual lens and the virtual object; Controlling the virtual object to move along the virtual motion track, and controlling the virtual camera to capture images of the virtual object moving along the virtual motion track; and The screen is displayed.

2. The motion trajectory playback method according to claim 1, wherein the step of controlling the virtual object to move according to the virtual motion trajectory and controlling the virtual camera to capture a picture of the virtual object moving according to the virtual motion trajectory comprises: Acquiring position information of the virtual object in the virtual action trajectory; Based on the position information, the virtual object is controlled to move along the virtual motion trajectory, and the virtual lens is controlled to capture a picture of the virtual object moving along the virtual motion trajectory.

3. The motion trajectory playback method according to claim 2, wherein the step of controlling the virtual object to move according to the virtual motion trajectory based on the position information comprises: Determine, according to the position information, a remaining track length of the virtual object, wherein the remaining track length is a track length of the virtual object in the virtual action track where no action has been taken; Determining a target motion speed of the virtual object according to the remaining trajectory length, wherein the remaining trajectory length is negatively correlated with the target motion speed; Based on the target motion speed, the virtual object is controlled to move according to the virtual motion trajectory.

4. The method for replaying the action trajectory according to claim 3, wherein the step of controlling the virtual lens to capture the image of the virtual object moving along the virtual action trajectory based on the position information comprises: Determining a target virtual lens angle of the virtual lens according to the remaining track length, wherein the remaining track length is positively correlated with the target virtual lens angle, and the target virtual lens angle is a pitch angle of the virtual lens; Based on the target virtual lens angle, the virtual lens is controlled to capture images of the virtual object moving along the virtual action trajectory.

5. The method for replaying the action trajectory according to claim 3, wherein the step of controlling the virtual lens to capture the image of the virtual object moving along the virtual action trajectory based on the position information comprises: Determining a target map scale corresponding to the virtual lens according to the remaining track length, wherein the target map scale is positively correlated with the remaining track length; Based on the target map scale, the virtual camera is controlled to capture images of the virtual object moving along the virtual action trajectory.

6. The motion trajectory playback method according to claim 2, wherein the virtual motion trajectory includes a plurality of control nodes, and the controlling the virtual object to move according to the virtual motion trajectory based on the position information, and controlling the virtual lens to capture a picture of the virtual object moving according to the virtual motion trajectory, comprises: When it is determined according to the position information that the virtual object has reached the control node, obtaining a control strategy corresponding to the control node; Based on the control strategy corresponding to the control node, the virtual object is controlled to move according to the virtual action trajectory, and the virtual lens is controlled to capture the picture of the virtual object moving according to the virtual action trajectory.

7. The method for replaying the action trajectory according to claim 6, wherein the controlling the virtual object to act according to the virtual action trajectory based on the control strategy corresponding to the control node and the controlling the virtual lens to capture the image of the virtual object acting according to the virtual action trajectory comprises: Obtaining the type of the control node; When the control node is a common control node, obtaining control parameters corresponding to the common control node, wherein the control parameters include the movement speed of the virtual object, the virtual lens angle of the virtual lens, and the map scale corresponding to the virtual lens, and the target virtual lens angle is the pitch angle of the virtual lens; Based on the movement speed, controlling the virtual object to move along the virtual movement trajectory; Based on the virtual lens angle and the map scale, the virtual lens is controlled to capture images of the virtual object moving along the virtual action trajectory.

8. The motion track playback method according to claim 7, wherein the common control nodes include a first control node, a second control node, and a third control node, wherein: The first control node, the second control node, and the third control node divide the virtual motion track into a first sub-track, a second sub-track, a third sub-track, and a fourth sub-track; The first sub-trajectory is a trajectory between the first control node and the starting point of the virtual action trajectory; The second sub-trace is a trajectory between the first control node and the second control node; The third sub-trace is a trajectory between the second control node and the third control node; The fourth sub-trajectory is a trajectory between the third control node and an end point of the virtual motion trajectory. 9 . The motion trajectory playback method according to claim 8 , wherein the trajectory length ratio among the first sub-trajectory, the second sub-trajectory, the third sub-trajectory and the fourth sub-trajectory is 2:1:2:

5.

10. The action trajectory playback method according to claim 8 or 9, wherein the control parameters corresponding to the first control node include a first action speed, a first virtual lens angle, and a first map scale; The control parameters corresponding to the second control node include a second action speed, a second virtual lens angle, and a second map scale; The control parameters corresponding to the third control node include a third action speed, a third virtual lens angle and a third map scale; The first movement speed is lower than the second movement speed, and the second movement speed is lower than the third movement speed; The first virtual lens angle is greater than or equal to the second virtual lens angle, and the second virtual lens angle is greater than the third virtual lens angle; The first map scale is larger than the second map scale, and the second map scale is larger than the third map scale.

11. The method for replaying the action trajectory according to any one of claims 6 to 10, wherein the controlling the virtual object to move according to the virtual action trajectory based on the control strategy corresponding to the control node and the controlling the virtual lens to capture the image of the virtual object moving according to the virtual action trajectory comprises: Obtaining the type of the control node; When the control node is a camera movement control node, determining a camera movement object corresponding to the camera movement control node; Obtaining the lens direction corresponding to the lens moving object; Based on the lens direction, the virtual lens is controlled to capture images of the virtual object moving along the virtual motion trajectory.

12. The action trajectory playback method according to claim 11, wherein the step of obtaining the lens orientation corresponding to the camera object comprises: When it is detected that the camera object is an intersection in the three-dimensional virtual scene, the movement direction of the virtual object is determined as the camera orientation.

13. The action trajectory playback method according to claim 11, wherein obtaining the lens orientation corresponding to the camera object comprises: When it is detected that the camera object is a target building in the three-dimensional virtual scene, the direction from the position of the virtual object to the position of the target building in the ground coordinate system of the three-dimensional virtual scene is determined as the camera orientation.

14. The motion track playback method according to claim 11, wherein the virtual motion track further comprises a plurality of common control nodes, wherein the plurality of common control nodes divide the virtual motion track into a plurality of sub-tracks, each of the plurality of sub-tracks corresponds to a reference priority, and before obtaining the lens orientation corresponding to the camera moving object, further comprising: Among the multiple sub-trajectories, select the sub-trajectory where the camera movement control node is located as the target sub-trajectory; Obtaining a reference priority corresponding to the target sub-track and a priority of the camera object; Comparing the priority of the camera object with the reference priority; When the priority of the camera movement object is greater than or equal to the reference priority, the step of obtaining the lens orientation corresponding to the camera movement object is performed. 15 . The motion trajectory playback method according to claim 14 , wherein the sub-trajectory corresponding reference priority is positively correlated with the distance from the sub-trajectory to the starting point of the virtual motion trajectory.

16. An action trajectory playback device, comprising: An acquisition unit, used to acquire a three-dimensional virtual scene and determine a real movement trajectory of a real object; A mapping unit, used for mapping the real action trajectory into the three-dimensional virtual scene to obtain a virtual action trajectory; A setting unit, used for setting a virtual object corresponding to the real object and a virtual lens corresponding to the virtual object in the three-dimensional virtual scene, wherein a preset relative position relationship is maintained between the virtual lens and the virtual object; A control unit, used to control the virtual object to move according to the virtual motion trajectory, and control the virtual lens to capture a picture of the virtual object moving according to the virtual motion trajectory; and A display unit is used to display the picture.

17. An electronic device comprising a processor and a memory, wherein the memory stores a plurality of instructions; the processor loads instructions from the memory to execute the steps in the action trajectory playback method according to any one of claims 1 to 15.

18. A computer-readable storage medium storing a plurality of instructions, wherein the instructions are suitable for being loaded by a processor to execute the steps in the action trajectory playback method according to any one of claims 1 to 15.

19. A computer program product, comprising a computer program / instruction, wherein when the computer program / instruction is executed by a processor, the steps in the action trajectory playback method according to any one of claims 1 to 15 are implemented.

Images