Navigation screen projection method, mobile terminal, server, electric two-wheeled vehicle and medium

Abstract

The present application provides a navigation screen projection method, a mobile terminal, a server, an electric two-wheeled vehicle, and a medium. After the server receives the navigation start instruction uploaded by the mobile terminal, the server draws a navigation image on the server according to the navigation route information and the real-time positioning position of the mobile terminal through the setting application in the server, and generates a navigation video based on the navigation image drawn on the server. The navigation video is encoded according to the audio and video codec parameters of the vehicle and sent to the mobile terminal, so that the mobile terminal forwards the encoded navigation video to the vehicle, so that the vehicle decodes the received navigation video and displays the navigation video. Therefore, when the mobile terminal is in the screen-off state, the navigation video can still be displayed on the vehicle, avoiding affecting the navigation effect when the mobile terminal is in the screen-off state and improving the user experience. In addition, the vehicle only needs to decode the received navigation video to display the navigation video, without the need to configure high-performance hardware, thereby reducing the cost of the vehicle.

Description

Technical Field

[0001] The present application relates to the field of navigation, and in particular to a navigation screen projection method, a mobile terminal, a server, an electric two-wheeled vehicle and a medium. Background Art

[0002] With the continuous development of vehicle networking technology, the number of times people travel by car is gradually increasing. In order to meet the diverse navigation needs of users during travel, the navigation in the mobile terminal can be projected onto the car to display the navigation information of the mobile terminal on the car screen.

[0003] However, this navigation function requires high hardware performance, and the conventional hardware configuration of some vehicles (such as electric two-wheeled vehicles) is difficult to support this navigation function. If such a navigation function is to be configured on these vehicles, high-performance hardware will be required, which will inevitably increase the cost significantly.

[0004] Moreover, even if the hardware configuration of these vehicles is improved, this navigation function can be achieved by projecting the navigation video in the mobile terminal onto the vehicle. However, the inventors found that when some mobile terminals are in the screen-off state, the vehicle cannot obtain the navigation video screen, and the navigation display is interrupted, which seriously affects the navigation effect and user experience. Summary of the Invention

[0005] The present application provides a navigation screen projection method, mobile terminal, server, electric two-wheeled vehicle and medium, which avoids the situation where the mobile terminal is in the screen-off state, causing the navigation display to be interrupted and affecting the navigation effect, thereby improving the user experience, and the vehicle does not need to be configured with high-performance hardware, thereby reducing the cost of the vehicle.

[0006] In a first aspect, the present application provides a navigation screen projection method, which is applicable to a server and includes:

[0007] receiving navigation route information and vehicle audio and video codec parameters uploaded by a mobile terminal; the navigation route information is returned to the mobile terminal after the mobile terminal receives a user's navigation instruction and sends the user-entered destination information and the current location of the mobile terminal to a setting application program interface;

[0008] After receiving the navigation start instruction uploaded by the mobile terminal, the server draws a navigation image on the server according to the navigation route information and the real-time positioning position of the mobile terminal sent by the mobile terminal through a setting application in the server;

[0009] generating a navigation video according to the navigation image drawn on the server;

[0010] The navigation video is encoded according to the audio and video codec parameters and then sent to the mobile terminal. The mobile terminal is used to forward the encoded navigation video to the vehicle so that the vehicle decodes the received navigation video and displays the navigation video.

[0011] Optionally, generating a navigation video according to the navigation image drawn on the server includes:

[0012] After drawing the navigation image on the server, performing screen recording or screenshot of the navigation image drawn on the server;

[0013] Generate a navigation video based on the navigation image obtained by screen recording or screenshot.

[0014] Optionally, encoding the navigation video according to the audio and video codec parameters of the vehicle and then sending it to the mobile terminal, and the mobile terminal being configured to forward the encoded navigation video to the vehicle so that the vehicle decodes the received navigation video and displays the navigation video, includes:

[0015] The navigation video is encoded according to the vehicle's audio and video encoding and decoding parameters according to the MPEG protocol and then sent to the mobile terminal. The mobile terminal is used to forward the encoded navigation video to the vehicle so that the vehicle can decode the received navigation video according to the MPEG protocol and display the navigation video.

[0016] Optionally, encoding the navigation video according to the audio and video codec parameters of the vehicle and then sending the encoding to the mobile terminal includes:

[0017] The navigation video is decoded according to the audio and video encoding and decoding parameters of the vehicle and then sent to the mobile terminal through the network communication connection between the server and the mobile terminal.

[0018] Optionally, the method further includes:

[0019] After receiving the navigation end instruction uploaded by the mobile terminal, the drawing of the navigation image and / or the generation of the navigation video are stopped.

[0020] In a second aspect, the present application provides a navigation screen projection method, which is applicable to a mobile terminal and includes:

[0021] After receiving a user's navigation instruction, the destination information input by the user and the current location information of the mobile terminal are sent to a setting application program interface through a navigation software development tool in the mobile terminal, so that the setting application program interface returns navigation route information between the destination and the current location to the mobile terminal;

[0022] sending the navigation route information and the audio and video codec parameters of the vehicle to a server, and sending the real-time location of the mobile terminal to the server, so that the server draws a navigation image on the server according to the navigation route information and the real-time location of the mobile terminal through a setting application in the server, generates a navigation video based on the navigation image, encodes the navigation video according to the audio and video codec parameters of the vehicle, and returns it to the mobile terminal;

[0023] After receiving the encoded navigation video returned by the server, the encoded navigation video is forwarded to the vehicle, so that the vehicle decodes the received navigation video and displays the navigation video.

[0024] Optional,

[0025] The method further comprises:

[0026] When the mobile terminal establishes a wireless communication connection with the vehicle for the first time, obtaining the audio and video codec parameters of the vehicle through the wireless communication connection established for the first time;

[0027] and / or,

[0028] After receiving the encoded navigation video returned by the server, forwarding the encoded navigation video to the vehicle includes:

[0029] After receiving the encoded navigation video sent by the server, forwarding the encoded navigation video to the vehicle through the wireless communication connection between the mobile terminal and the vehicle;

[0030] The wireless communication connection includes a Bluetooth communication connection and / or a Wi-Fi communication connection.

[0031] Optionally, the method further includes:

[0032] When the vehicle displays the navigation video, sending an end navigation instruction to the server to cause the server to stop drawing the navigation image and / or stop generating the navigation video;

[0033] and / or,

[0034] After receiving the end navigation instruction sent by the vehicle, the end navigation instruction is forwarded to the server, so that the server stops drawing the navigation image and / or stops generating the navigation video.

[0035] Optionally, the method further includes:

[0036] After receiving the navigation route information, the mobile terminal extracts information from the navigation route information and generates a navigation instruction; or receives the navigation instruction generated by the server after extracting information from the navigation route information;

[0037] The navigation instruction is sent to the vehicle, so that the vehicle displays the navigation video and / or a simple navigation image corresponding to the navigation instruction.

[0038] In a third aspect, the present application provides a navigation screen projection method, which is applicable to a vehicle and includes:

[0039] receiving an encoded navigation video forwarded by a mobile terminal; the encoded navigation video is generated by a server, after receiving a navigation start instruction sent by the mobile terminal, drawing a navigation image on the server through a setting application in the server based on navigation route information between the mobile terminal's current location and the destination and the mobile terminal's real-time location, generating a navigation video based on the navigation image, encoding the navigation video according to the vehicle's audio and video codec parameters, and then sending it to the mobile terminal;

[0040] The encoded navigation video forwarded by the mobile terminal is decoded, and the navigation video is displayed on a display screen of the vehicle.

[0041] Optionally, the receiving the encoded navigation video forwarded by the mobile terminal includes:

[0042] Receiving the navigation video forwarded by the mobile terminal and encoded by the server according to the MPEG protocol and the audio and video codec parameters of the vehicle;

[0043] The decoding of the encoded navigation video forwarded by the mobile terminal includes:

[0044] The encoded navigation video sent by the mobile terminal is decoded according to the MPEG protocol.

[0045] Optionally, the method further includes:

[0046] receiving a navigation instruction sent by the mobile terminal; the navigation instruction is extracted by the mobile terminal from the navigation route information;

[0047] A corresponding simple navigation image is selected on the vehicle according to the navigation instruction, and the simple navigation image and / or the navigation video is displayed.

[0048] In a fourth aspect, the present application provides a mobile device comprising a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor executes any possible method of the first aspect.

[0049] In a fifth aspect, the present application provides a server comprising a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor executes any possible method of the second aspect.

[0050] In a sixth aspect, the present application provides an electric two-wheeled vehicle, comprising a control module and a memory, wherein the memory stores a computer program, and when the computer program is executed by the control module, the control module executes any possible method of the third aspect.

[0051] In a seventh aspect, the present application provides a computer-readable storage medium for storing a computer program, wherein the computer program enables a computer to execute the method described above.

[0052] The navigation screen projection method provided in the present application is applicable to a server, wherein the server receives navigation route information uploaded by a mobile terminal and the audio and video codec parameters of a vehicle. The navigation route information is the destination information entered by the user and the current location of the mobile terminal sent to the setting application interface after the mobile terminal receives the navigation start instruction from the user. The setting application interface returns the navigation route information to the mobile terminal. After the server receives the navigation start instruction uploaded by the mobile terminal, the server draws a navigation image on the server according to the navigation route information and the real-time location of the mobile terminal sent by the mobile terminal through the setting application in the server, and generates a navigation video according to the navigation image drawn on the server. The navigation video is encoded according to the audio and video codec parameters of the vehicle and sent to the mobile terminal, so that the mobile terminal forwards the encoded navigation video to the vehicle, so that the vehicle decodes the received navigation video and displays the navigation video. In the solution of the present application, the server generates a navigation video according to the navigation route information sent by the mobile terminal and the real-time location of the mobile terminal and sends it to the mobile terminal. When the mobile terminal is in the screen-off state, the navigation video can still be displayed on the vehicle, thereby avoiding the situation where the navigation display is interrupted and the navigation effect is affected by the mobile terminal being in the screen-off state, thereby improving the user experience. Moreover, the vehicle only needs to decode the received navigation video to display the navigation video, and the processing complexity is low. The vehicle does not need to be configured with high-performance hardware, thus reducing the cost of the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] In order to more clearly illustrate the technical solutions in the present application or the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0054] Figure 1 A schematic diagram of a scenario of a navigation screen projection method provided by an embodiment of the present application is shown;

[0055] Figure 2 A flowchart of a navigation screen projection method provided by an embodiment of the present application is shown;

[0056] Figure 3 A flowchart of a navigation screen projection method provided by another embodiment of the present application is shown;

[0057] Figure 4 A schematic diagram of a vehicle display interface provided by an embodiment of the present application is shown;

[0058] Figure 5 A flowchart of a navigation screen projection method provided by another embodiment of the present application is shown;

[0059] Figure 6 A schematic diagram of a vehicle display interface provided by another embodiment of the present application is shown;

[0060] Figure 7 A signaling interaction diagram of a navigation screen projection method provided by an embodiment of the present application is shown. DETAILED DESCRIPTION

[0061] To make the objectives, technical solutions, and advantages of this application more clear, the technical solutions in this application will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the embodiments described are only part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0062] As described in the background art, the navigation function in a car has high requirements on hardware performance, especially on the processor (CPU) and memory. For example, the processor needs to be able to support mainstream audio and video codecs.

[0063] Currently, the computing power and storage capacity of the microcontrollers (MCUs) in some vehicles (e.g., electric two-wheelers) are insufficient to support this type of navigation functionality. Configuring these vehicles with high-performance hardware to support this navigation capability significantly increases costs. Furthermore, when projecting navigation videos from a mobile device to the vehicle, if the mobile device screen is off, the vehicle cannot access the navigation image, resulting in interrupted navigation display and severely impacting navigation quality and user experience.

[0064] To this end, the present application provides a navigation screen projection method. The server draws a navigation image based on the navigation route information between the destination and the current location of the mobile terminal in combination with the real-time location of the mobile terminal. After generating a navigation video based on the navigation image, the navigation video is encoded and sent to the mobile terminal. The mobile terminal forwards the navigation video to the vehicle. The vehicle only needs to decode the received navigation video to display the navigation video. The processing complexity is low, and the vehicle does not need to be configured with high-performance hardware, which reduces the cost of the vehicle. In addition, since the server is responsible for generating the navigation video, the navigation video can still be displayed on the vehicle when the mobile terminal is in the screen-off state, avoiding the impact on navigation when the mobile terminal is in the screen-off state and improving the user experience.

[0065] The following specific embodiments are used to describe the technical solution of the present application in detail. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0066] Figure 1 A scene diagram of a navigation screen projection method provided by an embodiment of the present application is shown.

[0067] Mobile terminal 101 and vehicle 102 are equipped with wireless communication modules (e.g., Bluetooth communication modules, Wi-Fi communication modules), enabling a wireless communication connection to be established between mobile terminal 101 and vehicle 102. Mobile terminal 101 can obtain vehicle 102's audio and video codec parameters through the wireless communication connection established with vehicle 102. Mobile terminal 101 receives destination information input by user 103 and, upon receiving a navigation start instruction from user 103, sends the destination information and mobile terminal 101's current location information to a setting application program interface (API) via the network, causing the API to return navigation route information between the destination and the current location to mobile terminal 101. After receiving the navigation route information between the destination and the current location, mobile terminal 101 uploads the navigation route information and vehicle 102's audio and video codec parameters to server 104. Upon receiving the navigation start instruction uploaded by the mobile terminal, server 104 uses a setting application within server 104 to draw a navigation image on server 104 based on the navigation route information and the mobile terminal's real-time location information sent by mobile terminal 101. Server 104 can also generate a navigation video based on the navigation image drawn on server 104, encode the navigation video according to the audio and video codec parameters of vehicle 102, and transmit it to mobile terminal 101. After receiving the encoded navigation video, mobile terminal 101 forwards the encoded navigation video to vehicle 104. The microcontroller with an M0 core in electronic device 102 has low processing performance and cannot support complex processing such as graphics processing units (GPUs). However, it can decode and display the received navigation video and transmit it to the display screen of vehicle 102 for display.

[0068] Figure 2 A flowchart of a navigation screen projection method provided by an embodiment of the present application is shown. Figure 2 As shown, with the server as the execution subject, the method of this embodiment may include the following steps:

[0069] S101: Receive navigation route information and vehicle audio and video codec parameters uploaded by a mobile terminal.

[0070] The navigation route information is returned to the mobile terminal by the setting application after the mobile terminal receives the user's navigation instruction and sends the destination information input by the user and the current location of the mobile terminal to the setting application interface.

[0071] For example, the mobile terminal may be a smart terminal such as a mobile phone, a tablet computer, a smart watch, etc. The set application program interface may be a third-party API (Application Programming Interface) interface of various maps.

[0072] After receiving the destination information and the current location information of the mobile terminal, the application programming interface is configured to send the destination information and the current location information of the mobile terminal to a third party, and return the navigation route information between the destination and the current location returned by the third party to the mobile terminal. The navigation route information may include images, text, etc. For example, the image displayed when searching for a location may be composed of multiple small images. The application programming interface can be configured to return these small images so that the desired image can be subsequently drawn based on the small images.

[0073] S102: After receiving the navigation start instruction uploaded by the mobile terminal, a setting application in the server draws a navigation image on the server according to the navigation route information and the real-time positioning position of the mobile terminal sent by the mobile terminal.

[0074] In the embodiment of the present application, a server runs a configuration application. After receiving a navigation start instruction uploaded by a mobile terminal, the configuration application can draw a navigation image on the server based on the navigation route information and the real-time location of the mobile terminal. The configuration application can be, for example, a software development kit (SDK) for various maps.

[0075] For example, after receiving the destination information and the current location information of the mobile terminal, the application programming interface can be configured to return information about most of the entire navigation route at once. The navigation route can include the most time-saving route or the shortest route between the destination and the current location of the mobile terminal. The navigation information can include images of multiple locations along the navigation route, which can include information such as landmarks and roads.

[0076] Therefore, the server can draw a navigation image according to the navigation route information and the real-time positioning position of the mobile terminal sent by the mobile terminal by setting up the application, so that the navigation image can be drawn in real time in combination with the real-time positioning position of the mobile terminal and the navigation route information.

[0077] In some examples, when the positioning position of the mobile terminal changes, if the image of the surrounding environment changes, the mobile terminal can send the changed positioning position to the setting application interface, so that the setting application interface can return information about the changed positioning position. For example, if the mobile terminal deviates from the navigation route, the navigation information initially returned by the setting application interface may not include environmental information surrounding the current positioning position of the mobile terminal after the deviation from the navigation route. The mobile terminal sends the positioning position information at this time to the setting application interface, so that the setting application interface can return environmental information surrounding the positioning position at this time. After receiving the environmental information surrounding the positioning position at this time, the mobile terminal promptly uploads it to the server, so that the server can continue to draw an accurate navigation image based on the environmental information surrounding the changed positioning position.

[0078] S103: Generate a navigation video according to the navigation image drawn on the server.

[0079] In an embodiment of the present application, the server generates a navigation video based on the drawn navigation image. When the mobile terminal is in the screen-off state, the server can still generate a navigation video so as to display the navigation video on the vehicle, thereby reducing the interruption of the navigation display when the mobile terminal is in the screen-off state and improving the user experience.

[0080] In some embodiments, after the navigation image is drawn on the server, the navigation image drawn on the server is screen recorded or captured, and a navigation video is generated based on the navigation image obtained by the screen recording or capture.

[0081] In some examples, after generating a navigation video based on a navigation image, the navigation video may be rendered to enhance the visual experience of the navigation video.

[0082] In some examples, the server can determine that the server has arrived at a predetermined intersection based on the real-time positioning position of the mobile terminal, and enlarge the intersection picture in the navigation image to capture the enlarged intersection picture to generate a navigation video, so as to more clearly display the information of complex locations and reduce the possibility of guidance errors.

[0083] S104: Encode the navigation video according to the audio and video codec parameters and send it to the mobile terminal. The mobile terminal is used to forward the encoded navigation video to the vehicle, so that the vehicle decodes the received navigation video and displays the navigation video.

[0084] In this embodiment of the present application, after generating a navigation video, the server encodes it according to the vehicle's audio and video codec parameters and transmits it to the mobile terminal. The mobile terminal forwards the encoded navigation video to the vehicle, which decodes and displays it. The vehicle only needs to decode the received navigation video to display it, reducing processing complexity. This eliminates the need for high-performance hardware and reduces vehicle costs. Furthermore, users can intuitively view rich reference information on the vehicle, reducing the likelihood of misguided navigation and improving the user experience.

[0085] For example, the vehicle may be an electric two-wheeled vehicle such as an electric bicycle, an electric motorcycle, an electric scooter, or an electric three-wheeled vehicle.

[0086] In some embodiments, the server can encode the navigation video according to the audio and video codec parameters of the vehicle according to the MPEG (Moving Picture Expert Group) protocol and send it to the mobile terminal. The mobile terminal forwards the encoded navigation video to the vehicle, so that the vehicle decodes the received navigation video according to the MPEG protocol and displays the navigation video, thereby further reducing the hardware requirements. The MPEG protocol can be various existing MPEGs, such as MPEG 1, MPEG 2, and MPEG 4. Other audio and video codecs can also be used, such as H264, H265, etc., as long as the mobile terminal and the electronic device can be aligned. The audio and video codec parameters may include frame rates and bit rates supported by the vehicle.

[0087] In some embodiments, after encoding the navigation video according to the vehicle's audio and video codec parameters, the server can transmit the encoded navigation video to the mobile terminal via a wireless communication connection between the mobile terminal and the vehicle. For example, the wireless communication connection can include Bluetooth and / or Wi-Fi, or other wireless or even wired communication methods. Typically, the communication bandwidth must be at least 40 KB / s to ensure stable navigation video transmission.

[0088] For example, when a server and a mobile terminal establish a wireless communication connection, the Real-time Transport Protocol (RTP) and / or the Real-time Transport Control Protocol (RTCP) can be used on the wireless communication channel between the server and the mobile terminal to reduce costs. The wireless communication channel can also use other video control protocols or custom protocols.

[0089] In some embodiments, after receiving the end navigation instruction uploaded by the mobile terminal, the server may stop drawing the navigation image and / or stop generating the navigation video to stop displaying the navigation video on the vehicle.

[0090] The navigation screen projection method provided in this application involves a server generating a navigation video based on the navigation route information sent by a mobile terminal and the mobile terminal's real-time positioning position. The server then encodes the navigation video and sends it to the mobile terminal, which then forwards the encoded navigation video to the vehicle. The vehicle then encodes the received encoded navigation video and displays it. This allows the vehicle to still display the navigation video even when the mobile terminal is in the screen-off state, thus avoiding any impact on the navigation effect when the mobile terminal is in the screen-off state and improving the user experience. Furthermore, the vehicle only needs to decode the received navigation video to display it, which reduces processing complexity and eliminates the need for high-performance hardware, thereby reducing vehicle costs.

[0091] Figure 3 A flowchart of a navigation screen projection method provided by an embodiment of the present application is shown. Figure 3 As shown, with the mobile terminal as the execution subject, the method of this embodiment may include the following steps:

[0092] S201. After receiving the user's navigation instruction, the destination information input by the user and the current location of the mobile terminal are sent to the setting application interface through the navigation software development tool in the mobile terminal, so that the setting application interface returns the navigation route information between the destination and the current location to the mobile terminal.

[0093] In an embodiment of the present application, a navigation software development tool is integrated into the mobile terminal. After receiving the user's navigation instruction, the mobile terminal sends the destination information and the current location information of the mobile terminal to the setting application interface through the navigation software development tool.

[0094] For example, a user can search for a destination, select a destination, and initiate navigation on a mobile terminal. After receiving the user's navigation instruction, the mobile terminal sends the destination information entered by the user and the current location information of the mobile terminal to the setting application program interface via the navigation software development tool. After receiving the destination information and the current location information of the mobile terminal, the setting application program interface sends the destination information and the current location information of the mobile terminal to a third party and returns the navigation route information between the destination and the current location returned by the third party to the mobile terminal.

[0095] In some examples, the user can also set relevant parameters such as navigation mode in the mobile terminal. The navigation mode can be, for example, an electric bicycle riding mode, so as to set the application to return more accurate navigation route information, thereby making a more accurate navigation route.

[0096] S202. Send the navigation route information and the audio and video codec parameters of the vehicle to the server, and send the real-time positioning position of the mobile terminal to the server, so that the server draws a navigation image on the server according to the navigation route information and the real-time positioning position of the mobile terminal through a setting application in the server, generates a navigation video according to the navigation image, encodes the navigation video according to the audio and video codec parameters of the vehicle, and returns it to the mobile terminal.

[0097] In some embodiments, when a mobile terminal establishes a wireless communication connection with a vehicle for the first time, it can obtain the audio and video codec parameters supported by the vehicle through the wireless communication connection established for the first time. The mobile terminal receives the navigation route information and the audio and video codec parameters of the vehicle, and sends the navigation route information and the audio and video codec parameters of the vehicle to the server through the wireless communication connection between the mobile terminal and the server. For example, the wireless communication connection may include a Bluetooth communication connection and / or a WiFi communication connection. The Bluetooth communication connection may, for example, include a Bluetooth low energy (BLE) connection; the audio and video codec parameters may, for example, include a frame rate, bit rate, etc. supported by the electronic device.

[0098] In some examples, when a mobile terminal establishes a wireless communication connection with a vehicle, the Real-time Transport Protocol (RTP) and / or the Real-time Transport Control Protocol (RTCP) can be used on the wireless communication channel between the mobile terminal and the vehicle to reduce costs.

[0099] S203: After receiving the encoded navigation video returned by the server, forward the encoded navigation video to the vehicle, so that the vehicle encodes the received navigation video and displays the navigation video.

[0100] In some embodiments, after encoding the navigation video according to the audio and video codec parameters of the electronic device, the mobile terminal may send the navigation video to the electronic device via a wireless communication connection between the mobile terminal and the electronic device.

[0101] In some embodiments, after receiving navigation route information, the mobile terminal extracts information from the navigation route information and generates navigation instructions, or the mobile terminal receives navigation instructions generated by a server after extracting information from the navigation route information. The navigation instructions are then transmitted to the vehicle, causing the vehicle to display a navigation video and / or a simplified navigation image corresponding to the navigation instructions. After receiving the navigation instructions, the vehicle can select a corresponding simplified navigation image on the vehicle based on the navigation instructions. The simplified navigation image may include, for example, a left turn arrow, a right turn arrow, etc.

[0102] For example, the mobile terminal can send the navigation video and navigation instructions to the vehicle synchronously, and the vehicle can display the navigation video and simple navigation images, such as Figure 4 As shown, for example, the navigation video can be displayed on the display screen of the vehicle, and the simple navigation image can be displayed in a small window or floating window. Alternatively, only the navigation video or only the simple navigation image can be displayed.

[0103] In some embodiments, when the vehicle displays a navigation video, an end navigation instruction is sent to the server to cause the server to stop drawing the navigation image and / or stop generating the navigation video; and / or, after the mobile terminal receives the end navigation instruction sent by the vehicle, the mobile terminal forwards the end navigation instruction to the server to cause the server to stop drawing the image and / or stop generating the navigation video.

[0104] The navigation screen projection method provided by the present application is that the mobile terminal sends the destination information and the current positioning position information of the mobile terminal to the setting application interface, and after receiving the navigation route information between the destination and the current positioning position returned by the setting application interface, the navigation route information is forwarded to the server, so that the server draws a navigation image based on the navigation route information and the real-time positioning position of the mobile terminal, generates a navigation video based on the navigation image, encodes the navigation video according to the audio and video codec parameters of the vehicle, and sends it to the mobile terminal. The mobile terminal sends the encoded navigation video to the vehicle, so that when the mobile terminal is in the screen-off state, the navigation video can still be displayed on the vehicle, avoiding affecting the navigation effect when the mobile terminal is in the screen-off state, thereby improving the user experience. In addition, the vehicle only needs to decode the received navigation video to display the navigation video, and the processing complexity is low. The vehicle does not need to be configured with high-performance hardware, which reduces the cost of the vehicle.

[0105] Figure 5 A flowchart of a navigation screen projection method provided by an embodiment of the present application is shown. Figure 5 As shown, with the vehicle as the execution subject, the method of this embodiment may include the following steps:

[0106] S301: Receive the encoded navigation video forwarded by a mobile terminal.

[0107] Among them, the encoded navigation video is that after the server receives the start navigation instruction sent by the mobile terminal, the server draws the navigation image on the server through the setting application in the server according to the navigation route information between the current positioning position of the mobile terminal and the destination and the real-time positioning position of the mobile terminal, generates the navigation video according to the navigation image, encodes the navigation video according to the audio and video encoding and decoding parameters of the vehicle, and then sends it to the mobile terminal.

[0108] For example, the vehicle may include an electric two-wheeled vehicle such as an electric bicycle, an electric motorcycle, an electric scooter, or an electric three-wheeled vehicle.

[0109] The vehicle stores the audio and video codec parameters it supports. In some embodiments, when a wireless communication connection is first established between the vehicle and a mobile terminal, the vehicle's audio and video codec parameters can be transmitted to the mobile terminal via the initially established wireless communication connection. This initially established wireless communication connection can, for example, be a Bluetooth communication connection to ensure transmission stability and, therefore, the accuracy of the transmitted audio and video codec parameters.

[0110] In some embodiments, the vehicle receives a navigation video that is encoded according to the audio and video codec parameters of the vehicle and is sent by the mobile terminal through a wireless communication connection between the mobile terminal and the vehicle.

[0111] In some embodiments, the server can encode the navigation video according to the vehicle's audio and video codec parameters according to the MPEG protocol and send it to the mobile terminal. The mobile terminal forwards the navigation video encoded according to the MPEG protocol to the vehicle, so that the vehicle can receive the navigation video encoded by the server according to the MPEG protocol according to the vehicle's audio and video codec parameters and forwarded by the mobile terminal.

[0112] S302: Decode the encoded navigation video forwarded by the mobile terminal, and display the navigation video on a display screen of the vehicle.

[0113] For example, the vehicle's microcontroller has low processing power, for example, a main frequency of no more than 200 MHz, a memory of no more than 1 MB, and a Flash memory of no more than 2 MB. The vehicle's microcontroller decodes and drives the encoded video sent by the mobile terminal, then transmits it to the display screen for displaying the navigation video, thereby reducing the hardware cost of the display screen. For example, the display screen is a dashboard.

[0114] In some embodiments, after receiving the navigation video encoded by the server using the MPEG protocol according to the vehicle's audio and video codec parameters and forwarded by the mobile terminal, the electronic device can decode the encoded navigation video forwarded by the mobile terminal according to the MPEG protocol, thereby reducing the hardware requirements.

[0115] In some embodiments, the vehicle receives a navigation instruction from a mobile terminal, selects a corresponding simplified navigation image on the vehicle according to the navigation instruction, and displays the simplified navigation image and / or navigation video, wherein the navigation instruction is extracted by the mobile terminal from the navigation route information.

[0116] For example, when a navigation video is displayed on a vehicle, upon receiving a trigger operation from the user or a switching instruction from a mobile terminal, the navigation video is switched to a simple navigation image. When an electronic device displays both a navigation video and a simple navigation image, upon receiving a trigger operation from the user or a switching instruction from a mobile terminal, both the navigation video and the simple navigation image are switched to the simple navigation image. For example, a preset interface can be displayed on the display screen, and a simple navigation image can be displayed in a small window or a floating window, such as Figure 6 As shown, the space occupied by the screen is reduced. The preset interface can be, for example, an audio playback interface, a vehicle speed / energy consumption display interface, etc.

[0117] The navigation screen projection method provided in the present application is that the electronic device can display the navigation video after decoding the received navigation video, the processing complexity is reduced, and the electronic device can navigate without being configured with high-performance hardware. In addition, since the navigation video generated by the server can intuitively display rich navigation information during the navigation process, the user can see rich navigation information in the vehicle, reducing the possibility of guidance errors and improving the user experience.

[0118] Figure 7 FIG1 shows a signaling interaction diagram of a navigation screen projection method provided by an embodiment of the present application. Figure 7 As shown, the method of this embodiment may include the following steps:

[0119] S401: After a wireless communication connection is established between a mobile terminal and a vehicle for the first time, a request for obtaining audio and video codec parameters is sent to the vehicle through the wireless communication connection established for the first time.

[0120] Illustratively, the wireless communication connection established for the first time may include a Bluetooth communication connection, such as a Bluetooth low energy connection.

[0121] S402: After receiving the audio and video codec acquisition request sent by the mobile terminal, the vehicle sends the stored audio and video codec parameters to the mobile terminal through the wireless communication connection established for the first time.

[0122] Audio and video codec parameters include the frame rate and bit rate supported by the electronic device.

[0123] The wireless communication connection includes a Bluetooth communication connection and / or a Wi-Fi communication connection.

[0124] S403: After receiving the navigation instruction from the user, the mobile terminal sends the destination information input by the user and the current location information of the mobile terminal to the setting application program interface.

[0125] S404: Setting an application program interface to return navigation route information between the destination and the current location to the mobile terminal.

[0126] S405 , after receiving the navigation route information returned by the setting application program interface, the mobile terminal uploads the navigation route information and the audio and video codec parameters of the vehicle to the server.

[0127] S406: After receiving the navigation start instruction uploaded by the mobile terminal, the server draws a navigation image on the server through a setting application in the server according to the navigation route information and the real-time positioning position of the mobile terminal sent by the mobile terminal.

[0128] S407: The server generates a navigation video according to the navigation image drawn on the server, and encodes the navigation video according to the audio and video encoding and decoding parameters of the vehicle.

[0129] S408: The server sends the encoded navigation video to the mobile terminal.

[0130] S409: The mobile terminal forwards the encoded navigation video to the vehicle.

[0131] S410: The vehicle decodes the received navigation video and displays the navigation video.

[0132] S411. When the vehicle displays the navigation video, send an end navigation instruction to the server, and / or, after receiving the end navigation instruction sent by the vehicle, forward the end navigation instruction to the server.

[0133] S412: The server stops drawing the navigation image and / or stops generating the navigation video, so that the vehicle stops displaying the navigation video.

[0134] The navigation screen projection method provided in this application generates a navigation video based on the navigation route information sent by the mobile terminal and the mobile terminal's real-time location. The server then sends the generated navigation video to the mobile terminal. Even when the mobile terminal is in the screen-off state, the navigation video can still be displayed on the vehicle, thus preventing the impact of the mobile terminal's screen-off state on navigation and improving the user experience. Furthermore, the vehicle only needs to decode the received navigation video to display it, which reduces processing complexity and eliminates the need for high-performance hardware, thus reducing vehicle costs.

[0135] An embodiment of the present application provides a mobile device comprising a processor and a memory, wherein a computer program is stored in the memory. When the computer program is executed by the processor, the processor executes the navigation projection method of any of the above embodiments.

[0136] The memory may include high-speed random access memory (RAM) and may also include non-volatile memory (NVM), such as at least one disk memory, and may also be a USB flash drive, a mobile hard disk, a read-only memory, a magnetic disk or an optical disk.

[0137] The processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), or application-specific integrated circuits (ASICs). A general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in the present invention may be directly executed by a hardware processor or by a combination of hardware and software modules in the processor.

[0138] The mobile device provided in this embodiment can be used to execute the above-mentioned navigation screen projection method. Its implementation method and technical effects are similar, and this embodiment will not be repeated here.

[0139] The present application also provides an electric bicycle comprising an electronic device, the electronic device including a control module and a memory, the memory storing a computer program that, when executed by the control module, causes the control module to perform the navigation screen projection method described in any of the above embodiments. The electric bicycle can be an electric two-wheeled vehicle, an electric scooter, an electric motorcycle, or the like.

[0140] The present application also provides a computer-readable storage medium for storing a computer program, which enables a computer to execute the navigation projection method described in any of the above embodiments with a mobile terminal as the execution subject.

[0141] The present application also provides a computer program product, comprising computer instructions stored in a computer-readable storage medium. At least one processor of a device can read the computer instructions from the computer-readable storage medium, and at least one processor can execute the computer instructions so that the device implements the methods provided in the various embodiments described above.

[0142] An embodiment of the present application also provides a chip, which includes a memory and a processor, wherein the memory is used to store computer instructions, and the processor is used to call and execute the computer instructions from the memory, so that a device equipped with the chip executes the methods described in the various possible implementation modes above.

[0143] Finally, it should be noted that the above embodiments are intended only to illustrate the technical solutions of this application and are not intended to limit them. Although this application has been described in detail with reference to the aforementioned embodiments, those skilled in the art will appreciate that they may modify the technical solutions described in the aforementioned embodiments or replace some or all of the technical features therein with equivalents. However, such modifications or replacements do not deviate from the essence of the corresponding technical solutions within the scope of the various embodiments of this application.

Claims

1. A navigation screen projection method, characterized in that: The method is applicable to a server, and includes: Receive navigation route information uploaded by a mobile terminal and audio and video codec parameters of a vehicle; the navigation route information is obtained after the mobile terminal receives a user's navigation instruction and sends the user-input destination information and the current location of the mobile terminal to a setting application interface, and the setting application interface sends the destination information and the current location to a third party on the map, and returns the navigation route information between the destination and the current location fed back by the third party to the mobile terminal; the navigation route information includes: pictures and text; the vehicle is an electric two-wheeled vehicle; the mobile terminal and the vehicle are connected via Bluetooth communication; After receiving the navigation start instruction uploaded by the mobile terminal, a setting application in the server draws a navigation image on the server according to the navigation route information and the real-time positioning position of the mobile terminal sent by the mobile terminal; and generates a navigation video according to the navigation image drawn on the server; The navigation video is encoded according to the audio and video codec parameters and then sent to the mobile terminal. The mobile terminal is used to forward the encoded navigation video to the vehicle so that the vehicle decodes the received navigation video and displays the navigation video.

2. The navigation screen projection method according to claim 1, characterized in that: Generating a navigation video according to the navigation image drawn on the server includes: After drawing the navigation image on the server, performing screen recording or screenshot of the navigation image drawn on the server; Generate a navigation video based on the navigation image obtained by screen recording or screenshot.

3. The navigation screen projection method according to claim 1, characterized in that: The step of encoding the navigation video according to the audio and video codec parameters of the vehicle and then sending the encoded navigation video to the mobile terminal, wherein the mobile terminal is configured to forward the encoded navigation video to the vehicle so that the vehicle decodes the received navigation video and then displays the navigation video, including: The navigation video is encoded according to the vehicle's audio and video encoding and decoding parameters according to the MPEG protocol and then sent to the mobile terminal. The mobile terminal is used to forward the encoded navigation video to the vehicle so that the vehicle can decode the received navigation video according to the MPEG protocol and display the navigation video.

4. The navigation screen projection method according to any one of claims 1 to 3, characterized in that: The encoding of the navigation video according to the audio and video encoding and decoding parameters of the vehicle and then sending the encoding to the mobile terminal includes: The navigation video is encoded according to the audio and video encoding and decoding parameters of the vehicle and then sent to the mobile terminal through the network communication connection between the server and the mobile terminal.

5. The navigation screen projection method according to any one of claims 1 to 3, characterized in that: The method further comprises: After receiving the navigation end instruction uploaded by the mobile terminal, the drawing of the navigation image and / or the generation of the navigation video are stopped.

6. A navigation screen projection method, characterized in that: The method is applicable to a mobile terminal, and includes: After receiving a user's navigation instruction, the destination information input by the user and the current location of the mobile terminal are sent to a setting application program interface through a navigation software development tool in the mobile terminal, so that the setting application program interface sends the destination information and the current location to a third party of the map, and continues to return navigation route information between the destination and the current location fed back by the third party to the setting application program interface to the mobile terminal; the navigation route information includes: pictures and text; The navigation route information and the audio and video codec parameters of the vehicle are sent to a server, and the location of the mobile terminal is sent to the server in real time, so that the server draws a navigation image on the server according to the navigation route information and the real-time location of the mobile terminal through a set application in the server, generates a navigation video based on the navigation image, encodes the navigation video according to the audio and video codec parameters of the vehicle, and returns it to the mobile terminal; the vehicle is an electric two-wheeled vehicle; the mobile terminal and the vehicle are connected via Bluetooth communication; After receiving the encoded navigation video returned by the server, the encoded navigation video is forwarded to the vehicle, so that the vehicle decodes the received navigation video and displays the navigation video.

7. The navigation screen projection method according to claim 6, characterized in that: The method further comprises: When the mobile terminal establishes the Bluetooth communication connection with the vehicle for the first time, obtaining the audio and video codec parameters of the vehicle through the Bluetooth communication connection established for the first time; and / or, After receiving the encoded navigation video returned by the server, forwarding the encoded navigation video to the vehicle includes: After receiving the encoded navigation video sent by the server, the encoded navigation video is forwarded to the vehicle through the Bluetooth communication connection between the mobile terminal and the vehicle.

8. The navigation screen projection method according to any one of claims 6-7, characterized in that: The method further comprises: When the vehicle displays the navigation video, sending an end navigation instruction to the server to cause the server to stop drawing the navigation image and / or stop generating the navigation video; and / or, After receiving the end navigation instruction sent by the vehicle, the end navigation instruction is forwarded to the server, so that the server stops drawing the navigation image and / or stops generating the navigation video.

9. The navigation screen projection method according to any one of claims 6-7, characterized in that: The method further comprises: After receiving the navigation route information, the mobile terminal extracts information from the navigation route information and generates a navigation instruction; or receives the navigation instruction generated by the server after extracting information from the navigation route information; The navigation instruction is sent to the vehicle, so that the vehicle displays the navigation video and / or a simple navigation image corresponding to the navigation instruction.

10. A navigation screen projection method, characterized in that: The method is applicable to a vehicle, wherein the vehicle is an electric two-wheeled vehicle, and the method comprises: Receive the encoded navigation video forwarded by the mobile terminal; the encoded navigation video is generated by the server after receiving the navigation start instruction sent by the mobile terminal, and the setting application in the server draws a navigation image on the server according to the navigation route information sent by the mobile terminal and the real-time positioning position of the mobile terminal, and after generating the navigation video according to the navigation image, the navigation video is encoded according to the audio and video encoding and decoding parameters of the vehicle and then sent to the mobile terminal; the navigation route information is generated by the mobile terminal after receiving the user's navigation start instruction and sending the user-input destination information and the current positioning position of the mobile terminal to the setting application interface, and the setting application interface sends the destination information and the current positioning position to a third party of the map, and returns the navigation route information between the destination and the current positioning position fed back by the third party to the mobile terminal; the navigation route information includes: pictures, text; the mobile terminal and the vehicle are connected via Bluetooth communication; The encoded navigation video forwarded by the mobile terminal is decoded, and the navigation video is displayed on a display screen of the vehicle.

11. The navigation screen projection method according to claim 10, characterized in that: The receiving of the encoded navigation video forwarded by the mobile terminal includes: Receiving the navigation video forwarded by the mobile terminal and encoded by the server according to the MPEG protocol and the audio and video codec parameters of the vehicle; The decoding of the encoded navigation video forwarded by the mobile terminal includes: The encoded navigation video sent by the mobile terminal is decoded according to the MPEG protocol.

12. The navigation screen projection method according to claim 10 or 11, characterized in that: The method further comprises: receiving a navigation instruction sent by the mobile terminal; the navigation instruction is extracted by the mobile terminal from the navigation route information; A corresponding simple navigation image is selected on the vehicle according to the navigation instruction, and the simple navigation image and / or the navigation video is displayed.

13. A mobile device, characterized in that: The method comprises a processor and a memory, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the method according to any one of claims 1 to 5.

14. A server, characterized in that: The method comprises a processor and a memory, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the method according to any one of claims 6 to 9.

15. An electric two-wheeled vehicle, characterized in that: The method comprises a control module and a memory, wherein a computer program is stored in the memory, and when the computer program is executed by the control module, the control module executes the method according to any one of claims 10 to 12.

16. A computer-readable storage medium, characterized in that Used to store a computer program, wherein the computer program causes a computer to execute the method according to any one of claims 1 to 12.

Images