Vehicle-mounted device assisted reversing method, device, apparatus and medium

Abstract

The application relates to the technical field of vehicle-mounted equipment and discloses a vehicle-mounted equipment assisted reversing method, device, equipment and medium, which comprises the following steps: detecting a reversing signal of a vehicle; acquiring a trajectory line picture resource according to the reversing signal, and generating a corresponding dynamic trajectory line through layer superposition according to the trajectory line picture resource; and sending the dynamic trajectory line to a preset vehicle-mounted equipment for reversing page display, so as to assist the vehicle in reversing. According to the application, the corresponding trajectory line picture resource is loaded according to the reversing signal to perform layer superposition, the dynamic trajectory line is generated according to the reversing, the dynamic trajectory line is displayed on the reversing page through the vehicle-mounted equipment, the user is assisted in reversing the vehicle, the display effect of the influence of the vehicle on real-time reversing is optimized through the dynamic trajectory line, the accuracy of real-time reversing in the reversing interface is improved, and the convenience of the user in reversing through the vehicle-mounted equipment is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of vehicle-mounted equipment, and particularly relates to a vehicle-mounted equipment assisted reversing method, device, equipment and medium. BACKGROUND

[0002] With the development of automobile electronic information, the infotainment system and the cockpit domain system are becoming larger and larger, and the larger and larger vehicle-mounted system carries more system functions. Therefore, the existing vehicle-mounted equipment has problems such as slow entering of a system interface at startup and poor playing effect of audio and video played through the system. Therefore, the method for assisting vehicle reversing through the vehicle-mounted equipment has poor display effect of real-time reversing image and low accuracy, which reduces the convenience of the user using the vehicle-mounted equipment to assist reversing. SUMMARY

[0003] The main purpose of the present application is to provide a vehicle-mounted equipment assisted reversing method, device, equipment and medium, which aims to improve the convenience of the user using the vehicle-mounted equipment to assist reversing.

[0004] To achieve the above purpose, the present application provides a vehicle-mounted equipment assisted reversing method, which is applied to an M4 core of a vehicle-mounted system. The method comprises the following steps:

[0005] detecting a reversing signal of a vehicle;

[0006] According to the reversing signal, a trajectory line picture resource is obtained, and a corresponding dynamic trajectory line is generated through layer superposition according to the trajectory line picture resource.

[0007] The dynamic trajectory line is sent to a preset vehicle-mounted equipment for reversing page display to assist the vehicle in reversing.

[0008] Preferably, the step of obtaining the trajectory line picture resource according to the reversing signal and generating the corresponding dynamic trajectory line through layer superposition according to the trajectory line picture resource comprises the following steps:

[0009] According to the reversing signal, a preset camera is started to obtain a corresponding reversing image, and a trajectory line picture resource of a preset partition is read;

[0010] The trajectory line picture is decoded by JPEG to obtain a dynamic trajectory line effect;

[0011] The dynamic trajectory line effect, a radar icon corresponding to the reversing image and the trajectory line picture resource, and a reversing trajectory line are superimposed to generate a corresponding reversing view picture.

[0012] Preferably, in the process of sending the dynamic trajectory line to the preset vehicle-mounted equipment for reversing page display to assist the vehicle in reversing, the method further comprises the following steps:

[0013] receiving radar data detected by a serial peripheral interface (SPI);

[0014] analyzing validity of the radar data to determine a broadcasting demand of an alarm of the vehicle;

[0015] according to the broadcasting demand, broadcasting a corresponding frequency tone according to a preset alarm frequency.

[0016] Preferably, after the step of sending the dynamic trajectory line to a preset vehicle-mounted device for display on a reversing page to assist the vehicle in reversing, the method further comprises:

[0017] playing a video in a pre-played boot sound video in the background, muting an audio in the boot sound video, and switching the vehicle-mounted device to a reversing interface;

[0018] receiving registration information of an A core of the vehicle-mounted system;

[0019] detecting the reversing signal according to the registration information to determine whether the vehicle is in a reversing state;

[0020] if the vehicle is in the reversing state, sending a busy tone response to the A core;

[0021] if the vehicle is not in the reversing state, sending a reversing end response to the A core and releasing the occupied resources.

[0022] To achieve the above object, the application further provides a vehicle-mounted device assisted reversing method, which is also applied to an A core of a vehicle-mounted system, and the method comprises:

[0023] obtaining a boot signal of the vehicle;

[0024] reading a resource file at a preset position according to the boot signal and putting the resource file into a shared memory;

[0025] receiving a reversing signal detected by an M4 core of the vehicle-mounted system;

[0026] analyzing the resource file in the shared memory according to the reversing signal to obtain corresponding communication resources.

[0027] Preferably, after the step of analyzing the resource file in the shared memory according to the reversing signal to obtain corresponding communication resources, the method further comprises:

[0028] sending registration information to the M4 core of the vehicle-mounted system;

[0029] receive a response corresponding to the registration information, if the response is a reverse end response, then according to the communication resource, obtain the current playing animation frame number index number in the boot sound and video;

[0030] According to the animation frame number index number, calculate the corresponding music segment index number;

[0031] According to the music segment index number, play audio, and according to the animation frame number index, play video, to realize the synchronous playing of boot sound and video.

[0032] In addition, to achieve the above object, the embodiment of the application also provides a vehicle-mounted equipment assisted reversing device, which comprises:

[0033] The first signal detection module is used for detecting the reversing signal of the vehicle.

[0034] The dynamic trajectory line module is used for acquiring a trajectory line picture resource according to the reversing signal, and generating a corresponding dynamic trajectory line by layer superposition according to the trajectory line picture resource.

[0035] The assisted reversing module is used for sending the dynamic trajectory line to a preset vehicle-mounted equipment for reversing page display, so as to assist the vehicle in reversing.

[0036] In addition, to achieve the above object, the embodiment of the application also provides a vehicle-mounted equipment assisted reversing device, which further comprises:

[0037] The second signal detection module is used for acquiring the boot signal of the vehicle.

[0038] The file analysis module is used for reading a resource file in a preset position according to the boot signal, and putting the resource file into a shared memory.

[0039] The third detection module is used for receiving the reversing signal detected by the M4 core of the vehicle-mounted system.

[0040] The dual-core communication module is used for analyzing the resource file in the shared memory according to the reversing signal, to obtain a corresponding communication resource.

[0041] In addition, to achieve the above object, the embodiment of the application also provides a device, which comprises a memory, a processor, and a vehicle-mounted equipment assisted reversing program stored in the memory and capable of running on the processor, wherein the vehicle-mounted equipment assisted reversing program is executed by the processor to realize the steps of the vehicle-mounted equipment assisted reversing method.

[0042] In addition, to achieve the above object, the application further provides a medium, which is a computer readable storage medium, and the computer readable storage medium stores a vehicle-mounted device assisted reversing program, and the vehicle-mounted device assisted reversing program realizes the steps of the vehicle-mounted device assisted reversing method when executed by a processor.

[0043] The application provides a vehicle-mounted device assisted reversing method, device, equipment and medium, the vehicle-mounted device assisted reversing method comprises the following steps: detecting a reversing signal of a vehicle; acquiring a trajectory line picture resource according to the reversing signal, and generating a corresponding dynamic trajectory line by performing layer superposition according to the trajectory line picture resource; and sending the dynamic trajectory line to a preset vehicle-mounted device for reversing page display, so as to assist the vehicle in reversing. According to the application, the corresponding trajectory line picture resource is loaded according to the reversing signal to perform layer superposition, the dynamic trajectory line is generated according to the reversing, the dynamic trajectory line is displayed on the reversing page of the vehicle-mounted device, the user is assisted in reversing the vehicle, the display effect of the influence of the vehicle on real-time reversing is optimized by the dynamic trajectory line, the accuracy of real-time reversing in the reversing interface is improved, and the convenience of the user in reversing the vehicle by the vehicle-mounted device is improved. BRIEF DESCRIPTION OF DRAWINGS

[0044] Figure 1 The application provides a device structure schematic diagram of a hardware running environment related to an embodiment of the vehicle-mounted device assisted reversing method.

[0045] Figure 2 The application provides a system architecture schematic diagram of the vehicle-mounted device assisted reversing method.

[0046] Figure 3 The application provides a communication structure schematic diagram of the vehicle-mounted device assisted reversing method.

[0047] Figure 4 The application provides a flowchart of the first embodiment of the vehicle-mounted device assisted reversing method.

[0048] Figure 5 The application provides an exemplary specific schematic diagram of the vehicle-mounted device assisted reversing method in the second embodiment of the vehicle-mounted device assisted reversing method.

[0049] Figure 6 The application provides a flowchart of the second embodiment of the vehicle-mounted device assisted reversing method.

[0050] Figure 7 The application provides an exemplary specific flowchart of the radar receiving task in the second embodiment of the vehicle-mounted device assisted reversing method.

[0051] Figure 8 The application provides an exemplary specific flowchart of the radar broadcasting task in the second embodiment of the vehicle-mounted device assisted reversing method.

[0052] Figure 9 The flowchart of the third embodiment of the vehicle-mounted equipment assisted reversing method of the application is shown in the figure.

[0053] Figure 10 The specific flowchart of the third embodiment of the vehicle-mounted equipment assisted reversing method of the application is shown in the figure.

[0054] Figure 11 The timing diagram of the start-up music and the start-up animation of the third embodiment of the vehicle-mounted equipment assisted reversing method of the application is shown in the figure.

[0055] Figure 12 The functional module diagram of the vehicle-mounted equipment assisted reversing device of the vehicle-mounted equipment assisted reversing method of the application is shown in the figure.

[0056] The implementation, functional features and advantages of the application will be further described with reference to the embodiments and the accompanying drawings. DETAILED DESCRIPTION

[0057] It should be understood that the specific embodiments described herein are merely intended to explain the application, and are not intended to limit the application.

[0058] The main implementation of the vehicle-mounted equipment assisted reversing method of the application is as follows:

[0059] The vehicle-mounted system of the application comprises an M4 core and an A core, and the above-mentioned dual-core is used to realize the scheme of the vehicle-mounted system of the vehicle-mounted equipment for packing, storing, picture decoding, reversing track superimposition and audio-video playing synchronization of resource files of audio-video information, so as to reduce the load of the vehicle-mounted system in operation, improve the operation speed of the vehicle-mounted system in operation, shorten the time for the vehicle-mounted equipment to enter the system interface and optimize the experience of the user.

[0060] Explanation of the special terms of the application:

[0061] DSP (Digital Signal Processing) refers to a microprocessor specially designed for audio signal processing, and the DSP is basically a CPU optimized only for solving audio processing problems, and the DSP chip is an important part of audio hardware, which makes digital audio operation possible, and one or more DSPs exist in the circuit of a general audio device for audio signal processing.

[0062] DPU (Data Processing Unit) is a special processor constructed based on data.

[0063] Rpmsg: a communication mode for communication between the M4 core and the A core in the application through memory sharing.

[0064] M4 core: ARMCortexTM The M4 processor is the latest ARM-developed embedded processor, which is based on the M3 and has enhanced computational power, with the addition of floating point, DSP, and parallel computing, to meet the needs of the digital signal control market that requires a mix of efficient and easy-to-use control and signal processing functions. The combination of its efficient signal processing functions with the low power, low cost, and ease of use of the Cortex-M processor family aims to meet the emerging class of flexible solutions specifically targeting the motor control, automotive, power management, embedded audio, and industrial automation markets.

[0065] A core: ARM Cortex TM The A series of application processors provide a full range of solutions for devices hosting rich OS platforms and user applications, from ultra-low-cost mobile phones, smartphones, mobile computing platforms, digital TVs and set-top boxes to enterprise networking, printers and server solutions. The high-performance Cortex-A15, scalable Cortex-A9, market-proven Cortex-A8 processor and efficient Cortex-A7 and Cortex-A5 processors all share the same architecture, thus having full application compatibility, supporting traditional ARM, Thumb instruction sets and the newly added high-performance compact Thumb-2 instruction set.

[0066] SOC (System on Chip) is a chip integration of the core of an information system, which integrates key components of a system on a single chip. In a broad sense, SoC is a micro system. If the central processing unit (CPU) is the brain, then SoC is a system that includes the brain, heart, eyes, and hands. The academic community generally tends to define SoC as integrating a microprocessor, analog IP (Intellectual Property) core, digital IP core, and memory (or off-chip memory control interface) on a single chip, which is usually customer-specific or a standard product for specific purposes.

[0067] STR (Suspend to RAM) is a common term for standby or sleep.

[0068] Existing techniques for selecting sample data:

[0069] Existing solutions for reversing a vehicle through a vehicle-mounted device include: a solution that pre-powers the vehicle-mounted system to address the slow loading problem of the vehicle-mounted system, i.e., implementing hibernation (STR) of the vehicle-mounted system, a solution that uses a small core to start the boot animation and reverse the vehicle, a solution that implements fast reverse in uboot or kernel, and a solution that implements fast reverse in the Ramdisk after the kernel.

[0070] The existing technical means has the following problems:

[0071] 1) The hibernation of the vehicle-mounted system reduces the loading time of the vehicle-mounted system on resources, but increases the energy consumption of the vehicle;

[0072] 2) The scheme of starting the boot animation and running the reverse process through the small core has poor display effect of the animation effect and the reverse interface in the reverse process through the vehicle-mounted device.

[0073] Therefore, the present application provides a vehicle-mounted device assisted reverse method based on M4 and A dual-core, which realizes the resource file packaging, storage, picture decoding, reverse trajectory superposition and audio and video playback synchronization of the vehicle-mounted system in the vehicle-mounted device based on the dual-core, and generates the corresponding dynamic trajectory line through layer superposition of the reverse signal, reduces the load of the vehicle-mounted system, improves the running speed of the vehicle-mounted system during running, shortens the time of the vehicle-mounted device entering the system interface, reduces the energy consumption of the vehicle-mounted device during running, improves the display effect of the animation and the reverse interface of the vehicle-mounted device, and optimizes the user experience.

[0074] Specifically, referring to Figure 1 , Figure 1 The device structure diagram of the hardware running environment involved in the embodiment of the vehicle-mounted device assisted reverse method of the present application.

[0075] Referring to Figure 1 , the device can include a processor 1001 such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002. The communication bus 1002 is used to realize the connection and communication between the components. The user interface 1003 can include a display screen (Display), an input unit such as a keyboard (Keyboard), and an optional user interface 1003 can also include a standard wired interface, a wireless interface. The network interface 1004 can optionally include a standard wired interface, a wireless interface (such as a WI-FI interface). The memory 1005 can be a high-speed RAM memory, or a stable memory (non-volatile memory) such as a magnetic disk memory. The memory 1005 can also be an independent storage device from the aforementioned processor 1001.

[0076] The memory 1005 stores an operating system and a vehicle-mounted device assisted reverse program, and the vehicle-mounted device assisted reverse program is executed by the processor to realize the following steps:

[0077] detecting a reverse signal of the vehicle;

[0078] According to the reversing signal, a track line picture resource is acquired, and layer superposition is performed according to the track line picture resource to generate a corresponding dynamic track line;

[0079] The dynamic track line is sent to a preset vehicle-mounted device for reversing page display to assist the vehicle in reversing.

[0080] Further, when the vehicle-mounted device assistance reversing program in the memory 1005 is executed by the processor, the following steps are further implemented:

[0081] According to the reversing signal, a preset camera is started, a corresponding reversing image is acquired, and track line picture resources of a preset partition are read;

[0082] The track line picture is subjected to JPEG decoding to acquire a dynamic track line effect;

[0083] The dynamic track line effect, a radar icon corresponding to the reversing image and the track line picture resource, and a reversing track line are subjected to layer superposition to generate a corresponding reversing view screen.

[0084] Further, when the vehicle-mounted device assistance reversing program in the memory 1005 is executed by the processor, the following steps are further implemented:

[0085] Radar data detected by a serial peripheral interface (SPI) is received;

[0086] The radar data is subjected to validity analysis to determine a broadcast demand of the vehicle for an alarm;

[0087] According to the broadcast demand, a corresponding frequency of a prompt tone is broadcasted at a preset alarm frequency.

[0088] Further, when the vehicle-mounted device assistance reversing program in the memory 1005 is executed by the processor, the following steps are further implemented:

[0089] A video in a pre-broadcast startup sound video is played in the background, an audio of the startup sound video is played in mute, and the vehicle-mounted device is switched to a reversing interface;

[0090] Registration information of a preset A core of the vehicle-mounted system is received;

[0091] According to the registration information, the reversing signal is detected to determine whether the vehicle is in a reversing state;

[0092] If the vehicle is in the reversing state, a busy tone response is sent to the A core;

[0093] If the vehicle is not in the reversing state, a reversing end response is sent to the A core, and occupied resources are released.

[0094] Further, the vehicle-mounted device-assisted reversing program in the memory 1005 is further implemented with the following steps when executed by the processor:

[0095] Obtaining a boot-up signal of the vehicle;

[0096] According to the boot-up signal, reading a resource file of a preset position, and putting the resource file into a shared memory;

[0097] Receiving a reversing signal detected by the M4 core of the vehicle-mounted system;

[0098] According to the reversing signal, parsing the resource file in the shared memory to obtain a corresponding communication resource.

[0099] Further, the vehicle-mounted device-assisted reversing program in the memory 1005 is further implemented with the following steps when executed by the processor:

[0100] Sending registration information to the M4 core of the vehicle-mounted system;

[0101] Receiving a response corresponding to the registration information, and if the response is a reversing end response, obtaining an animation frame number index number currently played in the boot-up audio and video according to the communication resource;

[0102] According to the animation frame number index number, calculating a corresponding music segment index number;

[0103] According to the music segment index number, playing audio, and according to the animation frame number index, playing video, to realize synchronous playing of the boot-up audio and video.

[0104] In order to better understand the above technical solutions, exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0105] Referring to Figure 2 , Figure 2 The system architecture of the present embodiment is shown in the figure. Specifically, the vehicle-mounted system SOC in the present embodiment is connected with DSP, MCU, LCD and Camera for data connection.

[0106] Referring to Figure 3 , Figure 3FIG. 1 is a schematic diagram of a communication structure for realizing communication between an M4 core and an A core through an rpmsg in the embodiment. Specifically, the M4 core is a secure area, and includes an IPC driver, a control application, a customer application, a customer driver, a DUP driver, and an ISI driver. The A core is a non-secure area, and includes a customer application in a user space, a GPU library, and other user space applications, and corresponding IPC drivers, GPU drivers, and other drivers.

[0107] Based on the terminal device architecture but not limited to the above-mentioned architecture, the application proposes the vehicle-mounted device assisted reversing method embodiment.

[0108] Specifically, referring to Figure 4 , Figure 4 FIG. 1 is a schematic diagram of a communication structure for realizing communication between an M4 core and an A core through an rpmsg in the embodiment. Specifically, the M4 core is a secure area, and includes an IPC driver, a control application, a customer application, a customer driver, a DUP driver, and an ISI driver. The A core is a non-secure area, and includes a customer application in a user space, a GPU library, and other user space applications, and corresponding IPC drivers, GPU drivers, and other drivers.

[0109] Step S10, detecting a reversing signal of the vehicle;

[0110] It should be noted that in the embodiment, the related peripheral resources and memory resources are initialized after the vehicle is started, the partition related resources are read into the shared memory through the uboot, the reversing signal of the current vehicle is detected, and whether the vehicle is in the reversing state is determined through the reversing signal.

[0111] Illustratively, in the embodiment, when the vehicle is reversing, the radar system around the vehicle transmits a reversing signal to the M4 core of the vehicle-mounted system, and the M4 core controls the RTOS system to drive the display screen, the deserializer, the Camera, and the MCU in the vehicle-mounted device to realize the assistance of the vehicle-mounted device in reversing. Specifically, for example, the display screen of the vehicle-mounted device switches the page to a reversing page, and the Camera of the vehicle-mounted device acquires the reversing image information of the corresponding position for corresponding playing.

[0112] Step S20, acquiring a trajectory line picture resource according to the reversing signal, and generating a corresponding dynamic trajectory line through layer superposition according to the trajectory line picture resource;

[0113] Further, the step of acquiring the trajectory line picture resource according to the reversing signal, and generating the corresponding dynamic trajectory line through layer superposition according to the trajectory line picture resource includes:

[0114] According to the reversing signal, a preset camera is started, a corresponding reversing image is acquired, and the trajectory line picture resource of a preset partition is read;

[0115] JPEG decoding the trajectory picture to obtain a dynamic trajectory effect;

[0116] Superimposing the dynamic trajectory effect, the radar icon corresponding to the trajectory picture resource and the reverse trajectory to generate a corresponding reverse view screen.

[0117] It should be noted that in the present embodiment, after the uboot initializes the emmc, the resource files are read from the preset hsaemisc partition, and these resource files are written into the designated reserved memory. The M4 core inputs the resource files into the JPEG decode controller, and decodes the NXP self-defined format JPEG picture in a loop. The corresponding BUF is output after decoding, and is specified to the corresponding DPU display BUF to increase the animation display effect.

[0118] Further, the trajectory display principle and animation are the same, but the trajectory display needs to be displayed simultaneously with the camera data through dpu layer superposition, so the alpha of the trajectory picture needs to be set to full transparency except for the trajectory and the car model. The reverse image data can be transparent.

[0119] Step S30, the dynamic trajectory line is sent to the preset vehicle-mounted device for reverse page display to assist the vehicle in reversing.

[0120] It should be noted that in the present embodiment, the display screen of the vehicle-mounted device displays the page for reversing the vehicle, and the dynamic trajectory line is included in the reverse page to assist in reversing. The user controls the direction and speed of the vehicle through the dynamic trajectory line, which facilitates the user to more conveniently realize the vehicle reversing.

[0121] Reference Figure 5 , Figure 5 is an exemplary specific schematic diagram of the vehicle-mounted device assisting in reversing method of the present embodiment. Specifically, for example, the display of the vehicle-mounted device includes a page for controlling the view angle of the car, the surrounding environment of the vehicle driving, and the dynamic trajectory line of the vehicle driving.

[0122] The present application loads the corresponding trajectory picture resource for layer superposition according to the reverse signal, generates a dynamic trajectory line according to the reverse, displays the dynamic trajectory line on the reverse page of the vehicle-mounted device, assists the user in reversing the vehicle, optimizes the display effect of the real-time reversing of the vehicle through the dynamic trajectory line, improves the accuracy of the real-time reversing in the reverse interface, and improves the convenience of the user in reversing the vehicle through the vehicle-mounted device.

[0123] Further, based on the first embodiment of the vehicle-mounted device assisting in reversing method of the present application, a second embodiment of the vehicle-mounted device assisting in reversing method of the present application is proposed.

[0124] The second embodiment of the vehicle-mounted device-assisted reversing method differs from the first embodiment of the vehicle-mounted device-assisted reversing method in that, after the dynamic trajectory line is sent to the preset vehicle-mounted device for display on a reversing page to assist the vehicle in reversing in step S30, the method further includes a radar data-based alert prompting scheme, as described in detail below with reference to Figure 6 , and specifically includes the following steps.

[0125] In step S301, radar data detected by a serial peripheral interface (SPI) is received.

[0126] In step S302, the radar data is analyzed for validity to determine a broadcast demand for an alert for the vehicle.

[0127] In step S303, a corresponding frequency of a prompt tone is broadcast according to the broadcast demand and a preset alert frequency.

[0128] It should be noted that in this embodiment, the radar module includes two tasks, one being a radar data receiving task and the other being a radar alert tone processing task. The radar data is obtained from an MCU end via SPI. As soon as the body radar data changes, the SPI receives the corresponding latest radar data. The MCU end communicates with an M4 via SPI. When the radar and steering wheel angle data change, the data is synchronized to the M4 core. The M4 core obtains a frame of data (20 bytes) from the MCU end via SPI using a blocking method. The validity of the data is analyzed to determine the type of data packet, and different processing is performed according to the type of data packet.

[0129] It should be noted that in this embodiment, the radar alert includes long and short alert tones, and the short alert tone has different alert frequencies. The broadcast task is delayed according to the different frequencies to meet the frequency requirements.

[0130] Refer to Figure 7 , Figure 7 FIG. 1 is an exemplary specific schematic diagram of the radar receiving task in this embodiment. Specifically, for example, the radar data is received via SPI, and the validity of the radar data is determined. When the data is valid, the radar data is processed. When the data is invalid, the radar data is received again via SPI.

[0131] Refer to Figure 8 , Figure 8For the exemplary specific flow diagram of the radar announcement task of the embodiment, specifically, for example, according to the corresponding announcement demand identified according to different types of radar data, it is judged whether to announce according to the announcement demand, if not to announce, then it is judged again whether to announce after delaying 100 ms, and further it is judged whether to long sound, if it needs to long sound, then it is returned to the previous step to judge whether to play, if it does not need to long sound, then it directly plays a short sound, and the delay number N is calculated through frequency, after delaying N, further the radar announcement task is realized.

[0132] In the embodiment, through the radar receiving task and the announcement task, specifically, after the SPI receives data, the data validity is processed, the data validity is improved, when the radar is used for the announcement task, according to the data type, the announcement type is judged, the diversity of the radar announcement is increased, the association of the announcement type and various scenes is enhanced, and the convenience of the user for the radar announcement is improved.

[0133] Further, based on the first and second embodiments of the vehicle-mounted device assisted reversing method, the third embodiment of the vehicle-mounted device assisted reversing method is proposed.

[0134] The third embodiment of the vehicle-mounted device assisted reversing method is different from the first and second embodiments of the vehicle-mounted device assisted reversing method in that the embodiment is applied to the A core of the vehicle-mounted system, and data interaction is realized through the A core of the vehicle-mounted system and the M4 core of the vehicle-mounted system to realize the vehicle-mounted device assisted reversing method, and the first embodiment of the vehicle-mounted device assisted reversing method is referred to. Figure 9 , specifically including:

[0135] Step S101, acquiring the start signal of the vehicle;

[0136] It should be noted that in the embodiment, when the vehicle starts, the M4 core of the SOC system of the vehicle-mounted device acquires the start signal, and in the embodiment, the start signal of the SOC system of the vehicle-mounted device can be that the M4 core of the vehicle-mounted device acquires the start signal after the SOC system is powered on and connected to the power supply.

[0137] Step S102, reading a resource file at a preset position according to the start signal, and putting the resource file into a shared memory;

[0138] It should be noted that after the SOC is powered on, the Uboot and the FreeRtos system of the M4 are loaded from the eMMC, and after the Uboot initializes the memory and other key peripherals, the resource file stored in the kernel is loaded into the memory. In addition, in this stage, the A core of the SOC system also reads the resource file required by the M4 from the specified partition of the Emmc and puts it into the agreed shared memory for subsequent calling of the M4.

[0139] Further, after the kernel is loaded into the memory, the kernel will first enter the kernel boot stage, and at the end of the boot stage, start_kernel is called to enter the kernel startup stage. Start_kernel finally starts the init program of the user space, and the init program is responsible for parsing the init.rc configuration file and starting the system daemon.

[0140] Further, after the resource file in the preset position is parsed, the boot audio and the boot video to be played are obtained, and the boot audio and the boot video are played through the display module.

[0141] Step S103, receiving a reverse signal detected by the M4 core of the vehicle-mounted system;

[0142] It should be noted that in this embodiment, when the vehicle-mounted device of the vehicle is playing the boot audio and video, the M4 core obtains the reverse signal of the current vehicle, and the vehicle-mounted device of the vehicle needs to vacate the playing device to display the reverse page to assist the reversing.

[0143] Step S104, according to the reverse signal, parsing the resource file in the shared memory to obtain the corresponding communication resource.

[0144] Further, in the implementation process of steps S101 to S106, the method is also applied to the M4 core of the vehicle-mounted system, and data interaction is performed between the M4 core and the A core to realize the assisting reversing method of the vehicle-mounted device, and specifically includes:

[0145] Step S105, playing the video in the pre-played boot audio and video in the background, playing the audio of the boot audio and video in mute, and switching the vehicle-mounted device to the reverse interface;

[0146] It should be noted that in this embodiment, the SOC system of the vehicle-mounted device of the vehicle will play a boot audio and video after power-on, which reminds the user that the vehicle starts running. When the M4 core detects that the current vehicle is in the reversing state, the playing of the boot audio and video on the vehicle-mounted device needs to be paused, and the display screen of the vehicle-mounted device is switched to the reverse page. Therefore, in this embodiment, the display screen of the vehicle-mounted device is switched by playing the video of the boot audio and video in the background and playing the audio in mute.

[0147] Step S106, receiving the registration information of the preset A core of the vehicle-mounted system;

[0148] Step S107, according to the registration information, detecting the reverse signal to determine whether the vehicle is in the reversing state;

[0149] Step S108, if the vehicle is in the reversing state, a busy tone response is sent to the A core;

[0150] Step S109, if the vehicle is not in the reversing state, a reversing end response is sent to the A core, and the occupied resources are released.

[0151] It needs to be specifically pointed out that in the embodiment, after receiving the message that the A core android system starts, the M4 core needs to reply to the A core. If the M4 core animation is not played or is executing the reversing event at that time, the M4 core is in a busy state, and if it is in an idle state, the hardware resources occupied by itself are released first, and after the release is completed, an Rpmsg message is sent to the A core to inform the A core to load the hardware resource driver occupied in the M4 core stage, so as to complete the switching of the M4 core to the A core.

[0152] Further, in the implementation process of steps S107 to S109, the method is also applied to the A core of the vehicle-mounted system, and data interaction is realized between the A core of the vehicle-mounted system and the M4 core of the vehicle-mounted system, so as to realize the assisted reversing method of the vehicle-mounted device, specifically including:

[0153] Step S110, registration information is sent to the M4 core of the vehicle-mounted system;

[0154] Step S111, a response corresponding to the registration information is received, if the response is a reversing end response, the current animation frame number index number is obtained according to the communication resource;

[0155] Step S112, the corresponding music segment index number is calculated according to the animation frame number index number;

[0156] Step S113, audio is played according to the music segment index number, and video is played according to the animation frame number index, so as to realize the synchronous playing of the boot sound and video.

[0157] Reference Figure 10 , Figure 10 is a specific flowchart of the embodiment. Specifically, the embodiment determines whether the current vehicle is in the reversing state through the M4 core, if it is in the reversing state, the reversing is taken as the main task, if not, the animation playing is taken as the main task, when the vehicle is not in the reversing state and the animation playing is completed and displayed, the resources are released to the A core for use.

[0158] Reference Figure 11 , Figure 11The timing diagram of the synchronization of the boot-up music and the boot-up animation of the present embodiment is shown in the figure. When the reverse page occupies the display device of the vehicle-mounted page, the corresponding animation frame number index is calculated by calculating the music segment index number of the boot-up animation music, and the music and the animation of the boot-up animation are played synchronously in timing according to the animation frame number index and the music segment index number.

[0159] It should be noted that the driving of the DSP is realized by the RTOS; the video part is realized by the picture decoding part, and the audio data is in the wav format and is packed in the hsaemisc partition, each audio file is placed in a block of a resource file, and the corresponding wav audio file can be found through the tag name of the block. The music file is segmented, and each segment is corresponded to a frame of the boot-up animation. When the animation is played again, only the animation frame number index to be played currently is acquired, and then the music segment index number is calculated, and the music is played from the position of the music segment index number.

[0160] The quick reverse mode can be cut in at any time during the boot-up animation process, and the requirement is that the boot-up animation in the quick reverse mode is equivalent to being played in the background. After the boot-up music is added, the boot-up music needs to be synchronized with the boot-up animation. It is equivalent to that the boot-up music also needs to be played silently in the background. The present solution is that the music file is segmented, and each segment is corresponded to a frame of the boot-up animation. When the animation is played again, only the animation frame number index to be played currently is acquired, and then the music segment index number is calculated, and the music is played from the position of the music segment index number.

[0161] The present embodiment is a method for assisting reverse driving of a vehicle-mounted device based on M4 and A dual cores. The resource file packing, storage, picture decoding, reverse trajectory superposition, and audio and video playback synchronization of the vehicle-mounted system of the vehicle-mounted device are realized based on the dual cores, and the corresponding dynamic trajectory line is generated through layer superposition of the reverse signal, thereby reducing the load of the vehicle-mounted system in operation, improving the running speed of the vehicle-mounted system in operation, shortening the time for the vehicle-mounted device to enter the system interface, reducing the energy consumption of the vehicle-mounted device in operation, improving the display effect of the vehicle-mounted device in displaying the animation and the reverse interface, and optimizing the experience of the user.

[0162] In addition, the present embodiment also provides a vehicle-mounted device for assisting reverse driving. Figure 12 , Figure 12 The present embodiment relates to a vehicle-mounted device for assisting reverse driving. As shown in Figure 12 ,

[0163] The first signal detection module 10 is configured to detect the reverse signal of the vehicle.

[0164] a dynamic trajectory line module 20 configured to acquire a trajectory line picture resource according to the reversing signal, and perform layer superposition according to the trajectory line picture resource to generate a corresponding dynamic trajectory line;

[0165] an assisting reversing module 30 configured to send the dynamic trajectory line to a preset vehicle-mounted device to display a reversing page to assist the vehicle to reverse.

[0166] Optionally, the vehicle-mounted device assisting reversing apparatus further comprises:

[0167] a second signal detection module 40 configured to acquire a starting signal of the vehicle;

[0168] a file analysis module 50 configured to analyze a resource file at a preset position according to the starting signal to play a corresponding starting audio and video through the vehicle-mounted device;

[0169] a third detection module 60 configured to receive a reversing signal detected by an M4 core of the vehicle-mounted system;

[0170] a background playing module 70 configured to perform background playing of a video in the starting audio and video based on the reversing signal, and perform mute playing of an audio in the starting audio and video;

[0171] an interface switching module 80 configured to switch the vehicle-mounted device to a reversing interface.

[0172] The principle and implementation process of the vehicle-mounted device assisting reversing method are achieved in the embodiment, and details are not described herein again.

[0173] In addition, the embodiment of the present application also proposes a device, which comprises a memory, a processor, and a vehicle-mounted device assisting reversing program stored in the memory and executable on the processor, and the vehicle-mounted device assisting reversing program implements the steps of the vehicle-mounted device assisting reversing method according to the above embodiments when executed by the processor.

[0174] In addition, in order to achieve the above-mentioned purpose, the present application also provides a medium, which is a computer readable storage medium, and the computer readable storage medium stores a vehicle-mounted device assisting reversing program, and the vehicle-mounted device assisting reversing program implements the steps of the vehicle-mounted device assisting reversing method when executed by a processor.

[0175] Since the vehicle-mounted device assisting reversing program is executed by the processor, all the technical solutions of the above-mentioned all embodiments are adopted, and at least all the beneficial effects brought by all the technical solutions of the above-mentioned all embodiments are achieved, and details are not described herein again.

[0176] It should be noted that, in this document, the terms "comprises", "comprising", or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element preceded by "comprises... a" does not, without more constraints, foreclose the existence of additional identical elements in the process, method, article, or apparatus that comprises the recited element.

[0177] The above-mentioned embodiment numbers of the present application are only for description, and do not represent the advantages and disadvantages of the embodiments.

[0178] From the above description of the embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be realized by means of software and the necessary general hardware platform, of course, they can also be realized by hardware, but in many cases the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a software product, which is stored in a storage medium (such as a ROM / RAM, a magnetic disk, or an optical disk) as described above, and includes a number of instructions for making a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) execute the methods described in the various embodiments of the present application.

[0179] The above is only the preferred embodiment of the present application, and does not limit the patent scope of the present application, and any equivalent structure or equivalent process transformation, or direct or indirect application in other related technical fields, which is made by using the content of the specification and drawings of the present application, is also included in the patent protection scope of the present application.

Claims

1. A method for assisting a driver in reversing a vehicle, the method comprising: The vehicle-mounted device-assisted reversing method is applied to an M4 core of a vehicle-mounted system, and the method comprises the following steps: detecting a reversing signal of a vehicle; acquiring a trajectory line picture resource according to the reversing signal, and generating a corresponding dynamic trajectory line through layer superposition according to the trajectory line picture resource; sending the dynamic trajectory line to a preset vehicle-mounted device for reversing page display to assist the vehicle in reversing; playing a video in a pre-played boot sound video in the background, muting the audio of the boot sound video, and switching the vehicle-mounted device to a reversing interface; receiving registration information of an A core of the vehicle-mounted system; wherein the M4 core and the A core communicate through rpmsg; detecting the reversing signal according to the registration information, and determining whether the vehicle is in a reversing state; if the vehicle is in the reversing state, sending a busy tone response to the A core; if the vehicle is not in the reversing state, sending a reversing end response to the A core, and releasing the occupied resources.

2. The vehicle equipment-assisted backing method of claim 1, wherein, The step of acquiring the trajectory line picture resource according to the reversing signal, and generating the corresponding dynamic trajectory line through layer superposition according to the trajectory line picture resource comprises the following steps: starting a preset camera according to the reversing signal, acquiring a corresponding reversing image, and reading trajectory line picture resources of a preset partition; JPEG decoding the trajectory line picture to acquire a dynamic trajectory line effect; performing layer superposition on the dynamic trajectory line effect, the reversing image, a radar icon corresponding to the trajectory line picture resource, and a reversing trajectory line to generate a corresponding reversing view picture.

3. The vehicle equipment-assisted backing-up method according to claim 2, wherein In the process of sending the dynamic trajectory line to the preset vehicle-mounted device for reversing page display to assist the vehicle in reversing, the method further comprises the following steps: receiving radar data detected by a serial peripheral interface (SPI); performing validity analysis on the radar data to determine a broadcast demand of the vehicle for an alarm; according to the broadcast demand, broadcasting a prompt tone at a corresponding frequency according to a preset alarm frequency.

4. The method of claim 1, wherein, The vehicle-mounted device-assisted reversing method is also applied to an A core of a vehicle-mounted system, and the method comprises the following steps: acquiring a boot signal of a vehicle; reading a resource file at a preset position according to the boot signal, and placing the resource file in a shared memory; receiving a reversing signal detected by an M4 core of the vehicle-mounted system; analyzing the resource file in the shared memory according to the reversing signal to obtain corresponding communication resources.

5. The vehicle equipment-assisted backing-up method according to claim 4, wherein After the step of analyzing the resource file in the shared memory according to the reversing signal to obtain the corresponding communication resources, the method further comprises the following steps: sending registration information to the M4 core of the vehicle-mounted system; receiving a response corresponding to the registration information, and if the response is a reversing end response, acquiring an animation frame number index number currently played in the boot sound video according to the communication resources; calculating a corresponding music segment index number according to the animation frame number index number; playing audio according to the music segment index number, and playing video according to the animation frame number index to realize synchronous playing of the boot sound video.

6. A device for assisting in reversing a vehicle, characterized in that The vehicle-mounted device-assisted reversing device comprises: a first signal detection module configured to detect a reversing signal of a vehicle; The dynamic trajectory line module is configured to acquire a trajectory line picture resource according to the reversing signal, and perform layer superposition according to the trajectory line picture resource to generate a corresponding dynamic trajectory line. The assisting reversing module is configured to send the dynamic trajectory line to a preset vehicle-mounted device to display a reversing page, so as to assist the vehicle in reversing. The assisting reversing module is further configured to play a video in a pre-played startup sound video in the background, mute an audio in the startup sound video, and switch the vehicle-mounted device to a reversing interface; receive registration information of an A core of a vehicle-mounted system; the M4 core and the A core communicate through rpmsg; detect the reversing signal according to the registration information, and determine whether the vehicle is in a reversing state; if the vehicle is in the reversing state, send a busy tone response to the A core; if the vehicle is not in the reversing state, send a reversing end response to the A core, and release the occupied resources.

7. The device according to claim 6, wherein the device is a car navigation system. The vehicle-mounted device assisting reversing apparatus further includes: A second signal detection module is configured to acquire a vehicle startup signal. A file analysis module is configured to read a resource file in a preset position according to the startup signal, and put the resource file into a shared memory. A third detection module is configured to receive a reversing signal detected by an M4 core of a vehicle-mounted system. A dual-core communication module is configured to analyze the resource file in the shared memory according to the reversing signal to obtain corresponding communication resources.

8. An apparatus, comprising: The device includes a memory, a processor, and a vehicle-mounted device assisting reversing program stored on the memory and executable on the processor, and the vehicle-mounted device assisting reversing program, when executed by the processor, implements the vehicle-mounted device assisting reversing method in any one of claims 1 to 5.

9. A medium, the medium being a computer-readable storage medium, characterized in that, The computer readable storage medium stores a vehicle-mounted device assisting reversing program, and the vehicle-mounted device assisting reversing program, when executed by the processor, implements the steps of the vehicle-mounted device assisting reversing method in any one of claims 1 to 5.

Images