Vehicle end image transmission method and device, equipment and storage medium

Abstract

The invention discloses a vehicle end image transmission method and device, equipment and a storage medium, relates to the technical field of data processing, and discloses the following steps: when a vehicle end completes local area network authorization, constructing a local area network between the vehicle end and a terminal application based on a preset protocol; sending the vehicle end identity information to the terminal application based on the local area network, so that the terminal application performs verification according to the vehicle end information and feeds back a verification result; receiving a verification result, and when the verification result is successful verification, obtaining target audio and video information based on the image acquisition request of the terminal application; sending the target audio and video information to a terminal application; according to the method, the local area network is constructed after authorization of the vehicle end and the terminal, the terminal verifies the identity information of the vehicle end based on the local area network, the image required by the terminal application is transmitted to the terminal application, bidirectional data sending and receiving of the vehicle end and the terminal are achieved, the transmission speed is high, the data stability is high, the mode that a user acquires the image of the vehicle end is simplified, and the user experience is improved. And the entertainment experience of the user in the vehicle using process is improved.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a vehicle-side image transmission method, device, equipment and storage medium. Background Art

[0002] With the development of automobile intelligence, the relationship between automobiles and users is getting closer and closer. Users can complete more entertaining and convenient functions while driving the car, and the car can also realize functions such as taking pictures and recording videos. The present invention proposes a method for automatically transmitting images (including pictures, videos, etc.) on the vehicle to the user's mobile phone on the vehicle terminal. The user establishes a WIFI hotspot connection with the vehicle terminal through the mobile phone to form a local area network, which can realize image transmission, or when the vehicle meets certain trigger conditions, the video or picture stored on the vehicle terminal is automatically transferred to the mobile phone terminal for storage, so that the user can store, view or re-edit the images taken on the vehicle.

[0003] There are two main image transmission solutions currently used by most vehicles on the market. One requires users to use an external USB storage device to copy it to a computer device for reading or other operations. Users need to rely on the computer device to obtain the image, which is extremely inconvenient. The other method is to establish a Bluetooth connection between the mobile phone and the vehicle terminal. Due to the limitation of Bluetooth transmission bandwidth, the transmission speed is slow. When transmitting large pictures and video files, users have to wait for a long time, and the user experience is poor.

[0004] The above contents are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above contents are prior art. Summary of the invention

[0005] The main purpose of this application is to provide a vehicle-side image transmission method, device, equipment and storage medium, aiming to solve the technical problem that the current method for users to obtain audio and video data on the vehicle side is very cumbersome and the user experience is poor.

[0006] To achieve the above objectives, the present application proposes a vehicle-side image transmission method, the vehicle-side image transmission method comprising:

[0007] When the LAN authorization is completed on the vehicle side, a LAN is built between the vehicle side and the terminal application based on the preset protocol;

[0008] Sending the vehicle-side identity information to the terminal application based on the local area network, so that the terminal application performs verification according to the vehicle-side information and feeds back the verification result;

[0009] receiving the verification result, and obtaining target audio and video information based on an image acquisition request of a terminal application when the verification result is successful;

[0010] Send the target audio and video information to the terminal application.

[0011] In one embodiment, the receiving of the verification result, when the verification result is successful, obtaining the target audio and video information based on the image acquisition request of the terminal application, includes:

[0012] receiving the verification result, and determining reference video and audio information based on an image acquisition request of a terminal application when the verification result is successful;

[0013] In response to the desensitization signal input by the user, the reference audio and video information is desensitized to obtain the target audio and video information.

[0014] In one embodiment, in response to the desensitization signal input by the user, desensitizing the reference video information to obtain the target video information includes:

[0015] In response to the desensitization signal input by the user, the reference audio and video information is subjected to image distortion correction and image decoding processing to obtain an image to be detected;

[0016] Performing sensitive information detection on the image to be detected to obtain a sensitive area;

[0017] The sensitive area of ​​the image to be detected is erased to obtain the image to be decoded, and the image to be decoded is encoded to obtain target audio and video information.

[0018] In one embodiment, the step of performing sensitive information detection on the image to be detected to obtain a sensitive area includes:

[0019] Performing vehicle body detection, license plate detection and face detection on the image to be detected to obtain a detection result;

[0020] Based on the detection results, license plate tracking and face tracking are performed to obtain sensitive areas.

[0021] In one embodiment, after building a local area network between the vehicle end and the terminal application based on a preset protocol when the vehicle is started, the method further includes:

[0022] Monitor the real-time status of the vehicle collision monitoring unit and the vehicle emergency brake monitoring unit;

[0023] Obtaining a vehicle-side emergency signal based on the real-time status, and obtaining current audio and video information based on the vehicle-side emergency signal;

[0024] Send an acquisition signal to the cloud, so that the cloud sends the acquisition signal to the terminal application, so that the terminal application acquires the current audio and video information according to the acquisition signal.

[0025] In one embodiment, obtaining a vehicle-side emergency signal based on the real-time status, and obtaining current audio and video information based on the vehicle-side emergency signal include:

[0026] Obtaining a vehicle-side emergency signal based on the real-time status;

[0027] Obtaining a reference time according to the vehicle-side emergency signal, and performing video acquisition based on the reference time to obtain a reference video;

[0028] The reference time and the reference video are used as current audio and video information.

[0029] In one embodiment, when the vehicle end completes the local area network authorization, before building the local area network between the vehicle end and the terminal application based on the preset protocol, it also includes:

[0030] When the user enters the vehicle-side photo album application for the first time, an authorization reminder is generated to obtain a reference signal input by the user based on the authorization reminder;

[0031] When the reference signal indicates that authorization is allowed, the automatic connection to the local area network permission and the automatic acquisition of audio and video information permission are obtained to complete the local area network authorization.

[0032] In addition, to achieve the above-mentioned purpose, the present application also proposes a vehicle-side image transmission device, the vehicle-side image transmission device comprising:

[0033] The LAN connection module is used to build a LAN between the vehicle and the terminal application based on a preset protocol when the vehicle completes the LAN authorization;

[0034] An identity authentication module, used for sending the vehicle-side identity information to the terminal application based on the local area network, so that the terminal application performs verification according to the vehicle-side information and feeds back the verification result;

[0035] An image transmission module, used to receive the verification result, and when the verification result is successful, obtain the target audio and video information based on the image acquisition request of the terminal application;

[0036] The image transmission module is also used to send the target audio and video information to the terminal application.

[0037] In addition, to achieve the above-mentioned purpose, the present application also proposes a vehicle-side image transmission device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, and the computer program is configured to implement the steps of the vehicle-side image transmission method described above.

[0038] In addition, to achieve the above-mentioned purpose, the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by the processor, the steps of the vehicle-side image transmission method described above are implemented.

[0039] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, it implements the steps of the vehicle-side image transmission method described above.

[0040] One or more technical solutions proposed in this application have at least the following technical effects:

[0041] After authorization by the vehicle and the terminal, a local area network is built based on the two. After the terminal verifies the identity information of the vehicle based on the local area network, the image required by the terminal application is transmitted to the terminal application, realizing two-way data sending and receiving between the vehicle and the terminal. The transmission speed is fast and the data stability is high. It simplifies the way users collect images from the vehicle and improves the entertainment experience of users when using the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0043] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0044] Figure 1 A schematic diagram of a process flow provided for the first embodiment of the vehicle-side image transmission method of the present application;

[0045] Figure 2 A schematic diagram of the automatic triggering process of image transmission in an emergency situation provided in the first embodiment of the vehicle-side image transmission method of the present application;

[0046] Figure 3 A schematic diagram of the image transmission process between the vehicle side and the mobile phone side provided in the first embodiment of the vehicle side image transmission method of the present application;

[0047] Figure 4 A flow chart of the second embodiment of the vehicle-side image transmission method of the present application;

[0048] Figure 5 A schematic diagram of an image desensitization processing flow provided for the second embodiment of the vehicle-side image transmission method of the present application;

[0049] Figure 6 This is a schematic diagram of the module structure of the vehicle-side image transmission device according to an embodiment of the present application;

[0050] Figure 7 This is a schematic diagram of the device structure of the hardware operating environment involved in the vehicle-side image transmission method in the embodiment of the present application. DETAILED DESCRIPTION

[0051] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0052] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0053] The main solution of the embodiment of the present application is: when the LAN authorization is completed on the vehicle side, a LAN is constructed between the vehicle side and the terminal application based on a preset protocol; the vehicle side identity information is sent to the terminal application based on the LAN, so that the terminal application performs verification based on the vehicle side information and feeds back the verification result; the verification result is received, and when the verification result is successful, the target audio and video information is obtained based on the image acquisition request of the terminal application; and the target audio and video information is sent to the terminal application.

[0054] In this embodiment, for ease of description, the following description is made by taking the identification of the vehicle-side image transmission device as the execution subject.

[0055] With the development of automobile intelligence, the relationship between automobiles and users is getting closer and closer. Users can complete more entertaining and convenient functions while driving the car, and the car can also realize functions such as taking pictures and recording videos. The present invention proposes a method for automatically transmitting images (including pictures, videos, etc.) on the vehicle to the user's mobile phone on the vehicle terminal. The user establishes a WIFI hotspot connection with the vehicle terminal through the mobile phone to form a local area network, which can realize image transmission, or when the vehicle meets certain trigger conditions, the video or picture stored on the vehicle terminal is automatically transferred to the mobile phone terminal for storage, so that the user can store, view or re-edit the images taken on the vehicle.

[0056] There are two main image transmission solutions currently used by most vehicles on the market. One requires users to use an external USB storage device to copy it to a computer device for reading or other operations. Users need to rely on the computer device to obtain the image, which is extremely inconvenient. The other method is to establish a Bluetooth connection between the mobile phone and the vehicle terminal. Due to the limitation of Bluetooth transmission bandwidth, the transmission speed is slow. When transmitting large pictures and video files, users have to wait for a long time, and the user experience is poor.

[0057] The present application provides a solution, which builds a local area network based on the authorization of the vehicle and the terminal, and after the terminal verifies the identity information of the vehicle based on the local area network, transmits the image required by the terminal application to the terminal application, thereby realizing two-way data sending and receiving between the vehicle and the terminal, with fast transmission speed and high data stability, simplifying the way users acquire images from the vehicle, and improving the entertainment experience of users when using the vehicle.

[0058] It can be seen from the above embodiments that the present application discloses a vehicle-side image transmission method, device, equipment and storage medium, which relates to the field of data processing technology, and discloses: when the vehicle-side completes the LAN authorization, a LAN is constructed between the vehicle-side and the terminal application based on a preset protocol; the vehicle-side identity information is sent to the terminal application based on the LAN, so that the terminal application verifies according to the vehicle-side information, and feeds back the verification result; the verification result is received, and when the verification result is successful, the target audio and video information is obtained based on the image acquisition request of the terminal application; the target audio and video information is sent to the terminal application; after the method is authorized by the vehicle-side and the terminal, a LAN is constructed based on the two, and after the terminal verifies the identity information of the vehicle-side based on the LAN, the image required by the terminal application is transmitted to the terminal application, so as to realize two-way data sending and receiving between the vehicle-side and the terminal, with fast transmission speed and high data stability, simplifying the user's way of acquiring images on the vehicle-side, and improving the user's entertainment experience during the use of the vehicle.

[0059] It should be noted that the execution subject of this embodiment may be a computing service device with data processing, network communication and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an electronic device capable of realizing the above functions, a vehicle-side image transmission device, etc. The following takes the vehicle-side image transmission device as an example to illustrate this embodiment and the following embodiments.

[0060] Based on this, the embodiment of the present application provides a vehicle-side image transmission method, referring to Figure 1 , Figure 1 This is a flow chart of the first embodiment of the vehicle-side image transmission method of the present application.

[0061] In this embodiment, the vehicle-side image transmission method includes steps S10 to S40:

[0062] Step S10, when the vehicle side completes the LAN authorization, a LAN is constructed between the vehicle side and the terminal application based on a preset protocol.

[0063] It should be noted that when the vehicle completes the LAN authorization, the terminal application also needs to complete the LAN authorization before the LAN between the vehicle and the terminal application can be built based on the preset protocol.

[0064] It is understandable that when the user authorizes for the first time, the mobile phone and the car computer establish a local area network by connecting to a WIFI hotspot. The preset protocol can be a WebSocket protocol designed in advance. After the car computer is started or the mobile phone is turned on, this service protocol is loaded. After establishing a connection once, the connection can be maintained, which improves communication efficiency. This protocol is a protocol that can perform full-duplex communication after connection, and has stronger real-time performance. Effectively ensure data security and stability.

[0065] It should be noted that when the LAN authorization is completed on the vehicle side, before the LAN between the vehicle side and the terminal application is constructed based on the preset protocol, it also includes: when the user enters the vehicle-side album application for the first time, an authorization reminder is generated to obtain a reference signal input by the user based on the authorization reminder; when the reference signal allows authorization, the permission to automatically connect to the LAN and the permission to automatically obtain audio and video information are obtained to complete the LAN authorization.

[0066] It should be noted that the reference signal may be authorization-permitting or unauthorized. If the user does not authorize, the local area network cannot be established.

[0067] It should be emphasized that after purchasing a vehicle, the user will download and install a mobile application of this brand (referred to as the vehicle brand APP) on the mobile phone. By uploading the purchase record and filling in the identity information, an account bound to this vehicle identification number (VIN code) is formed. The user can log in to this account on the vehicle brand APP on the mobile phone, and the user can remotely control the vehicle, check the vehicle status and obtain the vehicle album files.

[0068] It should be further explained that when a user enters the photo album application on the vehicle or mobile phone for the first time, a pop-up window will be displayed to guide the user to authorize functions, including automatic image transmission and automatic connection to wifi hotspots, and to connect to wifi hotspots for the first time. This function can be used after the user authorizes it.

[0069] Among them, it should be noted that the vehicle LAN authorization is confirmed every time the vehicle is started to avoid failure to authorize due to vehicle system updates or other reasons. If the authorization is not completed, the user can be reminded to re-authorize.

[0070] It should be understood that after connecting to the wifi hotspot, the photo album APP on the vehicle and the vehicle brand APP on the mobile phone form a specific network transmission protocol.

[0071] In a feasible implementation manner, step S10 may include steps A101 to A103:

[0072] Step A101, monitoring the real-time status of the vehicle collision monitoring unit and the vehicle emergency brake monitoring unit.

[0073] It is understandable that the real-time status of the vehicle collision monitoring unit may include status 0 and status 1, where status 0 indicates that the vehicle is driving normally and status 1 indicates that the vehicle has collided; the real-time status of the vehicle emergency braking monitoring unit may include status 0 and status 1, and similarly, status 0 indicates that the vehicle is driving normally and status 1 indicates that the vehicle has emergency braking.

[0074] Step A102, obtaining a vehicle-side emergency signal based on the real-time status, and obtaining current audio and video information based on the vehicle-side emergency signal.

[0075] It should be understood that obtaining the vehicle-side emergency signal based on the real-time status may be generating the vehicle-side emergency signal when the real-time status of either the vehicle collision monitoring unit or the vehicle emergency braking monitoring unit is 1.

[0076] It should be noted that a reference time is obtained according to the vehicle-side emergency signal, and video is captured based on the reference time to obtain a reference video; the reference time and the reference video are used as the current audio and video information.

[0077] It is understandable that when the vehicle-side emergency signal is generated, the time when the emergency signal is generated is saved and used as the reference time.

[0078] It should be noted that when a vehicle-side emergency signal is generated, the vehicle's driving recorder is triggered to record video based on the vehicle-side emergency signal, the recorded video is saved locally and the video and reference time are sent to the cloud for video backup.

[0079] In the specific implementation, after the user's authorization, the vehicle monitors the collision signals and emergency braking signals transmitted by the ACU controller and the ADAS controller. When a collision or emergency braking is detected, the driving recorder is triggered to record the video, and the event and the time of the event are reported to the cloud, and the vehicle's WiFi hotspot is turned on.

[0080] Step A103, sending an acquisition signal to the cloud, so that the cloud sends the acquisition signal to the terminal application, so that the terminal application acquires the current audio and video information according to the acquisition signal.

[0081] It is understandable that the vehicle side may not be able to maintain a continuous connection with the terminal. The vehicle side sends a signal to the cloud, and the cloud notifies the terminal to obtain information, which can transmit the video information and reference time collected by the vehicle side to the terminal application more quickly.

[0082] It is understandable that the acquisition signal can be a signal sent from the vehicle to the terminal through the cloud. After receiving the signal, the terminal application connects to the vehicle and quickly obtains the audio and video information collected by the vehicle in an emergency through the local area network.

[0083] In the specific implementation, after the cloud receives the emergency event, it notifies the mobile APP of the event, connects to the WiFi hotspot, and automatically obtains the video at the time of the emergency event. Figure 2 , Figure 2 This is a schematic diagram of the automatic triggering process of image transmission in an emergency, involving the vehicle side, cloud side and mobile phone APP side ( Figure 2 Taking the mobile phone APP as an example, the mobile phone APP end is the terminal application), the vehicle end is authorized for the first time and the terminal enters the authorization for the first time. The vehicle end obtains the corresponding authority and monitors the vehicle status in real time. When the vehicle collides or emergency brakes, it automatically records the video and reports the time point to the cloud. It automatically turns on the WIFI hotspot so that the terminal can connect to the local area network. At the same time, the vehicle end sends the emergency event and time point to the cloud. The cloud notifies the terminal, and then the terminal connects to the vehicle end, and obtains the video information and time information recorded and collected by the vehicle end based on the connected local area network.

[0084] In this embodiment, through automatic image transmission between the vehicle and the mobile phone, when the vehicle collides, emergency brakes, etc., the vehicle reports the emergency situation and the time when the emergency occurred to the cloud. At the same time, the vehicle's driving recorder triggers the emergency recording function and saves the recorded video. After the cloud receives the message, it notifies the mobile phone APP to actively obtain the video of the vehicle including the time when the emergency occurred, and stores it locally on the mobile phone.

[0085] The above are only feasible implementations after step S10 provided in this embodiment, and this embodiment does not specifically limit the specific implementations after step S10.

[0086] Step S20, sending the vehicle-side identity information to the terminal application based on the local area network, so that the terminal application performs verification according to the vehicle-side information and feeds back the verification result.

[0087] It is understandable that the vehicle sends the vehicle identity information to the terminal application based on the local area network for identity authentication, and the image data can be sent and received after the identity information is authenticated successfully.

[0088] It is understandable that the verification result may include verification success and verification failure.

[0089] It should be understood that the vehicle-side identity information can be a unique identification code of the vehicle.

[0090] It should be noted that the terminal application can verify based on the vehicle information by connecting the mobile phone to the vehicle's WIFI hotspot, so that the mobile phone and the vehicle form a local area network and establish a communication platform. After the connection is established, through the transmission protocol, the mobile phone vehicle brand application requests the vehicle album application for identity authentication, and the vehicle album application replies with the vehicle VIN information to the mobile phone application to confirm that the unique identification VIN codes of the two vehicles are consistent, so as to ensure that the vehicle bound to the mobile phone application and the vehicle connected to the WIFI hotspot are the same vehicle, so as to ensure user privacy and data security.

[0091] It is understandable that the local area network connection between the vehicle side and the terminal can be based on a specific vehicle application related to the vehicle on the terminal.

[0092] Step S30, receiving the verification result, and when the verification result is successful, obtaining target audio and video information based on an image acquisition request of a terminal application.

[0093] It is understandable that after the terminal successfully authenticates the vehicle information, the user can directly obtain the vehicle information, images, videos and other information from the terminal application.

[0094] In the specific implementation, after successful identity authentication, the vehicle brand application on the mobile phone can initiate a file acquisition request to the vehicle computer to obtain pictures, videos and other files in the vehicle computer album, and can display and preview them in the mobile phone vehicle brand application, or download and save them to the mobile phone system album.

[0095] It should be understood that the user connects to the WIFI hotspot of the vehicle computer through the mobile phone, so that the vehicle computer and the mobile phone form a local area network. At the same time, the vehicle brand application on the mobile phone and the album application on the vehicle computer define a specific communication protocol to achieve two-way data transmission and reception. The user can preview and download the image files on the vehicle computer to the mobile phone system album on the mobile phone vehicle brand application.

[0096] Step S40, sending the target audio and video information to the terminal application.

[0097] In the specific implementation, the image transmission process between the vehicle and the mobile phone can refer to Figure 3 , Figure 3 It includes specific execution actions on both the mobile phone and the vehicle computer. First, the vehicle computer and the mobile phone (taking the mobile phone as an example, that is, the above-mentioned terminal) load the preset communication protocol, and then the mobile phone opens the vehicle-specific APP in the mobile phone, or the APP associated with the vehicle, and connects to the WIFI hotspot on the vehicle computer. The vehicle computer feeds back the hotspot connection result to the mobile phone. When the connection is successful, the mobile phone sends an identity authentication request to the vehicle computer, and the vehicle computer feeds back the vehicle identity information to the mobile phone based on the request.

[0098] It should be emphasized that after successfully verifying the vehicle's identity information on the mobile phone, it is also necessary to determine whether it has the authority to access the vehicle's resources, and if it has the authority, send a request to the vehicle computer to obtain album pictures and video files.

[0099] Furthermore, the vehicle computer desensitizes the acquired files based on the information obtained from the mobile phone. The vehicle computer can also choose whether to desensitize the acquired files. The vehicle computer then sends the acquired album pictures and video files to the mobile phone, which can display, preview and download them.

[0100] It should be emphasized that users connect to the car's WIFI hotspot through their mobile phones, so that the car and the mobile phone form a local area network. At the same time, the vehicle brand application on the mobile phone and the album application on the car can send and receive data through a private communication protocol. Users can preview and download image files on the vehicle's car to the mobile phone system album on the mobile phone's vehicle brand application. When the hotspot is successfully connected, users only need to complete subsequent image downloads on the mobile phone, which is convenient and fast, improves the user's entertainment experience, meets the needs of fun and sharing, and enriches the diversified lifestyle in the car.

[0101] This embodiment provides a vehicle-side image transmission method. After authorization by the vehicle and the terminal, a local area network is constructed based on the two. After the terminal verifies the identity information of the vehicle based on the local area network, the image required by the terminal application is transmitted to the terminal application, thereby realizing two-way data sending and receiving between the vehicle and the terminal. The transmission speed is fast and the data stability is high. It simplifies the way users collect images on the vehicle side and improves the entertainment experience of users when using the vehicle.

[0102] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the above-mentioned embodiment 1 can be referred to the above introduction, and will not be repeated in the following. Figure 4 In the vehicle-side image transmission method, step S20 further includes steps S31 to S32:

[0103] Step S31, receiving the verification result, and when the verification result is successful, determining reference video and audio information based on an image acquisition request of a terminal application.

[0104] It is understandable that the reference audio and video information is audio and video information directly collected by the vehicle without any processing, wherein the reference audio and video information may be album pictures, video files, etc.

[0105] In a feasible implementation, step S10 may include steps A11 to A13:

[0106] Step S32, in response to the desensitization signal input by the user, desensitize the reference audio and video information to obtain the target audio and video information.

[0107] It is understandable that when receiving a request from the terminal to obtain reference audio and video information, a prompt is sent to the user on the vehicle side to ask whether to perform desensitization processing on the audio and video information obtained by the terminal.

[0108] It should be understood that users can choose to perform image desensitization or not according to their own needs, where desensitization is aimed at images, which can be each frame of the video, each image collected separately, or the user selectively determines the part of the audio and video information that needs to be desensitized.

[0109] It is understandable that when the user needs to desensitize the reference audio and video information, whether it is full desensitization or partial desensitization, when the user needs to desensitize the image, a desensitization signal for all audio and video information and a desensitization signal for partial audio and video information are generated accordingly.

[0110] It should be noted that from the perspective of data security and user privacy-sensitive data, the images output on the car computer can be desensitized, that is, personal information such as faces and license plates in the image can be erased or painted with uniform color blocks, so that the content theme cannot be identified or associated, and the processed information cannot be restored, while retaining the data features required by the target environment. The car computer album application integrates an algorithm for image desensitization, that is, an algorithm for image desensitization.

[0111] In the specific implementation, the image desensitization process can refer to Figure 5 In the figure, the image before desensitization is first obtained, and then the image before desensitization is subjected to image distortion correction and image decoding, and then vehicle detection, license plate detection, license plate tracking, face detection and face tracking are performed, and then the pixels in the image are identified, the sensitive area is located, the sensitive area is erased, and the erased image is encoded to obtain the desensitized image.

[0112] In a feasible implementation, step S32 may include steps A321 to A323:

[0113] Step A321, in response to the desensitization signal input by the user, image distortion correction and image decoding processing are performed on the reference audio and video information to obtain an image to be detected.

[0114] It should be noted that if the reference audio-visual information is an image, distortion and image decoding processing are performed on the image; if it is a video, distortion and image decoding processing are performed on each frame of the video.

[0115] It should be noted that if the camera has lens distortion (such as barrel distortion or pincushion distortion), it needs to be corrected. This is usually done by using the distortion parameters obtained through camera calibration, using a checkerboard or other known pattern for calibration, obtaining the intrinsic matrix and distortion coefficients, and performing distortion correction based on the intrinsic matrix and distortion coefficients.

[0116] It should be further explained that image decoding can be to convert the RGB image into a YUV encoding format, which can reduce the file size while ensuring the image quality.

[0117] It is understandable that the image after image distortion correction and image decoding processing is the image to be detected.

[0118] Step A322, performing sensitive information detection on the image to be detected to obtain a sensitive area.

[0119] It should be noted that the sensitive information detection of the image to be detected to obtain the sensitive area includes: performing vehicle body detection, license plate detection and face detection on the image to be detected to obtain detection results; and performing license plate tracking and face tracking based on the detection results to obtain the sensitive area.

[0120] It should be noted that sensitive information detection of the image to be detected can be performed by using a deep learning target detection solution to detect moving targets. The basic process is: by extracting features from the input image, first find the large target in the picture, and then track the small target. That is, through feature extraction and direct regression of the target position, target detection and positioning are performed, first tracking the vehicle body or human body, and then tracking the license plate or face, with high accuracy and good real-time performance.

[0121] The detection result may be features such as the vehicle body, license plate, and face obtained after detection.

[0122] Among them, license plate tracking and face tracking are performed based on the detection results, and the sensitive area can be obtained by tracking the target and then calling the image desensitization algorithm to identify the pixels of the decoded image, locate the sensitive information such as the face area and license plate number area, and confirm the sensitive area to be processed.

[0123] Step A323, erasing the sensitive area of ​​the image to be detected to obtain the image to be decoded, and encoding the image to be decoded to obtain target audio and video information.

[0124] It should be noted that erasing the sensitive area of ​​the image to be detected to obtain the image to be decoded may be replacing the sensitive area with a uniform color block to ensure that the image cannot be restored.

[0125] It can be understood that decoding and encoding are opposite steps, and decoding can be performed based on the previous encoding strategy.

[0126] In this implementation, by blurring and masking the face and license plate image information obtained by the terminal, the user can choose whether to desensitize the file as needed to meet the data security requirements of the image files transmitted externally by the vehicle end.

[0127] The above are only feasible implementations of step S32 provided in this embodiment, and this embodiment does not specifically limit the specific implementation of step S32.

[0128] This embodiment provides a vehicle-side image transmission method, which decodes the image, detects and tracks the face or license plate through a motion target tracking algorithm, and then performs color block masking on the sensitive information in the face and license plate images, while retaining the data features required by the target environment. It does not affect the information content in the audio and video information while ensuring the data security of the image files transmitted externally by the vehicle-side.

[0129] It should be noted that the above examples are only used to understand the present application and do not constitute a limitation on the vehicle-side image transmission method of the present application. More simple transformations based on this technical concept are all within the scope of protection of the present application.

[0130] This application also provides a vehicle-side image transmission device, please refer to Figure 6 , the vehicle-side image transmission device comprises:

[0131] The LAN connection module 10 is used to build a LAN between the vehicle end and the terminal application based on a preset protocol when the vehicle end completes the LAN authorization;

[0132] The identity authentication module 20 is used to send the vehicle-side identity information to the terminal application based on the local area network, so that the terminal application performs verification according to the vehicle-side information and feeds back the verification result;

[0133] The image transmission module 30 is used to receive the verification result, and when the verification result is successful, obtain the target audio and video information based on the image acquisition request of the terminal application;

[0134] The image transmission module 30 is further used to send the target audio and video information to the terminal application.

[0135] The vehicle-side image transmission device provided by the present application adopts the vehicle-side image transmission method in the above embodiment, which can solve the technical problem that the current user's way of obtaining audio and video data on the vehicle side is very cumbersome and the user experience is poor. Compared with the prior art, the beneficial effects of the vehicle-side image transmission device provided by the present application are the same as the beneficial effects of the vehicle-side image transmission method provided by the above embodiment, and the other technical features in the vehicle-side image transmission device are the same as the features disclosed in the above embodiment method, which will not be repeated here.

[0136] The present application provides a vehicle-side image transmission device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the vehicle-side image transmission method in the above-mentioned embodiment one.

[0137] Reference below Figure 7 , which shows a schematic diagram of the structure of a vehicle-side image transmission device suitable for implementing an embodiment of the present application. The vehicle-side image transmission device in the embodiment of the present application may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 7 The vehicle-side image transmission device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0138] like Figure 7As shown, the vehicle-side image transmission device may include a processing device 1001 (such as a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the vehicle-side image transmission device are also stored. The processing device 1001, ROM1002 and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the vehicle-side image transmission device to communicate with other devices wirelessly or by wire to exchange data. Although the figure shows a vehicle-side image transmission device with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or have alternatively.

[0139] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0140] The vehicle-side image transmission device provided by the present application adopts the vehicle-side image transmission method in the above embodiment, which can solve the technical problem that the current user's way of obtaining audio and video data on the vehicle side is very cumbersome and the user experience is poor. Compared with the prior art, the beneficial effects of the vehicle-side image transmission device provided by the present application are the same as the beneficial effects of the vehicle-side image transmission method provided by the above embodiment, and the other technical features in the vehicle-side image transmission device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0141] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0142] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0143] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the vehicle-side image transmission method in the above-mentioned embodiment.

[0144] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0145] The above-mentioned computer-readable storage medium may be included in the vehicle-side image transmission device; or it may exist independently without being assembled into the vehicle-side image transmission device.

[0146] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by the vehicle-side image transmission device, the vehicle-side image transmission device: when the LAN authorization is completed on the vehicle side, builds a local area network between the vehicle side and the terminal application based on a preset protocol; sends the vehicle-side identity information to the terminal application based on the local area network, so that the terminal application verifies according to the vehicle-side information and feeds back the verification result; receives the verification result, and when the verification result is successful, obtains the target audio and video information based on the image acquisition request of the terminal application; and sends the target audio and video information to the terminal application.

[0147] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0148] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0149] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0150] The readable storage medium provided by the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned vehicle-side image transmission method, and can solve the technical problem that the current user's way of obtaining the vehicle-side audio and video data is very cumbersome and the user experience is poor. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the present application are the same as the beneficial effects of the vehicle-side image transmission method provided by the above-mentioned embodiment, and will not be repeated here.

[0151] The present application also provides a computer program product, including a computer program, which implements the steps of the above-mentioned vehicle-side image transmission method when executed by a processor.

[0152] The computer program product provided by this application can solve the technical problem that the current way for users to obtain audio and video data on the vehicle side is very cumbersome and the user experience is poor. Compared with the prior art, the beneficial effects of the computer program product provided by this application are the same as the beneficial effects of the vehicle-side image transmission method provided by the above embodiment, which will not be repeated here.

[0153] The above descriptions are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect applications in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A vehicle-side image transmission method, characterized in that: The vehicle-side image transmission method comprises: When the LAN authorization is completed on the vehicle side, a LAN is built between the vehicle side and the terminal application based on the preset protocol; Sending the vehicle-side identity information to the terminal application based on the local area network, so that the terminal application performs verification according to the vehicle-side information and feeds back the verification result; receiving the verification result, and obtaining target audio and video information based on an image acquisition request of a terminal application when the verification result is successful; Send the target audio and video information to the terminal application.

2. The vehicle-side image transmission method according to claim 1, characterized in that: The receiving the verification result, and obtaining the target audio and video information based on the image acquisition request of the terminal application when the verification result is successful, includes: receiving the verification result, and determining reference video and audio information based on an image acquisition request of a terminal application when the verification result is successful; In response to the desensitization signal input by the user, the reference audio and video information is desensitized to obtain the target audio and video information.

3. The vehicle-side image transmission method according to claim 2, characterized in that: The step of performing desensitization processing on the reference video information in response to the desensitization signal input by the user to obtain the target video information includes: In response to the desensitization signal input by the user, the reference audio and video information is subjected to image distortion correction and image decoding processing to obtain an image to be detected; Performing sensitive information detection on the image to be detected to obtain a sensitive area; The sensitive area of ​​the image to be detected is erased to obtain the image to be decoded, and the image to be decoded is encoded to obtain target audio and video information.

4. The vehicle-side image transmission method according to claim 3, characterized in that: The performing sensitive information detection on the image to be detected to obtain a sensitive area includes: Performing vehicle body detection, license plate detection and face detection on the image to be detected to obtain a detection result; Based on the detection results, license plate tracking and face tracking are performed to obtain sensitive areas.

5. The vehicle-side image transmission method according to claim 1, characterized in that: When the vehicle is started, after building a local area network between the vehicle end and the terminal application based on a preset protocol, it also includes: Monitor the real-time status of the vehicle collision monitoring unit and the vehicle emergency brake monitoring unit; Obtaining a vehicle-side emergency signal based on the real-time status, and obtaining current audio and video information based on the vehicle-side emergency signal; Send an acquisition signal to the cloud, so that the cloud sends the acquisition signal to the terminal application, so that the terminal application acquires the current audio and video information according to the acquisition signal.

6. The vehicle-side image transmission method according to any one of claims 5, characterized in that: The obtaining of a vehicle-side emergency signal based on the real-time status, and obtaining current audio and video information based on the vehicle-side emergency signal, includes: Obtaining a vehicle-side emergency signal based on the real-time status; Obtaining a reference time according to the vehicle-side emergency signal, and performing video acquisition based on the reference time to obtain a reference video; The reference time and the reference video are used as current audio and video information.

7. The vehicle-side image transmission method according to claim 1, characterized in that: When the vehicle end completes the local area network authorization, before building the local area network between the vehicle end and the terminal application based on the preset protocol, it also includes: When the user enters the vehicle-side photo album application for the first time, an authorization reminder is generated to obtain a reference signal input by the user based on the authorization reminder; When the reference signal indicates that authorization is allowed, the automatic connection to the local area network permission and the automatic acquisition of audio and video information permission are obtained to complete the local area network authorization.

8. A vehicle-side image transmission device, characterized in that: The vehicle-side image transmission device comprises: The LAN connection module is used to build a LAN between the vehicle and the terminal application based on a preset protocol when the vehicle completes the LAN authorization; An identity authentication module, used for sending the vehicle-side identity information to the terminal application based on the local area network, so that the terminal application performs verification according to the vehicle-side information and feeds back the verification result; An image transmission module, used to receive the verification result, and when the verification result is successful, obtain the target audio and video information based on the image acquisition request of the terminal application; The image transmission module is also used to send the target audio and video information to the terminal application.

9. A vehicle-side image transmission device, characterized in that: The device includes: a memory, a processor, and a vehicle-side image transmission program stored in the memory and executable on the processor, wherein the vehicle-side image transmission program is configured to implement the vehicle-side image transmission method according to any one of claims 1 to 7.

10. A storage medium, characterized in that: The storage medium stores a vehicle-side image transmission program, and when the vehicle-side image transmission program is executed by the processor, the vehicle-side image transmission method according to any one of claims 1 to 7 is implemented.

Images