Display method of streaming media rearview mirror based on extended external connection of driving recorder

Abstract

The present invention provides a display method for a streaming media rearview mirror based on an external extension of a driving recorder, which belongs to the field of data security technology and is used to reduce the transmission load and ensure data security. The method includes: a terminal wirelessly receives continuous image frame information from a driving recorder external to the vehicle, the continuous image frame information including complete image ciphertext information of an important frame and partial image ciphertext information of multiple consecutive frames following the important frame; the terminal decrypts the complete image ciphertext information and the partial image ciphertext information respectively to obtain a complete image of the important frame and partial images of each of the multiple consecutive frames; the terminal uses the complete image of the important frame and the partial images of each of the multiple consecutive frames to restore the complete image of each of the multiple consecutive frames; the terminal controls the streaming media rearview mirror to sequentially display the complete image of the important frame and the complete image of each of the multiple consecutive frames.

Description

Technical Field

[0001] The present invention relates to the field of data security technology, and in particular to a display method for a streaming media rearview mirror based on an extended external connection of a driving recorder. Background Art

[0002] With the continuous development of the automotive industry, driving safety and convenience have become key concerns for users. Dashcams, devices that record various driving information, have been widely adopted by various vehicle models. Furthermore, streaming media rearview mirrors, emerging in-vehicle display devices, can provide real-time traffic information and entertainment content, enhancing the driving experience. Transmitting dashcam video to streaming media rearview mirrors for real-time display has become a key area of ​​technological development.

[0003] Specifically, a dashcam primarily records video and audio information while driving and typically includes a camera, storage device, and power module. Modern dashcams typically feature high-definition resolution, night vision, and automatic loop recording. Some high-end dashcams also include collision detection and parking monitoring. A streaming rearview mirror, on the other hand, is an in-vehicle device that integrates a display and camera, primarily used to display real-time traffic information and entertainment content. Users can use the streaming rearview mirror to view real-time information about the vehicle's surroundings while also viewing video calls, navigation information, and other content. Streaming rearview mirrors are often integrated with the vehicle's entertainment and navigation systems to provide a richer range of features. Furthermore, the video captured by the dashcam behind the vehicle can be transmitted to the streaming rearview mirror for display via wireless transmission technologies such as Wi-Fi, Bluetooth, and 4G / 5G networks. This process typically requires data compression and restoration to ensure display clarity.

[0004] However, how to reduce the transmission load and ensure data security is a current research issue. Summary of the Invention

[0005] The embodiment of the present invention provides a display method for a streaming media rearview mirror based on an extended external connection of a driving recorder, so as to reduce the transmission load and ensure data security.

[0006] In order to achieve the above object, the present invention adopts the following technical solutions:

[0007] In a first aspect, a display method for a streaming media rearview mirror based on an external extension of a driving recorder is provided, the method being applied to a terminal built into a vehicle, the terminal having a streaming media rearview mirror display function, the method comprising: the terminal wirelessly receiving continuous image frame information from a driving recorder external to the vehicle, the continuous image frame information comprising complete image ciphertext information of an important frame, and partial image ciphertext information of multiple continuation frames consecutively following the important frame, the important frame and the multiple continuation frames being image frames of the rear of the vehicle taken by the driving recorder; the terminal decrypting the complete image ciphertext information and the partial image ciphertext information respectively to obtain a complete image of the important frame and partial images of each of the multiple continuation frames; the terminal using the complete image of the important frame and the partial images of each of the multiple continuation frames to restore the complete image of each of the multiple continuation frames; the terminal controlling the streaming media rearview mirror to sequentially display the complete image of the important frame and the complete image of each of the multiple continuation frames.

[0008] Optionally, the terminal decrypts the complete image ciphertext information and the partial image ciphertext information respectively to obtain the complete image of the important frame and the partial image of each of the multiple continued frames, including: the terminal uses different decryption methods to decrypt the complete image ciphertext information and the partial image ciphertext information respectively to obtain the complete image of the important frame and the partial image of each of the multiple continued frames.

[0009] Optionally, the terminal uses different decryption methods to decrypt the complete image ciphertext information and the partial image ciphertext information respectively to obtain the complete image of the important frame and the partial images of each of the multiple continued frames, including: the terminal uses a dynamically derived first key to decrypt the complete image ciphertext information to obtain the complete image of the important frame; the terminal uses a dynamically derived second key to decrypt the partial image ciphertext information of the multiple continued frames respectively to obtain the partial images of each of the multiple continued frames.

[0010] Optionally, the important frame is the x-th important frame, x is an integer greater than or equal to 1, and the terminal uses a dynamically derived first key to decrypt the complete image ciphertext information to obtain the complete image of the important frame, including: when x=1, the terminal uses a preset root key as the input key, and uses preset parameters as input parameters, and uses a key deduction algorithm to calculate the input key and input parameters to obtain the first key, and the preset parameters are parameters negotiated when the terminal establishes a wireless connection with the driving recorder; or, when x>1, the terminal uses a preset root key as the input key, and uses relevant image information of the x-1th important frame as input parameters, and uses a key deduction algorithm to calculate the input key and input parameters to obtain the first key; the terminal uses the first key to decrypt the complete image ciphertext information to obtain the complete image of the x-th important frame.

[0011] Optionally, the root key is information of K1 characters, K1 is an integer greater than 1, the complete image of the x-1th important frame is information of K2 characters, and K2 is an integer greater than K1; the terminal uses a preset root key as the input key, and uses the relevant image information of the x-1th important frame as the input parameter, and uses a key deduction algorithm to calculate the input key and input parameters to obtain a first key, including: the terminal determines the preset root key as the input key; the terminal takes out the K3+1th to K3+K1th characters from K2 characters according to K2modK1=K3, and hashes the K3+1th to K3+K1th characters to obtain the input parameters; the terminal uses a key deduction algorithm to calculate the input key and input parameters to obtain the first key.

[0012] Optionally, the complete image of the N-frame continuation frame is restored based on the complete image of the x-1-th important frame and the partial image of the N-frame continuation frame; the terminal uses a preset root key as the input key, and uses the partial image information of the x-1-th important frame as the input parameter, and uses a key deduction algorithm to calculate the input key and input parameter to obtain a first key, including: the terminal determines the preset root key as the input key; the terminal determines the difference between the amount of information of the complete image of the x-1-th important frame and the amount of information of the partial image of the continuation frame specified in the N-frame continuation frame, and hashes the difference to obtain the input parameter; the terminal uses a key deduction algorithm to calculate the input key and input parameter to obtain the first key.

[0013] Optionally, the terminal uses a dynamically derived second key to decrypt partial image ciphertext information of multiple continuation frames respectively to obtain partial images of each of the multiple continuation frames, including: the terminal uses a preset root key as the input key, and uses the frame sequence number of the continuation frame specified in the multiple continuation frames as the input parameter, and uses a key deduction algorithm to calculate the input key and the input parameter to obtain the second key; the terminal uses the second key to decrypt partial image ciphertext information of multiple continuation frames respectively to obtain partial images of each of the multiple continuation frames.

[0014] Optionally, the terminal uses the complete image of the important frame and the partial images of each of the multiple-frame continuation frames to restore the complete image of each of the multiple-frame continuation frames, including: the terminal inputs the complete image of the important frame and the partial images of each of the multiple-frame continuation frames into the AI / ML model, and obtains the complete image of each of the multiple-frame continuation frames output by the AI / ML model.

[0015] Optionally, the multi-frame continuation frames include M-frame continuation frames, where M is an integer greater than 1. The terminal inputs the complete image of the important frame and the partial images of the multi-frame continuation frames into the AI / ML model to obtain the complete images of the multi-frame continuation frames output by the AI / ML model, including: the terminal inputs the complete image of the important frame and the partial image of the first frame continuation frame in the M frame continuation frames into the AI / ML model to obtain the complete image of the first frame continuation frame output by the AI / ML model; the terminal inputs the complete image of the important frame, the complete image of the first frame continuation frame, and the partial image of the second frame continuation frame in the M frame continuation frames into the AI / ML model to obtain the complete image of the second frame continuation frame output by the AI / ML model; and so on, until the terminal inputs the complete image of the important frame, the complete image of the M-1th frame continuation frame in the M frame continuation frames, and the partial image of the Mth frame continuation frame in the M frame continuation frames into the AI / ML model to obtain the complete image of the Mth frame continuation frame output by the AI / ML model.

[0016] In a second aspect, a display device for a streaming rearview mirror based on an external extension of a driving recorder is provided, the device being applied to a terminal built into a vehicle, the terminal having a streaming rearview mirror display function, and the device being configured as follows: the device wirelessly receives continuous image frame information from a driving recorder external to the vehicle, the continuous image frame information including complete image ciphertext information of an important frame and partial image ciphertext information of a plurality of continuation frames following the important frame, the important frame and the plurality of continuation frames being image frames of the rear of the vehicle taken by the driving recorder; the device decrypts the complete image ciphertext information and the partial image ciphertext information respectively to obtain a complete image of the important frame and partial images of each of the plurality of continuation frames; the device uses the complete image of the important frame and the partial images of each of the plurality of continuation frames to restore the complete image of each of the plurality of continuation frames; the device controls the streaming rearview mirror to display the complete image of the important frame and the complete image of each of the plurality of continuation frames in sequence.

[0017] In a third aspect, an electronic device is provided, comprising: a processor and a memory; the memory is used to store a computer program, and when the processor executes the computer program, the electronic device executes the method described in the first aspect.

[0018] In one possible design solution, the electronic device described in the third aspect may further include a transceiver. The transceiver may be a transceiver circuit or an interface circuit. The transceiver may be used for the electronic device described in the third aspect to communicate with other electronic devices.

[0019] In an embodiment of the present invention, the electronic device described in the third aspect may be a terminal, or a chip (system) or other parts or components that can be set in the terminal, or a system including the terminal.

[0020] In a fourth aspect, a computer-readable storage medium is provided, comprising: a computer program or instructions; when the computer program or instructions are run on a computer, the computer is caused to execute the method described in the first aspect.

[0021] In summary, the above method and system have the following technical effects:

[0022] The continuous image frame information wirelessly received by the terminal from the bicycle dashcam is encrypted, including the complete image ciphertext information of the important frame and the partial image ciphertext information of the multiple continuation frames following the important frame. This ensures the security of data transmission and prevents the leakage of relatively private user data collected by the dashcam. In addition, the terminal can use the complete image of the important frame and the partial images of the multiple continuation frames to restore the complete images of the multiple continuation frames. In other words, during the overall transmission process, the bicycle dashcam only needs to transmit the partial image information of the continuation frames, which can reduce the transmitted data and thus reduce the transmission load. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 A schematic diagram of a communication system provided in an embodiment of the present invention;

[0024] Figure 2 A flow chart of a method for displaying a streaming media rearview mirror based on an extended external driving recorder provided by an embodiment of the present invention;

[0025] Figure 3 A schematic structural diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0026] The technical solution of the present invention will be described below with reference to the accompanying drawings.

[0027] In the embodiment of the present invention, "indication" may include direct indication and indirect indication, and may also include explicit indication and implicit indication. The information indicated by a certain information is called information to be indicated. In the specific implementation process, there are many ways to indicate the information to be indicated, such as but not limited to, the information to be indicated can be directly indicated, such as the information to be indicated itself or the index of the information to be indicated. The information to be indicated can also be indirectly indicated by indicating other information, wherein the other information and the information to be indicated have an association relationship. It is also possible to indicate only a part of the information to be indicated, while the other parts of the information to be indicated are known or agreed in advance. For example, the indication of specific information can be achieved by means of the arrangement order of each piece of information that is agreed upon in advance (for example, stipulated by the protocol), thereby reducing the indication overhead to a certain extent. At the same time, the common parts of each piece of information can be identified and indicated uniformly to reduce the indication overhead caused by indicating the same information separately.

[0028] In addition, the specific indication method can also be various existing indication methods, such as but not limited to the above-mentioned indication methods and various combinations thereof. The specific details of the various indication methods can refer to the existing technology and will not be repeated in this article. As can be seen from the above, for example, when it is necessary to indicate multiple information of the same type, there may be a situation where the indication methods for different information are different. In the specific implementation process, the required indication method can be selected according to specific needs. The embodiment of the present invention does not limit the selected indication method. In this way, the indication method involved in the embodiment of the present invention should be understood to cover various methods that can enable the party to be indicated to obtain the information to be indicated.

[0029] It should be understood that the information to be indicated can be sent as a whole or divided into multiple sub-information and sent separately, and the sending period and / or sending timing of these sub-information can be the same or different. The specific sending method is not limited by the embodiment of the present invention. The sending period and / or sending timing of these sub-information can be predefined, for example, predefined according to a protocol, or can be configured by the transmitting device through sending configuration information to the receiving device.

[0030] "Pre-definition" or "pre-configuration" can be achieved by pre-saving corresponding codes, tables or other methods that can be used to indicate relevant information in the device, and the embodiments of the present invention do not limit the specific implementation method. Among them, "saving" can mean saving in one or more memories. The one or more memories can be set separately or integrated in an encoder or decoder, a processor, or an electronic device. The one or more memories can also be partially set separately and partially integrated in a decoder, a processor, or an electronic device. The type of memory can be any form of storage medium, which is not limited by the embodiments of the present invention.

[0031] The "protocol" involved in the embodiments of the present invention may refer to a protocol family in the communication field, a standard protocol with a similar protocol family frame structure, or a related protocol used in a future display method system of a streaming media rearview mirror based on an extended external driving recorder. The embodiments of the present invention do not specifically limit this.

[0032] In the embodiments of the present invention, descriptions such as "when...", "in the case of...", "if", and "if" all mean that the device will perform corresponding processing under certain objective circumstances. They do not limit the time, nor do they require the device to perform judgment actions during implementation, nor do they mean the existence of other limitations.

[0033] In the description of the embodiments of the present invention, unless otherwise specified, " / " indicates that the associated objects are in an "or" relationship. For example, A / B can mean either A or B. "And / or" in the embodiments of the present invention merely describes an association relationship between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can mean: A alone, A and B together, or B alone. A and B can be singular or plural. Furthermore, in the description of the embodiments of the present invention, unless otherwise specified, "multiple" refers to two or more. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, "at least one of a, b, or c" can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or plural. Furthermore, to facilitate the clear description of the technical solutions of the embodiments of the present invention, the terms "first" and "second" are used in the embodiments of the present invention to distinguish between identical or similar items with substantially the same function or effect. Those skilled in the art will understand that words such as "first" and "second" do not limit the quantity and execution order, and words such as "first" and "second" do not necessarily limit differences. At the same time, in the embodiments of the present invention, words such as "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present invention should not be interpreted as being more preferred or more advantageous than other embodiments or design. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a concrete way for easy understanding.

[0034] The network architecture and business scenarios described in the embodiments of the present invention are intended to more clearly illustrate the technical solutions of the embodiments of the present invention, and do not constitute a limitation on the technical solutions provided by the embodiments of the present invention. Ordinary technicians in this field can know that with the evolution of network architecture and the emergence of new business scenarios, the technical solutions provided by the embodiments of the present invention are also applicable to similar technical problems.

[0035] To facilitate understanding of the embodiments of the present application, first Figure 1 The communication system shown in FIG. 1 is used as an example to describe in detail a communication system applicable to an embodiment of the present application.

[0036] Figure 1 This is a schematic diagram of the architecture of a communication system applicable to the display method of the streaming media rearview mirror based on the extended external driving recorder provided in the embodiment of the present application. Figure 1 As shown, the communication system includes: a terminal and a driving recorder.

[0037] The term "terminal" may be a terminal device with transceiver and processing functions, or a chip or chip system that can be installed in the terminal device. The terminal device may also be referred to as user equipment (UE), access terminal equipment, subscriber unit (subscriberunit), subscriber station, mobile station (MS), mobile station, remote station, remote terminal equipment, mobile device, user terminal equipment, terminal equipment, wireless communication equipment, user agent, or user device. The terminal device in the embodiments of the present application can be a mobile phone, a cellular phone, a smart phone, a tablet computer, a wireless data card, a personal digital assistant (PDA), a wireless modem, a handheld device (handset), a laptop computer, a machine type communication (MTC) terminal device, a computer with wireless transceiver function, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal device in industrial control, a wireless terminal device in self-driving, a wireless terminal device in remote medical, a wireless terminal device in smart grid, a wireless terminal device in transportation safety, a wireless terminal device in smart city, a wireless terminal device in smart home, a vehicle-mounted terminal device, a road side unit (RSU) with terminal device function, etc. The terminal device of the present application may also be an onboard module, onboard module, onboard component, onboard chip, or onboard unit built into a vehicle as one or more components or units. Alternatively, the terminal device may be customer-premises equipment (CPE).

[0038] The terminal is built into the vehicle and can be considered as part of the vehicle computer. The terminal has a streaming media rearview mirror display function and can also be considered as a streaming media rearview mirror.

[0039] A dashcam can be installed externally on a vehicle's terminal, meaning it can be considered a third-party component, installed externally on the vehicle to capture video from behind. The dashcam and terminal can establish a wireless connection using various methods, such as Bluetooth, StarFlash, and PC5, with no specific restrictions.

[0040] Figure 2 This is a flow chart of the method provided by an embodiment of the present invention. The display method of the streaming media rearview mirror based on the extended external driving recorder can be applied to the above-mentioned terminal. The specific process is as follows:

[0041] S301: The terminal receives continuous image frame information from a driving recorder external to the vehicle in a wireless manner.

[0042] The continuous image frame information includes the complete image ciphertext of the key frame and the partial image ciphertext of the multiple continuation frames following the key frame. Both the key frame and the multiple continuation frames are image frames in the video captured by the dashcam behind the vehicle. The key frame can be understood as a key frame, containing complete image information, while the continuation frame can be understood as a non-key frame, containing partial image information. The missing information in these frames needs to be restored based on the key frame.

[0043] Each frame captured by the dash cam is a complete image, and the dash cam can automatically divide the captured frames into important frames and continuation frames. For example, the dash cam determines the first frame captured as an important frame, and then the next three consecutive frames as continuation frames. Then the dash cam determines the fourth frame captured as an important frame, and then the next three consecutive frames are further determined as continuation frames, and so on. For important frames, the dash cam can encrypt the complete image of the important frame and send it to the terminal. For continuation frames, the dash cam can extract part of the image from the complete image of the continuation frame (such as extracting one pixel from every 3*3 or 2*2 pixels) and then encrypt it and send it to the terminal. The encryption method corresponds to the decryption method described below. The embodiment of the present application adopts symmetric encryption and decryption, which are inverse processes of each other. You can refer to the decryption method described below for understanding, and will not repeat it here.

[0044] S302 : The terminal decrypts the complete image ciphertext information and the partial image ciphertext information respectively to obtain the complete image of the important frame and the partial images of the multiple continued frames.

[0045] Among them, the terminal can use different decryption methods to decrypt the complete image ciphertext information and partial image ciphertext information respectively, to obtain the complete image of the important frame and the partial image of each of the multiple continued frames, so as to achieve decoupling of the encryption and decryption methods of different frames, and information transmission can be more secure.

[0046] Specifically, on the one hand, the terminal can use the dynamically derived first key to decrypt the complete image ciphertext information to obtain the complete image of the important frame;

[0047] Specifically, the important frame may be the x-th important frame (or the x-th important frame received by the terminal), where x is an integer greater than or equal to 1.

[0048] When x=1, the terminal can use a preset root key as the input key and preset parameters as input parameters, and use a key deduction algorithm to calculate the input key and input parameters to obtain the first key. The root key can be predefined or preconfigured by the protocol, and the terminal and the dashcam both have the same root key. The preset parameters are parameters negotiated when the terminal and the dashcam establish a wireless connection. For example, they can be the count value of a counter that the terminal and the dashcam can synchronize, or a negotiated random number or random string, etc. The specific implementation is not limited.

[0049] Alternatively, when x>1, the terminal can use a preset root key as the input key, and use the relevant image information of the x-1th important frame as the input parameter, and use the key deduction algorithm to calculate the input key and input parameter to obtain the first key. For example, the root key is K1 characters of information, K1 is an integer greater than 1, and the complete image of the x-1th important frame is K2 characters of information, K2 is an integer greater than K1. On this basis, the terminal can determine the preset root key as the input key; the terminal can extract the K3+1th to K3+K1th characters from the K2 characters according to K2modK1=K3, and hash the K3+1th to K3+K1th characters to obtain the input parameter. The terminal can use the key deduction algorithm to calculate the input key and input parameter to obtain the first key. In one example, K1=5, K2=24, K2modK1=K3=4, where mod represents a modulo operation. Assuming the 24-character message is: USGSDIUFKG0KP14-GSDGJHO, then characters K3+1 through K3+K1 are IUFKG, which is hashed to obtain the input parameter. This means that the image information of the previous important frame can be used to derive the key used to decrypt the encrypted image information of the next important frame. Since each frame's image is different, the key derivation process is guaranteed to be random, further improving information transmission security. For another example, the complete image of an N-frame continuation is restored based on the complete image of the x-1-th important frame and partial images of N-frame continuation, where N is an integer greater than 1. Based on this, the terminal can determine a preset root key as the input key. The terminal can then determine the difference between the information content of the complete image of the x-1-th important frame and the information content of the partial image of a specified continuation frame in the N-frame continuation, and hash this difference to obtain the input parameter. The designated continuation frame may be the xyth frame of an N-frame continuation frame, such as the first frame, the first frame and the second frame, or an N-frame continuation frame. There is no specific limitation and this may be a pre-negotiated agreement between the terminal and the dash cam. The designated partial image of the continuation frame refers to the partial image of each designated continuation frame, i.e., the partial image received by the terminal from the dash cam, rather than the restored complete image. If the designated continuation frame is multiple frames, the information content of the partial image of the designated continuation frame may be the sum of the information content of the partial images of each designated continuation frame. The terminal may use a key deduction algorithm to calculate the input key and input parameters to obtain a first key. In other words, the information associated with the important frame of the previous frame and the continuation frame related to the important frame, such as the difference in information content, may be used to deduce the key used to decrypt the encrypted image information of the next important frame. Since the difference in information content between each important frame and the continuation frame related to the important frame is different, the key deduction process is guaranteed to be random throughout the entire process, thereby further improving information transmission security.

[0050] Afterwards, the terminal uses the first key to decrypt the complete image ciphertext information to obtain the complete image of the x-th important frame.

[0051] On the other hand, the terminal uses a dynamically derived second key to decrypt the ciphertext information of the partial images of the multiple consecutive frames, respectively, to obtain the partial images of each of the multiple consecutive frames. For example, the terminal uses a preset root key as the input key and the frame sequence number of a specified consecutive frame in the multiple consecutive frames (such as frame 1, frame 1 and frame 2, or N consecutive frames) as an input parameter. The terminal uses a key derivation algorithm to calculate the input key and input parameters to obtain the second key. The terminal can use the second key to decrypt the ciphertext information of the partial images of the multiple consecutive frames, respectively, to obtain the partial images of each of the multiple consecutive frames.

[0052] S303 : The terminal uses the complete image of the important frame and the partial images of the multiple continued frames to restore the complete images of the multiple continued frames.

[0053] The terminal can input the complete image of the important frame and the partial images of each of the multiple consecutive frames into the AI / ML model to obtain the complete images of each of the multiple consecutive frames output by the AI / ML model. The AI / ML model can be a trained model, such as an existing deep neural network model. The specific training process can be conventional technology and is not limited in the embodiments of the present application. Assuming that the multiple consecutive frames include M consecutive frames, where M is an integer greater than 1, the terminal can input the complete image of the important frame and the partial image of the first consecutive frame in the M consecutive frames into the AI / ML model to obtain the complete image of the first consecutive frame output by the AI / ML model. The terminal can input the complete image of the important frame, the complete image of the first consecutive frame, and the partial image of the second consecutive frame in the M consecutive frames into the AI / ML model to obtain the complete image of the second consecutive frame output by the AI / ML model. This can be repeated until the terminal inputs the complete image of the important frame, the complete image of the M-1 consecutive frame in the M consecutive frames, and the partial image of the M-th consecutive frame in the M consecutive frames into the AI / ML model to obtain the complete image of the Mth consecutive frame output by the AI / ML model.

[0054] S304 , the terminal controls the streaming media rearview mirror to sequentially display the complete image of the important frame and the complete images of the multiple continued frames.

[0055] In summary, the continuous image frame information wirelessly received by the terminal from the bicycle recorder is encrypted information, including the complete image ciphertext information of the important frame and the partial image ciphertext information of the multiple continuation frames following the important frame. This ensures the security of data transmission and prevents the leakage of relatively private user data collected by the dashcam. In addition, the terminal can use the complete image of the important frame and the partial images of the multiple continuation frames to restore the complete images of the multiple continuation frames. In other words, during the overall transmission process, the bicycle recorder only needs to transmit the partial image information of the continuation frames. This can reduce the transmitted data and thus reduce the transmission load.

[0056] Combination of the above Figure 3 The method provided by the embodiment of the present invention is described in detail. The following is a detailed description of a display device for a streaming media rearview mirror based on an extended external dashcam for executing the method provided by the embodiment of the present invention. The device is applied to a terminal built into a vehicle, and the terminal has a streaming media rearview mirror display function. The device is configured as follows: the device wirelessly receives continuous image frame information from a dashcam external to the vehicle, the continuous image frame information includes complete image ciphertext information of an important frame, and partial image ciphertext information of multiple consecutive frames following the important frame, the important frame and the multiple consecutive frames being image frames of the rear of the vehicle taken by the dashcam; the device decrypts the complete image ciphertext information and the partial image ciphertext information respectively to obtain a complete image of the important frame and partial images of each of the multiple consecutive frames; the device uses the complete image of the important frame and the partial images of each of the multiple consecutive frames to restore the complete image of each of the multiple consecutive frames; the device controls the streaming media rearview mirror to sequentially display the complete image of the important frame and the complete image of each of the multiple consecutive frames.

[0057] Optionally, the device decrypts the complete image ciphertext information and the partial image ciphertext information respectively to obtain the complete image of the important frame and the partial image of each of the multiple continued frames, including: the device uses different decryption methods to decrypt the complete image ciphertext information and the partial image ciphertext information respectively to obtain the complete image of the important frame and the partial image of each of the multiple continued frames.

[0058] Optionally, the device uses different decryption methods to decrypt the complete image ciphertext information and the partial image ciphertext information respectively to obtain the complete image of the important frame and the partial images of each of the multiple continued frames, including: the device uses a dynamically derived first key to decrypt the complete image ciphertext information to obtain the complete image of the important frame; the device uses a dynamically derived second key to decrypt the partial image ciphertext information of the multiple continued frames respectively to obtain the partial images of each of the multiple continued frames.

[0059] Optionally, the important frame is the x-th important frame, x is an integer greater than or equal to 1, and the device uses a dynamically derived first key to decrypt the complete image ciphertext information to obtain the complete image of the important frame, including: when x=1, the device uses a preset root key as the input key, and uses preset parameters as input parameters, and uses a key deduction algorithm to calculate the input key and input parameters to obtain a first key, and the preset parameters are parameters negotiated when the device establishes a wireless connection with the driving recorder; or, when x>1, the device uses a preset root key as the input key, and uses relevant image information of the x-1th important frame as input parameters, and uses a key deduction algorithm to calculate the input key and input parameters to obtain the first key; the device uses the first key to decrypt the complete image ciphertext information to obtain the complete image of the x-th important frame.

[0060] Optionally, the root key is information of K1 characters, K1 is an integer greater than 1, the complete image of the x-1th important frame is information of K2 characters, and K2 is an integer greater than K1; the device uses a preset root key as the input key, and uses the relevant image information of the x-1th important frame as the input parameter, and uses a key deduction algorithm to calculate the input key and input parameters to obtain a first key, including: the device determines the preset root key as the input key; the device takes out the K3+1th to K3+K1th characters from K2 characters according to K2modK1=K3, and hashes the K3+1th to K3+K1th characters to obtain the input parameters; the device uses a key deduction algorithm to calculate the input key and input parameters to obtain the first key.

[0061] Optionally, the complete image of the N-frame continuation frame is restored based on the complete image of the x-1th important frame and the partial image of the N-frame continuation frame; the device uses a preset root key as the input key, and uses the partial image information of the x-1th important frame as the input parameter, and uses a key deduction algorithm to calculate the input key and the input parameter to obtain a first key, including: the device determines the preset root key as the input key; the device determines the difference in information between the amount of information of the complete image of the x-1th important frame and the amount of information of the partial image of the continuation frame specified in the N-frame continuation frame, and hashes the difference in information to obtain the input parameter; the device uses a key deduction algorithm to calculate the input key and the input parameter to obtain the first key.

[0062] Optionally, the device uses a dynamically derived second key to decrypt partial image ciphertext information of multiple continuation frames respectively to obtain partial images of each of the multiple continuation frames, including: the device uses a preset root key as the input key, and uses the frame sequence number of the continuation frame specified in the multiple continuation frames as the input parameter, and uses a key deduction algorithm to calculate the input key and the input parameter to obtain the second key; the device uses the second key to decrypt partial image ciphertext information of multiple continuation frames respectively to obtain partial images of each of the multiple continuation frames.

[0063] Optionally, the device uses the complete image of the important frame and the partial images of each of the multiple continued frames to restore the complete image of each of the multiple continued frames, including: the device inputs the complete image of the important frame and the partial images of each of the multiple continued frames into the AI / ML model, and obtains the complete image of each of the multiple continued frames output by the AI / ML model.

[0064] Optionally, the multi-frame continuation frames include M-frame continuation frames, where M is an integer greater than 1. The terminal inputs the complete image of the important frame and the partial images of the multi-frame continuation frames into the AI / ML model to obtain the complete images of the multi-frame continuation frames output by the AI / ML model, including: the terminal inputs the complete image of the important frame and the partial image of the first frame continuation frame in the M frame continuation frames into the AI / ML model to obtain the complete image of the first frame continuation frame output by the AI / ML model; the terminal inputs the complete image of the important frame, the complete image of the first frame continuation frame, and the partial image of the second frame continuation frame in the M frame continuation frames into the AI / ML model to obtain the complete image of the second frame continuation frame output by the AI / ML model; and so on, until the terminal inputs the complete image of the important frame, the complete image of the M-1th frame continuation frame in the M frame continuation frames, and the partial image of the Mth frame continuation frame in the M frame continuation frames into the AI / ML model to obtain the complete image of the Mth frame continuation frame output by the AI / ML model.

[0065] Figure 3 This is a schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. For example, the electronic device may be a network device, or a chip (system) or other component or assembly that can be set in a network device. Figure 3 As shown, electronic device 400 may include a processor 401. Optionally, electronic device 400 may further include a memory 402 and / or a transceiver 403. Processor 401 is coupled to memory 402 and transceiver 403, for example, via a communication bus.

[0066] The following combination Figure 3 The components of the electronic device 400 are described in detail.

[0067] Processor 401 is the control center of electronic device 400 and can be a single processor or a collective term for multiple processing elements. For example, processor 401 can be one or more central processing units (CPUs), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present invention, such as one or more digital signal processors (DSPs) or one or more field programmable gate arrays (FPGAs).

[0068] Optionally, the processor 401 can execute various functions of the electronic device 400 by running or executing the software program stored in the memory 402 and calling the data stored in the memory 402, such as executing the above Figure 3 The display method of the streaming media rearview mirror shown is based on the expansion of the driving recorder.

[0069] In a specific implementation, as an embodiment, the processor 401 may include one or more CPUs, such as Figure 3 CPU0 and CPU1 are shown in FIG.

[0070] In a specific implementation, as an example, the electronic device 400 may also include multiple processors. Each of these processors may be a single-core processor (single-CPU) or a multi-core processor (multi-CPU). The processor herein may refer to one or more devices, circuits, and / or processing cores for processing data (e.g., computer program instructions).

[0071] The memory 402 is used to store the software program for executing the solution of the present invention, and is controlled by the processor 401 to execute the software program. The specific implementation method can refer to the above method embodiment and will not be repeated here.

[0072] Alternatively, the memory 402 may be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type of dynamic storage device that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compact disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 402 may be integrated with the processor 401 or exist independently and accessed through the interface circuit ( Figure 3 (not shown) is coupled to the processor 401, which is not specifically limited in this embodiment of the present invention.

[0073] Transceiver 403 is used for communication with other electronic devices. For example, if electronic device 400 is a terminal, transceiver 403 can be used to communicate with a network device or another terminal device. For another example, if electronic device 400 is a network device, transceiver 403 can be used to communicate with a terminal or another network device.

[0074] Optionally, the transceiver 403 may include a receiver and a transmitter ( Figure 3 The receiver is used to implement a receiving function, and the transmitter is used to implement a sending function.

[0075] Optionally, the transceiver 403 may be integrated with the processor 401 or may exist independently and communicate with the electronic device 400 through an interface circuit ( Figure 3 (not shown) is coupled to the processor 401, which is not specifically limited in this embodiment of the present invention.

[0076] It is understandable that Figure 3 The structure of the electronic device 400 shown in the figure does not constitute a limitation on the electronic device. The actual electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0077] In addition, the technical effects of the electronic device 400 can refer to the technical effects of the methods described in the above method embodiments, and will not be repeated here.

[0078] It should be understood that the processor in the embodiments of the present invention may be a central processing unit (CPU), but may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc.

[0079] It should also be understood that the memory in the embodiments of the present invention may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. The non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of random access memory (RAM) are available, such as static RAM (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct rambus RAM (DR RAM).

[0080] The above embodiments can be implemented in whole or in part via software, hardware (e.g., circuits), firmware, or any other combination thereof. When implemented using software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product comprises one or more computer instructions or computer programs. When loaded or executed on a computer, the processes or functions described in accordance with the embodiments of the present invention are fully or partially performed. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired means (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium accessible by a computer or a data storage device such as a server or data center that contains a collection of one or more available media. The available medium can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media. The semiconductor media can be a solid-state drive.

[0081] It should be understood that the term "and / or" as used herein simply describes a relationship between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can represent: A alone, A and B together, or B alone. A and B can be singular or plural. Furthermore, the character " / " as used herein generally indicates an "or" relationship between the associated objects, but it may also indicate an "and / or" relationship. For specific understanding, please refer to the context.

[0082] In this disclosure, "at least one" means one or more, and "plurality" means two or more. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, "at least one of a, b, or c" can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or plural.

[0083] It should be understood that in various embodiments of the present invention, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0084] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present invention.

[0085] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0086] In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0087] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0088] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0089] If the functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the portion that contributes to the prior art, or the portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage media include various media that can store program code, such as USB flash drives, mobile hard drives, read-only memories (ROM), random access memories (RAM), magnetic disks, or optical disks.

[0090] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any modifications or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present invention should be included in the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be based on the scope of protection of the claims.

Claims

1. A display method based on a streaming media rearview mirror extended by a driving recorder, characterized in that: The method is applied to a terminal built into a vehicle, the terminal having a streaming media rearview mirror display function, and the method includes: The terminal wirelessly receives continuous image frame information from a driving recorder external to the vehicle, the continuous image frame information including complete image ciphertext information of an important frame and partial image ciphertext information of multiple consecutive frames following the important frame, the important frame and the multiple consecutive frames being image frames of the rear of the vehicle captured by the driving recorder; The terminal decrypts the complete image ciphertext information using the dynamically derived first key to obtain the complete image of the important frame; The terminal uses the dynamically derived second key to decrypt the partial image ciphertext information of the multiple continued frames respectively to obtain the partial images of the multiple continued frames; The terminal uses the complete image of the important frame and the partial images of each of the multiple continued frames to restore the complete image of each of the multiple continued frames; The terminal controls the streaming media rearview mirror to sequentially display the complete image of the important frame and the complete images of each of the multiple continued frames; The important frame is the x-th important frame, where x is an integer greater than or equal to 1. The terminal uses the dynamically derived first key to decrypt the complete image ciphertext information to obtain the complete image of the important frame, including: In the case of x=1, the terminal uses a preset root key as the input key and a preset parameter as the input parameter, and uses a key deduction algorithm to calculate the input key and the input parameter to obtain the first key, where the preset parameter is the parameter negotiated when the terminal establishes a wireless connection with the driving recorder; When x>1, the terminal uses the preset root key as the input key and the relevant image information of the x-1th important frame as the input parameter, and uses the key deduction algorithm to calculate the input key and the input parameter to obtain the first key; The terminal decrypts the complete image ciphertext information using the first key to obtain the complete image of the x-th important frame; The terminal uses the dynamically derived second key to decrypt the partial image ciphertext information of the multiple continued frames respectively to obtain the partial images of the multiple continued frames, including: The terminal uses a preset root key as an input key, and uses a frame sequence number of a specified continuation frame in the multi-frame continuation frame as an input parameter, and uses a key deduction algorithm to calculate the input key and the input parameter to obtain the second key; The terminal uses the second key to decrypt the partial image ciphertext information of the multiple continued frames respectively to obtain the partial images of the multiple continued frames.

2. The method according to claim 1, characterized in that The root key is information of K1 characters, where K1 is an integer greater than 1; the complete image of the x-1th important frame is information of K2 characters, where K2 is an integer greater than K1; the terminal uses the preset root key as the input key and uses the relevant image information of the x-1th important frame as the input parameter, and uses the key deduction algorithm to calculate the input key and the input parameter to obtain the first key, including: The terminal determines the preset root key as the input key; The terminal extracts characters K3+1 to K3+K1 from the K2 characters according to K2modK1=K3, and hashes the characters K3+1 to K3+K1 to obtain the input parameter; The terminal uses the key deduction algorithm to calculate the input key and the input parameter to obtain the first key.

3. The method according to claim 2, characterized in that The complete image of the N-frame continuous frame is restored based on the complete image of the x-1-th important frame and the related images of the N-frame continuous frame; The terminal uses the preset root key as the input key and uses partial image information of the x-1th important frame as the input parameter, and uses the key deduction algorithm to calculate the input key and the input parameter to obtain the first key, including: The terminal determines the preset root key as the input key; The terminal determines the difference between the information amount of the complete image of the x-1th important frame and the information amount of the partial image of the specified continuation frame in the N continuation frames, and hashes the information amount of the difference to obtain the input parameter; The terminal uses the key deduction algorithm to calculate the input key and the input parameter to obtain the first key.

4. A display device based on a streaming media rearview mirror connected to a driving recorder, characterized in that: The device is applied to a terminal built into a vehicle, the terminal having a streaming media rearview mirror display function, and is configured as follows: The device wirelessly receives continuous image frame information from a driving recorder external to the vehicle, the continuous image frame information including complete image ciphertext information of an important frame and partial image ciphertext information of multiple consecutive frames following the important frame, the important frame and the multiple consecutive frames being image frames of the rear of the vehicle captured by the driving recorder; The device decrypts the complete image ciphertext information using a dynamically derived first key to obtain a complete image of the important frame; The device uses the dynamically derived second key to decrypt the partial image ciphertext information of the multiple consecutive frames respectively to obtain the partial images of the multiple consecutive frames; The device uses the complete image of the important frame and the partial images of each of the multiple continued frames to restore the complete image of each of the multiple continued frames; The device controls the streaming media rearview mirror to sequentially display the complete image of the important frame and the complete images of each of the multiple continued frames; The important frame is the xth important frame, where x is an integer greater than or equal to 1. The apparatus uses a dynamically derived first key to decrypt the complete image ciphertext information to obtain a complete image of the important frame, including: In the case of x=1, the device uses a preset root key as the input key and a preset parameter as the input parameter, and calculates the input key and the input parameter using a key deduction algorithm to obtain the first key, where the preset parameter is the parameter negotiated when the device establishes a wireless connection with the driving recorder; In the case where x>1, the device uses the preset root key as the input key and uses the relevant image information of the x-1th important frame as the input parameter, and uses the key deduction algorithm to calculate the input key and the input parameter to obtain the first key; The device decrypts the complete image ciphertext information using the first key to obtain the complete image of the xth important frame; The device uses the dynamically derived second key to decrypt the partial image ciphertext information of the multiple consecutive frames respectively to obtain the partial images of the multiple consecutive frames, including: The device uses a preset root key as an input key, and uses a frame sequence number of a specified continuation frame in the multi-frame continuation frame as an input parameter, and uses a key deduction algorithm to calculate the input key and the input parameter to obtain the second key; The device uses the second key to decrypt the partial image ciphertext information of the multiple continued frames respectively to obtain the partial images of the multiple continued frames.

Images