Display method, vehicle machine and storage medium

Abstract

The invention relates to a display method, a vehicle machine and a storage medium. In response to starting of system firmware of the in-vehicle infotainment device, first hardware information of a vehicle corresponding to the in-vehicle infotainment device is obtained; reading stored signature information from a security chip of the vehicle machine, and verifying the signature information based on the first hardware information and a public key; and in response to the fact that verification hardware information obtained by verifying the signature information by using the public key is not matched with the first hardware information, displaying watermark information on each display interface of the vehicle-mounted terminal. Therefore, the displayed watermark information can give an alarm to protect intellectual property of the firmware of the vehicle-mounted infotainment system when the firmware of the vehicle-mounted infotainment system is maliciously copied.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a display method, a vehicle computer, and a storage medium. Background Art

[0002] With the increasing popularity and development of intelligent cockpits, the number of customized versions of vehicle system firmware has also increased significantly. For example, each car model has its own unique design and customization. While the system firmware version of the vehicle is being customized, how to bind the system firmware to the vehicle and how to provide warnings when the system firmware is flashed to an unauthorized vehicle to protect the intellectual property rights of the system firmware have become issues. Summary of the Invention

[0003] The embodiments of the present disclosure provide display methods, as well as corresponding vehicle computers and storage media for executing these methods.

[0004] According to a first aspect of the present disclosure, a display method is provided, which is applied to a vehicle computer, and includes: in response to the startup of the system firmware of the vehicle computer, obtaining first hardware information of a vehicle corresponding to the vehicle computer; reading stored signature information from a security chip of the vehicle computer, and verifying the signature information based on the first hardware information and a public key; in response to the verification hardware information obtained by using the public key to verify the signature information and the first hardware information not matching, displaying watermark information on each display interface of the vehicle computer.

[0005] Optionally, obtaining the first hardware information of the vehicle corresponding to the vehicle computer includes: calling a method for obtaining vehicle attributes through a vehicle attribute manager, wherein the method for obtaining vehicle attributes at least includes obtaining the first hardware information; passing the method for obtaining vehicle attributes to a vehicle service, and the vehicle service initiates a request for obtaining the first hardware information to a vehicle hardware abstraction layer through an interface, and the vehicle hardware abstraction layer is configured to subscribe to relevant hardware information from a vehicle bus when the vehicle hardware abstraction layer is initialized; the hardware abstraction layer passes the obtained first hardware information to the interface of the vehicle service, so that the vehicle service passes the first hardware information to the vehicle attribute manager.

[0006] Optionally, the method also includes: in response to not reading the signature information from the security chip, displaying watermark information on each display interface of the vehicle computer; and / or in response to not reading the signature information from the security chip, sending the first hardware information to the server, receiving the signature information sent by the server and storing it in the security chip, the signature information is generated by the server using a private key to sign the first hardware information when the first hardware information is authorized.

[0007] Optionally, the first hardware information includes at least one of the VIN code of the vehicle, the model of the vehicle and the items corresponding to the vehicle; and / or the signature information is stored in the security chip before the vehicle leaves the factory; and / or the method also includes: in response to the verification hardware information obtained by verifying the signature information using the public key and the first hardware information matching, the watermark information is not displayed on any display interface of the vehicle computer.

[0008] Optionally, verifying the signature information based on the first hardware information and the public key includes: decrypting the signature information using the public key to obtain the verification hardware information; calculating the summary information of the first hardware information using a message digest algorithm; and determining whether the verification hardware information and the first hardware information match by comparing whether the verification hardware information is consistent with the summary information.

[0009] Optionally, displaying watermark information on each display interface of the vehicle computer includes: generating a watermark layer containing the watermark information; before each hardware refresh signal of the vehicle computer arrives, synthesizing the watermark layer into the frame to be displayed to obtain a display frame, wherein the watermark layer is located at the top layer of the display frame.

[0010] According to a second aspect of the present disclosure, a display method is provided, which is applied to a vehicle computer, and includes: in response to the first startup of the system firmware of the vehicle computer, sending first hardware information of a vehicle corresponding to the vehicle computer to a server; receiving signature information generated by the server using a private key based on the first hardware information and storing it in a security chip of the vehicle computer; in response to a non-first startup of the system firmware of the vehicle computer, obtaining the first hardware information of the vehicle corresponding to the vehicle computer; reading the stored signature information from the security chip of the vehicle computer, and verifying the signature information based on the first hardware information and a public key; in response to the fact that the verification hardware information obtained by verifying the signature information using the public key does not match the first hardware information, displaying watermark information on each display interface of the vehicle computer.

[0011] According to a third aspect of the present disclosure, a vehicle computer is provided, comprising: a display screen; a processor; and a memory on which executable code is stored. When the executable code is executed by the processor, the processor executes the method described in the first or second aspect above.

[0012] According to a fourth aspect of the present disclosure, a vehicle is provided, comprising: the vehicle computer as described in the third aspect above.

[0013] According to a fifth aspect of the present disclosure, a non-transitory machine-readable storage medium is provided, on which executable code is stored. When the executable code is executed by a processor of an electronic device, the processor executes the method described in the first or second aspect above. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] The above and other objects, features and advantages of the present disclosure will become more apparent through a more detailed description of exemplary embodiments of the present disclosure with reference to the accompanying drawings, wherein like reference numerals generally represent like components in the exemplary embodiments of the present disclosure.

[0015] Figure 1 A schematic diagram illustrating a principle of protecting the intellectual property rights of system firmware by displaying a watermark according to one embodiment.

[0016] Figure 2 A schematic flow chart of a display method according to an embodiment is shown.

[0017] Figure 3 A schematic flow chart of a display method according to another embodiment is shown.

[0018] Figure 4 A structural diagram of a vehicle computer that can be used to implement the above-mentioned display method according to one embodiment is shown.

[0019] Figure 5 A side view of a portion of a vehicle provided by at least one embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0020] The preferred embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although preferred embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments described herein. Rather, these embodiments are provided to make the present disclosure more thorough and complete, and to fully convey the scope of the present disclosure to those skilled in the art.

[0021] Those skilled in the art should understand that the terms "first", "second", etc. in the specification, claims and drawings of the present disclosure are used to distinguish similar objects, rather than to describe a specific order or sequence, and have no additional limiting effect.

[0022] In related technologies, a vehicle may include various electronic devices such as electronic control units (ECUs), domain controllers (such as autonomous driving domain controllers and cockpit domain controllers), or central computing platforms. These electronic devices are connected and communicated through the vehicle's bus network. The vehicle computer can be part of the cockpit and can include one or more computing devices and system firmware running on one or more computing devices. In some examples, it can also include third-party applications running on one or more computing devices. The vehicle computer can establish a connection with one or more sensors in the cockpit, such as microphones, speakers, cameras, etc. The system firmware and third-party applications can provide vehicle-related entertainment, communication, social or other functions for the occupants of the vehicle.

[0023] The system firmware of the vehicle computer is usually in a closed loop after the vehicle is sold. The vehicle manufacturer or vehicle system supplier can upgrade the system firmware of the vehicle computer through, for example, Over The Air (OTA). However, there are no corresponding protection measures to prevent the system firmware of the vehicle computer from being copied to other unauthorized vehicles for use. Once the system firmware is leaked, it is impossible to prevent the professional technical team from "transplanting" and transplanting / copying this version of the system firmware to other unauthorized vehicles, such as vehicles of other manufacturers or other models. Moreover, these transplanted or copied system firmware can still pass the relevant authority verification. The vehicle manufacturer or vehicle system supplier cannot judge which ones are officially authorized and which ones are copied based on the system firmware alone, which causes losses to the vehicle manufacturer or vehicle system supplier, and the vehicle manufacturer or vehicle system supplier may be deceived into providing services such as OTA for the unauthorized vehicle.

[0024] To address this, the present disclosure proposes to use asymmetric encryption to generate a signature in combination with the vehicle's hardware information, and to pre-set the signature in the vehicle (such as the vehicle's security chip). When the vehicle's system firmware is started, it verifies the locally pre-set signature in combination with the locally acquired vehicle hardware information. If the verification fails, a watermark is displayed on the vehicle's display interface. The displayed watermark can serve as a warning when the vehicle's system firmware has been maliciously copied, thereby protecting the system firmware.

[0025] Figure 1 A schematic diagram illustrating a principle of protecting the intellectual property rights of system firmware by displaying a watermark warning according to an embodiment.

[0026] like Figure 1 As shown, if the system firmware of vehicle A is leaked, the system firmware of vehicle A is transplanted to unauthorized vehicle B through "grafting", such as copying. When the system firmware transplanted to vehicle B is started, a signature verification will be performed.

[0027] When porting the system firmware of vehicle A's computer to vehicle B, if the signature information of vehicle A is also ported to vehicle B, since the signature information is generated based on the hardware information of vehicle A, the signature verification will fail, and a watermark will be displayed on every display interface of vehicle B's computer.

[0028] When porting vehicle A's system firmware to vehicle B, if vehicle A's signature information is not ported to vehicle B, or if vehicle A's signature information is ported to vehicle B but the signature is maliciously deleted through rooting or other means, the signature required for signature verification will no longer exist in vehicle B. This situation can also be considered a signature verification failure, and a watermark will be displayed on every display interface of vehicle B's system.

[0029] Therefore, when the vehicle A's system firmware is transplanted to vehicle B, regardless of whether the signature of vehicle A is transplanted to vehicle B, the signature verification will fail, and watermark information will be displayed on each display interface of vehicle B's system firmware, thereby serving as a warning when the vehicle A's system firmware is maliciously copied to protect the intellectual property rights of the system firmware.

[0030] The details of the present disclosure are further illustrated below with reference to specific embodiments.

[0031] Figure 2 A schematic flow chart of a display method according to an embodiment is shown. Figure 2 The method shown is applied to a vehicle computer. Figure 2 The method shown can be executed by the system firmware of the vehicle computer to protect the system firmware.

[0032] See also Figure 2 In step S210, in response to the startup of the system firmware of the vehicle computer, first hardware information of the vehicle corresponding to the vehicle computer is obtained.

[0033] The first hardware information may include, but is not limited to, at least one of the vehicle's VIN code, the vehicle model, and a vehicle-specific item. The VIN code is the vehicle identification number. The vehicle-specific item may refer to the vehicle's onboard computer item. Different onboard computer items generally correspond to different system firmware.

[0034] In some embodiments, the type of first hardware information to be obtained can be determined based on the degree of customization of the vehicle computer's system firmware. For example, when the degree of customization of the vehicle computer's system firmware is high, such as supporting users to customize the vehicle computer's system firmware so that different vehicles of the same model can have different system firmware under the user's customization, in order to protect the intellectual property rights of the user's customized system firmware, the first hardware information may include the vehicle's VIN code to distinguish different vehicles of the same model. For another example, when vehicles of the same model have the same system firmware, and vehicles of different models have different system firmware, the first hardware information may include "vehicle model", which is hardware information that can distinguish vehicles of different models.

[0035] The following is an exemplary description of a method for obtaining the first hardware information.

[0036] The vehicle property manager (such as CarPropertyManager) is used to call a method for obtaining vehicle properties (such as a getProperty method), wherein the method for obtaining vehicle properties at least includes obtaining the first hardware information.

[0037] The vehicle attribute acquisition method is passed to the vehicle service (e.g., CarService). The vehicle service initiates a request to obtain the first hardware information from the vehicle hardware abstraction layer (e.g., VehicleHal) through an interface (e.g., IVehicle interface). The vehicle hardware abstraction layer is configured to subscribe to the relevant hardware information from the vehicle bus when the vehicle hardware abstraction layer is initialized.

[0038] The hardware abstraction layer transmits the acquired first hardware information to the interface of the vehicle service, so that the vehicle service transmits the first hardware information to the vehicle attribute manager.

[0039] Taking the Android-based smart cockpit as an example, the path to obtain the first hardware information is:

[0040] 1.1 Hardware layer: can be CAN bus driver or Ethernet;

[0041] 1.2 Hardware Abstraction Layer (HAL): Generally, the corresponding information attributes are declared in IVehicle.hal, the corresponding code is generated through HIDL, and when VehicleHal is initialized, the change events of the relevant HAL attributes are subscribed to the bus;

[0042] 1.3CarService: Initiates data request to HAL layer through IVehicle interface proxy to obtain data;

[0043] 1.4 System framework: Call the getProperty method through CarPropertyManager to obtain relevant data from the HAL layer.

[0044] The acquired first hardware information can be used to generate a hardware information string according to a certain algorithm.

[0045] In step S220, the stored signature information is read from the security chip of the vehicle computer, and the signature information is verified based on the first hardware information and the public key.

[0046] Under normal circumstances, the signature information stored in the vehicle's security chip is generated by a server (such as a cloud server or a local server) using asymmetric encryption (i.e., the private key in the asymmetric encryption algorithm) combined with the corresponding hardware information. This signature information is stored in the security chip before the vehicle leaves the factory. The private key in the asymmetric encryption algorithm is stored in the cloud. The public key in the asymmetric encryption algorithm can be stored in the vehicle, such as in the vehicle's security chip.

[0047] In some embodiments, the cloud (i.e., server) can use a message digest algorithm and an asymmetric encryption algorithm in combination with the hardware information to generate signature information. Specifically, a message digest algorithm can be used to calculate a digest of the hardware information, and then the digest is encrypted using the private key in the asymmetric encryption algorithm to obtain the signature information. The message digest algorithm can be, but is not limited to, a hash algorithm, such as the SHA256 algorithm.

[0048] Therefore, the process of verifying the signature information based on the first hardware information and the public key may include: using the public key to decrypt the signature information to obtain the verification hardware information; using the message digest algorithm to calculate the summary information of the first hardware information; by comparing whether the verification hardware information is consistent with the summary information, determining whether the verification hardware information and the first hardware information match, that is, determining whether the signature information is the signature information generated in combination with the first hardware information.

[0049] The signature information generation and verification method that combines a message digest algorithm with an asymmetric encryption algorithm is highly secure and currently virtually impossible or extremely difficult to crack, thus improving the security of signature verification. If the verification hardware information and the digest information are inconsistent, it indicates that the verification hardware information and the first hardware information do not match, meaning that the signature information was not generated by combining the first hardware information. Conversely, if the verification hardware information and the digest information are consistent, it indicates that the verification hardware information and the first hardware information match, meaning that the signature information was generated by combining the first hardware information.

[0050] In some examples, the public key and private key can be generated by a local server / cloud server before the vehicle is sold. After the key is generated, the public key is stored in the storage space of the vehicle computer, such as a security chip, by burning, making the public key difficult to be tampered with, and the private key is uploaded to the cloud server or local server.

[0051] In step S230 , in response to the verification hardware information obtained by verifying the signature information using the public key and the first hardware information not matching, watermark information is displayed on each display interface of the vehicle computer.

[0052] If the verification hardware information does not match the first hardware information, it indicates that the vehicle currently associated with the vehicle computer is unauthorized, meaning that the system firmware of the vehicle computer was illegally transplanted to the vehicle. Therefore, a watermark can be displayed on each display interface of the vehicle computer to provide a warning when the system firmware of the vehicle computer has been maliciously copied, thereby protecting the intellectual property rights of the system firmware.

[0053] The verification hardware information matches the first hardware information, indicating that the vehicle currently associated with the vehicle computer is an authorized vehicle, meaning that the system firmware has been legally installed in the vehicle. Therefore, in response to the verification hardware information obtained by verifying the signature information using the public key and the first hardware information matching, the watermark information is not displayed on any display interface of the vehicle computer. Not displaying the watermark information on any display interface of the vehicle computer may mean not performing the operation of compositing the watermark layer into the frame to be displayed, as described below.

[0054] Exemplarily, the display interface of the car computer may include the startup interface when the car computer is started, the main interface of the car computer, the recording interface during the opening of the car computer application, the main interface of the application and various sub-interfaces, etc. This application does not impose any restrictions on the type and use of the display interface.

[0055] This disclosure does not limit the specific content of the watermark information displayed on the display interface. The style of the watermark information can be customized. For example, the watermark information can be words such as "unauthorized". For example, the watermark information can also be identification information that represents the party (such as a manufacturer or user) that owns the intellectual property rights of the system firmware.

[0056] In some exemplary embodiments, a watermark layer containing watermark information can be generated and composited into the frame to be displayed before each hardware refresh signal (such as a Vsync signal) from the vehicle computer arrives to obtain a display frame. The watermark layer is located at the top layer of the display frame. Thus, the watermark information can be displayed on the display interface.

[0057] Exemplarily, the operation of generating a watermark layer can be executed when the system firmware is booted. If the verification result indicates that the verification hardware information and the first hardware information do not match, the pre-generated watermark layer is synthesized into the frame to be displayed. If the verification result indicates that the verification hardware information and the first hardware information match, the watermark layer is not synthesized into the frame to be displayed. In other words, the operation of generating a watermark layer can be executed when the system firmware is booted, without relying on the signature verification result, and whether to synthesize the watermark layer into the frame to be displayed is determined based on the signature verification result.

[0058] In the case that the signature information does not exist in the security chip of the vehicle computer, in response to the signature information not being read from the security chip, the watermark information may be directly displayed on each display interface of the vehicle computer.

[0059] There are various scenarios where the signature information might not be present in the vehicle's security chip. For example, the vehicle associated with the vehicle might be an authorized vehicle, but a malicious individual might have deleted the signature information stored in the security chip through rooting or other means. Another example is that the vehicle associated with the vehicle might be an unauthorized vehicle, and the system firmware might have been illegally installed, deleting the signature information stored in the security chip.

[0060] If there is no signature information in the security chip of the vehicle computer, the first hardware information can be sent to the server, and the signature information sent by the server is received and stored in the security chip. The signature information is generated by the server using the private key to sign the first hardware information when the first hardware information is authorized. When the server receives the first hardware information, it can verify the legitimacy of the vehicle based on the first hardware information. If the vehicle passes the legitimacy verification (for example, the vehicle model matches the system firmware), the signature information is generated and sent to the vehicle. If the vehicle fails to pass the legitimacy verification, the generation of signature information can be refused.

[0061] Figure 3 A schematic flow chart of a display method according to another embodiment is shown.

[0062] like Figure 3 As shown, in response to the first startup of the system firmware of the vehicle computer, the vehicle computer can send the first hardware information of the vehicle corresponding to the vehicle computer to the server. For the method of obtaining the first hardware information, please refer to the relevant description above.

[0063] Next, the server generates signature information using a private key based on the first hardware information and stores it in the vehicle computer. For example, the system firmware may write the signature information sent by the server to a specific partition. This specific partition cannot be restored by the user by restoring system settings, and the user cannot access the cached data. For example, the data may be stored in the vehicle computer's security chip.

[0064] Regarding the method for obtaining the first hardware information and the method for the server to generate the signature information, please refer to the relevant description above.

[0065] The first startup of the vehicle computer's system firmware is generally completed by the equipment manufacturer before the vehicle leaves the factory.

[0066] By caching the signature information in the vehicle computer when the system firmware of the vehicle computer is started for the first time, the device does not need to be connected to the Internet for verification after leaving the factory, which lowers the verification threshold and speeds up the verification speed.

[0067] If a malicious user deletes the cached signature information of the device through rooting, the device's watermark may be displayed again. After the device restarts and connects to the network, the server will re-issue the signature and cache it, achieving the purpose of re-authorization. If a malicious user obtains the signature information of the device through rooting, the signature information contains specific hardware information and cannot be used to authorize other devices.

[0068] In response to a non-first startup of the vehicle computer's system firmware, first hardware information of the vehicle corresponding to the vehicle computer is obtained. Next, the stored signature information is read from the vehicle computer's security chip, and the signature information is verified based on the first hardware information and the public key. In response to the verification hardware information obtained by using the public key to verify the signature information and the first hardware information not matching, watermark information is displayed on each display interface of the vehicle computer. For the step flow of the non-first startup of the vehicle computer's system firmware, please refer to the above combined with Figure 2 Description.

[0069] Figure 4 A structural diagram of a vehicle computer that can be used to implement the above-mentioned display method according to one embodiment is shown.

[0070] See also Figure 4 The vehicle computer 400 may include a display screen 410 , a processor 420 and a memory 430 .

[0071] Processor 420 may be a multi-core processor or may include multiple processors. In some embodiments, processor 420 may include a general-purpose main processor and one or more specialized coprocessors, such as a graphics processing unit (GPU) or a digital signal processor (DSP). In some embodiments, processor 420 may be implemented using customized circuits, such as application-specific integrated circuits (ASICs) or field-programmable gate arrays (FPGAs).

[0072] Memory 430 may include various types of storage units, such as system memory, read-only memory (ROM), and permanent storage devices. ROM may store static data or instructions required by processor 420 or other modules of the computer. Permanent storage devices may be readable and writable storage devices. Permanent storage devices may be non-volatile storage devices that retain stored instructions and data even when the computer is powered off. In some embodiments, the permanent storage device uses a large-capacity storage device (e.g., a magnetic or optical disk, flash memory) as the permanent storage device. In other embodiments, the permanent storage device may be a removable storage device (e.g., a floppy disk, optical drive). System memory may be a readable and writable storage device or a volatile readable and writable storage device, such as dynamic random access memory. System memory may store some or all instructions and data required by the processor during operation. In addition, memory 430 may include any combination of computer-readable storage media, including various types of semiconductor memory chips (DRAM, SRAM, SDRAM, flash memory, programmable read-only memory), and magnetic disks and / or optical disks may also be used. In some embodiments, the memory 430 may include a readable and / or writable removable storage device, such as a compact disc (CD), a read-only digital versatile disc (e.g., DVD-ROM, dual-layer DVD-ROM), a read-only Blu-ray disc, an ultra-density optical disc, a flash memory card (e.g., SD card, mini SD card, Micro-SD card, etc.), a magnetic floppy disk, etc. Computer-readable storage media do not include carrier waves and transient electronic signals transmitted wirelessly or by wire.

[0073] The memory 430 stores executable codes. When the executable codes are processed by the processor 420 , the processor 420 can execute the display method described above.

[0074] The present disclosure also provides a vehicle, comprising the vehicle computer mentioned above.

[0075] Figure 5 A side view of a portion of a vehicle provided by at least one embodiment of the present disclosure is shown. Figure 5 In the example of FIG, vehicle 1210 is a type of vehicle that can carry passengers (e.g., a car, truck, or other automotive vehicle). Configurations in which vehicle 1210 is a robot (e.g., an autonomous robot) or other vehicle that does not carry human passengers may also be used. Figure 5 As shown, vehicle 1210 may be operating on, for example, road 1211 .

[0076] Vehicle 1210 may be manually driven (e.g., by a human driver), may be operated via remote control, and / or may be operated autonomously (e.g., by an autonomous driving system or other autonomous propulsion system). Using vehicle sensors such as lidar, radar, visible light and / or infrared cameras (e.g., two-dimensional and / or three-dimensional cameras), proximity (range) sensors, and / or other sensors, an autonomous driving system and / or driver assistance system in vehicle 1210 may perform automatic braking, steering, and / or other maneuvers to help avoid pedestrians, inanimate objects, and / or other external structures, such as exemplary obstacle 1212 on road 1211.

[0077] Vehicle 1210 may include a vehicle body, such as body 1213. Body 1213 may include vehicle structure, such as body panels formed from metal and / or other materials, and may include doors, a hood, a trunk, fenders, a chassis on which wheels are mounted, a roof, etc. Windows may be formed in doors 1214 (e.g., on the sides of body 1213, on the roof of vehicle 1210, and / or in other parts of vehicle 1210). Windows, doors 1214, and other parts of body 1213 may separate the interior of vehicle 1210 from the external environment surrounding vehicle 1210. Doors 1214 may open and close to allow people to enter and exit vehicle 1210. Seats and other structures may be formed in the interior of body 1213.

[0078] The vehicle 1210 may have automotive lighting, such as one or more headlights (sometimes referred to as headlamps), driving lights, fog lights, daytime running lights, turn signals, brake lights, and / or other lights. Figure 5 As shown, for example, vehicle 1210 may have lights, such as light 1215. Generally, light 1215 may be mounted on the front F of vehicle 1210, on the rear R of vehicle 1210, on the left and / or right sides W of vehicle 1210, and / or on other parts of vehicle body 1213 (e.g., the interior of vehicle 1210). As an example, there may be left and right headlights 1215 located on the left and right sides of vehicle 1210, respectively, to illuminate the vehicle in a forward direction (e.g., in the vehicle 1210). Figure 5 In the example, the vehicle 1210 is provided with illumination 1217 in the X direction (in the example, the X direction in which the vehicle 1210 moves when traveling forward). By illuminating the exterior surfaces 1216 in front of the vehicle 1210, such as the road 1211 and the exemplary obstacle 1212, with the left and right headlights 1215, the driver or passengers of the vehicle 1210 can see even in dim ambient lighting conditions (e.g., at night). The operation of sensors in the vehicle 1210, such as image sensors and other sensors that use light, can also be supported by providing illumination of the road 1211.

[0079] Vehicle 1210 may have an onboard terminal (e.g., a vehicle-mounted computer described herein) 1218. Vehicle-mounted terminal 1218 may include control circuitry and / or input-output devices. The control circuitry in vehicle-mounted terminal 1218 may be configured to run the underlying vehicle-mounted computer operating system, autonomous driving applications, navigation applications (e.g., an application for displaying a map on a display), and software for controlling vehicle temperature control, lighting, media playback, window lifts, door operation, sensor operation, and / or other vehicle operations. For example, a portion of the vehicle-mounted computer system may form an autonomous driving system that uses data, such as sensor data, to automatically drive vehicle 1210 on a road, such as road 1211. The control circuitry may include processing circuitry and memory and may be configured to perform operations in vehicle 1210 using hardware (e.g., dedicated hardware or circuitry), firmware, and / or software. Software code and other data used to perform operations in vehicle 1210 are stored on a non-transitory computer-readable storage medium (e.g., a tangible computer-readable storage medium) in the control circuitry. Software code may sometimes be referred to as software, data, program instructions, computer instructions, or code. The non-transitory computer-readable storage medium may include non-volatile memory, such as non-volatile random access memory, one or more hard disk drives (e.g., magnetic disk drives or solid-state drives), one or more removable flash drives or other removable media, or other memory. The software stored on the non-transitory computer-readable storage medium may be executed on the processing circuit of the vehicle terminal 1218. The processing circuit may include an application-specific integrated circuit having processing circuitry, one or more microprocessors, a central processing unit (CPU), or other processing circuitry.

[0080] The input-output device of the vehicle terminal 1218 may include a display, a button, a microphone, a speaker and / or user input and other devices for providing output. The input device can be used to receive input digital or character information, and to generate signal input related to the settings and function controls of the driver, passengers and other people of the vehicle 1210. Specifically, the input device may include a touch panel and other input devices (such as a microphone, buttons in the vehicle, etc.). The touch panel, also known as a touch screen, can collect touch operations performed by the driver, passengers and other people of the vehicle 1210 on or near it (such as operations performed by a user using a finger (such as a single finger or multiple fingers), a stylus or any other suitable object or accessory on or near the touch panel), and drive the corresponding connection device according to a pre-set program.

[0081] The output device of the vehicle-mounted terminal 1218 may be used to provide audio output, visual output (eg, display content, etc.), and / or other suitable output to the driver, passengers, and others of the vehicle 1210 .

[0082] The visual output device of the vehicle terminal 1218 can be divided into two categories. The first category is the vehicle display screen; the second category is the projection display screen, such as a head-up display (HUD). The vehicle display screen is a physical display screen and an important part of the vehicle system. The vehicle 1210 can be provided with multiple display screens, such as a digital instrument display screen, a central control screen, a display screen in front of the passenger on the co-pilot seat (also called the front passenger), a display screen in front of the left rear passenger, and a display screen in front of the right rear passenger. Even the car window can be used as a display screen for display. Head-up display, also known as head-up display system. It is mainly used to display driving information such as speed and navigation on a display device in front of the driver (such as a windshield). To reduce the driver's line of sight diversion time, avoid pupil changes caused by the driver's line of sight diversion, and improve driving safety and comfort. HUD includes, for example, a combined head-up display (C-HUD) system, a windshield head-up display (W-HUD) system, and an augmented reality head-up display (AR-HUD) system.

[0083] One or more vehicle-mounted display screens (or vehicle-mounted screens) are provided inside the vehicle 1210, including but not limited to the main driver's display screen (or, it can also be called the central control screen), the co-driver's display screen (or, it can also be called the co-driver's entertainment screen), the rear seat display screen (such as the screen behind the main driver's headrest, or, the screen behind the co-driver's headrest) and the instrument screen. In some possible implementations, the main driver's display screen can also be a long screen (such as a fish-eye screen) extending to the co-driver area. Any of the above-mentioned display screens can display a graphical user interface (GUI), which can include icons / running interfaces of one or more applications, and / or one or more cards. For example, an audio playback window of the vehicle system can be displayed on a display screen (such as a main driver's display screen or a co-driver's display screen or a rear seat display screen or other display screens), and the above-mentioned audio playback window can be displayed on the display screen in the form of a card, or displayed on the display screen in the form of a floating window. For example, the audio playback window can be draggable on the display screen, and the user or any person in the vehicle 1210 can drag the audio playback window to any area of ​​the display screen. Alternatively, the audio playback window can be enlarged or reduced on the display screen. In some examples, when the audio playback window is enlarged beyond a certain proportion of the display screen (for example, more than 50% or other proportion), the audio playback window is displayed in full screen on the display screen. When the audio playback window is reduced beyond a certain proportion of the display screen (for example, less than 10% or other proportion), the audio playback window is minimized or displayed as a card in a fixed area of ​​the display screen.

[0084] Vehicle 1210 may have components 1219, which may include, for example, propulsion and steering systems (e.g., a manually adjustable steering system and / or a steering system having wheels (not shown) coupled to body 1213, steering controls, one or more motors for driving the wheels, etc.) and other vehicle components. Components 1219 may also include other input-output devices within vehicle 1210, such as sensors, haptic devices, speakers, and / or other devices for collecting environmental measurements, information about vehicle operation, and / or user input, and for providing output. The sensors in component 1219 may include ambient light sensors, touch sensors, force sensors, proximity sensors, optical sensors such as cameras operating at visible, infrared, and / or ultraviolet wavelengths (e.g., fisheye cameras, two-dimensional cameras, three-dimensional cameras, and / or other cameras), capacitive sensors, resistive sensors, ultrasonic sensors (e.g., ultrasonic distance sensors), microphones, radio frequency sensors such as radar sensors, lidar (light detection and ranging) sensors, door open / close sensors, seat pressure sensors and other vehicle occupant sensors, window sensors, position sensors for monitoring position, orientation, and movement, speedometers, satellite positioning system sensors, and / or other sensors. The output devices in component 1219 may be used to provide tactile output (e.g., vibration of a vehicle seat), audio output (e.g., a speaker), visual output (e.g., lights, etc.), and / or other suitable outputs to vehicle occupants and other persons or the vehicle's external environment.

[0085] The three-dimensional sensor in component 1219 can be formed by a pair of two-dimensional image sensors that together act as a stereo depth sensor (e.g., a binocular camera pair formed at a three-dimensional camera). A three-dimensional sensor can also be formed using an image sensor system that emits structured light (e.g., an array of dots, lines, grids, and / or other structured light patterns of infrared and / or visible wavelengths) and captures images (e.g., two-dimensional images) for analysis. The captured image shows how the structured light pattern is distorted by the three-dimensional surface illuminated by the structured light pattern. By analyzing the distortion of the structured light, the three-dimensional shape of the surface can be reconstructed. If desired, the three-dimensional sensor of vehicle 1210 may include one or more time-of-flight sensors. For example, time-of-flight measurements can be performed using light (e.g., lidar sensor measurements) and radio frequency signals (e.g., three-dimensional radar).

[0086] During operation, component 1219 may collect information from sensors and / or other input-output devices, such as lidar data, camera data (e.g., two-dimensional images), radar data, and / or other sensor data. For example, a three-dimensional image sensor may be used to capture three-dimensional image data. Two-dimensional images (e.g., Figure 5 headlight illumination image on one or more areas of the road 1211).

[0087] The driver, passengers, or other users of vehicle 1210 can provide user input to the vehicle-mounted terminal 1218 and / or component 1219. Cameras, touch sensors, physical controls (e.g., steering wheels, brakes, etc.), and other input devices can be used to collect user input. Remote data sources can provide database information to the vehicle-mounted terminal 1218 and / or component 1219 by wirelessly communicating with vehicle 1210. Display screens, speakers, and other output devices can be used to provide content to the user, such as interactive on-screen menu options and audio. The user can interact with this interactive content by providing touch input to the touch sensors in the display and / or by providing user input using other input devices. If necessary, the control circuitry of vehicle 1210 can use sensor data, user input, information from a remote database, and / or other information (e.g., information about nearby obstacles on the road and / or other surroundings around vehicle 1210) to provide driver assistance information to the driver and / or autonomously drive vehicle 1210.

[0088] Component 1219 may include forward sensor circuitry, such as that comprised of Figure 5 The forward sensor circuit may include one or more sensors facing the surface in front of the vehicle 1210 (e.g., oriented Figure 5 One or more sensors in the X direction are used to detect structures in front of vehicle 1210, such as obstacle 1212 and surface 1216 of road 1211. For example, forward sensor 1220 can be a lidar, millimeter wave radar, ultrasonic radar, or any other sensor that can detect structures in front of vehicle 1210.

[0089] The vehicle 1210 may have a battery 12A, which may be located at the bottom, head, or tail of the vehicle 1210. The battery 12A may be used to power a lighting system (e.g., a lamp 1215), components 1219 (e.g., a motor in a propulsion system, an operating system for a vehicle computer, etc.), or other unillustrated parts of the vehicle 1210. For example, the battery 12A may be used to start the vehicle 1210, power the vehicle computer system, the air conditioning system, and power consumption during driving. For example, the battery 12A may include a battery module composed of multiple batteries or multiple battery cells as described in any example of the present disclosure, or may include a battery pack composed of multiple battery modules. In some examples, the battery pack includes multiple battery modules, a mechanical system (e.g., a battery pack cover, a tray, a metal bracket, etc.), an electrical system (e.g., a high-voltage wiring harness, a low-voltage wiring harness, and relays, etc.), a thermal management system (e.g., a water cooling, liquid cooling, or air cooling system, etc.), and a BMS (Battery Management System). In other examples, the battery pack may be directly composed of more batteries or more battery cells. For example, more batteries or more battery cells may be integrated on the chassis of the vehicle 1210 using CTC (Cell To Chassis) technology, thereby eliminating the design of the battery module.

[0090] The display method, vehicle computer, and vehicle according to the present disclosure have been described above in detail with reference to the accompanying drawings.

[0091] In addition, the method according to the present disclosure may also be implemented as a computer program or a computer program product, which includes computer program code instructions for executing the above steps defined in the above method of the present disclosure.

[0092] Alternatively, the present disclosure may also be implemented as a non-transitory machine-readable storage medium (or computer-readable storage medium, or machine-readable storage medium) on which executable code (or computer program, or computer instruction code) is stored. When the executable code (or computer program, or computer instruction code) is executed by a processor of an electronic device (or computing device, server, etc.), the processor is caused to perform the various steps of the above-mentioned method according to the present disclosure.

[0093] Those skilled in the art will further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both.

[0094] The flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems and methods according to multiple embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment or part of code, and the part of the module, program segment or code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0095] While various embodiments of the present disclosure have been described above, the above descriptions are illustrative, non-exhaustive, and not intended to be limiting of the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is selected to best explain the principles of the embodiments, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. A display method, applied to a vehicle computer, comprising: In response to the activation of the system firmware of the vehicle computer, obtaining first hardware information of a vehicle corresponding to the vehicle computer; Reading the stored signature information from the security chip of the vehicle computer, and verifying the signature information based on the first hardware information and the public key; In response to the verification hardware information obtained by using the public key to verify the signature information and the first hardware information not matching, watermark information is displayed on each display interface of the vehicle computer.

2. The method according to claim 1, wherein Obtaining first hardware information of a vehicle corresponding to the vehicle computer includes: Calling a method for obtaining vehicle attributes through a vehicle attribute manager, wherein the method for obtaining vehicle attributes at least includes obtaining the first hardware information; Passing a method for obtaining vehicle attributes to a vehicle service, the vehicle service initiating a request for obtaining the first hardware information to a vehicle hardware abstraction layer through an interface, the vehicle hardware abstraction layer being configured to subscribe to relevant hardware information from a vehicle bus when the vehicle hardware abstraction layer is initialized; The hardware abstraction layer transmits the acquired first hardware information to the interface of the vehicle service, so that the vehicle service transmits the first hardware information to the vehicle attribute manager.

3. The method according to claim 1, further comprising: In response to not reading signature information from the security chip, displaying watermark information on each display interface of the vehicle computer; and / or In response to not reading the signature information from the security chip, the first hardware information is sent to the server, the signature information sent by the server is received and stored in the security chip, and the signature information is generated by the server using a private key to sign the first hardware information when the first hardware information is authorized.

4. The method according to claim 1, wherein The first hardware information includes at least one of the VIN code of the vehicle, the model of the vehicle, and an item corresponding to the vehicle; and / or The signature information is stored in the security chip before the vehicle leaves the factory; and / or The method further includes: in response to verification hardware information obtained by using the public key to verify the signature information and the first hardware information matching, not displaying the watermark information on any display interface of the vehicle computer.

5. The method according to claim 1, wherein Verifying the signature information based on the first hardware information and the public key includes: Decrypt the signature information using the public key to obtain the verification hardware information; Calculate the summary information of the first hardware information using a message digest algorithm; By comparing the verification hardware information with the summary information to determine whether they are consistent, it is determined whether the verification hardware information matches the first hardware information.

6. The method according to claim 1, wherein Displaying watermark information on each display interface of the vehicle computer includes: generating a watermark layer including the watermark information; Before each hardware refresh signal of the vehicle computer arrives, the watermark layer is synthesized into the frame to be displayed to obtain a display frame, wherein the watermark layer is located at the top layer of the display frame.

7. A display method, applied to a vehicle computer, comprising: In response to the first startup of the system firmware of the vehicle computer, sending first hardware information of the vehicle corresponding to the vehicle computer to the server; receiving signature information generated by the server using a private key according to the first hardware information and storing the signature information in the security chip of the vehicle computer; In response to a non-first startup of the system firmware of the vehicle computer, obtaining first hardware information of a vehicle corresponding to the vehicle computer; Reading the stored signature information from the security chip of the vehicle computer, and verifying the signature information based on the first hardware information and the public key; In response to the verification hardware information obtained by using the public key to verify the signature information and the first hardware information not matching, watermark information is displayed on each display interface of the vehicle computer.

8. A vehicle computer, comprising: Display screen; processor; A memory having executable codes stored thereon, which, when executed by the processor, causes the processor to perform the method according to any one of claims 1 to 7.

9. A vehicle comprising: The vehicle computer according to claim 8.

10. A non-transitory machine-readable storage medium having executable codes stored thereon, which, when executed by a processor of an electronic device, causes the processor to perform the method according to any one of claims 1 to 7.

Images