A system for remotely upgrading controller firmware over a display
By remotely upgrading the server and display system, remote upgrades of the controller firmware were achieved, solving the problems of high cost and time impact of manual upgrades, and improving upgrade efficiency and security.
Patent Information
- Application Number
- CN202211359942.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-11-02
- Publication Date
- 2026-02-24
- Estimated Expiration
- 2042-11-02
AI Technical Summary
In existing technologies, manually upgrading the controller firmware on the vehicle by maintenance personnel results in high costs and affects the owner's working time.
The system employs a remote upgrade server, display screen, and controller. The controller firmware is remotely upgraded via the display screen. This includes a communication connection between the remote upgrade server and the display screen, a communication connection between the display screen and the controller, the remote upgrade server sending upgrade firmware to the display screen, the display screen sending the upgrade firmware to the controller, and the controller receiving and upgrading the firmware.
It greatly shortens the upgrade operation time, reduces manpower and material expenditures, saves upgrade costs, reduces the impact on car owners' working hours, and improves the convenience and safety of the upgrade.
Smart Images

Figure CN115794149B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of firmware upgrades, and more particularly to a system for remotely upgrading controller firmware via a display screen. Background Technology
[0002] With the development of automotive technology, more and more controllers are installed on the vehicle body, providing more precise control and displaying vehicle information data intuitively on the screen. Whether it's upgrading functions or fixing defects, controller upgrades are inevitable. Furthermore, the more controllers installed on the vehicle body, the more complex the overall electronic system becomes, and the more coupling occurs between controllers, making firmware upgrades even more crucial.
[0003] In the existing technology, the method of upgrading the firmware of the controller is generally to have maintenance personnel manually perform the upgrade operation on the vehicle. This upgrade method is not only costly, but may also affect the owner's working time. Summary of the Invention
[0004] The purpose of this invention is to disclose a system for remotely upgrading controller firmware via a display screen, thereby solving the problem of high costs and reduced working time for vehicle owners caused by manual firmware upgrades performed by maintenance personnel on vehicles in the prior art.
[0005] To achieve the above objectives, the present invention adopts the following technical solution:
[0006] A system for remotely upgrading controller firmware via a display screen includes a remote upgrade server, a display screen, and a controller;
[0007] Remote upgrade server and display screen communication connection;
[0008] The display screen communicates with the controller;
[0009] The remote upgrade server is used to send upgrade firmware to the display screen;
[0010] The display screen is used to receive upgrade firmware sent from the remote upgrade server, and to send the upgrade firmware to the controller;
[0011] The controller is used to receive the upgrade firmware sent from the display screen, and to upgrade its own firmware using the upgrade firmware.
[0012] Optionally, the display screen includes a power module, a first processing module, a wireless module, a display module, and a bus communication module;
[0013] The power supply module is used to supply power to the first processing module, the wireless module, the display module, and the bus communication module;
[0014] The first processing module is used to provide computing power and run remote upgrade applications;
[0015] The wireless module is used for communication with the remote upgrade server;
[0016] The display module is used to display vehicle data and firmware upgrade progress;
[0017] The bus communication module is used to enable communication between the remote upgrade application and the controller, and to send the upgrade firmware to the controller.
[0018] Optionally, the display module is also used to display vehicle control buttons.
[0019] Optionally, the first processing module is also used to run the drivers for the wireless module, the display module, and the bus communication module.
[0020] Optionally, the bus communication module is also used to receive vehicle data transmitted from the controller and to send control commands to the controller.
[0021] Optionally, the controller includes a second processing module and a bus module;
[0022] The bus module is used to communicate with the bus communication module and receive upgraded firmware from the bus communication module;
[0023] The second processing module is used to upgrade its own firmware using the upgrade firmware.
[0024] Optionally, the bus communication module includes a CAN bus or an RS-232 bus.
[0025] Optionally, the display screen is connected to the remote upgrade server via Ethernet.
[0026] This invention enables remote upgrades to vehicle controller firmware, significantly shortening upgrade time, reducing manpower and material costs, thereby saving upgrade costs and minimizing the impact of firmware upgrades on vehicle owners' working hours. Attached Figure Description
[0027] The present invention will be further described with reference to the accompanying drawings, but the embodiments in the drawings do not constitute any limitation on the present invention. For those skilled in the art, other drawings can be obtained based on the following drawings without creative effort.
[0028] Figure 1 This is a diagram illustrating one embodiment of a system for remotely upgrading controller firmware via a display screen according to the present invention.
[0029] Figure 2 This is a diagram illustrating one embodiment of the display screen of the present invention. Detailed Implementation
[0030] Embodiments of the present invention are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and should not be construed as limiting the present invention.
[0031] like Figure 1 As shown in one embodiment, the present invention provides a system for remotely upgrading controller firmware via a display screen, comprising a remote upgrade server, a display screen, and a controller;
[0032] Remote upgrade server and display screen communication connection;
[0033] The display screen communicates with the controller;
[0034] The remote upgrade server is used to send upgrade firmware to the display screen;
[0035] The display screen is used to receive upgrade firmware sent from the remote upgrade server, and to send the upgrade firmware to the controller;
[0036] The controller is used to receive the upgrade firmware sent from the display screen, and to upgrade its own firmware using the upgrade firmware.
[0037] This invention enables remote upgrades to vehicle controller firmware, significantly shortening upgrade time, reducing manpower and material costs, thereby saving upgrade costs and minimizing the impact of firmware upgrades on vehicle owners' working hours.
[0038] Firmware upgrades can be performed remotely, eliminating the need for car owners to drive their vehicles to authorized service centers like 4S stores for the upgrade. This greatly increases the convenience of the upgrade process and saves car owners time.
[0039] If the traditional local upgrade method is used, the car owner needs to drive the vehicle to the after-sales service center, and the after-sales service center also needs to prepare special staff to perform firmware upgrades, which leads to an increase in after-sales costs.
[0040] Optionally, the remote upgrade server includes a permission recognition module, an upload module, a storage module, and a push module;
[0041] The permission identification module is used to identify the permissions of staff using the upload module and determine whether the staff have upload privileges.
[0042] The upload module is used by staff with upload permissions to upload upgraded firmware;
[0043] The storage module is used to store upgrade firmware;
[0044] The push module is used to push the upgraded firmware to the display screen.
[0045] Optionally, the permission recognition module includes a camera unit, a storage unit, and a recognition unit;
[0046] The camera unit is used to capture facial images of staff members;
[0047] The storage unit is used to store facial images of staff members who have access to the upload module;
[0048] The recognition unit is used to compare the facial image captured by the camera unit with the facial image stored in the storage unit to determine whether the staff using the upload module have upload permissions.
[0049] By performing permission verification, the security of the remote firmware upgrade process of this invention can be improved, preventing unauthorized personnel from uploading malicious code and affecting the security of remote upgrades.
[0050] Optionally, acquiring the facial image of the staff member includes:
[0051] S1, take photos of the staff to obtain their facial images;
[0052] S2, calculates the capture coefficient of the face image;
[0053] S3: If the shooting coefficient is greater than the set shooting coefficient threshold, the face image is transmitted to the recognition unit; if the shooting coefficient is less than or equal to the set shooting coefficient threshold, the process returns to S1.
[0054] During the shooting process, a judgment based on the shooting coefficient was performed. Image recognition processing was applied to facial images that met the shooting coefficient requirements, which effectively improved the efficiency of permission recognition. If the shooting coefficient of the obtained facial image is very low, the facial image has defects such as blurriness and unclear edges, indicating that the facial image does not meet the requirements for permission recognition. If the above judgment step is not set during the shooting process, facial images with very low shooting coefficients will only be detected as permission verification failures after the complete image recognition process. At this time, staff will be prompted that they do not have upload permissions or be prompted to adjust the angle and retake the facial image. The recognition process of the complete facial image takes a long time, which will lead to an increase in the average recognition time after multiple permission recognitions, thus reducing the efficiency of permission recognition.
[0055] Optionally, the calculation of the shooting coefficient of the face image includes:
[0056] Edge detection is performed on the face image to obtain the set of edge pixels, colouredg;
[0057] Calculate the edge coefficient for each edge pixel in colofedg;
[0058] Store edge pixels whose edge coefficient is greater than the set coefficient threshold value into the collection bigedgthr;
[0059] The shooting coefficient is calculated based on bigedgthr.
[0060] By employing edge detection first, this invention effectively reduces the number of pixels involved in calculating edge coefficients, thereby reducing the number of pixels involved in calculating image capture coefficients. The inventors discovered that using the number of edge pixels and the values of surrounding pixels can reflect the sharpness of a facial image and the smoothness of pixel value distribution, without needing to calculate image capture coefficients based on all pixels. Therefore, the above-described embodiments of this invention effectively improve the calculation speed of image capture coefficients.
[0061] Optionally, the edge coefficient is calculated using the following formula:
[0062]
[0063] Among them, edgcoef d The edge coefficient of pixel d is represented by α and β, and the weight coefficients are represented by numofmdl. d This represents the number of pixels within a preset detection window (decw) that conform to the defined detection model (decmol). (numofl) d This represents the total number of pixels contained in decw, numofner d This indicates the number of other edge pixels contained in decw.
[0064] The edge coefficient is mainly considered from two aspects: the number of pixels that satisfy the detection model and the number of other edge pixels it contains. The more pixels that satisfy the detection model and the more other edge pixels it contains, the higher the probability that the edge pixel is a true edge pixel. This allows the present invention to remove noise pixels that are incorrectly identified as edge pixels from the coloredg set by using the edge coefficient before edge detection, thus improving the accuracy of the image capture. If filtering is performed before edge detection, all pixels need to be filtered. However, since the present invention uses the edge coefficient for filtering after edge detection, only the edge coefficient needs to be processed, significantly reducing the number of pixels that need to be calculated and improving the efficiency of the present invention in judging face images.
[0065] Optionally, the detection model decmol can be selected as follows:
[0066] like The Modone model is selected as the detection model decimol:
[0067]
[0068] like The Modtwo model is selected as the detection model decmol:
[0069]
[0070] Wherein, novLegd represents the number of pixels in colouredg with a grayscale value greater than the set grayscale threshold, N represents the number of pixels in the face image, T represents the set proportional threshold, R(x,y), G(x,y), and B(x,y) represent the values of the red, green, and blue components of the pixel at coordinates (x,y) in the RGB color space, respectively, baseR, baseG, and baseB represent the preset base detection values of the red, green, and blue components, respectively, and lumsca represents the adaptive scaling parameter. λ represents the control parameter, used to control baseR×lumsca to be less than 219, baseG×lumsca to be less than 209, and baseB×lumsca to be less than 168.
[0071] In the above embodiments, the present invention does not employ a fixed detection model, but rather... By comparing the detection model with a proportional threshold T, the appropriate detection model can be adaptively selected, improving the matching degree between the detection model of this invention and the actual pixel value distribution of the facial image, thereby improving the accuracy of the edge coefficient. In this invention, the detection model is mainly used to select the correct pixels in the facial skin region. Traditional detection models generally use fixed detection parameters without considering the actual lighting conditions during shooting. Using the same detection model under both sufficient and insufficient lighting conditions will certainly make it difficult to accurately acquire pixels in the skin region under both circumstances. Furthermore, in the Modtwo model, this invention also sets an adaptive scaling factor, allowing the parameters in the model to adaptively increase with the increase in lighting conditions, thereby further improving the accuracy of selecting pixels in the facial skin region.
[0072] Optionally, the shooting coefficient is calculated using the following formula:
[0073]
[0074] Where shotcoef represents the shooting coefficient, δ represents the scaling parameter, nfbigedgthr represents the number of elements in bigedgthr, nfcolofedg represents the number of pixels contained in colofedg, and nei i L represents the set of pixels within a preset size neighborhood of pixel i in bigedgthr. j Indicates nei i The luminance component value of pixel j in nfnei i Indicates nei i The number of pixels contained therein, and vaster represents the average variance of the set luminance component values.
[0075] Specifically, the image capture factor primarily considers the number of edge pixels before and after filtering, as well as the smoothness of pixel values around the edge pixels. The smaller the difference in the number of edge pixels before and after filtering, the higher the clarity of the facial image and the more prominent the edges. Conversely, the greater the smoothness of pixel values around the edge pixels, the larger the value to the right of the plus sign in the above calculation will be. Higher smoothness indicates a more uniform illumination distribution, further increasing the probability of selecting high-definition facial images with uniform illumination. This leads to a higher success rate for high-privilege facial recognition.
[0076] Optionally, comparing the facial image acquired by the camera unit with the facial image stored in the storage unit to determine whether the staff member using the upload module has upload permissions includes:
[0077] The facial images acquired by the camera unit are processed for image segmentation to obtain segmented images;
[0078] The segmented image is compared with the facial image stored in the storage unit to determine whether the staff member using the upload module has upload privileges.
[0079] Specifically, after obtaining the segmented image of the face image acquired by the camera unit, the face image stored in the storage unit is also segmented to obtain the corresponding segmented image. The degree of matching between the two segmented images is used to determine whether there is upload permission. The more similar the two segmented images are, the higher the degree of matching, which means that the staff using the upload module have the probability of having upload permission.
[0080] Optionally, the step of performing image segmentation processing on the facial image acquired by the camera unit to obtain a segmented image includes:
[0081] The maximum and minimum pixel values of the pixels in bigedgthr are represented by mavalue and mivalue, respectively;
[0082] The facial images captured by the camera unit are subjected to noise reduction processing to obtain a noise-reduced image;
[0083] Store the pixels in the denoised image into the set colpixfac;
[0084] Remove pixels whose pixel values are in the range [mavalue, 255] or [0, 255 - mavalue] from the set colpixfac, and obtain the set colpixfac'.
[0085] The Otsu algorithm is used to calculate the segmentation threshold segthr for the pixels in colpixfac'.
[0086] The face image is segmented using segthr, and the segmented image is composed of pixels with pixel values greater than segthr.
[0087] Unlike existing OTS methods that directly segment the entire face image, this invention reduces the number of pixels involved in the OTS calculation process by using the aforementioned two pixel value ranges, thereby improving the speed of face image acquisition. Because `mavalue` is larger than `segthr`, pixels with values greater than `mavalue` are included in the subsequently obtained segmented image, while pixels with values in the range [0, 255 - `mavalue`] are background pixels. In this invention, since the set of edge pixels has already been calculated during the shooting stage, this invention utilizes the previous calculation results to directly remove pixels with values greater than the maximum value of edge pixels, as well as smaller portions of symmetrical pixels, from the set `colpixfac`, effectively reducing the number of pixels involved in the OTS calculation process and thus improving the efficiency of acquiring segmented images.
[0088] Optional, such as Figure 2 As shown, the display screen includes a power module, a first processing module, a wireless module, a display module, and a bus communication module;
[0089] The power supply module is used to supply power to the first processing module, the wireless module, the display module, and the bus communication module;
[0090] The first processing module is used to provide computing power and run remote upgrade applications;
[0091] The wireless module is used for communication with the remote upgrade server;
[0092] The display module is used to display vehicle data and firmware upgrade progress;
[0093] The bus communication module is used to enable communication between the remote upgrade application and the controller, and to send the upgrade firmware to the controller.
[0094] The power module is used to process the power supplied by the car and supply it to the corresponding modules according to the different voltage and current requirements of other modules in the display screen.
[0095] Optionally, the wireless module can communicate with the remote upgrade server via a 4G communication network, a 5G communication network, or a WiFi communication network.
[0096] Optionally, the display module is also used to display vehicle control buttons.
[0097] Control buttons are used to control the vehicle's infotainment system. These may include buttons such as a back button and an confirm button.
[0098] Optionally, the first processing module is also used to run the drivers for the wireless module, the display module, and the bus communication module.
[0099] A driver, or device driver, is a special program added to the operating system that contains information about a hardware device. This information enables the computer to communicate with the corresponding device.
[0100] In this invention, the driver enables communication and control between the first processing module and the wireless module, display module, and bus communication module.
[0101] Optionally, the bus communication module is also used to receive vehicle data transmitted from the controller and to send control commands to the controller.
[0102] Specifically, vehicle data can include the status data of the windows, the air conditioning, the vehicle lights, the engine, the steering mechanism, etc.
[0103] Control commands are commands used to control equipment on a vehicle. Examples include commands to adjust the engine's status or to adjust the vehicle's lights.
[0104] Optionally, the controller includes a second processing module and a bus module;
[0105] The bus module is used to communicate with the bus communication module and receive upgraded firmware from the bus communication module;
[0106] The second processing module is used to upgrade its own firmware using the upgrade firmware.
[0107] Optionally, the bus communication module includes a CAN bus or an RS-232 bus.
[0108] Specifically, buses used for communication can also include LIN bus, FlexRay bus, Most bus, etc.
[0109] Optionally, the display screen is connected to the remote upgrade server via Ethernet.
[0110] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., refer to specific features, structures, materials, or characteristics described in connection with that embodiment or example, which are included in at least one embodiment or example of the present invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples, without contradiction. Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention. Those skilled in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present invention.
Claims
1. A system for remotely upgrading controller firmware via a display screen, characterized in that, This includes remotely upgrading servers, displays, and controllers; Remote upgrade server and display screen communication connection; The display screen communicates with the controller; The remote upgrade server is used to send upgrade firmware to the display screen; The display screen is used to receive upgrade firmware sent from the remote upgrade server, and to send the upgrade firmware to the controller; The controller is used to receive the upgrade firmware sent by the display screen, and to upgrade its own firmware using the upgrade firmware; The remote upgrade server includes a permission recognition module and an upload module; The permission recognition module includes a camera unit, a storage unit, and a recognition unit; The camera unit is used to capture facial images of staff members; The storage unit is used to store facial images of staff members who have access to the upload module; The recognition unit is used to compare the facial image captured by the camera unit with the facial image stored in the storage unit to determine whether the staff using the upload module have upload permissions; The process of obtaining the staff's facial images includes: S1, take photos of the staff to obtain their facial images; S2, calculates the capture coefficient of the face image; S3, if the shooting coefficient is greater than the set shooting coefficient threshold, the face image is transmitted to the recognition unit; if the shooting coefficient is less than or equal to the set shooting coefficient threshold, return to S1. The calculation of the shooting coefficient of the facial image includes: Edge detection is performed on the face image to obtain the set of edge pixels, colouredg; Calculate the edge coefficient for each edge pixel in colofedg; Store edge pixels whose edge coefficient is greater than the set coefficient threshold value into the collection bigedgthr; Calculate shooting coefficients based on bigedgthr; The edge coefficient is calculated using the following formula: Among them, edgcoef d The edge coefficient of pixel d is represented by α and β, and the weight coefficients are represented by numofmdl. d This represents the number of pixels within a preset detection window (decw) that conform to the defined detection model (decmol). (numofl) d This represents the total number of pixels contained in decw, numofner d This indicates the number of other edge pixels contained in decw; The shooting coefficient is calculated using the following formula: Where shotcoef represents the shooting coefficient, δ represents the scaling parameter, nfbigedgthr represents the number of elements in bigedgthr, nfcolofedg represents the number of pixels contained in colofedg, and nei i L represents the set of pixels within a preset neighborhood of pixel i in bigedgthr. j Indicates nei i The luminance component value of pixel j in nfnei i Indicates nei i The number of pixels contained therein, where vaster represents the average variance of the set luminance component values.
2. The system for remotely upgrading controller firmware via a display screen according to claim 1, characterized in that, The display screen includes a power module, a first processing module, a wireless module, a display module, and a bus communication module; The power supply module is used to supply power to the first processing module, the wireless module, the display module, and the bus communication module; The first processing module is used to provide computing power and run remote upgrade applications; The wireless module is used for communication with the remote upgrade server; The display module is used to display vehicle data and firmware upgrade progress; The bus communication module is used to enable communication between the remote upgrade application and the controller, and to send the upgrade firmware to the controller.
3. The system for remotely upgrading controller firmware via a display screen according to claim 2, characterized in that, The display module is also used to display the vehicle control buttons.
4. A system for remotely upgrading controller firmware via a display screen according to claim 2, characterized in that, The first processing module is also used to run the drivers for the wireless module, the display module, and the bus communication module.
5. A system for remotely upgrading controller firmware via a display screen according to claim 2, characterized in that, The bus communication module is also used to receive vehicle data transmitted from the controller and to send control commands to the controller.
6. A system for remotely upgrading controller firmware via a display screen according to claim 2, characterized in that, The controller includes a second processing module and a bus module; The bus module is used to communicate with the bus communication module and receive upgraded firmware from the bus communication module; The second processing module is used to upgrade its own firmware using the upgrade firmware.
7. A system for remotely upgrading controller firmware via a display screen according to claim 2, characterized in that, The bus communication module includes a CAN bus or an RS-232 bus.
8. A system for remotely upgrading controller firmware via a display screen according to claim 1, characterized in that, The display screen is connected to the remote upgrade server via Ethernet.
Citation Information
Patent Citations
Server, vehicle and remote upgrading method and remote upgrading system thereof
CN112947980A
Electricity doctor electricity selling management system based on cloud computing
CN113793196A