Method for updating firmware of vehicle-mounted camera, electronic device and storage medium

Abstract

Embodiments of the present application provide a firmware updating method of a vehicle-mounted camera, an electronic device and a storage medium. In some embodiments, the firmware updating method of the vehicle-mounted camera comprises: obtaining environmental data of a vehicle, and determining a firmware suitable for an environment in which the vehicle is located from a firmware library according to the environmental data; the environmental data comprises light data of the environment in which the vehicle is located, or location information of the environment in which the vehicle is located and time information of the vehicle; and in response to the firmware currently used by the vehicle not being the firmware suitable for the environment in which the vehicle is located, updating the firmware of the vehicle-mounted camera using the firmware suitable for the environment in which the vehicle is located.

Description

Technical Field

[0001] The embodiments of this application relate to the field of vehicle technology, and more specifically, to a firmware update method, electronic device and storage medium for an in-vehicle camera. Background Technology

[0002] For reasons of driving safety and user experience, vehicles are typically equipped with one or more onboard cameras. These cameras connect to the vehicle's main unit via a serial protocol to transmit video and control signals.

[0003] However, like regular cameras, automotive cameras also suffer from white balance issues. Due to the size and power consumption limitations of automotive cameras, their white balance performance is limited, resulting in poor image quality under some extreme conditions. Summary of the Invention

[0004] The embodiments of this application provide a firmware update method, electronic device, and storage medium for a vehicle-mounted camera that can at least partially solve the above-mentioned or other problems existing in the prior art.

[0005] The embodiments of this application provide a firmware update method for an in-vehicle camera, comprising: acquiring environmental data of the vehicle, and determining firmware suitable for the vehicle's environment from a firmware library based on the environmental data; the environmental data includes: light data of the vehicle's environment, or location information of the vehicle's environment and time information of the vehicle; and updating the firmware of the in-vehicle camera using firmware suitable for the vehicle's environment in response to the fact that the firmware currently used by the vehicle is not suitable for the vehicle's environment.

[0006] Embodiments of this application also provide an electronic device, including: at least one processor and a memory. The memory is communicatively connected to the at least one processor and stores instructions executable by the at least one processor. The instructions are executed by the at least one processor to enable the at least one processor to perform the firmware update method for an in-vehicle camera as mentioned in the above embodiments.

[0007] The embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the firmware update method for an in-vehicle camera as described in the above embodiments.

[0008] According to some embodiments of this application, the electronic device can determine firmware suitable for the vehicle's environment from a firmware library based on the light data of the vehicle's environment, or the location information of the vehicle's environment and the vehicle's time information, and then update the firmware of the vehicle-mounted camera according to the determined firmware. Since the firmware used by the vehicle-mounted camera is more suitable for the vehicle's environment, it can better solve problems such as white balance under the lighting conditions of the vehicle's environment, reducing the impact of the environment on the image quality of the vehicle-mounted camera and improving the image quality. Attached Figure Description

[0009] Other features, objects, and advantages of this application will become more apparent from the following detailed description of non-limiting embodiments with reference to the accompanying drawings. Wherein:

[0010] Figure 1 This is a flowchart illustrating a firmware update method for an in-vehicle camera according to some embodiments of this application.

[0011] Figure 2 These are schematic block diagrams of electronic devices according to some embodiments of this application. Detailed Implementation

[0012] To better understand this application, various aspects of this application will be described in more detail with reference to the accompanying drawings. It should be understood that these detailed descriptions are merely illustrative of exemplary embodiments of this application and are not intended to limit the scope of this application in any way. Throughout the specification, the same reference numerals refer to the same elements. The expression "and / or" includes any and all combinations of one or more of the associated listed items.

[0013] It should also be understood that expressions such as "comprising," "including," "having," "containing," and / or "comprising" are open-ended rather than closed-ended expressions in this specification, indicating the presence of the stated features, elements, and / or components, but not excluding the presence of one or more other features, elements, components, and / or combinations thereof. Furthermore, when expressions such as "at least one of..." appear after a list of listed features, they modify the entire list of features, not just individual elements in the list. Additionally, when describing embodiments of this application, the word "may" is used to mean "one or more embodiments of this application." And the term "exemplary" is intended to refer to examples or illustrations.

[0014] Unless otherwise specified, all terms used herein (including engineering and technical terms) shall have the same meaning as commonly understood by one of ordinary skill in the art to which this application pertains. It should also be understood that, unless expressly stated herein, terms defined in common dictionaries shall be interpreted as having the meaning consistent with their meaning in the context of the relevant art, and not as having an idealized or overly formalized meaning.

[0015] It should be noted that the acquisition, storage, and application of user personal information involved in the technical solution disclosed herein all comply with relevant laws and regulations and do not violate public order and good morals. It should also be noted that the vehicle data in this embodiment was obtained after being authorized by the user (i.e., with the user's consent).

[0016] It should be noted that, unless otherwise specified, the embodiments and features described in this application can be combined with each other. Furthermore, unless explicitly limited or contradicted by the context, the specific steps included in the methods described in this application are not limited to the order in which they are described, but can be performed in any order or in parallel. This application will now be described in detail with reference to the accompanying drawings and embodiments.

[0017] In some implementations, the vehicle-mounted camera presets different image processing parameters for different lighting parameters (such as color temperature) to achieve better shooting results. However, due to the size and power consumption limitations of vehicle-mounted cameras, the firmware is relatively simple, the white balance function is weak, and a single firmware is difficult to cope with extreme lighting conditions, resulting in poor shooting performance of vehicle-mounted cameras under extreme lighting conditions.

[0018] Figure 1 This is a flowchart illustrating a firmware update method for an in-vehicle camera according to some embodiments of this application. For example... Figure 1 As shown, the firmware update method 100 for a vehicle-mounted camera provided in the embodiments of this application may include the following steps:

[0019] S11, acquire the vehicle's environmental data, and determine the appropriate firmware for the vehicle's environment from the firmware library based on the environmental data; the environmental data includes: light data of the vehicle's environment, or location information and time information of the vehicle's environment; and

[0020] S12, in response to the fact that the firmware currently used by the vehicle is not suitable for the environment in which the vehicle is located, update the firmware of the vehicle camera using firmware suitable for the environment in which the vehicle is located.

[0021] According to some embodiments of this application, the electronic device can determine firmware suitable for the vehicle's environment from a firmware library based on the light data of the vehicle's environment, or the location information of the vehicle's environment and the vehicle's time information, and then update the firmware of the vehicle-mounted camera according to the determined firmware. Since the firmware used by the vehicle-mounted camera is more suitable for the vehicle's environment, it can better solve problems such as white balance under the lighting conditions of the vehicle's environment, reducing the impact of the environment on the image quality of the vehicle-mounted camera and improving the image capture effect. Furthermore, using different firmware for image capture under different ambient lighting conditions can reduce the difficulty of firmware debugging during the development phase of the vehicle-mounted camera, achieving image capture quality that was previously difficult to obtain with a single firmware.

[0022] For ease of understanding, the process of the vehicle-mounted host executing the firmware update method 100 for the vehicle-mounted camera is described below by way of example. However, it is understood that, in addition to the vehicle-mounted host, the firmware update method 100 for the vehicle-mounted camera can also be executed by other devices that are communicatively connected to the vehicle-mounted host. The execution process can be referred to the relevant content below. This application does not limit the device that executes the firmware update method 100 for the vehicle-mounted camera.

[0023] First, the following provides an example of when the on-board unit acquires environmental data about the vehicle.

[0024] In some embodiments of this application, the vehicle-mounted host can detect a user's intention to enter the vehicle, acquire environmental data of the vehicle, and download firmware suitable for the vehicle's environment from a firmware library based on the environmental data. In the above scheme, after determining that the user intends to enter the vehicle, the vehicle-mounted host completes the process of determining and downloading firmware suitable for the vehicle's environment. This allows for firmware upgrades of the vehicle-mounted camera before the user starts the vehicle, enabling the vehicle-mounted camera to start quickly after the vehicle is started, thus meeting the requirement for rapid startup of the vehicle-mounted camera.

[0025] Optionally, the vehicle-mounted unit can use a short-range wireless communication module to sense the user's mobile terminal to determine whether the user intends to get into the vehicle. For example, the vehicle-mounted unit can detect the distance between itself and the user's mobile terminal (e.g., a terminal device with the vehicle's digital key installed) via the short-range wireless communication module. If the distance between the mobile terminal and itself is determined to be less than a preset distance, it is determined that the user intends to get into the vehicle. Alternatively, after detecting that the distance between the user's mobile terminal and itself is less than a preset distance via the short-range wireless communication module, the vehicle-mounted unit can determine the movement trajectory of the mobile terminal. If the movement trajectory indicates that the user is approaching the vehicle, it is determined that the user intends to get into the vehicle.

[0026] It should be understood that, without departing from the teachings of this application, the wireless short-range communication module may be an ultra-wideband (UWB) module or other communication modules, and this application does not limit them.

[0027] Optionally, the vehicle camera can be an Around View Monitor (AVM) camera. Utilizing wireless short-range positioning technology based on UWB and other wireless short-range communication modules, the vehicle camera firmware is upgraded before the user even gets into the vehicle, balancing the needs for high image quality and rapid reversing.

[0028] In other embodiments of this application, the vehicle-mounted host can acquire vehicle environmental data in real time during driving. For example, the vehicle's environmental data may include light data of the environment in which the vehicle is located. After determining that the light parameters have changed based on the light data, the vehicle-mounted host can determine firmware suitable for the vehicle's environment from a firmware library based on the environmental data.

[0029] As an example, the vehicle-mounted host can determine the changes in light parameters of the vehicle's environment based on real-time acquired light data. If the change in light parameters within a preset time period exceeds a preset threshold, the host executes the step of determining firmware suitable for the vehicle's environment. The threshold can be set as needed, and this application does not impose any restrictions on it. In the above scheme, if the vehicle experiences a sudden and drastic change in light while driving, such as when the vehicle enters or leaves an underground parking garage, the operation of determining and updating firmware suitable for the vehicle's environment can be automatically triggered, so that the vehicle-mounted camera is adapted to capture images in the environment the vehicle is about to enter.

[0030] It should be understood that, without departing from the teachings of this application, light parameters may include, but are not limited to, light intensity, light brightness, and light color temperature, etc., and this application does not impose any restrictions on them.

[0031] It should be understood that, without departing from the teachings of this application, the vehicle host may also acquire vehicle environmental data at other times. For example, in other embodiments, the vehicle host may acquire vehicle environmental data after the user starts the vehicle, and this application does not limit the timing at which the vehicle host acquires vehicle environmental data.

[0032] In some scenarios, the vehicle's main unit can combine changes in light data with other information to determine whether to trigger the operation of determining the firmware suitable for the vehicle's environment. This reduces the impact of frequent firmware upgrades on the vehicle's camera due to frequent changes in the light data of the vehicle's environment during driving.

[0033] As an example, the vehicle's main unit can determine the appropriate firmware for the vehicle's environment from the firmware library based on environmental data after determining that the light data indicates a change in light parameters and the vehicle's current speed is below a speed threshold. The speed threshold can be set as needed, for example, to any value less than 30 such as 10, 20, or 30; there is no restriction here. When a vehicle is moving from one environment to another, such as entering or exiting an underground parking garage, its speed is typically low. The above solution uses the vehicle's current speed as a factor in determining whether to trigger the appropriate firmware for the vehicle's environment, which can reduce the frequency of firmware upgrades caused by short-term changes in light due to factors such as passing through building shadows.

[0034] As another example, the vehicle-mounted unit can determine, based on environmental data, the appropriate firmware for the vehicle's environment after determining that the light parameters, as indicated by light data, have changed and that the trend of these changes is a gradual increase or decrease within a preset time. The preset time can be set as needed, for example, 1 minute, 2 minutes, etc. For instance, if the vehicle-mounted unit determines that the light parameters have gradually increased or decreased within a preset time period prior to the current moment, and the total change exceeds a threshold, it can determine the appropriate firmware for the vehicle's environment based on environmental data. This approach uses the trend of light change as a factor in determining whether to trigger the appropriate firmware for the vehicle's environment, reducing the likelihood of frequent firmware upgrades due to short-term light changes caused by factors such as shadows cast by buildings.

[0035] As another example, the vehicle-mounted host can determine the median value of the light parameters based on the light data after determining that the light parameters have changed and the number of times the light parameters change abruptly exceeds N within a preset time. Then, it can determine the appropriate firmware for the vehicle's environment from the firmware library based on the median value. Here, N can be an integer greater than 1, such as 2 or 3. For example, in some scenarios, the light parameters of the vehicle's environment change frequently. For instance, when driving in mountainous areas with many tunnels, light parameters will change abruptly when the vehicle enters and exits a tunnel. To reduce the frequency of determining the appropriate firmware based on the vehicle's environment's light parameters, the vehicle-mounted host determines the firmware for the vehicle camera based on the median value of the light parameters after the light parameters in the vehicle's environment have changed repeatedly. During this period, the firmware for the vehicle camera will not be updated in real-time based on the light parameters. This reduces frequent firmware upgrades and makes the vehicle camera's firmware more suitable for capturing images in the current environment.

[0036] It should be understood that, without departing from the teachings of this application, the vehicle host may also determine the firmware suitable for the vehicle's environment based on the statistical values ​​of light parameters over a certain period of time determined by light data, and this application does not impose any restrictions on this.

[0037] As another example, the vehicle-mounted unit can determine the appropriate firmware for the vehicle's environment from the firmware library based on environmental data after confirming that the light data indicates a change in light parameters and the vehicle's navigation data indicates that the current location is not an environmental abrupt change type. For example, different locations are categorized into environmental abrupt change types and non-abrupt change types based on whether light parameter abrupt changes frequently occur within their respective areas. In locations classified as environmental abrupt change types, the light parameters of the vehicle's environment change frequently. If the vehicle-mounted unit were to determine the appropriate firmware based on the light parameters of the vehicle's environment in real time, the firmware upgrade frequency would be high, potentially affecting the user experience of the vehicle's camera. In the above solution, the vehicle-mounted unit determines the appropriate firmware for the vehicle's environment only after confirming that the light data indicates a change in light parameters and that the current location is not an environmental abrupt change type, thus reducing the frequency of firmware upgrades.

[0038] Optionally, after determining that the vehicle's current location is an environmental abrupt change type, the on-board unit may not trigger the operation of determining the firmware suitable for the vehicle's environment. Alternatively, it may collect light parameters for a specified period, determine the firmware suitable for the vehicle's environment based on the median of the collected light parameters, and then, upon reaching a location no longer classified as an environmental abrupt change type, execute the real-time determination of the firmware suitable for the vehicle's environment from the firmware library based on environmental data. This application does not restrict the operations performed by the on-board unit when the vehicle is in a location classified as an environmental abrupt change type.

[0039] After providing an exemplary description of when to acquire vehicle environmental data, the following provides an exemplary description of how to acquire vehicle environmental data.

[0040] In some embodiments of this application, the vehicle's environmental data may include light data of the environment in which the vehicle is located. For example, the vehicle's onboard unit may acquire light data based on signals collected by devices such as light sensors. It is understood that the light sensor may be installed around the vehicle's camera or in other locations; no limitation is made herein.

[0041] Optionally, the ambient light data acquired by the vehicle-mounted host after determining that the user intends to get into the vehicle may include first ambient light data of the current environment and second ambient light data of the predicted environment the vehicle will enter. The determined firmware suitable for the vehicle's current environment includes first firmware suitable for the current environment and second firmware suitable for the environment the vehicle will enter. In the above scheme, after the user indicates their intention to get into the vehicle, the vehicle-mounted host pre-determines the first firmware and one or more second firmwares suitable for the current trip, enabling the vehicle-mounted host to more quickly update the firmware of the vehicle-mounted camera while the vehicle is in motion.

[0042] Optionally, the predicted ambient light data for the environment the vehicle will soon enter can be determined based on the user's current trip. For example, the onboard unit can determine the road segments the vehicle will traverse based on the user's current trip data, and obtain ambient light data collected by other vehicles on each road segment through a vehicle network as secondary ambient light data for each segment. Alternatively, the onboard unit can determine the road segments the vehicle will traverse based on the user's current trip data, and determine secondary ambient light data for each road segment using weather data from a weather forecast application. This application does not limit the method of predicting the ambient light data the vehicle will soon enter based on trip data.

[0043] It should be understood that, without departing from the teachings of this application, the user's current trip information can be obtained in various ways. For example, the vehicle-mounted unit can communicate with the user's mobile terminal to obtain the trip data input by the user. Alternatively, the vehicle-mounted unit can predict the user's current trip based on the vehicle's current location and historical trip information. This application does not limit the method by which the vehicle-mounted unit predicts the light data of the environment the vehicle is about to enter.

[0044] In some other embodiments of this application, the vehicle's environmental data may include location information of the vehicle's surroundings and the vehicle's time information. For example, when determining whether to update the firmware of the vehicle's camera, the on-board unit can obtain the location information of the vehicle's surroundings and the vehicle's time information through a positioning device such as GPS. Light parameters may differ at different locations and times. The on-board unit can estimate the lighting conditions of the vehicle's surroundings based on the location information and the vehicle's time information.

[0045] Optionally, after determining that the user intends to get into the vehicle, the vehicle-mounted host obtains location information including the vehicle's current first location and predicted second locations the vehicle will soon pass through. Time information includes the vehicle's first time at the first location and the predicted second time of each second location. The determined firmware applicable to the vehicle's environment includes first firmware applicable to the current environment and second firmware applicable to the environment the vehicle is about to enter. The predicted second locations the vehicle will soon pass through and the predicted second times of each second location can be determined based on the user's current trip and road conditions. The method for obtaining the current trip information can be found in the relevant description above and will not be repeated here. In the above scheme, after the user intends to get into the vehicle, the vehicle-mounted host pre-determines the first firmware and one or more second firmware applicable to the current trip, enabling the vehicle-mounted host to more quickly update the firmware of the vehicle-mounted camera during vehicle operation.

[0046] It should be understood that, without departing from the teachings of this application, the vehicle-mounted host may also acquire other data that can reflect the lighting conditions of the vehicle's environment as environmental data, and this application does not limit the specific content of the vehicle's environmental data.

[0047] After providing an exemplary description of acquiring vehicle environmental data, the following is an exemplary description of how to determine firmware suitable for the vehicle's environment based on the vehicle's environmental data.

[0048] Example 1

[0049] In some embodiments of this application, the environmental data includes light data of the vehicle's environment. The vehicle-mounted host can determine the appropriate firmware for the vehicle's environment from a firmware library based on the environmental data. This can include identifying the firmware with the highest image quality score corresponding to the light data in the firmware library as the appropriate firmware for the vehicle's environment. For example, the vehicle-mounted host may have a firmware library locally and / or in a cloud connected to it. This firmware library stores firmware for multiple vehicle-mounted cameras, and the shooting effects of each firmware may differ. The vehicle-mounted host can determine the firmware with the highest image quality score corresponding to the light data from the firmware library based on the environmental data of the vehicle's environment to improve the shooting quality of the vehicle-mounted cameras.

[0050] As an example, the vehicle host may store image quality scores of images taken by various firmware under different lighting conditions. The vehicle host may determine the firmware with the highest image quality score by: obtaining the image quality score of each firmware in the firmware library corresponding to the lighting data and sorting the firmware based on the image quality score; and determining the firmware with the highest image quality score (i.e. the firmware with the best shooting effect in the vehicle's environment) as the firmware suitable for the vehicle's environment.

[0051] It should be understood that, without departing from the teachings of this application, camera manufacturers may upload image quality scores for the firmware under different lighting conditions. For example, after using a camera loaded with this firmware to take images under different lighting conditions, the camera manufacturer may score the captured images manually or intelligently, and then upload the image quality scores for the firmware under different lighting conditions to the cloud. This application does not impose any restrictions on this.

[0052] As another example, the vehicle host may store different light data and the corresponding relationship between the firmware with the highest image quality score under the light data. The vehicle host may determine the firmware with the highest image quality score by: determining the firmware with the highest image quality score corresponding to the light data of the vehicle's environment based on the stored correspondence between the light data and the firmware and the light data of the vehicle's environment.

[0053] It should be understood that, without departing from the teachings of this application, firmware in the cloud firmware library can be uploaded by camera manufacturers. For example, camera manufacturers can manually adjust the firmware by setting different lighting conditions, and after manually or automatically scoring the images taken by the firmware under different lighting conditions, select the firmware with the best shooting effect under the corresponding lighting conditions and upload it to the cloud. Firmware in the cloud firmware library can also be automatically generated by the cloud. For example, with the user's permission, the cloud can collect various scenes from the vehicle's main unit, and then use artificial intelligence to automatically adjust the firmware based on the scene images. After generating firmware based on the adjustment results and scoring it, the generated firmware and image quality score are uploaded. This application does not restrict the source of firmware uploaded to the cloud firmware library.

[0054] In some scenarios, the firmware library may include a local firmware library stored locally on the vehicle's head unit and a cloud firmware library stored in the cloud. The vehicle's head unit may store image quality scores for all firmware in both the local and cloud firmware libraries. The firmware with the highest image quality score is then stored in the cloud firmware library, and the vehicle's head unit downloads the firmware from the cloud firmware library. This solution, by considering both the local and cloud firmware libraries during the search for firmware suitable for the vehicle's environment, ensures continuous optimization of firmware performance, thereby continuously improving the user experience without increasing the user's operational burden.

[0055] It should be understood that, without departing from the teachings of this application, the firmware in the cloud firmware library can be updated at any time, and this application does not restrict the maintenance method of the cloud firmware library.

[0056] It should be understood that, without departing from the teachings of this application, the vehicle host may periodically clean up the firmware in the local firmware library according to the usage frequency of the firmware in the local firmware library in order to save local storage space. This application does not restrict the maintenance method of the local firmware library.

[0057] Optionally, if the firmware with the highest image quality score determined based on the cloud firmware library and the local firmware library is located in the cloud firmware library, and the download time exceeds a preset download time threshold based on the current network, the vehicle host can determine the firmware with the highest image quality score in the local firmware library corresponding to the lighting data of the vehicle's environment, and use it as the firmware suitable for the vehicle's environment. In the above solution, the vehicle host determines the firmware suitable for the vehicle's environment by considering the network conditions, which can reduce the impact of poor network conditions on the vehicle camera's shooting performance due to firmware upgrade failures.

[0058] Optionally, after determining that the download time exceeds a preset download time threshold, the system can continue downloading the firmware with the highest image quality score determined by the cloud firmware library and the local firmware library, so that the vehicle host can call the firmware from the local firmware library the next time it enters the environment.

[0059] In some scenarios, a vehicle may include one or more in-vehicle cameras, which can be installed in different locations within the vehicle. The in-vehicle host can adjust the firmware used for each in-vehicle camera based on the light intensity at its location, enabling the in-vehicle cameras in different lighting conditions to achieve better shooting results.

[0060] It should be understood that, without departing from the teachings of this application, the light parameters of the vehicle in various directions can be obtained by light sensors located in various directions of the vehicle, or by other means, and this application does not limit this.

[0061] Example 2

[0062] In some embodiments of this application, environmental data includes location information of the vehicle's environment and time information of the vehicle. The firmware library includes firmware applicable to different time periods and / or different weather conditions. The on-board unit determines the firmware suitable for the vehicle's environment from the firmware library based on the environmental data in the following ways: determining the time period information and / or weather information of the vehicle's environment based on the location information and time information of the vehicle's environment, and identifying the firmware in the firmware library corresponding to the determined time period information and / or weather information as the firmware suitable for the vehicle's environment. In the above scheme, the on-board unit determines the firmware suitable for the vehicle's environment based on location and time information, eliminating the need for light detection in the vehicle and reducing vehicle costs.

[0063] As an example, the firmware library includes firmware applicable to different time periods and weather conditions, as well as the correspondence between time periods, weather, and firmware. The vehicle host determines the time period and weather information of the vehicle's environment based on the vehicle's location information and time information, and then determines the firmware applicable to the vehicle's environment based on the time period information, weather information, and the correspondence between the three.

[0064] As another example, time periods can be divided into sunrise and sunset periods, and the firmware library includes daytime firmware and nighttime firmware. If the vehicle's host determines that the vehicle is located after sunset based on the vehicle's location, time, and weather data, the time period is determined to be the sunset period, and the applicable firmware is the nighttime firmware. If the host determines that the vehicle is located before sunset based on the same factors, the time period is determined to be the sunrise period, and the applicable firmware is the daytime firmware. Optionally, the nighttime firmware can be adjusted by the camera manufacturer based on various lighting conditions, and the daytime firmware can be adjusted by the camera manufacturer based on natural light, which can also optimize image quality under certain circumstances.

[0065] It should be understood that, without departing from the teachings of this application, the division of time periods and weather types can be set as needed, and firmware can be debugged and stored in the firmware library for different time periods and weather types. This application does not impose any restrictions on this.

[0066] Example 3

[0067] In some embodiments of this application, the environmental data includes location information of the vehicle's environment and time information, and the firmware library includes firmware suitable for different scene modes. The method by which the vehicle-mounted host determines the firmware suitable for the vehicle's environment from the firmware library based on the environmental data may include: determining the scene mode of the vehicle based on the location and time information, and determining the firmware in the firmware library corresponding to the scene mode of the vehicle's environment as the firmware suitable for the vehicle's environment based on the scene mode and its correspondence. In the above scheme, the vehicle-mounted host stores firmware optimized for various scene modes of the vehicle, which is beneficial for calling the optimized firmware after the vehicle arrives at frequently visited scenes to achieve better shooting results.

[0068] Optionally, the vehicle-mounted unit can determine one or more scene modes for the vehicle based on its historical environmental data. This historical environmental data includes light data collected by the vehicle, collection time information, and collection location information. It can also acquire the firmware used by the vehicle-mounted camera in each scene mode, optimize the firmware, add the optimized firmware to a firmware library, and record the correspondence between scene modes and optimized firmware. For example, the vehicle-mounted unit can use the vehicle-mounted camera to capture images of the vehicle's surroundings and record the corresponding GPS coordinates and time points each time the vehicle stops and starts. Based on this accumulated data, the vehicle-mounted unit can statistically analyze the lighting conditions of several frequently encountered scenes. Through the vehicle-mounted unit's AI algorithm, it can automatically optimize the firmware for these frequently encountered scenes, so that the optimized firmware is automatically matched when the vehicle approaches that fixed scene again.

[0069] It should be understood that, without departing from the teachings of this application, the scene mode can also be determined and the firmware optimized for each scene mode can be performed by a cloud connected to the vehicle's host computer. This cloud can determine the scene mode for each vehicle separately based on data collected from each vehicle and perform firmware optimization for each scene mode, or it can jointly determine the scene mode based on data collected from multiple vehicles and perform firmware optimization for each scene mode; this application does not impose any limitations on this.

[0070] Having provided an exemplary description of how to determine the firmware suitable for the vehicle's environment, the following is an exemplary description of the process for upgrading the firmware of an in-vehicle camera.

[0071] In some embodiments of this application, if the vehicle-mounted host determines that the firmware currently used by the vehicle is suitable for the vehicle's environment, it may not upgrade the firmware of the vehicle-mounted camera. If it determines that the firmware currently used by the vehicle is not suitable for the vehicle's environment, it may update the firmware of the vehicle-mounted camera using firmware suitable for the vehicle's environment. For example, the vehicle-mounted host and the vehicle-mounted camera can communicate via an Inter-Integrated Circuit (I2C) or a Universal Asynchronous Receiver / Transmitter (UART). The vehicle-mounted host can communicate with the microprocessor inside the vehicle-mounted camera to perform firmware writing operations.

[0072] As described above, in some embodiments of this application, the vehicle-mounted host can determine firmware suitable for the vehicle's environment from a firmware library based on the lighting data of the vehicle's surroundings, or the location information of the vehicle's surroundings and the vehicle's time information. Then, it updates the firmware of the vehicle-mounted camera based on the determined firmware. Because the firmware used by the vehicle-mounted camera is more suitable for the vehicle's environment, it can better solve problems such as white balance under the lighting conditions of the vehicle's surroundings, reducing the impact of the environment on the image quality of the vehicle-mounted camera and improving the image quality.

[0073] The steps of the various methods described above are only for clarity. In practice, they can be combined into one step or some steps can be split into multiple steps. As long as they include the same logical relationship, they are all within the scope of protection of this patent. Adding insignificant modifications or introducing insignificant designs to the algorithm or process, but without changing the core design of the algorithm and process, are also within the scope of protection of this patent.

[0074] This application also provides an electronic device, such as... Figure 2 As shown, the electronic device 200 may include: at least one processor and a memory, the memory being communicatively connected to the at least one processor and storing instructions executable by the at least one processor. These instructions are executed by the at least one processor to enable the at least one processor to perform the aforementioned firmware update method 100 for the vehicle-mounted camera. For example, the electronic device 200 may be a vehicle-mounted host or other device communicatively connected to the vehicle-mounted host.

[0075] One embodiment of this application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements a firmware update method 100 for an in-vehicle camera.

[0076] Figure 2This is a schematic block diagram of an electronic device 200 according to some embodiments of this application. For example... Figure 2 As shown, the electronic device 200 includes a processor 201, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 202 or a computer program loaded from a memory 208 into a random access memory (RAM) 203. The RAM 203 may also store various programs and data required for the operation of the electronic device 200. The processor 201, ROM 202, and RAM 203 are interconnected via a bus 204. An input / output (I / O) interface 205 is also connected to the bus 204.

[0077] Multiple components in electronic device 200 are connected to I / O interface 205, including: input unit 206, such as buttons or a touchscreen in a vehicle infotainment system; output unit 207, connected to various types of displays, speakers, etc., to output various forms of signals; memory 208, including any medium for storing computer-executable programs; and communication unit 209, such as a network interface card (NIC), modem, or wireless transceiver. Communication unit 209 allows electronic device 200 to exchange information / data with other devices via a local area network (LAN) or other wireless communication networks.

[0078] Processor 201 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 201 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 201 performs the various methods and processes described above, such as the firmware update method 100 for an in-vehicle camera. For example, in some embodiments, the firmware update method 100 for an in-vehicle camera may be implemented as a computer software program tangibly contained in a computer-readable storage medium, such as memory 208. In some embodiments, part or all of the computer program may be loaded and / or installed on electronic device 200 via ROM 202 and / or communication unit 209. When the computer program is loaded into RAM 203 and executed by processor 201, one or more steps of the firmware update method 100 for an in-vehicle camera described above may be performed. Alternatively, in other embodiments, the processor 201 may be configured by any other suitable means (e.g., by means of firmware) to perform the firmware update method 100 for the vehicle camera.

[0079] Various aspects of this application have been described herein with reference to flowchart illustrations and / or timing diagrams of methods, apparatus (systems), and computer program products according to exemplary embodiments of this application. It should be understood that each step of the flowchart illustrations and / or timing diagrams, as well as combinations of steps in the flowchart illustrations and / or timing diagrams, can be implemented by computer-readable program instructions.

[0080] These computer-readable program instructions can be provided to a processor, general-purpose computer, special-purpose computer, or other programmable data processing unit in an electronic device to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing device, they create means for implementing the functions / steps specified in one or more steps of a flowchart and / or timing diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing device, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / steps specified in one or more steps of a flowchart and / or timing diagram.

[0081] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / steps specified in one or more steps of a flowchart and / or timing diagram.

[0082] The flowcharts and timing diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of devices, methods, and computer program products according to various embodiments of this application. In this regard, each step in a flowchart or timing diagram may represent a module, segment, or part of an instruction that contains one or more executable instructions for implementing a specified logical function. In some alternative embodiments, the functions indicated in the steps may occur in a different order than those indicated in the drawings. For example, two consecutive steps may actually be performed substantially in parallel, and they may sometimes be performed in reverse order, depending on the functions involved. It should also be noted that each step in a timing diagram and / or flowchart, and combinations of steps in timing diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0083] The above description is merely an illustration of the embodiments of this application and the technical principles employed. Those skilled in the art should understand that the scope of protection involved in this application is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the technical concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features with similar functions disclosed in this application.

Claims

1. A firmware update method for an in-vehicle camera, characterized in that, include: In response to detecting that a user intends to get into the vehicle, the system acquires environmental data of the vehicle and determines firmware suitable for the environment in which the vehicle is located from the firmware library based on the environmental data. The firmware suitable for the environment in which the vehicle is located includes a first firmware suitable for the current environment in which the vehicle is located and a second firmware suitable for the environment in which the vehicle is about to enter. The environmental data includes: light data of the environment in which the vehicle is located, or location information of the environment in which the vehicle is located and time information of the vehicle; wherein, the light data includes first light data of the current environment in which the vehicle is located and second light data of the predicted environment in which the vehicle will enter; the location information includes information of the first location in which the vehicle is currently located and information of the predicted second locations in which the vehicle will pass; the time information includes first time information of the vehicle at the first location and second time information of the predicted passage of the vehicle through each of the second locations; and In response to the fact that the firmware currently used by the vehicle is not suitable for the environment in which the vehicle is located, the firmware of the vehicle camera is updated using the firmware suitable for the environment in which the vehicle is located.

2. The method according to claim 1, wherein, The method further includes: Based on the vehicle's historical environmental data, one or more scene modes of the vehicle are determined; the historical environmental data includes light data collected by the vehicle, collection time information, and collection location information; Obtain the firmware used by the vehicle-mounted camera in the scene mode, and optimize the firmware used by the vehicle-mounted camera in the scene mode; and The optimized firmware is added to the firmware library, and the correspondence between the scene mode and the optimized firmware is recorded. The environmental data includes location information of the vehicle's environment and time information of the vehicle. The step of determining firmware suitable for the vehicle's environment from the firmware library based on the environmental data includes: Based on the location information and the time information, the scene mode in which the vehicle is located is determined; and Based on the scene mode in which the vehicle is located and the corresponding relationship, the firmware in the firmware library that corresponds to the scene mode in which the vehicle is located is determined as the firmware suitable for the environment in which the vehicle is located.

3. The method according to claim 1, wherein, The environmental data includes light data of the environment in which the vehicle is located, and the step of determining firmware suitable for the environment in which the vehicle is located from the firmware library based on the environmental data includes: Based on the light data, the firmware with the highest image quality score corresponding to the light data in the firmware library is determined as the firmware suitable for the environment in which the vehicle is located.

4. The method according to claim 1, wherein, The environmental data includes the light data, and the step of determining firmware suitable for the environment in which the vehicle is located from the firmware library based on the environmental data includes: In response to a change in light parameters indicated by the light data, the firmware suitable for the environment in which the vehicle is located is determined from the firmware library based on the environmental data.

5. The method according to claim 4, wherein, The firmware that responds to a change in light parameters indicated by the light data and determines the firmware suitable for the environment in which the vehicle is located from the firmware library based on the environmental data includes: In response to a change in the light parameters indicated by the light data, and the vehicle's current speed being less than a speed threshold, the firmware suitable for the environment in which the vehicle is located is determined from the firmware library based on the environmental data.

6. The method according to claim 4, wherein, The firmware that responds to a change in light parameters indicated by the light data and determines the firmware suitable for the environment in which the vehicle is located from the firmware library based on the environmental data includes: In response to a change in light parameters indicated by the light data, and the trend of the change in light parameters being a gradual increase or decrease within a preset time, the firmware suitable for the environment in which the vehicle is located is determined from the firmware library based on the environmental data; or, In response to a change in the light parameters indicated by the light data, and if the number of jumps in the light parameters within a preset time is greater than N, the median value of the light parameters is determined based on the light data, and the firmware suitable for the environment in which the vehicle is located is determined from the firmware library based on the median value of the light parameters, where N is a positive integer greater than 1.

7. The method according to claim 4, wherein, The firmware that responds to a change in light parameters indicated by the light data and determines the firmware suitable for the environment in which the vehicle is located from the firmware library based on the environmental data includes: In response to a change in the light parameters indicated by the light data, and the navigation data of the vehicle indicating that the type of the first location where the vehicle is currently located is not an environmental change type, the firmware suitable for the environment in which the vehicle is located is determined from the firmware library based on the environmental data.

8. An electronic device, characterized in that, include: At least one processor; as well as, A memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform a firmware update method for an in-vehicle camera as described in any one of claims 1 to 7.

9. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, it implements the firmware update method for the vehicle-mounted camera as described in any one of claims 1 to 7.

Images