License plate anomaly detection method, and apparatus

Abstract

Disclosed in the present application are a license plate anomaly detection method and an apparatus. The method comprises: a first apparatus acquiring a first license plate image of a first vehicle; on the basis of the first license plate image, determining a license plate state of the first vehicle, the license plate state of the first vehicle being a normal state or an abnormal state; and if the license plate state of the first vehicle is the abnormal state, sending first information, the first information being used for indicating that a license plate of the first vehicle is abnormal. After acquiring the first license plate image of the first vehicle, the first apparatus can detect the first license plate image by itself so as to determine whether the license plate state of the first vehicle is the abnormal state. In this way, the first vehicle can recognize whether the license plate of the first vehicle is abnormal by means of self-detection, which helps the first apparatus to detect the abnormal license plate condition of the first vehicle in a timely and effective manner. In addition, by means of sending the first information, the abnormal license plate condition of the first vehicle can be notified to an owner of the first vehicle in a timely manner, allowing for the owner to perform corresponding processing.

Description

A method and device for detecting license plate anomalies Technical Field

[0001] This application relates to the field of image processing technology, and in particular to a method and apparatus for detecting license plate anomalies. Background Technology

[0002] License plates (also known as vehicle registration plates or vehicle license plates) are an important identifier for vehicle information (such as vehicle identity, owner identity, and registration area), and are a mandatory tool for vehicles. In traffic management, the role of license plates is indispensable; they serve not only as proof of vehicle passage and parking but also as crucial evidence for investigating and punishing traffic violations. Therefore, relevant regulations require that vehicle license plates be displayed correctly, clearly, and completely, and must not be intentionally obscured or damaged.

[0003] However, in actual use, vehicle license plates may be subject to various forms of obstruction, including deliberate obstruction (such as using tape or altering the plate), unintentional obstruction (such as the plate being covered by dust, garbage, or defaced), and the use of counterfeit or cloned plates. In such cases, to provide effective support for safety and security and to ensure normal traffic management, it is necessary to detect any abnormalities in the license plates.

[0004] Currently, industry-provided license plate anomaly detection solutions rely on monitoring platforms (also known as surveillance systems) to identify license plate anomalies. Specifically, the monitoring platform identifies video images provided by video surveillance devices to determine if the license plates of one or more vehicles are abnormal. However, this license plate anomaly detection solution is only applicable to scenarios with video surveillance devices, and has certain limitations, failing to identify license plate anomalies in a timely and effective manner. Therefore, further research is needed on how to detect license plate anomalies in a timely and effective manner. Summary of the Invention

[0005] This application provides a method and apparatus for detecting license plate anomalies, which enables vehicles to perform self-inspection of their own license plates and can detect license plate anomalies in a timely and effective manner.

[0006] Firstly, this application provides a method for detecting license plate anomalies, which can be executed by a first device in a first vehicle. For example, the first device can be a first apparatus for implementing the license plate anomaly detection function of the first vehicle, or it can be a module (such as a processor, processing unit, chip system, circuit, or chip) within the first apparatus, or it can be a logic module or software capable of implementing all or part of the functions of the first apparatus. The method may include the following steps: the first device acquires a first license plate image of the first vehicle; then, the first device determines the license plate status of the first vehicle based on the first license plate image, wherein the license plate status of the first vehicle can be a normal state or an abnormal state; if the license plate status of the first vehicle is an abnormal state, the first device can send first information, wherein the first information can be used to indicate that the license plate of the first vehicle is abnormal.

[0007] In this method, after acquiring the first license plate image of the first vehicle, the first device in the first vehicle can automatically detect the first license plate image to accurately determine whether the license plate status of the first vehicle is abnormal. This allows the first vehicle to identify whether its license plate is abnormal through self-checking, which helps the first device to detect license plate anomalies in a timely and effective manner. If the license plate status of the first vehicle is abnormal, the first device can send information indicating that the license plate is abnormal, so that the receiving device (such as a terminal device or vehicle display device) can promptly and effectively notify (or remind) the owner of the first vehicle that the license plate is abnormal. This allows the owner to promptly notify the owner of the license plate anomaly, enabling the owner to promptly discover the license plate anomaly and take appropriate action.

[0008] In one possible implementation, the first device determines the license plate status of the first vehicle based on the first license plate image, including:

[0009] The first device performs damage identification on the first license plate image to obtain the damage status of the license plate of the first vehicle.

[0010] If the license plate of the first vehicle is not damaged, the first device can determine that the license plate of the first vehicle is in a normal state; or,

[0011] If the license plate of the first vehicle is damaged, the first device can determine that the license plate of the first vehicle is in an abnormal state.

[0012] In the above implementation, the first device can accurately detect whether the license plate of the first vehicle is damaged or obscured by performing dirt recognition on the first license plate image, which can help to accurately determine whether the license plate of the first vehicle is abnormal.

[0013] In one possible implementation, the first device determines the license plate status of the first vehicle based on the first license plate image, including:

[0014] The first device performs license plate number recognition on the first license plate image to obtain the first license plate number of the first vehicle;

[0015] If the first license plate number is the same as the second license plate number, then the first device can determine that the license plate status of the first vehicle is normal, wherein the second license plate number is the actual license plate number of the first vehicle; or,

[0016] If the first license plate number is different from the second license plate number, the first device can determine that the license plate status of the first vehicle is abnormal.

[0017] In the above implementation, the first device can accurately obtain the license plate number contained in the first license plate image by performing license plate number recognition on the first license plate image, and compare the license plate number with the real license plate number of the first vehicle to accurately determine whether the license plate number of the first vehicle has changed, that is, to determine whether the license plate number contained in the first license plate image is correct, thereby helping to accurately determine whether the license plate of the first vehicle is abnormal.

[0018] In one possible implementation, the first device determines the license plate status of the first vehicle based on the first license plate image, including:

[0019] The first device performs damage identification on the first license plate image to obtain the damage status of the license plate of the first vehicle.

[0020] The first device performs license plate number recognition on the first license plate image to obtain the first license plate number of the first vehicle;

[0021] If the license plate of the first vehicle is not damaged and the first license plate number is the same as the second license plate number, then the first device can determine that the license plate of the first vehicle is in a normal state, wherein the second license plate number is the actual license plate number of the first vehicle; or,

[0022] If the license plate of the first vehicle is damaged and / or the license plate number is different from the license plate number of the second vehicle, the first device can determine that the license plate status of the first vehicle is abnormal.

[0023] The above implementation method can more accurately determine whether the license plate of the first vehicle is abnormal by performing dual recognition on the first license plate image (i.e., damage recognition and license plate number recognition).

[0024] In one possible implementation, the first device performs damage identification on the first license plate image to obtain the damage status of the first vehicle's license plate, including:

[0025] The first device can determine the license plate damage status of the first vehicle based on the first license plate image and the first model. The first model is used to describe the correspondence between the license plate image and the license plate damage status, which may include whether the license plate is damaged or not.

[0026] In the above implementation, the first device uses a trained first model to process the first license plate image, which can obtain the license plate damage status of the first vehicle in a timely and accurate manner.

[0027] In one possible implementation, the first device performs license plate number recognition on the first license plate image to obtain the first license plate number of the first vehicle, including:

[0028] The first device can determine the first license plate number based on the first license plate image and the second model, wherein the second model is used to describe the correspondence between the license plate image and the license plate number.

[0029] In the above implementation, the first device processes the first license plate image using a trained second model, and can obtain the license plate number contained in the first license plate image in a timely and accurate manner.

[0030] In one possible implementation, sending the first message includes:

[0031] If the first vehicle is in a dormant state, the first device may send first information to the terminal device and / or the safety device of the first vehicle; or,

[0032] If the first vehicle is in a sleep / wake-up state, a power-on state, or a running state, the first device can send first information to the terminal device and / or the vehicle display device.

[0033] The above implementation method can notify the owner of any license plate anomalies of the first vehicle based on its different vehicle states. For example, when the first vehicle is in a dormant state, the first device can promptly notify the terminal device of the license plate anomaly, allowing the terminal device to promptly remind the owner that the license plate is abnormal, thus enabling the owner to promptly detect and address the license plate anomaly. Similarly, when the first vehicle is in a dormant-to-wake-up state or in operation, the device can promptly notify the terminal device or vehicle display device of the license plate anomaly, allowing the terminal device or vehicle display device to promptly remind the owner that the license plate is abnormal, thus enabling the owner to promptly detect and address the license plate anomaly.

[0034] In one possible implementation, the method further includes:

[0035] If the first vehicle is in a dormant state or in operation, the first device can send second information to the image acquisition device on the first vehicle, wherein the second information can be used to instruct the image acquisition device to periodically acquire images of the license plate of the first vehicle; or,

[0036] If the first vehicle is in a sleep-wake state or a powered-on state, the first device can send third information to the image acquisition device, wherein the third information can be used to instruct the image acquisition device to acquire the license plate image of the first vehicle.

[0037] The above implementation allows the image acquisition device on the first vehicle to adopt different monitoring strategies to collect license plate images based on the different vehicle states, thus helping to detect license plate anomalies promptly and accurately. For example, when the first vehicle is in a dormant or running state, the image acquisition device on the first vehicle can be triggered to periodically collect license plate images. Compared to the continuous collection of license plate images by the video surveillance device in existing solutions, this saves power consumption of the first vehicle or its image acquisition device. As another example, when the first vehicle is in a dormant-to-wake-up state (which can be understood as when the vehicle has just started), the image acquisition device on the first vehicle can be triggered to collect a license plate image once. This enables triggered detection of license plate anomalies and avoids discovering license plate anomalies only during vehicle operation.

[0038] In one possible implementation, the method further includes:

[0039] The first device receives fourth information, which can be used to instruct the first vehicle to activate the license plate anomaly detection mode.

[0040] In the above implementation, the first device can promptly execute the license plate anomaly detection mode by receiving the fourth information.

[0041] In one possible implementation, the license plate anomaly detection mode may include one of the following:

[0042] Perform license plate anomaly detection periodically, whether the first vehicle is in a dormant or operational state; or,

[0043] The license plate anomaly detection is triggered when the first vehicle is in a sleep / wake-up state or in a powered-on state.

[0044] The above implementation method can adopt different license plate anomaly detection methods according to different vehicle states of the first vehicle, making license plate anomaly detection more flexible and more in line with the actual vehicle state of the first vehicle, which helps to meet the license plate anomaly detection needs under different vehicle states.

[0045] In one possible implementation, the first device acquires an image of the first license plate of the first vehicle, including:

[0046] The first device acquires an image of the second license plate of the first vehicle. Then, the first device processes the second license plate image to obtain the first license plate image.

[0047] In the above implementation, the first device can make the second license plate image clearer and without obvious distortion by performing corresponding processing (such as perspective transformation processing) on ​​the second license plate image, thereby facilitating the subsequent accurate detection of the license plate damage and license plate number of the first vehicle.

[0048] In one possible implementation, the second license plate image can be acquired via an image acquisition device on the first vehicle; or,

[0049] The second license plate image can be obtained via the second vehicle; or,

[0050] The second license plate image can be obtained via roadside sensor equipment.

[0051] In the above implementation, the first device can acquire the second license plate image in a variety of ways, which are flexible and diverse and can meet the needs of different scenarios.

[0052] In one possible implementation, the first information may include at least one of the following: a first license plate image of the first vehicle, an abnormal license plate status of the first vehicle, and the acquisition time of the first license plate image of the first vehicle.

[0053] In the above implementation method, by carrying the above content in the first information, it is convenient for the owner of the first vehicle to promptly discover the abnormality of the license plate of the first vehicle.

[0054] Secondly, this application provides a method for detecting license plate anomalies, which can be executed by a terminal device or a vehicle-mounted display device in a first vehicle. For example, the terminal device can be a terminal equipment, or a component within a terminal equipment, such as a communication module, circuits or chips responsible for communication functions (e.g., modem chips, also known as baseband chips, or system-on-chip (SoC) chips or system-in-package (SIP) chips containing modem cores), chip systems, or processors, etc., or logic modules or software capable of implementing all or part of the terminal equipment's functions. The vehicle-mounted display device can be a vehicle-mounted display device (or vehicle display) in the first vehicle, or a module within a vehicle-mounted display device (e.g., a processor, processing unit, chip system, circuit, or chip, etc.), or logic modules or software capable of implementing all or part of the vehicle-mounted display device's functions. The method may include the following steps: a terminal device or a vehicle display device receives first information, wherein the first information may be used to indicate that the license plate of the first vehicle is abnormal; thereafter, the terminal device or the vehicle display device may display fifth information on a first interface or play the fifth information by voice, wherein the fifth information may be used to notify the owner of the first vehicle that the license plate of the first vehicle is abnormal.

[0055] The technical effects achievable in the second aspect are similar to those achieved in the first aspect mentioned above, and will not be repeated here. Furthermore, it should be understood that displaying the fifth information on the first interface makes the notification information to the vehicle owner more intuitive and convenient, allowing the owner to promptly learn about the abnormal license plate situation of the first vehicle. Playing the fifth information via voice allows the vehicle owner to learn about the abnormal license plate situation of the first vehicle even more promptly.

[0056] In one possible implementation, the method further includes:

[0057] The terminal device or vehicle display device can provide a second interface, which can be an interface for assisting the vehicle owner in setting up vehicle-related functions. In response to the owner of the first vehicle clicking the license plate anomaly detection function on the second interface, the terminal device or vehicle display device can send a fourth message, which is used to instruct the first vehicle to activate the license plate anomaly detection mode.

[0058] The technical effects achievable by the above implementation method can be referenced from the corresponding implementation method in the first aspect above, and will not be repeated here. Furthermore, it should be understood that by providing a second interface to the car owner, human-computer interaction can be achieved, making the editing of vehicle-related functions more intuitive and convenient, and facilitating the visual editing of vehicle-related functions.

[0059] In one possible implementation, the license plate anomaly detection mode may include one of the following:

[0060] Perform license plate anomaly detection periodically, whether the first vehicle is in a dormant or operational state; or,

[0061] The license plate anomaly detection is triggered when the first vehicle is in a sleep / wake-up state or in a powered-on state.

[0062] The technical effects achievable by the above implementation method can be referred to the technical effects of the corresponding implementation method in the first aspect above, and will not be repeated here.

[0063] In one possible implementation, the method further includes:

[0064] The terminal device or vehicle display device can receive the sixth information, which may include video information within a first time period, where the first time period refers to a period of time before and after the acquisition time of the first license plate image of the first vehicle.

[0065] In the above implementation, the terminal device can receive the sixth information and play the video information within the first time period in a timely and effective manner, so that the owner of the first vehicle can determine in a timely and effective manner whether the license plate is really abnormal, and can help the owner to determine the specific reason for the license plate abnormality in a timely and effective manner, or help the owner to find the reason for the license plate abnormality more quickly.

[0066] In one possible implementation, the first information may include at least one of the following: a first license plate image of the first vehicle, an abnormal license plate status of the first vehicle, and the acquisition time of the first license plate image of the first vehicle.

[0067] The technical effects achievable by the above implementation method can be referred to the technical effects of the corresponding implementation method in the first aspect above, and will not be repeated here.

[0068] Thirdly, this application provides a method for detecting license plate anomalies, which can be executed by a safety device in a first vehicle. For example, the safety device can be a safety equipment in the first vehicle used to implement the vehicle's safety monitoring function, or it can be a module within the safety equipment (such as a processor, processing unit, chip system, circuit, or chip), or it can be a logic module or software capable of implementing all or part of the safety equipment's functions. The method may include the following steps: the safety device receives first information, which can be used to indicate that the license plate of the first vehicle is abnormal; subsequently, the safety device can send sixth information to a terminal device and / or a vehicle display device based on the first information, wherein the sixth information may include video information within a first time period, where the first time period represents a period before and after the acquisition time of the first license plate image of the first vehicle.

[0069] The technical effects achievable in the third aspect are described in the technical effects of the corresponding implementation methods in the second aspect above, and will not be repeated here.

[0070] In one possible implementation, the first information may include at least one of the following: a first license plate image of the first vehicle, an abnormal license plate status of the first vehicle, and the acquisition time of the first license plate image of the first vehicle.

[0071] The technical effects achievable by the above implementation method can be referred to the technical effects of the corresponding implementation method in the first aspect above, and will not be repeated here.

[0072] Fourthly, this application provides a method for detecting abnormal license plates, which can be executed by a terminal device. For example, the terminal device can be a terminal equipment, or a component within a terminal equipment, such as a communication module, circuits or chips responsible for communication functions (e.g., modem chips, also known as baseband chips, or system-on-chip (SoC) chips or system-in-package (SIP) chips containing modem cores), chip systems, or processors, etc., or logic modules or software capable of implementing all or part of the terminal equipment's functions. The terminal device can be associated with or bound to a first vehicle. The method may include the following steps: the terminal device acquires a first license plate image of the first vehicle; then, the terminal device determines the license plate status of the first vehicle based on the first license plate image, wherein the license plate status can be normal or abnormal.

[0073] In this method, after acquiring the first license plate image of the first vehicle, the terminal device can detect the first license plate image to accurately determine whether the license plate status of the first vehicle is abnormal. This enables the terminal device to identify whether the license plate of the first vehicle is abnormal, which helps the terminal device to detect abnormal license plate conditions of the first vehicle in a timely and effective manner. This allows the owner of the first vehicle to be aware of the abnormal license plate conditions of the first vehicle in a timely manner.

[0074] In one possible implementation, the method further includes:

[0075] If the license plate status is abnormal, the terminal device can display the fifth information on the first interface or play the fifth information by voice. The fifth information can be used to notify the owner of the first vehicle that the license plate of the first vehicle is abnormal.

[0076] In the above implementation, by displaying the fifth information on the first interface, the terminal device makes the notification information to the vehicle owner more intuitive and convenient, allowing the vehicle owner to promptly learn about the abnormal license plate situation of the first vehicle. Playing the fifth information via voice allows the vehicle owner to learn about the abnormal license plate situation of the first vehicle even more promptly.

[0077] In one possible implementation, the method further includes:

[0078] If the license plate status is abnormal, and the abnormal status is determined based on the fact that the license plate of the first vehicle is damaged, the terminal device can send a first instruction to the first vehicle, wherein the first instruction can be used to instruct the first vehicle to clean the damage to the license plate of the first vehicle.

[0079] In the above implementation, when it is determined that the license plate of the first vehicle is damaged, the terminal device can send a first instruction to the first vehicle so that the first vehicle can clean the license plate in a timely and effective manner, which helps to ensure that the license plate of the first vehicle is clearly visible, or can ensure that the license plate of the first vehicle is clean.

[0080] In one possible implementation, the method further includes:

[0081] If the license plate status is abnormal, the terminal device can send a seventh message to the first vehicle. The seventh message can be used to instruct the first vehicle to report video information related to the license plate of the first vehicle. The seventh message can include the acquisition time of the first license plate image. After that, the terminal device can receive an eighth message from the first vehicle. The eighth message can include video information within a second time period, which represents a period of time before and after the acquisition time of the first license plate image of the first vehicle.

[0082] In the above implementation, the terminal device can receive the eighth information and play the video information in the second time period in a timely and effective manner, so that the owner of the first vehicle can determine in a timely and effective manner whether the license plate is really abnormal, and can help the owner to determine the specific reason for the license plate abnormality in a timely and effective manner, or help the owner to find the reason for the license plate abnormality more quickly.

[0083] In one possible implementation, the terminal device determines the license plate status of the first vehicle based on the first license plate image, including:

[0084] The terminal device can identify the damage to the license plate of the first vehicle by performing a damage detection on the first license plate image;

[0085] If the license plate of the first vehicle is not damaged, the terminal device can determine that the license plate of the first vehicle is in a normal state; or,

[0086] If the license plate of the first vehicle is damaged, the terminal device can determine that the license plate of the first vehicle is in an abnormal state.

[0087] For the technical effects that can be achieved by the above implementation method, please refer to the technical effects that can be achieved by the corresponding implementation method provided in the first aspect above, which will not be repeated here.

[0088] In one possible implementation, the terminal device determines the license plate status of the first vehicle based on the first license plate image, including:

[0089] The terminal device can obtain the first license plate number of the first vehicle by recognizing the license plate number of the first license plate image;

[0090] If the first license plate number is the same as the second license plate number, the terminal device can determine that the license plate status of the first vehicle is normal, wherein the second license plate number is the actual license plate number of the first vehicle; or,

[0091] If the first license plate number is different from the second license plate number, the terminal device can determine that the license plate status of the first vehicle is abnormal.

[0092] For the technical effects that can be achieved by the above implementation method, please refer to the technical effects that can be achieved by the corresponding implementation method provided in the first aspect above, which will not be repeated here.

[0093] In one possible implementation, the terminal device determines the license plate status of the first vehicle based on the first license plate image, including:

[0094] The terminal device can identify the damage to the license plate of the first vehicle by performing a damage detection on the first license plate image;

[0095] The terminal device can obtain the first license plate number of the first vehicle by recognizing the license plate number of the first license plate image;

[0096] If the license plate of the first vehicle is not damaged and the first license plate number is the same as the second license plate number, then the terminal device can determine that the license plate status of the first vehicle is normal, wherein the second license plate number is the actual license plate number of the first vehicle; or,

[0097] If the license plate of the first vehicle is damaged and / or the license plate number of the first vehicle is different from that of the second vehicle, the terminal device can determine that the license plate status of the first vehicle is abnormal.

[0098] For the technical effects that can be achieved by the above implementation method, please refer to the technical effects that can be achieved by the corresponding implementation method provided in the first aspect above, which will not be repeated here.

[0099] In one possible implementation, the terminal device performs defacement recognition on the first license plate image to obtain the defacement status of the first vehicle's license plate, including:

[0100] The terminal device can determine the license plate damage status of the first vehicle based on the first license plate image and the first model. The first model is used to describe the correspondence between the license plate image and the license plate damage status, which may include whether the license plate is damaged or not.

[0101] For the technical effects that can be achieved by the above implementation method, please refer to the technical effects that can be achieved by the corresponding implementation method provided in the first aspect above, which will not be repeated here.

[0102] In one possible implementation, the terminal device performs license plate number recognition on the first license plate image to obtain the first license plate number of the first vehicle, including:

[0103] The terminal device can determine the first license plate number based on the first license plate image and the second model, wherein the second model is used to describe the correspondence between the license plate image and the license plate number.

[0104] For the technical effects that can be achieved by the above implementation method, please refer to the technical effects that can be achieved by the corresponding implementation method provided in the first aspect above, which will not be repeated here.

[0105] In one possible implementation, the terminal device receives an image of the first license plate of the first vehicle, including:

[0106] The terminal device sends a second instruction to the first vehicle, wherein the second instruction is used to instruct the first vehicle to report the license plate image of the first vehicle, and then the terminal device can receive the first license plate image from the first vehicle.

[0107] In the above implementation, the first vehicle can report the license plate image of the first vehicle based on the request of the terminal device. This can realize that the license plate image of the first vehicle is reported on demand, which helps to avoid frequent (or uninterrupted) reporting of the license plate image of the first vehicle, thereby reducing image transmission overhead and making the sending of the second command more reasonable and accurate.

[0108] In one possible implementation, the terminal device sends a second instruction to the first vehicle, including:

[0109] The terminal device provides a second interface, which is used to assist the vehicle owner in setting up vehicle-related functions. In response to the owner of the first vehicle clicking the license plate image reporting function on the second interface, the terminal device can send a second instruction to the first vehicle.

[0110] In the above implementation, the terminal device provides a second interface to the vehicle owner, enabling human-computer interaction. This makes the editing of vehicle-related functions (such as license plate image reporting) more intuitive and convenient, facilitating the visual editing of vehicle-related functions and improving the convenience and accuracy of the vehicle owner issuing commands to the first vehicle.

[0111] In one possible implementation, the terminal device acquires an image of the first license plate of the first vehicle, including:

[0112] The terminal device receives the first license plate image from the first vehicle.

[0113] In the above implementation, the first vehicle can proactively report its license plate image to the terminal device without needing to trigger the first vehicle to report its license plate image based on a request from the terminal device. This helps save signaling overhead and enables the first vehicle to autonomously report its license plate image, thus improving the initiative of the first vehicle in reporting its license plate image.

[0114] In one possible implementation, the method further includes:

[0115] The terminal device provides a second interface, which is used to assist the vehicle owner in setting up vehicle-related functions. In response to the owner of the first vehicle clicking the license plate image acquisition function on the second interface, the terminal device can send a ninth message to the first vehicle, which is used to instruct the first vehicle to activate the license plate image acquisition mode.

[0116] In the above implementation, the terminal device provides a second interface to the vehicle owner, enabling human-computer interaction. This makes the editing of vehicle-related functions (such as license plate image acquisition) more intuitive and convenient, facilitating the visual editing of vehicle-related functions and improving the convenience and accuracy of the vehicle owner issuing commands to the first vehicle.

[0117] In one possible implementation, the license plate image acquisition mode may include one of the following:

[0118] License plate image acquisition is performed periodically, whether the first vehicle is in a dormant state or in operation; or,

[0119] The license plate image acquisition is triggered when the first vehicle is in a sleep-wake state or in a powered-on state.

[0120] The above implementation method can adopt different license plate image acquisition methods according to different vehicle states of the first vehicle, making license plate image acquisition more flexible and more in line with the actual vehicle state of the first vehicle, which helps to meet the license plate image acquisition needs under different vehicle states.

[0121] Fifthly, this application provides a license plate anomaly detection method, which can be executed by a first vehicle or a module (such as a processor, processing unit, chip system, circuit, or chip) in the first vehicle. Optionally, the method can also be implemented by a logic node, logic module, or software capable of implementing all or part of the functions of the first vehicle. For example, the following describes the execution of the license plate anomaly detection method by a first vehicle. The method may include the following steps: the first vehicle sends a first license plate image of the first vehicle to a terminal device.

[0122] The technical effects achievable in the fifth aspect are similar to those achievable in the fourth aspect above, and will not be elaborated upon here.

[0123] In one possible implementation, the method further includes:

[0124] The first vehicle receives a first instruction, which instructs the first vehicle to clean the defacement of its license plate. The first vehicle can then clean the defacement of its license plate according to the first instruction.

[0125] The technical effects achievable by the above implementation methods can be referred to the technical effects of the corresponding implementation methods in the fourth aspect above, and will not be repeated here.

[0126] In one possible implementation, the method further includes:

[0127] The first vehicle receives a seventh message from the terminal device, wherein the seventh message instructs the first vehicle to report video information related to the license plate of the first vehicle. The seventh message may include the acquisition time of the first license plate image of the vehicle. Afterward, the first vehicle may send an eighth message to the terminal device, wherein the eighth message may include video information within a second time period, the second time period representing a period before and after the acquisition time of the first license plate image of the first vehicle.

[0128] The technical effects achievable by the above implementation methods can be referred to the technical effects of the corresponding implementation methods in the fourth aspect above, and will not be repeated here.

[0129] In one possible implementation, the method further includes:

[0130] The first vehicle receives a second instruction from the terminal device, wherein the second instruction instructs the first vehicle to report the license plate image of the first vehicle, and then the first vehicle can send the first license plate image of the first vehicle to the terminal device.

[0131] The technical effects achievable by the above implementation methods can be referred to the technical effects of the corresponding implementation methods in the fourth aspect above, and will not be repeated here.

[0132] In one possible implementation, the method further includes:

[0133] The first vehicle receives a ninth message from the terminal device, wherein the ninth message is used to instruct the first vehicle to activate the license plate image acquisition mode.

[0134] In the above implementation method, the first vehicle can perform license plate image acquisition in a timely and effective manner based on the ninth information sent by the terminal device.

[0135] In one possible implementation, the license plate image acquisition mode may include one of the following:

[0136] License plate image acquisition is performed periodically, whether the first vehicle is in a dormant state or in operation; or,

[0137] The license plate image acquisition is triggered when the first vehicle is in a sleep-wake state or in a powered-on state.

[0138] For the technical effects that can be achieved by the above implementation method, please refer to the technical effects that can be achieved by the corresponding implementation method provided in the fourth aspect above, which will not be repeated here.

[0139] In a sixth aspect, this application provides a license plate anomaly detection device, including units or means for performing each step of any of the implementation methods in the first aspect described above.

[0140] For example, the license plate anomaly detection device can be a first device. The first device may be a first apparatus for implementing the license plate anomaly detection function of a first vehicle, or it may be a module within the first apparatus (such as a processor, processing unit, chip system, circuit, or chip). The license plate anomaly detection device has the function of implementing the method in any of the possible implementations of the first aspect described above. This function can be implemented in hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above-described function.

[0141] In a seventh aspect, this application provides a license plate anomaly detection device, including units or means for performing each step of any of the implementation methods in the second or fourth aspect described above.

[0142] For example, the license plate anomaly detection device can be a terminal device or a vehicle-mounted display device. A terminal device can be a terminal equipment or a module within a terminal equipment (such as a processor, processing unit, chip system, circuit, or chip). A vehicle-mounted display device can be a vehicle-mounted display device (or vehicle display) in a first vehicle, or it can be a module within a vehicle-mounted display device (such as a processor, processing unit, chip system, circuit, or chip). The license plate anomaly detection device has the function of implementing the method in any of the possible implementations of the second or fourth aspect described above. This function can be implemented in hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above-described function.

[0143] Eighthly, this application provides a license plate anomaly detection device, including units or means for performing each step of any of the implementation methods in the third aspect above.

[0144] For example, the license plate anomaly detection device can be a security device. This security device could be a security equipment in the first vehicle used to implement the vehicle's security monitoring functions, or it could be a module within the security equipment (such as a processor, processing unit, chip system, circuit, or chip). The license plate anomaly detection device has the functionality to implement the method in any of the possible implementations of the third aspect described above. This functionality can be implemented in hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the aforementioned functionality.

[0145] Ninthly, this application provides a license plate anomaly detection device, including units or means for performing each step of any of the implementation methods in the fifth aspect above.

[0146] For example, the license plate anomaly detection device may be a first vehicle or a module within the first vehicle (such as a processor, processing unit, chip system, circuit, or chip). This license plate anomaly detection device has the functionality to implement the method in any of the possible implementations of the fifth aspect described above. This functionality can be implemented in hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the aforementioned functionality.

[0147] In a tenth aspect, this application provides a license plate anomaly detection device, which has the functions involved in the first to fifth aspects mentioned above. For example, the license plate anomaly detection device includes modules, units or means corresponding to the operations involved in the first to fifth aspects mentioned above. The functions, units or means can be implemented by software, or by hardware, or by hardware executing corresponding software.

[0148] In one possible implementation, the license plate anomaly detection device may include a transceiver module (or communication module or transceiver unit, used for sending and receiving data) and a processing module (or processing unit). The transceiver module can be used to send and receive signals to enable communication between the license plate anomaly detection device and other devices; for example, it can be used to send data to other communication devices. The processing module can be used to perform some internal operations of the license plate anomaly detection device. The functions performed by the transceiver module and the processing module can correspond to the operations described in the first to fifth aspects above.

[0149] In one possible implementation, the license plate anomaly detection device includes a processor that can be coupled to a memory. The memory can store necessary computer programs or instructions for implementing the functions described in the first to fifth aspects above. The processor can execute the computer programs or instructions stored in the memory, causing the license plate anomaly detection device to implement the methods in any possible implementation of any of the first to fifth aspects above.

[0150] In one possible implementation, the license plate anomaly detection device includes a processor and a memory, the memory of which may store necessary computer programs or instructions for implementing the functions described in the first to fifth aspects above. The processor may execute the computer programs or instructions stored in the memory, and when the computer programs or instructions are executed, the license plate anomaly detection device shall implement the methods in any possible implementation of any of the first to fifth aspects above.

[0151] In one possible implementation, the license plate anomaly detection device includes a processor and an interface circuit (or communication interface), wherein the processor is used to communicate with other devices via the transceiver and to execute the methods in any of the possible implementations of any of the first to fifth aspects described above. The transceiver is used to enable the license plate anomaly detection device to communicate with other devices, for example, to receive signals from other communication devices and transmit them to the processor, or to send signals from the processor of the license plate anomaly detection device to other communication devices, such as the transmission or reception of data and / or signals. Exemplarily, the communication interface may be a transceiver, circuit, bus, module, or other type of communication interface.

[0152] It is understood that, in the tenth aspect mentioned above, the processor can be implemented in hardware or software. When implemented in hardware, the processor can be a logic circuit, integrated circuit, etc.; when implemented in software, the processor can be a general-purpose processor that reads software code stored in memory. Furthermore, there can be one or more processors, and one or more memories. The memory can be integrated with the processor, or the memory and processor can be separately configured. In specific implementations, the memory can be integrated with the processor on the same chip, or it can be configured on different chips. This application does not limit the type of memory or the configuration of the memory and processor.

[0153] Eleventhly, this application provides a vehicle that may include an image acquisition device and a vehicle-mounted infotainment system. Optionally, the vehicle may further include a vehicle-mounted display device. The vehicle-mounted infotainment system may include a first device. Optionally, the vehicle-mounted infotainment system may further include a safety device. The image acquisition device may be used to acquire an image of the vehicle's license plate, or it may be used to acquire an image of the vehicle's surrounding environment. The first device may be used to perform the method in any possible implementation of the first aspect. The vehicle-mounted display device may be used to perform the method in any possible implementation of the second aspect. The safety device may be used to perform the method in any possible implementation of the third aspect. Optionally, the vehicle may be used to perform the method in any possible implementation of the fifth aspect.

[0154] In a twelfth aspect, this application provides a computer program product comprising a computer program or instructions that, when executed on a computer, cause the computer to perform the method in any possible implementation of any of the first to fifth aspects described above.

[0155] In a thirteenth aspect, this application provides a computer-readable storage medium storing a computer program or instructions that, when executed by a computer, cause the computer to perform the method in any possible implementation of any of the first to fifth aspects described above.

[0156] In a fourteenth aspect, this application provides a chip that may include a processor and may also include a memory (or the chip may be coupled to the memory). The chip executes program instructions in the memory to cause the chip to perform any possible implementation of any of the first to fifth aspects described above. Here, "coupling" refers to two components being directly or indirectly connected to each other, such as coupling referring to an electrical connection between two components.

[0157] In a fifteenth aspect, this application also provides a chip system including a processor for supporting a computer device in implementing any possible implementation of the methods in any of the first to fifth aspects described above. In one possible implementation, the chip system further includes a memory for storing programs and data necessary for the computer device. The chip system may be composed of chips or may include chips and other discrete devices.

[0158] Based on the implementation methods provided in the above aspects, this application can be further combined to provide more implementation methods. Attached Figure Description

[0159] Figure 1 illustrates a possible application scenario provided by an embodiment of this application.

[0160] Figure 2 illustrates a schematic diagram of the functional module structure of a vehicle infotainment system provided in an embodiment of this application.

[0161] Figure 3 illustrates a schematic flowchart of a license plate anomaly detection method provided in an embodiment of this application;

[0162] Figure 4a illustrates, by way of example, a schematic diagram of the axis of a license plate and the axis of a fisheye camera provided in an embodiment of this application;

[0163] Figure 4b illustrates, exemplarily, a license plate captured by a fisheye camera according to an embodiment of this application;

[0164] Figure 4c is an exemplary schematic diagram of perspective transformation of a deformed license plate image into a normal license plate image according to an embodiment of this application;

[0165] Figure 5 illustrates a flowchart of another license plate anomaly detection method provided in an embodiment of this application;

[0166] Figure 6 illustrates a schematic diagram of the structure of a license plate anomaly detection device provided in an embodiment of this application.

[0167] Figure 7 illustrates a schematic diagram of another license plate anomaly detection device provided in an embodiment of this application. Detailed Implementation

[0168] The embodiments of this application will now be described in detail with reference to the accompanying drawings.

[0169] The following describes the application scenarios applicable to the license plate anomaly detection method provided in this application. It should be noted that this description is for the convenience of those skilled in the art and does not constitute a limitation on the scope of protection claimed in this application.

[0170] Please refer to Figure 1, which is a schematic diagram of a possible application scenario applicable to the embodiments of this application. As shown in Figure 1, the application scenario may include a vehicle 100 and a terminal device 200, which can communicate via a network. The network may be a wireless network, such as a Wi-Fi (Wi-Fi) network, or a mobile cellular network, or other forms of network. The embodiments of this application do not limit this to any particular type of network.

[0171] The terminal device 200 is equipped with a target application for providing users with various vehicle services or functions.

[0172] Understandably, the target application can be a client (also known as an application (APP) or application software, such as a personal computer (PC) client or mobile client), a web application, or a mini-program embedded in other applications. For example, the target application can include, but is not limited to, vehicle applications or car owner applications.

[0173] For example, taking a vehicle application as the target application, the vehicle application can provide vehicle users (or vehicle owners) with services such as license plate anomaly detection, license plate image acquisition, license plate image reporting, vehicle binding, remote control, remote parking, navigation, remote operation and maintenance (e.g., vehicle monitoring, vehicle diagnostics, vehicle maintenance), over-the-air (OTA) upgrades, automatic parking, or autonomous driving. Optionally, the term "service" in the above description can be replaced with "function".

[0174] For example, the terminal device 200 described above is a device that provides voice or data connectivity to users. It can also be an Internet of Things (IoT) device, and may also be referred to as a terminal, user equipment (UE), access terminal device, vehicle terminal, industrial control terminal, mobile terminal (MT), remote terminal device, or mobile device, etc. For example, terminal device 200 can be: mobile phone, tablet computer, laptop computer, handheld computer, customer-premises equipment (CPE), personal digital assistant (PDA) computer, handset, laptop computer, computer with wireless transceiver function, virtual reality (VR) terminal device, augmented reality (AR) terminal device, head-mounted display (HMD), wearable terminal device (such as smartwatch, smart bracelet, pedometer, etc.), wireless terminal in industrial control, mobile internet device (MID), vehicle terminal (or vehicle functional module or vehicle device, such as a telematics box (T-Box) in a vehicle), wireless terminal in self-driving, wireless terminal in remote medical care, wireless terminal in smart city, or wireless terminal in smart home, etc.

[0175] The vehicle 100 may include a computing platform (also referred to as a computer system), and some or all of the functions of the vehicle 100 are controlled by the computing platform. For example, the computing platform may include at least one processor. The processor can execute instructions stored in a non-transitory computer-readable medium such as memory. In some embodiments, the computing platform may also be multiple computing devices that control individual components or subsystems of the vehicle 100 in a distributed manner. The processor may be any conventional processor, such as a central processing unit (CPU). Optionally, the processor may also include graphics processing units (GPUs), field-programmable gate arrays (FPGAs), systems on chips (SOCs), application-specific integrated circuits (ASICs), or combinations thereof. Optionally, the computing platform may also include a transceiver (or communication interface or interface circuitry). The transceiver may be used to enable the computing platform to communicate with other devices (such as control systems or user interfaces), for example, to receive signals from other devices and transmit them to the processor, or to send signals from the processor in the computing platform to other devices, such as the transmission or reception of data and / or signals. In addition to storing instructions, the memory can also store data such as road maps, route information, vehicle position, vehicle direction, vehicle speed, and other data. This data can be used by the vehicle 100 and the computing platform in autonomous, semi-autonomous, and / or manual modes.

[0176] In one possible example, the first device may be set up (or deployed) in a computing platform. In another possible example, the first device may be set up in the vehicle 100 independently of the computing platform; for example, the first device may be a chip or component set up in the vehicle 100 independently of the computing platform, or it may be a software module set up in the vehicle 100 independently of the computing platform. Optionally, the first device may be set up in the vehicle's infotainment system (or the vehicle perception system (or vehicle perception device) within the infotainment system). For example, the computing platform may also be an infotainment system. For instance, when the computing platform is an infotainment system, the first device may be set up in the infotainment system, or the first device may be set up in the vehicle 100 independently of the infotainment system. When the computing platform is not an infotainment system, the first device may be set up in the computing platform, or the first device may be set up in the vehicle 100 independently of the computing platform; for example, the first device may be set up in the vehicle's infotainment system, or the first device may be a chip or component set up in the vehicle 100 independently of the computing platform, or it may be a software module set up in the vehicle 100 independently of the computing platform. Optionally, in some embodiments, the first device can be described as a "self-testing device, self-testing module, or self-testing process." The first device is used to implement the license plate anomaly detection function of vehicle 100. It is understood that the related functions of the first device (such as the license plate anomaly detection function) can also be deployed on the terminal device, or the first device can also be deployed on the terminal device; that is, the terminal device can also implement the related functions of the first device. Optionally, the vehicle system may also include a safety device. The safety device is used to implement the safety monitoring function of vehicle 100. For example, the safety device can monitor the environment around vehicle 100 in real time through a camera installed on vehicle 100, and when vehicle 100 is subjected to a sudden impact or other acts that infringe on the vehicle, it can record the scene through the camera and promptly alert the vehicle user. For example, in some embodiments, the safety device can be a sentinel module or sentinel process installed in vehicle 100. Optionally, the safety device can also be used to send video information of the license plate image of vehicle 100 within a certain period before and after the acquisition time of the license plate image of vehicle 100 to the vehicle display device or terminal device after obtaining the processing result of the processing of the license plate image of vehicle 100 fed back by the first device. This can help the vehicle user of vehicle 100 to determine the relevant circumstances of the license plate abnormality, such as whether the license plate is really abnormal or the specific reason for the license plate abnormality.

[0177] For example, the first device can be a vehicle control unit (VCU) or a vehicle domain controller (VDC) integrated into the computing platform of the vehicle 100 to control the entire vehicle. Alternatively, it can be an intelligent driving domain control unit or an intelligent driving computing platform (also known as an intelligent driving computing center, such as a mobile data center, MDC) to implement intelligent driving or assisted driving functions. This application does not limit the product form or deployment method of the first device.

[0178] Understandably, vehicle 100 may also include an image acquisition device. This image acquisition device can be used to capture the license plate image of vehicle 100, or it can be used to capture at least one image of the surrounding environment. For example, the image acquisition device may include, but is not limited to: visible light cameras, depth cameras (i.e., 3D cameras), fisheye cameras, monocular cameras, binocular cameras, near-infrared cameras, video cameras, cockpit cameras, dashcams (i.e., recording terminals), reversing camera cameras, or depth cameras, etc. For instance, taking fisheye cameras as the image acquisition device, fisheye cameras can be installed in the front, rear, left, and right directions of vehicle 100 to acquire environmental information in these four directions. The field of view of each of the four fisheye cameras can be greater than 180 degrees, thus achieving omnidirectional capture of the surrounding environment of vehicle 100. It should be understood that the larger the field of view of the image acquisition device, the larger the range that the image acquisition device can perceive.

[0179] Vehicle 100 may also include an in-vehicle display device. Understandably, the aforementioned target application can also be installed on the in-vehicle display device. For details regarding the implementation of the target application installed on the in-vehicle display device, please refer to the relevant introduction to the target application installed on the terminal device; it will not be repeated here.

[0180] For example, the vehicle-mounted display device can be used by the vehicle user of vehicle 100 to input information related to vehicle 100. For instance, the user can edit or input the license plate number of vehicle 100 on the interface provided by the display device, or edit or input other information (such as the relevant functions of vehicle 100). Alternatively, the display device can also be used to provide visuals, such as audio / video displays, navigation displays, or reversing displays. Optionally, the display device also has audio / video playback functionality. Optionally, the display device can provide a vehicle function editing interface to the user of vehicle 100, facilitating the user's editing of the vehicle's relevant functions. For example, the user can trigger a license plate anomaly detection function, a license plate image acquisition function, or a license plate image reporting function on the vehicle function editing interface.

[0181] For example, the aforementioned vehicle 100 may be a pure electric vehicle (battery electric vehicle, pure EV / battery EV), a hybrid electric vehicle (HEV), a range-extended electric vehicle (REEV), a plug-in hybrid electric vehicle (PHEV), an intelligent vehicle (such as an automated guided vehicle (AGV)), a digital vehicle, an unmanned vehicle, an intelligent manufacturing vehicle, or other forms of vehicle, etc., which can be applied to fields such as unmanned driving, assisted driving, intelligent driving, autonomous driving, or connected vehicles.

[0182] For example, consider a vehicle user as the user, a smartphone as the terminal device 200, and a vehicle application as the target application, which provides a license plate anomaly detection function for the vehicle user. The vehicle application is installed on the smartphone. For instance, after logging into the vehicle application on the smartphone, the vehicle user can click (or select) the license plate anomaly detection function on the function service interface provided by the vehicle application. In response to the vehicle user's click (or selection) operation for the license plate anomaly detection function, the smartphone can send information A to the vehicle 100. Information A instructs the vehicle 100 to activate the license plate anomaly detection mode (or the license plate anomaly detection function). After receiving information A, the vehicle 100 can then activate the license plate anomaly detection mode. The vehicle 100 can then acquire the license plate image and perform license plate anomaly detection on the image.

[0183] It should be noted that Figure 1 only schematically illustrates one possible application scenario. This illustrative application scenario is intended to more clearly explain the technical solution of the embodiments of this application and does not constitute a limitation on the application scenarios of the license plate anomaly detection method provided in this application. Furthermore, those skilled in the art will understand that with the emergence of new application scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0184] For example, based on the application scenario shown in Figure 1, to facilitate understanding of this application, this embodiment provides a functional module structure for a vehicle infotainment system. This vehicle infotainment system is configured in a vehicle 100. As shown in Figure 2, according to logical functions, the vehicle infotainment system can be divided into the following functional modules: a first device (or first module) and a safety device (or safety module). Optionally, the vehicle infotainment system may also include an image acquisition process (or image acquisition module or image forwarding module). It should be noted that the connection relationships between the functional modules shown in Figure 2 are merely an example and do not constitute a limitation of this application. The functions of each functional module are described below.

[0185] The first device is used to realize the license plate anomaly detection function of vehicle 100.

[0186] For example, after acquiring the license plate image of vehicle 100, the first device can process the license plate image to obtain a processing result (such as whether the license plate is abnormal). Then, the first device can send the processing result to at least one of the following: a vehicle display device, a terminal device, or a security device.

[0187] Understandably, for details regarding the first device that are not described in detail, please refer to the relevant introduction about the first device above, which will not be repeated here.

[0188] The safety device is used to implement the safety monitoring function of vehicle 100. Optionally, the safety device can also communicate with the vehicle display device or terminal device.

[0189] For example, after receiving the processing results from the first device, the security device can obtain video information for a period of time before and after the capture time of the abnormal license plate image. Then, the security device can send this video information to the vehicle's display device or terminal device, allowing the vehicle's user to easily determine the relevant circumstances of the license plate anomaly, such as the specific reason for the anomaly.

[0190] Optionally, the first device and the safety device can be two independent devices, or they can be integrated into one device, or they can be the same device. When the first device and the safety device are integrated into one device, or when the first device and the safety device are the same device, the device (referring to the same device or an integrated device) can perform the functions of both the first device and the safety device. For example, when the device performs the function of the safety device, it does not need to obtain the processing result fed back by the first device, but can directly obtain video information within a certain period before and after the acquisition time of the abnormal license plate image based on the license plate anomaly result. Then, the device can send the video information within this period of time to the vehicle display device or terminal device.

[0191] When the vehicle infotainment system includes an image acquisition process, the image acquisition process can be used to acquire the license plate image of vehicle 100 from the image acquisition device and can send the license plate image of vehicle 100 to the first device. When the vehicle infotainment system does not include an image acquisition process, the first device can acquire the license plate image of vehicle 100 from the image acquisition device. For example, after acquiring the license plate image of vehicle 100, the image acquisition device can send the license plate image of vehicle 100 to the first device.

[0192] Optionally, the first device, the safety device, and the image acquisition process can all be implemented in software or in hardware. For example, the implementation of the first device will be described below. Similarly, the implementation of the safety device and the image acquisition process can refer to the implementation of the first device, and will not be repeated here.

[0193] When implemented via software, the first device can be an application or code block running on a computing device (or control unit, etc.) with data processing capabilities within the vehicle's infotainment system. The computing device can be at least one of a physical host, virtual machine, container, etc. Furthermore, there can be one or more computing devices. For example, the first device can be an application running on multiple hosts / virtual machines / containers.

[0194] When implemented in hardware, the first device may include at least one processor (or chip, etc.). Alternatively, the first device may be implemented using an application-specific integrated circuit (ASIC) or a programmable logic device (PLD). The PLD may be a complex programmable logical device (CPLD), a field-programmable gate array (FPGA), generic array logic (GAL), or any combination thereof.

[0195] Furthermore, it is understood that the module division in the embodiments of this application is illustrative and merely a logical functional division; in actual implementation, there may be other division methods. The functional modules in the embodiments of this application can be integrated into one module, or each module can exist physically separately, or two or more modules can be integrated into one module. For example, taking the first device and the image acquisition process as an example, the first device and the image acquisition process can be integrated into one module, or the first device and the image acquisition process can be the same module, or the first device and the image acquisition process can also be independent modules. The integrated unit described above can be implemented in hardware or as a software functional unit.

[0196] As described in the background section, taking a parking lot with video surveillance as an example, the monitoring platform acquires the license plate image of a vehicle through the parking lot's video surveillance devices. Then, the monitoring platform identifies the license plate image to determine if there are any anomalies. If the license plate is abnormal, and the vehicle owner has not provided contact information, the platform can only notify the owner offline, such as when the owner passes through the parking lot entrance or exit, or by contacting the owner if they have provided contact information. However, this solution has certain limitations, such as limited application area (e.g., it can only detect license plate anomalies in parking lots with video surveillance), or situations where license plate anomalies cannot be detected (e.g., replacing the license plate of one vehicle in the parking lot with the license plate of another vehicle in the same parking lot would prevent the detection of license plate anomalies).

[0197] In view of this, this application provides a method for detecting license plate anomalies, which enables vehicles to perform self-checks on their own license plates and can detect license plate anomalies in a timely and effective manner.

[0198] Based on the application scenario shown in Figure 1, the specific implementation of the license plate anomaly detection method in this application embodiment will be described in detail below.

[0199] Figure 3 illustrates a flowchart of a license plate anomaly detection method provided in an embodiment of this application. This method is applicable to the application scenario shown in Figure 1. It is understood that the license plate anomaly detection method shown in Figure 3 is illustrated using multiple devices in a first vehicle (such as a first device, terminal device, vehicle display device, or safety device, etc.) as the execution subject for the interactive illustration, but this application does not limit the execution subject of the interactive illustration. For example, the first device can be a first equipment for implementing the license plate anomaly detection function of the first vehicle, or it can be a module in the first equipment (such as a processor, processing unit, chip system, circuit, or chip, etc.), or it can be a logic module or software capable of implementing all or part of the functions of the first equipment. A terminal device can be a terminal equipment, or a component within a terminal equipment. Examples include communication modules, circuits or chips responsible for communication functions (such as modem chips, also known as baseband chips, or system-on-chip (SoC) chips or system-in-package (SIP) chips containing modem cores), chip systems, or processors, and logic modules or software capable of implementing all or part of the terminal equipment's functions. A vehicle-mounted display device can be a vehicle-mounted display device (or vehicle-mounted display) in the first vehicle, or a module within a vehicle-mounted display device (such as a processor, processing unit, chip system, circuit, or chip), and logic modules or software capable of implementing all or part of the vehicle-mounted display device's functions. A safety device can be a safety device in the first vehicle used to implement the vehicle's safety monitoring functions, or a module within a safety device (such as a processor, processing unit, chip system, circuit, or chip), and logic modules or software capable of implementing all or part of the safety device's functions.

[0200] As shown in Figure 3, the method includes:

[0201] Step 301: The first device acquires the first license plate image of the first vehicle.

[0202] The first device is located on the first vehicle. For a description of the first device, please refer to the introduction above; it will not be repeated here.

[0203] The following describes the process of the first device acquiring the first license plate image of the first vehicle through several possible implementation methods.

[0204] Method a1: The first device acquires an image of the second license plate of the first vehicle. Then, the first device can process the second license plate image to obtain the first license plate image.

[0205] In one example, the image of the second license plate of the first vehicle may be acquired (or captured) via an image acquisition device on the first vehicle.

[0206] Understandably, before the image acquisition device on the first vehicle acquires the license plate image of the first vehicle, it needs to be confirmed that the image acquisition device on the first vehicle is in normal working condition.

[0207] For example, after acquiring an image of the second license plate of the first vehicle, the image acquisition device on the first vehicle can send the image of the second license plate of the first vehicle to the first device. Alternatively, after acquiring the image of the second license plate of the first vehicle, the image acquisition device on the first vehicle can store (or cache) the image of the second license plate of the first vehicle. Then, the first device in the first vehicle can retrieve the image of the second license plate of the first vehicle from the cache area or storage area used to store the license plate image.

[0208] In another example, the image of the second license plate of the first vehicle could be obtained via a second vehicle or another vehicle.

[0209] For example, let's assume the second license plate image is acquired via a second vehicle. The second license plate image of the first vehicle can be acquired by an image acquisition device on the second vehicle and transmitted to the first vehicle. Then, a first device in the first vehicle can acquire the second license plate image. Understandably, after acquiring the second license plate image, the first vehicle can send it to the first device. Alternatively, after acquiring the second license plate image, the first vehicle can store it. Then, the first device in the first vehicle can retrieve the second license plate image from a cache area or storage area used for storing license plate images.

[0210] For example, after the image of the second license plate of the first vehicle is acquired by the image acquisition device on the second vehicle, it is transmitted to the first vehicle by the second vehicle (or its onboard equipment) using vehicle-to-vehicle communication (V2V) technology. Then, the first device in the first vehicle can acquire the second license plate image of the first vehicle. In one possible implementation, after acquiring the second license plate image of the first vehicle, the image acquisition device on the second vehicle can send the second license plate image of the first vehicle to the onboard equipment (such as a communication module or remote communication module) of the second vehicle, which then uses V2V technology to send the second license plate image of the first vehicle back to the first vehicle.

[0211] For example, after the image of the second license plate of the first vehicle is acquired by the image acquisition device on the second vehicle, it is transmitted by the second vehicle (or its onboard equipment) to a roadside device (such as a roadside unit (RSU)) using vehicle-to-everything (V2X) technology. The roadside device then transmits the image to the first vehicle. Subsequently, the first device in the first vehicle can acquire the second license plate image of the first vehicle. It is understood that the second vehicle and the first vehicle can be located in the same area, such as traveling on the same road. In one possible implementation, after acquiring the second license plate image of the first vehicle, the image acquisition device on the second vehicle can send the image to its onboard equipment (such as a remote communication module). The onboard equipment then uses V2X technology to transmit the image to the roadside device. After acquiring the second license plate image of the first vehicle, the roadside device can then transmit it back to the first vehicle. Optionally, the roadside equipment can use V2X technology to directly transmit the second license plate image of the first vehicle to the first vehicle, or it can use V2X technology to transmit the second license plate image of the first vehicle to a third vehicle, which then uses V2V technology to transmit the second license plate image of the first vehicle back to the first vehicle. Understandably, the third vehicle and the first vehicle can also be located in the same area, such as traveling on the same road.

[0212] In yet another example, the second license plate image of the first vehicle could be obtained via roadside sensing devices (such as roadside cameras).

[0213] For example, after a roadside sensor acquires an image of the second license plate of a first vehicle, it can directly transmit the image to the first vehicle. Then, a first device in the first vehicle can acquire the second license plate image. It is understandable that after acquiring the second license plate image, the first vehicle can send it to the first device. Alternatively, after acquiring the second license plate image, the first vehicle can store it. Then, the first device in the first vehicle can retrieve the second license plate image from a cache area or storage area used for storing license plate images.

[0214] For example, after a roadside sensor acquires an image of the second license plate of a first vehicle, it can transmit this image to other vehicles (such as a second or third vehicle). These other vehicles (or their onboard devices) then use V2V technology to transmit the second license plate image back to the first vehicle. Subsequently, a first device in the first vehicle can acquire the second license plate image.

[0215] For example, after a roadside sensor acquires an image of the second license plate of a first vehicle, it can transmit the image to the roadside equipment, which then transmits it back to the first vehicle. Subsequently, a first device in the first vehicle can acquire the second license plate image. Optionally, the roadside equipment can use V2X technology to directly transmit the second license plate image to the first vehicle, or it can use V2X technology to transmit the image to a fourth vehicle, which then uses V2V technology to transmit the image back to the first vehicle. Understandably, the fourth vehicle and the first vehicle can also be located in the same area, such as traveling on the same road.

[0216] In one possible implementation, after acquiring the second license plate image of the first vehicle, the first device can perform perspective transformation processing on the second license plate image to obtain the first license plate image.

[0217] For example, let's take an image acquisition device on a first vehicle, specifically a fisheye camera, as an example, to acquire an image of the vehicle's second license plate. It should be understood that fisheye cameras have a wide shooting angle. By adjusting the angle between the axis of the license plate and the axis of the fisheye camera, the fisheye camera can acquire a suitable license plate image, as shown in Figure 4a. In this case, by adjusting the angle between the axis of the license plate and the axis of the fisheye camera, the fisheye camera can acquire a suitable image of the vehicle's license plate. Fisheye cameras are installed at both the front and rear positions of the first vehicle.

[0218] However, due to the special design of the lens, images captured by fisheye cameras often exhibit significant distortion and curvature, as shown in Figure 4b. As shown in Figure 4b, the license plate image captured by the fisheye camera shows obvious distortion and curvature. Therefore, in order to convert the license plate image captured by the fisheye camera into a clear image without significant distortion, it is necessary to correct or remove the distortion. For example, the radial distortion occurring in the license plate image captured by the fisheye camera can be corrected using perspective transformation, thereby obtaining a license plate image with a normal perspective (or a normal license plate image), as shown in Figure 4c. It is understandable that the license plate image captured by the fisheye camera is a distorted license plate image (or a deformed license plate image).

[0219] Method a2: After acquiring the second license plate image of the first vehicle, the image acquisition device on the first vehicle, the second vehicle, the roadside sensor, or the roadside equipment can process the second license plate image of the first vehicle to obtain the first license plate image of the first vehicle. Then, the image acquisition device on the first vehicle, the second vehicle, the roadside sensor, or the roadside equipment can send the first license plate image of the first vehicle to the first device in the first vehicle.

[0220] For example, after acquiring an image of the second license plate of the first vehicle, the image acquisition device on the first vehicle can process the second license plate image, such as performing perspective transformation, to obtain the first license plate image of the first vehicle. Then, the image acquisition device on the first vehicle can send the first license plate image to the first vehicle. Then, the first device in the first vehicle can acquire the first license plate image.

[0221] For example, after acquiring the second license plate image of the first vehicle, the second vehicle can process the second license plate image, such as performing perspective transformation, to obtain the first license plate image of the first vehicle. Then, the second vehicle can send the first license plate image of the first vehicle to the first vehicle. Then, the first device in the first vehicle can acquire the first license plate image of the first vehicle. Understandably, the process of the second vehicle sending the first license plate image of the first vehicle to the first vehicle can refer to the process of the second vehicle transmitting the second license plate image of the first vehicle to the first vehicle described above, and the process of the first device acquiring the first license plate image of the first vehicle can refer to the process of the first device acquiring the second license plate image of the first vehicle described above; it will not be repeated here.

[0222] For example, after acquiring the second license plate image of a first vehicle, the roadside sensor can process the second license plate image, such as performing perspective transformation, to obtain the first license plate image. Then, the roadside sensor can send the first license plate image to the first vehicle. Subsequently, a first device in the first vehicle can acquire the first license plate image. Understandably, the process of the roadside sensor sending the first license plate image to the first vehicle can refer to the process of the roadside sensor transmitting the second license plate image to the first vehicle described above, and the process of the first device acquiring the first license plate image can refer to the process of the first device acquiring the second license plate image of the first vehicle described above; it will not be repeated here.

[0223] For example, after acquiring the second license plate image of the first vehicle, the roadside equipment can process the second license plate image, such as performing perspective transformation, to obtain the first license plate image. Then, the roadside equipment can send the first license plate image to the first vehicle. Then, the first device in the first vehicle can acquire the first license plate image. Understandably, the process of the roadside equipment sending the first license plate image to the first vehicle can refer to the process of the roadside equipment transmitting the second license plate image to the first vehicle described above, and the process of the first device acquiring the first license plate image can refer to the process of the first device acquiring the second license plate image of the first vehicle described above; it will not be repeated here.

[0224] Optionally, when the second license plate image of the first vehicle is acquired by the image acquisition device on the first vehicle, the first device can also send instruction information to the image acquisition device on the first vehicle according to the vehicle status (or vehicle system status) of the first vehicle. This implementation allows the image acquisition device on the first vehicle to adopt different monitoring strategies (or monitoring methods) to acquire the license plate image of the first vehicle according to different vehicle statuses, thereby helping the first device to detect license plate anomalies in a timely and accurate manner. The instruction information is used to instruct the image acquisition device on the first vehicle to acquire the license plate image of the first vehicle. Then, the image acquisition device on the first vehicle can acquire the second license plate image of the first vehicle according to the instruction information. Then, the image acquisition device on the first vehicle can send the second license plate image of the first vehicle to the first device, or it can store the second license plate image of the first vehicle. When the image acquisition device on the first vehicle stores the second license plate image of the first vehicle, the first device in the first vehicle can retrieve the second license plate image of the first vehicle from the cache area or storage area used for storing the license plate image. For example, the vehicle status of the first vehicle may include a dormant state, a dormant-wake-up state (which can be understood as a startup state), or a running state, etc. For example, when the first vehicle is parked in a garage, parking lot, or on the roadside, its vehicle status is dormant. When the vehicle's user (or driver) starts the first vehicle, its vehicle status is awakened from dormancy. When the first vehicle is in motion, its vehicle status is running.

[0225] Optionally, before sending instruction information to the image acquisition device on the first vehicle, the first device may also receive fourth information from the terminal device or the vehicle display device. This fourth information may be used to instruct the first vehicle (or the first device) to activate the license plate anomaly detection mode (or license plate anomaly detection function). For example, the license plate anomaly detection mode may include one of the following modes.

[0226] Mode m1: When the first vehicle is in a dormant state or in an operating state, the first vehicle (or the first device) periodically performs license plate anomaly detection.

[0227] Mode m2: When the first vehicle is in a sleep-wake state or in a powered-on state, the first vehicle (or the first device) triggers the license plate anomaly detection.

[0228] In one possible implementation, the terminal device or in-vehicle display device can provide a second interface. This second interface is used to assist the vehicle owner (or the driver of the first vehicle or the vehicle user of the first vehicle) in setting up vehicle-related functions. For example, a target application can be installed on the terminal device or in-vehicle display device. The target application can be used to provide at least one vehicle service or vehicle function. When the vehicle owner logs into the target application, the target application can display the second interface. It is understood that a description of the target application can be found in the introduction above, and will not be repeated here.

[0229] The owner of the first vehicle can edit relevant functions of the first vehicle on the second interface, such as editing the license plate anomaly detection function, license plate image reporting function, license plate image acquisition function, remote parking function, remote control function, etc. In response to the owner clicking the license plate anomaly detection function on the second interface, the terminal device or vehicle display device can send fourth information to the first vehicle (or the first device). Afterwards, the first vehicle (or the first device) can receive the fourth information from the terminal device or vehicle display device. Optionally, when the first vehicle receives the fourth information from the terminal device or vehicle display device, the first vehicle can send the fourth information to the first device.

[0230] The following examples illustrate the process of the first device sending instruction information to the image acquisition device on the first vehicle.

[0231] Example b1: If the first vehicle is in a dormant state or in a running state, the first device can send second information to the image acquisition device on the first vehicle. The image acquisition device on the first vehicle can then receive the second information. The image acquisition device on the first vehicle can then periodically acquire images of the first vehicle's license plate (e.g., a second license plate image) based on the second information. The second information can be used to instruct the image acquisition device on the first vehicle to periodically acquire (or capture) images of the first vehicle's license plate. For example, the second information can be used to instruct the image acquisition device on the first vehicle to acquire an image of the first vehicle's license plate at regular intervals (e.g., intervals of 10s, 20s, or other durations (e.g., 20ms)).

[0232] Example b1 above involves periodically acquiring license plate images. Compared to the continuous acquisition of license plate images by video surveillance devices in existing solutions, this saves power consumption of the first vehicle or the image acquisition device on the first vehicle. Furthermore, example b1 enables the first vehicle (or the first device) to detect license plate anomalies promptly and accurately.

[0233] Example b2: If the first vehicle is in a sleep / wake-up state or a powered-on state, the first device can send third information to the image acquisition device on the first vehicle. Then, the image acquisition device on the first vehicle can receive the third information. Then, the image acquisition device on the first vehicle can, based on the third information, trigger-based (or immediately) acquire an image of the first vehicle's license plate (e.g., a second license plate image). The third information can be used to instruct the image acquisition device on the first vehicle to acquire the license plate image of the first vehicle. Optionally, the statement that the third information can be used to instruct the image acquisition device on the first vehicle to acquire the license plate image of the first vehicle can be replaced with the description "The third information can be used to instruct the image acquisition device on the first vehicle to immediately (or trigger-based) acquire the license plate image of the first vehicle."

[0234] Example b2 above triggers the image acquisition device on the first vehicle to capture an image of the license plate when the vehicle is just started. This enables triggered detection of license plate anomalies and avoids discovering the anomaly only during vehicle operation. Furthermore, example b2 also allows the first vehicle (or the first device) to detect license plate anomalies promptly and accurately.

[0235] Step 302: The first device determines the license plate status of the first vehicle based on the first license plate image.

[0236] For example, the license plate status of the first vehicle can be normal or abnormal.

[0237] The following describes the implementation process of the first device determining the license plate status of the first vehicle based on the first license plate image through several possible implementation methods.

[0238] Method c1: The first device can perform damage recognition on the first license plate image to obtain the license plate damage status or license plate occlusion status of the first vehicle. The license plate damage status can include whether the license plate is damaged or not. The license plate occlusion status can include whether the license plate is occluded or not. If the first vehicle's license plate is neither damaged nor occluded, the first device can determine that the license plate status of the first vehicle is normal. If the first vehicle's license plate is damaged or occluded, the first device can determine that the license plate status of the first vehicle is abnormal.

[0239] Method c2: The first device can perform license plate number recognition on the first license plate image to obtain the first license plate number of the first vehicle. After obtaining the first license plate number, the first device can compare (or contrast) the first license plate number with a second license plate number. If the first license plate number and the second license plate number are the same, the first device can determine that the license plate status of the first vehicle is normal. If the first license plate number and the second license plate number are different, the first device can determine that the license plate status of the first vehicle is abnormal. The second license plate number is the actual license plate number of the first vehicle (or may be referred to as the real license plate number).

[0240] For example, the second license plate number of the first vehicle can be sent to the first vehicle (or the first device) by the owner of the first vehicle through the vehicle's infotainment display device or terminal device, or the second license plate number of the first vehicle can be obtained by the first device through license plate number recognition of the license plate image of the first vehicle in a normal state. Understandably, "normal state" can mean that the license plate is undamaged or intact, or it can mean that the owner of the first vehicle finds no abnormalities in the license plate during inspection.

[0241] In one example, the owner of a first vehicle can edit or input (e.g., manually enter) the vehicle's actual license plate number in a target application on a terminal device or in-vehicle display device and submit it. In response to the owner's submission of the vehicle's actual license plate number, the terminal device or in-vehicle display device can obtain the vehicle's actual license plate number. Then, the terminal device or in-vehicle display device can send the vehicle's actual license plate number to the first vehicle (or the first device). After obtaining the vehicle's actual license plate number, the first vehicle (or the first device) can store it. Optionally, when the terminal device or in-vehicle display device can send the vehicle's actual license plate number to the first vehicle, the first vehicle can also send its actual license plate number to the first device.

[0242] In another example, the image acquisition device on the first vehicle can acquire an image of the vehicle's license plate in its normal state. The image acquisition device then sends this license plate image to a first device. After acquiring the license plate image, the first device can process it (e.g., perform perspective transformation) to obtain a processed license plate image. Then, the first device can perform license plate number recognition on the processed license plate image, and the obtained license plate number is the vehicle's actual license plate number. After obtaining the vehicle's actual license plate number, the first device can store it.

[0243] Method c3: The first device can perform damage recognition on the first license plate image to obtain the damage status of the license plate of the first vehicle. The first device can also perform license plate number recognition on the first license plate image to obtain the first license plate number of the first vehicle. If the license plate of the first vehicle is not damaged and the first license plate number is the same as the second license plate number, the first device can determine that the license plate status of the first vehicle is normal. If the license plate of the first vehicle is damaged, or the first license plate number is different from the second license plate number, or the license plate of the first vehicle is damaged and the first license plate number is different from the second license plate number, the first device can determine that the license plate status of the first vehicle is abnormal.

[0244] Regarding the license plate defacement recognition mentioned in method c1 or method c3 above, in one possible implementation, when the first device performs defacement recognition on the first license plate image, it can determine the defacement status of the first vehicle's license plate based on the first license plate image and a first model. The first model can be used to describe the correspondence between the license plate image and the defacement status of the license plate.

[0245] For example, the first device can input the first license plate image into the trained first model to obtain the license plate damage status of the first vehicle.

[0246] The following section describes the training process of the first model, which is generated by training a first model on a computing device. The initial first model is an initial convolutional neural network. Optionally, during the training of the first model, one or more machine learning algorithms can be used to achieve equivalent or similar functions, such as convolutional neural networks, reinforcement learning, and deep learning.

[0247] For example, the computing device can be the first device, or it can be other devices or modules of the first vehicle, or it can be other devices. After acquiring the first training sample set, the computing device can input the first training sample set into the initial convolutional neural network for training (or iterative training) until the initial convolutional neural network converges or meets the training requirement, thus obtaining the trained first model. The first training sample set can include multiple license plate image samples with labels or categories (license plate damaged or license plate undamaged), or the first training sample set can include multiple license plate image samples with pre-labeled license plate damage status (license plate damaged or license plate undamaged). It is understood that each license plate image sample is labeled with whether the corresponding license plate is damaged or undamaged. In one possible implementation, manual labeling (or manual marking) can be used. Based on whether each license plate image sample in the multiple license plate image samples is damaged, each license plate image sample is labeled, thus obtaining multiple license plate image samples labeled with license plate damage status (or multiple license plate image samples with labels or categories).

[0248] Regarding the license plate number recognition mentioned in method c2 or method c3 above, in one possible implementation, when the first device performs license plate number recognition on the first license plate image, it can determine the first license plate number of the first vehicle based on the first license plate image and a second model. The second model can be used to describe the correspondence between the license plate image and the license plate number.

[0249] For example, the first device can input the first license plate image into the trained second model to obtain the first license plate number.

[0250] The following section describes the training process of the second model, using a computing device as an example, with the initial second model being an initial convolutional neural network. Optionally, during the training of the second model, one or more machine learning algorithms can be used to achieve equivalent or similar functions, such as convolutional neural networks, reinforcement learning, deep learning, and other machine learning algorithms.

[0251] For example, the computing device can be the first device, or it can be other devices or modules of the first vehicle, or it can be other devices. After acquiring the second training sample set, the computing device can input the second training sample set into the initial convolutional neural network for training (or iterative training) until the initial convolutional neural network converges or meets the training requirement, thus obtaining the trained second model. The second training sample set can include multiple license plate image samples with license plate numbers, or it can include multiple license plate image samples with pre-annotated license plate numbers. In one possible implementation, manual annotation can be used. Based on the license plate number contained in each license plate image sample, each license plate image sample is annotated to obtain multiple license plate image samples with annotated license plate numbers (or multiple license plate image samples with license plate numbers).

[0252] Step 303: If the license plate status of the first vehicle is abnormal, the first device sends first information. Accordingly, the terminal device, the vehicle display device, or the safety device receives the first information from the first device.

[0253] For example, the first information may include at least one of the following: the first license plate image of the first vehicle, the abnormal status of the license plate of the first vehicle, or the acquisition time of the first license plate image of the first vehicle.

[0254] The following examples illustrate the process of the first device sending the first information.

[0255] Example d1: If the first vehicle is in a dormant state, the first device may send first information to the terminal device and / or the safety device in the first vehicle.

[0256] For example, when the first vehicle is in a dormant state, the first device may send the first information to the terminal device, or it may send the first information to the safety device in the first vehicle, or it may send the first information to both the terminal device and the safety device in the first vehicle.

[0257] Example d1 above can promptly notify the terminal device of any abnormality in the license plate of the first vehicle when the first vehicle is in a dormant state. This allows the terminal device to promptly remind the vehicle owner that the license plate of the first vehicle is abnormal, enabling the vehicle owner to promptly detect the abnormality and handle the problem in a timely manner.

[0258] Example d2: If the first vehicle is in a sleep-wake state, or the first vehicle is powered on, or the first vehicle is in operation, the first device may send first information to the terminal device and / or the vehicle display device in the first vehicle.

[0259] For example, when the first vehicle is in a sleep / wake-up state, a running state, or a power-on state, the first device can send the first information to the terminal device, or it can send the first information to the vehicle display device in the first vehicle, or it can send the first information to both the terminal device and the vehicle display device in the first vehicle.

[0260] Example d2 above can promptly notify the terminal device or vehicle display device of the license plate anomaly of the first vehicle when the first vehicle is in a sleep / wake-up state or in operation state. This allows the terminal device or vehicle display device to promptly remind the vehicle owner that the license plate of the first vehicle is abnormal, thereby enabling the vehicle owner to promptly discover the license plate anomaly and facilitate timely handling of the license plate anomaly problem.

[0261] Step 304: The terminal device or vehicle display device displays the fifth information on the first interface, or plays the fifth information by voice.

[0262] The fifth piece of information can be used to notify (or remind) the owner of the first vehicle that the license plate of the first vehicle is abnormal.

[0263] In one example, the terminal device or in-vehicle display device can provide a first interface. This first interface is used to notify the vehicle owner that the license plate is abnormal.

[0264] In one possible implementation, after the terminal device or vehicle display device receives the first information, it can display the first interface. Then, the terminal device or vehicle display device can display the fifth information on the first interface.

[0265] For example, consider a target application installed on a terminal device or in-vehicle display device. After receiving the first information, the target application on the terminal device or in-vehicle display device can display a first interface (such as a pop-up window, prompt, message, or notification window). Then, the target application on the terminal device or in-vehicle display device can display a fifth piece of information on the first interface. Understandably, a description of the target application can be found in the introduction above, and will not be repeated here.

[0266] In another example, the terminal device or vehicle display device can play the fifth message via voice.

[0267] For example, after receiving the first information, the terminal device can send a tenth piece of information to its voice device (or voice playback device, such as a microphone). This tenth piece of information can instruct the voice device to play a message indicating an anomaly in the license plate of the first vehicle. Upon receiving the tenth piece of information, the voice device can generate a fifth piece of information and then transmit it. It is understood that this fifth piece of information can refer to voice information.

[0268] For example, after receiving the first information, the vehicle's display device can send a tenth message to the vehicle's in-vehicle voice acquisition device (also called a voice acquisition device or sound acquisition device, such as an in-vehicle microphone). This tenth message can be used to instruct the in-vehicle voice acquisition device to play a message indicating an anomaly in the vehicle's license plate. Upon receiving the tenth message, the in-vehicle voice acquisition device can generate a fifth message and then send it out. It is understandable that this fifth message can refer to voice information.

[0269] Step 305: The safety device sends sixth information to the terminal device and / or the vehicle display device based on the first information. Accordingly, the terminal device and / or the vehicle display device receives the sixth information.

[0270] The sixth piece of information may include video information within the first time period. The first time period refers to a period of time before and after the acquisition time (or acquisition moment) of the first license plate image of the first vehicle. Optionally, when the license plate contained in the first license plate image is in an abnormal state, the first time period may also refer to a period of time before and after the acquisition time of the abnormal first license plate image.

[0271] For example, let's take the acquisition time of the first license plate image as t1. In one example, a time interval Δt is taken before and after the acquisition time t1. In this case, the first time interval can be [t1-Δt, t1+Δt]. Thus, the security device can obtain video information whose video time (or video acquisition time or video recording time) falls within the first time interval [t1-Δt, t1+Δt]. For instance, the security device can obtain video information whose video time falls within the first time interval [t1-Δt, t1+Δt] from a storage area or cache area used to store video information.

[0272] In another example, a time interval Δt1 is taken before the acquisition time t1 of the first license plate image, and a time interval Δt2 is taken after the acquisition time t1. In this case, the first time interval can be [t1-Δt1, t1+Δt2]. Thus, the security device can obtain video information whose video time falls within the first time interval [t1-Δt1, t1+Δt2]. For example, the security device can obtain video information whose video time falls within the first time interval [t1-Δt1, t1+Δt2] from a storage area or cache area used to store video information. Here, Δt1 and Δt2 are not equal.

[0273] In another example, a duration Δt3 is taken before the acquisition time t1 of the first license plate image. In this case, the first time period can be [t1-Δt3, t1]. Thus, the security device can obtain video information whose video time falls within the first time period [t1-Δt3, t1]. For example, the security device can obtain video information whose video time falls within the first time period [t1-Δt3, t1] from a storage area or cache area used to store video information.

[0274] In another example, a duration Δt4 is taken after the acquisition time t1 of the first license plate image. In this case, the first time period can be [t1, t1 + Δt4]. Thus, the security device can obtain video information whose video time falls within the first time period [t1, t1 + Δt4]. For example, the security device can obtain video information whose video time falls within the first time period [t1, t1 + Δt4] from a storage area or cache area used to store video information.

[0275] In one possible implementation, after receiving the sixth information, the terminal device can display a prompt (or notification) on the third interface. This prompt can encourage the vehicle owner to click to play the video information within the first time period. In response to the vehicle owner clicking the play button on the third interface, the terminal device can play the video information within the first time period. Optionally, the terminal device can also play the video information within the first time period on the third interface after receiving the sixth information. By playing the video information within the first time period, the terminal device can help the vehicle owner promptly and effectively determine whether the license plate is truly abnormal, and can help the vehicle owner promptly and effectively determine the specific reason for the license plate abnormality, or can help the vehicle owner more quickly find the cause of the license plate abnormality.

[0276] In another possible implementation, after receiving the sixth information, the vehicle-mounted display device can display a prompt message on the third interface. This prompt message can encourage the driver to click to play the video information within the first time period, allowing the driver to promptly and effectively determine the specific reason for the license plate anomaly, or to more quickly identify the cause of the anomaly. In response to the driver clicking the play button on the third interface, the vehicle-mounted display device can play the video information within the first time period. Optionally, the vehicle-mounted display device can also play the video information within the first time period on the third interface after receiving the sixth information. By playing the video information within the first time period, the vehicle-mounted display device can help the driver promptly and effectively determine whether the license plate is indeed abnormal, and can help the driver promptly and effectively determine the specific reason for the license plate anomaly, or can help the driver more quickly identify the cause of the license plate anomaly.

[0277] As can be seen from steps 301 to 305 above, after acquiring the first license plate image of the first vehicle, the first device in the first vehicle can automatically detect the first license plate image to determine whether the license plate status of the first vehicle is abnormal. This allows the first vehicle to identify whether its license plate is abnormal through self-checking, which helps to detect license plate anomalies in a timely and effective manner. If the license plate status of the first vehicle is abnormal, the first device can send information indicating that the license plate is abnormal, so that the receiving device (such as a terminal device or vehicle display device) can promptly and effectively notify (or remind) the owner of the first vehicle that the license plate is abnormal. This allows the owner of the first vehicle to be notified of the license plate anomaly in a timely manner, making it easier for them to discover the license plate anomaly and take appropriate action.

[0278] Figure 5 is a flowchart illustrating another license plate anomaly detection method provided in this application embodiment. This method is applicable to the application scenario shown in Figure 1. It is understood that the license plate anomaly detection method shown in Figure 5 is illustrated using a terminal device and a first vehicle as the execution subjects in the interaction illustration, but this application does not limit the execution subjects in the interaction illustration. The terminal device can have an association or binding relationship with the first vehicle. It is understood that in this application embodiment, the terminal device can implement the relevant functions of the first device (such as the license plate anomaly detection function). For example, a target application on the terminal device can establish an association with the first vehicle, allowing the owner of the first vehicle to control the first vehicle by performing corresponding operations on the target application. It is understood that the method executed by the first vehicle in this application can also be executed by a module applied to the first vehicle (such as a processor, processing unit, chip system, circuit, or chip), or by a logic node, logic module, or software capable of implementing all or part of the functions of the first vehicle. For example, a terminal device can be a terminal equipment, or a component in a terminal equipment, such as a communication module, a circuit or chip responsible for communication functions (such as a modem chip, also known as a baseband chip, or a system-on-chip (SoC) chip or system-in-package (SIP) chip containing a modem core), a chip system, or a processor, etc. It can also be a logic module or software that can realize all or part of the functions of a terminal equipment.

[0279] As shown in Figure 5, the method includes:

[0280] Step 501: The first vehicle sends its first license plate image to the terminal device. Accordingly, the terminal device acquires (or receives) the first license plate image of the first vehicle.

[0281] For example, the first license plate image of the first vehicle can be acquired by the first vehicle and sent to the terminal device, or it can be acquired by the first device in the first vehicle and sent to the terminal device.

[0282] The following describes the implementation process of the first vehicle sending its first license plate image to the terminal device through several possible implementation methods. Optionally, the first device in the first vehicle may also send the first license plate image to the terminal device. It is understood that the implementation process of the first device in the first vehicle sending the first license plate image to the terminal device can refer to the relevant descriptions of methods e1 to e2 below and the relevant descriptions of the first device obtaining the first license plate image above, and will not be repeated here.

[0283] Method e1: The first vehicle acquires an image of its second license plate. Then, the first vehicle processes the second license plate image to obtain a first license plate image. Finally, the first vehicle sends the first license plate image to the terminal device.

[0284] In one possible implementation, after obtaining an image of its first license plate, the first vehicle can proactively send that image to the terminal device. The terminal device can then acquire the image of the first vehicle's first license plate.

[0285] In another possible implementation, the first vehicle can send its first license plate image to the terminal device after receiving a second instruction from the terminal device. The terminal device can then acquire the first license plate image. The second instruction instructs the first vehicle to report its license plate image.

[0286] For example, the terminal device can provide a second interface. This second interface is used to assist the vehicle owner (or the driver of the first vehicle or the vehicle user of the first vehicle) in setting up vehicle-related functions. For example, a target application can be installed on the terminal device. The target application can be used to provide at least one vehicle service or vehicle function. When the vehicle owner logs into the target application, the target application can display the second interface. As you can understand, a description of the target application can be found in the introduction above, and will not be repeated here.

[0287] The owner of the first vehicle can edit relevant functions of the first vehicle on the second interface, such as editing the license plate image reporting function. In response to the owner clicking the license plate image reporting function on the second interface, the terminal device can send a second command to the first vehicle.

[0288] The following example illustrates the process of acquiring the first license plate image of the first vehicle.

[0289] In one example, the image of the second license plate of the first vehicle may be acquired via an image acquisition device on the first vehicle.

[0290] Understandably, before the image acquisition device on the first vehicle acquires the license plate image of the first vehicle, it needs to be confirmed that the image acquisition device on the first vehicle is in normal working condition.

[0291] For example, after acquiring an image of the second license plate of the first vehicle, the image acquisition device on the first vehicle can store the image. Then, the first vehicle can retrieve the second license plate image from a cache area or storage area used to store the license plate image. Optionally, after acquiring the second license plate image, the image acquisition device on the first vehicle can also send the image to the processing module of the first vehicle (such as the first device), whereby the processing module will process the image accordingly.

[0292] In another example, the image of the second license plate of the first vehicle could be obtained via a second vehicle or another vehicle.

[0293] For example, consider a scenario where the second license plate image is acquired via a second vehicle. The second license plate image of the first vehicle can be acquired by an image acquisition device on the second vehicle and transmitted to the first vehicle. After acquiring the second license plate image, the first vehicle can process it accordingly. Optionally, the first vehicle can also store the second license plate image after acquiring it. Subsequently, the first vehicle can retrieve the second license plate image from a cache area or storage area used for storing license plate images and process it accordingly.

[0294] Understandably, the specific implementation of obtaining the second license plate image of the first vehicle via the second vehicle can be found in the description of obtaining the second license plate image of the first vehicle via the second vehicle in step 301 above, and will not be repeated here.

[0295] In yet another example, the second license plate image of the first vehicle could be obtained via roadside sensing devices (such as roadside cameras).

[0296] For example, after acquiring an image of the second license plate of a first vehicle, the roadside sensor can directly transmit the image to the first vehicle. Optionally, after acquiring the image of its second license plate, the first vehicle can store the image.

[0297] For example, after the roadside sensor acquires the image of the second license plate of the first vehicle, it can transmit the image of the second license plate of the first vehicle to other vehicles (such as the second vehicle or the third vehicle). The other vehicles (or the on-board equipment on other vehicles) can then use V2V technology to transmit the image of the second license plate of the first vehicle back to the first vehicle.

[0298] For example, after acquiring an image of the second license plate of a first vehicle, the roadside sensor can transmit the image to the roadside equipment, which then transmits it back to the first vehicle. Optionally, the roadside equipment can use V2X technology to directly transmit the second license plate image to the first vehicle, or it can use V2X technology to transmit the image to a fourth vehicle, which then uses V2V technology to transmit the image back to the first vehicle. Understandably, the fourth vehicle and the first vehicle can also be located in the same area, such as traveling on the same road.

[0299] In one possible implementation, after acquiring the second license plate image of the first vehicle, the first vehicle can perform perspective transformation processing on the second license plate image to obtain the first license plate image. It is understood that the relevant description of perspective transformation processing can be found in the introduction to perspective transformation processing in step 301 above, and will not be repeated here.

[0300] Method e2: After acquiring the second license plate image of the first vehicle, the image acquisition device on the first vehicle, the second vehicle, the roadside sensor, or the roadside equipment can process the second license plate image to obtain the first license plate image of the first vehicle. Then, the image acquisition device on the first vehicle, the second vehicle, the roadside sensor, or the roadside equipment can send the first license plate image of the first vehicle to the first vehicle. Finally, after acquiring the first license plate image, the first vehicle can send the first license plate image of the first vehicle to the terminal device.

[0301] In one possible implementation, after obtaining an image of its first license plate, the first vehicle can proactively send that image to the terminal device. The terminal device can then acquire the image of the first vehicle's first license plate.

[0302] In another possible implementation, the first vehicle can send its first license plate image to the terminal device after receiving a second instruction from the terminal device. The terminal device can then acquire the first license plate image. The second instruction instructs the first vehicle to report its license plate image. It is understood that the description of the terminal device sending the second instruction to the first vehicle can be found in the above introduction, and will not be repeated here.

[0303] The following example illustrates the process of acquiring the first license plate image of the first vehicle.

[0304] For example, after acquiring an image of the second license plate of the first vehicle, the image acquisition device on the first vehicle can process the second license plate image, such as performing perspective transformation on it, to obtain an image of the first license plate of the first vehicle. Then, the image acquisition device on the first vehicle can send the image of the first license plate of the first vehicle to the first vehicle.

[0305] For example, after acquiring the second license plate image of the first vehicle, the second vehicle can process the second license plate image, such as performing perspective transformation, to obtain the first license plate image of the first vehicle. Then, the second vehicle can send the first license plate image of the first vehicle to the first vehicle. Understandably, the process of the second vehicle sending the first license plate image of the first vehicle to the first vehicle can refer to the process of the second vehicle transmitting the second license plate image of the first vehicle to the first vehicle described above, and will not be repeated here.

[0306] For example, after acquiring the image of the second license plate of a first vehicle, the roadside sensor can process the image, such as performing perspective transformation, to obtain the image of the first license plate. Then, the roadside sensor can send the image of the first license plate to the first vehicle. Understandably, the process of the roadside sensor sending the image of the first license plate to the first vehicle can be referenced from the process of the roadside sensor transmitting the image of the second license plate to the first vehicle described above, and will not be repeated here.

[0307] For example, after acquiring the image of the second license plate of the first vehicle, the roadside equipment can process the image, such as performing perspective transformation, to obtain the image of the first license plate. Then, the roadside equipment can send the image of the first license plate to the first vehicle. Understandably, the process of the roadside equipment sending the image of the first license plate to the first vehicle can be referenced from the process of the roadside equipment transmitting the image of the second license plate to the first vehicle described above, and will not be repeated here.

[0308] Optionally, when the second license plate image of the first vehicle is acquired by the image acquisition device on the first vehicle, the first vehicle (or the first device in the first vehicle) can also send instruction information to the image acquisition device on the first vehicle according to the vehicle status (or vehicle system status). This implementation allows the image acquisition device on the first vehicle to adopt different monitoring strategies to acquire the license plate image of the first vehicle according to different vehicle statuses, thereby helping to detect license plate anomalies in a timely and accurate manner. The instruction information is used to instruct the image acquisition device on the first vehicle to acquire the license plate image of the first vehicle. Then, the image acquisition device on the first vehicle can acquire the second license plate image of the first vehicle according to the instruction information. Then, the image acquisition device on the first vehicle can send the second license plate image of the first vehicle to the first vehicle (or the first device in the first vehicle), or it can store the second license plate image of the first vehicle. When the image acquisition device on the first vehicle stores the second license plate image of the first vehicle, the first vehicle (or the first device in the first vehicle) can retrieve the second license plate image of the first vehicle from the cache area or storage area used for storing the license plate image. For example, the vehicle status of the first vehicle may include a dormant state, a dormant-wake-up state, or a running state, etc. For example, when the first vehicle is parked in a garage, parking lot, or on the roadside, its vehicle status is dormant. When the vehicle's user (or driver) starts the first vehicle, its vehicle status is awakened from dormancy. When the first vehicle is in motion, its vehicle status is running.

[0309] Optionally, before the first vehicle (or the first device in the first vehicle) sends instruction information to the image acquisition device on the first vehicle, the first vehicle (or the first device in the first vehicle) may also receive a ninth message from the terminal device. This ninth message instructs the first vehicle (or the image acquisition device on the first vehicle) to activate the license plate image acquisition mode (or license plate image acquisition function). For example, the license plate image acquisition mode may include one of the following modes.

[0310] Mode m3: When the first vehicle is in a dormant state or in a running state, the first vehicle (or the image acquisition device on the first vehicle) periodically performs license plate image acquisition.

[0311] Mode m4: When the first vehicle is in a sleep-wake state or in a powered-on state, the first vehicle (or the image acquisition device on the first vehicle) triggers the acquisition of license plate images.

[0312] In one possible implementation, the terminal device can provide a second interface. This second interface is used to assist the vehicle owner (or the driver of the first vehicle or the vehicle user of the first vehicle) in setting up vehicle-related functions. For example, a target application can be installed on the terminal device. The target application can be used to provide at least one vehicle service or vehicle function. When the vehicle owner logs into the target application, the target application can display the second interface. Understandably, a description of the target application can be found in the introduction above, and will not be repeated here.

[0313] The owner of the first vehicle can edit relevant functions of the first vehicle on the second interface, such as editing the license plate image capture function. In response to the owner clicking the license plate image capture function on the second interface, the terminal device can send the ninth information to the first vehicle (or the first device within the first vehicle). Afterwards, the first vehicle (or the first device within the first vehicle) can receive the ninth information from the terminal device. Optionally, when the first vehicle receives the ninth information from the terminal device, the first vehicle can send the ninth information to the first device.

[0314] The following examples illustrate the process of a first vehicle sending instruction information to an image acquisition device on the first vehicle. Alternatively, the first device in the first vehicle may send instruction information to the image acquisition device on the first vehicle. It is understood that the process of the first device in the first vehicle sending instruction information to the image acquisition device on the first vehicle can be referred to the relevant descriptions of methods f1 to f2 below, simply by replacing the executing entity "first vehicle" with "first device," and will not be elaborated further here.

[0315] Example f1: If the first vehicle is in a dormant state or in a running state, the first vehicle can send a first instruction message to the image acquisition device on the first vehicle. The image acquisition device on the first vehicle can then receive the first instruction message. Then, the image acquisition device on the first vehicle can periodically acquire images of the vehicle's license plate (e.g., a second license plate image) according to the first instruction message. The first instruction message can be used to instruct the image acquisition device on the first vehicle to periodically acquire images of the vehicle's license plate. For example, the first instruction message can be used to instruct the image acquisition device on the first vehicle to acquire a license plate image at regular intervals (e.g., intervals of 10s, 20s, or other durations (e.g., 20ms)).

[0316] The example f1 described above periodically acquires license plate images. Compared to existing solutions where video surveillance devices continuously acquire license plate images, this saves power consumption on the first vehicle or the image acquisition device on it. Furthermore, example f1 enables timely and accurate detection of license plate anomalies.

[0317] Example f2: If the first vehicle is in a sleep / wake-up state or a powered-on state, the first vehicle can send a second instruction message to the image acquisition device on the first vehicle. The image acquisition device on the first vehicle can then receive the second instruction message. The image acquisition device on the first vehicle can then, based on the second instruction message, trigger-based (or immediately) acquire an image of the first vehicle's license plate (e.g., a second license plate image). The second instruction message can be used to instruct the image acquisition device on the first vehicle to acquire the first vehicle's license plate image. Optionally, the description "the second instruction message can be used to instruct the image acquisition device on the first vehicle to acquire the first vehicle's license plate image" can be replaced with "the second instruction message can be used to instruct the image acquisition device on the first vehicle to immediately (or trigger-based) acquire the first vehicle's license plate image."

[0318] Example f2 above triggers the image acquisition device on the first vehicle to capture a license plate image immediately upon vehicle startup. This allows for triggered detection of license plate anomalies and avoids discovering them only while the vehicle is in motion. Furthermore, example f2 also enables timely and accurate detection of license plate anomalies.

[0319] Step 502: The terminal device determines the license plate status of the first vehicle based on the first license plate image.

[0320] For example, the license plate status of the first vehicle can be normal or abnormal.

[0321] The following describes the implementation process of the terminal device determining the license plate status of the first vehicle based on the first license plate image through several possible implementation methods.

[0322] Method g1: The terminal device can perform damage recognition on the first license plate image to obtain the license plate damage status or license plate occlusion status of the first vehicle. The license plate damage status can include whether the license plate is damaged or not. The license plate occlusion status can include whether the license plate is obscured or not. If the first vehicle's license plate is neither damaged nor obscured, the terminal device can determine that the license plate status of the first vehicle is normal. If the first vehicle's license plate is damaged or obscured, the terminal device can determine that the license plate status of the first vehicle is abnormal.

[0323] Method g2: The terminal device can perform license plate number recognition on the first license plate image to obtain the first license plate number of the first vehicle. After obtaining the first license plate number, the first device can compare the first license plate number with a second license plate number. If the first license plate number and the second license plate number are the same, the terminal device can determine that the license plate status of the first vehicle is normal. If the first license plate number and the second license plate number are different, the terminal device can determine that the license plate status of the first vehicle is abnormal. The second license plate number is the actual license plate number of the first vehicle.

[0324] For example, the second license plate number of the first vehicle can be entered by the vehicle owner on the interface provided by the vehicle's infotainment system and sent to the terminal device via the vehicle's onboard equipment (such as a communication module or remote communication module); alternatively, the second license plate number can be entered by the vehicle owner on the interface provided by the terminal device; or the second license plate number can be obtained by the first vehicle (or the first device in the first vehicle) through license plate number recognition of the license plate image under normal conditions and sent to the terminal device via the vehicle's communication module. Understandably, "normal conditions" can refer to a state where the license plate is undamaged or intact, or it can refer to a state where the vehicle owner finds no abnormalities in the license plate upon inspection.

[0325] In one example, the owner of the first vehicle can edit or input (e.g., manually enter) the vehicle's actual license plate number in a target application on the terminal device and submit it. In response to the owner's submission of the edited license plate number, the terminal device can obtain the vehicle's actual license plate number. The terminal device can then store the vehicle's actual license plate number.

[0326] In another example, the owner of the first vehicle can edit or input (e.g., manually enter) the vehicle's actual license plate number in a target application on the vehicle's infotainment display and submit it. In response to the owner's submission of the license plate number, the infotainment display can obtain the actual license plate number. Then, the infotainment display can send the license plate number to a terminal device, such as the vehicle's onboard equipment (e.g., a communication module or remote communication module), which in turn sends the license plate number from the vehicle's onboard equipment to the terminal device. The terminal device, after obtaining the license plate number, can then store it.

[0327] In another example, an image acquisition device on a first vehicle can acquire an image of the vehicle's license plate in its normal state. This image can then be sent to a first device within the vehicle. After acquiring the license plate image, the first device can process it (e.g., perform perspective transformation) to obtain a processed license plate image. The first device can then perform license plate number recognition on the processed image, obtaining the vehicle's actual license plate number. After obtaining the actual license plate number, the first device can send it to a terminal device. The terminal device, after acquiring the actual license plate number, can then store it.

[0328] In another example, the image acquisition device on the first vehicle can acquire an image of the vehicle's license plate in its normal state. Then, the image acquisition device on the first vehicle can send this license plate image to a terminal device. For example, the image acquisition device can send the actual license plate number of the first vehicle to the vehicle's onboard equipment (such as a communication module or remote communication module), and the onboard equipment of the second vehicle will then send the actual license plate number of the first vehicle to the terminal device. After acquiring the license plate image, the terminal device can process the image (such as through perspective transformation) to obtain a processed license plate image. Then, the first device can perform license plate number recognition on the processed license plate image, and the obtained license plate number is the actual license plate number of the first vehicle. Finally, the terminal device can store the actual license plate number of the first vehicle.

[0329] Method g3: The terminal device can perform damage recognition on the first license plate image to obtain the damage status of the first vehicle's license plate. The terminal device can also perform license plate number recognition on the first license plate image to obtain the first license plate number of the first vehicle. If the first vehicle's license plate is undamaged and the first license plate number is the same as the second license plate number, the terminal device can determine that the first vehicle's license plate status is normal. If the first vehicle's license plate is damaged, or the first license plate number is different from the second license plate number, or the first vehicle's license plate is damaged and the first license plate number is different from the second license plate number, the terminal device can determine that the first vehicle's license plate status is abnormal.

[0330] Regarding the license plate defacement recognition mentioned in method g1 or method g3 above, in one possible implementation, when the terminal device performs defacement recognition on the first license plate image, it can determine the defacement status of the first vehicle's license plate based on the first license plate image and a first model. The first model can be used to describe the correspondence between the license plate image and the defacement status of the license plate.

[0331] Understandably, the description of the training process for the first model can be found in the introduction above, and will not be repeated here. For example, the computing device used to perform the training process for the first model can be a terminal device, a module within a terminal device, or other devices.

[0332] Regarding the license plate number recognition mentioned in method g2 or method g3 above, in one possible implementation, when the terminal device performs license plate number recognition on the first license plate image, it can determine the first license plate number of the first vehicle based on the first license plate image and a second model. The second model can be used to describe the correspondence between the license plate image and the license plate number.

[0333] Understandably, the description of the training process for the second model can be found in the introduction above, and will not be repeated here. For example, the computing device used to perform the training process for the second model can be a terminal device, a module within a terminal device, or other devices.

[0334] Optionally, if the terminal device determines that the license plate status of the first vehicle is abnormal, the terminal device may display the fifth information on the first interface or play the fifth information aloud. The fifth information can be used to notify the owner of the first vehicle that the license plate of the first vehicle is abnormal.

[0335] In one possible implementation, if the terminal device determines that the license plate status of the first vehicle is abnormal, the terminal device can provide a first interface. This first interface is used to notify the vehicle owner that the license plate is abnormal. Subsequently, the terminal device can display the fifth piece of information on the first interface.

[0336] For example, consider a terminal device or device with a target application installed. After receiving the first information, the target application on the terminal device can display a first interface (such as a pop-up window, prompt, message interface, notification interface, message window, or notification window). Then, the target application on the terminal device can display the fifth information on the first interface. As you can understand, a description of the target application can be found in the introduction above, and will not be repeated here.

[0337] In another possible implementation, the terminal device can play the fifth message via voice.

[0338] For example, if the terminal device determines that the license plate of the first vehicle is in an abnormal state, the terminal device can send a tenth message to the voice device (such as a microphone) within the terminal device. This tenth message can instruct the voice device to play a message indicating that the license plate of the first vehicle is abnormal. After receiving the tenth message, the voice device can generate a fifth message and transmit it externally. It is understood that this fifth message can refer to voice information.

[0339] Optionally, if the license plate of the first vehicle is in an abnormal state, and the abnormal state is determined based on the presence of dirt or debris on the license plate, the terminal device can send a first instruction to the first vehicle. This first instruction can be used to instruct the first vehicle to clean the dirt or debris (such as dirt, dust, or other contaminants) from its license plate. After receiving the first instruction, the first vehicle can then clean the license plate accordingly.

[0340] For example, after receiving the first instruction, the first vehicle can send a third instruction to its cleaning module (such as a license plate cleaning device). This third instruction instructs the cleaning module to clean the license plate of the first vehicle. Upon receiving the third instruction, the cleaning module in the first vehicle can use water or a dirt cleaner to clean the license plate.

[0341] Optionally, if the terminal device determines that the license plate status of the first vehicle is abnormal, the terminal device may send a seventh message to the first vehicle. This seventh message may instruct the first vehicle to report video information related to its license plate. For example, the seventh message may include the acquisition time of the first license plate image. After receiving the seventh message, the first vehicle may send an eighth message to the terminal device. This eighth message may include video information within a second time period. The second time period represents a period before and after the acquisition time of the first license plate image. Optionally, when the license plate status contained in the first license plate image is abnormal, the second time period may also refer to a period before and after the acquisition time of the abnormal first license plate image. Understandably, examples of the second time period can be found in the examples of the first time period described above, and will not be repeated here.

[0342] In one possible implementation, after receiving the eighth message, the terminal device can display a prompt (or notification) on the third interface. This prompt can encourage the vehicle owner to click to play the video information within the second time period. In response to the vehicle owner clicking the play button on the third interface, the terminal device can play the video information within the second time period. Optionally, the terminal device can also play the video information within the second time period on the third interface after receiving the eighth message. By playing the video information within the second time period, the terminal device can help the vehicle owner promptly and effectively determine whether the license plate is truly abnormal, and can help the vehicle owner promptly and effectively determine the specific reason for the license plate abnormality, or can help the vehicle owner more quickly find the cause of the license plate abnormality.

[0343] As can be seen from steps 501 to 502 above, after the terminal device acquires the first license plate image of the first vehicle, it can detect the first license plate image and accurately determine whether the license plate status of the first vehicle is abnormal. This enables the terminal device to identify whether the license plate of the first vehicle is abnormal, which helps the terminal device to detect the abnormality of the license plate of the first vehicle in a timely and effective manner, thereby making it easier for the owner of the first vehicle to know about the abnormality of the license plate of the first vehicle in a timely manner.

[0344] It should be noted that in the description of this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, "at least one of A, B, and C" includes A, B, C, AB, AC, BC, or ABC. Furthermore, unless otherwise specified, the ordinal numbers "first," "second," "third," etc., mentioned in the embodiments of this application are used to distinguish multiple objects and are not used to limit the order, sequence, priority, or importance of multiple objects. In addition, the terms "including," "comprising," "having," and their variations appearing in this application all mean "including but not limited to," unless otherwise specifically emphasized.

[0345] Furthermore, it should be noted that each step in the above embodiments can be executed by the corresponding device, or by components such as chips, processors, or chip systems within that device. This application does not limit the scope of these steps. The above embodiments are only illustrated by examples of execution by the corresponding device.

[0346] It should be noted that in the above embodiments, some steps may be selected for implementation, and the order of the steps in the figures may be adjusted. This application does not limit this. It should be understood that performing some of the steps in the figures, adjusting the order of the steps, or combining them in a specific implementation all fall within the protection scope of this application.

[0347] It is understood that, in order to achieve the functions described in the above embodiments, each device involved in the above embodiments includes a hardware structure and / or software module corresponding to perform each function. Those skilled in the art should readily recognize that, based on the units and method steps of the various examples described in conjunction with the embodiments disclosed in this application, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application scenario and design constraints of the technical solution.

[0348] It should be noted that the "steps" in the embodiments of this application are merely illustrative and are intended to better understand one method of presentation used in the embodiments. They do not constitute a substantial limitation on the execution of the solution of this application. For example, the "step" can also be understood as a "feature". Furthermore, the steps do not constitute any limitation on the execution order of the solution of this application. Any changes to the order of steps, or the merging or splitting of steps made on this basis without affecting the overall solution implementation, resulting in a new technical solution, are also within the scope of disclosure of this application.

[0349] The following are schematic diagrams of possible license plate anomaly detection devices provided in embodiments of this application. These license plate anomaly detection devices can be used to implement the functions of the license plate anomaly detection devices in the above method embodiments, and thus can also achieve the beneficial effects of the above method embodiments. For example, the license plate anomaly detection device can be a first device, a safety device, a vehicle display device, or a terminal device.

[0350] As shown in Figure 6, the license plate anomaly detection device 600 includes a transceiver module 610 (or a communication module, transceiver unit, or communication unit, used for sending and receiving data) and a processing module 620 (or a processing unit). The license plate anomaly detection device 600 can be used to implement the functions of the first device, vehicle display device, terminal device, or security device in the method embodiment shown in Figure 3. The license plate anomaly detection device 600 can also be used to implement the functions of the first device, first vehicle, or terminal device in the method embodiment shown in Figure 5. For example, the transceiver module 610 can perform the receiving and sending actions performed by the license plate anomaly detection device in the above method embodiment. The processing module 620 can perform other actions besides the sending and receiving actions performed by the license plate anomaly detection device in the above method embodiment.

[0351] Optionally, the transceiver module 610 may include a receiving module and / or a transmitting module. The receiving module can be used by the license plate anomaly detection device 600 to receive signals (or information or data, etc.); the transmitting module can be used by the license plate anomaly detection device 600 to transmit signals (or information or data, etc.). The transmitting module can transmit signals (or information or data, etc.) under the control of the processing module 620, and the receiving module can receive signals (or information or data, etc.) under the control of the processing module 620.

[0352] When the license plate anomaly detection device 600 is used to implement the function of the first device in the method embodiment shown in Figure 3: the transceiver module 610 is used to acquire a first license plate image of the first vehicle. The processing module 620 is used to determine the license plate status of the first vehicle based on the first license plate image. The license plate status can be normal or abnormal. The transceiver module 610 is also used to send first information if the license plate status is abnormal. The first information can be used to indicate that the license plate of the first vehicle is abnormal.

[0353] When the license plate anomaly detection device 600 is used to implement the functions of the terminal device or vehicle display device in the method embodiment shown in Figure 3 above: the transceiver module 610 is used to receive first information. The first information can be used to indicate that the license plate of the first vehicle is abnormal. The processing module 620 is used to display fifth information on a first interface, or to play the fifth information aloud. The fifth information can be used to notify the owner of the first vehicle that the license plate of the first vehicle is abnormal. For example, the processing module 620 can be used to control the display module (e.g., a display screen) in the terminal device or vehicle display device to display the first interface and show the fifth information on the first interface. The processing module 620 can also be used to control the voice playback module (e.g., a microphone) in the terminal device or vehicle display device to play the fifth information aloud.

[0354] When the license plate anomaly detection device 600 is used to implement the function of the safety device in the method embodiment shown in Figure 3 above: the transceiver module 610 is used to receive first information. The first information can be used to indicate that the license plate of the first vehicle is abnormal. The transceiver module 610 is also used to send sixth information to the terminal device and / or the vehicle display device according to the first information. The sixth information may include video information within a first time period. The first time period represents a period before and after the acquisition time of the first license plate image of the first vehicle. The processing module 620 is used to perform corresponding processing operations, such as controlling the video acquisition device to acquire video information around the vehicle.

[0355] For a more detailed description of the transceiver module 610 and the processing module 620, please refer to the relevant description in the method embodiment shown in Figure 3 above, which will not be repeated here.

[0356] It should be understood that the transceiver module 610 in the embodiments of this application can be implemented by an interface circuit (or communication interface or transceiver) or interface circuit-related circuit components, and the processing module 620 can be implemented by a processor or processor-related circuit components.

[0357] It should be noted that the module division in the embodiments of this application is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods. Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, exist as separate physical entities, or have two or more units integrated into one unit. The integrated units described above can be implemented in hardware or as software functional units.

[0358] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, or a server, etc.) or processor to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as a USB flash drive, a portable hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0359] Based on the same concept, this application also provides a possible license plate anomaly detection device. This license plate anomaly detection device is used to implement the technical solutions involved in the first device, vehicle display device, terminal device, or security device in the method embodiment shown in FIG3 above, and therefore can also achieve the beneficial effects of the first device, vehicle display device, terminal device, or security device in the method embodiment shown in FIG3 above. This license plate anomaly detection device is used to implement the technical solutions involved in the first device, first vehicle, or terminal device in the method embodiment shown in FIG5 above, and therefore can also achieve the beneficial effects of the first device, first vehicle, or terminal device in the method embodiment shown in FIG5 above.

[0360] Referring to Figure 7, the license plate anomaly detection device 700 shown in Figure 7 includes an interface circuit 710 and a processor 720. The processor 720 and the interface circuit 710 are coupled to each other. It can be understood that the interface circuit 710 can be a transceiver or an input / output interface. The input / output interface is used for inputting and / or outputting information; output can be understood as sending, and input can be understood as receiving. Optionally, the license plate anomaly detection device 700 may also include a memory 730 for storing instructions executed by the processor 720, or storing input data required by the processor 720's execution instructions, or storing data generated after the processor 720 executes the instructions.

[0361] When the license plate anomaly detection device 700 is used to implement the method embodiment shown in Figure 3 or Figure 5, the processor 720 implements the functions of the processing module 620, and the interface circuit 710 implements the functions of the transceiver module 610. The processor 720 can be a central processing unit (CPU), a network processor (NP), or a combination of a CPU and an NP, etc. The processor 720 may further include a hardware chip. The hardware chip can be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof. The PLD can be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof. When implementing the above functions, the processor 720 can be implemented in hardware, or it can be implemented by executing corresponding software.

[0362] Based on the same concept, this application also provides a vehicle, which may include an image acquisition device and a vehicle-mounted infotainment system. Optionally, the vehicle may further include a vehicle-mounted display device. The vehicle-mounted infotainment system may include a first device. Optionally, the vehicle-mounted infotainment system may further include a safety device. The image acquisition device may be used to acquire an image of the vehicle's license plate, or it may be used to acquire an image of the vehicle's surrounding environment. The first device is used to implement the technical solutions related to the first device in the above method embodiments. The safety device is used to implement the technical solutions related to the safety device in the above method embodiments. The vehicle-mounted display device is used to implement the technical solutions related to the vehicle-mounted display device in the above method embodiments.

[0363] Based on the same concept, this application also provides a computer program product, which includes a computer program or instructions that, when run on a computer, cause the computer to perform the methods provided in the above embodiments.

[0364] Based on the same concept, embodiments of this application also provide a computer-readable storage medium storing a computer program or instructions, which, when executed by a computer, causes the computer to perform the methods provided in the above embodiments.

[0365] The storage medium can be any available medium that a computer can access. For example, but not limited to, a computer-readable medium can include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage media or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer.

[0366] Based on the same concept, embodiments of this application also provide a chip, which may include a processor and a memory (or the chip may be coupled to the memory). The chip executes program instructions in the memory to perform the methods provided in the above embodiments. Here, "coupling" refers to two components being directly or indirectly connected to each other; for example, coupling can refer to an electrical connection between two components.

[0367] Based on the same concept, this application also provides a chip system, which includes a processor for supporting a computer device in implementing the functions involved in the first device, terminal device, vehicle display device, safety device, or first vehicle in the above embodiments. In one possible implementation, the chip system further includes a memory for storing necessary programs and data of the computer device. The chip system may be composed of chips or may include chips and other discrete components.

[0368] The methods provided in this application can be implemented entirely or partially through software, hardware, firmware, or any combination thereof. When implemented in software, they can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available media may be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., high-density digital video discs (DVDs)), or semiconductor media (e.g., solid-state drives (SSDs)).

[0369] The steps of the methods described in the embodiments of this application can be directly embedded in hardware, a software unit executed by a processor, or a combination of both. The software unit can be stored in RAM, ROM, EEPROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium in the art. Exemplarily, the storage medium can be connected to the processor so that the processor can read information from the storage medium and write information to the storage medium. Optionally, the storage medium can also be integrated into the processor. The processor and the storage medium can be housed in an ASIC.

[0370] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in one or more blocks of the flowchart illustrations and / or one or more blocks of the block diagrams.

[0371] These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, such that the instructions, which execute on the computer or other programmable apparatus, provide steps for implementing the functions specified in one or more flowcharts and / or one or more block diagrams.

[0372] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the spirit and scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.

Claims

A license plate anomaly detection method, characterized in that, The method includes: (The first device is applied in a first vehicle) Obtain the first license plate image of the first vehicle; Based on the first license plate image, determine the license plate status of the first vehicle, wherein the license plate status is normal or abnormal. If the license plate status is abnormal, a first message is sent, which indicates that the license plate of the first vehicle is abnormal. The method of claim 1, wherein Determining the license plate status of the first vehicle based on the first license plate image includes: The first license plate image is subjected to damage identification to obtain the damage status of the license plate of the first vehicle; If the license plate of the first vehicle is not damaged, then the license plate of the first vehicle is in a normal state; or, If the license plate of the first vehicle is damaged, then the license plate status of the first vehicle is abnormal. The method of claim 1, wherein Determining the license plate status of the first vehicle based on the first license plate image includes: The license plate number is identified from the first license plate image to obtain the first license plate number of the first vehicle; If the first license plate number is the same as the second license plate number, then the license plate status of the first vehicle is normal, and the second license plate number is the actual license plate number of the first vehicle; or, If the first license plate number is different from the second license plate number, then the license plate status of the first vehicle is abnormal. The method of claim 1, wherein Determining the license plate status of the first vehicle based on the first license plate image includes: The first license plate image is subjected to damage identification to obtain the damage status of the license plate of the first vehicle; The license plate number is identified from the first license plate image to obtain the first license plate number of the first vehicle; If the license plate of the first vehicle is not damaged and the first license plate number is the same as the second license plate number, then the license plate status of the first vehicle is normal, and the second license plate number is the actual license plate number of the first vehicle; or, If the license plate of the first vehicle is damaged and / or the first license plate number is different from the second license plate number, then the license plate status of the first vehicle is abnormal. The method of claim 2 or 4, wherein The first license plate image is subjected to damage identification to obtain the damage status of the first vehicle's license plate, including: Based on the first license plate image and the first model, the license plate damage status of the first vehicle is determined. The first model is used to describe the correspondence between the license plate image and the license plate damage status, which includes whether the license plate is damaged or not. The method according to claim 3 or 4, characterized in that Perform license plate number recognition on the first license plate image to obtain the first license plate number of the first vehicle, including: The first license plate number is determined based on the first license plate image and the second model, wherein the second model is used to describe the correspondence between the license plate image and the license plate number. The method according to any one of claims 1 to 6, characterized in that Send the first message, including: If the first vehicle is in a dormant state, then the first information is sent to the terminal device and / or the safety device of the first vehicle; or, If the first vehicle is in a sleep / wake-up state or in operation state, the first information is sent to the terminal device and / or the vehicle display device. The method according to any one of claims 1 to 7, characterized in that The method further includes: If the first vehicle is in a dormant state or in operation, a second message is sent to the image acquisition device on the first vehicle, the second message instructing the image acquisition device to periodically acquire images of the first vehicle's license plate; or, If the first vehicle is in a sleep / wake-up state or is powered on, a third message is sent to the image acquisition device, which instructs the image acquisition device to acquire the license plate image of the first vehicle. The method according to any one of claims 1 to 8, characterized in that The method further includes: The fourth information is received, which is used to instruct the first vehicle to activate the license plate anomaly detection mode. The method of claim 9, wherein The license plate anomaly detection mode includes one of the following: When the first vehicle is in a dormant state or in operation, license plate anomaly detection is performed periodically; or, When the first vehicle is in a sleep / wake-up state or in a powered-on state, the license plate anomaly detection is triggered. The method according to any one of claims 1 to 10, characterized in that Obtain the image of the first license plate of the first vehicle, including: Obtain the image of the second license plate of the first vehicle; The second license plate image is processed to obtain the first license plate image. The method of claim 11, wherein The second license plate image was acquired via an image acquisition device on the first vehicle; or, The second license plate image was acquired via the second vehicle; or, The second license plate image was acquired via roadside sensor equipment. The method according to any one of claims 1 to 12, characterized in that The first information includes at least one of the following: the first license plate image of the first vehicle, the abnormal state of the license plate of the first vehicle, and the acquisition time of the first license plate image of the first vehicle. A license plate abnormality detection method characterized by comprising: Applied to terminal devices or in-vehicle display devices, the method includes: Receive first information, which indicates that the license plate of the first vehicle is abnormal; The fifth information is displayed on the first interface or played by voice. The fifth information is used to notify the owner of the first vehicle that the license plate of the first vehicle is abnormal. The method of claim 14, wherein The method further includes: A second interface is provided, which is used to assist car owners in setting up vehicle-related functions; In response to the owner of the first vehicle clicking the license plate anomaly detection function on the second interface, a fourth message is sent, which is used to instruct the first vehicle to activate the license plate anomaly detection mode. The method of claim 15, wherein The license plate anomaly detection mode includes one of the following: When the first vehicle is in a dormant state or in operation, license plate anomaly detection is performed periodically; or, When the first vehicle is in a sleep / wake-up state or in a powered-on state, the license plate anomaly detection is triggered. The method according to any one of claims 14 to 16, characterized in that The method further includes: Receive the sixth message; The sixth piece of information includes video information within a first time period, which refers to a period of time before and after the acquisition time of the first license plate image of the first vehicle. The method according to any one of claims 14 to 17, characterized in that The first information includes at least one of the following: the first license plate image of the first vehicle, the abnormal state of the license plate of the first vehicle, and the acquisition time of the first license plate image of the first vehicle. A license plate abnormality detection method, characterized by, Applied to safety devices, the method includes: Receive first information, which indicates that the license plate of the first vehicle is abnormal; Based on the first information, send the sixth information to the terminal device and / or the vehicle display device; The sixth piece of information includes video information within a first time period, which refers to a period of time before and after the acquisition time of the first license plate image of the first vehicle. The method of claim 19, wherein The first information includes at least one of the following: the first license plate image of the first vehicle, the abnormal state of the license plate of the first vehicle, and the acquisition time of the first license plate image of the first vehicle. An abnormal license plate detection device is characterized by comprising: It includes modules or units for performing the method as described in any one of claims 1-13, or modules or units for performing the method as described in any one of claims 14-18, or modules or units for performing the method as described in any one of claims 19-20. An abnormality detection device for a license plate, characterized by comprising: Includes processor and interface circuitry; The interface circuit is used to receive signals from other communication devices and transmit them to the processor, or to send signals from the processor to other communication devices. The processor is configured to implement the method as described in any one of claims 1-13, or the method as described in any one of claims 14-18, or the method as described in any one of claims 19-20, through logic circuits or executing code instructions. A car machine system, characterized in that, Includes a first device; wherein the first device is used to perform the method as described in any one of claims 1-13. The car kit system of claim 23, wherein The vehicle infotainment system further includes a safety device; wherein the safety device is used to perform the method as described in any one of claims 19-20. A vehicle characterized by comprising: Includes an image acquisition device and the vehicle infotainment system as described in claim 23 or 24; The image acquisition device is used to acquire the license plate image of the vehicle. The vehicle of claim 25, wherein The vehicle further includes an in-vehicle display device; wherein the in-vehicle display device is used to perform the method as described in any one of claims 14-18. A computer-readable storage medium, characterized by The computer-readable storage medium stores a computer program or instructions that, when executed by a computer, cause the method as described in any one of claims 1-13, or the method as described in any one of claims 14-18, or the method as described in any one of claims 19-20 to be implemented. A computer program product, characterized in that The computer program product includes a computer program or instructions that, when executed on a computer, cause the method of any one of claims 1-13, or the method of any one of claims 14-18, or the method of any one of claims 19-20 to be implemented. A chip characterized by The chip includes a processor coupled to a memory, the processor being configured to execute a computer program or instructions stored in the memory to implement the method as claimed in any one of claims 1-13, or the method as claimed in any one of claims 14-18, or the method as claimed in any one of claims 19-20.

Images