A multi-modal based banknote authentication device

Abstract

The utility model discloses a kind of paper currency identification forgery instrument based on multi-modal, through modular integrated design, control module is responsible for forwarding main control board instruction, guarantee main control board and light source module, camera acquisition control module and equipment hatch control module data interaction;Support multispectral light source switching, camera brightness focal length intelligent adjustment and 10 times optical amplification, and with digital amplification, infrared filter function;Magnetic image acquisition module is responsible for collecting magnetic image and transmission to main control board;Touch screen connects main control board real-time display identification forgery result, with touch screen control function, can touch screen and carry out light, camera control, album viewing, call software program and carry out paper currency identification forgery, applicable to multi-country paper currency identification forgery inspection, solve the problem that traditional equipment function is single, cannot simultaneously inspect multiple anti-fake features, complex operation.

Description

Technical Field

[0001] This utility model belongs to the field of counterfeit detection technology, and in particular relates to a multimodal banknote counterfeit detection device. Background Technology

[0002] The methods of counterfeiting banknotes in various countries are becoming increasingly sophisticated, seriously disrupting economic development and social stability. Multimodal counterfeit detection technology, as a widely used method, utilizes the counterfeit detection characteristics of different modalities and corresponding algorithms to quickly and accurately collect, identify, and authenticate banknotes, thereby distinguishing between genuine and counterfeit banknotes.

[0003] However, banknote counterfeit detection devices on the market still have many problems. First, most counterfeit detection devices are cumbersome to operate, can only identify a limited number of banknotes, and suffer from low accuracy and high error rates, which is inconvenient in a globalized economic transaction environment. Second, while some counterfeit detection devices have optimized their operation, their functions are limited, such as only having a fixed-focus mode and a limited range of light types, making them suitable for a narrow range of scenarios and unable to cope with the ever-evolving counterfeiting problems.

[0004] In view of this, existing banknote counterfeit detection devices urgently need improvement. A solution that is easy to operate, feature-rich, highly accurate, and capable of detecting a variety of counterfeits is needed to meet the counterfeit detection needs in different scenarios. Utility Model Content

[0005] This utility model provides a multimodal banknote counterfeit detection device. The problems and defects of the existing technology are: the existing banknote counterfeit detection devices have limited functions, limited detection methods, and are complicated to operate.

[0006] To solve the above problems, the technical solution provided by this utility model is as follows:

[0007] This utility model discloses a multimodal banknote counterfeit detector, including a counterfeit detector housing and a main control board, control module, first light source module, second light source module, third light source module, camera acquisition control module, magnetic image acquisition module and equipment door control module integrated in the housing;

[0008] The counterfeit detector housing has a touch screen embedded on the upper front of the housing, a device door on the lower front of the housing with a banknote storage area inside the door, a power button on the lower left side of the housing, a magnetic image acquisition module on the lower right side of the housing, and a USB interface, a DC12V interface and an RJ45 network port on the lower back of the housing.

[0009] The main control board is connected to the control module, the magnetic image acquisition module, the touch screen, the device power button, and the rear interface of the counterfeit detector housing via interfaces for data interaction, program execution, and image storage. The control module is electrically connected to the first light source module, the second light source module, the third light source module, the camera acquisition control module, and the device door control module to forward commands from the main control board. The first, second, and third light source modules contain multiple light sources and excitation sources of different spectra to provide a multi-dimensional lighting environment. The camera acquisition control module contains a zoom camera and a control motor to acquire multi-spectral image and video streams. The magnetic image acquisition module is used to acquire magnetic signal images of banknotes and upload them to the main control board. The device door control module contains a position sensor to detect the door status and trigger an alarm or counterfeit detection process.

[0010] In a preferred embodiment of this utility model, the first light source module, the second light source module, and the third light source module each include one anti-Stokes laser light, six white light lights, six blue light lights, six green light lights, twelve 850nm near-infrared lights, twelve 365nm near-ultraviolet lights, one transmissive white light light, one transmissive infrared light, and one transmissive ultraviolet light. The white light lights, green light lights, blue light lights, ultraviolet light lights, and infrared light lights are distributed around the circumference of the camera of the camera acquisition and control module. The transmissive white light lights, transmissive infrared lights, and transmissive ultraviolet lights are evenly distributed above the banknote placement area. The anti-Stokes laser light is located on the side of the front end of the camera.

[0011] In a preferred embodiment of this utility model, the magnetic image acquisition module includes an ARM Cortex-M7 main controller, a TMR linear array magnetic sensor, a DC motor, an encoder module, and multiple infrared emitting and receiving tubes. The front of the magnetic image acquisition module is provided with a rectangular banknote placement slot, and it communicates bidirectionally with the main control board through an interface.

[0012] In a preferred embodiment of this utility model, when the position sensor of the equipment door control module detects that the door is not properly closed, it triggers an audible and visual alarm; when it detects that the door is closed, it automatically triggers the authentication process of the main control board.

[0013] In a preferred embodiment of this utility model, the USB interface is used for data export, the DC12V interface is used for power supply, and the RJ45 network port is used for network connection, updating the database, or uploading authentication records.

[0014] Based on the above technical solutions and the technical problems solved, the advantages and positive effects of the technical solution to be protected by this utility model are as follows:

[0015] First, this utility model realizes the diversification of the functions of the banknote counterfeit detection device, which can meet the shooting and inspection needs in various situations and has a wide range of applications.

[0016] The counterfeit detection module of this utility model includes: a control module, a first light source module, a second light source module, a third light source module, a magnetic image acquisition module, an equipment door control module, a camera acquisition control module, and a main control board. The first, second, and third light source modules can provide various lighting conditions; the magnetic image acquisition module can acquire high-quality two-dimensional magnetic signal images; the equipment door control module triggers an alarm when the door is not properly closed to prevent external light from interfering with the banknote counterfeit detection results; the camera acquisition control module has automatic focusing and automatic brightness adjustment functions, supports a maximum optical magnification mode of 10x and a maximum digital magnification mode of 80x, and has an infrared filter function for acquiring image and video stream information under different scenarios.

[0017] This invention enables multispectral image capture: the banknote authentication device can capture banknote images under multiple spectra, including infrared, ultraviolet, white light, transmitted white light, transmitted infrared, transmitted ultraviolet, green light, and blue light images, meeting the needs of shooting and authentication in different situations. Furthermore, through the software of the host control module, the acquired multimodal banknote images can be used to accurately authenticate the banknotes under test.

[0018] Secondly, this utility model boasts a high degree of integration and simple operation. It automates and intelligently performs the banknote authentication process via touchscreen clicks, including light switching, image acquisition, and camera mode switching, all without manual intervention. The software program on the main control board automatically switches camera brightness, focus, and spectrum according to the pre-set process, ultimately calculating and identifying the multimodal anti-counterfeiting features of the banknote and displaying the authentication results on the touchscreen. It also enables automatic banknote loading and unloading and automatic magnetic signal image acquisition when banknotes approach the magnetic image module. Furthermore, the sensor in the door control module automatically detects whether the door is closed; if the door is closed, the authentication process is automatically triggered, achieving automatic detection and simplifying the operation process by eliminating the need for manual triggering. Attached Figure Description

[0019] To more clearly illustrate the technical solutions in the embodiments or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the utility model. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0020] Figure 1This is a three-dimensional structural diagram of a multimodal banknote authentication device provided in an embodiment of this application.

[0021] Figure 2 This is a front view of a multimodal banknote authentication device provided in an embodiment of this application.

[0022] Figure 3 The left view of a multimodal banknote authentication device provided in this application embodiment.

[0023] Figure 4 This is a schematic diagram of the internal structure of a multimodal banknote authentication device provided in an embodiment of this application.

[0024] Figure 5 This application provides a schematic diagram of the structure of a main control board.

[0025] Figure 6 This application provides a schematic diagram of the structure of a control module.

[0026] Figure 7 This application provides a schematic diagram of the structure of a magnetic image acquisition module and a main control board.

[0027] Figure 8 This application provides a schematic diagram of the workflow of a multimodal banknote authentication device. Detailed Implementation

[0028] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the scope of protection of this application. The terms "upper," "lower," "front," "rear," "left," and "right," etc., used when describing the installation position or direction of the structure or components in this embodiment are based on the orientation shown in the accompanying drawings. They are merely for convenience of description, used to distinguish the relative positions of various components or directions, and do not represent the orientation of the device or functional component in this embodiment during use.

[0029] like Figures 1-8 As shown, this utility model embodiment provides a multimodal banknote counterfeit detector, including a counterfeit detector housing 10 and a main control board 8, a control module 5, a first light source module 2, a second light source module 3, a third light source module 4, a camera acquisition control module 1, a magnetic image acquisition module 6, and an equipment door control module 7 integrated within the housing.

[0030] The front of the counterfeit detection device housing 10 is fitted with a touch screen 11, which is used to display video frames captured by the camera and magnetic images captured by the magnetic image module, and to control the system by touch.

[0031] The counterfeit detection device housing 10 has a device door on the lower front, inside which is a banknote storage area 9. A power button 12 is embedded on the lower left side of the housing 10, and a magnetic image acquisition module 6 is built into the lower right side. The lower back of the housing 10 has a USB port 15, a DC 12V port 16, and an RJ45 network port 17. The USB port 15 on the back of the housing 10 is used for data export, the DC 12V port 16 is used for power supply, and the RJ45 network port 17 is used for network connection, updating the database, or uploading counterfeit detection records.

[0032] The equipment door control module 7 is located in the center of the front of the housing. It is used to determine the closure status of the door and trigger an alarm when the door is not properly closed. This prevents external light from interfering with the banknote authentication results, achieving automatic triggering of the authentication process when the door is closed, thus realizing automatic detection and eliminating the need for manual triggering, simplifying the operation process. The equipment power button 12 is located on the lower left side of the front of the housing, and a single click turns the equipment on and off. The magnetic image acquisition module 6 is located on the lower right side of the front of the housing, used for acquiring magnetic signal images of banknotes.

[0033] The main control board 8 connects to the control module 5, the magnetic image acquisition module 6, the touch screen display 11, the device power button 12, and the rear interface of the counterfeit detector housing 10 via interfaces for data interaction, program execution, and image storage. The control module 5 is electrically connected to the first light source module 2, the second light source module 3, the third light source module 4, the camera acquisition control module 1, and the device door control module 7, and is used to forward commands from the main control board 8. The first light source module 2, the second light source module 3, and the third light source module 4 contain multiple light sources and excitation sources of different spectra to provide a multi-dimensional lighting environment; the camera acquisition control module 1 contains a zoom camera and a control motor for acquiring multi-spectral image and video streams. The magnetic image acquisition module 6 acquires magnetic signal images of banknotes and uploads them to the main control board 8. The device door control module 7 contains a position sensor for detecting the door status and triggering alarms or counterfeit detection processes.

[0034] The first light source module 2, the second light source module 3, and the third light source module 4 each include one anti-Stokes laser light, six white light lights, six blue light lights, six green light lights, twelve 850nm near-infrared lights, twelve 365nm near-ultraviolet lights, one transmitted white light light, one transmitted infrared light, and one transmitted ultraviolet light. The white light lights, green light lights, blue light lights, ultraviolet light lights, and infrared light lights are distributed around the circumference of the camera in the camera acquisition and control module 1. The transmitted white light lights, transmitted infrared light lights, and transmitted ultraviolet light lights are evenly distributed above the banknote placement area 9. The anti-Stokes laser light is located on the side of the front end of the camera.

[0035] The zoom camera in the camera acquisition control module 1 supports intelligent brightness / focal length adjustment, 10x optical magnification, 80x digital magnification, and infrared filter functions. The control motor adjusts the focal length and zoom ratio of the camera through physical movement.

[0036] The magnetic image acquisition module 6 includes an ARM Cortex-M7 main controller 300, a TMR linear array magnetic sensor 51, a DC motor 53, an encoder module 54, and multiple infrared transmitters / receivers 55. The front of the magnetic image acquisition module 6 has a rectangular banknote placement slot, which communicates bidirectionally with the main control board 8 via an interface. The rectangular banknote placement slot in the middle of the magnetic image acquisition module 6 serves as the magnetic image acquisition entry point for banknotes. Internally, it contains an ARM processor, a TMR magnetic sensor set, a DC motor, an encoder, and multiple infrared transmitters / receivers.

[0037] The magnetic image acquisition module 6 is connected to the main control board 8 via an interface and is used to acquire magnetic images of banknotes; the equipment door control module 7 includes a foldable door and a set of position sensors for detecting the door's open / closed state; the camera acquisition control module 1 includes a zoom camera and a control motor for acquiring image and video stream information in different scenarios; the banknote counterfeit detector of this embodiment is suitable for the authentication and inspection of different versions of banknotes in different countries and regions, and has multiple functions such as taking pictures, storing, recognizing, and authenticating counterfeits. The system contains multiple light sources with multiple spatial positions and different frequencies, which can emit different types of illumination light, support high-resolution acquisition of images and videos under different light sources, and support magnification and inspection of fine details in the captured images; the system contains the magnetic image acquisition module 6, which supports high-resolution two-dimensional magnetic signal image acquisition.

[0038] When the position sensor of the equipment door control module 7 detects that the door is not properly closed, it triggers an audible and visual alarm; when it detects that the door is closed, it automatically triggers the counterfeit detection process of the main control board 8. The main control board 8 uses an embedded x86 processor, runs a customized Windows operating system, and has built-in image processing programs (supporting image rotation, cropping, and JPEG format storage) and banknote counterfeit detection algorithm programs (including a multi-currency standard image database). The counterfeit detection algorithm program can automatically extract the anti-counterfeiting features of multispectral images and magnetic images, compare them with the standard database, and output the counterfeit detection results to the touch screen display (11).

[0039] like Figure 5 As shown, the main control board 8 in this embodiment is equipped with a USB interface 15, a DC power interface 16, an RJ45 network port 17, a control module 5 interface, a power switch 12 interface, and a magnetic image acquisition module 6 interface. The USB interface 15 is used to connect USB devices; the DC power interface 16 is used to connect a power adapter to power the banknote counterfeit detector; the RJ45 network port 17 is used to connect to a network; the control module 5 interface is connected to the control module 5 to establish a connection between the main control board 8 and the control module 5, enabling bidirectional communication between them; the power switch 12 interface is connected to the power switch 12 to establish a connection between the main control board 8 and the power switch 12, thereby enabling the system to control the power on and off; the magnetic image acquisition module 6 interface is connected to the magnetic image acquisition module 6 to establish an electrical connection between the main control board 8 and the magnetic image acquisition module 6, enabling bidirectional communication between the main control board 8 and the control module 5.

[0040] like Figure 6 As shown, the control module 5 in this embodiment is equipped with a main control board 8 interface, interfaces for the first light source module 2, the second light source module 3, and the third light source module 4, an interface for the camera acquisition control module 1, and an interface for the equipment door control module 7. The main control board 8 interface is connected to the main control board 8, enabling bidirectional communication between the main control board 8 and the control module 5. The interfaces for the first light source module 2, the second light source module 3, and the third light source module 4 are connected to the first light source module 2, the second light source module 3, and the third light source module 4, respectively, providing an electrical connection between the control module 5 and these modules, allowing the control module 5 to control the on / off state of various lights. The interface for the camera acquisition control module 1 is connected to the camera acquisition control module 1, enabling the control module 5 to control the camera acquisition control module 1 to take pictures.

[0041] like Figure 7As shown, the magnetic image acquisition module 6 in this embodiment is equipped with an ARM Cortex-M7 main controller 300, a main control board 8 interface, an infrared emitting tube 50 interface, a TMR linear array magnetic sensor 51 interface, a DC power supply 52 interface, a motor 53 interface, an encoder module 54 interface, and an infrared receiving tube 55 interface. The ARM Cortex-M7 main controller 300 is the core of the magnetic image acquisition module 6, responsible for the logic operations and signal processing of image acquisition. The main control board 8 interface connects to the main control board 8, enabling bidirectional communication between the main control board 8 and the control module 5. The infrared emitting diode 50 interface connects to multiple infrared emitting diodes for emitting infrared light. The TMR linear array magnetic sensor 51 interface connects to the TMR linear array magnetic sensor 51, allowing the ARM Cortex-M7 main controller 300 to control the TMR linear array magnetic sensor 51 to acquire the target's magnetic signal. The DC power supply 52 interface connects to the power supply to provide power to the magnetic image acquisition module 6. The motor 53 interface connects to the motor, enabling the ARM Cortex-M7 main controller 300 to control the motor 53. The encoder module 54 interface connects to the encoder module 54, enabling the ARM Cortex-M7 main controller 300 to control the motor 53. The Coretex-M7 main controller 300 can obtain the speed of the code disk module 54; the infrared receiver tube 55 interface is connected to multiple infrared receiver tubes 55 to form a connection between the ARM Coretex-M7 main controller 300 and the infrared receiver tubes 55, so that the ARM Coretex-M7 main controller 300 can obtain the status of the infrared receiver tubes 55.

[0042] It should be noted that the main control board 8 (PCB development board) in this embodiment also has built-in software programs for real-time processing of video streams and images, used for operations such as rotation, cropping, scaling, and saving of the acquired video streams; it also has a built-in banknote recognition and counterfeit detection program, used for extracting, analyzing, calculating, and comparing details of the acquired images. The main control board 1 in this embodiment is equipped with an embedded x86 processor, on which a customized and trimmed Windows operating system is installed, and a software module (image processing software module, the methods used in various operations of this module are all existing technologies and are not within the protection scope of this utility model) runs on the operating system. The three together constitute the embedded device system.

[0043] The present invention provides a multimodal banknote counterfeit detector, the core structure of which includes a detector housing and a main control board, control module, light source module, camera acquisition and control module, magnetic image acquisition module, and device door control module integrated within the housing. The housing also has external supporting operation and interface components. The specific structure and connection relationships are as follows:

[0044] Counterfeit detection device housing 10: As the device carrier, a touch screen display 11 is embedded in the upper front, a device door (including a rectangular door handle, with a banknote placement area 9 inside) is located in the lower front, a device power button 12 is embedded in the lower left side, a magnetic image acquisition module 6 is built in the lower right side, and a USB interface, a DC12V interface, and an RJ45 network port are located in the lower back.

[0045] Main control board 8: Fixed inside the housing cavity, it adopts an embedded x86 processor, runs a customized Windows operating system, and has built-in image processing program (supporting image rotation, cropping, scaling, and storage) and banknote authentication algorithm program; it is connected to the control module 5, magnetic image acquisition module 6, touch screen display 11, device power button 12 and rear interface through interfaces respectively, and is responsible for data interaction, program operation and image storage.

[0046] Control module 5: It communicates bidirectionally with the main control board 8 via wires, and is also electrically connected to the first light source module 2, the second light source module 3, the third light source module 4, the camera acquisition control module 1, and the equipment door control module 7. It is used to forward the main control board's instructions to each execution module and synchronously feed back the module status data.

[0047] The first light source module 2, the second light source module 3, and the third light source module 4 provide a multispectral illumination environment, including one anti-Stokes laser light, six white lights, six blue lights, six green lights, twelve infrared lights (850nm near-infrared), twelve ultraviolet lights (365nm near-ultraviolet), one transmitted white light light, one transmitted infrared light, and one transmitted ultraviolet light. Among them, the white / green / blue / ultraviolet / infrared lights are distributed around the circumference of the remote camera (three white / green / blue lights on each side, and six ultraviolet / infrared lights on each side). The transmitted lights are evenly distributed above the banknote placement area 9. The anti-Stokes laser light is located on the front side of the camera acquisition and control module 1 and is used to excite the laser anti-counterfeiting pattern on the banknote.

[0048] Camera acquisition and control module 1: includes one zoom camera and one control motor; the camera supports intelligent brightness / focal length adjustment, 10x optical magnification, 80x digital magnification and infrared filter function, and the control motor adjusts the camera focal length and zoom ratio through physical movement to acquire banknote image video streams under multispectral conditions.

[0049] Magnetic image acquisition module 6: It has a built-in ARM Cortex-M7 main controller 300, TMR linear array magnetic sensor 51, DC motor 53, code disk module 54, multiple infrared emitters 50 and multiple receiver tubes 55. The front of the housing has a rectangular banknote placement slot (as a magnetic signal acquisition inlet). It is connected to the main control board 8 through an interface and can automatically acquire two-dimensional magnetic signal images of banknotes and upload them to the main control board.

[0050] Equipment hatch control module 7: includes a foldable hatch and a position sensor for detecting the hatch opening and closing status; triggers an alarm when the hatch is not properly closed (to avoid interference from external light); automatically triggers the authentication process after the hatch is closed.

[0051] A core connectivity relationship for a multimodal banknote counterfeit detection device:

[0052] Main control board 8 → Control module 5 → Light source module / camera acquisition control module / equipment door control module, realizing command forwarding; Magnetic image acquisition module 6 → Main control board 8, realizing magnetic image data upload; Camera acquisition control module 1 / first light source module 2, second light source module 3 and third light source module 4 → Main control board 8, realizing image / status data feedback; Touch screen display 11 → Main control board 8, realizing operation command input + counterfeit detection result display.

[0053] A multimodal banknote counterfeit detection device supports both manual and intelligent counterfeit detection modes. The specific operation is as follows:

[0054] 1. Manual counterfeit detection mode (for high-quality / new types of counterfeit currency): Press the power button 12 to turn on the device, the touch screen 11 will display the main interface, click "Manual counterfeit detection"; open the device door, put the banknote to be tested into the banknote placement area 9, and close the door (to create a black box environment to avoid light interference).

[0055] Switch the light source via the virtual buttons on the display screen (e.g., use ultraviolet light to view the fluorescent security line, or use an anti-Stokes laser light to view the laser anti-counterfeiting pattern). The camera will capture and display images in real time. For details such as microtext, click the "zoom in" button (supports 10x optical magnification + 80x digital magnification) to adjust the brightness to a clear level. Place the banknote into the slot of the magnetic image acquisition module (6). The module will automatically feed the banknote and capture the magnetic image. Click "magnetic image display" to view it. Click the "take a picture" button to save the current image (stored in the local memory of the main control board). It can be exported via the USB interface.

[0056] 2. Intelligent Authentication Mode (Fast Batch Authentication): After powering on, click "Intelligent Authentication" on the main interface, open the door, put in the banknote to be tested, and close it (the door sensor will automatically trigger the authentication process after detecting that it is closed); the control module (5) will light up the white light, transmitted white light, infrared light, ultraviolet light, and transmitted infrared light in sequence according to the preset time sequence. For each type of light source that is lit, the camera will automatically adjust the brightness, focal length, and color parameters, collect the corresponding spectral image, and upload it to the main control board; if the magnetic image has been collected in advance, the magnetic image data will be uploaded to the main control board synchronously; the authentication algorithm program will extract the anti-counterfeiting features (such as watermark outline, magnetic ink distribution, and fluorescence intensity) of the multispectral image and magnetic image, compare them with the standard database, and output the authentication result ("genuine" / "counterfeit" + suspicious feature label) within 10 seconds and display it on the screen; click "history" to view nearly 1,000 authentication data, and support uploading to the background system for archiving via RJ45 network port.

[0057] Performance verification: Through testing with 1000 genuine banknotes (including RMB, USD, EUR, and 10 other currencies) and 200 high-quality counterfeit banknotes, the accuracy rate of this invention in detecting counterfeits reached 99.8%, the average detection time was ≤15s, the light source switching response time was ≤0.5s, and the magnetic image acquisition resolution reached 500dpi, meeting the high-efficiency counterfeit detection requirements in cash transaction scenarios.

[0058] The working principle of a multimodal banknote authentication device is as follows:

[0059] Lighting: Multiple built-in lights are used to activate various anti-counterfeiting features on banknotes. Transmitted white light and transmitted infrared light are used to activate visible light transmission and infrared transmission anti-counterfeiting features. Infrared, visible light, and ultraviolet top light are used to activate visible light reflection, infrared reflection, and ultraviolet anti-counterfeiting features. Furthermore, the infrared light source is an 850nm near-infrared (NIR) source, possessing strong penetrating power and low scattering ability, improving infrared image quality. The ultraviolet light source is a 365nm near-ultraviolet (UV-A) source, capable of penetrating plastic coatings on object surfaces and highlighting security features and authentication patterns on the image. Anti-Stokes luminescence refers to the phenomenon where a material, when excited by low-energy light, emits high-energy light; that is, when excited by long-wavelength, low-frequency light, the material emits short-wavelength, high-frequency light. The principles of anti-Stokes luminescence include excited-state absorption (ESA), energy transfer upconversion (ETU), and photon avalanche (PA). This example uses a 980nm infrared laser, which produces an anti-Stokes luminescence phenomenon when it illuminates a specific anti-counterfeiting area of ​​the item being inspected. The power of the light source was intentionally controlled during the design process to avoid harm to humans and the environment.

[0060] Camera: It adopts a zoom camera that supports 15x optical zoom, can automatically adjust exposure and white balance, and can capture infrared and ultraviolet spectral images.

[0061] Magnetic image acquisition module: It adopts a high-resolution TMR linear array magnetic sensor and advanced automatic control algorithm, combined with a mechanical banknote feeding structure, which can stably acquire the magnetic signal anti-counterfeiting features of banknotes and form a high-resolution, high-contrast two-dimensional magnetic signal grayscale image.

[0062] The specific workflow of this utility model during use is as follows: Figure 8 As shown, the process involves multimodal image acquisition → image processing → feature comparison → result display. It includes multimodal image acquisition, image processing, storage, and a user interface. Specifically, a zoom camera is used to acquire the video stream; the video stream is displayed in real-time on the touchscreen; video storage involves capturing a frame from the video stream, encoding it, and storing the encoded data in JPEG format on local storage; the user interface is used for real-time image display, camera control, lighting switching, photo capture, album browsing, intelligent anti-spoofing, etc., allowing users to perform various operations.

[0063] Specifically, the application scenarios of the banknote counterfeit detection device provided in this embodiment can be basically divided into two categories, and the specific operation is as follows:

[0064] The first scenario involves manually authenticating banknotes that are difficult to counterfeit, such as high-quality counterfeits or new types of counterfeit currency. This involves observing, photographing, and storing the banknotes' different modalities and details. In use, the authentication instrument is powered on. Using the software built into the main control board 1, the manual authentication mode is selected. The device door is opened, and the banknote to be tested is placed in the banknote placement area 9 before closing the door. At this point, the entire device forms a black box environment. Clicking the virtual light source button on the touchscreen display 11 activates different light sources to illuminate the object. The options include natural light, infrared light, ultraviolet light, transmitted white light, transmitted infrared light, transmitted ultraviolet light, blue light, and green light. The camera captures a video stream, which is then displayed on the touchscreen. Detailed observation of the object's image under different spectra is possible. When acquiring a magnetic image, the banknote to be tested is placed in the banknote placement slot of the magnetic image acquisition module 6. The acquisition device in this module stores the magnetic image on the main control board 1, which can be displayed by clicking the virtual magnetic image button on the touchscreen display 11.

[0065] Meanwhile, to counterfeit-proof features such as microtext, the camera's exposure mode and magnification can be adjusted via virtual buttons, allowing for optical or digital image magnification by changing the image's brightness. Pressing the virtual photo button on the touchscreen display 11 saves the image to the built-in storage.

[0066] The second scenario involves automatically authenticating banknotes using the built-in software of the main control board 1, a simple operation. To use the device, power on the authentication instrument, access the intelligent authentication mode through the built-in software on the main control board 1, open the device door, place the banknote to be tested into the banknote placement area 9, and close the door. This creates a black box environment. In intelligent authentication mode, closing the door automatically triggers the intelligent authentication process. The light source sequentially illuminates the white light, transmitted light, infrared light, ultraviolet light, and transmitted infrared light. After illuminating each spectral light, the camera automatically adjusts its brightness, focal length, and color parameters to ensure image quality under different spectra and saves the images locally. The authentication program on the built-in software of the main control board 1 automatically calculates features from the acquired multispectral images and compares them with standard images in the built-in database, outputting the results on the touchscreen display 11. If a magnetic image is acquired before the intelligent authentication process is triggered by closing the door, the magnetic image will also participate in the intelligent authentication process.

[0067] This invention integrates all external hardware connected to the main control board 1 into the casing 10 of the counterfeit detection device, achieving a high degree of integration and versatility in the banknote counterfeit detection device. Furthermore, this invention features multiple light sources of different wavelengths to meet various shooting needs, offering wide applicability and allowing for multi-angle light source adjustment based on specific circumstances. The invention acquires high-quality two-dimensional magnetic signal images through the magnetic image acquisition module 6. The camera acquisition control module 1 features automatic focusing and automatic brightness adjustment, supports up to 10x optical magnification and up to 80x digital magnification, and includes an infrared filter for acquiring image and video stream information in different scenarios. The control motor in this module controls the camera's focal length and zoom ratio through physical movement. Simultaneously, the built-in program on the main control board 1, along with corresponding sensors and a touchscreen display 11, enables one-click intelligent counterfeit detection. The sensor in the device door control module 7 determines the door's closure status, triggering an alarm if the door is not properly closed to prevent external light from interfering with the banknote counterfeit detection results. Furthermore, it achieves automatic triggering of the counterfeit detection process when the door closes, realizing automatic detection functionality, greatly reducing the operational difficulty of the banknote counterfeit detector and simplifying the operation process; this utility model can display real-time images of the banknote to be tested through the main control board 1 and the touch screen display 11. This utility model has strong scalability, high integration, compact structure, rich functions, and is suitable for various complex environments.

[0068] To demonstrate the inventiveness and technical value of the present invention, this section provides specific product or related technology application examples of the claimed technical solutions.

[0069] In key cash transaction locations such as bank counters, supermarket checkouts, and subway ticket offices, as well as in some hotels and shopping malls that handle foreign currency exchange, cashiers, tellers, and related staff bear the important responsibility of verifying the authenticity of banknotes. They need to inspect various banknotes from different countries, denominations, and versions. To complete this task efficiently and accurately, they have adopted a banknote authentication device based on this utility model patent. This device helps to quickly identify the authenticity and anti-counterfeiting features of circulating banknotes in daily transactions, thus maintaining financial transaction security and market order.

[0070] During inspection, staff can choose different light sources and detection modes to suit the anti-counterfeiting features of different banknotes. For example, in manual authentication mode, to inspect a new version of RMB, an ultraviolet light source can be selected to clearly display the fluorescent ink and security thread features; the magnetic detection head of the magnetic image acquisition module (6) can be selected to verify the authenticity of the magnetic ink area. To quickly screen the anti-counterfeiting points of a US dollar, a white light penetration mode can be selected to better observe the watermark and holographic security thread. To finely examine specific microtext or complex patterns on the banknote, a high-magnification lens can be switched to multi-angle white light / infrared light for clearer observation of details. Of course, the intelligent authentication mode of this device can also be used for fast and comprehensive banknote authentication.

[0071] Using an LCD touchscreen, staff can view detection results in real time, zoom in on specific areas of the image, and perform feature comparisons for a more intuitive and accurate determination of authenticity. Using a USB interface or data connection, staff can transmit images or detection records of suspicious banknotes to the back-end system for archiving or further analysis.

[0072] This banknote counterfeit detection device can also be used in a variety of complex scenarios, such as bank counters, busy cash registers, and mobile ticket booths. Due to its integrated design, rapid response, and ease of operation, it can be easily deployed on various work surfaces, enabling staff to conveniently and reliably complete banknote counterfeit detection even when dealing with high-frequency, fast-paced cash transactions.

[0073] The above is an application embodiment of the banknote counterfeit detection device based on this utility model patent, which proves the inventiveness and technical value of the patented technical solution.

[0074] To verify the effectiveness of this embodiment of the invention, the following experiment was conducted. The same banknote was photographed using the banknote authentication device described in this embodiment, employing infrared light, ultraviolet light, white light, and transmitted light respectively, and the image effects under different spectra were compared.

[0075] For magnified image capture, this utility model uses a zoom camera in this embodiment to magnify and capture details in the banknote image, and compares it with that of a regular camera. The middle image shows the entire document image taken with a regular camera, while the four images on either side show the results of magnifying and examining multiple parts of the document using the zoom camera.

[0076] In summary, although the present invention has been disclosed above with reference to preferred embodiments, the above preferred embodiments are not intended to limit the present invention. Those skilled in the art can make various modifications and refinements without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention shall be determined by the scope defined in the claims.

Claims

1. A multimodal banknote counterfeit detection device, characterized in that, The device includes a housing for a counterfeit detection instrument and a main control board, a control module, a first light source module, a second light source module, a third light source module, a camera acquisition and control module, a magnetic image acquisition module, and an equipment door control module integrated within the housing. The counterfeit detector housing has a touch screen embedded on the upper front of the housing, a device door on the lower front of the housing with a banknote storage area inside the door, a power button on the lower left side of the housing, a magnetic image acquisition module on the lower right side of the housing, and a USB interface, a DC12V interface and an RJ45 network port on the lower back of the housing. The main control board is connected to the control module, the magnetic image acquisition module, the touch screen, the device power button, and the rear interface of the counterfeit detector housing via interfaces for data interaction, program execution, and image storage. The control module is electrically connected to the first light source module, the second light source module, the third light source module, the camera acquisition control module, and the device door control module to forward commands from the main control board. The first, second, and third light source modules contain multiple light sources and excitation sources of different spectra to provide a multi-dimensional lighting environment. The camera acquisition control module contains a zoom camera and a control motor to acquire multi-spectral image and video streams. The magnetic image acquisition module is used to acquire magnetic signal images of banknotes and upload them to the main control board. The device door control module contains a position sensor to detect the door status and trigger an alarm or counterfeit detection process.

2. The multimodal banknote authentication device according to claim 1, characterized in that, The first light source module, the second light source module, and the third light source module each include one anti-Stokes laser light, six white light lights, six blue light lights, six green light lights, twelve 850nm near-infrared light lights, twelve 365nm near-ultraviolet light lights, one transmitted white light light, one transmitted infrared light, and one transmitted ultraviolet light. The white light lights, green light lights, blue light lights, ultraviolet light lights, and infrared light lights are distributed around the circumference of the camera in the camera acquisition and control module. The transmitted white light light, transmitted infrared light, and transmitted ultraviolet light are evenly distributed above the banknote placement area. The anti-Stokes laser light is located on the side of the front end of the camera.

3. The multimodal banknote authentication device according to claim 1, characterized in that, The magnetic image acquisition module includes an ARM Cortex-M7 main controller, a TMR linear array magnetic sensor, a DC motor, an encoder module, and multiple infrared transmitters and receivers. The front of the magnetic image acquisition module has a rectangular banknote placement slot, and it communicates bidirectionally with the main control board through an interface.

4. The multimodal banknote authentication device according to claim 1, characterized in that, When the position sensor of the equipment door control module detects that the door is not closed properly, it triggers an audible and visual alarm; when it detects that the door is closed, it automatically triggers the authentication process of the main control board.

5. The multimodal banknote authentication device according to claim 1, characterized in that, The USB interface is used for data export, the DC12V interface is used for power supply, and the RJ45 network port is used for network connection, updating the database, or uploading authentication records.

Images