MEASURING AND / OR SENSOR DEVICE WITH A CAMERA
Patent Information
- Application Number
- DE502017016733
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2016-12-23
- Filing Date
- 2017-12-20
- Publication Date
- 2025-03-20
- Estimated Expiration
- 2037-12-20
Description
[0001] The invention relates to a measuring and / or sensor device with a camera. Such measuring and / or sensor devices are used in various industrial sectors, for example, in the food and pharmaceutical industries, etc., to inspect products and their packaging. For example, markings or imprints in the form of barcodes are read and checked, i.e., photographed and analyzed.
[0002] Such cameras are also used for measuring purposes, for example in the logistics industry, when determining the dimensions (length, width, height) of shipping goods.
[0003] Even in today's modern processing and management of large flows of goods, the quality of recognition of product labeling and the accuracy of determining dimensions play a very important role.
[0004] For example, labeling regarding data content and layout formats must be created according to specific design rules. The resulting layouts must be applied to an intermediate carrier or directly to the product or its packaging using high-quality printing, labeling, or marking systems. Precise positioning and alignment of the labeling is necessary.
[0005] At the end of the labeling process, the label must meet a variety of requirements and specifications and be of high quality. This high level of labeling quality must not only be present during the product's production, but must also be maintained throughout the product's subsequent distribution chain, for example, right up to the point of delivery of the product to the final consumer in the supermarket. Otherwise, a label that is unreadable by the electronic cash register in the supermarket would lead to failure for the entire upstream production and logistics chain and could potentially result in the rejection of entire delivery batches.
[0006] To monitor the quality of markings (on products), cameras are used at many stations in the goods flow. The quality of the cameras used is therefore of great importance for the quality of the overall process. Such cameras are usually subjected to certain quality tests during production. However, over the course of their life cycle, the cameras' measurement properties change. This can be due, for example, to changes in the properties (electronic, physical, chemical) of the sensor chip. The lighting modules that interact with the cameras (or are even integrated into them) can also change their properties (regarding brightness and illumination) over time. One reason for this can be the aging of the LEDs used.
[0007] If the required quality or accuracy is no longer present, existing cameras must be replaced with new cameras, which disadvantageously increases the costs of the application (e.g., when processing, managing and / or monitoring large flows of goods).
[0008] The present invention is therefore based on the object of creating a measuring and / or sensor device which enables a reduction of these costs in use.
[0009] DE 41 19 371 A1 discloses a camera in which access to certain setting areas is protected by a password.
[0010] This object is achieved according to the invention by a measuring and / or sensor device having the features of claim 1.
[0011] Since the measuring and / or sensor device according to the invention has a memory unit in which data for controlling the measuring and / or sensor device, in particular the camera, are stored, such a measuring and / or sensor device can not only be calibrated (determining / ascertaining a measurement deviation), but can also be adjusted or readjusted (reducing or eliminating a measurement deviation) by changing the data.
[0012] This advantageously avoids costly replacement with a new measuring and / or sensor device, in particular a new camera that meets the quality requirements.
[0013] The possibility of (readjusting) the measuring and / or sensor device by changing the data stored in the memory unit can significantly extend the service life of the measuring and / or sensor device while maintaining quality requirements.
[0014] In order to protect these data against unauthorized changes, the measuring and / or sensor device according to the invention also has a protective device for the storage unit, which protects the data stored in the storage unit against unauthorized changes and in this way also ensures compliance with the quality requirements.
[0015] According to the invention, the measuring and / or sensor device can also comprise a lighting device, so that the data for controlling the measuring and / or sensor device can be data for controlling the camera and / or lighting device. By (readjusting) the data for controlling the lighting device, not only (physical) changes in the lighting device itself but also, in interaction with the camera, changes in the camera itself can be compensated.
[0016] In addition, a measuring and / or sensor device with a preferably integrated controllable lighting device makes it possible to design the measuring and / or sensor device, in particular the camera, to be more independent of the ambient light.
[0017] The data stored in the storage unit is adjustment data for adjusting the measuring and / or sensor device. Examples of adjustment data include camera adjustment data, such as aperture, focal length, white balance, ISO, exposure time, distance between camera and object, etc., and / or data for adjusting a lighting device, such as brightness, color, intensity, luminous intensity, timing (pulsed operation), etc.
[0018] In one possible embodiment of the invention, the protective device is designed as a mechanical access barrier, for example, in the form of a switch for blocking or enabling a write line of the storage unit. In the operating mode, the switch can additionally be provided with a lock, seal, sealing, etc., to prevent unauthorized operation, so that unauthorized write access to the storage unit is easily and quickly detected by a break in the seal, sealing, or a damaged lock.
[0019] It is also possible to configure the protection device as an electronic access lock. Thus, the write line (or channel) can be interrupted by an electronic switch (or circuit) in operating mode and only released upon a specific request / signal (e.g., via an electronic lock) to enable write access to the data stored in the memory unit in adjustment mode.
[0020] Another option is to implement the protection device as a software-implemented access lock. This way, a program module, for example, in an image processing computer or a programmable logic controller (PLC), can be protected against unauthorized use for write access to the memory unit and / or access to this program module is only possible when the protection device is deactivated, for example, with appropriate authentication.
[0021] Further possible implementations of the aforementioned protective device configurations include software-implemented solutions, such as monitoring and / or logging of data write access, such as log files, audit trails, etc. Such implementations of a protective device can also prevent unauthorized access and / or detect or uncover unauthorized access that has already occurred. In the event of an attempted unauthorized access, it is of course also conceivable to issue an alarm (visual, acoustic, or as a message) and / or temporarily or permanently disable the operating mode.
[0022] Furthermore, it is conceivable to implement the protective device in electronic or software-implemented encryption and / or authentication in a network.
[0023] For example, write access to a storage device located on the network or to the data stored there can be secured by appropriate encryption and authenticated mapping. It is also conceivable to secure read access to a storage device located on the network by appropriate encryption and authenticated mapping.
[0024] In this way, according to the invention, even with a storage unit located decentrally in a network (intranet, internet, cloud, etc.), it is possible to protect the data stored there against unauthorized write access and possibly also against unauthorized read access.
[0025] To implement, in particular, the above-mentioned electronically and software-implemented protective device, the measuring and / or sensor device can have a control device which controls access to the storage unit and is itself designed as a protective device.
[0026] In a further embodiment of the invention, the measuring and / or sensor device has an operating mode in which the protective device is active. In addition to this operating mode, the measuring and / or sensor device can, in an advantageous embodiment, have—as at least one further mode—an adjustment mode or adjustment function in which the protective device is deactivated and adjustment data is generated.
[0027] The measuring and / or sensor device, in particular the camera and / or lighting device, can only be adjusted in adjustment mode. For this purpose, an otherwise locked adjustment function is enabled, for example, using the control device, and the camera and / or lighting device is adjusted. Locking and unlocking the adjustment function can also be accomplished via the protective device for the storage unit or via a separately designed protective device (also implemented in hardware or software).
[0028] Data generated in this adjustment mode, in particular image data, can advantageously be differentiated from data generated in the operating mode, in particular image data. To distinguish them, at least one corresponding bit can be set in the data generated in the operating mode and / or at least one specific piece of (data) information can be missing. For example, the data generated in the operating mode can contain at least one of the information unique to a measuring and / or sensor device, such as serial number, metrological properties subject to inspection, date, adjustment factor, software version, etc., whereas such information is missing in the data generated in the test mode and / or the image or measurement data is not output to the user or the application purpose.
[0029] In this adjustment mode, the hardware and / or software-implemented protection of the protective device(s) is visibly removed. In a hardware-implemented design of the protective device, the protection can be removed, for example, by breaking a corresponding seal, a seal, or a lead seal.
[0030] In the adjustment mode or using the adjustment function, adjustment data for the correct adjustment of the measuring and / or sensor device is determined, for example, using a suitably designed control unit and stored in the memory unit. As explained above, adjustment data can include, for example, data for adjusting the camera, such as aperture, focal length, white balance, ISO, exposure time, distance between camera and object, etc., and / or data for adjusting the lighting device, such as brightness, color, intensity, luminous intensity, timing (pulsed operation), etc.
[0031] When adjusting the measuring and / or sensor device, for example, using a test standard (on the input side) and the corresponding adjustment or modification of the adjustment of the measuring and / or sensor device, in particular the camera, data, in particular image data or measurement data, can be generated on the output side that lie within a desired tolerance. The corresponding adjustment settings are then stored as new adjustment data in the memory unit. When exiting adjustment mode, the protective device is reactivated, thus protecting the adjustment data and / or the adjustment function against unauthorized access.
[0032] In a particularly preferred embodiment of the invention, the camera is designed as a digital camera in order to inspect an object by means of reflected light or by means of X-rays (in the case of transparent objects with light or in the case of non-transparent objects with X-rays).
[0033] In a further embodiment of the invention, the measuring and / or sensor device can be designed as an X-ray measuring and / or sensor device. In this case, the camera can be designed as a sensor, in particular a line sensor, which directly or indirectly (for example, by means of a scintillator) converts the X-ray radiation passing through an object to be examined or inspected. In this way, not only the exterior (contour, surfaces, color design, patterns, printed or adhesive labels) but also the interior of objects (products, packaging, etc.) can be inspected. It is also conceivable to design the measuring and / or sensor device based on terahertz spectroscopy (also called submillimeter wave, far-infrared, or far-IR spectroscopy), in particular the camera as a terahertz camera or terahertz scanner.
[0034] The invention, explained above in various embodiments, advantageously serves not only to monitor the quality of markings (IDs, identifiers, labels, features, etc.) on products or packaging, as well as to monitor and / or measure permissible dimensions and contents of objects, but can also contribute to improved or even complete, automated traceability (track and trace) of objects such as products, packaging, or packaged products. In particular, tampering can be made more difficult or even impossible. Protected data can include, for example, unique data from a measuring and / or sensor device, such as the serial number, data requiring verification, adjustment data, adjustment size, adjustment factor, and software version, individually or in any combination.
[0035] In normal operation (operating mode), these (control) data can be loaded into the camera or the unprotected memory located there in the different variations explained below, for example before each start of the measuring and / or sensor device for further operation, before each mode change, for example from a standby mode to an active (recording) mode, after a predefined time interval or after a predefined number of recordings.
[0036] For safe operation, the camera and control system can be electronically locked against each other to prevent exchange.
[0037] Especially in the case of a camera without its own intelligence, an electronic interlock between the camera and the control system can be advantageous. For this purpose, important operating data or identification data of the camera are stored in the control system and checked by the control system at specific times or reloaded into the camera for security reasons. For example, this identification data can include the camera's type, type designation, serial number, and software version.
[0038] In the adjustment mode, the aforementioned identification data of the camera are stored in the (protected) storage device.
[0039] Further advantageous embodiments of the invention emerge from the subclaims.
[0040] The invention is explained in more detail below using an embodiment shown in the drawing.
[0041] The measuring and / or sensor device 1 according to the invention, schematically illustrated in the figure, consists in a first embodiment (without elements shown in dashed lines in the drawing) of a camera 3 and a control device 7, which are connected unidirectionally (in the direction of the camera 3) or bidirectionally via a communication link 11. Like all other communication links, the communication link 11 can be implemented either hard-wired or wirelessly, in particular via encrypted communication.
[0042] Furthermore, the measuring and / or sensor device 1 comprises a lighting device in the form of a lighting unit 19 for adequately illuminating an object 21 to be inspected. The object 21 is exemplary for a plurality of objects in a flow of goods that is to be inspected at high speed by the measuring and / or sensor device 1. Objects 21 are guided past the camera 3 or its lens 23 (if present) as a flow of goods one after the other at a fixed distance A.
[0043] To inspect an object 21, the camera 3 is controlled via communication connections 11 and the lighting unit 19 (also unidirectional or bidirectional) via communication connections 27 in order to obtain image data of the object.
[0044] The control unit 7 has a memory unit 5b and a protective device in the form of a switch, in particular a mechanical switch 9b, which are preferably formed within a housing protected against unauthorized opening. Protection against unauthorized opening can be achieved, for example, by sealing or sealing the housing.
[0045] Although the switch 9b can be operated from the outside (slider, lever, etc.), it is also protected against unauthorized operation by a seal in this area. The electrical contacts of the switch are preferably located inside the housing of the control device 7, so that they are not accessible from the outside.
[0046] The storage unit 5b stores the data by means of which the camera 3 and preferably additionally the lighting unit 19 were adjusted to maintain predetermined parameters (data for adjusting the camera 3, such as aperture, focal length, white balance, ISO, distance A between camera 3 and object 21 and the exposure time, etc. and / or data for adjusting a lighting device, such as brightness, color, etc.).
[0047] The corresponding data, settings and parameters are therefore protected against unauthorized changes, as the aforementioned seals cannot be broken without causing damage.
[0048] If a deviation from the specified parameters is detected during an interval-like or permanent test (calibration) of the measuring and / or sensor device 1, the measuring and / or sensor device 1 according to the invention can be readjusted or re-adjusted by authorized personnel. For this purpose, the seal of switch 9b is broken, and a readjustment, in particular a re-adjustment, is performed to eliminate a measurement deviation by changing the adjustment until the measuring and / or sensor device 1 again meets the specifications, for example, those that require testing.
[0049] For this purpose, for example, an otherwise locked adjustment function is enabled by means of the control device 1, and the camera 3 and / or the lighting unit 19 are adjusted. The locking and unlocking of the adjustment function or the adjustment mode can also be accomplished via the hardware- or software-implemented protective device for the storage unit, for example via switches 9a, 9b, or via a separately designed protective device (also implemented in hardware or software) not shown.
[0050] To adjust the camera 3 and / or lighting unit 19, image data that should lie within a desired tolerance is generated on the output side using a test standard (on the input side) and corresponding adjustments or changes to the adjustment of the camera 3 and / or lighting unit 19 made via the control device 7. The corresponding adjustment settings are then stored as new adjustment data in the storage unit 5a, 5b, 5c by the appropriately designed control device 7. Upon exiting the adjustment mode, the protective device is reactivated, thus protecting the adjustment data against unauthorized access.
[0051] In addition to the data for adjusting the camera and / or data for adjusting the lighting unit 19 explained above, adjustment data can also include adjustment variables for changing existing variables, in particular an adjustment factor.
[0052] After the adjustment has been successfully carried out and the new adjustment data are stored in the storage unit 5b or are stored there, the switch 9b is resealed so that the new data are again protected against unauthorized access.
[0053] In a second embodiment of the invention, the switch can be configured as switch 9a and the memory unit as memory unit 5a, rather than in the control device 7, in the camera 3 or within its housing. Protection against unauthorized access is also provided here in a manner similar to that explained above with reference to the first embodiment. As in the first embodiment, a separate control device 7 can be provided to control the camera 3 and the lighting unit 19. This control device 7 can, of course, also be partially or completely integrated into the camera 3 or configured within the housing of the camera 3.
[0054] In a third embodiment, the storage unit is embodied as a memory 17 in a network or a cloud. There, the memory 17 is protected by a software-implemented security device against unauthorized modification of the data stored therein. For example, the data is encrypted, whereby the corresponding secret key must be used to modify the data. Alternatively or additionally, authentication may preferably also be required for write access to the memory 17. Of course, in this embodiment, the control device 7 can also be embodied separately or partially or completely integrated into the camera 3. Communication between the memory 17 and the control device 7 then takes place via a preferably bidirectional communication connection 31 or, alternatively, between the memory 17 and the camera 3 via a communication connection 29.
[0055] In the fourth embodiment, an operating terminal 13, for example a personal computer, is provided instead of the control device 7 or in addition to this control device 7. If, in this embodiment, the protected storage unit 5a or 5b is embodied in the camera 3 or in the control device 7 or as a memory 17 in the network or the cloud, the operating terminal 13 serves for convenient operation of the measuring and / or sensor device 1. Communication between the operating terminal 13 and the control device 7 or between the operating terminal 13 and the camera 3 (the dotted line continues through the control device 7) takes place via a communication connection 15, which is protected against manipulation by means of sealing and / or encrypted data access and / or authentication.However, instead of the variants described above, it is also possible to design the storage unit as a storage unit 5c in the operating terminal and to protect it there against unauthorized access in a manner corresponding to that described above for the storage units 5a and 5b.
[0056] Finally, it should be pointed out again that the device according to the invention is not limited to cameras or inspection devices for recognizing optical codes, but can also be used in the same way for other optical recognition tasks or devices. For example, the invention can also be used to test and / or adjust a camera or inspection device for recognizing optical structures when testing the optical properties of components, or a camera or inspection device for testing the completeness of printed circuit board assembly. The invention can also be used for cameras in other applications, such as cameras for automotive applications (cameras for lane assistants, cameras for autonomous driving, traffic sign recognition, etc.), for example, in the context of routine inspections. List of reference symbols
[0057] 1Measuring and / or sensor device 3Camera 5aStorage unit in the camera 5bStorage unit in the control device 5cStorage unit in the operating terminal 7Control device 9aSwitch in the camera 9bSwitch in the control device 11Communication connection between camera and control unit 13Operating terminal 15Communication connection 17Storage in network or cloud 19Lighting unit 21Object 23Lens 25Communication connection between camera and lighting 27Communication connection between control device and lighting 29Communication connection between camera and storage in network or cloud 31Communication connection between control device and storage in network or cloud Distance between object and camera or its lens
Claims
1. Measuring and / or sensor device, comprising a camera (3) and a memory unit (5a, 5b, 5c, 17), as well as data stored in the memory unit (5a, 5b, 5c, 17) for controlling the measuring and / or sensor device (1), characterized in that the measuring and / or sensor device (1) has a protective device (9a, 9b) for the memory unit (5a, 5b, 5c, 17) in the form of a mechanical, electronic or software-implemented access lock which protects the data stored in the memory unit (5a, 5b, 5c, 17) against unauthorized modification, the protective device being designed to detect any unauthorized access, and the control data stored in the memory unit (5a, 5b, 5c, 17) being adjustment data for adjusting the measuring and / or sensor device (1).
2. Measuring and / or sensor device according to claim 1, characterized in that the measuring and / or sensor device (1) has an operating mode in which the protective device is active.
3. Measuring and / or sensor device according to either claim 1 or claim 2, characterized in that the measuring and / or sensor device (1) has an adjustment mode in which the protective device (9a, 9b) is deactivated in order to carry out an adjustment of the measuring and / or sensor device (1) and to store the adjustment data determined thereby in the memory unit (5a, 5b, 5c, 17).
4. Measuring and / or sensor device according to any of the preceding claims, characterized in that the protective device (9a, 9b) is designed as a mechanical, electronic or software-implemented access lock which protects the data stored in the memory unit (5a, 5b, 5c, 17) against write access.
5. Measuring and / or sensor device according to any of the preceding claims, characterized in that the camera (3) is designed as a digital camera.
6. Measuring and / or sensor device according to any of the preceding claims, characterized in that the measuring and / or sensor device (1) is designed as an X-ray measuring and / or sensor device.
7. Measuring and / or sensor device according to any of the preceding claims, characterized in that the measuring and / or sensor device (1) has a control device (7), the control device (7) controlling access to the memory unit (5a, 5b, 5c, 17) and the control device (7) being designed as a protective device (9b).