SYSTEM AND METHOD FOR OPERATING A SYSTEM, ELEVATING A FIRST COMMUNICATION UNIT AND A SECOND COMMUNICATION UNIT
Patent Information
- Application Number
- DE502019012522
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2018-09-04
- Filing Date
- 2019-08-23
- Publication Date
- 2024-12-05
- Estimated Expiration
- 2039-08-23
AI Technical Summary
Existing data transmission methods lack reliability in recognizing data streams, particularly in systems using smartphones as communication units, due to errors in image evaluation caused by focused light sources and limited coverage of light-sensitive surfaces.
A system with a controllable light source emitting modulated light, where the image is projected out of focus onto a camera's light-sensitive surface, scanned line by line, and a lenticular film is used to align the image transversely, allowing for a large, blurred representation that reduces error rates in data stream recognition.
This method enables reliable data stream recognition with reduced error rates by ensuring the spatial brightness curve is accurately determined across the line direction, allowing for efficient data transmission using existing smartphones and cameras.
Description
[0001] The invention relates to a system and a method for operating a system comprising a first communication unit and a second communication unit.
[0002] It is generally known that a smartphone functions as a communication device, establishing a mobile network connection. It is also known that smartphones can run application programs, especially apps, and take pictures with their camera.
[0003] From DE 10 2015 015 898 B4 a method for data transmission is known in which a camera is used as a receiver.
[0004] From the WO 2016 / 001339 A1 The most obvious state of the art is known to be communication via barcode.
[0005] From the EP 2 811 668 A1 A method for receiving visible light is known.
[0006] From the DE 10 2016 102119 A1 A lighting device is known.
[0007] From the US 2014 / 0 286 644 A1 , in particular from the figure there, an information method and an associated system are known.
[0008] From the WO 2016 1187 328 A1 Power beam transmission is known.
[0009] From the WO 2012 1127 439 A1 A light detection method is known.
[0010] From the WO 20161128 967 A1 A method for transmitting optically encoded information is known.
[0011] From the US 2009 / 0 052 902 A1 A communication system is known.
[0012] The invention is therefore based on the objective of further developing a system with communication units, whereby a data stream should be reliably identifiable.
[0013] According to the invention, the problem is solved in the system according to claim 1 and in the method according to claims 1 and 2. 12 solved by the specified characteristics. Key features of the invention in the system are that the system comprises a first communication unit, in particular a transmitter, and a second communication unit, in particular a receiver, wherein the first communication unit has a controllable light source which emits modulated light according to a predetermined data stream, wherein the second communication unit has a camera which has an optical element and an image sensor, wherein a light-sensitive area of the image sensor has several rows of light-sensitive elements, wherein the image sensor is designed such that the image of the light source projected by the optical element onto the light-sensitive area of the image sensor is blurred and / or covers more than half of the light-sensitive area and is scanned line by line, in particular such that the image has stripes of different brightness and / or such thatthat the brightness gradient caused perpendicular to the line direction spatially indicates the temporal progression of the data stream, in particular wherein each stripe covers partial areas of lines, wherein the second communication unit has a lenticular film which is arranged between the optical element and the first communication unit, wherein the preferred direction of the lenticular film is oriented perpendicular to a connecting line between the light source and the optical element, wherein the second communication unit has a portable communication device, in particular a smartphone, tablet, smartwatch or laptop having a camera, and a recording unit which has a first and a second part, wherein the first part is arranged to be movable relative to the second part, in particular rotatable,is arranged in a swiveling and / or sliding manner, wherein the portable communication device is housed in the first part and the lenticular film is housed in the second part.
[0014] An advantage of this method is the further development of a data transmission technique that uses a camera as the receiver. Another advantage is the ability to reliably detect the transmitted data stream. For this purpose, the light source is projected with such a blurred image that the image is not a point, but covers a large portion of the sensitive area. As a result of the serial scanning of the sensitive elements arranged in the respective rows of the sensitive area, the projected image of the light source is striped. Due to the large-area blurred representation of the light source, the striped areas of the sensitive surface are also large, resulting in a reduced error rate during image evaluation. The spatial brightness distribution perpendicular to the line direction can therefore be determined with minimal error.
[0015] In an advantageous embodiment, the optical element is a converging lens, wherein the image distance, in particular the distance between the light-emitting optical element, and the object distance, in particular the distance between the optical element and the light-sensitive area, are related to the focal length of the converging lens such that the image of the light source is blurred, in particular blurred to such an extent that the image covers more than 20 percent, in particular more than 50 percent, of the area of the light-sensitive area perpendicular to the line direction. An advantage of this is that an existing smartphone can be used if the camera is set and operated in such a way that the camera's converging lens produces a blurred image. The spatial brightness distribution perpendicular to the line direction can thus be determined with minimal error.
[0016] In an advantageous embodiment, the optical element is a diverging lens, wherein the image distance, in particular the distance between the light source and the optical element, and the object distance, in particular the distance between the optical element and the light-sensitive area, are related to the focal length of the converging lens such that the image of the light source is blurred, in particular so blurred that the image covers more than 20 percent, in particular more than 50 percent, of the area of the light-sensitive area perpendicular to the line direction. It is advantageous that a diverging lens can be used instead of a converging lens, or that a diverging lens with a greater refractive power than the converging lens can be positioned very close to it, so that the lenses together form a diverging lens. Thus, the light source is imaged blurred, and the resulting striped image can be evaluated.The spatial brightness gradient perpendicular to the line direction can be determined with minimal error.
[0017] According to the invention The second communication unit features a lenticular film positioned between the optical element and the first communication unit, with the preferred direction of the lenticular film oriented perpendicular to a connecting line between the light source and the optical element. An advantage of this is that the image is projected stretched in the preferred direction. This results in a blurred image of the light source, allowing the captured striped image to be evaluated. The spatial brightness distribution perpendicular to the line direction can be determined with minimal error in the signal electronics.
[0018] In an advantageous embodiment, the image sensor is designed such that the light-sensitive area of the image sensor is scanned line by line, and in particular, this scanning of the light-sensitive area is repeated at a time-recurring frame rate. It is advantageous that the image is scanned serially, and thus bright and dark areas alternate perpendicular to the line direction according to the temporal progression.
[0019] In an advantageous embodiment, the system is dimensioned such that the image of the light source is blurred, in particular blurred to such an extent that the image of the light source covers more than 20 percent, and in particular more than 50 percent, of the area of the light-sensitive surface perpendicular to the line direction, and / or that the image covers more than 50 percent of the light-sensitive surface. It is advantageous that each stripe covers such a large proportion of the light-sensitive surface that a low-error determination of the brightness gradient of the stripes perpendicular to the line direction is possible. This is because an evaluation based on a first surface allows for the determination of a larger amount of data per image than an evaluation based on a second surface, if the second surface is smaller than the first.
[0020] According to the inventionThe second communication unit comprises a portable communication device, in particular a smartphone, tablet, smartwatch or laptop with a camera, and a recording unit comprising a first and a second part. wherein the first part is arranged to be movable relative to the second part, in particular rotatable, pivotable and / or slidable, wherein the portable communication device is housed in the first part and the lenticular film is housed in the second part, in particular wherein the housing unit is a smartphone case or smartphone pouch. It is advantageous that the housing unit can be designed as a case which has two covers, i.e., the first part and the second part, that can pivot relative to each other. Thus, in a first pivot position, the lenticular film covers the lens of the camera of the portable communication device, in particular a smartphone or tablet, and in another pivot position, the lenticular film does not cover the lens of the camera of the portable communication device, in particular a smartphone or tablet.
[0021] In an advantageous embodiment, the temporal progression of the data stream with which the light source is controlled is displayed as a spatial brightness progression in the column direction and / or in the transverse direction to the row direction of the image sensor of the image detected by the camera. In particular, the column-directed progression of the brightness averaged over the respective row of a single sampled image represents only a time segment of the temporal progression of the data stream transmitted by the light source, and in particular, the duration of the time segment is the reciprocal of the frame rate. An advantage of this is that, with suitable matching of the data word rate to the frame rate, one data word can be transmitted per image, thus achieving higher data transmission efficiency.
[0022] Furthermore, suitable software allows the image, and thus the brightness profile, to be displayed continuously, enabling prolonged observation or evaluation by an observer. In particular, the spatial profile of a single image captured by the camera represents only a segment of the overall temporal progression, specifically within the area of the projected image of the light source. Therefore, the spatial profile can be easily identified and unambiguously assigned through image processing.
[0023] In an advantageous embodiment, the data stream is periodic, meaning it has a period, and the frame rate during sampling, or an integer multiple of the frame rate during sampling, is the reciprocal of the period. An advantage of this is that a static image can be displayed on the display of the second communication unit if suitable software is used. This is because the same image can then be displayed continuously at the specified frame rate.
[0024] In an advantageous embodiment, the second communication unit also has a controllable light source, in particular an LED, and the first communication unit has another light-sensitive element. In particular, the system is designed to enable bidirectional data transmission between the two communication units. A key advantage is that data can also be transferred from the second to the first communication unit. This allows for bidirectional data transmission between the first and second communication units. The first communication unit does not need to be a smartphone with a camera; it is sufficient to connect the signal electronics of the first communication unit to a light-sensitive element.
[0025] A photodiode or phototransistor is preferably used as the light-sensitive element.
[0026] In an advantageous embodiment, the second communication unit is designed as a smartphone and / or functions as a mobile communication device, in particular comprising signal electronics and a display means, especially a touch-sensitive screen. It is advantageous that the first communication unit can be implemented as an electrical device, in particular an inverter for supplying an electric motor, or as a self-propelled intralogistics transport vehicle, in particular an automated guided vehicle or an autonomously guided vehicle. Thus, the data stream transmitted by the first communication unit can be evaluated, displayed, and / or visualized using a smartphone, especially for diagnostic or analytical purposes.In particular, only one lenticular film needs to be held in front of the camera lens to produce a large image of the light source stretched in the preferred direction, thus achieving an error-free evaluation.
[0027] Important features of the procedure for operating the aforementioned system are that In the recorded image, the difference between a threshold value and the sum of the brightness values of the light-sensitive elements, in particular pixels, is determined for each line, and thus the sequence of differences indicates a time period of the temporal course of the data stream, in particular as a spatial brightness profile perpendicular to the line direction, in particular where the threshold value is the mean value of the brightness values.
[0028] The advantage here is that the received data stream can be easily determined, i.e., extracted from the recorded image.
[0029] Further advantages arise from the sub-claims.
[0030] The invention will now be explained in more detail with reference to schematic illustrations: In the Figure 1 A first embodiment of the invention is shown schematically. Figure 2 A second embodiment of the invention is shown schematically. Figure 3 A third embodiment of the invention is shown schematically. Figure 4 A portable communication device is shown in a receiving unit, in particular a case, wherein the receiving unit is opened and shown in an oblique view. Figure 5 A second part of the recording unit is folded back. In the Figure 6 A corresponding cropped oblique view is shown.
[0031] As shown in the figures, a receiver, in particular a portable communication device, especially a smartphone, has a camera with which light emitted by a controllable light source 3, in particular an LED, of a transmitter can be detected.
[0032] The transmitter and receiver together form a system according to the invention. The transmitter is either stationary within a system such as a production plant and / or logistics plant, or designed as a mobile unit that moves automatically within such a plant, particularly for the execution of an intralogistics task.
[0033] The controllable light source 3 is controlled by a signal electronics unit 2 with a data stream TX, as illustrated in the figures. Thus, the light is modulated according to the shape of the data stream TX, in particular, it is controlled by a clock signal.
[0034] Simply put, the light source is repeatedly switched on for a first period of time and then switched off for a subsequent second period of time, so that the data bits of the data stream are transmitted one after the other.
[0035] A lenticular film 7 is positioned in front of the camera lens 8 at the receiver. The focal length and distances between the light source 3, the lens 8, and the image sensor 9 of the camera are such that a sharp image of the light source could be captured by the camera without the lenticular film 7.
[0036] However, the lenticular film 7 prevents the recording of a sharp image of the light source 3. Rather, the lenticular film 7 is positioned so close to the lens 8 that the image 10 of the light source 3 is elongated parallel to the preferred direction of the lenticular film 7.
[0037] As a result of the image sensor scanning image 10 line by line, specifically using a rolling shutter, image 10 appears striped. This is because the lines scanned in the first time interval are bright, while the other lines are dark. The spatial width of the stripes is essentially proportional to the respective time intervals.
[0038] The spatial progression RX, which is evaluated by the signal electronics 6 connected to the image sensor 5, is shown to the side of image 10.
[0039] The line frequency of the camera is greater, in particular an integer multiple, than the reciprocal of the shortest time segment of the data stream RX.
[0040] If the line frequency is an integer multiple of the reciprocal of the shortest time segment of the data stream RX and / or the data stream is periodic synchronously with the frame rate, a stationary image 10 is created, i.e., a striped image that does not change over time.
[0041] A film can also be made if, after the display of one image, the next image is transmitted in a corresponding manner.
[0042] The lenticular film 7 has a preferred orientation and consists of a plastic film that is essentially flat. The normal direction of the plastic film is aligned parallel to the camera's viewing direction, i.e., parallel to the axis of symmetry of the camera's lens 8 and / or to a connecting line running from the light source 3 to the camera.
[0043] The lenticular film 7 has protrusions whose height, and thus also the wall thickness of the lenticular film 7, is constant parallel to the preferred direction and varies periodically perpendicular to the preferred direction. Transverse to the preferred direction, the wall thickness preferably follows a semicircular pattern or corresponds to the magnitude of a sine function. Thus, each protrusion exhibits the material thickness profile of the cross-section of a converging lens transversely to the preferred direction, but a constant material thickness parallel to the preferred direction.
[0044] The lenticular film 7 therefore has a constant wall thickness parallel to the preferred direction, the value of which varies periodically perpendicular to the preferred direction, in particular where the rise of each elevation is mirror-symmetric to the respective descent.
[0045] As in the Figures 4 to 6As shown, the portable communication device 40 is received in a first part 41 of a receiving unit, in particular a case. A second part 42, in particular a cover flap, which is pivotable relative to the first part 41, is pivotally mounted relative to the first part 41. In a first pivot position, i.e., in the closed state, the portable communication device can be arranged protected between the first and second parts (41, 42). In a second pivot position, in particular in the folded-back state, the first part 41 is arranged between the second part 42 and the portable communication device 40.
[0046] Furthermore, a lenticular film 7 is received in a recess of the second part 42, the recess being positioned such that the lenticular film 7 is spaced apart in front of the lens 8 of the portable communication device in the second pivot position. In particular, the beam path thus passes through the lenticular film 7 when images are taken and generates the striped images according to the invention for determining the transmitted data stream.
[0047] The area covered by the lenticular film 7 of distances measured to the swivel bearing includes the area covered by the lens 8 of the camera of distances measured to the swivel bearing.
[0048] The receiving unit is preferably made of leather, plastic, imitation leather or leatherette.
[0049] Unlike the Figure 1 Instead of lens 8 of the camera Figure 1A diverging lens 21 is used, and the lenticular film 7 is not used. Thus, the light rays emitted by the light source 3 fill a large proportion of the image 20 captured by the camera, and the determination of the fringes and their width is possible with a reduced error rate. In this way, low-error data transmission is achievable.
[0050] In contrast to the execution according to Figure 2Instead of the diverging lens 21, a converging lens 31 is used, but it has such a position, i.e., object distance, that the light source is not sharply focused, but rather blurred. Preferably, the object distance is chosen such that the light rays emitted by the light source fill a large proportion of the image 20 captured by the camera. The determination of the fringes and their width is then also possible with a reduced error rate. In this way, low-error data transmission is achievable.
[0051] In further embodiments of the invention, the portable communication device also has a controllable light source, in particular an LED. To establish bidirectional communication, this light source of the communication device is controlled by the signal electronics 6 of the portable communication device. The transmitter additionally has a sensor which detects the light emitted by the light source of the portable communication device, so that the received data stream can be evaluated and taken into account in the signal electronics 2.
[0052] In further embodiments according to the invention, the receiver is not a portable communication device but a mobile unit which moves automatically within the system, in particular for the execution of an intralogistics order.
[0053] In further embodiments of the invention, instead of repeatedly switching the light source on and off, the light source switches back and forth between two different intensity values. In further developments, discrete intensity modulations can also be used. More advanced modulation methods, such as frequency modulation, pulse modulation, or the like, are also possible. Reference symbol list
[0054] TX: temporal progression of the transmitted data stream; RX: spatial representation of the temporal progression of the received data stream. 1 Sensitive area of the camera 8, in particular of the portable communication device, in particular of the smartphone 2 Signal electronics 3 Controllable light source, in particular LED 4 Emitted light 5 Camera 6 Signal electronics with display means 7 Lenticular film 8 Lens 9 Image sensor 10 Image 20 Image 21 Diverging lens 30 Image 31 Converging lens 40 Portable communication device 41 First part of the recording unit 42 Second part of the recording unit T Time X Column position
Claims
1. System comprising a first communication unit, in particular a transmitter, and a second communication unit, in particular a receiver, wherein the first communication unit comprises a controllable lamp (3) which emits light (4) that has been modulated in accordance with a predetermined data stream, wherein the second communication unit comprises a camera (5), which comprises an optical element and an image sensor (9), wherein a light-sensitive area of the image sensor (9) comprises a plurality of rows of light-sensitive elements, wherein the image sensor (9) is configured such that the image of the lamp (3), projected by the optical element onto the light-sensitive area of the image sensor (9), is imaged in a blurred manner and / or covers more than half of the light-sensitive area and is scanned row by row, in particular such that the image comprises stripes of different brightness and / or such that the brightness characteristic produced transversely to the direction of the rows spatially displays the time characteristic of the data stream, in particular wherein each stripe covers portions of rows in each case, characterised in that the second communication unit comprises a lenticular film (7) which is arranged between the optical element and the first communication unit, wherein the preferential direction of the lenticular film (7) is oriented transversely to a connecting line between the lamp (3) and the optical element, wherein the second communication unit comprises a portable communication device (40), in particular a smartphone, tablet, smartwatch or laptop comprising a camera (5), as well as a support unit which comprises a first and a second part (41, 42), wherein the first part (41) is arranged so as to be movable relative to the second part (42), in particular is arranged so as to be rotatable, pivotable and / or displaceable, wherein the portable communication device (40) is supported in the first part (41) and the lenticular film (7) is supported in the second part (42).
2. System according to claim 1, characterised in that the optical element is a convergent lens (31), wherein the image distance, i.e. in particular the distance between the lamp (3) and the convergent lens (31), and the object distance, i.e. in particular the distance between the convergent lens (31) and the light-sensitive area, in relation to the focal distance of the convergent lens (31), are such that the image of the lamp (3) is blurred, in particular such that, transversely to the direction of the rows, the image covers more than 20 percent, in particular more than 50 percent, of the extent of the light-sensitive area transversely to the direction of the rows, or such that the image covers more than 50 percent of the light-sensitive area.
3. System according to claim 1, characterised in that the optical element is a divergent lens (21), wherein the image distance, i.e. in particular the distance between the lamp (3) and the divergent lens (21), and the object distance, i.e. in particular the distance between the divergent lens (21) and the light-sensitive area, in relation to the focal distance of the convergent lens (31), are such that the image of the lamp (3) is blurred, in particular such that, transversely to the direction of the rows, the image covers more than 20 percent, in particular more than 50 percent, of the extent of the light-sensitive area transversely to the direction of the rows, or such that the image covers more than 50 percent of the light-sensitive area.
4. System according to any of the preceding claims, characterised in that the support unit is a smartphone case or a smartphone sleeve.
5. System according to any of the preceding claims, characterised in that the image sensor (9) is configured such that the light-sensitive area of the image sensor (9) is scanned row by row, and in particular this scanning of the light-sensitive area is repeated recurrently over time at a frame frequency.
6. System according to any of the preceding claims, characterised in that the system is dimensioned such that the image of the lamp (3) is blurred, in particular is so blurred that, transversely to the direction of the rows, the image covers more than 20 percent, in particular more than 50 percent, of the extent of the light-sensitive area transversely to the direction of the rows, or such that the image covers more than 50 percent of the light-sensitive area.
7. System according to any of the preceding claims, characterised in that the time characteristic of the data stream by which the lamp (3) is activated is displayed as a spatial brightness characteristic of the image taken by the camera (5) in the direction of the columns and / or in the transverse direction to the direction of the rows of the image sensor (9) of the camera (5), in particular wherein the spatial characteristic of a single image taken by the camera (5) represents just one time interval of the time characteristic, in particular wherein the spatial characteristic is arranged only in the region of the projected image of the lamp (3).
8. System according to any of the preceding claims, characterised in that the time characteristic of the data stream is periodic, i.e. has a period duration, and the frame frequency during the scanning, or an integer multiple of the frame frequency during the scanning, is equal to the inverse of the period duration.
9. System according to any of the preceding claims, characterised in that the second communication unit likewise comprises a controllable lamp (3), in particular an LED, and the first communication unit comprises a further light-sensitive element, in particular such that data can be transmitted bidirectionally between the two communication units.
10. System according to any of the preceding claims, characterised in that the second communication unit is configured as a smartphone and / or operates as a mobile communications device, in particular wherein the second communication unit comprises signal electronics (2, 6) and a display means, in particular a touch-sensitive screen.
11. System according to any of the preceding claims, characterised in that the first communication unit is an electrical device, in particular a converter for feeding an electric motor, or an autonomously moving intralogistics transportation vehicle, in particular a driverless transportation system or a self-driving vehicle.
12. Method for operating a system according to any of the preceding claims, characterised in that in the image taken, for each row the difference between a threshold value and the sum of the brightness values of the light-sensitive elements, in particular pixels, is determined, and thus the series of differences displays one time interval of the time characteristic of the data stream, in particular as a spatial brightness characteristic transverse to the direction of the rows, in particular wherein the threshold value is the average of the brightness values.
