Location observation system and location observation program

The position observation system uses a sensor to generate infrared and depth images for precise alignment of pins and receivers, addressing the inefficiencies of visual methods and reducing assembly costs.

JP7596229B2Active Publication Date: 2024-12-09KK TOSHIBA
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2021121830
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-07-26
Publication Date
2024-12-09
Estimated Expiration
2041-07-26

AI Technical Summary

Technical Problem

The alignment of pins and pin receivers in a railway vehicle connection is often inaccurate, leading to potential damage during assembly, and conventional visual observation methods are costly and inefficient.

Method used

A position observation system using a sensor to scan a light beam through a through hole, generating infrared and depth images to evaluate positional deviations between pins and receivers, allowing for accurate alignment without the need for costly pit formations.

Benefits of technology

Enables low-cost, precise alignment of pins and receivers by displaying images that indicate positional deviations, facilitating safe and efficient vehicle assembly.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007596229000001
    Figure 0007596229000001
  • Figure 0007596229000002
    Figure 0007596229000002
  • Figure 0007596229000003
    Figure 0007596229000003
Patent Text Reader

Abstract

To provide a position observation system capable of checking relative positions of an insertion target and an insertion at low cost, and a position observation program.SOLUTION: A position observation system comprises a sensor, an image generation unit, and a display control unit. The sensor is arranged so as to face a first opening in a through hole of a first target including the through hole. The sensor scans a light beam toward the through hole and receives reflected light of a light beam from a second target inserted from a second opening in the through hole into the through hole. The image generation unit generates an image on the basis of the reflected light received by the sensor. The display control unit displays the image on a display device.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The embodiment relates to a position observation system and a position observation program. [Background technology]

[0002] The car body and the bogie of a railway vehicle are coupled, for example, by inserting a pin provided on the car body into a pin receiver provided on the bogie. Since the car body is heavy, if the pin and the pin receiver are not accurately aligned, the bogie may be damaged when the car body and the bogie are coupled. Conventionally, the relative positions of the pin and the pin receiver are observed visually by a worker. This visual observation is performed, for example, by a worker looking at the pin through the pin receiver from a hole called a pit dug in the floor on which the bogie is placed. Since forming a pit is costly, a lower-cost observation method is desired. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2010 / 041371 Summary of the Invention [Problem to be solved by the invention]

[0004] The embodiments provide a position observation system and a position observation program that can confirm the relative positions of an insertion object and an insert at low cost. [Means for solving the problem]

[0005] A position observation system according to one embodiment includes a sensor, an image generating unit, and a display control unit. Evaluation department andThe sensor is disposed so as to face a first opening of a through hole of a first object having a through hole. The sensor scans a light beam toward the through hole and receives a reflected light of the light beam from a second object inserted into the through hole through a second opening of the through hole. The image generating unit generates an image based on the reflected light received by the sensor. The display control unit displays the image on a display device. The evaluation unit The positional deviation of the second object with respect to the through hole is evaluated based on the image. The image includes a first image having a pixel value representing the brightness of reflected light. The evaluation unit evaluates the positional deviation of the second object with respect to the through hole based on the symmetry of a dark portion formed at the position of the through hole in the image. [Brief description of the drawings]

[0006] [Figure 1] FIG. 1 is a diagram showing an application example of a position observation system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating a configuration of a position observation system according to an embodiment. [Diagram 3] FIG. 3 is a diagram illustrating an example of a hardware configuration of the position observation device. [Figure 4] FIG. 4 is a flowchart showing the operation of the position observation device. [Figure 5A] FIG. 5A is a diagram showing the relationship between the pin and the light beam projected from the sensor when the horizontal positional deviation between the pin and the pin receiver is large. [Figure 5B] FIG. 5B is a diagram showing an example of an infrared image obtained in accordance with the situation of FIG. 5A. [Figure 6A] FIG. 6A is a diagram showing the relationship between the pin and the light beam projected from the sensor when the horizontal positional deviation between the pin and the pin receiver is small. [Figure 6B] FIG. 6B is a diagram showing an example of an infrared image obtained in accordance with the situation of FIG. 6A. [Figure 7A] FIG. 7A is a diagram showing the relationship between the pin and the light beam projected from the sensor when the pin is brought close to the pin receiver with a small horizontal positional deviation between the pin and the pin receiver. [Figure 7B] FIG. 7B is a diagram showing an example of an infrared image obtained in accordance with the situation of FIG. 7A. [Figure 8A] FIG. 8A is a diagram showing a change in a depth image according to the vertical positional relationship between a pin and a pin receiver. [Figure 8B] FIG. 8B is a diagram showing a change in the depth image according to the vertical positional relationship between the pin and the pin receiver. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] Hereinafter, an embodiment will be described with reference to the drawings. Fig. 1 is a diagram showing an application example of a position observation system according to an embodiment. The position observation system according to an embodiment can be used, for example, when coupling a car body 1 and a bogie 2 of a railway vehicle.

[0008] The car body 1 is lifted, for example, by a crane (not shown) so that it can move in a horizontal direction parallel to the floor surface on which the bogie 2 is placed and in a vertical direction relative to the floor surface. A pin 10 as an example of a second object is provided on the lower part of the car body 1. The pin 10 is, for example, a substantially cylindrical pin, and one or more pins 10 are formed on the car body 1. The cross-sectional shape of the pin 10 does not necessarily have to be circular.

[0009] The bogie 2 is fixed at a predetermined position on the floor surface. The bogie 2 is provided with a pin receiver 20 as an example of a first object. The pin receiver 20 is a through hole formed in the bogie 2. The shape of the pin receiver 20 may be determined according to the shape of the pin 10. The cross-sectional shape of the pin receiver 20 may be the same as or different from the cross-sectional shape of the pin 10. For example, the cross-sectional shape of the pin 10 may be a circle, and the cross-sectional shape of the pin receiver 20 may be an ellipse. Hereinafter, the opening on the side of the pin receiver 20 facing the floor surface will be referred to as a first opening, and the opening on the side facing the car body 1 will be referred to as a second opening.

[0010] When connecting the car body 1 and the bogie 2, a worker operates the crane to insert the pin 10 of the car body 1 into the pin receiver 20 of the bogie 2 while observing the relative positions of the pin 10 and the pin receiver 20 using the position observation system of the embodiment.

[0011] 2 is a diagram showing a configuration of a position observation system according to an embodiment of the present invention. The position observation system includes a sensor 30 and a position observation device 40.

[0012] The sensor 30 is disposed on a floor surface facing the first opening of each pin receiver 20. More specifically, the sensor 30 is disposed so that the center position of the light receiving surface is disposed on the central axis of the through hole of the pin receiver 20. The sensor 30 may be, for example, a LiDAR (Light Detecting and Ranging) depth camera. The LiDAR depth camera has, for example, a light source, a deflection element, and a light receiving element. The light source is, for example, an infrared light source that emits infrared light toward the deflection element. The deflection element has, for example, a MEMS (Micro Electro Mechanical Systems) mirror, and scans the pin 10 in a cone shape through the pin receiver 20 by changing the emission direction of the light beam by controlling the mirror. The light receiving element is, for example, an element having a light receiving surface on which pixels made of elements such as photodiodes sensitive to the infrared range and SPADs (Single-Photon Avalanche Diodes) are arranged two-dimensionally.

[0013] The sensor 30 in this embodiment projects infrared light L from a first opening, which is an opening on the lower side of the pin receiver 20, and receives reflected light of the infrared light L that is emitted from the second opening and reflected by the pin 10. Then, the sensor 30 transmits sensor data based on the reflected light to the position observation device 40. The sensor data includes, for example, data representing the brightness of the reflected light and data representing the time difference between the projected and received light.

[0014] Here, the sensor 30 is configured to scan the pin 10 in a cone shape via the pin receiver 20. The configuration of the sensor 30 is not limited to a specific configuration as long as the sensor 30 can scan the light beam L so that the light beam L is normally incident on the center of the second opening and the light beam L is obliquely incident on the edge of the second opening. For example, the sensor 30 is not necessarily limited to a configuration in which the light beam is scanned by a mirror.

[0015] The position observation device 40 has an image generation unit 41, an evaluation unit 42, a switching unit 43, and a display control unit 44. The position observation device 40 is configured to be able to communicate with the sensor 30. The communication between the position observation device 40 and the sensor 30 may be wireless or wired. The position observation device 40 is also configured to be able to communicate with the display device 50. The display device 50 is a display device such as a liquid crystal display or an organic EL display. The display device 50 displays various images based on the data transferred from the position observation device 40. The communication between the position observation device 40 and the display device 50 may be wireless or wired.

[0016] The image generating unit 41 generates an image based on the sensor data from the sensor 30. The image generating unit 41 generates a first image in which the pixel value is, for example, the brightness of reflected light, and a second image in which the pixel value is the depth calculated based on the reflected light. The first image is an infrared image generated by assigning a value to each pixel according to the brightness value of infrared light detected at each scanning position of the sensor 30. On the other hand, the second image is a depth image generated by assigning a value to each pixel according to the depth value calculated by, for example, the time difference between projected and received infrared light detected at each scanning position of the sensor 30.

[0017] The evaluation unit 42 evaluates the positional misalignment between the pin 10 and the pin receiver 20 by evaluating the first image or the second image in the image generation unit 41. The method of evaluating the positional misalignment will be described in detail later.

[0018] The switching unit 43 switches the image to be output to the display control unit 44 between the first image and the second image depending on the evaluation result in the evaluation unit 42. Details of the switching will be described later.

[0019] The display control unit 44 displays the image input from the switching unit 43 on the display device 50. The display control unit 44 may superimpose various information on the image input from the switching unit 43 and display it on the display device 50 as necessary.

[0020] Fig. 3 is a diagram showing an example of a hardware configuration of the position observation device 40. The position observation device 40 can be various terminal devices such as a personal computer (PC) or a tablet terminal. As shown in Fig. 3, the position observation device 40 has a processor 401, a ROM 402, a RAM 403, a storage 404, an input interface 405, and a communication device 406 as hardware.

[0021] The processor 401 is a processor that controls the overall operation of the position observation device 40. The processor 401 operates as an image generation unit 41, an evaluation unit 42, a switching unit 43, and a display control unit 44, for example, by executing a program stored in the storage 404. The processor 401 is, for example, a central processing unit (CPU). The processor 401 may be a micro-processing unit (MPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or the like. The processor 401 may be a single CPU, or a plurality of CPUs, or the like.

[0022] The ROM (Read Only Memory) 402 is a non-volatile memory. The ROM 402 stores a startup program and various thresholds of the position observation device 40. The RAM (Random Access Memory) 403 is a volatile memory. The RAM 403 is used as a working memory for processing in the processor 401, for example.

[0023] The storage 404 is, for example, a storage such as a hard disk drive, a solid state drive, etc. The storage 404 stores various programs executed by the processor 401, such as a position observation program.

[0024] The input interface 405 includes input devices such as a touch panel, a keyboard, a mouse, etc. When an input device of the input interface 405 is operated, a signal corresponding to the operation content is input to the processor 401. The processor 401 performs various processes according to this signal.

[0025] The communication device 406 is a communication device for the position observation device 40 to communicate with external devices such as the sensor 30 and the display device 50. The communication device 406 may be a communication device for wired communication or a communication device for wireless communication.

[0026] Next, the operation of the position observation system will be described. FIG. 4 is a flow chart showing the operation of the position observation device 40. The processing of FIG. 4 is executed by the processor 401. During the processing of FIG. 4, a worker, while watching an image displayed on the display device 50, operates, for example, a crane to insert the pin 10 of the car body 1 into the pin receiver 20 of the dolly 2. At this time, the sensor 30 scans the pin 10 via the pin receiver 20 while projecting a light beam toward the pin receiver 20. Then, the sensor 30 sequentially transmits sensor data to the position observation device 40. Upon receiving the sensor data, the processor 401 starts the processing of FIG. 4.

[0027] In step S1, the processor 401 generates an infrared image as a first image and a depth image as a second image based on the sensor data from the sensor 30. As described above, the infrared image is an image in which each pixel value is assigned according to the luminance of the infrared light obtained from the sensor data. Also, the depth image is an image in which each pixel value is assigned according to the depth calculated based on the time difference between projecting and receiving the infrared light obtained from the sensor data.

[0028] In step S2, the processor 401 detects dark areas in the infrared image. Here, the dark areas in the infrared image will be described.

[0029] FIG. 5A is a diagram showing the relationship between the light beam projected from the sensor 30 and the pin 10 when the horizontal positional deviation between the pin 10 and the pin receiver 20 is large. In the embodiment, the light beam is projected from the sensor 30 in a cone shape. That is, the light beam is obliquely emitted from the edge of the second opening of the pin receiver 20. Therefore, as shown in FIG. 5A, when the center of the pin 10 is significantly deviated from the center C of the pin receiver 20, a part of the light beam L1 projected from the sensor 30 and emitted from the second opening of the pin receiver 20 is reflected by the tip of the pin 10, while a part of the light beam L2 does not hit the tip of the pin 10 and passes through the side of the pin 10. Therefore, the reflected light of the light beam L2 does not return, or even if it returns, it is weaker than the reflected light of the light beam L1. Here, when the center of the pin 10 is significantly deviated from the center C of the pin receiver 20, the light beam L2 is biased toward the light beam emitted from a specific part of the pin receiver 20. For example, in FIG. 5A, the light ray L2 is biased toward a light ray emitted from the right side of the pin receiver 20.

[0030] Fig. 5B is a diagram showing an example of an infrared image obtained in the situation of Fig. 5A. The reflected light of light ray L2 is weaker than the reflected light of light ray L1. Therefore, in the infrared image 200, the portion based on the reflected light of light ray L1 becomes a bright portion 201 that represents the shape of the tip of the pin 10, whereas the portion based on the reflected light of light ray L2 becomes a dark portion 202. Here, when the horizontal positional deviation between the pin 10 and the pin receiver 20 is large, a bias occurs in the light ray L2, and the shape of the dark portion 202 becomes asymmetric with respect to the center of the circle representing the pin receiver 20.

[0031] Fig. 6A is a diagram showing the relationship between the light beam projected from the sensor 30 and the pin 10 when the horizontal positional deviation between the pin 10 and the pin receiver 20 is small. As shown in Fig. 6A, even when the center of the pin 10 almost coincides with the center C of the pin receiver 20, some of the light beams L2 projected from the sensor 30 and emitted from the second opening of the pin receiver 20 do not hit the tip of the pin 10 and pass through as is. However, when the center of the pin 10 almost coincides with the center C of the pin receiver 20, the light beams L2 are emitted almost evenly from the edge of the second opening of the pin receiver 20.

[0032] Fig. 6B is a diagram showing an example of an infrared image obtained in the situation of Fig. 6A. Since the light rays L2 are emitted almost uniformly from the edge of the second opening of the pin receiver 20, the shape of the dark area 202 in the infrared image 200 becomes a band that is almost symmetrical with respect to the center of the circle representing the pin receiver 20.

[0033] 7A is a diagram showing the relationship between the pin 10 and the light beams emitted from the sensor 30 when the pin 10 is brought close to the pin receiver 20 with a small horizontal positional deviation between the pin 10 and the pin receiver 20. As shown in FIG 7A, when the distance between the pin 10 and the pin receiver 20 becomes shorter, the number of light beams L2 passing through the side surface of the pin 10 decreases.

[0034] Fig. 7B is a diagram showing an example of an infrared image obtained in the situation of Fig. 7A. Since the number of light rays L2 is reduced, the width of the band as the dark area 202 in the infrared image 200 is narrower than when the distance between the pin 10 and the pin receiver 20 is large. After the pin 10 is inserted into the pin receiver 20, the band as the dark area 202 in the infrared image 200 is almost invisible.

[0035] In this way, the shape of the dark portion 202 changes according to the positional deviation between the pin 10 and the pin receiver 20. Therefore, the amount of deviation between the pin 10 and the pin receiver 20 can be evaluated from the shape of the dark portion 202. Based on this principle, the processor 401 detects, as the dark portion 202, an area in the infrared image 200 that has, for example, a predetermined pixel value or less.

[0036] In step S3, the processor 401 judges whether the amount of deviation between the pin 10 and the pin receiver 20 is large. For example, when the shape of the dark portion 202 does not have symmetry of a certain threshold value or more with respect to the center of the circle representing the pin receiver 20, the processor 401 judges that the amount of deviation between the pin 10 and the pin receiver 20 is large. Note that even when the pin 10 is not located at all on the pin receiver 20, the shape of the dark portion 202 can be symmetric. However, in this case, the bright portion 201 does not exist. The processor 401 also judges that the amount of deviation between the pin 10 and the pin receiver 20 is large when there is no boundary between the bright portion 201 and the dark portion 202 in such an infrared image 200. When it is judged in step S3 that the amount of deviation between the pin 10 and the pin receiver 20 is large, the process proceeds to step S4. When it is judged in step S3 that the amount of deviation between the pin 10 and the pin receiver 20 is not large, the process proceeds to step S6.

[0037] In step S4, the processor 401 causes the display device 50 to display the infrared image. After that, the processor 401 transitions the process to step S5. By displaying an infrared image such as that shown in Fig. 5A on the display device 50, the worker can observe the positional misalignment between the pin 10 and the pin receiver 20 from the display device 50. Here, in addition to the infrared image shown in Fig. 5A, a guidance display of the crane operation direction according to the direction of the misalignment between the pin 10 and the pin receiver 20 determined from the symmetry of the dark portion 202 may be displayed.

[0038] In step S5, the processor 401 determines whether or not to end the operation of the position observation device 40. For example, when an instruction to end the operation is given by the worker operating the input interface 405, the processor 401 determines to end the operation of the position observation device 40. When it is determined in step S5 that the operation of the position observation device 40 is to be ended, the process of FIG. 4 ends. When it is not determined in step S5 that the operation of the position observation device 40 is to be ended, the process returns to step S1.

[0039] In step S 6 , the processor 401 calculates the width of the band as the dark area 202 in the infrared image 200 .

[0040] In step S7, processor 401 determines whether or not pin 10 is not inserted in pin receiver 20. For example, processor 401 determines that pin 10 is not inserted in pin receiver 20 when the width of the band as dark portion 202 is greater than a predetermined threshold value. When it is determined in step S7 that pin 10 is not inserted in pin receiver 20, the process proceeds to step S8. When it is determined in step S8 that pin 10 is inserted in pin receiver 20, the process proceeds to step S9.

[0041] In step S8, the processor 401 causes the display device 50 to display the infrared image. After that, the processor 401 shifts the process to step S5. By displaying the infrared image as shown in FIG. 6B or FIG. 7B on the display device 50, the worker can observe from the display device 50 that the horizontal positional deviation between the pin 10 and the pin receiver 20 is reduced. In addition, the worker can fine-tune the horizontal position of the pin 10 and the pin receiver 20 while looking at the width of the band in the infrared image. Here, in addition to the infrared image shown in FIG. 6B or FIG. 7B, a guide display of the crane operation direction according to the direction of deviation between the pin 10 and the pin receiver 20 determined by the width of the band of the dark portion 202 may be displayed.

[0042] In step S9, the processor 401 displays the depth image on the display device 50. After that, the processor 401 shifts the process to step S5. As described above, after the pin 10 is inserted into the pin receiver 20, the band as the dark portion 202 in the infrared image 200 is hardly visible. On the other hand, the worker needs to operate the crane to completely insert the pin 10 into the pin receiver 20. If the worker lowers the crane too much, the car body 1 may come into contact with the dolly 2 and the dolly 2 may be damaged. For this reason, it is desirable to be able to confirm to what extent the pin 10 is inserted into the pin receiver 20. However, in the infrared image 200, it is difficult to confirm the vertical positional relationship between the pin 10 and the pin receiver 20. For this reason, after the pin 10 is inserted, the processor 401 switches the image displayed on the display device 50 from the infrared image to the depth image.

[0043] 8A and 8B are diagrams showing changes in the depth image according to the vertical positional relationship between the pin 10 and the pin receiver 20. As shown in FIG. 8A, in the depth image 300, pixel values ​​are assigned according to the depth relative to the sensor 30. This allows the positional relationship between the pin 10 and the pin receiver 20 to be expressed. That is, when the vertical positional relationship between the pin 10 and the pin receiver 20 is a certain relationship, as shown in FIG. 8A, a portion 301 of the pin 10 in the depth image 300 has a certain pixel value according to the distance between the sensor 30 and the pin 10. On the other hand, when the pin 10 is further inserted into the pin receiver 20, as shown in FIG. 8B, the portion 301 of the pin 10 in the depth image 300 has a pixel value different from that in FIG. 8A. In this way, the operator can check the insertion state of the pin 10 into the pin receiver 20 on the display device 50.

[0044] Here, not only the pixel values ​​of the image of the portion 301 of the pin 10 in Fig. 8A and the image of the portion 301 of the pin 10 in Fig. 8B may be changed, but also the colors, etc. Changing the colors, etc. according to the vertical positional relationship between the pin 10 and the pin receiver 20 makes it easier for the worker to confirm the vertical positional relationship between the pin 10 and the pin receiver 20 on the image on the display device 50.

[0045] As described above, according to the embodiment, a sensor is used to observe the relative positional relationship between a first object and a second object when the second object is inserted through one opening of a through hole in a first object having a through hole, and the sensor is arranged to face the other opening of the through hole, scans a light beam toward the through hole, and receives the reflected light of the light beam from the second object. In this case, the relative positional relationship between the first object and the second object in the cross-sectional direction of the through hole and the horizontal direction may cause a light beam to be missed. This light beam is detected as a dark area in the image, and the relative positional relationship between the first object and the second object may be evaluated on the image. In addition, the image including such a dark area is displayed, and the worker can observe the relative positional relationship between the first object and the second object. In the embodiment, since it is only necessary to arrange the sensor to face the through hole, formation of a pit or the like is not required, and a position observation system can be realized at low cost.

[0046] In addition, in the embodiment, the relative positions can be observed without setting a reference position such as a marker on the object and without detecting the reference position of the marker on the image, which is particularly suitable for observing the relative positions between large objects.

[0047] In addition, in the embodiment, after the second object is inserted into the first object, the image displayed on the display device is switched from the first image having the brightness of the reflected light as a pixel value to the second image having the depth to the sensor calculated based on the reflected light as a pixel value, so that the worker can observe the insertion state of the first object and the second object on the image even after the second object is inserted into the first object.

[0048] In the embodiment, infrared light is used as the light, so that the relative position can be observed through the through-hole even in a non-illuminated environment.

[0049] [Variations] A modified example of the embodiment will be described below. In the above-mentioned embodiment, after the second object is inserted into the first object, the image displayed on the display device is switched from the first image having the brightness of the reflected light as a pixel value to the second image having the depth to the sensor calculated based on the reflected light as a pixel value. In contrast, the image displayed on the display device may be the second image even before the second object is inserted into the first object. In this case, the dark portion 202 is generated as an image representing a relatively long distance.

[0050] In addition, although infrared light is used as the light in the embodiment, visible light may be used as the light under an environment in which the through-hole can be illuminated. In this case, a color image may be displayed on the display device 50 instead of an infrared image.

[0051] Also, in the embodiment, both the infrared image and the depth image are generated in step S1, whereas the depth image may be generated during the processing of step S9.

[0052] In the embodiment, when it is determined that the pin 10 is inserted into the pin receiver 20, the image displayed on the display device 50 is automatically switched from the infrared image to the depth image. On the other hand, the image displayed on the display device 50 may be switched by, for example, an operator operating the input interface 405. In this case, the determination in step S7 is replaced with whether or not an operation for switching by the operator has been accepted. Then, when it is determined that an operation for switching has been accepted, the processor 401 shifts the process to step S9. Furthermore, the automatic switching from the infrared image to the depth image and the manual switching may be used in combination. In this case, a determination is made as to whether or not the pin 10 is inserted into the pin receiver 20 as shown in step S7 of FIG. 4, and a determination is made as to whether or not an operation for switching by the operator has been accepted.

[0053] In addition, in the embodiment, an example is shown in which the position observation system can be used when the car body and the bogie of a railway vehicle are coupled. In contrast, the position observation system of the embodiment is not necessarily limited to being used when the car body and the bogie of a railway vehicle are coupled. In this case, the sensor does not necessarily need to be arranged below the first object. For example, when the second object is inserted from the lower opening of the through hole, the sensor is arranged so as to face the upper opening of the through hole. Also, when the second object is inserted from one opening of the through hole formed in the horizontal direction, the sensor is arranged so as to face the other opening of the through hole.

[0054] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0055] 1 vehicle body, 2 bogie, 10 pin, 20 pin receiver, 30 sensor, 40 position observation device, 41 image generation unit, 42 evaluation unit, 43 switching unit, 44 display control unit, 50 display device, 401 processor, 402 ROM, 403 RAM, 404 storage, 405 input interface, 406 communication device.

Claims

1. a sensor disposed to face a first opening of a through hole of a first object having a through hole, scanning a light beam toward the through hole, and receiving reflected light of the light beam from a second object inserted into the through hole through a second opening of the through hole; an image generating unit that generates an image based on the reflected light received by the sensor; A display control unit that displays the image on a display device; an evaluation unit that evaluates a positional deviation of the second object with respect to the through hole based on the image; Equipped with the image includes a first image having a pixel value corresponding to the luminance of the reflected light; The evaluation unit evaluates the positional deviation of the second object relative to the through hole based on symmetry of a dark area formed at the position of the through hole in the image.

2. The image further includes a second image having a pixel value representing a depth relative to the sensor calculated based on the reflected light, The position observation system of claim 1, further comprising a switching unit that automatically switches the image displayed on the display device by the display control unit from the first image to the second image when the second object is inserted into the through hole.

3. The image further includes a second image having a pixel value representing a depth relative to the sensor calculated based on the reflected light, 3. The position observation system according to claim 1, further comprising an operation unit that accepts a manual operation for switching the image displayed by the display control unit on the display device from the first image to the second image.

4. 4. The position observation system according to claim 1, wherein the light beam is an infrared light beam.

5. 5. The position observation system according to claim 1, wherein the sensor scans the light beam so that the light beam is normally incident on the center of the second opening and obliquely incident on the edge of the second opening.

6. a sensor disposed to face a first opening of a through hole of a first object having a through hole, scanning a light beam toward the through hole, and receiving reflected light of the light beam from a second object inserted into the through hole through a second opening of the through hole, generating an image based on reflected light received by the sensor; displaying the image on a display device; evaluating a positional deviation of the second object relative to the through hole based on the image; and A position observation program for causing a computer to execute the above, the image includes a first image having a pixel value corresponding to the luminance of the reflected light; The evaluating step includes evaluating a positional deviation of the second object with respect to the through hole based on a symmetry of a dark portion formed at the position of the through hole in the image. A location observation program for causing a computer to execute the above.

Citation Information

Patent Citations

  • PCB positioning hole positioning mechanism based on visual positioning

    CN211346689U

  • Accurate fine positioning unit

    JP1988137309A

  • Method for testing deviation of installed metallic dome and method for testing deviation of installed parts

    JP2003097917A

  • Nozzle gap measuring apparatus

    JP2011045892A

  • Method for taking out work

    WO2010041371A1