Wireless communication system and wireless power supply system

The wireless communication system uses markers outside boundary members to enhance alignment and recognition, addressing the challenge of communication stability across obstructions, thereby improving inter-vehicle and inter-building communication accuracy.

JP7611285B2Active Publication Date: 2025-01-09SOFTBANK CORPORATION
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2023058711
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-03-31
Publication Date
2025-01-09
Estimated Expiration
2043-03-31

AI Technical Summary

Technical Problem

Existing wireless communication systems struggle to maintain accurate alignment and recognition of communication partners across boundary members such as window glass, leading to reduced recognition rates and unstable communication due to reflections and brightness differences.

Method used

A wireless communication system employing markers placed outside boundary members, allowing devices to detect and align their orientations using these markers, ensuring accurate imaging and communication direction alignment despite obstructions like window glass.

Benefits of technology

Improves recognition rates and stabilizes wireless communication by enabling precise alignment of imaging and communication units across boundary members, enhancing inter-vehicle or inter-building communication.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007611285000001
    Figure 0007611285000001
  • Figure 0007611285000002
    Figure 0007611285000002
  • Figure 0007611285000003
    Figure 0007611285000003
Patent Text Reader

Abstract

To improve a recognition rate of a communication partner.SOLUTION: A radio communication system 1 which performs directional radio communication comprises: a first device 100 including a first imaging unit 102 mounted on a first gimbal 106 and a first radio communication unit 104; a second device 200 arranged in an object 20 including a boundary member 22 and including a second imaging unit 202 and a second radio communication unit 204 mounted on a second gimbal 206; and markers 180 and 280 arranged outside the boundary members 12 and 22. The second imaging unit and the second radio communication unit are arranged so that the second imaging unit captures an outside direction of the object 20 via the boundary member 22 and the second radio unit communicates with the outside direction of the object 20 via the boundary member 22. The first device detects a marker 280 by the image captured by the first imaging unit, detects the second imaging unit on the basis of the detected marker 280, and controls the first gimbal so that an imaging direction of the first imaging unit faces the second imaging unit on the basis of the detection results of the second imaging unit.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a wireless communication system and a wireless power supply system. [Background technology]

[0002] Patent Document 1 relates to an optical wireless device and an optical fiber positioning method, and in particular describes a technique for determining the position of the tip of an optical fiber for an optical wireless device. [Prior art document] [Patent documents] [Patent Document 1] JP 2022-73629 A Summary of the Invention [Means for solving the problem]

[0003] According to an embodiment of the present invention, a wireless communication system is provided. The wireless communication system may perform directional wireless communication. The wireless communication system may include a first device having a first imaging unit and a first wireless communication unit mounted on a first gimbal. The wireless communication system may include a second device having a second imaging unit and a second wireless communication unit mounted on a second gimbal, which is disposed within an object including a boundary member. The wireless communication system may include a marker disposed outside the boundary member. The second imaging unit and the second wireless communication unit may be disposed such that the second imaging unit captures an image of the outer direction of the object through the boundary member, and the second wireless communication unit communicates with the outer direction of the object through the boundary member. The first device may include a first marker detection unit that detects the marker by an image captured by the first imaging unit. The first device may include a first imaging unit detection unit that detects the second imaging unit based on the marker detected by the first marker detection unit. The first device may include a first gimbal control unit that controls the first gimbal based on a detection result by the first imaging unit detection unit so that an imaging direction of the first imaging unit faces the second imaging unit.

[0004] In the wireless communication system, the marker may be positioned outside the boundary member and outside an adjustment range of the imaging direction of the second imaging unit that is adjusted by the second gimbal.

[0005] In the wireless communication system, the marker may be arranged outside the boundary member at a position shifted from a position on the boundary member that is closest to the second imaging section.

[0006] In any of the wireless communication systems, the first imaging unit detection unit may detect the second imaging unit based on a position obtained by converting the center position of a bounding box of the marker detected by the first marker detection unit using a predetermined conversion method based on a positional relationship between the second imaging unit and the marker with the bounding box as a reference.

[0007] Any of the wireless communication systems described above may further comprise a light absorbing material disposed around the marker.

[0008] In any of the wireless communication systems described above, the marker may be a marker that can identify the second device by at least one of a color and a shape.

[0009] The second device may be disposed within a second object including the boundary member, and the first device may be disposed within a first object including the boundary member, and the wireless communication system may include a first marker disposed outside the boundary member of the first object and a second marker disposed outside the boundary member of the second object, and the second device may have a second marker detection unit that detects the first marker using an image captured by the second imaging unit, a second imaging unit detection unit that detects the first imaging unit based on the first marker detected by the second marker detection unit, and a second gimbal control unit that controls the second gimbal so that the imaging direction of the second imaging unit faces the first imaging unit based on the detection result by the second imaging unit detection unit. The first device may be located in a first vehicle, the second device may be located in a second vehicle, the first marker may be located on a windshield of the first vehicle, and the second marker may be located on a rear window of the second vehicle, and the first device and the second device may perform vehicle-to-vehicle communication using the first wireless communication unit and the second wireless communication unit.

[0010] According to an embodiment of the present invention, a wireless power supply system is provided. The wireless power supply system may perform directional wireless power supply. The wireless power supply system may include a first device having a first imaging unit and a wireless power receiving unit mounted on a first gimbal. The wireless power supply system may include a second device having a second imaging unit and a wireless power receiving unit mounted on a second gimbal, which is disposed within an object including a boundary member. The wireless power supply system may include a marker disposed outside the boundary member. The second imaging unit and the wireless power receiving unit may be disposed such that the second imaging unit captures an image of the outside of the object through the boundary member, and the wireless power receiving unit receives power from the outside of the object through the boundary member. The first device may include a first marker detection unit that detects the marker by an image captured by the first imaging unit. The first device may include a first imaging unit detection unit that detects the second imaging unit based on the marker detected by the first marker detection unit. The first device may include a first gimbal control unit that controls the first gimbal based on a detection result by the first imaging unit detection unit so that an imaging direction of the first imaging unit faces the second imaging unit.

[0011] The above summary of the invention does not list all of the necessary features of the present invention. Also, subcombinations of these features may also be inventions. [Brief description of the drawings]

[0012] [Figure 1] 1 illustrates an example of a wireless communication system 1. [Diagram 2] 2 shows an example of a positional relationship between the imaging unit 202 and the marker 280. [Diagram 3] 2 shows an example of an image 120 captured by the imaging section 102. [Figure 4] 2 shows another example of the positional relationship between the imaging unit 202 and the marker 280. [Diagram 5] 2 is an explanatory diagram for explaining the relationship between the imaging unit 202 and the marker 280. FIG. [Figure 6]An example of a light absorbing material 282 is shown diagrammatically. [Figure 7] 2 illustrates an example of a functional configuration of the device 100. [Figure 8] 2 illustrates an example of a functional configuration of the device 200. [Figure 9] 1 shows an example of a process flow by the device 100. [Figure 10] 1 illustrates an example of a wireless power supply system 2. [Figure 11] 2 illustrates an example of a functional configuration of the device 300. [Figure 12] 4 shows an example of a functional configuration of the device 400. [Figure 13] An example of a hardware configuration of a computer 1200 that functions as the device 100, the device 200, the device 300, or the device 400 is shown in schematic form. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] For example, in conventional tracking optical wireless communication, each communication device recognizes the other by image recognition or the like, and automatically adjusts the orientation of the device so that the optical axis is aligned. At this time, by attaching a marker to the tracking target object, it is possible to improve the recognition rate of the target device in image recognition and LiDAR (Light Detection and Ranging). However, when tracking is performed through a member such as window glass, such as between vehicles or between buildings, the marker may not be visible due to the reflection of external light by the member or the difference in brightness between the inside and outside of the member. For example, the wireless communication system according to the present embodiment provides a technology for improving the recognition rate of the communication partner in order to realize marker tracking even through window glass such as between vehicles or between buildings. Specifically, in the wireless communication system according to the present embodiment, a marker is directly placed on a member located on the boundary between the inside and outside of an object, such as window glass, according to a predetermined rule, and the position of the communication partner is identified based on the placed marker, thereby improving the recognition rate of the communication partner.

[0014] The present invention will be described below through the embodiments of the invention, but the following embodiments do not limit the invention according to the claims. Also, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention. Note that the following description will be given by taking as an example a case where a window glass is interposed between wireless communication devices, such as between vehicles or between buildings.

[0015] 1 illustrates an example of a wireless communication system 1. The wireless communication system 1 performs directional wireless communication. The wireless communication system 1 includes an apparatus 100 and an apparatus 200. The apparatus 100 may be an example of a first apparatus. The apparatus 200 may be an example of a second apparatus.

[0016] The device 100 is disposed within an object 10. The object 10 includes a boundary member 12. The device 200 is disposed within an object 20. The object 20 includes a boundary member 22. The device 100 and the device 200 perform directional wireless communication via the boundary member 12 and the boundary member 22. The device 100 and the device 200 perform, for example, optical wireless communication. The device 100 and the device 200 perform, for example, millimeter wave wireless communication.

[0017] The boundary member 12 and the boundary member 22 may be any member as long as they do not block directional wireless communication between the device 100 and the device 200. The boundary member 12 and the boundary member 22 may be a member that transmits a part of the incident light or incident wave and reflects a part of it. The boundary member 12 and the boundary member 22 are, for example, window glass. The boundary member 12 and the boundary member 22 are, for example, an acrylic plate. The boundary member 12 and the boundary member 22 are, for example, a plastic plate. These are merely examples, and the boundary member 12 and the boundary member 22 may be other members that do not block directional wireless communication.

[0018] The object 10 and the object 20 are, for example, vehicles such as an automobile and a bus. The types of vehicles are not limited to these. The device 100 arranged in the object 10 and the device 200 arranged in the object 20 may perform vehicle-to-vehicle communication. As a specific example, the boundary member 12 of the object 10 may be a windshield, and the boundary member 22 of the object 20 may be a rear glass. In this case, when the object 20 is located in front of the object 10, the device 100 and the device 200 perform wireless communication via the boundary member 12 and the boundary member 22.

[0019] Two devices 100 may be disposed on the object 10. For example, a device 100 may be disposed on each of the rear glass side and the windshield side of the object 10. Two devices 200 may also be disposed on the object 20. For example, a device 200 may be disposed on each of the rear glass side and the windshield side of the object 20.

[0020] The objects 10 and 20 may be buildings such as buildings. In this case, the boundary members 12 and 22 may be windows of the buildings. The boundary members 12 and 22 may be window glass, or may be acrylic or plastic panels. The objects 10 and 20 may be any objects including the boundary members 12 and 22, respectively. The objects 10 and 20 may be different types of objects. For example, the object 10 may be a vehicle, and the object 20 may be a building.

[0021] The device 100 includes an image capturing unit 102, a wireless communication unit 104, and a gimbal 106. The image capturing unit 102 may be an example of a first image capturing unit. The wireless communication unit 104 may be an example of a first wireless communication unit. The gimbal 106 may be an example of a first gimbal.

[0022] The imaging unit 102 and the wireless communication unit 104 are mounted on a gimbal 106. The imaging unit 102 and the wireless communication unit 104 are installed with respect to the gimbal 106 so that the imaging direction of the imaging unit 102 and the wireless communication direction of the wireless communication unit 104 coincide with each other. The orientations of both the imaging unit 102 and the wireless communication unit 104 are adjusted by the gimbal 106. The imaging unit 102 and the wireless communication unit 104 are arranged so that the imaging unit 102 captures an image of the outward direction of the object 10 via the boundary member 12, and the wireless communication unit 104 communicates with the outward direction of the object 10 via the boundary member 12.

[0023] The device 200 includes an imaging unit 202, a wireless communication unit 204, and a gimbal 206. The imaging unit 202 may be an example of a second imaging unit. The wireless communication unit 204 may be an example of a second wireless communication unit. The gimbal 206 may be an example of a second gimbal.

[0024] The imaging unit 202 and the wireless communication unit 204 are mounted on a gimbal 206. The imaging unit 202 and the wireless communication unit 204 are installed with respect to the gimbal 206 so that the imaging direction of the imaging unit 202 and the wireless communication direction of the wireless communication unit 204 coincide with each other. The orientations of both the imaging unit 202 and the wireless communication unit 204 are adjusted by the gimbal 206. The imaging unit 202 and the wireless communication unit 204 are arranged so that the imaging unit 202 images an image of the outward direction of the object 20 via the boundary member 22, and the wireless communication unit 204 communicates with the outward direction of the object 20 via the boundary member 22.

[0025] The imaging unit 102 and the wireless communication unit 104, and the imaging unit 202 and the wireless communication unit 204 are arranged so that the imaging direction of the imaging unit 102 and the imaging direction of the imaging unit 202 coincide with each other, and thereby the communication direction of the wireless communication unit 104 and the communication direction of the wireless communication unit 204 coincide with each other.

[0026] In this embodiment, a marker 180 is placed outside the boundary member 12, not on the imaging unit 102. The marker 180 is placed at a position corresponding to the imaging unit 102. The marker 180 is placed at a position according to a predetermined rule with respect to the imaging unit 102. This makes it possible to detect the position of the imaging unit 102 from the position of the marker 180.

[0027] For example, the marker 180 is disposed in front of the imaging unit 102. For example, the marker 180 is disposed at a position slightly shifted from the front of the imaging unit 102. For example, the marker 180 is disposed outside the adjustment range of the imaging direction of the imaging unit 102 that is adjusted by the gimbal 106.

[0028] The marker 180 is, for example, a sticker, and is attached to the outside of the boundary member 12. The method of attaching the marker 180 to the boundary member 12 is not limited to attaching, and any method may be used for attaching the marker 180. The material of the marker 180 may be a reflective material.

[0029] The marker 280, like the marker 180, is disposed on the outside of the boundary member 22. The material of the marker 280 may be a reflective material.

[0030] The device 100 detects the marker 280 from an image captured by the imaging unit 102. The device 100 detects the imaging unit 202 based on the detected marker 280. The device 100 controls the gimbal 106 based on the detection result of the imaging unit 202 so that the imaging direction of the imaging unit 102 faces the imaging unit 202. This allows the communication direction of the wireless communication unit 104 to be aligned with the wireless communication unit 204. When the marker 280 is arranged on the imaging unit 202 as in the conventional case, the marker 280 may not be identified due to reflection of external light by the boundary member 22 or a difference in brightness between the inside and outside of the boundary member 22. In contrast, in the wireless communication system 1 of this embodiment, the marker 280 is placed outside the boundary member 22 at a position relative to the imaging unit 202 that follows predetermined rules, and the device 100 is configured to detect the imaging unit 202 from the marker 280 based on the rules, thereby improving the recognition rate of the imaging unit 202 and, as a result, stabilizing the wireless communication between the device 100 and the device 200.

[0031] Like the device 100, the device 200 detects the marker 180 from an image captured by the imaging unit 202. The device 200 detects the imaging unit 102 based on the detected marker 180. The device 200 controls the gimbal 206 based on the detection result of the imaging unit 102 so that the imaging direction of the imaging unit 202 faces the imaging unit 102. In this way, by performing adjustments using the markers 180 and 280 in both the device 100 and the device 200, the orientations of the wireless communication unit 104 and the wireless communication unit 204 can be aligned with higher accuracy.

[0032] FIG. 2 shows an example of a positional relationship between the imaging unit 202 and the marker 280. The following mainly describes the marker 280, but the marker 180 may be similar to the marker 280. In the example shown in FIG. 2, the marker 280 is arranged so that the center of the marker 280 is located at the center of the lens of the imaging unit 202 when viewed from the front side of the imaging unit 202. By arranging as shown in FIG. 2, the marker 280 can be detected and the center position of the marker 280 can be identified, thereby detecting the center of the lens of the imaging unit 202. The marker 180 may be arranged in a positional relationship between the imaging unit 102 and the marker 180, which is similar to the positional relationship between the imaging unit 202 and the marker 280.

[0033] The marker 280 shown in FIG. 2 is an example, and the marker 280 may have any shape. The marker 280 is required to accurately grasp the position of the marker 280, so it is desirable that the marker 280 has a distinctive shape. If the shape is too complicated, it may be difficult for the imaging unit to recognize the marker 280, so it is desirable that the shape is relatively simple. A color that is easily distinguishable from the surroundings may be adopted as the color of the marker 280. The size of the marker 280 may be determined in consideration of the ease of recognition by the imaging unit and the adverse effects of placing the marker 280 on a boundary member. For example, when the marker 280 is placed on the windshield or rear window of a vehicle, a size that is easy for the imaging unit to recognize is selected within a range that does not interfere with driving, etc.

[0034] Marker 280 may be a marker that can identify device 200 by at least one of color and shape. That is, multiple markers installed on multiple devices may be distinguishable by differences in color and shape. This allows the marker to have a function of making the imaging unit easily detectable and a function of making the device identifiable, thereby increasing its usefulness.

[0035] The number of markers 280 arranged on the imaging unit 202 is not limited to one, and multiple markers 280 may be arranged. When multiple markers 280 are arranged, for example, when the object 10 and the object 20 are vehicles and the lateral positional relationship is shifted, the amount of shift can be identified. Furthermore, compared to the case where only one marker 280 is arranged, erroneous detection of the marker 280 can be reduced by arranging multiple markers 280.

[0036] 3 is a schematic diagram of an example of an image 120 captured by the imaging unit 102. The device 100 detects a marker 280 from the captured image 120. The device 100 identifies a marker center 124 of the marker 280 in the captured image 120. The device 100 controls the gimbal 106 so that the image center 122 of the captured image 120 overlaps with the marker center 124. This causes the imaging direction of the imaging unit 102 to face the imaging unit 202, and as a result, the communication direction of the wireless communication unit 104 to face the wireless communication unit 204.

[0037] Fig. 4 shows another example of the positional relationship between the imaging unit 202 and the marker 280. In the example shown in Fig. 4, the marker 280 is disposed so that the center of the lens of the imaging unit 202 is located at the center position of a box (sometimes referred to as a mirror bounding box 132) that is mirror-transformed based on the sides of the bounding box 130 of the marker 280.

[0038] 4, the device 100 detects the marker 280 from the image captured by the imaging unit 102, identifies the bounding box 130, and identifies the marker center 124. The device 100 identifies a mirror bounding box 132 that is a mirror transformation of the bounding box 130 based on the bottom side of the bounding box 130, and identifies the center of the imaging unit 202.

[0039] 4 is an example, and the marker 280 may be disposed in any positional relationship as long as the position of the image capturing unit 202 can be identified from the position of the marker 280. For example, the marker 280 may be disposed such that the center of the lens of the image capturing unit 202 is located at the center position of a box obtained by mirror transformation based on the top side, left side, or right side of the bounding box 130 of the marker 280. The marker 280 may be disposed in a positional relationship that allows the position of the image capturing unit 202 to be identified by a method other than mirror transformation.

[0040] The marker 280 may be disposed outside the boundary member 22 at a position that is shifted from the position of the boundary member 22 that is closest to the imaging unit 202. In particular, the marker 280 may be disposed outside the adjustment range of the imaging direction of the imaging unit 202 that is adjusted by the gimbal 206. In this way, even if the marker 280 is disposed at a position that is shifted from the imaging unit 202, the position of the imaging unit 202 can be identified from the marker 280 as long as the device 100 side understands according to what rule the marker 280 is disposed.

[0041] If the marker 280 were located within the adjustment range of the imaging direction of the imaging unit 202 adjusted by the gimbal 206, the marker 280 would block the field of view of the imaging unit 202 when the imaging unit 202 faces an oblique direction, as exemplified in Fig. 5. In contrast, by locating the marker 280 outside the adjustment range of the imaging direction of the imaging unit 202 adjusted by the gimbal 206, it is possible to prevent the marker 280 from blocking the field of view of the imaging unit 202.

[0042] Fig. 6 shows a schematic example of the light absorbing material 282. The wireless communication system 1 may further include a light absorbing material 282 arranged around the marker 280, as shown in Fig. 6. The light absorbing material 282 can suppress whiteout of the marker 280 caused by external light, and can improve the visibility of the marker 280. The wireless communication system 1 may further include a light absorbing material (not shown) arranged around the marker 180.

[0043] 7 shows an example of a schematic functional configuration of the device 100. The device 100 includes an imaging unit 102, a wireless communication unit 104, a gimbal 106, a marker detection unit 110, an imaging unit detection unit 112, a gimbal control unit 114, and a communication control unit 116. Here, a case will be mainly described as an example in which the device 100 is placed inside an object 10 and the communication partner is a device 200 placed inside an object 20.

[0044] The marker detection unit 110 detects the marker 280 of the communication partner from the captured image captured by the imaging unit 102.

[0045] The imaging unit detection unit 112 detects the imaging unit 202 based on the marker 280 detected by the marker detection unit 110. The imaging unit detection unit 112 detects the imaging unit 202 based on, for example, a position obtained by converting the center position of a bounding box of the marker 280 detected by the marker detection unit 110 using a predetermined conversion method based on the positional relationship between the imaging unit 202 and the marker 280 with the bounding box as a reference.

[0046] The gimbal control unit 114 controls the gimbal 106 based on the detection result by the imaging unit detection unit 112 so that the imaging direction of the imaging unit 102 faces the imaging unit 202 .

[0047] The communication control unit 116 controls communication by the wireless communication unit 104. When the imaging direction of the imaging unit 102 faces the imaging unit 202 as a result of control of the gimbal 106 by the gimbal control unit 114, the communication control unit 116 may start wireless communication by the wireless communication unit 104.

[0048] When the marker 280 is a marker that can identify the device 200 by at least one of a color and a shape, the marker detection unit 110 may identify the device 200 by analyzing the marker 280. For example, when the analysis result of the marker 280 by the marker detection unit 110 is the device 200, the imaging unit detection unit 112 executes detection of the imaging unit 202 using the marker 280. This makes it possible to prevent erroneous detection of the imaging unit of the other device when, for example, the marker 280 of the device 200 and a marker of another device are included within the imaging range of the imaging unit 102.

[0049] 8 illustrates an example of a functional configuration of the device 200. The device 200 includes an imaging unit 202, a wireless communication unit 204, a gimbal 206, a marker detection unit 210, an imaging detection unit 212, a gimbal control unit 214, and a communication control unit 216.

[0050] The marker detection unit 210, like the marker detection unit 110, detects the marker 180 of the communication partner from the captured image captured by the imaging unit 202. The imaging unit detection unit 212, like the imaging unit detection unit 112, detects the imaging unit 102 based on the marker 180 detected by the marker detection unit 210. The gimbal control unit 214, like the gimbal control unit 114, controls the gimbal 206 based on the detection result by the imaging unit detection unit 212 so that the imaging direction of the imaging unit 202 faces the imaging unit 102. The communication control unit 216, like the communication control unit 116, controls communication by the wireless communication unit 204.

[0051] 9 shows an example of a process flow by the device 100. Here, a process from when the communication device 100 and the communication device 200 are not performing wireless communication to when they start wireless communication will be described. It is assumed that each of the imaging unit 102 and the imaging unit 202 performs imaging continuously, periodically, or irregularly. Also, here, for example, the process contents on the device 100 side in wireless communication between the device 100 and the device 200 will be described.

[0052] In step (sometimes abbreviated to S) 102, the imaging unit 102 captures an image of the outward direction of the object 10 through the boundary member 12. In S104, the marker detection unit 110 executes a detection process for the marker 280 using the image captured by the imaging unit 102. If the marker is detected (YES in S104), the process proceeds to S106, and if the marker 280 is not detected (NO in S104), the process returns to S102.

[0053] In S106, the imaging unit detection unit 112 detects the imaging unit 202 based on the marker 280. In S108, the gimbal control unit 114 controls the gimbal 106 based on the detection result in S106. The gimbal control unit 114 controls the gimbal 106 so that the imaging direction of the imaging unit 102 faces the imaging unit 202.

[0054] In S110, in response to the end of the control of the gimbal 106 in S108, the communication control unit 116 starts wireless communication using the wireless communication unit 104 and the wireless communication unit 204.

[0055] After starting wireless communication, the apparatus 100 and the apparatus 200 may continue to adjust with each other. The apparatus 100 and the apparatus 200 may alternately perform adjustment by transmitting notification data to each other. For example, the apparatus 100 first controls the gimbal 106, and transmits notification data to the apparatus 200 after completing the control. The apparatus 200 does not control the gimbal 106 until it receives the notification data. Having received the notification data, the apparatus 200 controls the gimbal 206. After adjustment, the apparatus 200 transmits the notification data to the apparatus 100.

[0056] 10 illustrates an example of a wireless power feeding system 2. The wireless power feeding system 2 performs directional wireless power feeding. The wireless power feeding system 2 includes an apparatus 300 and an apparatus 400. The apparatus 300 may be an example of a first apparatus. The apparatus 400 may be an example of a second apparatus.

[0057] The device 300 is disposed within the object 10. The object 10 includes a boundary member 12. The device 400 is disposed within the object 20. The object 20 includes a boundary member 22. The device 300 and the device 400 perform directional wireless power supply via the boundary member 12 and the boundary member 22. The boundary member 12 and the boundary member 22 may be any member as long as they do not block directional wireless power supply between the device 100 and the device 200. The boundary member 12 and the boundary member 22 may be a member that transmits a part of the incident light or incident wave and reflects a part of it. The boundary member 12 and the boundary member 22 are, for example, window glass. The boundary member 12 and the boundary member 22 are, for example, an acrylic plate. The boundary member 12 and the boundary member 22 are, for example, a plastic plate. These are examples, and the boundary member 12 and the boundary member 22 may be other members that do not block directional wireless power supply.

[0058] Two devices 300 may be disposed on the object 10. For example, a device 300 may be disposed on each of the rear window side and the windshield side of the object 10. Two devices 400 may also be disposed on the object 20. For example, a device 400 may be disposed on each of the rear window side and the windshield side of the object 20.

[0059] The device 300 includes an imaging unit 302, a wireless power receiving unit 304, and a gimbal 306. The imaging unit 302 may be an example of a first imaging unit. The wireless power receiving unit 304 performs wireless power reception. In this embodiment, the term "power reception" indicates that at least one of power reception and power supply can be performed. That is, the wireless power receiving unit 304 may be capable of wireless power supply and wireless power reception, may be capable of only wireless power supply, or may be capable of only wireless power reception. When the wireless power receiving unit 304 is capable of only wireless power supply, the wireless power receiving unit 404 may be capable of wireless power reception. When the wireless power receiving unit 304 is capable of only wireless power reception, the wireless power receiving unit 404 may be capable of wireless power supply. The wireless power receiving unit 304 may be an example of a second wireless power receiving unit. The gimbal 306 may be an example of a first gimbal.

[0060] The imaging unit 302 and the wireless power receiving unit 304 are mounted on a gimbal 306. The imaging unit 302 and the wireless power receiving unit 304 are installed with respect to the gimbal 306 so that the imaging direction of the imaging unit 302 coincides with the wireless power receiving direction of the wireless power receiving unit 304. The orientations of both the imaging unit 302 and the wireless power receiving unit 304 are adjusted by the gimbal 306. The imaging unit 302 and the wireless power receiving unit 304 are arranged so that the imaging unit 302 captures an image in the outward direction of the object 10 via the boundary member 12, and the wireless power receiving unit 304 receives power in the outward direction of the object 10 via the boundary member 12.

[0061] The device 400 includes an imaging unit 402, a wireless power receiving unit 404, and a gimbal 406. The imaging unit 402 may be an example of a second imaging unit. The wireless power receiving unit 404 may be an example of a second wireless power receiving unit. The gimbal 406 may be an example of a second gimbal.

[0062] The imaging unit 402 and the wireless power receiving unit 404 are mounted on a gimbal 406. The imaging unit 402 and the wireless power receiving unit 404 are installed with respect to the gimbal 406 so that the imaging direction of the imaging unit 402 and the wireless power receiving direction of the wireless power receiving unit 404 coincide with each other. The orientations of both the imaging unit 402 and the wireless power receiving unit 404 are adjusted by the gimbal 406. The imaging unit 402 and the wireless power receiving unit 404 are arranged so that the imaging unit 402 captures an image of the outward direction of the object 20 via the boundary member 22, and the wireless power receiving unit 404 receives power from the outward direction of the object 20 via the boundary member 22.

[0063] The imaging unit 302 and the wireless power receiving unit 304, and the imaging unit 402 and the wireless power receiving unit 404 are arranged so that the imaging direction of the imaging unit 302 and the imaging direction of the imaging unit 402 coincide with each other, and thereby the power receiving direction of the wireless power receiving unit 304 and the power receiving direction of the wireless power receiving unit 404 coincide with each other.

[0064] In this embodiment, the marker 380 is disposed on the outside of the boundary member 12, not on the imaging unit 302. The marker 380 may be the same as the marker 280. The marker 380 is disposed at a position corresponding to the imaging unit 302. The marker 380 is disposed at a position according to a predetermined rule with respect to the imaging unit 402. This makes it possible to detect the position of the imaging unit 302 from the position of the marker 380. For example, the marker 380 is disposed in front of the imaging unit 302. For example, the marker 380 is disposed at a position slightly shifted from the front of the imaging unit 302. For example, the marker 380 is disposed outside the adjustment range of the imaging direction of the imaging unit 302 adjusted by the gimbal 306. The marker 380 is, for example, a sticker, and is attached to the outside of the boundary member 12. The installation of the marker 380 on the boundary member 12 is not limited to attachment, and may be performed by any method. The material of the marker 380 may be a reflective material. The marker 480, like the marker 380, is disposed on the outside of the boundary member 22. The material of the marker 480 may be a reflective material.

[0065] The device 300 detects the marker 480 from an image captured by the imaging unit 302. The marker 480 may be similar to the marker 280. The device 300 detects the imaging unit 402 based on the detected marker 480. The device 300 controls the gimbal 306 based on the detection result of the imaging unit 402 so that the imaging direction of the imaging unit 302 faces the imaging unit 402. This allows the power receiving direction of the wireless power supply receiving unit 304 to be aligned with the wireless power supply receiving unit 404.

[0066] Like the device 300, the device 400 detects the marker 380 from an image captured by the imaging unit 402. The device 400 detects the imaging unit 302 based on the detected marker 380. The device 400 controls the gimbal 406 based on the detection result of the imaging unit 302 so that the imaging direction of the imaging unit 402 faces the imaging unit 302.

[0067] 11 shows an example of a schematic functional configuration of the device 300. The device 300 includes an imaging unit 302, a wireless power supply / reception unit 304, a gimbal 306, a marker detection unit 310, an imaging unit detection unit 312, a gimbal control unit 314, and a power supply / reception control unit 316. Here, the case where the device 300 is placed inside the object 10 and the power receiving partner is a device 400 placed inside the object 20 will be mainly described as an example.

[0068] The marker detection unit 310, like the marker detection unit 110, detects the marker 480 of the power supply partner from the captured image captured by the imaging unit 302. The imaging unit detection unit 312, like the imaging unit detection unit 112, detects the imaging unit 402 based on the marker 480 detected by the marker detection unit 310. The gimbal control unit 314, like the gimbal control unit 114, controls the gimbal 306 based on the detection result by the imaging unit detection unit 312 so that the imaging direction of the imaging unit 302 faces the imaging unit 402.

[0069] The power supply / reception control unit 316 controls power supply / reception by the wireless power supply / reception unit 304. The power supply / reception control unit 316 may start wireless power supply / reception by the wireless power supply / reception unit 304 in response to the imaging direction of the imaging unit 302 being oriented toward the imaging unit 402 as a result of control of the gimbal 306 by the gimbal control unit 314.

[0070] 12 illustrates an example of a functional configuration of the device 400. The device 400 includes an image capture unit 402, a wireless power supply / reception unit 404, a gimbal 406, a marker detection unit 410, an image capture unit detection unit 412, a gimbal control unit 414, and a power supply / reception control unit 416.

[0071] The marker detection unit 410, like the marker detection unit 310, detects the marker 380 of the power supply partner from the captured image captured by the imaging unit 402. The imaging unit detection unit 412, like the imaging unit detection unit 312, detects the imaging unit 302 based on the marker 380 detected by the marker detection unit 410. The gimbal control unit 414, like the gimbal control unit 314, controls the gimbal 406 based on the detection result by the imaging unit detection unit 412 so that the imaging direction of the imaging unit 402 faces the imaging unit 302. The power supply and reception control unit 416, like the power supply and reception control unit 316, controls the power supply and reception by the wireless power supply and reception unit 404.

[0072] 13 is a schematic diagram showing an example of a hardware configuration of a computer 1200 functioning as the device 100, the device 200, the device 300, or the device 400. The computer 1200 according to this embodiment includes a CPU 1212, a RAM 1214, and a graphic controller 1216, which are connected to each other by a host controller 1210. The computer 1200 also includes input / output units such as a communication interface 1222, a storage device 1224, a DVD drive, and an IC card drive, which are connected to the host controller 1210 via the input / output controller 1220. The DVD drive may be a DVD-ROM drive, a DVD-RAM drive, or the like. The storage device 1224 may be a hard disk drive, a solid state drive, or the like. The computer 1200 also includes a legacy input / output unit such as a ROM 1230 and a keyboard, which are connected to the input / output controller 1220 via an input / output chip 1240.

[0073] The CPU 1212 operates according to a program stored in the ROM 1230 and the RAM 1214, thereby controlling each unit. The graphic controller 1216 retrieves image data generated by the CPU 1212 into a frame buffer or the like provided in the RAM 1214 or into itself, and causes the image data to be displayed on the display device 1218.

[0074] The communication interface 1222 communicates with other electronic devices via a network. The storage device 1224 stores programs and data used by the CPU 1212 in the computer 1200. The DVD drive reads programs or data from a DVD-ROM or the like and provides them to the storage device 1224. The IC card drive reads programs and data from an IC card and / or writes programs and data to an IC card.

[0075] The ROM 1230 stores therein a boot program or the like that is executed by the computer 1200 upon activation, and / or a program that depends on the hardware of the computer 1200. The input / output chip 1240 may also connect various input / output units to the input / output controller 1220 via a USB port, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

[0076] The programs are provided by a computer-readable storage medium such as a DVD-ROM or an IC card. The programs are read from the computer-readable storage medium, installed in the storage device 1224, the RAM 1214, or the ROM 1230, which are also examples of computer-readable storage media, and executed by the CPU 1212. Information processing described in these programs is read by the computer 1200, and brings about cooperation between the programs and the various types of hardware resources described above. An apparatus or method may be constructed by implementing operations or processing of information according to the use of the computer 1200.

[0077] For example, when communication is performed between the computer 1200 and an external device, the CPU 1212 may execute a communication program loaded in the RAM 1214 and instruct the communication interface 1222 to perform communication processing based on the processing described in the communication program. Under the control of the CPU 1212, the communication interface 1222 reads transmission data stored in a transmission buffer area provided in the RAM 1214, the storage device 1224, a DVD-ROM, or a recording medium such as an IC card, and transmits the read transmission data to a network, or writes reception data received from the network to a reception buffer area or the like provided on the recording medium.

[0078] Furthermore, the CPU 1212 may cause all or a necessary portion of a file or database stored in an external recording medium such as the storage device 1224, a DVD drive (DVD-ROM), an IC card, etc. to be read into the RAM 1214, and perform various types of processing on the data on the RAM 1214. The CPU 1212 may then write back the processed data to the external recording medium.

[0079] Various types of information, such as various types of programs, data, tables, and databases, may be stored in the recording medium and undergo information processing. The CPU 1212 may perform various types of processing on the data read from the RAM 1214, including various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, information search / replacement, etc., as described throughout this disclosure and specified by the instruction sequence of the program, and write back the results to the RAM 1214. The CPU 1212 may also search for information in a file, database, etc. in the recording medium. For example, when a plurality of entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored in the recording medium, the CPU 1212 may search for an entry whose attribute value of the first attribute matches a specified condition from among the plurality of entries, read the attribute value of the second attribute stored in the entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.

[0080] The above-described programs or software modules may be stored in a computer-readable storage medium on the computer 1200 or in the vicinity of the computer 1200. In addition, a recording medium such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, thereby providing the programs to the computer 1200 via the network.

[0081] The blocks in the flowcharts and block diagrams in the present embodiment may represent stages of a process in which an operation is performed or "parts" of an apparatus responsible for performing the operation. Particular stages and "parts" may be implemented by dedicated circuitry, programmable circuitry provided with computer-readable instructions stored on a computer-readable storage medium, and / or a processor provided with computer-readable instructions stored on a computer-readable storage medium. The dedicated circuitry may include digital and / or analog hardware circuits, and may include integrated circuits (ICs) and / or discrete circuits. The programmable circuitry may include reconfigurable hardware circuits, such as, for example, field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), and the like, including AND, OR, XOR, NAND, NOR, and other logical operations, flip-flops, registers, and memory elements.

[0082] A computer-readable storage medium may include any tangible device capable of storing instructions that are executed by a suitable device, such that a computer-readable storage medium having instructions stored thereon comprises an article of manufacture that includes instructions that can be executed to create means for performing the operations specified in the flowcharts or block diagrams. Examples of computer-readable storage media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, etc. More specific examples of computer-readable storage media may include floppy disks, diskettes, hard disks, random access memories (RAMs), read-only memories (ROMs), erasable programmable read-only memories (EPROMs or flash memories), electrically erasable programmable read-only memories (EEPROMs), static random access memories (SRAMs), compact disk read-only memories (CD-ROMs), digital versatile disks (DVDs), Blu-ray disks, memory sticks, integrated circuit cards, etc.

[0083] The computer readable instructions may include either assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk®, JAVA®, C++, etc., and conventional procedural programming languages ​​such as the “C” programming language or similar programming languages.

[0084] Computer readable instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, or to a programmable circuit, either locally or over a local area network (LAN), a wide area network (WAN), such as the Internet, etc., to cause the processor of the general purpose computer, special purpose computer, or other programmable data processing apparatus, or to a programmable circuit, to execute the computer readable instructions to generate means for performing the operations specified in the flowcharts or block diagrams. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, etc.

[0085] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It is clear to those skilled in the art that various modifications and improvements can be made to the above embodiments. It is clear from the description of the claims that such modifications and improvements can also be included in the technical scope of the present invention.

[0086] It should be noted that the order of execution of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not specifically stated as "before" or "prior to," and that the process may be performed in any order unless the output of a previous process is used in a later process. Even if the operational flow in the claims, specifications, and drawings is described using "first," "next," etc. for convenience, it does not mean that the process must be performed in this order. [Explanation of symbols]

[0087] 1 wireless communication system, 10 object, 12 boundary member, 20 object, 22 boundary member, 100 device, 102 imaging unit, 104 wireless communication unit, 106 gimbal, 110 marker detection unit, 112 imaging unit detection unit, 114 gimbal control unit, 116 communication control unit, 120 captured image, 122 image center, 124 marker center, 130 bounding box, 132 mirror bounding box, 180 marker, 200 device, 202 imaging unit, 204 wireless communication unit, 206 gimbal, 210 marker detection unit, 212 imaging unit detection unit, 214 gimbal control unit, 216 communication control unit, 280 marker, 282 light absorbing material, 300 device, 302 imaging unit, 304 wireless power supply unit, 306 gimbal, 310 Marker detection unit, 312, imaging unit detection unit, 314, gimbal control unit, 316, power supply control unit, 380, marker, 400, device, 402, imaging unit, 404, wireless power supply control unit, 406, gimbal, 410, marker detection unit, 412, imaging unit detection unit, 414, gimbal control unit, 416, power supply control unit, 480, marker, 1200, computer, 1210, host controller, 1212, CPU, 1214, RAM, 1216, graphic controller, 1218, display device, 1220, input / output controller, 1222, communication interface, 1224, storage device, 1230, ROM, 1240, input / output chip

Claims

1. A wireless communication system that performs directional wireless communication, a first device having a first imaging unit and a first wireless communication unit mounted on a first gimbal; a second device having a second imaging unit and a second wireless communication unit mounted on a second gimbal, the second device being disposed within an object including a boundary member; A marker disposed outside the boundary member; Equipped with the second imaging unit and the second wireless communication unit are arranged such that the second imaging unit captures an image of an outer side of the object through the boundary member, and the second wireless communication unit communicates with the outer side of the object through the boundary member; The first device is a first marker detection unit that detects the marker from an image captured by the first imaging unit; a first imaging unit detection unit that detects the second imaging unit based on the marker detected by the first marker detection unit; a first gimbal control unit that controls the first gimbal based on a detection result by the first imaging unit detection unit so that an imaging direction of the first imaging unit faces the second imaging unit; A wireless communication system comprising:

2. The wireless communication system according to claim 1 , wherein the marker is disposed outside the boundary member and outside an adjustment range of the imaging direction of the second imaging section that is adjusted by the second gimbal.

3. The wireless communication system according to claim 1 , wherein the marker is arranged outside the boundary member and at a position shifted from a position on the boundary member that is closest to the second imaging unit.

4. 4. The wireless communication system according to claim 2, wherein the first imaging unit detection unit detects the second imaging unit based on a position obtained by converting a center position of a bounding box of the marker detected by the first marker detection unit using a predetermined conversion method based on a positional relationship between the second imaging unit and the marker with the bounding box as a reference.

5. The wireless communication system according to claim 1 , further comprising a light absorbing material disposed around the marker.

6. The wireless communication system according to claim 1 , wherein the marker is capable of identifying the second device by at least one of a color and a shape.

7. the second device is disposed within a second object that includes the boundary member; the first device is disposed within a first object that includes a boundary member; The wireless communication system includes: a first marker disposed outside the boundary member of the first object; a second marker disposed outside the boundary member of the second object; Equipped with The second device is a second marker detection unit that detects the first marker from an image captured by the second imaging unit; a second imaging unit detection unit that detects the first imaging unit based on the first marker detected by the second marker detection unit; a second gimbal control unit that controls the second gimbal based on a detection result by the second imaging unit detection unit so that an imaging direction of the second imaging unit faces the first imaging unit; A wireless communication system according to claim 1 , comprising:

8. the first device is located in a first vehicle; the second device is located in a second vehicle; the first marker is disposed on a windshield of the first vehicle; the second marker is disposed on a rear window of the second vehicle; The wireless communication system according to claim 7 , wherein the first device and the second device perform vehicle-to-vehicle communication using the first wireless communication unit and the second wireless communication unit.

9. A wireless power feeding system that performs directional wireless power feeding, a first device having a first imaging unit and a first wireless power supply / reception unit mounted on a first gimbal; a second device having a second imaging unit and a second wireless power supply unit mounted on a second gimbal, the second device being disposed within an object including a boundary member; A marker disposed outside the boundary member; Equipped with the second imaging unit and the second wireless power receiving unit are arranged such that the second imaging unit captures an image of the outside of the object through the boundary member and the second wireless power receiving unit receives power from the outside of the object through the boundary member; The first device is a first marker detection unit that detects the marker from an image captured by the first imaging unit; a first imaging unit detection unit that detects the second imaging unit based on the marker detected by the first marker detection unit; a first gimbal control unit that controls the first gimbal based on a detection result by the first imaging unit detection unit so that an imaging direction of the first imaging unit faces the second imaging unit; A wireless power supply system comprising:

Citation Information

Patent Citations

  • Terminal device and control method thereof, communication system, communication method, communication program, and recording medium

    JP2009177637A

  • Tag recognition system, tag recognition device, and tag recognition method

    JP2011192236A

  • Droplet discharger inspection device and droplet supply device

    JP2016045147A

  • Optical space communication system and optical space communication method

    WO2021001885A1