Image system and imaging apparatus

Abstract

In the present invention, an image system comprises a camera for capturing images, and a display device for displaying the images captured by the camera. The camera has an imaging element for capturing images, and an image processing unit for processing the images captured by the imaging element. The image processing unit outputs a plurality of images having different capturing ranges.

Description

[0002] The present disclosure relates to an image system. Background

[0003] An IP-based CCTV system encodes images captured by an IP camera in H264 / MPEG4 / JPEG or the like, and then decodes the images received by a server or the like and displays the images on a monitor. Compared to an analog CCTV system, the IP-based CCTV system is advantageous in that it is possible to select image resolution or frame rate, and simplify wiring by transmitting a plurality of images through a single cable. Therefore, the IP-based CCTV system is used in an on-board surveillance system for railways, which has a limited installation space. The on-board surveillance system is used to check the safety of a plurality of boarding and alighting doors using surveillance cameras in order to realize unmanned train operations. Hence, the display area of one monitor is divided and surveillance images of the plurality of boarding and alighting doors are displayed to confirm safety.

[0004] The following prior art will be described as the background technique of this technical field. For example, Patent Document 1 (Japanese Patent Laid-open Publication No. 2018-113602) discloses a surveillance system in which a train is equipped with a camera that captures at least the vicinity of the doors of the cars of the train and a monitor that displays the camera images captured by the camera. The camera is provided for each of a plurality of doors on both sides of the car, and the display area of the monitor is divided into a plurality of areas. The surveillance system includes a display control part for performing control in which the plurality of camera images captured by the cameras of the cars are allocated to the respective areas and displayed. The display control part controls the allocation of the camera images for each area based on information indicating the direction in which the train is traveling and information indicating the side on which the door opens. Summary Problems to Be Resolved by the Invention

[0005] In-vehicle surveillance systems use a plurality of cameras to capture surveillance images, but each camera outputs only one image. Therefore, nearby objects may be framed out of the field of view or distant objects may appear smaller and be unlikely to be seen. In particular, the display area of the surveillance monitor installed in the driver's seat is divided into a plurality of areas, and images of a plurality of boarding and alighting doors are displayed in the respective areas to monitor passengers getting on and off near the doors when the vehicle is stopped.

[0006] However, a single-chip camera with one imaging element is usually attached to the side of the vehicle. When the vehicle is long or a plurality of doors are monitored, objects near the camera may be framed out of the field of view or objects far from the camera may appear smaller, which makes it difficult to obtain the required information.

[0007] The present disclosure aims to provide an image system that can accurately monitor both objects near the camera and objects distant from the camera. Means for Solving the Problems

[0008] A representative example of the present disclosure will be described as follows. An image system comprises a camera configured to capture images, and a display device configured to display the images captured by the camera, wherein the camera has an imaging element configured to capture images and an image processing part configured to process the images captured by the imaging element, and the image processing part is configured to output a plurality of images having different capturing ranges.

[0009] Further, in the image system according to an example of the present disclosure, the camera has a plurality of the imaging elements and a plurality of lenses respectively provided in front of the plurality of imaging elements, the plurality of lenses have different focal lengths so that the capturing ranges are different, and the image processing part is configured to output a plurality of images with different angles of view which are captured by the plurality of imaging elements.

[0010] Further, in the image system according to an example of the present disclosure, the display device is configured to display, side by side, a plurality of images with different capturing ranges outputted from the camera.

[0011] Further, in the image system according to an example of the present disclosure, the display device is configured to selectively display one of the plurality of images with different capturing ranges outputted from the camera.

[0012] Further, in the image system according to an example of the present disclosure, the image processing part is configured to combine a plurality of images with different capturing ranges into one image and output the combined image.

[0013] Further, an imaging apparatus for capturing images according to an example of the present disclosure comprises an imaging element configured to capture images, and an image processing part configured to process the images captured by the imaging element, wherein the image processing part is configured to output a plurality of images with different capturing ranges. Effect of the Invention

[0014] In accordance with one aspect of the present disclosure, a plurality of images with different capturing ranges are outputted from the camera, so that the capturing range of nearby objects can be widened and distant objects can be captured in large size. Problems, configurations, and effects other than those described above will be clarified by the following description of the embodiment for implementing the present disclosure. Brief Description of the Drawings

[0015] FIG. 1 is a diagram showing an overview of an image system of an embodiment of the present disclosure. FIG. 2 is a diagram showing a configuration of the image system of the present embodiment. FIG. 3 is a diagram showing a configuration of a camera of the present embodiment. FIG. 4 is a diagram showing an image displayed on a surveillance monitor in a conventional image system. FIG. 5 is a diagram showing an image captured by a camera in a leading car in the conventional image system. FIG. 6 is a diagram showing an image displayed on a surveillance monitor in the image system of the present embodiment. FIG. 7 is a diagram showing a telephoto image captured by a camera in the leading car in the image system of the present embodiment. FIG. 8 is a diagram showing a wide-angle image captured by a camera in the leading car in the image system of the present embodiment. Detailed Description

[0016] An embodiment of the present disclosure will be described with reference to the drawings.

[0017] FIG. 1 is a diagram showing an overview of an image system according to an embodiment of the present disclosure.

[0018] The image system of the present embodiment is implemented in a three-car train including a leading car 1, a middle car 2, and a trailing car 3.

[0019] Each of the leading car 1, the middle car 2, and the trailing car 3 has two doors 7 to 12 on one side, and passengers get on and off the car through the doors 7 to 12. Cameras 4 to 6 are provided on the side surface of each of the cars 1 to 3 to monitor passengers getting on and off through the doors 7 to 12. As shown in FIG. 1, in the present embodiment, one camera is provided for one car, and one camera monitors passengers getting on and off through two doors. The cameras 4 to 6 are provided near the leading car of each car, but may be provided near the trailing car.

[0020] Surveillance monitors 13 and 14 are provided at the driver's cabs of the leading car 1 and the trailing car 3. The surveillance monitors 13 and 14 are display devices that display images captured by the cameras 4 to 6. The crew can check the images captured by the cameras 4 to 6 using the surveillance monitors 13 and 14. In the illustrated example, passengers 31 to 35 exist at the platform where the train is stopped.

[0021] FIG. 2 is a diagram showing the configuration of the image system of the present embodiment.

[0022] The leading car 1 is provided with an image server 19, a recording device 18, a host server 20, the surveillance monitor 13, and a camera 4, which are connected by a network device (e.g., an L2 switch) 15. The network that connects these devices may be configured as a wired network, or may be partially or entirely configured as a wireless network.

[0023] The image server 19 is a control device that performs image processing such as switching of images captured by the cameras 4 to 6 and displaying the images on the surveillance monitors 13 and 14. The recording device 18 records the images captured by the cameras 4 to 6 in a non-volatile recording medium, if required. The crew can display the images recorded in the recording device 18 by operating the operation panel provided on the surveillance monitors 13 and 14. If trouble occurs, the images recorded in the recording device 18 are used to investigate the cause of the trouble.

[0024] The host server 20 is a control device that controls the operation of the train. In the present embodiment, the image server 19 acquires the train status (e.g., running status, or door opening / closing status) from the host server 20. For example, when a door opening signal is received from the host server 20, the image server 19 controls the surveillance monitors 13 and 14 to display the images of the doors. In addition, when a departure signal (over 5 km / h signal) is received from the host server 20, the image server 19 erases the images of the doors from the surveillance monitors 13 and 14.

[0025] The surveillance monitor 13 has a display part that displays the images captured by the cameras 4 to 6 and an operation part for issuing instructions to the image server 19. The operation part may be configured as a touch panel, and the operation part and the display part may be integrated. The surveillance monitor 13 is not limited to a display device installed in the driver's cab, and may be a portable terminal device carried by the crew.

[0026] The camera 4 is installed on the side surface of the leading car 1, and captures images of passengers getting on and off through two doors 7 and 8. The configuration of the camera 4 will be described later with reference to FIG. 3.

[0027] The surveillance monitor 14 and the camera 6 are installed in the trailing car 3, and are connected by a network device (e.g., an L2 switch) 17. The network that connects these devices may be configured as a wired network, or may be partially or entirely configured as a wireless network.

[0028] The surveillance monitor 14 has the same configuration as that of the surveillance monitor 13, and has a display part that displays images captured by the cameras 4 to 6, and an operation part for issuing instructions to the image server 19. The operation part may be configured as a touch panel, and the operation part and the display part may be integrated. The surveillance monitor 14 is not limited to a display device installed in the driver's cab, but may be a portable terminal device carried by the crew.

[0029] The camera 6 is installed on the side surface of the trailing car 3, and captures images of passengers getting on and off through two doors 11 and 12. The configuration of the camera 6 is the same as that of camera 4, and will be described later with reference to FIG. 3.

[0030] The camera 5 is installed in the middle car 2, and is connected to a network device (e.g., an L2 switch) 16.

[0031] The camera 5 is installed on the side surface of the middle car 2, and captures images of passengers getting on and off through two doors 9 and 10. The configuration of the camera 5 is the same as that of the camera 4, and will be described later with reference to FIG. 3.

[0032] The network devices 15, 16, and 17 are connected by a communication path 50 to form an in-train network.

[0033] FIG. 3 is a diagram showing the configuration of the camera 4 in the present embodiment. The camera 4 will be described in FIG. 3. The cameras 5 and 6 have the same configuration as that of the camera 4.

[0034] The camera 4 in the present embodiment is a dual-imager camera capable of outputting images via a network.

[0035] The camera 4 has two light receiving windows 81 and 82, and lenses 83 and 84 with different characteristics (e.g., different focal lengths) are provided in the light receiving windows 81 and 82, respectively. The lens 83 is a telephoto lens with a field of view ranging from 95 to 92, and captures the door 8 at a long distance. The lens 84 is a wide-angle lens with a field of view ranging from 93 to 94, and captures the door 7 at a close distance. Although the lenses 83 and 84 are each shown as single convex lenses, they are actually a combination of multiple lenses.

[0036] Light collected by the lens 83 is incident on an imaging element 85, and light collected by the lens 84 is incident on an imaging element 86. The imaging elements 85 and 86 capture images with different capturing ranges due to differences in the focal lengths and optical axis directions of the lenses 83 and 84. The imaging elements 85 and 86 generate raw image data (e.g., RAW data) by photoelectric conversion. Signal processing parts 87 and 88 perform signal processing such as noise removal from the raw image data or edge processing for clarifying contours, thereby generating image data.

[0037] An image processing part 89 cuts out the required area from the image data generated by the signal processing parts 87 and 88, or combines multiple images into one image and inputs the generated image to an encoder part 90. For example, the image processing part 89 generates an image 37 displayed in an area 25 shown in FIG. 7, which is obtained by cutting out the area around the door, or an image 38 displayed in an area 26 shown in FIG. 8, or generates one image by combining the images 37 and 38.

[0038] The encoder part 90 converts the image data into a predetermined data format (e.g., JPEG / H.264), and outputs it to the network via a physical interface 91.

[0039] The image processing part 89 receives image data from the signal processing part 87 and image data from the signal processing part 88, i.e., two images with different capturing ranges, and controls whether to output only the image from the signal processing part 87, the image from the signal processing part 88, or both images, depending on the user's operation of the surveillance monitors 13 and 14. In the case of outputting two images, the image processing part 89 can select whether to output them as two independent images or to combine the two images and output one image. Since the two images are outputted from the same address, it is preferable to assign different port numbers to the transmission of the output image. Further, door identification information may be added to the two image data to identify the door shown in the image.

[0040] In the above example, the cameras 4, 5, and 6 are dual-imager cameras having two imaging elements 85 and 86. However, the cameras 4, 5, and 6 may output images with different angles of view. For example, the cameras 4, 5, and 6 may have one high-resolution imaging element, and may generate a plurality of images with different capturing ranges (for example, two images with different angles of view) from the image captured by the imaging element by digital zoom processing, and output the plurality of images thus generated. Further, an in-vehicle image system requires vibration resistance, and thus cannot adopt an optical zoom that moves a lens inside a lens barrel. Therefore, it is preferable to generate two images by digital zoom, instead of changing the magnification of the optical zoom to capture two images.

[0041] In FIG. 3, the configuration of the camera 4 is illustrated according to the flow of the image signal. However, the camera 4 has a control part (logic or CPU) that is not illustrated. The control part controls the operation of the imaging elements 85 and 86, the signal processing parts 87 and 88, the image processing part 89, and the encoder part 90.

[0042] In FIG. 3, the series including the lens 83, the imaging element 85, and the signal processing part 87 and the series including the lens 84, the imaging element 86, and the signal processing part 88 are arranged vertically. However, they may be arranged horizontally, because they are upside down when installed on the opposite side of the vehicle. In addition, the camera 4 has the light receiving window 81 on the right side and the light receiving window 82 on the right lower corner side, but the positions of the light receiving windows may be adjusted depending on the positions of the camera 4 and the door to be monitored.

[0043] In this manner, the camera 4 outputs the two images acquired by the signal processing parts 87 and 88 as one image or two images.

[0044] The camera 4 has been described above, and the cameras 5 and 6 have the same configuration as that of the camera 4. In other words, the camera 5 captures an image of the door 10 at a long distance with the lens 83, and captures an image of the door 9 at a short distance with the lens 84. Similarly, the camera 6 captures an image of the door 12 ata long distance with the lens 83, and captures an image of the door 11 at a short distance with the lens 84.

[0045] Next, the image outputted by the image system of the present embodiment will be described in comparison with the image outputted by the conventional image system.

[0046] FIG. 4 shows an image displayed on a monitor in the conventional image system, and FIG. 5 shows an image captured by the camera of the leading car 1 in the conventional image system. FIG. 6 shows an image displayed on a monitor in the image system of the present embodiment. FIG. 7 shows a telephoto image captured by the camera 4 in the leading car 1 in the image system of the present embodiment. FIG. 8 shows a wide-angle image captured by the camera 4 in the leading car 1 in the image system of the present embodiment.

[0047] In the conventional image system, in order to monitor passengers getting on and off when the train stops at a station, the images captured by the cameras are displayed side by side on the monitor of the leading car 1 or the trailing car 3. The monitor screen is divided into three parts as shown in FIG. 4, and an image 21 captured by the camera of the leading car 1, an image 22 captured by the camera of the middle car 2, and an image 23 captured by the camera 6 of the trailing car are displayed side by side. The image 21 captured by the camera in the leading car 1, which is displayed on the three-part image, is obtained by cutting out an image 36 captured by the camera in the leading car 1 shown in FIG. 5 in an area 24.

[0048] In the state shown in FIG. 1, the image of the leading car 1 displayed on the monitor of the conventional image system shows the passengers 31 and 32 getting on through the door 7, and the passenger 33 getting on through the door 8. Further, the image of the middle car 2 shows no passengers. The image of the trailing car 3 shows the passenger 34 getting off through the door 11, and the passenger 35 getting off through the door 12. However, the lower part of the passengers 31 and 32 from the waist near the door 7 and the lower part of the passenger 34 from the waist near the door 11 are in the blind spots that are not included in the image. Further, the passenger 33 near the door 8 and the passenger 35 near the door 12 appear smaller and are unlikely to be seen.

[0049] On the other hand, in the image system of the present embodiment, in order to monitor passengers getting on and off when the train stops at a station, the images captured by the cameras 4 to 6 are displayed side by side on the surveillance monitor 13 of the leading car 1 or the surveillance monitor 14 of the trailing car 3. The screens of the surveillance monitors 13 and 14 are divided into six parts as shown in FIG. 6, and a telephoto image 40 captured by the camera 4 of the leading car 1, a wide-angle image 41 captured by the camera 4 of the leading car 1, a telephoto image 42 captured by the camera 5 of the middle car 2, a wide-angle image 43 captured by the camera 5 of the middle car 2, a wide-angle image 44 captured by the camera 6 of the trailing car 3, and a telephoto image 45 captured by the camera 6 of the trailing car 3 are displayed side by side. The image 40 displayed on the six-split screen is obtained by cutting out the telephoto image 37 captured by the camera 4 of the leading car 1 shown in FIG. 7 in the area 25, and the image 41 is obtained by cutting out the wide-angle image 38 captured by the camera 4 of the leading car 1 shown in FIG. 8 in the area 26. The surveillance monitors 13 and 14 can display one image selected by the driver's operation, as shown in FIG. 7 or 8, in addition to the six-split image shown in FIG. 6.

[0050] The camera 4 cuts out the image 37 in the area 25 and cuts out the image 28 in the area 26, combines the two images into one image, and transfers it to the surveillance monitors 13 and 14 via the network. The other cameras 5 and 6 also process the captured images in the same manner, and transfer the combined one image to the surveillance monitors 13 and 14 via the network. The surveillance monitors 13 and 14 display the image shown in FIG. 6 by arranging the three images received from the cameras 4, 5, and 6 side by side. Although the example in which the cameras 4, 5, and 6 cut out the images and the surveillance monitors 13 and 14 combines the images has been described, the surveillance monitors 13 and 14 may cut out the images or combine the images, or the image server 19 may cut out the images or combine the images.

[0051] In the conventional image system, as shown in FIG. 4, the lower part of the passengers 31 and 32 from the waist near the door 7 and the lower part of the passenger 34 from the waist near the door 11 are blind spots that are not visible in the image. However, in the image system of the present embodiment, as shown in FIG. 6, the entire bodies of the passengers are captured, and there is almost no blind spot around the doors. In addition, in the conventional image system, as shown in FIG. 4, the passenger 33 at the door 8 and the passenger 35 at the door 12, which are far from the cameras, appear smaller. However, in the image system of the present embodiment, they are displayed in a large size and sufficient resolution, similarly to the images 40 and 44 shown in FIG. 6.

[0052] While the example in which the image system of the present disclosure is applied to the case of monitoring the boarding and disembarking of trains, the present disclosure is not limited to the case of monitoring the boarding and disembarking of trains, and can be applied to other systems that display images from a surveillance camera on a multi-split screen.

[0053] For example, in a pantograph monitoring system that captures a pantograph with a camera installed on the roof of a train, the entire pantograph is captured in the wide-angle image of the camera, and the friction plate in contact with the catenary is captured in the telephoto image of the camera. Accordingly, the operating state of the pantograph and the wear of the friction plate can be monitored simultaneously.

[0054] In addition, in a forward monitoring system that captures the direction of travel with a camera installed in the front of the train (e.g., in the driver's compartment), the coupling section between cars is captured in the wide-angle image of the camera, and the track in the direction of travel is captured in the telephoto image of the camera. Accordingly, the train approaching state or the coupling section state at the time of being connected to and separated from the front of the train can be monitored with one camera. Further, by capturing the driver's compartment (e.g., the driver's seat) with the wide-angle image of the camera and capturing the track in the direction of travel with the telephoto image, the train's front and the driver can be monitored simultaneously, and any abnormal situation that occurs to the driver can be identified.

[0055] In addition, in a passenger compartment monitoring system that captures the inside of a train's passenger compartment with a camera installed in the passenger compartment, the inside of the nearby passenger compartment is captured in the wide-angle image of the camera, and the inside of the distant passenger compartment is captured in the telephoto image of the camera. Hence, a wide area inside the vehicle can be captured with a sufficient resolution. Further, the nearby door is captured with the wide-angle image of the camera, and the distant door is captured in the telephoto image of the camera. Accordingly, the passengers getting on and off at multiple doors can be monitored simultaneously.

[0056] As described above, in accordance with the image system of the embodiment of the present disclosure, the wide-angle image at a close distance from the camera and the telephoto image at a long distance from the camera are captured, so that a wide area including blind spots that are outside the capturing range of a monocular camera can be captured, and a distant subject can be captured in a large size. In addition, since a plurality of lenses and a plurality of image sensors are provided in one camera, close images and distant images are captured by different image sensors, which makes it possible to realize both the wide-angle imaging over a wide range and the telephoto imaging of distant objects.

[0057] Further, the present disclosure is not limited to the embodiments described above, and includes various modifications and equivalent configurations within the spirit of the appended claims. For example, the embodiments have been described in detail in order to facilitate understanding of the present disclosure, but the present disclosure is not necessarily limited to the configurations having all of the described elements. Furthermore, a part of the configuration according to one embodiment may be replaced with the configuration of another embodiment. The configuration according to one embodiment may additionally include the configuration according to another embodiment. In addition, a part of the configuration according to each of the embodiments may be added, deleted, or replaced with another configuration.

[0058] In addition, a part or all of the above-described configurations, functions, processing parts, processing devices, and the like may be realized by hardware by, for example, designing with an integrated circuit, or may be realized by software by a processing part interpreting and executing a program for realizing the functions.

[0059] Information such as a program, a table, and a file for implementing these 5 functions may be stored in a storage device such as a memory, a hard disk, and a solid state drive (SSD), or a recording medium such as an IC card, an SD card, and a DVD.

[0060] In addition, the control lines and the information lines considered to be 10 necessary in the description are illustrated, and not all of the control lines and the information lines required in the implementation are illustrated. In practice, it may be considered that almost all of these configurations are connected to one another.

Claims

1. An image system comprising:a camera configured to capture images; anda display device configured to display the images captured by the camera, wherein the camera has an imaging element configured to capture images and an image processing part configured to process the images captured by the imaging element, andthe image processing part is configured to output a plurality of images having different capturing ranges.

2. The image system of claim 1, wherein the camera has a plurality of the imaging elements and a plurality of lenses respectively provided in front of the plurality of imaging elements,the plurality of lenses have different focal lengths so that the capturing ranges are different, andthe image processing part is configured to output a plurality of images with different angles of view which are captured by the plurality of imaging elements.

3. The image system of claim 1, wherein the display device is configured to display, side by side, a plurality of images with different capturing ranges outputted from the camera.

4. The image system of claim 3, wherein the display device is configured to selectively display one of the plurality of images with different capturing ranges outputted from the camera.

5. The image system of claim 1, wherein the image processing part is configured to combine a plurality of images with different capturing ranges into one image and output the combined image.

6. An imaging apparatus for capturing images, comprising:an imaging element configured to capture images; andan image processing part configured to process the images captured by the imaging element,wherein the image processing part is configured to output a plurality of images with different capturing ranges.

7. The imaging apparatus of claim 6, further comprising:a plurality of the imaging elements; anda plurality of lenses respectively provided in front of the plurality of imaging elements,wherein the plurality of lenses have different focal lengths so that the capturing ranges are different, andthe image processing part is configured to output a plurality of images with different angles of view which are captured by the plurality of imaging elements.INTERNATIONAL SEARCH REPORT International application No. PCT / JP2023 / 033342A. CLASSIFICATION OF SUBJECT MATTER H04N 7 / 1^(2006.01)i; B61K LW(2006.01)i; B61L 25 / «2(2006.01)i; l / 04W23 / 0(2023.01)i; BIW2W3(2023.01)i FI: H04N7 / 18 J; H04N7 / 18 E; H04N23 / 60 500; H04N23 / 63; B61K13 / 04; B61L25 / 02 According to International Patent Classification (IPC) or to both national classification and IPC B. FIELDS SEARCHED Minimum documentation searched (classification system followed by classification symbols) H04N7 / 18; B61K13 / 04; B61L25 / 02; H04N23 / 60; H04N23 / 63 Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched Published examined utility model applications of Japan 1922-1996 Published unexamined utility model applications of Japan 1971-2023 Registered utility model specifications of Japan 1996-2023 Published registered utility model applications of Japan 1994-2023 Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) C. DOCUMENTS CONSIDERED TO BE RELEVANT Category* Citation of document, with indication, where appropriate, of the relevant passages Relevant to claim No. Y WO 2019 / 102935 Al (SHARP KABUSHIKI KAISHA) 31 May 2019 (2019-05-31) paragraphs [0010]-[0037], [0050], fig. 1-6, 10 1-7 Y JP 2017-181634 A (PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.) 05 October 2017 (2017-10-05) paragraphs [0005]-[0022], fig. 1-4, 6, 9 1-7 | | Further documents are listed in the continuation of Box C. | «71 See patent family annex. * Special categories of cited documents: “A” document defining the general state of the art which is not considered to be of particular relevance “E” earlier application or patent but published on or after the international filing date “L” document which may throw doubts on priority claim(s) or which is cited to establish the publication date of another citation or other special reason (as specified) “O” document referring to an oral disclosure, use, exhibition or other means “P” document published prior to the international filing date but later than the priority date claimed “T” later document published after the international filing date or priority date and not in conflict with the application but cited to understand the principle or theory underlying the invention “X” document of particular relevance; the claimed invention cannot be considered novel or cannot be considered to involve an inventive step when the document is taken alone “Y” document of particular relevance; the claimed invention cannot be considered to involve an inventive step when the document is combined with one or more other such documents, such combination being obvious to a person skilled in the ait document member of the same patent family Date of the actual completion of the international search 17 November 2023 Date of mailing of the international search report 28 November 2023 Name and mailing address of the ISA / JP Japan Patent Office (ISA / JP) 3-4-3 Kasumigaseki, Chiyoda-ku, Tokyo 100-8915 Japan Authorized officer Telephone No.INTERNATIONAL SEARCH REPORT Information on patent family members International application No. PCT / JP2023 / 033342Patent document cited in search report Publication date (day / month / year) Patent family member)s) Publication date (day / month / year) WO 2019 / 102935 Al 31 May 2019 US 2020 / 0280699 Al paragraphs [0026]-[0053], ____________________________________________________10066], Jig._l-6,J0__________________________________ JP 2017-181634 A 05 October 2017 (Family: none)

Images