Image processing device, image providing system, and program
The image processing device replaces the interior of train images with exterior scenery, addressing the limitation of window-framed captures and enhancing photographic services.
Patent Information
- Application Number
- JP2020132926
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-08-05
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2040-08-05
AI Technical Summary
Existing image capturing systems from inside a train only capture scenery within the window frame, failing to include the entire landscape, limiting the attractiveness of photographs.
An image processing device that receives images from inside a vehicle, processes them to replace the interior with exterior scenery using frame images from exterior cameras, and transmits the processed images to a user terminal.
Enables capturing the entire landscape as if taken from outside the vehicle, providing an attractive photographic service to passengers.
Smart Images

Figure 0007593003000001 
Figure 0007593003000002 
Figure 0007593003000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an image processing device or the like that processes an image captured by a user from inside a vehicle such as a train, showing the outside of the vehicle. [Background technology]
[0002] In recent years, tourist trains have become popular, offering passengers attractive ride experiences, such as elaborate cuisine served on board, luxurious interiors, and trains that are wrapped in special designs to give them a unique appearance.
[0003] Such trains often run along scenic routes, and passengers often take photos of scenic spots along the route from inside the train. As part of the photography service, the train may slow down when approaching such scenic spots to make it easier to take photos.
[0004] On the other hand, Patent Document 1 also describes a system that allows users to view video of the scenery outside the train captured by a camera installed on the train, thereby allowing the user to virtually experience the view from the train window. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] Japanese Patent Application Publication No. 10-304339 Summary of the Invention [Problem to be solved by the invention]
[0006] One problem with photographing the scenery outside the train from inside the train as described above is that even if you photograph the scenery outside the train from inside the train, in the captured image the scenery will only appear within the window frames of the train, and the rest of the image will be the interior of the train.
[0007] As a result, even if a landscape is beautiful, the entire image may not be captured. By solving this problem, it may be possible to provide an attractive photography service to passengers on trains, etc.
[0008] The present invention has been made in consideration of the above problems, and has an object to provide an image processing device and the like that can provide an attractive photography service to passengers on trains, etc. [Means for solving the problem]
[0009] The first invention for solving the above-mentioned problems is an image processing device characterized by having a captured image receiving means for receiving from a user terminal a captured image of the scenery outside the vehicle from inside the vehicle while it is in motion, an image processing means for performing image processing using a frame image corresponding to the scenery captured in the captured image of a video of the scenery outside the vehicle captured using a camera device equipped in the vehicle, and making the interior part of the captured image the scenery of the frame image, and a transmission means for transmitting the captured image after image processing to the user terminal.
[0010] In the present invention, as described above, for an image taken by a user from inside the train of the outside, a frame image in a video taken of the outside of the train by a camera installed in the train is used to represent the inside of the train as the scenery outside. This makes the image taken by the user an image that captures the entire scenery as if it were taken outside the train, and it is possible to provide an attractive photography service to passengers on trains, etc.
[0011] It is desirable that the video is stored in a memory unit of the image processing device in association with the shooting time of the video or the location history of the shooting device, and that the image processing means refers to information on the shooting time or shooting location of the captured image, cuts out a frame image from the video corresponding to the shooting time or shooting location, and uses it for the image processing. In the present invention, when performing image processing, metadata such as the shooting time and shooting position of a captured image can be referenced as described above, and frame images corresponding to these times and positions can be extracted from a moving image.
[0012] It is preferable that the image processing means extracts an image of a person from the photographed image and combines the image of the person with the frame image. This allows the user to obtain a photographed image after image processing in which the interior of the vehicle in the photographed image is replaced with a view outside the vehicle and in which people in the photographed image are also captured.
[0013] It is preferable that the image processing device has a moving image receiving means for receiving the moving image from the vehicle. The image processing device of the present invention can receive moving images captured by a camera installed in a vehicle from the vehicle after the vehicle has been driven, and use the received moving images for image processing.
[0014] The video includes a video of the scenery on the left side of the vehicle captured by a camera mounted on the left side of the vehicle, and a video of the scenery on the right side of the vehicle captured by a camera mounted on the right side of the vehicle, and the video is stored in a memory unit of the image processing device in association with the location history of the camera, and it is desirable that the image processing means refers to information on the shooting locations of the captured images and selects which video to use for image processing, between the video captured by the camera mounted on the left side of the vehicle or the video captured by the camera mounted on the right side of the vehicle. This allows a suitable video to be used for image processing depending on whether the user is shooting the left or right scenery from the vehicle.
[0015] The second invention is An image providing system including an image processing device having a captured image receiving means for receiving from a user terminal a captured image of a scene outside a vehicle while the vehicle is in motion, an image processing means for performing image processing using a frame image corresponding to a scene captured in the captured image of a video of the scene outside the vehicle captured by a camera device provided in the vehicle, and changing a part of the interior of the captured image into a scene of the frame image, and a transmission means for transmitting the captured image after image processing to the user terminal, wherein the user terminal comprises: Images taken from inside a moving vehicle showing the scenery outside the vehicle The above The present invention is characterized in that the present invention has a photographed image transmitting means for transmitting a photographed image to an image processing device, and a receiving means for receiving from the image processing device a photographed image after image processing in which a portion of the interior of the photographed image is converted into a frame image scenery corresponding to the scenery captured in the photographed image of a moving image of a scenery outside the vehicle captured by a photographing device provided in the vehicle. Image provision system It is.
[0016] A third invention is a method for making a computer function as an image processing device having a captured image receiving means for receiving from a user terminal a captured image of a scene outside a vehicle while the vehicle is in motion, an image processing means for performing image processing using a frame image corresponding to a scene captured in the captured image of a moving image of a scene outside the vehicle captured by a camera device provided in the vehicle, and changing a part of the interior of the captured image into a scene of the frame image, and a transmission means for transmitting the captured image after image processing to the user terminal. Rup It is a program. Effect of the Invention
[0018] According to the present invention, it is possible to provide an image processing device or the like that can provide an attractive photography service to passengers on a train or the like. [Brief description of the drawings]
[0019] [Figure 1] FIG. 1 shows an image providing system 1. [Diagram 2] FIG. 2 is a diagram showing the hardware configuration of an image processing device 3. [Diagram 3] FIG. 2 shows a hardware configuration of a user terminal 5. [Figure 4] FIG. 2 is a diagram showing the arrangement of the imaging device 7. [Diagram 5] FIG. 2 is a diagram showing the functional configuration of an image processing device 3 and a user terminal 5. [Figure 6] FIG. 2 shows video data 200. [Figure 7] 2 is a diagram for explaining a shooting time 205 and a position history 206 of a video 204. FIG. [Figure 8] 1 is a flow chart showing an image providing method. [Figure 9] 4 is a diagram showing a screen displayed on a display unit 53 of the user terminal 5. FIG. [Figure 10] 4 is a flowchart showing an image processing method. [Figure 11] 5A to 5C are diagrams for explaining an image processing method. [Figure 12] 5A to 5C are diagrams for explaining an image processing method. [Figure 13] FIG. 13 is a diagram showing a difference d between the positions of the image capturing device 7 and the user. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0020] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.
[0021] (1. Image provision system 1) 1 is a diagram showing an image providing system 1 including an image processing device 3 according to an embodiment of the present invention. The image providing system 1 is configured by connecting the image processing device 3, a user terminal 5, and a train 100 (a computer 8 in the train 100) so that they can communicate with each other wirelessly or the like. In the image providing system 1, a user who is a passenger on the train 100 takes an image of the scenery outside the train 100 from inside the train 100, and transmits the image to the image processing device 3 from the user terminal 5. The image processing device 3 processes the image and provides it to the user.
[0022] 2 is a diagram showing a hardware configuration of the image processing device 3. The image processing device 3 can be realized by a computer configured by connecting a control unit 31, a storage unit 32, a communication unit 33, etc. via a bus or the like. However, the image processing device 3 is not limited to this, and various configurations can be used as appropriate.
[0023] The control unit 31 is composed of a CPU, a ROM, a RAM, etc. The CPU loads programs related to the processing of the image processing device 3 stored in a storage medium such as the storage unit 32 or the ROM into a work area on the RAM and executes them. The ROM is a non-volatile memory, and permanently stores programs such as a boot program and a BIOS, data, etc. The RAM is a volatile memory, and temporarily stores programs and data loaded from the storage unit 32 or the ROM, etc., and also has a work area used by the control unit 31 to perform various processes.
[0024] The storage unit 32 is a hard disk drive, a solid state drive, a flash memory, or the like, and stores programs executed by the image processing device 3 in processes described below, data necessary for executing the programs, an OS, etc. These programs and data are read and executed by the control unit 31 as necessary.
[0025] The communication unit 33 is a communication interface that mediates communication via a network, and performs communication with the user terminal 5 and the like.
[0026] Returning to the explanation of Fig. 1, the user terminal 5 is a camera-equipped terminal carried by a user, which takes pictures of the scenery outside the train 100 from inside the train and transmits the taken images to the image processing device 3. As the user terminal 5, for example, a mobile terminal with a camera such as a smartphone or a tablet terminal is used, but a camera with a communication function can also be used.
[0027] 3 is a diagram showing the hardware configuration of the user terminal 5. The user terminal 5 can be realized by a computer configured by connecting a control unit 51, a storage unit 52, a display unit 53, an input unit 54, a communication unit 55, a camera 56, etc. via a bus or the like. However, the present invention is not limited to this, and various configurations can be used as appropriate.
[0028] The control unit 51, the storage unit 52, and the communication unit 55 are substantially the same as the control unit 31, the storage unit 32, and the communication unit 33 described above, and the storage unit 52 stores an application program (app) dedicated to this system for executing the processes described below. The display unit 53 has a display device such as a liquid crystal panel, and a touch panel is provided as the input unit 54 for inputting data to the user terminal 5.
[0029] The camera 56 is an area camera that includes an optical lens, an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide Semiconductor), an A / D (Analog / Digital) converter, etc. The camera 56 photoelectrically converts the subject image input through the optical lens using the imaging element to generate an analog image signal. The A / D converter then converts the analog image signal into digital image data.
[0030] Returning to the explanation of Fig. 1, the train 100 that the user boards is provided with an imaging device 7. The imaging device 7 is for capturing images of scenery outside the train 100. As shown in Fig. 4, the imaging devices 7 are provided on the left and right sides of the train 100, and capture the scenery on the left and right sides of the train 100 as video.
[0031] In this embodiment, the photographing device 7 is a photographing device such as a drive recorder with a GPS function that photographs video and continuously records the photographing time and the location of the photographing device 7 as photographing time 205 and location history 206 (see FIG. 6 and the like) described later. The photographing device 7 is connected to a computer 8 in the train 100. The computer 8 has a control unit, a storage unit, a communication unit, and the like similar to the control unit 31, the storage unit 32, and the communication unit 33 described above, and communicates with the image processing device 3 wirelessly.
[0032] Fig. 5 is a diagram showing the functional configuration of the image processing device 3 and the user terminal 5. As shown in Fig. 5, the image processing device 3 has a moving image receiving means 301, a captured image receiving means 302, an image processing means 303, a transmitting means 304, etc., and the user terminal 5 has a captured image transmitting means 501, a receiving means 502, etc.
[0033] The video receiving means 301 of the image processing device 3 receives, via the communication unit 33, from the train 100, video images of the scenery outside the train captured by the camera device 7 of the train 100, using the control unit 31 of the image processing device 3.
[0034] The captured image receiving means 302 receives, via the control unit 31 of the image processing device 3, from the user terminal 5 via the communication unit 33, a captured image of the scenery outside the train 100 captured by a user from inside the train.
[0035] The image processing means 303 performs image processing on the captured image received by the control unit 31 of the image processing device 3 from the user terminal 5. The details of this image processing will be described later.
[0036] The transmission means 304 is a means for the control unit 31 of the image processing device 3 to transmit the photographed image after image processing to the user terminal 5 via the communication unit 33.
[0037] In addition, the memory unit 32 of the image processing device 3 stores video data 200 including video of the scenery outside the train 100 while it is in operation, captured by the imaging device 7, and the video data 200 is used for image processing by the image processing means 303.
[0038] Fig. 6 is a diagram showing this video data 200. As shown in Fig. 6, the video data 200 includes a train ID 201, a camera position 202, a date 203, a video 204, a shooting time 205, a position history 206, and the like.
[0039] The train ID 201 is identification information for identifying the train 100, and is, for example, the name of the carriage and its departure time, but is not limited to this.
[0040] The camera position 202 is information indicating the position of the photographing device 7 within the train 100. As described above, in this embodiment, the photographing device 7 is provided on the left and right sides of the train 100, and the camera position 202 is, for example, “right side of vehicle” or “left side of vehicle”.
[0041] Date 203 is the date that train 100 ran.
[0042] The video 204 is a video file of the scenery outside the vehicle captured by each imaging device 7.
[0043] The image capturing time 205 is the time when the video 204 was captured, and the position history 206 is information indicating the change in position of the camera 7 during the capture of the video 204 (the change accompanying the movement of the train 100).
[0044] In this embodiment, as shown in FIG. 7 , the above-mentioned shooting time 205 and location history 206 are used to associate a frame image 204a in a video 204 with the time at which it was shot and the location of the camera 7, and by identifying the time or location, it is possible to extract a frame image 204a corresponding to the time or location from the video 204.
[0045] Returning to the explanation of Fig. 5, the captured image transmitting means 501 of the user terminal 5 transmits, to the image processing device 3 via the communication unit 55, a captured image of the scenery outside the train 100 captured by the control unit 51 of the user terminal 5 from inside the train 100 in operation.
[0046] The receiving means 502 is a means for the control unit 51 of the user terminal 5 to receive the photographed image after the above-mentioned image processing from the image processing device 3 via the communication unit 55.
[0047] (2. Image provision method) Next, an image providing method implemented in the image providing system 1 will be described with reference to Fig. 8 etc. Fig. 8 is a flowchart showing the image providing method, in which S1 to S2 and S4 to S6 are processes executed by the control unit 31 of the image processing device 3 by controlling each unit of the image processing device 3. S3 and S7 are executed by the control unit 51 of the user terminal 5 by controlling each unit of the user terminal 5.
[0048] In this embodiment, the train 100 starts photographing the scenery outside the train with the photographing device 7 at the same time as the train starts its operation (departure from the starting station), and stops photographing at the end of the operation (arrival at the end station). The photographing device 7 records the photographed video 204 in a storage unit of the computer 8 together with the photographing time 205, the position history 206 of the photographing device 7, etc.
[0049] Meanwhile, while the train 100 is in operation, the user operates the user terminal 5 to start the application, inputs the train ID 201, etc., and selects to take a photo on a menu screen (not shown). The control unit 51 of the user terminal 5 then starts the camera 56, and the user takes a photo of the scenery outside the train from any position inside the train using the camera 56. The captured image is linked to the train ID 201, etc., and recorded in the memory unit 52 of the user terminal 5. The captured image is recorded together with metadata such as the time of capture and the capture position (the position of the user terminal 5 at the time of capture).
[0050] When the train 100 finishes running, the train 100 (computer 8) transmits video data 200, such as a train ID 201, a camera position 202, a date 203, a video 204, a shooting time 205, and a position history 206, to the image processing device 3. The image processing device 3 receives the video data 200 (S1) and records it in the storage unit 32 (S2).
[0051] Meanwhile, the user operates the user terminal 5 to start the application, inputs the train ID 201, etc., and selects to perform image processing of the captured image on a menu screen (not shown). In this embodiment, at this time, one or more captured images 300 linked to the train ID 201 and recorded are displayed in a selectable manner on the display unit 53 of the user terminal 5 as shown in FIG. 9(a). The user selects the captured image 300 to be subjected to image processing on this selection screen. Note that multiple captured images 300 are selectable on the selection screen of FIG. 9(a), and a mark 401 indicating the selection order is displayed on the selected captured image 300.
[0052] When the captured image 300 to be subjected to image processing is selected, the user terminal 5 transmits the selected captured image 300 to the image processing device 3 (S3). The captured image 300 is transmitted to the image processing device 3 together with metadata such as the above-mentioned shooting time and shooting position.
[0053] When the image processing device 3 receives the captured image 300 together with the above metadata (S4), it performs image processing on the captured image 300 (S5) and transmits the processed captured image to the user terminal 5 (S6).
[0054] When the user terminal 5 receives the photographed image after image processing (S7), it displays the photographed image 300a after image processing on the display unit 53 together with the photographed image 300 before image processing, as shown in FIG. 9(b).
[0055] As can be seen from Fig. 9(b), in this embodiment, the captured image 300a after image processing is a scene in which the part a (shown by the hatched part in the figure) inside the vehicle in the captured image 300 before image processing is changed to a scene corresponding to the scene b outside the vehicle captured within the window frame. As a result, the captured image 300a after image processing is an image capturing the entire scene as if it were taken outside the vehicle. The procedure of this image processing will be described below with reference to Fig. 10 etc.
[0056] (3. Image processing of captured image 300) FIG. 10 is a flowchart showing the procedure of the image processing in S5 of FIG.
[0057] In this embodiment, the above image processing is performed using a frame image 204a in a video 204 captured by the camera 7 of the train 100. Therefore, in S5, first, a video 204 captured by one of the camera devices 7 provided on the left and right sides of the train 100 is selected as the video 204 to be used for image processing (S51).
[0058] In this embodiment, information on the shooting position of the captured image 300 is referenced, and as shown in Fig. 11, the shooting position A of the captured image 300 is compared with the position history 206 of the camera devices 7 on the left and right sides of the train 100. Then, depending on which of the position histories 206 of the camera devices 7 the shooting position A is closer to, the video 204 to be used for image processing is selected.
[0059] For example, if the photographing position A of the photographed image 300 is closer to the position history 206 of the photographing device 7 with the camera position 202 of "vehicle left", it is assumed that the photographing position of the photographed image 300 is the left side of the train 100 and photographed the scenery on the left side of the train 100. Therefore, the video 204 photographed by the photographing device 7 with the camera position 202 of "vehicle left" is used for image processing.
[0060] Next, the image processing device 3 cuts out the frame image 204a to be used for image processing of the photographed image 300 from the selected moving image 204 (S52).
[0061] In this embodiment, by referring to information on the shooting time of the captured image 300, as shown in Fig. 12(a), a frame image 204a having a shooting time corresponding to the shooting time of the captured image 300 is extracted from the video 204. For example, if the shooting time of the captured image 300 is 11:00:00, a frame image 204a having a shooting time of 11:00:00 is extracted from the video 204.
[0062] Next, as shown in FIG. 12(b), the image processing device 3 extracts a person image c from the photographed image 300 (S53), and combines the person image c with the above-mentioned frame image 204a (S54).
[0063] The extraction of the person image c can be performed using a known person extraction technique using AI (artificial intelligence), but is not limited to this. As for the frame image 204a, image editing is performed as necessary, such as matching the angle of view of the scenery with the angle of view of the scenery b in the window frame in the photographed image 300, or matching the size of the frame image 204a with the size of the photographed image 300, and the person image c is placed at a position on the frame image 204a that corresponds to the position on the photographed image 300.
[0064] 9(b), a photographed image 300a is obtained in which the portion a of the interior of the vehicle in the photographed image 300 is replaced with the scenery of the frame image 204a corresponding to the scenery b of the photographed image 300. Note that only the portion a of the interior of the vehicle in the photographed image 300 may be replaced with the range corresponding to the portion a in the frame image 204a, and this also results in a photographed image 300a after image processing in which the portion a of the interior of the vehicle in the photographed image 300 is replaced with the scenery of the frame image 204a corresponding to the scenery b of the photographed image 300.
[0065] As described above, in this embodiment, for the captured image 300 taken by the user from inside the train, the frame image 204a in the video 204 taken of the outside of the train by the imaging device 7 provided on the train 100 is used, and the part a inside the train is set to the scenery outside the train. As a result, the captured image 300 taken by the user becomes a captured image 300a that captures the entire scenery as if it was taken outside the train, and an attractive photography service can be provided to passengers on the train 100.
[0066] Furthermore, in this embodiment, when performing image processing, the shooting time of the captured image 300 can be referenced as described above, and the frame image 204a corresponding to the shooting time can be extracted from the video 204.
[0067] Furthermore, in this embodiment, a person image c is extracted from the captured image 300 and combined with the frame image 204a, so that the user can obtain a captured image 300a after image processing in which the part a inside the vehicle of the captured image 300 is turned into a view outside the vehicle and in which the person in the captured image 300 is also captured.
[0068] Furthermore, the image processing device 3 of this embodiment can receive video 204 captured by the imaging device 7 provided on the train 100 from the train 100 after the train 100 has been running, and can use this for image processing.
[0069] In addition, in this embodiment, information on the shooting position of the captured image 300 is used to select which of the videos 204 captured by the shooting devices 7 attached to the left and right sides of the train 100 to use for image processing. Therefore, depending on whether the user was capturing the scenery on the left or right side of the train 100, the appropriate video 204 can be used for image processing.
[0070] However, the present embodiment is not limited to the above embodiment. For example, the present embodiment has been described with reference to an example of a photography service provided to passengers of the train 100, but the present invention is not limited to the train 100 and can be applied as a photography service for passengers of any vehicle, such as a tourist bus.
[0071] In this embodiment, the shooting time of the photographed image 300 is used to cut out the frame image 204a, but in this case, as shown in Fig. 13(a), due to a difference d between the position of the user in the train 100 and the position of the photographing device 7, there is a subtle difference between the scenery photographed by the user terminal 5 and the photographing device 7 at the same time. Therefore, there is a slight difference between the scenery b in the photographed image 300 and the scenery in the frame image 204a cut out in S52.
[0072] If such a difference becomes a problem, it is possible to reduce the difference d by providing multiple camera devices 7 in the front-rear direction of the train 100 and using a video 204 from a camera device 7 that is closer to the user's position, as shown in Fig. 13(b). In this case, when performing image processing of the captured image 300, the user inputs position information of the user in the train (e.g., seat position, etc.) to the user terminal 5 and transmits it to the image processing device 3, and the image processing device 3 refers to the position information and uses the video 204 from the camera device 7 that is closer to the user's position for image processing.
[0073] Also in the case of Figure 13(a), when performing image processing of the captured image 300, the user's position information within the vehicle is input into the user terminal 5 and transmitted to the image processing device 3, so that the image processing device 3 can extract a frame image 204a with a shooting time shifted by a time equivalent to the difference d (for example, the time obtained by dividing the difference d by the speed of the train 100) from the shooting time of the captured image 300 and use it for image processing.
[0074] In addition, it is also possible to extract the frame image 204a using image recognition technology. For example, all the frame images 204a captured within a certain range of shooting times including the shooting time of the captured image 300 can be extracted, and the frame image 204a that has the highest degree of match with the scenery b in the captured image 300 can be used for image processing.
[0075] Furthermore, when cutting out the frame image 204a, it is also possible to refer to the shooting position of the photographed image 300. The method of cutting out the frame image 204a is the same as when the shooting time of the photographed image 300 is referred to, and it is sufficient to cut out the frame image 204a photographed at a position corresponding to the shooting position of the photographed image 300 (a position closest to the shooting position of the photographed image 300). Although it depends on the accuracy of the GPS, in this case, there is no difference between the scenery photographed by the user terminal 5 and the photographing device 7 at the same position, so the above-mentioned difference hardly occurs.
[0076] Although the preferred embodiment of the present invention has been described above with reference to the accompanying drawings, the present invention is not limited to the above examples. It is clear that a person skilled in the art can come up with various modified or altered examples within the scope of the technical ideas disclosed in this application, and it is understood that these also naturally belong to the technical scope of the present invention. [Explanation of symbols]
[0077] 1: Image provision system 3: Image processing device 5: User terminal 7: Shooting device 100:Train 200:Video data 202: Camera position 203:Date 204:Video 204a: Frame image 205:Time of photo 206: Location History 300, 300a: Photographed images 301: Video receiving means 302: Photographed image receiving means 303: Image processing means 304: Transmission method 501: Photographed image transmission means 502: Receiving means
Claims
1. a captured image receiving means for receiving, from a user terminal, a captured image of a scene outside the vehicle taken from inside the vehicle while in motion; an image processing means for performing image processing using a frame image corresponding to a scene captured in a moving image of a scene outside the vehicle, the frame image corresponding to a scene captured in the captured image, and converting a part of the interior of the vehicle in the captured image into a scene in the frame image; A transmission means for transmitting the photographed image after image processing to a user terminal; 13. An image processing device comprising:
2. the video is stored in a storage unit of the image processing device in association with a shooting time of the video or a location history of the shooting device; 2. The image processing device according to claim 1, wherein the image processing means refers to information on the shooting time or shooting position of the captured image, extracts a frame image from the video corresponding to the shooting time or shooting position, and uses the frame image for the image processing.
3. 3. The image processing apparatus according to claim 1, wherein said image processing means extracts a portrait image from said photographed image and synthesizes said portrait image with said frame image.
4. 4. The image processing device according to claim 1, further comprising a moving image receiving unit for receiving the moving image from the vehicle.
5. The video includes a scene of the left side of the vehicle captured by a camera provided on the left side of the vehicle, and a scene of the right side of the vehicle captured by a camera provided on the right side of the vehicle, The video is stored in a storage unit of the image processing device in association with a location history of the imaging device; 5. The image processing device according to claim 1, wherein the image processing means refers to information on the shooting position of the captured image and selects which video to use for image processing, from the video of the camera on the left side of the vehicle or the video of the camera on the right side of the vehicle.
6. A captured image receiving means for receiving from a user terminal an image of an outside view taken from inside a moving vehicle; an image processing means for performing image processing using a frame image corresponding to a scene captured in a moving image of a scene outside the vehicle, the frame image corresponding to a scene captured in the captured image, and converting a part of the interior of the vehicle in the captured image into a scene in the frame image; A transmission means for transmitting the photographed image after image processing to a user terminal; An image processing device having A user terminal; An image providing system comprising: The user terminal, a captured image transmission means for transmitting a captured image of an outside view taken from inside the vehicle while the vehicle is in motion to the image processing device; a receiving means for receiving from the image processing device a photographed image after image processing in which a portion of the interior of the photographed image is processed into a frame image of a moving image of a scene outside the vehicle captured by a photographing device provided in the vehicle, the frame image corresponding to the scene captured in the photographed image; An image providing system comprising:
7. Computer, a captured image receiving means for receiving, from a user terminal, a captured image of a scene outside the vehicle taken from inside the vehicle while in motion; an image processing means for performing image processing using a frame image corresponding to a scene captured in a moving image of a scene outside the vehicle, the frame image corresponding to a scene captured in the captured image, and converting a part of the interior of the vehicle in the captured image into a scene in the frame image; A transmission means for transmitting the photographed image after image processing to a user terminal; A program that causes the image processing device to function as an image processing device having the above-mentioned configuration.
Citation Information
Patent Citations
Vehicle video providing system and virtual vehicle traveling system
JP1998304339A
Server, client terminal, system and program
JP2013161416A
Mobile device wireless camera integration with vehicle
JP2014007744A
Video processing system and video processing method
JP2017005300A
On-vehicle photographing apparatus, photographing system and photographing method
JP2020010123A
