Method and apparatus for processing video obtained by round road traveling

Abstract

The invention relates to a method and an apparatus for processing video obtained by roundabout driving. A method for processing a video obtained by running around a road includes: receiving a plurality of videos obtained by photographing an outside of a vehicle; receiving an input of a user for moving a viewpoint of the first surround view video; a second surround-view video having a viewpoint moving from the first surround-view video is created based on the plurality of videos and the user's input, and the second surround-view video is provided, where the first surround-view video and the second surround-view video display both an exterior of the vehicle and a virtual model of the vehicle by processing of the plurality of videos.

Description

Technical Field

[0001] The present disclosure relates to a method and apparatus for processing a video obtained by driving a vehicle on a circular road, and more particularly, to a system and method configured to process a plurality of videos of a vehicle obtained from driving a circular road and convert the videos into a video combined with a surrounding field of view. Background Art

[0002] The existing video shooting method of the vehicle traveling on the ring road is usually performed in the vehicle. In order to shoot the outside of the vehicle, a separate camera can be installed, in which case there is a possibility that the camera falls, and only a specific viewpoint can be provided.

[0003] Conventionally, in the prior art, a video recorded by a front camera is made available by superimposing log data on the video as a shooting method of a vehicle traveling on a ring road, but this method has limitations in that the method only uses the front camera video and must record on a specific SD card and play the video.

[0004] Meanwhile, cameras for surround view videos are generally located on the front / rear / left / right, etc. of the vehicle and capture the entire area of ​​the field of view of each video through a wide-angle lens, so that a 360° view outside the vehicle can be recorded.

[0005] This video is played in an environment such as Audio Video Navigation (AVN) (integrated electrical component) or a specific Application Programming Interface (API), and it can also be provided as a 360° bird's eye view.

[0006] However, for safety purposes, cameras for surround view video in the related art are designed to automatically stop shooting when the speed exceeds a predetermined level, and therefore, vehicles traveling on a ring road or a highway cannot use the surround view video and only partially use the surround view video when parking or stopping. Summary of the invention

[0007] A system and method are configured to provide a surround view video of a vehicle that changes by adjusting the vehicle's viewpoint during or after driving.

[0008] Additionally, the systems and methods may provide a map of a circular road created using a surround view video of the vehicle or may provide a trail line, which is the path that the vehicle follows to travel on the circular road.

[0009] According to an embodiment, a method for a circular road driving video service includes: receiving, by a processor, a plurality of videos obtained by shooting the outside of a vehicle; receiving, by the processor, a user's input for moving a viewpoint of a first surround view video; creating, by the processor, a second surround view video having a viewpoint moved from the first surround view video based on the plurality of videos and the user's input; and providing, by the processor, a second surround view video, wherein the first surround view video and the second surround view video display both the outside of the vehicle and a virtual model of the vehicle through processing of the plurality of videos.

[0010] The method may further include: receiving, by a processor, one or more of a driving state of a vehicle and position information of the vehicle; and providing, by the processor, a first surround view video or a second surround view video according to any one or more of the driving state of the vehicle and the position information of the vehicle.

[0011] Providing the first surround view video or the second surround view video may include providing the first surround view video or the second surround view video when any one or more conditions are satisfied that the driving state of the vehicle is a stopped state or the position of the vehicle is on a ring road that is a racing road.

[0012] The method may further include: creating, by the processor, a ring road map of a ring road on which the vehicle is traveling and a track line along which the vehicle is traveling on the ring road using multiple videos; creating, by the processor, a first ring road driving map showing the ring road and the driving path of the vehicle using the ring road map and the track line; and providing, by the processor, the first ring road driving map.

[0013] The method may further include: receiving, by a processor, position information of the vehicle and ring road data related to the position of the vehicle; using, by the processor, the position information of the vehicle and the ring road data to create a track line along which the vehicle travels in a ring road map included in the ring road data; using, by the processor, the ring road map and the track line to create a second ring road driving map showing the ring road and the driving path of the vehicle; and providing, by the processor, the second ring road driving map.

[0014] The method may further include: receiving, by the processor, an optimal driving route in the ring road map; creating, by the processor, a third ring road driving map showing a trail line and the optimal driving route in the ring road map; and providing, by the processor, the third ring road driving map.

[0015] The method may further include: receiving, by a processor, position information of another vehicle located on the same circular road as the vehicle and circular road data related to the position of the vehicle; creating, by the processor, a fourth circular road driving map showing the position of the other vehicle in a circular road map included in the circular road data using the position information and circular road data of the other vehicle; and providing, by the processor, the fourth circular road driving map.

[0016] The plurality of videos, the first surround view video, and the second surround view video may be any of real-time videos and recorded videos.

[0017] The method may further include transmitting, by the processor, any one or more of the first surround view video and the second surround view video in a real-time streaming manner.

[0018] The first surround-view video and the second surround-view video may be provided as virtual reality (VR) videos.

[0019] According to an embodiment, an apparatus for processing a video obtained by driving on a circular road includes: a memory configured to store instructions for providing a circular road driving video service; and a processor configured to execute the instructions, wherein the instructions are configured to cause the apparatus, when executed by the processor, to: receive a plurality of videos obtained by shooting the outside of a vehicle; receive a user's input for moving a viewpoint of a first surround view video; create a second surround view video having a viewpoint moved from the first surround view video based on the plurality of videos and the user's input; and provide a second surround view video, wherein the first surround view video and the second surround view video display both the outside of the vehicle and a virtual model of the vehicle through processing of the plurality of videos.

[0020] The processor may receive one or more of a driving state of the vehicle and position information of the vehicle, and provide a first surround view video or a second surround view video according to any one or more of the driving state of the vehicle and the position information of the vehicle.

[0021] When any one or more conditions that the driving state of the vehicle is a stopped state or the position of the vehicle is on a circular road as a racing road are satisfied, the processor may provide the first surround view video or the second surround view video.

[0022] The processor can use multiple videos to create a ring road map of the ring road on which the vehicle travels and a track line along which the vehicle travels on the ring road, use the ring road map and the track line to create a first ring road driving diagram showing the ring road and the vehicle's driving path, and provide the first ring road driving diagram.

[0023] The processor may receive position information of the vehicle and ring road data associated with the position of the vehicle, use the position information of the vehicle and the ring road data to create a trace line along which the vehicle travels in a ring road map included in the ring road data, use the ring road map and the trace line to create a second ring road driving map showing the ring road and the driving path of the vehicle, and provide the second ring road driving map.

[0024] The processor may receive the best driving route in the ring road map, create a fourth ring road driving map showing the trail line and the best driving route in the ring road map, and provide the fourth ring road driving map.

[0025] The processor can receive position information of another vehicle located on the same circular road as the vehicle and circular road data related to the position of the vehicle, use the position information and the circular road data of the other vehicle to create a third circular road driving map showing the position of the other vehicle in a circular road map included in the circular road data, and provide the third circular road driving map.

[0026] The plurality of videos, the first surround view video, and the second surround view video may be any of real-time videos and recorded videos.

[0027] The processor may transmit any one or more of the first surround view video and the second surround view video in a real-time streaming manner.

[0028] The first surround-view video and the second surround-view video may be provided as virtual reality (VR) videos.

[0029] The present disclosure provides a surround view video that changes by adjusting the viewpoint of the user during or after driving, thereby being able to provide the user with a more interesting and dynamic vehicle video and driving video. Therefore, it is possible to increase the user's satisfaction when the vehicle is driving and to arouse the user and other users' interest in the vehicle and vehicle driving.

[0030] In addition, utilizing surround view video, the present disclosure enables users to easily know what to compensate for when traveling on a ring road, and can help improve the user's ring road driving record by providing a ring road map and / or a trail line, where the trail line is the path followed by a vehicle traveling on a ring road.

[0031] Furthermore, the present disclosure may arouse the user and other users' interest in the vehicle and the driving of the vehicle by providing the user and other users with a trace line of a circular road, driving record time, vehicle information, and the like. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The above and other objects, features and other advantages of the present disclosure will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings, in which:

[0033] Figure 1 is a diagram showing a ring road driving video service system according to an embodiment;

[0034] Figure 2 It is schematically shown Figure 1 A diagram of a service device shown in ;

[0035] Figure 3 is a diagram illustrating the operation of a service device;

[0036] Figure 4 and Figure 5 is a diagram showing an example of moving the viewpoint of a surround view video by an operation of a service device in response to an input from a user; and

[0037] Figures 6 to 8 : is a view showing an example of creating a circular road travel map provided by a service device. DETAILED DESCRIPTION

[0038] It should be understood that the term "vehicle" or "vehicle-based" or other similar terms as used herein include a broad range of motor vehicles, such as passenger cars, including sport utility vehicles (SUVs), buses, trucks, various commercial vehicles, watercraft (including various boats and ships), aircraft, etc., and include hybrid vehicles, electric vehicles, plug-in hybrid electric vehicles, hydrogen-powered vehicles, and other alternative fuel vehicles (e.g., fuels derived from resources other than petroleum). As mentioned herein, a hybrid vehicle is a vehicle having two or more power sources, for example, gasoline-powered and electric vehicles.

[0039] The terms used herein are only used for the purpose of describing specific embodiments, and are not intended to limit the present disclosure. As used herein, unless the context clearly indicates otherwise, the singular forms "one", "an" and "the" are intended to also include plural forms. It should also be understood that when the terms "comprises" and / or "comprising" are used in this specification, they specify the presence of the features, wholes, steps, operations, elements and / or parts, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, parts and / or their combinations. As used in this article, the term "and / or" includes any and all combinations of one or more related listed items. Throughout the specification, unless explicitly described to the contrary, the word "comprise" and variants such as "comprises" or "comprising" will be understood to imply the inclusion of the elements, but do not exclude any other elements. In addition, the terms "unit", "-er", "-or", "part" and "module" described in the specification are meant to be used to process at least one function and operation unit, and can be implemented by hardware components or software components and combinations thereof.

[0040] In addition, the control logic of the present disclosure may be embodied as a non-volatile computer-readable medium on a computer-readable medium containing executable program instructions executed by a processor, a controller, etc. Examples of computer-readable media include, but are not limited to, ROM, RAM, compact disk (CD)-ROM, magnetic tape, floppy disk, flash drive, smart card, and optical data storage device. The computer-readable medium may also be distributed in a network-coupled computer system so that the computer-readable medium is stored and executed in a distributed manner, for example, by a telematics server or a controller area network (CAN).

[0041] Hereinafter, the embodiments of the present disclosure will be described in detail with reference to the accompanying drawings, and regardless of the numbering of the drawings, the same or similar components are given the same reference numerals and will not be described repeatedly. In the following description, if it is determined that the detailed description of the known technology related to the present disclosure makes the subject matter of the embodiments described herein unclear, the detailed description is omitted. In addition, the drawings are provided only to facilitate the understanding of the embodiments disclosed in this specification, the technical spirit disclosed in this specification is not limited by the drawings, and all changes, equivalents, and substitutions should be understood to be included in the spirit and scope of the present disclosure.

[0042] Terms including ordinal numbers such as "first" and "second" may be used to describe various components, but these components should not be construed as being limited to these terms. These terms are only used to distinguish one component from another.

[0043] It should be understood that when an element is referred to as being “connected to” or “coupled to” another element, it may be directly connected to or directly coupled to the other element, or connected to or coupled to the other element with other elements interposed therebetween. On the other hand, it should be understood that when an element is referred to as being “directly connected to” or “directly coupled to” another element, it may be connected to or coupled to the other element without other elements interposed therebetween.

[0044] Unless the context clearly indicates otherwise, singular forms are intended to include plural forms.

[0045] Figure 1 is a diagram illustrating a ring road driving video service system according to an embodiment.

[0046] The circular road driving video service system 10 includes a plurality of cameras 100 , a service device 200 , a display device 300 , and a server 400 .

[0047] The roundabout road driving video service system 100 may provide a surround view video of a vehicle that is changed by adjusting a viewpoint by a user.

[0048] The circular road driving video service system 10 may provide a circular road map created using a surround view video of a vehicle and / or a trace line as a driving path of a vehicle in a circular road.

[0049] The camera 100 is installed in a vehicle and may photograph the exterior of the vehicle, and may transmit a plurality of photographed images.

[0050] For example, the camera 100 can be configured so that the field of view (FOV) area of ​​each camera includes the common ring road width at the time of shooting (e.g., a left-right width of approximately 8 m and a front-rear width of approximately 3.5 m), and can be configured so that even if the vehicle travels close to a line (apex line) on the ring road, the opposing line is included in the FOV area.

[0051] The service device 200 provides a surround view video that changes when the user adjusts the viewpoint during or after driving, thereby being able to provide the user with a more interesting and dynamic vehicle video and driving video. Therefore, it is possible to increase the user's satisfaction when driving the vehicle and arouse the user and other users' interest in the vehicle and driving the vehicle.

[0052] Using the surround view video, the service device 200 can enable the user to easily know what to compensate for when driving on a ring road, and can help improve the user's ring road driving record by using a ring road map and / or trail lines, which are the paths followed by vehicles driving on the ring road.

[0053] The service device 200 may stimulate the user and other users' interest in vehicles and vehicle driving by providing the user and other users with trace lines of a circular road, driving record time, vehicle information, and the like.

[0054] The service device 200 may receive a plurality of videos transmitted from the camera 100 .

[0055] The service device 200 may create a surround view video showing both the exterior of the vehicle and the virtual model of the vehicle by processing a plurality of videos.

[0056] For example, the surround view may include a bird's-eye view that is a viewpoint looking down on the exterior of the vehicle from above the virtual model of the vehicle.

[0057] The service device 200 may receive an input from a user of the display device 300 and / or the server 400 or an input from another user.

[0058] The service device 200 may create a surround view video having a viewpoint moved from the surround view video before the user input after the user input based on the plurality of videos and the user's input.

[0059] The service device 200 may store a surround view video and / or a plurality of videos.

[0060] The service device 200 may transmit a surround view video and / or a plurality of videos to the display device 300 and / or the server 400 .

[0061] For example, when the service device 200 transmits a surround view video and / or a plurality of videos, the service device 200 may transmit them in a wired / wireless type through another high-performance communication device (not shown).

[0062] For example, the service device 200 may process and store the surround view video and the video of the plurality of videos actually displayed on the display device 300 as one video.

[0063] The service device 200 can use any one or more of multiple videos, surround view videos, vehicle location information, other vehicles' location information, and / or optimal driving lines of a circular road to create a circular road driving map, which includes the path along which the vehicle travels on the circular road, the locations of other vehicles on the circular road, and / or any one or more of the optimal driving lines in the circular road map of the circular road on which the vehicle travels.

[0064] The service device 200 may transmit and / or store the ring road driving map.

[0065] The display device 300 may display any one or more of the surround view video and / or the plurality of videos.

[0066] The display device 300 may sense a user's input for moving a viewpoint of any one or more of the surround view video and / or the plurality of videos.

[0067] For example, the display device 300 may sense a user's input for moving the viewpoint in a dragging direction accompanying the user's touch input or may remotely sense a user's finger gesture and / or finger movement for moving the viewpoint.

[0068] The display apparatus 300 may transmit the sensed user's input to the service apparatus 200 .

[0069] For example, the display device 300 may be an in-vehicle infotainment (IVI) device, and may be implemented as, for example, an audio video navigation (AVN) device, a dashboard, an integrated display, or the like.

[0070] The server 400 may receive and store a plurality of videos and / or surround-view videos, and may transmit the stored plurality of videos and / or surround-view videos in a streaming manner through the Internet.

[0071] The server may provide a surround-view video by processing a plurality of videos, and may provide other users with a surround-view video having a viewpoint moved by receiving and processing an input for moving the viewpoint of the other users.

[0072] For example, when another user watches the surround view video provided by the server 400 and gives an input for moving the viewpoint while watching the surround view video, the server 400 may provide the surround view video with the moved viewpoint to the other user in a streaming manner.

[0073] Figure 2 is schematically shown in Figure 1 Schematic diagram of the service device shown in .

[0074] The service device 200 includes a processor 210 and a memory 220 .

[0075] The service device 200 is connected to a network through the processor 210 and can communicate with the server 400 or the like.

[0076] The processor 210 is connected to a network through wireless communication or wired communication, and can communicate with the server 400 or the like.

[0077] The processor 210 may include one or more of a central processing unit, an application processor, and a communication processor.

[0078] The processor 210 may perform operations or data processing related to control of at least one other component of the service device 200. For example, the processor 210 may execute an application and / or software stored in the memory 220.

[0079] The processor 210 may process the received data and the data stored in the memory 220. The processor 210 may process the data stored in the memory 220. The processor 210 may execute a computer readable code (eg, software) stored in the memory 220 and instructions caused by the processor 210.

[0080] The processor 210 may be a data processing device implemented as hardware having circuits having a physical structure for performing desired operations. For example, a desired program may include codes or instructions included in the program.

[0081] For example, a data processing device implemented as hardware may include a microprocessor, a central processing unit, a processor core, a multi-core processor, a multiprocessor, an application specific integrated circuit (ASIC), and a field programmable gate array (FPGA).

[0082] Processor 210 may receive a plurality of videos capturing the exterior of the vehicle.

[0083] For example, multiple videos may be shot at wide angles, and when the multiple videos are integrated, it may be a video that includes all 360° images of the exterior of the vehicle.

[0084] The processor 210 may create a first surround view video by processing a plurality of videos.

[0085] The processor 210 may receive a user's input for moving a viewpoint of the first surround view video.

[0086] The processor 210 may create a second surround view video having a viewpoint moved from the first surround view video based on the plurality of videos and the user's input.

[0087] For example, the first surround-view video and the second surround-view video may be videos that display both the exterior of the vehicle and the virtual model of the vehicle through processing of a plurality of videos.

[0088] For example, the processor 210 may output a video that is the same as or similar to an actual graphic by applying a correction filter to a plurality of videos that are shot in a distorted state different from the actual graphic due to the influence of a camera lens.

[0089] For example, the plurality of videos, the first surround view video, and the second surround view video may be any of real-time videos and recorded videos.

[0090] For example, the first surround view video and the second surround view video may be provided as virtual reality (VR) videos.

[0091] The processor 210 may provide a first surround view video and / or a second surround view video.

[0092] Processor 210 may receive any one or more of driving status and / or location information of the vehicle.

[0093] For example, the location information of the vehicle may be GPS information or a location in vehicle navigation.

[0094] The processor 210 may receive the ring road positioning information from a ring road positioning device (not shown).

[0095] For example, a roundabout location device (not shown) may determine the position of the vehicle on the roundabout and transmit the position along with the roundabout location information.

[0096] The processor 210 may provide a first surround view video or a second surround view video according to any one or more of the driving state and / or position information of the vehicle.

[0097] For example, when the driving state of the vehicle is a stopped state (e.g., the vehicle is in P gear) or the position of the vehicle is on a ring road serving as a racing road, when any one or more conditions are met, the processor 210 may provide and / or store a first surround view video or a second surround view video.

[0098] For example, when the driving state of the vehicle is a stopped state, the processor 210 may provide the first surround view video or the second surround view video.

[0099] For example, when the driving state of the vehicle is in the driving state, the processor 210 may provide the first surround view video or the second surround view video only if the position of the vehicle is on a roundabout road.

[0100] The processor 210 may use the plurality of videos to create a map of a circular road on which the vehicle is traveling and a track line along which the vehicle is driving on the circular road.

[0101] For example, the processor 210 may create a circular road map and trail lines by extracting and integrating the road width, road slope, road shape, road curvature, relative positions of vehicles on the road, etc. of the circular road that appears continuously in multiple videos.

[0102] The processor 210 may create a first circular road driving diagram showing the circular road and the driving path of the vehicle using the circular road map and the trail lines.

[0103] The processor 210 may provide a first ring road driving map.

[0104] Processor 210 may receive location information of the vehicle and surrounding road data associated with the location of the vehicle.

[0105] Processor 210 may use the vehicle's position information and the roundabout data to create a track line along which the vehicle travels in a roundabout map included in the roundabout data.

[0106] For example, the processor 210 may create driving points that continuously exist on a ring road using the position information of the vehicle, and may create a trail line by connecting the driving points with a line and mapping the driving points in a ring road map.

[0107] For example, the processor 210 may create driving points of the vehicle continuously existing on the ring road by comparing the vehicle's position information and the ring road positioning information, and may create a trail line by connecting the driving points with a line and mapping the driving points in the ring road map.

[0108] Processor 210 may use the circular road map and the trail lines to create a second circular road driving diagram showing the circular road and the driving path of the vehicle.

[0109] The processor 210 may provide a second ring road driving map.

[0110] The processor 210 may receive an optimal driving route in a ring road map.

[0111] For example, the optimal driving line may be a driving path of the vehicle in a circular road map that enables the vehicle to achieve the shortest driving record when driving, and may include an optimal speed depending on the circular road section, the state of the vehicle, and the like.

[0112] Processor 210 may create a third circular road driving map showing the trail lines and the optimal driving routes in the circular road map.

[0113] The processor 210 may provide a third ring road driving map.

[0114] The processor 210 may receive a vehicle location sharing confirmation message from a user for sharing the location of the vehicle with other users.

[0115] The processor 210 may register the user's vehicle as a shared vehicle in response to the vehicle location sharing confirmation message.

[0116] The processor 210 may transmit location information of a vehicle registered as a shared vehicle.

[0117] The processor 210 may receive location information of another vehicle located on the same roundabout as the user's vehicle and roundabout data associated with the location of the vehicle.

[0118] For example, the location information of another vehicle may be GPS information or a location in navigation in another vehicle.

[0119] The processor 210 may use the position information of the other vehicle and the ring road data to create a fourth ring road driving map showing the position of the other vehicle in the ring road map included in the ring road data.

[0120] For example, when the vehicle or another vehicle leaves the ring road, the processor 210 stops creating the fourth ring road driving map using the location information of the vehicle or the location information of another vehicle.

[0121] The processor 210 may provide a fourth ring road driving map.

[0122] The processor 210 may transmit any one or more of the first surround view video and / or the second surround view video in a real-time streaming manner.

[0123] The processor 210 may receive vehicle information, track lines, driving records, and ring road status during driving days of the user and other users, and may create weekly ranking information, monthly ranking information, and / or total ranking information in order of driving records.

[0124] Processor 210 may provide weekly ranking information, monthly ranking information, and / or overall ranking information.

[0125] The memory 220 may include volatile and / or non-volatile memory. The memory 220 may store instructions and / or data related to at least one other component of the service device 200.

[0126] The memory 220 may store software and / or programs. For example, the memory 220 may store an application program, software, etc. for providing a circular road driving video service.

[0127] Figure 3 : is a view showing the operation of the service device.

[0128] The service device 200 may receive a plurality of videos capturing the exterior of the vehicle ( 3100 ).

[0129] The service device 200 may create a first surround view video by processing a plurality of videos ( 3200 ).

[0130] The service device 200 may receive a user input for moving a viewpoint of the first surround view video ( 3310 ).

[0131] The service device 200 may create a second surround view video having a viewpoint moved from the first surround view video based on the plurality of videos and the user's input (3320).

[0132] For example, the first surround-view video and the second surround-view video may be videos that display both the exterior of the vehicle and the virtual model of the vehicle through processing of a plurality of videos.

[0133] For example, the plurality of videos, the first surround view video, and / or the second surround view video may be any of real-time videos or recorded videos.

[0134] For example, the first surround view video and / or the second surround view video may be provided as a virtual reality (VR) video.

[0135] The service device 200 may provide a first surround view video and / or a second surround view video (3330).

[0136] For example, the service device 200 may transmit any one or more of the first surround view video and / or the second surround view video in a real-time streaming manner.

[0137] For example, the service device 200 may receive any one or more of the driving status and / or location information of the vehicle.

[0138] For example, the service device 200 may receive the ring road positioning information from a ring road positioning device (not shown). The ring road positioning device (not shown) may determine the position of the vehicle on the ring road and transmit the position together with the ring road positioning information.

[0139] For example, the service device 200 may provide the first surround view video or the second surround view video according to any one or more of the driving state and / or position information of the vehicle.

[0140] For example, when any one or more conditions that the driving state of the vehicle is a stopped state or the position of the vehicle is on a roundabout road as a racing road are satisfied, the service device 200 may provide the first surround view video or the second surround view video.

[0141] The service device 200 may create a ring road map of a ring road on which the vehicle travels and a track line along which the vehicle travels on the ring road using the plurality of videos ( 3410 ).

[0142] The service device 200 may create a first circular road driving graph showing the circular road and the driving path of the vehicle using the circular road map and the trail line (3420).

[0143] The service device 200 may provide a first ring road driving map (3430).

[0144] The service device 200 may receive location information of the vehicle and round-trip road data related to the location of the vehicle ( 3510 ).

[0145] The service device 200 may use the location information of the vehicle and the roundabout road data to create a track line along which the vehicle travels in a roundabout road map included in the roundabout road data (3520).

[0146] For example, the processor 210 may create driving points that continuously exist on a ring road using the position information of the vehicle, and may create a trail line by connecting the driving points with a line and mapping the driving points in a ring road map.

[0147] For example, the processor 210 may create driving points of the vehicle continuously existing on the ring road by comparing the vehicle's position information and the ring road positioning information, and may create a trail line by connecting the driving points with a line and mapping the driving points in the ring road map.

[0148] The service device 200 may create a second ring road driving map showing the ring road and the driving path of the vehicle using the ring road map and the trail line (3530).

[0149] The service device 200 may provide a second ring road driving map (3540).

[0150] The service device 200 may receive an optimal driving route in a ring road map (3610).

[0151] The service device 200 may create a third circular road driving map showing a trail line and an optimal driving route in the circular road map.

[0152] The service device 200 may provide a third ring road driving map (3630).

[0153] The service device 200 may receive a vehicle location sharing confirmation message from the user for sharing the location of the vehicle with other users.

[0154] The service device 200 may register the user's vehicle as a shared vehicle in response to the vehicle location sharing confirmation message.

[0155] The service device 200 may transmit location information of a vehicle registered as a shared vehicle.

[0156] The service device 200 may receive location information of another vehicle located on the same roundabout as the user's vehicle, and roundabout data related to the location of the vehicle (3710).

[0157] The service device 200 may create a fourth roundabout road driving map showing the position of the other vehicle in the roundabout road map included in the roundabout road data using the position information of the other vehicle and the roundabout road data ( 3720 ).

[0158] The service device 200 may provide a fourth ring road driving map (3730).

[0159] Figure 4 and Figure 5 : is a diagram showing an example of moving the viewpoint of a surround view video by the operation of a service device in response to an input from a user.

[0160] The display device 300 may sense a user's input for moving a viewpoint of any one or more of the surround view video and / or the plurality of videos.

[0161] Reference Figure 4 , the display device 300 may sense a user's input for moving the viewpoint in a drag direction 4130 along with a user's touch input 4110 and a touch input 4120 .

[0162] The service device 200 may provide a surround view video 4300 having a viewpoint moved from the surround view video 4200 before the user input after the user input based on the plurality of videos and the user's touch inputs 4110 and 4120 .

[0163] refer to Figure 5 , the display device 300 may remotely sense the user's finger gestures and / or finger movements 5110 , 5120 , and 5130 for moving the viewpoint.

[0164] The service device 200 may provide a surround view video 5300 having a viewpoint moved from the surround view video 5200 before the user input after the user input based on the plurality of videos and the user's finger gestures and / or finger movements 5110 , 5120 , and 5130 .

[0165] Figures 6 to 8 : is a diagram showing an example of creating a circular road travel map provided by a service device.

[0166] The service device 200 can use any one or more of multiple videos, surround view videos, vehicle location information, other vehicles' location information, and / or optimal driving routes for a circular road to create a circular road driving map, which includes the path along which the vehicle travels on the circular road, the locations of other vehicles on the circular road, and / or any one or more of the optimal driving lines in the circular road map of the circular road on which the vehicle travels.

[0167] The service device 200 may use the plurality of videos to create a ring road map of the ring road on which the vehicle travels and a track line along which the vehicle travels on the ring road.

[0168] refer to Figure 6 The service device 200 can create a circular road map by extracting and integrating the road width, road slope, road shape, road curvature, relative positions of vehicles on the road, etc. of the circular roads that appear continuously in multiple videos.

[0169] Specifically, when the vehicle is traveling, the service device 200 may gradually create a circular road 6100 around the vehicle captured by multiple cameras using multiple videos, and when the vehicle returns to the starting point, a circular road map 6200 may be created by integrating the circular road 6100 around the vehicle.

[0170] refer to Figure 7 and Figure 8 , the service device 200 can use multiple videos or vehicle position information to determine the first position P1 and the second position P2 of the vehicle, and then use these positions to map the track lines 7100 and 8100 into the ring road map.

[0171] For example, the service device 200 can estimate the direction and speed of the vehicle based on the relationship between the frame change value over time and the immediately previous image (for example, by extracting a vector value), and can determine the current position of the vehicle.

[0172] The service device 200 may provide the circular road map 8000 having the mapped trail lines 8100 , that is, may provide a circular road driving map.

[0173] Although the embodiments of the present disclosure are described in more detail with reference to the accompanying drawings, the present disclosure is not limited to the embodiments and may be modified in various ways without departing from the scope of the present disclosure. Therefore, the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention. Therefore, the above-mentioned embodiments are only examples and should not be interpreted as being restrictive in all aspects. The scope of protection of the present disclosure should be interpreted by the attached claims, and the scope and spirit of the present disclosure should be interpreted as being included in the patent claims of the present disclosure.

Claims

1. A method for processing a video obtained by driving a ring road, the method comprising: A processor receives a plurality of videos obtained by shooting the exterior of the vehicle; receiving, by the processor, a user input for moving a viewpoint of the first surround view video; creating, by the processor, a second surround view video having a viewpoint moved from the first surround view video based on the plurality of videos and the user's input; as well as providing, by the processor, the second surround view video, The first surround view video and the second surround view video display both the exterior of the vehicle and the virtual model of the vehicle through processing of the plurality of videos.

2. The method according to claim 1, further comprising: Receiving, by the processor, one or more of the driving status of the vehicle and the position information of the vehicle; as well as The processor provides the first surround view video or the second surround view video according to any one or more of the driving state of the vehicle and the position information of the vehicle.

3. The method according to claim 2, wherein: Providing the first surround view video or the second surround view video includes: providing the first surround view video or the second surround view video when any one or more conditions are satisfied that the driving state of the vehicle is a stopped state or the position of the vehicle is on a circular road that is a racing road.

4. The method according to claim 3, further comprising: creating, by the processor, a ring road map of the ring road on which the vehicle travels and a track line along which the vehicle travels on the ring road using the plurality of videos; creating, by the processor, a first circular road driving map showing the circular road and a driving path of the vehicle using the circular road map and the trail lines; as well as The first ring road driving map is provided by the processor.

5. The method according to claim 3, further comprising: receiving, by the processor, position information of the vehicle and round-trip road data associated with the position of the vehicle; creating, by the processor, a track line along which the vehicle travels in a roundabout map included in the roundabout data using the position information of the vehicle and the roundabout data; creating, by the processor, a second ring road driving map showing the ring road and a driving path of the vehicle using the ring road map and the trail line; as well as The second ring road driving map is provided by the processor.

6. The method according to claim 5, further comprising: The processor receives the best driving route in the ring road map; creating, by the processor, a third ring road driving map showing the track line and the optimal driving route in the ring road map; as well as The third ring road driving map is provided by the processor.

7. The method according to claim 3, further comprising: receiving, by the processor, position information of another vehicle located on the same roundabout as the vehicle and roundabout data related to the position of the vehicle; creating, by the processor, a fourth circular road travel map showing the position of the other vehicle in a circular road map included in the circular road data using the position information of the other vehicle and the circular road data; as well as The fourth ring road driving map is provided by the processor.

8. The method according to claim 1, wherein: The plurality of videos, the first surround view video, and the second surround view video are any of real-time videos and recorded videos.

9. The method according to claim 8, further comprising: Any one or more of the first surround view video and the second surround view video are transmitted by the processor in a real-time streaming manner.

10. The method according to claim 8, wherein: The first surround view video and the second surround view video are provided as virtual reality videos.

11. A device for processing a video obtained by driving a ring road, the device comprising: A memory configured to store instructions for processing a video obtained by driving the ring road; as well as a processor configured to execute the instructions, Wherein, the instructions are configured to, when executed by the processor, cause the device to: receiving a plurality of videos obtained by photographing an exterior of a vehicle; receiving a user input for moving a viewpoint of the first surround view video; creating a second surround view video having a viewpoint moved from the first surround view video based on the plurality of videos and the user's input; and providing the second surround view video, The first surround view video and the second surround view video display both the exterior of the vehicle and the virtual model of the vehicle through processing of the plurality of videos.

12. The device according to claim 11, wherein The processor is configured to: receiving one or more of the driving status of the vehicle and the location information of the vehicle, and The first surround view video or the second surround view video is provided according to any one or more of a driving state of the vehicle and the position information of the vehicle.

13. The device according to claim 12, wherein: The processor is configured to provide the first surround-view video or the second surround-view video when any one or more conditions are satisfied that the driving state of the vehicle is a stopped state or the position of the vehicle is on a roundabout road that is a race road.

14. The device according to claim 13, wherein: The processor is configured to: creating a ring road map of the ring road on which the vehicle travels and a track line along which the vehicle travels on the ring road using the plurality of videos, creating a first ring road driving map showing the ring road and the driving path of the vehicle using the ring road map and the trail line, and The first ring road driving map is provided.

15. The device according to claim 13, wherein: The processor is configured to: receiving position information of the vehicle and ring road data associated with the position of the vehicle, creating a track line along which the vehicle travels in a ring road map included in the ring road data using the position information of the vehicle and the ring road data, creating a second ring road driving map showing the ring road and the driving path of the vehicle using the ring road map and the trail line, and The second ring road driving map is provided.

16. The device according to claim 15, wherein: The processor is configured to: receiving an optimal driving route in the ring road map; creating a fourth ring road driving map showing the track line and the optimal driving route in the ring road map, and A fourth ring road driving map is provided.

17. The device according to claim 13, wherein: The processor is configured to: receiving position information of another vehicle located on the same circular road as the vehicle and circular road data related to the position of the vehicle; creating a third ring road travel map showing the position of the other vehicle in a ring road map included in the ring road data using the position information of the other vehicle and the ring road data, and A third ring road driving map is provided.

18. The device according to claim 11, wherein The plurality of videos, the first surround view video, and the second surround view video are any of real-time videos and recorded videos.

19. The device according to claim 18, wherein: The processor is configured to transmit any one or more of the first surround view video and the second surround view video in a real-time streaming manner.

20. The device according to claim 18, wherein The first surround view video and the second surround view video are provided as virtual reality videos.

Images