Processing system and processing method

Abstract

The purpose of the present invention is to create added value by utilizing a surround view. A processing system 1 comprises: an acquisition unit that acquires first moving image data captured by a plurality of cameras 12 provided on the outer peripheral part of a vehicle 10 while the vehicle 10 is traveling; a storage unit that stores the first moving image data acquired by the acquisition unit; and a generation unit that generates second moving image data of a surround view, which is a composite image looking down on the vehicle 10 from the outside, on the basis of the first moving image data stored in the storage unit.

Description

[0001] [Document name] Statement

[0002] [Title of invention] Processing system and processing method

[0003] [Technical Field]

[0004] [. 0 0 1] The present invention relates to a processing system and a processing method.

[0005] [Background technology]

[0006]

[002] In recent years, for example, as disclosed in Patent Document 1, a technology relating to display control for assisting a vehicle driver in driving has been proposed.

[0007] [Prior art documents]

[0008] [Patent documents]

[0009]

〇 0 0 3

[0010] [Patent Document 1] U.S. Patent Application Publication No. 2015 / 0097860

[0011] Summary of the Invention

[0012] [Problem to be solved by the invention]

[0013] [0 0 4] Display control that displays a surround view may be used to assist the driver when parking, etc. Surround view is a composite image that shows a bird's-eye view of the vehicle from the outside. For example, by performing driving operations while viewing the surround view, the driver can park smoothly as if they were looking down from the outside. Here, it is desirable to create added value by utilizing the surround view.

[0014]

[0005] Therefore, in view of these problems, the present invention aims to provide a processing system and a processing method that can create added value by utilizing surround view.

[0015] [Means for solving the problem]

[0016] [0 0 0 6] In order to solve the above problem, the processing system includes an acquisition unit that acquires first video data obtained by a plurality of cameras provided on the periphery of the vehicle while the vehicle is traveling, a memory unit that stores the first video data acquired by the acquisition unit, and a generation unit that generates second surround view video data, which is a composite image of the vehicle as seen from above from the outside, based on the first video data stored in the memory unit.

[0017] [0 0 0 7] In order to solve the above problem, the processing method includes an acquisition unit of the processing system acquiring first video data obtained by a plurality of cameras provided on the periphery of the vehicle while the vehicle is traveling, a memory unit of the processing system storing the first video data acquired by the acquisition unit, and a generation unit of the processing system generating second surround view video data, which is a composite image of the vehicle as viewed from the outside, based on the first video data stored in the memory unit.

[0018] [Effects of the Invention]

[0019]

[0008] According to the present invention, it is possible to create added value by utilizing surround view.

[0020] [Brief explanation of the drawings]

[0021]

〇 0 0 9

[0022] [Figure 1] Schematic diagram showing the general configuration of a processing system according to an embodiment of the present invention.

[0023] FIG. 2 is a block diagram showing an example of the functional configuration of a processing device according to an embodiment of the present invention.

[0024] [Figure 3] A block diagram showing an example of the functional configuration of a server relating to an embodiment of the present invention.

[0025] [Figure 4] A block diagram showing an example of the functional configuration of a user terminal according to an embodiment of the present invention.

[0026] [Figure 5] A figure showing an example of a surround view in an embodiment of the present invention.

[0027] [Figure 6] A flowchart showing an example of the flow of the accumulation process of first video data performed by a processing device related to an embodiment of the present invention.

[0028] [Figure 7] A flowchart showing an example of the flow of the first video data transmission process performed by a processing device related to an embodiment of the present invention.

[0029] [Figure 8] A flowchart showing an example of the flow of the second video data generation process performed by the server in an embodiment of the present invention.

[0030] [Figure 9] A flowchart showing an example of the flow of the second video data transmission process performed by the server in an embodiment of the present invention.

[0031] [Figure 10] A figure showing an example of processing the second video data shown in Figure 5.

[0032] [Figure 11] A figure showing an example of processing the second video data shown in Figure 5.

[0033] DETAILED DESCRIPTION OF THE INVENTION

[0034]

[0010] Preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings. The dimensions, materials, and other specific values ​​shown in the embodiments are merely examples for facilitating understanding of the invention, and do not limit the present invention unless otherwise specified. In this specification and drawings, elements having substantially the same functions and configurations are designated by the same reference numerals to avoid redundant explanation, and elements not directly related to the present invention are not shown.

[0035]

[0011] <Configuration of processing system> The configuration of a processing system 1 according to an embodiment of the present invention will be described with reference to Figures 1 to 4.

[0036]

[0012] Figure 1 is a schematic diagram showing the general configuration of a processing system 1. As shown in Figure 1, the processing system 1 includes a vehicle 10, a server 20, and a user terminal 30. The vehicle 10, the server 20, and the user terminal 30 can communicate with each other via a wireless communication network N1.

[0037]

[0013] Note that, in FIG. 1, one vehicle 10 is shown for ease of understanding, but in reality, the processing system 1 includes a plurality of vehicles 10. Also, in FIG. 1, one user terminal 30 is shown for ease of understanding, but in reality, the processing system 1 includes a plurality of user terminals 30.

[0038]

[0014] As shown in FIG. 1, a vehicle 10 includes a display device 11, a plurality of cameras 12, and a processing device 13.

[0039]

[0015] The drive source of the vehicle 10 is not particularly limited. For example, the vehicle 10 may be equipped with only a motor as a drive source, only an engine as a drive source, or both a motor and an engine as drive sources.

[0040]

[0016] The display device 11 is a device that visually displays various types of information. Examples of the display device 11 include a liquid crystal display.

[0041]

[0017] The cameras 12 are provided on the outer periphery of the vehicle 10 and capture images of the area around the vehicle 10. In the example of FIG. 1, four cameras 12 are provided at the front, rear, left side, and right side of the vehicle 10. The front camera 12 captures images in front of the vehicle 10. The rear camera 12 captures images behind the vehicle 10. The left camera 12 captures images on the left side of the vehicle 10. The right camera 12 captures images on the right side of the vehicle 10. Note that data obtained by each of the multiple cameras 12 is used to display a surround view, as described below. However, the number and arrangement of the cameras 12 are not limited to the example of FIG. 1. For example, there may be more cameras 12 than in the example of FIG. 1.

[0018] The processing device 13 includes a CPU (Central Processing Unit), which is an arithmetic processing device, a ROM (Read Only Memory), which is a memory element that stores programs used by the CPU, calculation parameters, etc., and a RAM (Read Only Memory), which is a memory element that temporarily stores parameters that change as the CPU executes. The processing device 13 may be, for example, a single device, or may be divided into multiple devices. When the processing device 13 is divided into multiple devices, some of the functions described below may be shared by different devices.

[0042]

[0019] Figure 2 is a block diagram showing an example of the functional configuration of the processing device 13. As shown in Figure 2, the processing device 13 includes, for example, an acquisition unit 13a, a communication unit 13b, a processing unit 13c, and a storage unit 13d.

[0043]

[0020] The acquisition unit 13a acquires information from each device in the vehicle 10. For example, the acquisition unit 13a acquires information from the camera 12. In this specification, the acquisition of information may include the extraction or generation (e.g., calculation) of information.

[0044]

[0021] The communication unit 13b performs wireless communication with devices external to the vehicle 10 via the communication network N1. Specifically, as will be described later, the communication unit 13b performs wireless communication with the server 20 via the communication network N1, thereby transmitting data obtained by each of the multiple cameras 12 (specifically, first video data, which will be described later) to the server 20.

[0045]

[0022] The processing unit 13c performs various processes. For example, the processing unit 13c performs processes related to display on the display device 11. In particular, the processing unit 13c can use data obtained by each of the multiple cameras 12 to display a surround view on the display device 11, as will be described later.

[0046]

[0023] The memory unit 13d stores various information.

[0047]

[0024] The server 20 in Fig. 1 includes a CPU, which is an arithmetic processing unit; a ROM, which is a storage element for storing programs and calculation parameters used by the CPU; and a RAM, which is a storage element for temporarily storing parameters that change as the CPU executes. The server 20 may be, for example, a single server, or may be divided into multiple servers. When the server 20 is divided into multiple servers, some of the functions described below may be shared by separate devices.

[0048]

[0025] Figure 3 is a block diagram showing an example of the functional configuration of the server 20. As shown in Figure 3, the server 20 includes, for example, a communication unit 20a, a generation unit 20b, and a storage unit 20c.

[0049]

[0026] The communication unit 20a performs wireless communication with devices external to the server 20 via the communication network N1. Specifically, as described below, the communication unit 20a performs wireless communication with the vehicle 10 via the communication network N1 to receive data obtained by each of the multiple cameras 12 (specifically, first video data described below) from the vehicle 10.

[0050]

[0027] The generation unit 20b generates data (specifically, second video data described later) to be transmitted to the user terminal 30 based on data received from the vehicle 10 (specifically, first video data described later). The data generated by the generation unit 20b is transmitted to the user terminal 30 by the communication unit 20a.

[0051]

[0028] The memory unit 20c stores various information.

[0029] The user terminal 30 in Fig. 1 is, for example, a terminal such as a smartphone or personal computer owned by the user of the vehicle 10.

[0052]

[0030] The user terminal 30 includes a CPU, which is an arithmetic processing unit; a ROM, which is a storage element that stores programs and calculation parameters used by the CPU; and a RAM, which is a storage element that temporarily stores parameters that change as the CPU executes. The user terminal 30 may be, for example, a single unit, or may be divided into multiple units. When the user terminal 30 is divided into multiple units, some of the functions described below may be shared by separate devices.

[0053]

[0031] Figure 4 is a block diagram showing an example of the functional configuration of the user terminal 30. As shown in Figure 4, the user terminal 30 includes, for example, a communication unit 30a, a processing unit 30b, and a storage unit 30c.

[0054]

[0032] The communication unit 30a performs wireless communication with devices external to the user terminal 30 via the communication network N1. Specifically, as will be described later, the communication unit 30a performs wireless communication with the server 20 via the communication network N1 to receive data generated by the generation unit 20b of the server 20 (specifically, second video data, which will be described later) from the server 20.

[0055]

[0033] The processing unit 30 performs various processes. For example, the processing unit 30b performs processes related to display by the user terminal 30.

[0056]

[0034] The memory unit 30c stores various information.

[0057]

[0035] <Operation of the processing system> With reference to Figures 5 to 11, the operation of the processing system 1 according to the embodiment of the present invention will be described.

[0058]

[0036] As described above, the processing unit 13c of the processing device 13 of the vehicle 10 can display a surround view on the display device 11 using data obtained by each of the multiple cameras 12.

[0059]

[0037] Figure 5 is a diagram showing an example of a surround view. As shown in Figure 5, the surround view is a composite image that shows the vehicle 10 as if it were viewed from the outside. In other words, the surround view is a composite image that shows the model M1 of the vehicle 10 and its surroundings from a perspective that simulates a bird's-eye view of the vehicle 10 from the outside. Specifically, the processing unit 13c performs a synthesis process that stitches together image data obtained by each camera 12, and processes the flat image into a bowl-shaped three-dimensional image in the virtual space. Furthermore, the processing unit 13c sets the viewpoint in the virtual space to face near the center of the three-dimensional image, thereby generating an image that shows the surroundings including the front, rear, left side, and right side of the vehicle 10. The processing unit 13c then displays a model M1, such as a 3D model, that shows the vehicle 10 in the generated image. In the example of FIG. 5, a 3D model is used as the model M1 representing the vehicle 10. The model M1 representing the vehicle 10 is stored in advance in, for example, a storage unit 13 d.

[0060]

[0038] The surround view is primarily used to assist the driver in parking. For example, when the driver performs a specific operation, the processing unit 13c displays the surround view on the display device 11. Examples of the specific operation include an operation using a specific operation unit in the vehicle 10 (for example, pressing a button), or switching the shift position to a position that reverses the vehicle 10 (for example, R range). The driver can then perform driving operations while viewing the surround view, thereby smoothly parking the vehicle. For example, the driver can change the viewpoint of the surround view (i.e., the direction from which the vehicle 10 is viewed in the surround view). This allows the driver to park by switching the viewpoint of the surround view to a desired viewpoint.

[0061]

[0039] According to the processing system 1 of this embodiment, as will be described later, by further utilizing the surround view in a way other than the above-mentioned way of using it, it is possible to create added value. Below, examples of processing performed by each device of the processing system 1 will be explained in order.

[0062]

[0040] Fig. 6 is a flow chart showing an example of the flow of the accumulation process of first video data performed by the processing device 13. Step S101 in Fig. 6 corresponds to the start of the process flow shown in Fig. 6. The process flow shown in Fig. 6 starts, for example, when a specific operation (such as pressing a button or voice input) is performed by the driver or passenger of the vehicle 10, and is executed while the vehicle 10 is traveling.

[0063]

[0041] When the processing flow shown in FIG. 6 starts, in step S102, the acquisition unit 13a acquires first video data obtained by each of the multiple cameras 12.

[0064]

[0042] As described above, since each camera 12 is provided on the outer periphery of the vehicle 10, the first video data obtained by each camera 12 is video data showing the area around the vehicle 10. For example, the acquisition unit 13a acquires first video data showing the area in front of the vehicle 10 from the front camera 12. Also, for example, the acquisition unit 13a acquires first video data showing the area behind the vehicle 10 from the rear camera 12. Also, for example, the acquisition unit 13a acquires first video data showing the left side of the vehicle 10 from the left camera 12. Also, for example, the acquisition unit 13a acquires first video data showing the right side of the vehicle 10 from the right camera 12.

[0065]

[0043] In step S102, specifically, the acquisition unit 13a acquires first moving image data having a predetermined time width from each camera 12.

[0066]

[0044] After step S102, in step S103, the processing unit 13c stores the first video data acquired by the acquisition unit 13a in step S102 in the memory unit 13d, and the process returns to step S102.

[0067]

[0045] As described above, in step S103, the memory unit 13d stores the first video data acquired by the acquisition unit 13a in step S102. Then, in the processing flow shown in Fig. 6, steps S102 and S103 are repeated. Therefore, while the vehicle 10 is traveling, the first video data acquired by each of the multiple cameras 12 is accumulated in the memory unit 13d over time. Note that the memory unit 13d may store the acquired first video data as it is over time, or may store the data after, for example, changing the order of the data.

[0068]

[0046] Fig. 7 is a flowchart showing an example of the flow of the first video data transmission process performed by the processing device 13. Step S201 in Fig. 7 corresponds to the start of the process flow shown in Fig. 7. Step S204 in Fig. 7 corresponds to the end of the process flow shown in Fig. 7. The process flow shown in Fig. 7 starts, for example, when the vehicle 10 finishes traveling (for example, when the vehicle 10 stops and the ignition is turned off).

[0069]

[0047] When the processing flow shown in Fig. 7 starts, in step S202, the acquisition unit 13a determines whether or not a command to transmit the first video data has been acquired.

[0048] As will be described later, in the processing system 1, the first video data stored in the vehicle 10 by the storage process of the first video data is transmitted to the server 20, second video data of the surround view is generated based on the first video data, and the user terminal 30 can download the second video data from the server 20. As a result, as will be described later, added value is created by utilizing the surround view.

[0070]

[0049] Here, the driver of the vehicle 10 can select whether or not to transmit the first video data to the server 20. The command to transmit the first video data is a command to transmit the first video data accumulated in the memory unit 13d during the current trip to the server 20. For example, the driver of the vehicle 10 can input the command to transmit the first video data to the processing device 13 by performing a specific operation using an input device in the vehicle 10.

[0071]

[0050] If it is determined that the command to send the first moving image data has not been received (step S202 / NO), the first moving image data is not transmitted, and the processing flow shown in Fig. 7 ends. On the other hand, if it is determined that the command to send the first moving image data has been received (step S202 / YES), the processing proceeds to step S203.

[0072]

[0051] If the answer is YES in step S202, in step S203, the communication unit 13b transmits the first video data accumulated in the memory unit 13d during the current run to the server 20, and the processing flow shown in Figure 7 ends.

[0073]

[0052] For example, when the driver of the vehicle 10 inputs a command to transmit the first video data to the processing device 13, the driver may specify a portion of the first video data stored in the memory unit 13d (for example, first video data from a specific time period) as the first video data to be transmitted to the server 20. In this case, in step S203, the communication unit 13b transmits to the server 20 only the portion of the first video data specified by the driver from the first video data stored in the memory unit 13d during the current trip.

[0074]

[0053] In the above example, the first video data is transmitted when a command to transmit the first video data is received. However, the communication unit 13 b may automatically transmit the first video data at predetermined time intervals while the vehicle 10 is traveling.

[0075]

[0054] Fig. 8 is a flowchart showing an example of the flow of the second video data generation process performed by the server 20. Step S301 in Fig. 8 corresponds to the start of the process flow shown in Fig. 8.

[0076]

[0055] When the processing flow shown in FIG. 8 starts, in step S302, the communication unit 20a determines whether or not it has received the first video data transmitted by the communication unit 13b of the processing device 13 of the vehicle 10.

[0077]

[0056] If it is determined that the first moving image data has not been received (step S302 / NO), step S302 is repeated. On the other hand, if it is determined that the first moving image data has been received (step S302 / YES), the process proceeds to step S303. In the server 20, the received first moving image data is stored in the memory unit 20c.

[0078]

[0057] If the answer is YES in step S302, in step S303, the generation unit 20b generates second surround view video data, which is a composite image of the vehicle 10 as if it were viewed from the outside, based on the first video data.

[0079]

[0058] In step S303, the generation unit 20b generates, for example, the surround view video data shown in FIG. 5 as the second video data. For example, the generation unit 20b performs a synthesis process to connect the first video data obtained by each camera 12, and processes the planar video data into bowl-shaped three-dimensional video data in the virtual space. Furthermore, the generation unit 20b generates video data representing the surroundings, including the front, rear, left side, and right side of the vehicle 10, by setting the viewpoint in the virtual space to face near the center of the three-dimensional video data. Then, the generation unit 20b displays a model M1, such as a 3D model, representing the vehicle 10 on the video data generated in this way. The model M1 representing the vehicle 10 is stored in advance in, for example, the storage unit 20c.

[0080]

[0059] After step S303, in step S304, the generation unit 20b stores the second video data generated in step S303 in the memory unit 20c, and the process returns to step S302.

[0081]

[0060] As described above, in step S304, the memory unit 20c stores the second video data generated by the generator 20b in step S303. In the processing flow shown in Fig. 8, steps S302, S303, and S304 are repeated. Therefore, each time first video data is transmitted from each vehicle 10 to the server 20, second video data is generated based on the first video data and stored in the memory unit 20c.

[0082]

[0061] Fig. 9 is a flowchart showing an example of the flow of the second video data transmission process performed by the server 20. Step S401 in Fig. 9 corresponds to the start of the process flow shown in Fig. 9.

[0083]

[0062] When the processing flow shown in FIG. 9 starts, in step S402, the communication unit 20a determines whether or not a request to send second video data has been received.

[0084]

[0063] Here, the user of the user terminal 30 can download the desired second video data from the server 20 to the user terminal 30. A request to send the second video data is a request to download the desired second video data from the server 20 to the user terminal 30. For example, the user of the user terminal 30 can input a request to send the second video data to the user terminal 30 by performing a specific operation using an input device provided on the user terminal 30. When a request to send the second video data is input to the user terminal 30, the user terminal 30 transmits the request to send to the server 20.

[0085]

[0064] If it is determined that a request to send the second video data has not been received (step S402 / NO), the second video data is not sent and step S402 is repeated. On the other hand, if it is determined that a request to send the second video data has been received (step S402 / YES), the process proceeds to step S403.

[0086]

[0065] If the determination in step S402 is YES, in step S403, the communication unit 20a transmits the second video data specified in the received transmission request from the second video data stored in the memory unit 20c to the communication unit 30a of the user terminal 30, and the process returns to step S402. Note that in the user terminal 30, the second video data received by the communication unit 30a is stored in the memory unit 30c.

[0087]

[0066] For example, of the second video data stored in the server 20, only the second video data generated based on the first video data transmitted from the vehicle 10 that is pre-linked to the user of the user terminal 30 can be downloaded to the user terminal 30. In this case, the user can download to the user terminal 30 the second video data generated based on the first video data acquired while the user was driving the vehicle 10. Therefore, the user can download the second video data of a surround view that provides a bird's-eye view from the outside of the vehicle 10 that the user actually drove in the past.

[0088]

[0067] When the second video data is downloaded from the server 20 to the user terminal 30, the user of the user terminal 30 can play and view the downloaded second video data on the user terminal 30. The user can also share the downloaded second video data with others via a social networking service. In this way, the user can enjoy the second video data by watching it themselves or sharing it with others.

[0089]

[0068] Here, the generation unit 20b of the server 20 may generate the second video data in a data format that allows processing of the second video data after generation. In this case, after the second video data is downloaded from the server 20 to the user terminal 30, the user of the user terminal 30 can process the downloaded second video data. Furthermore, the processed second video data can be shared with others via a social networking service. Below, an example of processing the second video data will be described with reference to Fig. 10 and Fig. 11. Figs. 10 and 11 are diagrams showing an example of processing the second video data shown in Fig. 5.

[0090]

[0069] For example, as shown in Fig. 10, the user of the user terminal 30 may be able to switch the viewpoint of the downloaded second video data shown in Fig. 5. In this case, the generation unit 20b of the server 20 generates the second video data in a data format that allows the viewpoint to be switched as part of processing the second video data after generation. By downloading such second video data to the user terminal 30, the user of the user terminal 30 can switch the viewpoint of the downloaded second video data.

[0091]

[0070] For example, as shown in FIG. 11, the user of the user terminal 30 may be able to enlarge the downloaded second video data shown in FIG. 5. The user of the user terminal 30 may also be able to reduce the downloaded second video data shown in FIG. 5. In this case, the generation unit 20b of the server 20 generates the second video data in a data format that allows enlargement and reduction as processing of the second video data after generation. By downloading such second video data to the user terminal 30, the user of the user terminal 30 can enlarge or reduce the downloaded second video data.

[0092]

[0071] The generation unit 20b of the server 20 may generate the second video data in a data format that allows for processing other than the above-described processing after the second video data is generated. In other words, the user of the user terminal 30 may be able to process the downloaded second video data in a manner other than the above-described processing. For example, the user of the user terminal 30 may be able to process the downloaded second video data by adding objects such as text, figures, or symbols. Furthermore, for example, the user of the user terminal 30 may be able to process the downloaded second video data by adjusting the color or brightness.

[0093]

[0072] Above, with reference to Fig. 5 to Fig. 11, examples of processing performed in the processing system 1 have been described. However, the processing performed in the processing system 1 may be modified from the processing examples described above.

[0094]

[0073] For example, the allocation of the processing performed in the processing system 1 among the processing device 13 of the vehicle 10, the server 20, and the user terminal 30 may be different from the example above. For example, part of the processing performed by the server 20 may be allocated to the processing device 13 of the vehicle 10. For example, the processing device 13 of the vehicle 10 may perform part or all of the processing to generate the second video data. In this case, the second video data may be transmitted from the processing device 13 of the vehicle 10 to the user terminal 30.

[0095]

[0074] <Effects of the Processing System> The effects of the processing system 1 according to the embodiment of the present invention will be described.

[0096]

[0075] The processing system 1 includes an acquisition unit 13a that acquires first video data obtained by a plurality of cameras 12 installed on the periphery of the vehicle 10 while the vehicle 10 is traveling, a memory unit 13d that stores the first video data acquired by the acquisition unit 13a, and a generation unit 20b that generates surround-view second video data, which is a composite image of the vehicle 10 as seen from above from the outside, based on the first video data stored in the memory unit 13d. This allows users to enjoy the second video data by viewing it themselves later or sharing it with others. In this way, the processing system 1 can create added value by utilizing the surround view.

[0097]

[0076] Preferably, in the processing system 1, the generation unit 20b generates the second video data in a data format that allows the second video data to be processed after generation. This allows the user to process the second video data to create the video data of their choice. Therefore, the added value created by utilizing surround view can be increased.

[0098]

[0077] Preferably, in the processing system 1, the processing includes switching the viewpoint. This allows the user to change the viewpoint of the second video data to suitably edit the second video data into preferred video data. This makes it possible to more appropriately enhance the added value created by utilizing surround view.

[0099]

[0078] Preferably, in the processing system 1, the processing includes enlargement and reduction. This allows the user to appropriately edit the second video data into the video data of their choice by enlarging or reducing the second video data. This allows the added value created by utilizing surround view to be more appropriately enhanced.

[0100]

[0079] Preferably, the processing system 1 includes a vehicle 10, a server 20, and a user terminal 30. The vehicle 10 includes a processing device 13 including an acquisition unit 13a, a memory unit 13d, and a first communication unit (in the above example, communication unit 13b) that transmits the first video data stored in the memory unit 13d. The server 20 includes a second communication unit (in the above example, communication unit 20a) that receives the first video data transmitted by the first communication unit and a generation unit 20b, and the second communication unit transmits the second video data. The user terminal 30 includes a third communication unit (in the above example, communication unit 30a) that receives the second video data transmitted by the second communication unit. This allows the user to enjoy the second video data by watching it by himself or by sharing it with others. In this way, the processing system 1 allows the creation of added value by utilizing surround view.

[0101]

[0080] Although the preferred embodiments of the present invention have been described above with reference to the accompanying drawings, it goes without saying that the present invention is not limited to the above-described embodiments, and that various modifications and alterations within the scope of the claims also fall within the technical scope of the present invention.

[0102]

[0081] For example, the processes described herein using flowcharts do not necessarily have to be performed in the order shown in the flowcharts. Some processing steps may be performed in parallel. Additional processing steps may also be employed, and some processing steps may be omitted.

[0103]

[0082] For example, the series of processes performed by the processing device 13 described above may be realized by software, hardware, or a combination of software and hardware. The programs constituting the software are stored in advance in a storage medium provided inside or outside the information processing device.

[0104]

[0083] For example, the series of processes performed by the server 20 described above may be implemented using software, hardware, or a combination of software and hardware. The programs constituting the software are stored in advance in a storage medium provided inside or outside the information processing device.

[0105]

[0084] For example, the series of processes performed by the user terminal 30 described above may be realized by software, hardware, or a combination of software and hardware. The programs constituting the software are stored in advance in a storage medium provided inside or outside the information processing device.

[0106] [Explanation of symbols]

[0107] [ 0 0 8 5 ]

[0108] 1 Processing System

[0109] 1. Vehicle

[0110] 11. Display device

[0111] 12. Camera

[0112] 13. Processing device

[0113] 13a. Acquisition unit

[0114] 13b. Communication unit (First communication unit)

[0115] 13c. Processing unit

[0116] 13d. Memory unit

[0117] 2. Server

[0118] 20a. Communication unit (Second communication unit)

[0119] 20. Generation unit

[0120] 20c. Memory unit

[0121] 3. User terminal

[0122] 30a. Communication unit (Third communication unit)

[0123] 30b. Processing unit

[0124] 30c. Memory unit

[0125] M1. Model

[0126] N1. Communication network

Claims

【Document Name】 Claims

1. A processing system comprising: an acquisition unit (13a) that acquires first video data respectively obtained by a plurality of cameras (12) provided on an outer peripheral portion of the vehicle (10) during traveling of the vehicle (10); a storage unit (13d) that stores the first video data acquired by the acquisition unit (13a); and a generation unit (20b) that generates second video data of a surround view, which is a composite image obtained by overlooking the vehicle (10) from the outside, based on the first video data stored in the storage unit (13d).

2. The processing system according to claim 1, wherein the generation unit (20b) generates the second video data in a data format capable of executing processing of the second video data after generation of the second video data.

3. The processing system according to claim 2, wherein the processing includes switching of viewpoints.

4. The processing system according to claim 2, wherein the processing includes enlargement and reduction.

5. The processing system (1) includes the vehicle (10), a server (20), and a user terminal (30), the vehicle (10) includes a processing device (13) including the acquisition unit (13a), the storage unit (13d), and a first communication unit (13b) that transmits the first video data stored in the storage unit (13d), the server (20) includes a second communication unit (20a) that receives the first video data transmitted by the first communication unit (13b) and the generation unit (20b), the second communication unit (20a) transmits the second video data, and the user terminal (30) includes a third communication unit (30a) that receives the second video data transmitted by the second communication unit (20a). The processing system according to any one of claims 1 to 4.

6. A processing method, wherein an acquisition unit (13a) of a processing system (1) acquires first video data respectively obtained by a plurality of cameras (12) provided on an outer periphery of a vehicle (10) while the vehicle (10) is traveling, a storage unit (13d) of the processing system (1) stores the first video data acquired by the acquisition unit (13a), and a generation unit (20b) of the processing system (1) generates second video data of a surround view, which is a composite image as if the vehicle (10) is viewed from above externally, based on the first video data stored in the storage unit (13d).

Images