Panoramic situation acquisition method and system for immersive performance

Abstract

The invention discloses a panoramic situation acquisition method and system for immersive performance, and the method comprises the steps: enabling each vehicle to be provided with a camera for collecting the video of a rear vehicle, carrying out the recognition of the collected video, distributing the collected video to the recognized vehicle and the vehicle receiving the video, recognizing the vehicles in the video, taking the vehicle as the center, and obtaining the panoramic situation of the vehicle. And capturing a picture containing the surrounding vehicle, and displaying the picture. And after the identified vehicle receives the video distribution connection, a comparison request message is returned, after all the vehicles distributing the videos receive the comparison request message, the pixel quantity occupied by the identified vehicle is compared, and the vehicle with the maximum pixel quantity distributes the videos to the identified vehicle. The technical scheme of the invention participates in cooperation of numerous vehicles in performance, and early warning and cooperation of dangerous driving are realized. And the front vehicle sends the panoramic video to the rear vehicle, so that the equipment cost is reduced, the rear vehicle can obtain the traffic information around the vehicle and the position of the vehicle, and the driving safety is ensured.

Description

Technical Field

[0001] This application belongs to the technical field of vehicle safety operation during immersive performances, and particularly relates to a method and system for obtaining panoramic situation of immersive performances. Background Art

[0002] With the rapid development of China's economy, people's lives have undergone earth-shaking changes, and cultural tourism activities are increasingly popular among ordinary people. The steady growth of residents' income and the continuous increase in disposable income enable people to have more funds for leisure and entertainment consumption. The consumption structure has also been continuously upgraded, shifting from meeting basic material needs to pursuing spiritual and cultural enjoyment, and cultural tourism exactly fits this trend.

[0003] Among numerous cultural and tourism activities, immersive performance activities are very popular. Immersive performances redefine the relationship between the audience and the performance, enabling the audience to be more immersed in the performance environment and enjoy the interactive experience. The audience is no longer a passive recipient, but can freely shuttle through the plot, interact with the actors, and experience a unique dramatic world. The application of immersive performances in the field of drama is very extensive, and they can be performed not only in theaters, but also in non-traditional theater spaces such as factories, garages, streets, and shopping malls after transformation. This form greatly stimulates the innovation potential of drama performances, becomes a new performance format, and promotes the development of the "experience economy".

[0004] In immersive performance activities, multiple performance vehicles are often required. Both the performance and the audience are on the vehicles. Actions such as the audience waving ribbons during interaction may affect the driver's line of sight of the vehicle, posing certain safety hazards. To avoid this phenomenon, the vehicle can be installed with omnidirectional cameras to fully display the surrounding scenes, facilitating the driver to observe the surroundings and make correct judgments. However, installing cameras omnidirectionally will result in higher equipment costs.

[0005] In addition, even if the vehicle is installed with omnidirectional cameras, it is only the observation result from the perspective of this vehicle, lacking a reference to other surrounding vehicles, and unable to determine the specific position of this vehicle in the entire performance scene. Summary of the Invention

[0006] The purpose of this application is to provide a method and system for obtaining panoramic situation of immersive performances, which can obtain panoramic situation with the least number of cameras while reducing equipment costs.

[0007] A method for obtaining panoramic situation of immersive performances includes: Each vehicle installs a camera for collecting videos of the following vehicle, performs vehicle recognition on the collected videos, and distributes the collected videos to the recognized vehicles; The vehicle that receives the video identifies the vehicles in the video, takes a picture centered on its own vehicle that includes the surrounding vehicles, and displays it.

[0008] Further, the vehicle identification of the collected video and the distribution of the collected video to the identified vehicles include: Perform vehicle identification on the collected video, and cut out the picture containing the identified vehicles from the collected video and distribute it to the identified vehicles.

[0009] Further, the panoramic situation acquisition method for immersive performances further includes: Perform driving risk identification on the collected video, and send an alarm to the vehicle with driving risk when the driving risk is identified.

[0010] Further, the vehicle identification of the collected video and the distribution of the collected video to the identified vehicles include: Perform vehicle identification on the collected video. If the pixels occupied by the identified vehicle in the picture exceed the set threshold, then distribute the collected video to the identified vehicle, otherwise do not distribute.

[0011] Further, the vehicle identification of the collected video and the distribution of the collected video to the identified vehicles include: After receiving the distributed video connection, the identified vehicle returns a comparison request message; After receiving the comparison request message, all the vehicles that distribute the video compare the pixel amounts occupied by the identified vehicles, and the vehicle with the largest pixel amount distributes the video to the identified vehicle.

[0012] This application also proposes a panoramic situation acquisition system for immersive performances. The panoramic situation acquisition system for immersive performances includes at least two vehicles participating in the performance, where: Each vehicle installs a camera for collecting the video of the vehicle behind, performs vehicle identification on the collected video, and distributes the collected video to the identified vehicles; The vehicle that receives the video identifies the vehicles in the video, takes a picture centered on its own vehicle that includes the surrounding vehicles, and displays it.

[0013] Further, the vehicle performs vehicle identification on the collected video and distributes the collected video to the identified vehicles, and performs the following operations: Perform vehicle identification on the collected video, and cut out the picture containing the identified vehicles from the collected video and distribute it to the identified vehicles.

[0014] Further, the vehicle also performs the following operations: Identify driving risks for the collected videos. When a driving risk is identified, send an alarm to the vehicle with the driving risk.

[0015] Further, the vehicle identifies the vehicle for the collected video, distributes the collected video to the identified vehicle, and performs the following operations: Identify the vehicle for the collected video. If the pixels occupied by the identified vehicle in the picture exceed the set threshold, distribute the collected video to the identified vehicle; otherwise, do not distribute.

[0016] Further, the vehicle in the panoramic situation acquisition system of the immersive performance also performs the following operations: After receiving the distributed video connection, the identified vehicle returns a comparison request message; After receiving the comparison request message, all vehicles that distribute the video compare the size of the pixel amount occupied by the identified vehicle, and the vehicle with the largest pixel amount distributes the video to the identified vehicle.

[0017] An immersive performance panoramic situation acquisition method and system proposed in this application enable many vehicles participating in the performance to cooperate to achieve early warning and cooperation for dangerous driving. The front vehicle sends the panoramic video to the rear vehicle, reducing the equipment cost. The rear vehicle can obtain the traffic information around its own vehicle and its own location to ensure driving safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 It is a flowchart of the immersive performance panoramic situation acquisition method of this application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0019] In order to make the objectives, technical solutions and advantages of this application clearer, the following further describes this application in detail with reference to the drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain this application and are not used to limit this application.

[0020] This application is applicable to immersive performance scenarios. Actors perform on the top of the vehicle, and the audience also participates in the activity by taking a vehicle or on both sides of the road. A camera for collecting the video of the rear vehicle is installed at the roof tail of each vehicle participating in the performance, and the traffic situation behind can be obtained. Each vehicle registers with the management platform, including the IP address and license plate of each vehicle. Therefore, the management platform records the IP address and license plate of each vehicle for information communication between vehicles.

[0021] Embodiment 1: As Figure 1 shown, a method for acquiring a panoramic situation of an immersive performance is proposed, including: Step S1: Each vehicle installs a camera for collecting the video of the rear vehicle, identifies the vehicle for the collected video, and distributes the collected video to the identified vehicle.

[0022] In this embodiment, cameras are installed on the participating vehicles. The cameras face backward and can collect the overall traffic conditions behind. The vehicle that collects the video can establish communication with the clients of nearby vehicles through the client. The client is a software built into the vehicle and its content is displayed on the screen in the cockpit.

[0023] It should be noted that the communication method between the vehicles in this application can be the communication between the cameras or the communication between the clients, as long as the vehicles are connected through the network, and it is not limited to the specific implementation method.

[0024] After the vehicle's camera collects the traffic panorama behind, vehicle recognition is performed. Vehicle recognition can be license plate recognition or the recognition of other markers, as long as different vehicles can be accurately recognized. This application does not limit how to recognize vehicles and will not elaborate here.

[0025] After the vehicles are recognized, for example, the camera of vehicle A collects the traffic panorama behind. The video includes following vehicles B1 and B2. After vehicle recognition, the license plates of vehicle B1 and vehicle B2 are obtained, and thus the collected video is sent to vehicle B1 and vehicle B2.

[0026] If the video includes more vehicles, after vehicle recognition, the collected video is sent to all the recognized vehicles. For example, the recognized vehicles in the recognition screen are, for example, B1, B2, B3, B4, and B5. By recognizing the license plates of these vehicles, the license plates of 5 vehicles are reported to the management platform to obtain the IP addresses of the 5 vehicles. The complete video stream is sent to the clients of the 5 vehicles.

[0027] Step S2: The vehicle that receives the video recognizes the vehicles in the video, and takes the picture containing the surrounding vehicles with its own vehicle as the center for display.

[0028] In this embodiment, after vehicles B1 and B2 receive the video, in order to let the driver focus on the environment of their own vehicle, each client recognizes the vehicles in the picture, and then takes the picture containing the surrounding vehicles with its own vehicle as the center for display.

[0029] It is easy to understand that this process is dynamic, that is to say, in the video picture given by the vehicle in front, the position of its own vehicle will constantly change in the whole picture, and the client needs to track its own vehicle and take the picture containing the surrounding vehicles for display.

[0030] Embodiment 2: The vehicle recognition of the collected video and the distribution of the collected video to the recognized vehicles include: Perform vehicle recognition on the collected video, and intercept the picture containing the recognized vehicles from the collected video and distribute it to the recognized vehicles.

[0031] In this embodiment, the camera of vehicle A captures the entire traffic scene behind it. The video includes following vehicles B1 and B2. After vehicle recognition, the license plates of vehicles B1 and B2 are obtained. Then, the regions containing vehicles B1 and B2 are intercepted from the video content, and a new video stream is generated and sent to B1 and B2.

[0032] In this embodiment, the video is intercepted to only include the video frames of the following vehicles, which can avoid the influence of invalid frames on the following vehicles and reduce the amount of data transmitted over the network.

[0033] Embodiment 3: The method for obtaining the panoramic situation of the immersive performance further includes: Identifying driving risks in the captured video, and sending an alarm to the vehicle with driving risks when a driving risk is identified.

[0034] Specifically, after vehicle A captures the entire traffic scene behind it and identifies vehicles B1 and B2 in the video, it further identifies that following vehicle B2 is located at the right rear of B1, and B1 has turned on its right turn signal. Judging from the distance, the two vehicles are too close to each other. At this time, if B1 turns right, it is likely to cause a collision accident, so it is determined that there is a driving risk. Therefore, vehicle A sends an alarm message "Pay attention to the vehicle in front turning" to the client of vehicle B2. After the clients of following vehicles B1 and B2 receive the video stream, the video is displayed on the screen so that the driver can see the right-side view. After the client of following vehicle B2 receives the alarm message, it is displayed on the screen to alert the driver and pay attention to safety.

[0035] In this embodiment, by identifying driving risk behaviors and sending alarms to following vehicles in a timely manner, it is beneficial to the safe driving of following vehicles.

[0036] Embodiment 4: The vehicle recognition of the captured video and distributing the captured video to the recognized vehicles includes: Performing vehicle recognition on the captured video. If the pixels occupied by the recognized vehicle in the frame exceed a set threshold, the captured video is distributed to the recognized vehicle; otherwise, no distribution is performed.

[0037] In this embodiment, after performing vehicle recognition on the captured video, the video is not distributed to all recognized vehicles but is screened to avoid following vehicles receiving invalid videos.

[0038] For example, vehicle A recognizes vehicles B1 and B2 in the captured video. The pixel amount occupied by vehicle B1 in the frame exceeds the set threshold (for example, 10 pixels), then the video is distributed to vehicle B2. If the pixel amount occupied by vehicle B2 does not exceed the set threshold, the video is not distributed to vehicle B2. The set threshold can be set according to experiments and is not limited to a specific value.

[0039] When the number of pixels occupied by the following vehicle does not exceed the set threshold, it means that the distance is too far and the video is meaningless for vehicle B2. Then vehicle A does not send the collected video to vehicle B2, which can prevent vehicle B2 from receiving invalid videos and affecting the driver's correct judgment.

[0040] Embodiment 5: The vehicle recognition of the collected video and the distribution of the collected video to the recognized vehicles include: After receiving the distributed video connection, the recognized vehicle returns a comparison request message; After receiving the comparison request message, all vehicles distributing the video compare the amount of pixels occupied by the recognized vehicle, and the vehicle with the largest amount of pixels occupied distributes the video to the recognized vehicle.

[0041] In this embodiment, for example, vehicle B5 is in the video collected by vehicle A and also in the videos collected by vehicles B1, B2, B3, and B4, and the amount of pixels occupied by vehicle B5 in these videos all reaches the threshold. Then vehicles A, B1, B2, B3, and B4 will all distribute the video to vehicle B5. To distribute the video, these vehicles all try to connect to vehicle B5 or send a message indicating the video to be distributed to vehicle B5. Vehicle B5 can obtain information such as the IP addresses of these vehicles that will send videos to itself. Thus, it can carry this IP address information and return a comparison request message to the vehicles distributing the video.

[0042] The purpose of sending the comparison request message is to enable comparison among the vehicles distributing the video. After receiving the comparison request message, vehicles A, B1, B2, B3, and B4 compare with each other. If the amount of pixels occupied by vehicle B5 in the video collected by their own vehicle is small, they do not distribute the video. Through comparison, finally, the vehicle with the largest amount of pixels occupied distributes the video to the following vehicle.

[0043] The technical solution of this embodiment avoids the frequent switching of the cockpit display screen in vehicle B5, which interferes with the driver. And it selects the picture that can best reflect the surrounding conditions of the vehicle itself for display.

[0044] For safe driving, this application can display real-time videos in all directions on the in-vehicle screen, realizing the coordination between the vehicle itself and surrounding vehicles. One can see videos in all directions on the screen in the vehicle cockpit and one's own position among them. Compared with the traditional technical solution of installing omnidirectional cameras on the vehicle body itself, it reduces costs and avoids the defect that one can only see surrounding information but not one's own position. The following vehicle can obtain the traffic information around its own vehicle, ensuring driving safety.

[0045] Embodiment 6: This application also proposes a panoramic situation acquisition system for immersive performances. The panoramic situation acquisition system for immersive performances includes at least two vehicles participating in the performance, where: Each vehicle is equipped with a camera for collecting videos of the following vehicle, performs vehicle recognition on the collected videos, and distributes the collected videos to the recognized vehicles; The vehicle that receives the video recognizes the vehicles in the video, takes a picture containing the surrounding vehicles centered on its own vehicle, and displays it.

[0046] Corresponding to the above method, in a specific embodiment, the vehicle performs vehicle recognition on the collected videos, distributes the collected videos to the recognized vehicles, and performs the following operations: Performs vehicle recognition on the collected videos, intercepts the pictures containing the recognized vehicles from the collected videos, and distributes them to the recognized vehicles.

[0047] In another specific embodiment, the vehicle further performs the following operations: Performs driving risk recognition on the collected videos, and when a driving risk is recognized, sends an alarm to the vehicle with the driving risk.

[0048] In another specific embodiment, the vehicle performs vehicle recognition on the collected videos, distributes the collected videos to the recognized vehicles, and performs the following operations: Performs vehicle recognition on the collected videos. If the pixels occupied by the recognized vehicle in the picture exceed the set threshold, the collected videos are distributed to the recognized vehicles; otherwise, no distribution is performed.

[0049] In another specific embodiment, the vehicle in the panoramic situation acquisition system of the immersive performance further performs the following operations: The recognized vehicle returns a comparison request message after receiving the distributed video connection; All vehicles that distribute videos compare the amount of pixels occupied by the recognized vehicle after receiving the comparison request message, and the vehicle with the largest amount of occupied pixels distributes the video to the recognized vehicle.

[0050] The above embodiments only represent several implementation manners of the present application, and their descriptions are relatively specific and detailed, but should not be construed as limiting the scope of the invention patent. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several deformations and improvements can still be made, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the appended claims.

Claims

1. A method for acquiring panoramic situation of immersive performance, characterized in that: The method for obtaining the panoramic situation of the immersive performance includes: Each vehicle is equipped with a camera that collects videos of the vehicles behind it, performs vehicle identification on the collected videos, and distributes the collected videos to the identified vehicles; The vehicle receiving the video identifies the vehicles in the video, captures the image including the surrounding vehicles with the own vehicle as the center, and displays it.

2. The method for obtaining a panoramic situation of an immersive performance according to claim 1, characterized in that: The performing vehicle identification on the collected video and distributing the collected video to the identified vehicle includes: Vehicle recognition is performed on the collected video, and the images containing the recognized vehicle are intercepted from the collected video and distributed to the recognized vehicle.

3. The method for obtaining a panoramic situation of an immersive performance according to claim 1, characterized in that: The method for obtaining the panoramic situation of the immersive performance also includes: The collected videos are used to identify driving risks, and when driving risks are identified, warnings are sent to vehicles with driving risks.

4. The method for obtaining a panoramic situation of an immersive performance according to claim 1, characterized in that: The performing vehicle identification on the collected video and distributing the collected video to the identified vehicle includes: Vehicle recognition is performed on the collected video. If the pixels occupied by the recognized vehicle in the picture exceed the set threshold, the collected video is distributed to the recognized vehicle, otherwise it is not distributed.

5. The method for acquiring panoramic situation of immersive performance according to claim 4, characterized in that: The performing vehicle identification on the collected video and distributing the collected video to the identified vehicle includes: After receiving the distribution video connection, the identified vehicle returns a comparison request message; After receiving the comparison request message, all vehicles distributing videos compare the size of the pixels occupied by the identified vehicles, and the vehicle with the largest pixel size distributes the video to the identified vehicle.

6. A panoramic situation acquisition system for immersive performances, characterized in that: The panoramic situation acquisition system for the immersive performance includes at least two vehicles participating in the performance, wherein: Each vehicle is equipped with a camera that collects videos of the vehicles behind it, performs vehicle identification on the collected videos, and distributes the collected videos to the identified vehicles; The vehicle receiving the video identifies the vehicles in the video, captures the image including the surrounding vehicles with the own vehicle as the center, and displays it.

7. The panoramic situation acquisition system for immersive performance according to claim 6, characterized in that: The vehicle performs vehicle identification on the collected video, distributes the collected video to the identified vehicle, and performs the following operations: Vehicle recognition is performed on the collected video, and the images containing the recognized vehicle are intercepted from the collected video and distributed to the recognized vehicle.

8. The panoramic situation acquisition system for immersive performance according to claim 6, characterized in that: The vehicle further performs the following operations: The collected videos are used to identify driving risks, and when driving risks are identified, warnings are sent to vehicles with driving risks.

9. The panoramic situation acquisition system for immersive performance according to claim 6, characterized in that: The vehicle performs vehicle identification on the collected video, distributes the collected video to the identified vehicle, and performs the following operations: Vehicle recognition is performed on the collected video. If the pixels occupied by the recognized vehicle in the picture exceed the set threshold, the collected video is distributed to the recognized vehicle, otherwise it is not distributed.

10. The panoramic situation acquisition system for immersive performance according to claim 9, characterized in that: The vehicle in the panoramic situation acquisition system of the immersive performance further performs the following operations: After receiving the distribution video connection, the identified vehicle returns a comparison request message; After receiving the comparison request message, all vehicles distributing videos compare the size of the pixels occupied by the identified vehicles, and the vehicle with the largest pixel size distributes the video to the identified vehicle.

Images