A method and system for acquiring panoramic situational awareness in immersive performances

Abstract

This invention discloses a panoramic situational awareness acquisition method and system for immersive performances. Each vehicle is equipped with a camera that captures video from vehicles behind it. The captured video is then used for vehicle identification, and the video is distributed to the identified vehicles. Each receiving vehicle identifies the vehicles in the video, captures a frame centered on itself, including surrounding vehicles, and displays it. Upon receiving the distributed video connection, the identified vehicle returns a comparison request message. All vehicles distributing video, upon receiving the comparison request message, compare the pixel count of the identified vehicles. The vehicle with the largest pixel count distributes its video to the identified vehicle. This invention's technical solution enables collaborative warnings and coordination among numerous vehicles participating in the performance, achieving dangerous driving warnings and coordination. The leading vehicle sends panoramic video to the following vehicles, reducing equipment costs. The following vehicles can obtain traffic information around their own vehicle, as well as their own location, ensuring driving safety.

Description

Technical Field

[0001] This application belongs to the field of vehicle safety operation technology during immersive performances, and particularly relates to a method and system for acquiring panoramic situation during immersive performances. Background Technology

[0002] With the rapid development of my country's economy, people's lives have undergone tremendous changes, and cultural tourism activities are becoming increasingly popular. Steady growth in residents' income and increasing disposable income have given people more funds for leisure and entertainment. The consumption structure is also continuously upgrading, shifting from meeting basic material needs to pursuing spiritual and cultural enjoyment, and cultural tourism perfectly aligns with this trend.

[0003] Immersive performances are particularly popular among cultural and tourism activities. They redefine the audience-performer relationship, allowing viewers to become more immersed in the performance environment and enjoy an interactive experience. Audiences are no longer passive recipients but can freely move through the storyline, interact with actors, and experience a unique theatrical world. Immersive performances have a wide range of applications in the theater industry, not only in theaters but also in non-traditional theater spaces such as factories, garages, streets, and shopping malls. This format greatly stimulates the innovative potential of theatrical performances, becoming a new performance industry model and promoting the development of the "experience economy."

[0004] Immersive performance events often require multiple vehicles, with both performers and audience members riding in them. Audience members' actions, such as waving ribbons during interactions, can obstruct the driver's view, posing a safety hazard. To avoid this, vehicles can be equipped with omnidirectional cameras to provide a comprehensive view of the surrounding environment, allowing the driver to better observe their surroundings and make informed decisions. However, installing omnidirectional cameras results in higher equipment costs.

[0005] Furthermore, even if the vehicle is equipped with an all-around camera, it only provides an observation from the perspective of the vehicle itself, lacking reference to other vehicles in the surrounding area, making it impossible to determine the vehicle's specific location within the entire performance scene. Summary of the Invention

[0006] The purpose of this application is to provide a method and system for acquiring panoramic situational awareness in immersive performances, using a minimum number of cameras to achieve panoramic situational awareness while reducing equipment costs.

[0007] A method for acquiring a panoramic view of an immersive performance includes:

[0008] Each vehicle is equipped with a camera that captures video of the vehicle behind it. The camera then identifies the vehicle in the captured video and distributes the video to the identified vehicle.

[0009] Upon receiving the video, the vehicle identifies the vehicles in the video, and, with its own vehicle as the center, captures a frame containing surrounding vehicles for display.

[0010] Furthermore, the step of performing vehicle identification on the collected video and distributing the collected video to the identified vehicles includes:

[0011] Vehicle identification is performed on the collected video, and the footage containing the identified vehicles is extracted from the collected video and distributed to the identified vehicles.

[0012] Furthermore, the method for acquiring the panoramic situation of the immersive performance also includes:

[0013] The system identifies driving risks in the collected videos and sends alerts to vehicles with identified risks.

[0014] Furthermore, the step of performing vehicle identification on the collected video and distributing the collected video to the identified vehicles includes:

[0015] Vehicle identification is performed on the captured video. If the number of pixels occupied by the identified vehicle in the image exceeds a set threshold, the captured video is distributed to the identified vehicle; otherwise, it is not distributed.

[0016] Furthermore, the step of performing vehicle identification on the collected video and distributing the collected video to the identified vehicles includes:

[0017] Upon receiving the distributed video link, the identified vehicle returns a comparison request message;

[0018] Upon receiving a comparison request message, all vehicles distributing videos compare the number of pixels occupied by the identified vehicles, and the vehicle with the largest number of pixels distributes the video to the identified vehicles.

[0019] This application also proposes a panoramic situational awareness system for immersive performances, which includes at least two vehicles participating in the performance, wherein:

[0020] Each vehicle is equipped with a camera that captures video of the vehicle behind it. The camera then identifies the vehicle in the captured video and distributes the video to the identified vehicle.

[0021] Upon receiving the video, the vehicle identifies the vehicles in the video, and, with its own vehicle as the center, captures a frame containing surrounding vehicles for display.

[0022] Furthermore, the vehicle performs vehicle identification on the collected video, distributes the collected video to the identified vehicles, and performs the following operations:

[0023] Vehicle identification is performed on the collected video, and the footage containing the identified vehicles is extracted from the collected video and distributed to the identified vehicles.

[0024] Furthermore, the vehicle also performs the following operations:

[0025] The system identifies driving risks in the collected videos and sends alerts to vehicles with identified risks.

[0026] Furthermore, the vehicle performs vehicle identification on the collected video, distributes the collected video to the identified vehicles, and performs the following operations:

[0027] Vehicle identification is performed on the captured video. If the number of pixels occupied by the identified vehicle in the image exceeds a set threshold, the captured video is distributed to the identified vehicle; otherwise, it is not distributed.

[0028] Furthermore, the vehicles in the panoramic situational awareness system for the immersive performance also perform the following operations:

[0029] Upon receiving the distributed video link, the identified vehicle returns a comparison request message;

[0030] Upon receiving a comparison request message, all vehicles distributing videos compare the number of pixels occupied by the identified vehicles, and the vehicle with the largest number of pixels distributes the video to the identified vehicles.

[0031] This application proposes a panoramic situational awareness acquisition method and system for immersive performances, enabling collaborative warnings and coordination among numerous vehicles participating in the performance. The leading vehicle sends panoramic video to the following vehicles, reducing equipment costs. The following vehicles can obtain traffic information surrounding their own vehicles, as well as their own location, ensuring driving safety. Attached Figure Description

[0032] Figure 1 This is a flowchart illustrating the method for obtaining the panoramic view of the immersive performance in this application. Detailed Implementation

[0033] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0034] This application applies to immersive performance scenarios where actors perform on the roofs of vehicles, and audience members also participate in activities while riding in vehicles or along the sides of the road. Each vehicle participating in the performance has a camera mounted on its roof and rear to capture traffic conditions behind it. Each vehicle registers with a management platform, containing its IP address and license plate number. Therefore, the management platform records the IP address and license plate number of each vehicle to facilitate communication between them.

[0035] Example 1: As Figure 1 As shown, a method for acquiring the panoramic situation of an immersive performance is proposed, including:

[0036] Step S1: Install a camera on each vehicle to collect video of the vehicle behind, perform vehicle identification on the collected video, and distribute the collected video to the identified vehicle.

[0037] In this embodiment, all participating vehicles are equipped with cameras facing rearward to capture comprehensive traffic conditions behind them. The vehicles capturing video can communicate with nearby vehicles via a client application. This client application is software embedded in the vehicle, and its content is displayed on the driver's cockpit screen.

[0038] It should be noted that the communication method between vehicles in this application can be communication between cameras or communication between clients, as long as the vehicles are connected via a network, and is not limited to a specific implementation method.

[0039] After capturing a panoramic view of the traffic behind the vehicle, the vehicle's camera performs vehicle recognition. Vehicle recognition can be license plate recognition or recognition of other markers, as long as it can accurately identify different vehicles. This application does not restrict how vehicles are identified, and will not elaborate further here.

[0040] After identifying the vehicles, for example, if the camera of vehicle A captures a panoramic view of the traffic behind it, including vehicles B1 and B2, the license plates of vehicles B1 and B2 are obtained after vehicle identification, and the captured video is then sent to vehicles B1 and B2.

[0041] If the video includes more vehicles, after vehicle recognition, the captured video is sent to all identified vehicles. For example, if the identified vehicles are B1, B2, B3, B4, and B5, their license plates are identified, and these five license plates are reported to the management platform to obtain the IP addresses of these five vehicles. The complete video stream is then sent to the clients of these five vehicles.

[0042] Step S2: Upon receiving the video, identify the vehicles in the video, and capture a frame containing surrounding vehicles centered on the vehicle itself for display.

[0043] In this embodiment, after vehicles B1 and B2 receive the video, in order to allow the driver to focus on the environment of their own vehicle, each client identifies the vehicle in the picture, and then captures a picture including the surrounding vehicles with its own vehicle as the center and displays it.

[0044] It's easy to understand that this process is dynamic. That is, in the video footage provided by the vehicle in front, the position of your own vehicle will constantly change within the entire frame, and the client needs to track its own vehicle and capture the footage that includes the surrounding vehicles for display.

[0045] Example 2: The process of performing vehicle identification on the collected video and distributing the collected video to the identified vehicles includes:

[0046] Vehicle identification is performed on the collected video, and the footage containing the identified vehicles is extracted from the collected video and distributed to the identified vehicles.

[0047] In this embodiment, the camera of vehicle A captures a panoramic view of the traffic behind it. The video includes vehicles B1 and B2. After vehicle recognition, the license plates of vehicles B1 and B2 are obtained. Then, the area containing vehicles B1 and B2 is extracted from the video content, and a new video stream is generated and sent to B1 and B2.

[0048] This embodiment extracts video footage, capturing only the portion containing the following vehicle. This avoids invalid footage affecting the following vehicle and reduces the amount of data transmitted over the network.

[0049] Example 3: The method for acquiring the panoramic situation of the immersive performance further includes:

[0050] The system identifies driving risks in the collected videos and sends alerts to vehicles with identified risks.

[0051] Specifically, after capturing a panoramic view of the traffic behind it, vehicle A identifies vehicles B1 and B2 in the video. Further analysis reveals that vehicle B2 is positioned to the right rear of vehicle B1, and B1 has its right turn signal on. Judging from the distance, the two vehicles are too close, and B1's right turn at this moment could easily cause a collision, thus posing a driving risk. Therefore, vehicle A sends a warning message to vehicle B2's client: "Caution: Vehicle ahead is turning." Upon receiving the video stream, the clients of vehicles B1 and B2 display the image on their screens, allowing the drivers to see the right-hand view. Vehicle B2's client, upon receiving the warning message, displays it on its screen, alerting the driver to the danger and urging them to be cautious.

[0052] This embodiment identifies driving risk behaviors and promptly issues warnings to following vehicles, which is beneficial to the safe driving of those vehicles.

[0053] Example 4: The process of performing vehicle identification on the collected video and distributing the collected video to the identified vehicles includes:

[0054] Vehicle identification is performed on the captured video. If the number of pixels occupied by the identified vehicle in the image exceeds a set threshold, the captured video is distributed to the identified vehicle; otherwise, it is not distributed.

[0055] In this embodiment, after vehicle identification is performed on the collected video, the video is not distributed to all identified vehicles, but is filtered to avoid subsequent vehicles receiving invalid videos.

[0056] For example, if vehicle A identifies vehicles B1 and B2 in the captured video, and vehicle B1 occupies more than a set threshold (e.g., 10 pixels) in the frame, then video is sent to vehicle B2. If vehicle B2 occupies less than the set threshold, then video is not sent to vehicle B2. The set threshold can be determined experimentally and is not limited to a specific value.

[0057] If the number of pixels occupied by the following vehicle does not exceed the set threshold, it means that the distance is too far and the video is meaningless for vehicle B2. Therefore, vehicle A will not send the collected video to vehicle B2 to avoid vehicle B2 receiving invalid video and affecting the driver's correct judgment.

[0058] Example 5: The process of performing vehicle identification on the collected video and distributing the collected video to the identified vehicles includes:

[0059] Upon receiving the distributed video link, the identified vehicle returns a comparison request message;

[0060] Upon receiving a comparison request message, all vehicles distributing videos compare the number of pixels occupied by the identified vehicles, and the vehicle with the largest number of pixels distributes the video to the identified vehicles.

[0061] In this embodiment, for example, if the video captured by vehicle B5 in vehicle A is also included in the videos captured by vehicles B1, B2, B3, and B4, and the number of pixels occupied by vehicle B5 in all these videos reaches a threshold, then vehicles A, B1, B2, B3, and B4 will all distribute the video to vehicle B5. To distribute the video, these vehicles attempt to connect to vehicle B5 or send a message to vehicle B5 indicating that they intend to distribute the video. Vehicle B5 can obtain information such as the IP addresses of these vehicles that will send it the video. Therefore, it can carry this IP address information and return a comparison request message to the vehicles distributing the video.

[0062] The purpose of sending the comparison request message is to allow vehicles distributing video to make comparisons. After receiving the comparison request message, vehicles A, B1, B2, B3, and B4 compare their videos. If vehicle B5 has the smallest pixel count in its own video feed, it will not distribute its video. Finally, the vehicle with the largest pixel count distributes its video to the vehicles following it.

[0063] The technical solution of this embodiment avoids frequent switching of the cockpit display screen in vehicle B5, which would interfere with the driver. Furthermore, it selects the image that best reflects the surrounding conditions of the vehicle for display.

[0064] This application, for the purpose of safe driving, displays real-time video from all directions on the in-vehicle screen, enabling coordination between the vehicle and surrounding vehicles. Drivers can see video from all directions and their own position within it on the screen in the cockpit. Compared to traditional solutions that install omnidirectional cameras on the vehicle body, this reduces costs and avoids the limitation of only seeing surrounding information without knowing one's own location. Following vehicles can also obtain traffic information about the vehicle's surroundings, ensuring driving safety.

[0065] Example 6: This application also proposes a panoramic situational awareness system for immersive performances, which includes at least two vehicles participating in the performance, wherein:

[0066] Each vehicle is equipped with a camera that captures video of the vehicle behind it. The camera then identifies the vehicle in the captured video and distributes the video to the identified vehicle.

[0067] Upon receiving the video, the vehicle identifies the vehicles in the video, and, with its own vehicle as the center, captures a frame containing surrounding vehicles for display.

[0068] Corresponding to the above method, in a specific embodiment, the vehicle performs vehicle identification on the collected video, distributes the collected video to the identified vehicles, and performs the following operations:

[0069] Vehicle identification is performed on the collected video, and the footage containing the identified vehicles is extracted from the collected video and distributed to the identified vehicles.

[0070] In another specific embodiment, the vehicle also performs the following operations:

[0071] The system identifies driving risks in the collected videos and sends alerts to vehicles with identified risks.

[0072] In another specific embodiment, the vehicle performs vehicle identification on the collected video, distributes the collected video to the identified vehicles, and performs the following operations:

[0073] Vehicle identification is performed on the captured video. If the number of pixels occupied by the identified vehicle in the image exceeds a set threshold, the captured video is distributed to the identified vehicle; otherwise, it is not distributed.

[0074] In another specific embodiment, the vehicles in the panoramic situational awareness system for the immersive performance also perform the following operations:

[0075] Upon receiving the distributed video link, the identified vehicle returns a comparison request message;

[0076] Upon receiving a comparison request message, all vehicles distributing videos compare the number of pixels occupied by the identified vehicles, and the vehicle with the largest number of pixels distributes the video to the identified vehicles.

[0077] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the invention patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this patent application should be determined by the appended claims.

Claims

1. A method for acquiring a panoramic situation of an immersive performance, characterized in that, The method for acquiring the panoramic situation of the immersive performance includes: Each vehicle is equipped with a camera that captures video of the vehicle behind it. The camera then identifies the vehicle in the captured video and distributes the video to the identified vehicle, or extracts a frame containing the identified vehicle from the captured video and distributes it to the identified vehicle. Upon receiving the video, the vehicle identifies the vehicles in the video, and, with its own vehicle as the center, captures a frame containing surrounding vehicles for display.

2. The method for acquiring panoramic status of immersive performances according to claim 1, characterized in that, The method for acquiring the panoramic situation of the immersive performance also includes: The system identifies driving risks in the collected videos and sends alerts to vehicles with identified risks.

3. The method for acquiring a panoramic view of an immersive performance according to claim 1, characterized in that, The step of performing vehicle identification on the collected video and distributing the collected video to the identified vehicles includes: Vehicle identification is performed on the captured video. If the number of pixels occupied by the identified vehicle in the image exceeds a set threshold, the captured video is distributed to the identified vehicle; otherwise, it is not distributed.

4. The method for acquiring a panoramic view of an immersive performance according to claim 3, characterized in that, The step of performing vehicle identification on the collected video and distributing the collected video to the identified vehicles includes: Upon receiving the distributed video link, the identified vehicle returns a comparison request message; Upon receiving a comparison request message, all vehicles distributing videos compare the number of pixels occupied by the identified vehicles, and the vehicle with the largest number of pixels distributes the video to the identified vehicles.

5. A panoramic situational awareness system for immersive performances, characterized in that, The panoramic situational awareness system for the immersive performance includes at least two vehicles participating in the performance, wherein: Each vehicle is equipped with a camera that captures video of the vehicle behind it. The camera then identifies the vehicle in the captured video and distributes the video to the identified vehicle, or extracts a frame containing the identified vehicle from the captured video and distributes it to the identified vehicle. Upon receiving the video, the vehicle identifies the vehicles in the video, and, with its own vehicle as the center, captures a frame containing surrounding vehicles for display.

6. The panoramic situation acquisition system for immersive performances according to claim 5, characterized in that, The vehicle also performs the following operations: The system identifies driving risks in the collected videos and sends alerts to vehicles with identified risks.

7. The panoramic situation acquisition system for immersive performances according to claim 5, characterized in that, The vehicle performs vehicle identification on the collected video, distributes the collected video to the identified vehicles, and performs the following operations: Vehicle identification is performed on the captured video. If the number of pixels occupied by the identified vehicle in the image exceeds a set threshold, the captured video is distributed to the identified vehicle; otherwise, it is not distributed.

8. The panoramic situation acquisition system for immersive performances according to claim 7, characterized in that, The vehicles in the panoramic situational awareness system for the immersive performance also perform the following operations: Upon receiving the distributed video link, the identified vehicle returns a comparison request message; Upon receiving a comparison request message, all vehicles distributing videos compare the number of pixels occupied by the identified vehicles, and the vehicle with the largest number of pixels distributes the video to the identified vehicles.

Images