Method, device and equipment for processing and displaying 360-degree panoramic image and medium

Abstract

The invention discloses a 360-degree panoramic image processing and displaying method, device, equipment and medium, and the method comprises the steps: collecting to-be-transmitted video information of the surrounding environment of a vehicle through at least two star flash wireless communication cameras disposed around the vehicle; transmitting the to-be-transmitted video information to a 360-degree panoramic image domain controller, and performing image splicing processing on the to-be-transmitted video information through the 360-degree panoramic image domain controller to obtain a panoramic image video signal; according to the embodiment of the invention, the operation information of the vehicle is obtained, and the display trigger control is performed on the panoramic image video signal according to the operation information, so that the panoramic image video signal meeting the trigger condition is transmitted to the vehicle-mounted display terminal for display, wireless transmission of the 360-degree panoramic image camera video signal can be realized, and the use of a high-speed cable is not depended any more; and the influence on the wire diameter and the weight of the whole vehicle wire harness is reduced.

Description

Technical Field

[0001] This invention relates to the field of intelligent driving assistance technology, and in particular to a method, apparatus, device and medium for processing and displaying 360-degree panoramic images. Background Technology

[0002] The automotive industry has been developing rapidly in recent years, and 360-degree panoramic imaging, as an important function to help drivers understand the vehicle's surroundings in real time, is increasingly being integrated into automobiles. Current 360-degree panoramic imaging systems use AHD or LVDS cameras, which are connected to a 360-degree panoramic imaging domain controller via high-speed cables for video stitching before being displayed on the in-vehicle screen.

[0003] Existing 360° panoramic imaging systems generally suffer from the following problems: 1. Complex wiring: A large number of high-speed cables need to be laid throughout the vehicle, which is time-consuming and easily limited by the vehicle's structure (such as in commercial vehicle trailer separation scenarios). Furthermore, the mechanical performance requirements for high-speed connectors are high at the connection points. 2. High cost: The costs of cable materials, labor for installation, and subsequent maintenance are significantly increased, and the weight of the wiring harness also increases considerably. 3. Latency and synchronization issues: Wired transmission has a high latency (approximately 200ms), and simultaneous splicing of multiple video streams can easily result in stuttering or screen tearing, affecting driving safety. Currently, other wireless transmission methods, such as Bluetooth and Wi-Fi communication, have even higher latency. Summary of the Invention

[0004] This invention provides a method, apparatus, device, and medium for processing and displaying 360-degree panoramic images, enabling real-time stitching and transmission of 360-degree panoramic images in vehicles. It is applicable to scenarios such as commercial vehicles and passenger vehicles, and solves the problems of complex wiring, high cost, and large latency in traditional wired solutions.

[0005] According to one aspect of the present invention, a method for processing and displaying 360-degree panoramic images is provided, comprising: The system uses at least two StarFlash wireless communication cameras positioned around the vehicle to collect video information about the surrounding environment that needs to be transmitted. The video information to be transmitted is transmitted to the 360° panoramic image domain controller, and the 360° panoramic image domain controller performs image stitching processing on the video information to be transmitted to obtain a panoramic image video signal. The system acquires vehicle operating information and performs display trigger control on the panoramic image video signal based on the operating information, so as to transmit the panoramic image video signal that meets the trigger conditions to the vehicle display terminal for display.

[0006] According to another aspect of the present invention, a processing and display device for 360-degree panoramic images is provided, comprising: The video acquisition module is used to acquire video information of the vehicle's surrounding environment to be transmitted through at least two StarFlash wireless communication cameras set around the vehicle. The processing and transmission module is used to transmit the video information to be transmitted to the 360° panoramic image domain controller, and to perform image stitching processing on the video information to be transmitted through the 360° panoramic image domain controller to obtain a panoramic image video signal. The control display module is used to acquire vehicle operating information and perform display trigger control on the panoramic image video signal according to the operating information, so as to transmit the panoramic image video signal that meets the trigger conditions to the vehicle display terminal for display.

[0007] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising: At least one processor; and memory that is communicatively connected to at least one processor; The memory stores a computer program that can be executed by at least one processor, which enables the at least one processor to perform the 360-degree panoramic image processing and display method of any embodiment of the present invention.

[0008] According to another aspect of the present invention, a computer-readable storage medium is provided, which stores computer instructions for causing a processor to execute and implement a 360° panoramic image processing and display method according to any embodiment of the present invention.

[0009] The technical solution of this invention uses at least two wireless communication cameras positioned around the vehicle to collect video information of the surrounding environment. This video information is then transmitted to a 360° panoramic image domain controller, which performs image stitching processing on the video information to obtain a panoramic video signal. Vehicle operating information is acquired, and based on this information, display trigger control is applied to the panoramic video signal to transmit the signal that meets the trigger conditions to an in-vehicle display. This technical solution, using wireless communication cameras for acquisition and transmission, solves the problems of complex wiring, high costs, delays, and synchronization issues. It achieves wireless transmission of the 360° panoramic image camera video signal, eliminating reliance on high-speed cables and reducing the impact on the overall vehicle wiring harness diameter and weight.

[0010] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0011] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0012] Figure 1 A flowchart illustrating a method for processing and displaying 360° panoramic images provided in an embodiment of the present invention. Figure 2 This invention provides an architecture diagram of a 360° panoramic image processing and display system. Figure 3 A flowchart illustrating another method for processing and displaying 360° panoramic images provided in an embodiment of the present invention. Figure 4 A schematic diagram of the structure of a wireless processing and display device for 360-degree panoramic images provided in an embodiment of the present invention; Figure 5 A schematic diagram of the structure of an electronic device for implementing the wireless processing and display method of 360-degree panoramic images according to an embodiment of the present invention. Detailed Implementation

[0013] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0014] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0015] Figure 1This is a flowchart illustrating a method for processing and displaying 360° panoramic images according to an embodiment of the present invention. This embodiment is applicable to the processing and display of 360° panoramic images in vehicles. The method can be executed by a 360° panoramic image processing and display device, which can be implemented in hardware and / or software and can be configured in a vehicle. Figure 1 As shown, the method specifically includes the following steps: S110: Collect video information of the vehicle's surrounding environment to be transmitted through at least two Star Flash wireless communication cameras installed around the vehicle.

[0016] Among them, the StarFlash wireless communication camera refers to an in-vehicle image acquisition camera that integrates the StarFlash wireless communication module and supports the StarFlash wireless communication protocol. The video information to be transmitted can be video data of the vehicle's surrounding environment captured by the camera.

[0017] Specifically, at least two StarFlash wireless communication cameras can be deployed around the vehicle. The exact number of cameras can be selected based on actual needs and is not specifically limited here. These cameras can capture real-time images of the vehicle's surroundings and collect corresponding video information to be transmitted. StarFlash wireless communication cameras eliminate the wiring constraints of traditional wired cameras, improving the flexibility of camera deployment.

[0018] In some possible implementations, the step of collecting video information to be transmitted about the vehicle's surrounding environment using at least two StarFlash wireless communication cameras positioned around the vehicle includes: setting the StarFlash wireless communication cameras at the front, rear, left, and right sides of the vehicle; the StarFlash wireless communication cameras being high-definition fisheye cameras with integrated StarFlash wireless communication modules; capturing video of the full-view environment around the vehicle using the high-definition fisheye cameras to obtain multiple channels of raw video information; and constructing the video information to be transmitted based on the multiple channels of raw video information.

[0019] Among them, the high-definition fisheye camera has a wide-angle shooting capability, enabling high-definition image acquisition; multi-channel raw video information refers to the independent video information captured by cameras in different positions on the vehicle. The StarFlash wireless communication module can be used to send the video information to be transmitted to the 360-degree panoramic image domain controller.

[0020] Specifically, StarFlash wireless communication cameras are installed at the front, rear, left, and right of the vehicle. High-definition fisheye cameras at each location simultaneously collect real-time video of the vehicle's surroundings. Each camera generates one channel of raw video information. The multiple channels of raw video information collected from all locations are integrated to form the video information to be transmitted.

[0021] S120. The video information to be transmitted is transmitted to the 360° panoramic image domain controller, and the 360° panoramic image domain controller performs image stitching processing on the video information to be transmitted to obtain a panoramic image video signal.

[0022] Among them, the 360-degree panoramic imaging domain controller can be an on-board control unit used to receive and stitch together multiple channels of raw video information, and the panoramic imaging video signal can be a video signal obtained after processing.

[0023] Specifically, the acquired video information to be transmitted is transmitted to the 360° panoramic image domain controller. The domain controller can perform image stitching processing on the received video information to be transmitted, stitching multiple video information into a complete panoramic image video signal.

[0024] In some possible implementations, transmitting the video information to be transmitted to the 360° panoramic image domain controller includes: synchronizing and aligning multiple channels of original video information based on the microsecond-level synchronization accuracy of StarSpark wireless communication; and transmitting the synchronized and aligned video information to be transmitted to the 360° panoramic image domain controller via the StarSpark wireless communication protocol. The 360° panoramic imaging domain controller integrates a StarFlash wireless communication module.

[0025] Specifically, based on the microsecond-level synchronization accuracy of StarScan wireless communication, frame-level synchronization alignment processing is performed on multiple original video information channels to eliminate timing deviations of multiple video channels; the synchronized video information to be transmitted is wirelessly transmitted to the 360-degree panoramic imaging domain controller through the StarScan wireless communication protocol, because the domain controller integrates a StarScan wireless communication module, which can realize StarScan wireless communication interface with the camera.

[0026] In some possible implementations, transmitting the synchronized and aligned video information to be transmitted to the 360° panoramic image domain controller via the Star Flash wireless communication protocol includes: determining a target Star Flash transmission mode based on the vehicle's power consumption information; and transmitting the synchronized and aligned video information to be transmitted to the 360° panoramic image domain controller via the target Star Flash transmission mode.

[0027] The target star-flash transmission mode includes at least a star-flash basic mode and a star-flash low-power mode. The star-flash basic mode refers to a high-transmission-rate, high-concurrency transmission mode, while the star-flash low-power mode refers to reducing energy consumption while ensuring basic transmission requirements.

[0028] Specifically, the power consumption information of the vehicle can be collected, and a suitable target star flash transmission mode can be determined from the star flash basic mode and star flash low power mode according to the actual energy consumption requirements of the vehicle. Then, the video information to be transmitted is wirelessly transmitted to the 360 ​​panoramic imaging domain controller using the target star flash transmission mode. This method can adapt to different power consumption requirements.

[0029] In some possible implementations, the step of performing image stitching processing on the video information to be transmitted through the 360° panoramic image domain controller to obtain a panoramic image video signal includes: The 360° panoramic image domain controller sequentially performs image distortion correction and perspective transformation on the video information to be transmitted to obtain the corrected video information to be transmitted; according to the local pyramid fusion algorithm, it performs stitching processing on the corrected video information to be transmitted to obtain the panoramic image video signal.

[0030] Among them, the local pyramid fusion algorithm can be an algorithm that fuses and stitches together local regions of an image by constructing an image pyramid.

[0031] Specifically, the 360° panoramic image domain controller can perform image distortion correction and perspective transformation on the video information to be transmitted to obtain the corrected video information to be transmitted. Then, through the local pyramid fusion algorithm, the overlapping areas of the corrected video information to be transmitted are smoothly fused and stitched together to integrate multiple video streams into a single complete 360° panoramic video signal.

[0032] S130. Obtain vehicle operation information and perform display trigger control on the panoramic image video signal according to the operation information, so as to transmit the panoramic image video signal that meets the trigger conditions to the vehicle display terminal for display.

[0033] Specifically, the display of panoramic video signals is controlled based on operational information, that is, panoramic video signals that meet the trigger conditions are transmitted to the vehicle display terminal for display, thereby realizing the intelligent opening and closing of panoramic images.

[0034] In some possible implementations, the step of acquiring vehicle operating information and performing display trigger control on the panoramic image video signal based on the operating information includes: the 360-degree panoramic image domain controller acquiring vehicle operating information through a bus communication protocol; performing logical judgment based on the operating information; generating a corresponding display trigger command based on the result of the logical judgment; and performing automatic control on the display state of the panoramic image video signal through the display trigger command.

[0035] The bus communication protocol can be the CAN bus protocol, and the operating information includes at least one of the following: gear position, vehicle speed, steering signal, and surrounding radar perception information.

[0036] Specifically, the 360° panoramic imaging domain controller can acquire operational information from various sensors and control units in the vehicle via a bus communication protocol. After acquiring the operational information, it analyzes and judges the information according to preset logic rules, and generates corresponding display trigger commands based on the judgment results. This enables automatic on / off control of the panoramic imaging video signal display status. For example, it can be automatically activated in scenarios such as automatic parking, narrow road passage, and vehicle speeds below 30km / h.

[0037] In some possible implementations, the 360° panoramic imaging domain controller is integrated with the vehicle's smart cockpit domain controller. This integrated design reduces the number of hardware components in the vehicle controller, lowering the wiring complexity and hardware cost of the vehicle system.

[0038] The technical solution of this invention uses at least two wireless communication cameras positioned around the vehicle to collect video information of the surrounding environment. This video information is then transmitted to a 360° panoramic image domain controller, which performs image stitching processing on the video information to obtain a panoramic video signal. Vehicle operating information is acquired, and based on this information, display trigger control is applied to the panoramic video signal to transmit the signal that meets the trigger conditions to an in-vehicle display. This technical solution, using wireless communication cameras for acquisition and transmission, solves the problems of complex wiring, high costs, delays, and synchronization issues. It achieves wireless transmission of the 360° panoramic image camera video signal, eliminating reliance on high-speed cables and reducing the impact on the overall vehicle wiring harness diameter and weight.

[0039] Figure 2 This is an architectural diagram of a 360° panoramic image processing and display system provided in an embodiment of the present invention. This embodiment is a preferred embodiment of the above embodiments, and its specific implementation can be found in the technical solution of this embodiment. Technical terms that are the same as or corresponding to those in the above embodiments will not be repeated here. Figure 2 As shown, the system includes the following: This invention proposes an in-vehicle 360° panoramic imaging system and vehicle based on star-flash technology. For example... Figure 2 As shown, the system of the present invention mainly includes the following: Fisheye cameras using StarFlash wireless communication technology are installed in vehicles, as are 360° panoramic imaging domain controllers and in-vehicle display screens using StarFlash wireless communication technology.

[0040] Figure 3 A flowchart of another 360° panoramic image processing and display method provided in an embodiment of the present invention is shown below. Figure 3 As shown, the method includes: A fisheye camera employing StarFlash wireless communication technology captures video images of the vehicle's surroundings and wirelessly transmits them to a 360° panoramic imaging domain controller, also using StarFlash wireless communication technology. The domain controller utilizes the low-latency video transmission from StarFlash for video stitching, including distortion correction and perspective transformation, to create a video image suitable for external display. The 360° panoramic imaging domain controller then transmits the processed panoramic video signal to the vehicle's large screen via high-speed cable for viewing.

[0041] The 360° panoramic imaging domain controller obtains information such as vehicle gear position, speed, steering signals, and surrounding radar perception via the CAN bus or other communication protocols, and uses logic to determine whether to automatically turn the 360° panoramic imaging function on or off. Additionally, under permissible pre-defined conditions, such as when the vehicle speed is below 30 km / h, the 360° panoramic imaging function can be manually turned on or off.

[0042] The number of cameras in the system can be adjusted according to the actual needs of the vehicle. For example, passenger cars and blue-plate commercial vehicles are typically equipped with four cameras; longer commercial vehicles, including cargo trucks or tractor-trailers, can be equipped with six or more cameras to achieve more accurate image and video stitching. All cameras transmit video stream information through StarFlash wireless communication technology.

[0043] The technical solutions of this invention include: the StarFlash wireless communication protocol enables fully wireless communication for the in-vehicle 360° panoramic system; the intelligent triggering mechanism of the 360° panoramic image domain controller enhances driving safety and operational convenience; the fusion algorithm ensures seamless stitching of panoramic images; and anti-interference design and precise synchronization technology guarantee reliability in complex environments.

[0044] Figure 4 This is a schematic diagram of a wireless processing and display device for 360° panoramic images provided in an embodiment of the present invention. Figure 4 As shown, the device includes: The video acquisition module 410 is used to acquire video information to be transmitted about the surrounding environment of the vehicle through at least two Star Flash wireless communication cameras set around the vehicle. The processing and transmission module 420 is used to transmit the video information to be transmitted to the 360 ​​panoramic image domain controller, and to perform image stitching processing on the video information to be transmitted through the 360 ​​panoramic image domain controller to obtain a panoramic image video signal. The control display module 430 is used to acquire vehicle operating information and perform display trigger control on the panoramic image video signal according to the operating information, so as to transmit the panoramic image video signal that meets the trigger conditions to the vehicle display terminal for display.

[0045] The technical solution of this invention uses at least two wireless communication cameras positioned around the vehicle to collect video information of the surrounding environment. This video information is then transmitted to a 360° panoramic image domain controller, which performs image stitching processing on the video information to obtain a panoramic video signal. Vehicle operating information is acquired, and based on this information, display trigger control is applied to the panoramic video signal to transmit the signal that meets the trigger conditions to an in-vehicle display. This technical solution, using wireless communication cameras for acquisition and transmission, solves the problems of complex wiring, high costs, delays, and synchronization issues. It achieves wireless transmission of the 360° panoramic image camera video signal, eliminating reliance on high-speed cables and reducing the impact on the overall vehicle wiring harness diameter and weight.

[0046] In some possible implementations, the video acquisition module 410 includes: The arrangement unit is used to set the Star Flash wireless communication camera in the front, rear, left and right positions of the vehicle. The Star Flash wireless communication camera is a high-definition fisheye camera with integrated Star Flash wireless communication module. The acquisition unit is used to acquire video of the full-view environment around the vehicle through the high-definition fisheye camera, obtain multiple channels of raw video information, and construct the video information to be transmitted based on the multiple channels of raw video information.

[0047] In some possible implementations, the processing and transmission module 420 includes: The synchronization unit is used to synchronize and align multiple original video information channels of the video information to be transmitted based on the microsecond-level synchronization accuracy of the StarFlash wireless communication. The transmission unit is used to transmit the synchronized and aligned video information to the 360° panoramic image domain controller via the StarFlash wireless communication protocol, wherein the 360° panoramic image domain controller integrates a StarFlash wireless communication module.

[0048] In some possible implementations, the transmission unit is specifically used for: The target star flash transmission mode is determined based on the vehicle's power consumption information, wherein the target star flash transmission mode includes at least the star flash basic mode and the star flash low power mode. The synchronized and aligned video information to be transmitted is transmitted to the 360-degree panoramic image domain controller via the target star flash transmission mode.

[0049] In some possible implementations, the processing and transmission module 420 includes: The correction unit is used to sequentially perform image distortion correction processing and perspective transformation processing on the video information to be transmitted to obtain the corrected video information to be transmitted. The stitching unit is used to perform stitching processing on the corrected video information to be transmitted according to the local pyramid fusion algorithm to obtain the panoramic image video signal.

[0050] In some possible implementations, the control display module 430 includes: The acquisition unit is used to acquire vehicle operating information through a bus communication protocol, wherein the operating information includes at least one of gear position, vehicle speed, steering signal and surrounding radar perception information. The generation unit is used to make logical judgments based on the running information, generate corresponding display trigger instructions based on the results of the logical judgments, and automatically control the display status of the panoramic image video signal through the display trigger instructions.

[0051] In some possible implementations, the 360° panoramic imaging domain controller is integrated with the vehicle's intelligent cockpit domain controller.

[0052] The 360° panoramic image processing and display device provided in this embodiment of the invention can execute the 360° panoramic image processing and display method provided in any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the method.

[0053] Figure 5 This is a schematic diagram of the structure of an electronic device for implementing the 360° panoramic image processing and display method according to embodiments of the present invention. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0054] like Figure 5As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12 or a random access memory (RAM) 13, communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer program stored in the ROM 12 or loaded into the RAM 13 from storage unit 18. The RAM 13 can also store various programs and data required for the operation of the electronic device 10. The processor 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0055] Multiple components in electronic device 10 are connected to I / O interface 15, including: input unit 16, such as keyboard, mouse, etc.; output unit 17, such as various types of displays, speakers, etc.; storage unit 18, such as disk, optical disk, etc.; and communication unit 19, such as network card, modem, wireless transceiver, etc. Communication unit 19 allows electronic device 10 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0056] Processor 11 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, digital signal processors (DSPs), and any suitable processor, controller, microcontroller, etc. Processor 11 performs the various methods and processes described above, such as the processing and display methods for 360-degree panoramic images.

[0057] In some embodiments, the method for processing and displaying 360° panoramic images can be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed on electronic device 10 via ROM 12 and / or communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the method for processing and displaying 360° panoramic images described above can be performed. Alternatively, in other embodiments, processor 11 can be configured to perform the method for processing and displaying 360° panoramic images by any other suitable means (e.g., by means of firmware).

[0058] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations may include: implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0059] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0060] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0061] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0062] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or middleware components (e.g., application servers), or frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0063] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0064] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0065] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A method for processing and displaying 360° panoramic images, characterized in that, include: The system uses at least two StarFlash wireless communication cameras positioned around the vehicle to collect video information about the surrounding environment that needs to be transmitted. The video information to be transmitted is transmitted to the 360° panoramic image domain controller, and the 360° panoramic image domain controller performs image stitching processing on the video information to be transmitted to obtain a panoramic image video signal. The system acquires vehicle operating information and performs display trigger control on the panoramic image video signal based on the operating information, so as to transmit the panoramic image video signal that meets the trigger conditions to the vehicle display terminal for display.

2. The method according to claim 1, characterized in that, The method involves acquiring video information about the vehicle's surrounding environment through at least two wireless communication cameras positioned around the vehicle, including: The Star Flash wireless communication cameras are installed at the front, rear, left, and right sides of the vehicle. The Star Flash wireless communication cameras are high-definition fisheye cameras with integrated Star Flash wireless communication modules. The high-definition fisheye camera captures video of the vehicle's surrounding environment from all angles, obtaining multiple channels of raw video information, which are then used to construct the video information to be transmitted.

3. The method according to claim 1, characterized in that, The step of transmitting the video information to be transmitted to the 360° panoramic image domain controller includes: Based on the microsecond-level synchronization precision of StarFlash wireless communication, the multiple original video information of the video information to be transmitted is synchronized and aligned. The synchronized and aligned video information to be transmitted is transmitted to the 360° panoramic image domain controller via the StarFlash wireless communication protocol, wherein the 360° panoramic image domain controller integrates a StarFlash wireless communication module.

4. The method according to claim 3, characterized in that, The step of transmitting the synchronized and aligned video information to the 360° panoramic image domain controller via the StarFlash wireless communication protocol includes: The target star flash transmission mode is determined based on the vehicle's power consumption information, wherein the target star flash transmission mode includes at least the star flash basic mode and the star flash low power mode. The synchronized and aligned video information to be transmitted is transmitted to the 360-degree panoramic image domain controller via the target star flash transmission mode.

5. The method according to claim 1, characterized in that, The step of performing image stitching processing on the video information to be transmitted through the 360° panoramic image domain controller to obtain a panoramic image video signal includes: The 360° panoramic image domain controller sequentially performs image distortion correction and perspective transformation processing on the video information to be transmitted to obtain the corrected video information to be transmitted. According to the local pyramid fusion algorithm, the corrected video information to be transmitted is stitched together to obtain the panoramic image video signal.

6. The method according to claim 1, characterized in that, The step of acquiring vehicle operating information and performing display trigger control on the panoramic image video signal based on the operating information includes: The 360° panoramic imaging domain controller obtains vehicle operating information through a bus communication protocol, wherein the operating information includes at least one of gear position, vehicle speed, steering signal, and surrounding radar perception information. Based on the operational information, a logical judgment is made, and a corresponding display trigger command is generated based on the result of the logical judgment. The display trigger command is then used to automatically control the display status of the panoramic image video signal.

7. The method according to claim 1, characterized in that, The method further includes: The 360° panoramic imaging domain controller is integrated with the vehicle's intelligent cockpit domain controller.

8. A 360° panoramic image processing and display device, characterized in that, include: The video acquisition module is used to acquire video information of the vehicle's surrounding environment to be transmitted through at least two StarFlash wireless communication cameras set around the vehicle. The processing and transmission module is used to transmit the video information to be transmitted to the 360° panoramic image domain controller, and to perform image stitching processing on the video information to be transmitted through the 360° panoramic image domain controller to obtain a panoramic image video signal. The control display module is used to acquire vehicle operating information and perform display trigger control on the panoramic image video signal according to the operating information, so as to transmit the panoramic image video signal that meets the trigger conditions to the vehicle display terminal for display.

9. An electronic device, characterized in that, The electronic device includes: At least one processor; and a memory communicatively connected to the at least one processor; The memory stores a computer program that can be executed by the at least one processor, which is then executed by the at least one processor to enable the at least one processor to perform the 360-degree panoramic image processing and display method according to any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that, when executed by a processor, implement the processing and display method of the 360-degree panoramic image according to any one of claims 1-7.

Images