Display processing method and apparatus, electronic device, storage medium, and program product

Abstract

This disclosure provides a display processing method, apparatus, electronic device, storage medium, and program product, relating to the field of vehicle display technology. The method includes: in response to receiving a split-screen command, dividing the display interface of the vehicle's main display device into a first display interface for displaying different content and at least one second display interface; processing the display content corresponding to the at least one second display interface into multiple different projection data; and sending the multiple different projection data to multiple projection devices. This method can improve the diversity and security of in-vehicle projection displays, thereby enhancing the user experience.

Description

Technical Field

[0001] This disclosure relates to the field of vehicle display technology, and in particular to a display processing method, apparatus, electronic device, storage medium, and program product. Background Technology

[0002] As vehicles become increasingly intelligent and electronic, the functions enabled by in-vehicle infotainment (IVI) systems are becoming more and more diverse. Currently, in addition to the main screen corresponding to the driver's seat, other passenger seats are also equipped with screens that are matched with IVI. Therefore, there is usually more than one screen in a vehicle. However, in the current multi-screen interaction, the content displayed on the screens corresponding to the passenger seats is the same as all the content displayed on the main screen. That is, they share the same screen content with the main screen, resulting in relatively limited infotainment content. This content may not be what the passenger seat users want, thus failing to meet user needs and affecting the user experience. Summary of the Invention

[0003] This disclosure provides a display processing method, display processing device, electronic device, computer-readable storage medium, and computer program product, which can project and display data with different display content to different projection devices without affecting or interfering with the display content corresponding to the first display interface. This can improve the diversity and security of in-vehicle projection display and enhance the user experience.

[0004] In a first aspect, embodiments of this disclosure propose a display processing method, comprising: in response to receiving a split-screen instruction, dividing the display interface of the vehicle's main display device into a first display interface for displaying different content and at least one second display interface; processing the display content corresponding to the at least one second display interface into multiple different data to be projected; and sending the multiple different data to be projected to multiple devices to be projected.

[0005] Secondly, embodiments of this disclosure provide a display processing apparatus, comprising: a partitioning module, a processing module, and a communication module. The partitioning module is configured to, in response to receiving a screen splitting command, partition the display interface of the vehicle's main display device into a first display interface for displaying different content and at least one second display interface; the processing module is configured to process the display content corresponding to the at least one second display interface into multiple different data to be projected; and the communication module is configured to send the multiple different data to be projected to multiple devices to be projected.

[0006] Thirdly, embodiments of this disclosure provide an electronic device, the electronic device including: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to implement the display processing method as described in any implementation of the first aspect.

[0007] Fourthly, embodiments of this disclosure provide a non-transitory computer-readable storage medium storing computer instructions that enable a computer to implement the display processing method described in any of the implementations of the first aspect when executed.

[0008] Fifthly, embodiments of this disclosure provide a computer program product including a computer program that, when executed by a processor, can implement the display processing method as described in any implementation of the first aspect.

[0009] The display processing solution provided in this disclosure can, based on the on-demand splitting of the display interface of the vehicle's main display device to obtain display interfaces for displaying different content (i.e., including a first display interface and one or more second display interfaces), process the display content corresponding to a portion of the split display interfaces (i.e., at least one second display interface) into projection data that can be projected onto the corresponding projection devices. In this way, projection data corresponding to different display content can be displayed on different projection devices without affecting or interfering with the display content corresponding to the first display interface, thereby improving the diversity and security of in-vehicle projection displays and enhancing the user experience.

[0010] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this disclosure, nor is it intended to limit the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0011] Other features, objects, and advantages of this disclosure will become more apparent from the following detailed description of non-limiting embodiments with reference to the accompanying drawings:

[0012] Figure 1 This is an exemplary system architecture to which this disclosure can be applied;

[0013] Figure 2 A flowchart of a display processing method provided in an embodiment of this disclosure;

[0014] Figure 3 This is a schematic diagram of a display processing architecture provided in an application scenario according to an embodiment of the present disclosure;

[0015] Figure 4 For based on Figure 3 The diagram illustrates the effect of screen mirroring after split-screen operation in the corresponding application scenarios.

[0016] Figure 5 A structural block diagram of a display processing device provided in an embodiment of this disclosure;

[0017] Figure 6 This is a schematic diagram of the structure of an electronic device suitable for performing a display processing method, provided as an embodiment of the present disclosure. Detailed Implementation

[0018] The exemplary embodiments of this disclosure are described below with reference to the accompanying drawings, including various details of the embodiments to aid understanding; these should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of this disclosure. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description. It should be noted that, unless otherwise specified, the embodiments and features described in this disclosure can be combined with each other.

[0019] It should be noted that the collection, acquisition, storage, processing, transmission, provision, disclosure, and application of user personal information (such as identity verification information) involved in the technical solution disclosed herein are all carried out with the user's knowledge and explicit authorization, comply with the provisions of relevant laws and regulations, and do not violate public order and good morals.

[0020] As vehicles become increasingly intelligent and electronic, the functions of in-vehicle infotainment (IVI) systems are becoming more diverse. Currently, in addition to the main screen for the driver, other passenger seats are also equipped with screens that match IVI. Therefore, there is usually more than one screen in a vehicle. However, in the current multi-screen interaction, the screens for passenger seats display all the content of the main screen in sync, meaning they share the same screen content. This results in limited infotainment content that may not be what the passenger wants, thus failing to meet user needs and affecting the user experience.

[0021] Therefore, considering the current diversity of in-vehicle infotainment functions and users' demand for infotainment content, there is a need for a solution that can split the content of the main screen and project or cast it to two independent display screens, such as the rear of the vehicle, without affecting the operation of the main screen and the different functions of the split content.

[0022] Figure 1An exemplary architecture of a vehicle 100 to which embodiments of the display processing methods, display processing apparatus, electronic devices, computer-readable storage media, and computer program products of the present disclosure can be applied is illustrated. The vehicle 100 may include a first controller 110, a second controller 120, a screen 130, and peripherals 140. The first controller 110 and the second controller 120 are communicatively connected to enable data interaction.

[0023] In some optional implementations of the embodiments of this disclosure, the first controller 110 can be implemented as a microcontroller (MCU), mainly responsible for controlling and managing various devices and sensors of the vehicle. The first controller 110 can be used to acquire and process sensor data, control and schedule actuators, etc. It should be noted that, without departing from the teachings of this disclosure, the first controller 110 can also be implemented as other devices with data processing capabilities, and no specific limitations are made herein.

[0024] In some optional implementations of the embodiments of this disclosure, the second controller 120 can be implemented as a system-on-a-chip (SoC), which integrates a processor, memory, peripherals, and other functions. Due to its powerful computing and processing capabilities, the second controller 120 can be integrated into an in-vehicle infotainment system (referred to as an in-vehicle infotainment system) and used to process and analyze sensor data in real time, and make decisions. It should be noted that, without departing from the teachings of this disclosure, the second controller 120 can also be implemented as other devices with computing and processing capabilities, and no specific limitations are made herein.

[0025] In some optional implementations of the embodiments of this disclosure, the first controller 110 and the second controller 120 may be specifically located in the cockpit domain of the vehicle 100.

[0026] It should be noted that in some optional implementations of the embodiments of this disclosure, other controllers may also be provided in the vehicle 100 to better realize the functions of the vehicle system, etc., which are not specifically limited here.

[0027] In some optional implementations of the embodiments of this disclosure, the screen 130 may include, but is not limited to, at least one of an instrument cluster display, a central control display, and a rear-seat display. In some optional implementations, after the vehicle system mounted on the second controller 120 is started, it can output the instrument cluster interface, etc., to the instrument cluster display for display, and output the central control interface, etc., to the central control display for display.

[0028] In some optional implementations of the embodiments of this disclosure, the peripheral device 140 of the vehicle 100 may refer to the device of the vehicle system mounted on the second controller 120, which may include, but is not limited to, devices such as microphones and vehicle cameras, etc., which will not be listed here.

[0029] Please refer to Figure 2 , Figure 2 A flowchart of a display processing method provided in this disclosure embodiment, the display processing method being applied to an in-vehicle infotainment system, wherein process 200 includes the following steps:

[0030] Step 201: In response to receiving the split-screen instruction, the display interface of the vehicle's main display device is divided into a first display interface for displaying different content and at least one second display interface.

[0031] This step is intended to be performed by the entity executing the display processing method (e.g., Figure 1 The vehicle infotainment system (VIS) in the vehicle 100 shown receives a split-screen command and can dynamically divide the display interface of the main display device (such as the central control display device) into display interfaces (or display areas) for displaying different content based on the requirements corresponding to the split-screen command. Specifically, the display interface of the main display device can be divided into a first display interface and at least one second display interface. If the number of at least one second display interface is one, the first display interface and the second display interface will display different content respectively. If the number of at least one second display interface is multiple, the first display interface and the multiple second display interfaces can display different content respectively to meet different split-screen display requirements.

[0032] Step 202: Process the display content corresponding to at least one second display interface into multiple different data to be projected.

[0033] Based on step 201, this step aims to have the aforementioned executing entity process the display content corresponding to at least one second display interface obtained from the above-mentioned screen splitting into multiple different screen-casting data suitable for screen casting.

[0034] Step 203: Send multiple different screen projection data to multiple screen projection devices.

[0035] Based on step 202, step 203 aims to have the aforementioned executing entity send multiple data to be projected to multiple devices for projecting, obtained by processing the display content corresponding to each of the at least one second display interface, to meet diverse projecting needs.

[0036] The display processing method provided in this disclosure can, based on the on-demand splitting of the display interface of the vehicle's main display device to obtain display interfaces for displaying different content (i.e., including a first display interface and one or more second display interfaces), process the display content corresponding to a portion of the split display interfaces (i.e., at least one second display interface) into projection data that can be projected onto the corresponding projection devices. In this way, projection data corresponding to different display content can be displayed on different projection devices without affecting or interfering with the display content corresponding to the first display interface, allowing different projection devices to display independently, improving the diversity and security of in-vehicle projection display, and enhancing the user experience.

[0037] In the above Figure 2 Based on the corresponding display processing method embodiments, in some optional implementations of the embodiments of this disclosure, in response to the different number of the above-mentioned at least one second display interface and the different types of the corresponding display content, the above-mentioned step 202 can be specifically executed as a scheme corresponding to different screen projection requirements. The following will further explain in conjunction with the corresponding implementation methods.

[0038] In one optional implementation of this disclosure, the number of the at least one second display interface is one, and the display content corresponding to the second display interface is multi-party interactive content. Further, step 202 can be specifically executed as follows: based on the multiple interactive perspectives associated with the multi-party interactive content, and the correspondence between the multiple interactive perspectives and the multiple devices to be projected, the multi-party interactive content is processed into multiple different data to be projected.

[0039] In this embodiment, the multi-party interactive content displayed on the same display interface can be processed based on its associated multiple interactive perspectives and displayed on the projection device corresponding to each interactive perspective. This enables the complete display content on the same display interface to be processed into different parts of projection data and displayed on the corresponding projection devices, thereby improving the user's interactive experience based on projection.

[0040] Furthermore, in an optional implementation of this disclosure, the above display processing method may further include the following: in response to receiving operation data associated with multiple interactive perspectives from multiple devices to be projected, updating the multi-party interactive content displayed on the second display interface according to the operation data associated with the multiple interactive perspectives.

[0041] In this embodiment, different users can input operations on the display content corresponding to the data to be projected, based on their respective target devices and interactive perspectives. This allows them to obtain operation data associated with each interactive perspective in real time. Furthermore, each target device can synchronously feed back the real-time operation data associated with its corresponding interactive perspective to the vehicle's main display device. In this way, the operation data associated with different interactive perspectives fed back by different target devices can be integrated and displayed in real time on the second display interface of the vehicle's main display device. This enables the updating of the display content on the second display interface, ensuring high synchronization with the real-time content displayed on each target device. This allows the latest multi-party interactive content to be displayed to the user corresponding to the vehicle's main display device, further enhancing the user experience.

[0042] Furthermore, in an optional implementation of this disclosure, the correspondence between the multiple interactive viewpoints and the multiple screen-projection devices can be determined based on different preset operations, thereby ensuring the reliability and stability of establishing the correspondence between different interactive viewpoints and different screen-projection devices. The preset operations may include, but are not limited to, one of the following:

[0043] In one implementation, a correspondence between multiple interactive perspectives and multiple devices to be projected can be established based on click operations on the identifiers of multiple devices to be projected displayed on the second display interface. In this implementation, the identifiers of multiple devices to be projected can be displayed on the second display interface of the vehicle's main display device, and in response to receiving click operations on the identifiers of the devices to be projected, the corresponding devices to be projected can be selected for different interactive perspectives.

[0044] In another implementation, the sliding operation received by the second display interface can establish a correspondence between multiple interactive perspectives and multiple screen projection devices; different sliding operations correspond to different screen projection devices, for example, sliding operations corresponding to different directions can correspond to different screen projection devices, which can efficiently establish a correspondence; furthermore, the sliding operation can include a touch operation input in the display area of ​​the vehicle's main display device corresponding to the second display interface.

[0045] In another implementation, a correspondence between multiple interactive perspectives and multiple devices to be projected can be established based on a selection operation performed on the first speech recognition result; wherein the first speech recognition result is obtained by semantic recognition of the received first speech information. This implementation can improve the convenience of establishing the above correspondence.

[0046] Furthermore, in an optional implementation of this disclosure, the aforementioned multi-party interactive content may include, but is not limited to, game application content based on multi-party interaction.

[0047] In another optional implementation of this disclosure, the number of the at least one second display interface is multiple, and the multiple second display interfaces are respectively used to display content of different applications. Further, step 202 can be specifically executed as follows:

[0048] In response to receiving a screen projection command for a target display interface among multiple second display interfaces, the coordinate data of the area occupied by the target display interface in the main display device of the vehicle system is determined; based on the coordinate data and the application content displayed in the target display interface, the screen projection data corresponding to the target screen projection device is determined; wherein, the target screen projection device is the display device corresponding to the screen projection command among multiple screen projection devices.

[0049] In this embodiment, the application content displayed on a target display interface (which may include some or all of the multiple second display interfaces) that meets the casting requirements (i.e., corresponds to the currently received casting command) from multiple second display interfaces on the vehicle's main display device can be cast to a target device that meets the aforementioned casting requirements. This achieves casting of the complete application content displayed on a specific second display interface and allows different devices to display independently. Specifically, the casting data that can be cast to the target device can be generated based on the specific area occupied by the target display interface on the vehicle's main display device and the application content displayed therein. The coordinate data of the area occupied by the target display interface on the vehicle's main display device can be used to effectively distinguish the content displayed on different second display interfaces.

[0050] Furthermore, based on any of the above embodiments, some optional implementations of the embodiments of this disclosure may also include the following: In response to the difference between the display parameters of each second display interface and the display parameters of its corresponding projection device, when displaying each projection data on its corresponding projection device, in order to ensure the display effect, it is necessary to adaptively adjust the projection data based on the display parameters of the projection device. The display parameters may include, but are not limited to, resolution, aspect ratio, etc.

[0051] Furthermore, based on any of the above embodiments, in some optional implementations of the embodiments of this disclosure, after step 203, the following may also be included: setting the display mode of at least one second display interface to floating display (e.g., displaying on the side or bottom edge of the vehicle's main control display device) or hidden display (e.g., running in the background) to further ensure the display effect of the display content corresponding to the first display interface in the vehicle's main display device.

[0052] Based on any of the above embodiments, in some optional implementations of the embodiments of this disclosure, the triggering method of the above split-screen command includes, but is not limited to, one of the following implementation methods:

[0053] In one implementation, in response to detecting a second voice message indicating that the interface of the vehicle's main display device should be split into two screens, it can be determined that an operation needs to be performed to divide the display interface of the vehicle's main display device into a first display interface for displaying different content and at least one second display interface. This implementation can ensure the convenience of splitting the display interface of the vehicle's main display device.

[0054] In another implementation, in response to detecting a preset gesture indicating that the interface of the vehicle's main display device should be split into two screens, it can be determined that an operation needs to be performed to divide the display interface of the vehicle's main display device into a first display interface for displaying different content and at least one second display interface. This implementation can ensure the convenience of splitting the display interface of the vehicle's main display device.

[0055] In another implementation, in response to the detection of a preset button being triggered, it can be determined that an operation needs to be performed to divide the display interface of the vehicle's main display device into a first display interface for displaying different content and at least one second display interface. This implementation ensures the convenience of splitting the display interface of the vehicle's main display device. The preset button may include a combination of multiple physical buttons based on the vehicle's steering wheel, or it may include controls or buttons displayed on the display interface of the vehicle's main display device that can trigger the split-screen function.

[0056] Based on any of the above embodiments, in some optional implementations of the embodiments of this disclosure, the display content corresponding to the first display interface may include, but is not limited to, driver assistance content (such as navigation information) or in-vehicle entertainment content (such as in-vehicle broadcast information).

[0057] Based on any of the above embodiments, in some optional implementations of the embodiments of this disclosure, the plurality of display devices to be projected may include a display device corresponding to the front passenger position of the vehicle and at least one display device corresponding to the rear passenger position of the vehicle; wherein, the display device corresponding to the rear passenger position of the vehicle may include a display device disposed on the back of the front seat of the vehicle.

[0058] To enhance understanding, this disclosure also provides a specific implementation scheme based on a particular application scenario. Please refer to the example below. Figure 3The display processing framework 300 shown can be applied to in-vehicle infotainment systems. Specifically, it can be used in scenarios where the main screen content (corresponding to the display content of the main display device in the above embodiment) is divided and projected or cast to two independent rear-seat displays (corresponding to multiple devices to be cast in the above embodiment) and a gamepad is supported for multiplayer online games. The framework 300 may include:

[0059] The intelligent split-screen processing module 301 has dynamic partitioning capability, which can split the vehicle's main screen interface (corresponding to the display interface of the vehicle's main display device in the above embodiment) into two parts according to the needs. One part maintains the regular main screen function operation interface (corresponding to the first display interface in the above embodiment), and the other part serves as the game screen source (corresponding to at least one second display interface in the above embodiment). That is, the game application can be launched through the main screen and the split screen can be intelligently split.

[0060] Specifically, users can initiate split-screen mode via commands (such as voice / gesture / shortcut). After receiving the screen casting command, the displayed data is integrated and encoded for the casting party and different roles (corresponding to multiple screen casting devices and multiple interactive perspectives in the above embodiments). The data can be cast to the screen based on the encoding, and different screens receive different data.

[0061] Furthermore, the confirmation method for the target screen to be projected, such as the left rear screen, may include, but is not limited to: (1) selecting from the screens that have been connected; (2) selecting based on voice control to achieve semantic recognition selection, such as projecting to user A, who is a passenger in the left rear seat; (3) selecting by sliding, such as long-pressing the side of the screen to be projected, sliding down to the left rear screen, sliding to the right to the front passenger screen, and sliding down to the right to the right rear screen.

[0062] Furthermore, after the split-screen is completed, a floating window can be used to display the projected screen (i.e., the game screen source mentioned above). Clicking on it will display it in full screen, or the floating window can be hidden and run in the side / background.

[0063] The split-screen transmission module 302 can encode the two split screen parts separately and transmit them to the corresponding rear-seat displays via the in-vehicle high-speed communication network. Alternatively, it can split the screen into more parts, such as three parts, to be projected onto three or more screens, including the passenger seat and rear seats. The encoding also includes the coordinates of the projection data, and the passenger seat or rear-seat screen receiving the projection will adjust the display according to its own screen size. The game screen can be transmitted to the rear-seat screen wirelessly or via wired connection.

[0064] The wireless communication module 303 is used in a vehicle with two independent displays in the rear, each receiving and decoding content from the main screen for independent display. The rear of the vehicle is equipped with at least two independent displays, each with the built-in wireless communication module 303 for receiving and displaying the corresponding content. These independent rear displays can either be fully covered, meaning that other functions cannot be operated while the game is running; or the screen can be hidden (by sliding to the side or displaying in the background), for example, after the game character has finished playing (game over), allowing further operation of other functions on the independent display.

[0065] The controller interface module 304 integrates a wireless controller interface on the rear-seat display, supporting simultaneous connection and game control of at least two controllers. Controller operation signals are transmitted back to the game server in real time for response. This means rear passengers can connect controllers and start playing games, with controller operation data synchronized to the game system. The projected screen can be operated via external devices or touchscreens.

[0066] The front main screen function isolation module 305 ensures that while the rear passengers are playing games, the driver or passengers in the front can continue to use functions such as navigation, music playback, and vehicle settings in the display window D of the projection screen (which can correspond to the second display interface in the vehicle main display device in the above embodiment) without interference. In other words, the front main screen retains a non-game function area for the driver or other passengers to operate independently, achieving complete independence and non-interference between the front and rear functions.

[0067] The screen adaptation and content synchronization and adaptive module 306 can ensure the synchronous update of the screen between the main screen and the rear display screen. It automatically adjusts the game screen display effect according to the characteristics of the rear display screen, such as resolution and aspect ratio, to ensure smooth display effect and game experience.

[0068] The game data synchronization and control module 307 can synchronize game data across multiple screens via the vehicle network and recognize and forward controller input commands, allowing rear passengers to independently control their respective game characters or units using controllers, touchscreens, gestures, or other methods. Specifically, the main control of each screen varies depending on the user's selected online game perspective, such as... Figure 4 As shown, the user selects character A on screen A and character B on screen B. Each screen controls the character's actions, and the actions are fed back to display window C on the projection screen (which can correspond to the second display interface in the vehicle's main display device in the above embodiment). The projection screen then summarizes and displays the actions from both screens. Screens A and B (which can correspond to multiple projection devices in the above embodiment) represent the primary perspective of their respective characters, while the main screen displays a third-person perspective after summarizing the actions.

[0069] The resource scheduling and optimization module 308 allows the system to monitor and adjust resource allocation in real time through efficient resource allocation and scheduling algorithms. This ensures that while meeting the different needs of the front and rear rows and ensuring the normal operation of front and rear row functions, the overall performance of the vehicle system remains stable, preventing performance degradation of other key functions due to game operation.

[0070] The solution provided in this embodiment can effectively address the need for parallel operation of front and rear row functions in in-vehicle multimedia systems, especially the issue of rear passengers playing games without interfering with the front row driving assistance and entertainment functions, thereby improving the diversity and safety of in-vehicle entertainment facilities.

[0071] Further reference Figure 5 As an implementation of the methods shown in the above figures, this disclosure provides an embodiment of a display processing device, which is similar to... Figure 2 Corresponding to the method embodiment shown, the device can be specifically applied to in-vehicle infotainment systems.

[0072] like Figure 5 As shown, the display processing device 500 of this embodiment may include: a partitioning module 501, a processing module 502, and a communication module 503.

[0073] The partitioning module 501 is configured to, in response to receiving a screen splitting command, divide the display interface of the vehicle's main display device into a first display interface for displaying different content and at least one second display interface; the processing module 502 is configured to process the display content corresponding to at least one second display interface into multiple different data to be projected; and the communication module 503 is configured to send multiple different data to be projected to multiple devices.

[0074] In the display processing device 500 of this embodiment, the specific processing of the partitioning module 501, the processing module 502, and the communication module 503, and the resulting technical effects, can be found in the following references: Figure 2 The relevant descriptions of steps 201-203 in the corresponding embodiments will not be repeated here.

[0075] In some optional implementations of this embodiment, the display content corresponding to the second display interface is multi-party interactive content; and the processing module 502 is further configured to: process the multi-party interactive content into multiple different screen-projection data based on multiple interactive perspectives associated with the multi-party interactive content and the correspondence between the multiple interactive perspectives and multiple screen-projection devices.

[0076] In some optional implementations of this embodiment, the display processing device 500 may further include: an update module (not shown in the figure), configured to update the multi-party interactive content displayed on the second display interface in response to receiving operation data associated with multiple interactive perspectives from multiple devices to be projected.

[0077] In some optional implementations of this embodiment, the correspondence between the multiple interactive perspectives and the multiple screen-projection devices is determined based on preset operations. The preset operations include one of the following: a click operation on the identifiers of the multiple screen-projection devices displayed on the second display interface; a swipe operation received through the second display interface; wherein different swipe operations correspond to different screen-projection devices; a selection operation performed on the first voice recognition result; wherein the first voice recognition result is obtained based on semantic recognition of the received first voice information.

[0078] In some optional implementations of this embodiment, the number of the at least one second display interface is multiple, and the multiple second display interfaces are used to display the content of different applications respectively; and the processing module 502 is further configured to: in response to receiving a screen projection instruction for a target display interface among the multiple second display interfaces, determine the coordinate data of the area occupied by the target display interface in the interface of the vehicle's main display device; based on the coordinate data and the application content displayed in the target display interface, determine the screen projection data corresponding to the target screen projection device; wherein, the target screen projection device is the display device corresponding to the screen projection instruction among the multiple screen projection devices.

[0079] In some optional implementations of this embodiment, the triggering method of the above-mentioned split-screen instruction includes one of the following: detecting a second voice message indicating that the interface of the vehicle's main display device is split-screen; detecting a preset gesture indicating that the interface of the vehicle's main display device is split-screen; or detecting that a preset button is triggered.

[0080] This embodiment is a device embodiment corresponding to the method embodiment described above. The display processing device provided in this embodiment can, based on the on-demand splitting of the display interface of the vehicle's main display device to obtain display interfaces for displaying different content (i.e., including one first display interface and one or more second display interfaces), process the display content corresponding to a portion of the split display interfaces (i.e., at least one second display interface) into projection data that can be projected onto the corresponding projection device. In this way, projection data corresponding to different display content can be displayed on different projection devices without affecting or interfering with the display content corresponding to the first display interface, thereby improving the diversity and safety of in-vehicle projection display and enhancing the user experience.

[0081] According to embodiments of the present disclosure, the present disclosure also provides an electronic device, the electronic device comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to implement the display processing method described in any of the above embodiments when executed.

[0082] According to embodiments of this disclosure, this disclosure also provides a readable storage medium storing computer instructions that enable a computer to implement the display processing method described in any of the above embodiments when executed.

[0083] According to embodiments of this disclosure, this disclosure also provides a computer program product that, when executed by a processor, can implement the display processing method described in any of the above embodiments.

[0084] Figure 6 A schematic block diagram of an example electronic device 600 that can be used to implement embodiments of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as in-vehicle systems in vehicles. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0085] like Figure 6 As shown, the electronic device 600 includes a processing unit 601, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 602 or a computer program loaded from a storage unit 608 into a random access memory (RAM) 603. The RAM 603 may also store various programs and data required for the operation of the electronic device 600. The processing unit 601, ROM 602, and RAM 603 are interconnected via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0086] Multiple components in electronic device 600 are connected to I / O interface 605, including: input unit 606, such as a touch screen; output unit 607, such as various types of displays, speakers, etc.; storage unit 608, such as an embedded multi-media card (EMMC), universal flash storage (UFS), etc.; and communication unit 609, such as a network card, modem, wireless transceiver, etc. Communication unit 609 allows electronic device 600 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0087] Processing unit 601 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processing unit 601 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processing unit 601 performs the various methods and processes described above, such as display processing methods. For example, in some embodiments, display processing methods may be implemented as computer software programs tangibly contained in a machine-readable medium, such as storage unit 608. In some embodiments, part or all of the computer program may be loaded and / or installed on electronic device 600 via ROM 602 and / or communication unit 609. When the computer program is loaded into RAM 603 and executed by processing unit 601, one or more steps of the display processing methods described above may be performed. Alternatively, in other embodiments, processing unit 601 may be configured to perform display processing methods by any other suitable means (e.g., by means of firmware).

[0088] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0089] The program code used to implement the methods of this disclosure may be written in any combination of one or more programming languages. This program code may be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus, such that when executed by the processor or controller, the program code causes the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The program code may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0090] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0091] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0092] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as a data server), or computing systems that include middleware components (e.g., an application server), or computing systems that include frontend components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with embodiments of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), and the Internet.

[0093] Computer systems can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud microprocessor, a microprocessor product within the cloud computing service system, designed to address the shortcomings of traditional physical microprocessors and Virtual Private Server (VPS) services, such as high management difficulty and weak business scalability.

[0094] According to the technical solution of this disclosure, the display interface of the vehicle's main display device can be split into multiple screens as needed to obtain display interfaces for displaying different content (i.e., including a first display interface and one or more second display interfaces). Then, the display content corresponding to a portion of the split display interfaces (i.e., at least one second display interface) can be processed into projection data that can be projected onto the corresponding projection device. In this way, projection data with different content can be displayed on different projection devices without affecting or interfering with the display content corresponding to the first display interface. This improves the diversity and security of in-vehicle projection display and enhances the user experience.

[0095] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this disclosure can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution disclosed in this disclosure can be achieved, and this is not a limitation herein; and the terms "first," "second," "third" (if any) in this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence, nor do they constitute a specific limitation.

[0096] It should also be understood that expressions such as "comprising," "including," "having," "containing," and / or "comprising" are open-ended rather than closed-ended expressions in this disclosure, indicating the presence of the stated features, elements, and / or components, but not excluding the presence of one or more other features, elements, components, and / or combinations thereof. Furthermore, when expressions such as "at least one of..." appear after a list of listed features, they modify the entire list of features, not just individual elements in the list. Additionally, when describing embodiments of this disclosure, the word "may" is used to mean "one or more embodiments of this disclosure." And the term "exemplary" is intended to refer to an example or illustration.

[0097] Unless otherwise specified, all terms used herein (including engineering and technical terms) shall have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure pertains. It should also be understood that, unless expressly stated in this disclosure, terms as defined in common dictionaries shall be interpreted as having the meaning consistent with their meaning in the context of the relevant art, and not as having an idealized or overly formalized meaning.

[0098] The specific embodiments described above do not constitute a limitation on the scope of protection of this disclosure. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure should be included within the scope of protection of this disclosure.

Claims

1. A display processing method, comprising: In response to receiving a split-screen command, the display interface of the vehicle's main display device is divided into a first display interface for displaying different content and at least one second display interface; The display content corresponding to the at least one second display interface is processed into multiple different data to be projected onto the screen. The various different screen projection data are sent to the various screen projection devices.

2. The method according to claim 1, wherein, The content displayed on the second display interface is multi-party interactive content; as well as The step of processing the display content corresponding to the at least one second display interface into multiple different data to be projected includes: Based on the multiple interactive perspectives associated with the multi-party interactive content, and the correspondence between the multiple interactive perspectives and the multiple screen projection devices, the multi-party interactive content is processed into multiple different screen projection data.

3. The method according to claim 2, further comprising: In response to receiving operation data associated with the multiple interactive perspectives from the multiple devices to be projected, the multi-party interactive content displayed on the second display interface is updated according to the operation data associated with the multiple interactive perspectives.

4. The method according to claim 2, wherein, The correspondence between the multiple interactive viewpoints and the multiple devices to be projected is determined based on a preset operation, wherein the preset operation includes one of the following: Clicking on the icons of the multiple devices to be projected displayed in the second display interface; The sliding operation received through the second display interface; wherein, different sliding operations correspond to different screen projection devices; A selection operation is performed on the first speech recognition result; wherein the first speech recognition result is obtained based on semantic recognition of the received first speech information.

5. The method according to claim 1, wherein, The number of the at least one second display interface is multiple, and the multiple second display interfaces are used to display the content of different applications; as well as The step of processing the display content corresponding to the at least one second display interface into multiple different data to be projected includes: In response to receiving a projection command for a target display interface among the plurality of second display interfaces, the coordinate data of the area occupied by the target display interface in the interface of the vehicle's main display device are determined; Based on the coordinate data and the application content displayed in the target display interface, the screen projection data corresponding to the target screen projection device is determined; wherein, the target screen projection device is the display device corresponding to the screen projection command among the plurality of screen projection devices.

6. The method according to any one of claims 1 to 5, wherein, The split-screen command is triggered in one of the following ways: A second voice message instructing the user to split the screen of the vehicle's main display device was detected. A preset gesture indicating that the interface of the vehicle's main display device should be split into two screens was detected; A preset key has been triggered.

7. A display processing device, comprising: The partitioning module is configured to, in response to receiving a screen splitting command, divide the display interface of the vehicle's main display device into a first display interface for displaying different content and at least one second display interface. The processing module is configured to process the display content corresponding to the at least one second display interface into multiple different data to be projected. The communication module is configured to send the multiple different screen projection data to multiple screen projection devices.

8. An electronic device, comprising: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the display processing method according to any one of claims 1-6.

9. A non-transitory computer-readable storage medium storing computer instructions for causing the computer to perform the display processing method according to any one of claims 1-6.

10. A computer program product comprising a computer program that, when executed by a processor, implements the steps of the display processing method according to any one of claims 1-6.

Images