Screen projection method, device and equipment and storage medium

Abstract

The disclosure provides a screen projection method, device, equipment and storage medium, relates to the technical field of computers, in particular to the technical field of artificial intelligence, automatic driving and intelligent traffic. The specific implementation scheme is: applied to the vehicle-mounted electronic equipment deployed on the vehicle; the vehicle includes a plurality of display screens; the vehicle-mounted electronic equipment is installed with a plurality of connection management APPs corresponding to the plurality of display screens one by one; the screen projection method comprises: receiving terminal information from a plurality of terminals; for each display screen in the plurality of display screens, according to the terminal information of the plurality of terminals, controlling the display screen to display the connection management page of the corresponding connection management APP; the connection management page includes the terminal information of the plurality of terminals; in response to the operation of selecting the terminal information of the first terminal on the connection management page of the first display screen, establishing the screen projection relationship between the first terminal and the first display screen, wherein the plurality of display screens include the first display screen.

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and in particular to the fields of artificial intelligence, autonomous driving and intelligent transportation, specifically to a screen projection method, device, equipment and storage medium. Background Technology

[0002] As the in-vehicle environment develops rapidly, user needs in this scenario include screen mirroring, which projects the content of the phone onto the in-vehicle display to enrich the user experience.

[0003] With the rapid development of intelligent vehicles, there are now intelligent vehicles with multiple displays installed on a single vehicle. For example, a display can be installed on the center console for front-seat users, and another display can be installed behind the headrests of the front seats or behind the center armrest of the front seats for rear-seat users. Summary of the Invention

[0004] This disclosure provides a screen projection method, apparatus, device, and storage medium.

[0005] According to a first aspect of this disclosure, a screen projection method is provided, applied to an in-vehicle electronic device deployed in a vehicle; the vehicle includes multiple displays; the in-vehicle electronic device is equipped with multiple connection management apps corresponding one-to-one with the multiple displays; the screen projection method includes: receiving terminal information from multiple terminals; for each of the multiple displays, controlling the display to display a connection management page of the corresponding connection management app based on the terminal information of the multiple terminals; the connection management page includes terminal information of the multiple terminals; in response to a user's operation on the connection management page of the first display for selecting terminal information of the first terminal, establishing a screen projection relationship between the first terminal and the first display, wherein the multiple displays include the first display.

[0006] According to a second aspect of this disclosure, a screen projection device is provided, which is applied to an in-vehicle electronic device deployed in a vehicle; the vehicle includes multiple displays; multiple connection management applications (APPs) corresponding one-to-one with the multiple displays are installed on the in-vehicle electronic device; the screen projection device includes: a receiving unit, a control unit, and a processing unit; the receiving unit is used to receive terminal information from multiple terminals;

[0007] For each of the multiple displays, a control unit is used to control the display to show the connection management page of the corresponding connection management APP based on the terminal information of the multiple terminals; the connection management page includes the terminal information of the multiple terminals; a processing unit is used to respond to the user's operation on the connection management page of the first display to select the terminal information of the first terminal, and establish a projection relationship between the first terminal and the first display, wherein the multiple displays include the first display.

[0008] According to a third aspect of this disclosure, an electronic device is provided, comprising:

[0009] At least one processor; and

[0010] A memory that is communicatively connected to at least one processor; wherein,

[0011] The memory stores instructions that can be executed by at least one processor, such that the at least one processor is able to perform any of the methods in the first aspect.

[0012] According to a fourth aspect of this disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, comprising:

[0013] Computer instructions are used to cause the computer to perform any of the methods in the first aspect.

[0014] According to a fifth aspect of this disclosure, a computer program product is provided, comprising:

[0015] A computer program, any one of the methods of a computer program in the first aspect of being executed by a processor.

[0016] According to a sixth aspect of this disclosure, a vehicle is provided, including the electronic equipment provided in the third aspect.

[0017] The technology disclosed herein solves the problem that common screen projection methods lead to high vehicle manufacturing costs.

[0018] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this disclosure, nor is it intended to limit the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0019] The accompanying drawings are provided to better understand this solution and do not constitute a limitation of this disclosure. Wherein:

[0020] Figure 1 This is a schematic diagram of the structure of a screen projection system provided in an embodiment of this disclosure;

[0021] Figure 2 This is a flowchart illustrating a screen mirroring method provided in an embodiment of this disclosure;

[0022] Figure 3 This is a schematic diagram illustrating the display of a connection management page provided in an embodiment of this disclosure;

[0023] Figure 4 This is a flowchart illustrating another screen mirroring method provided in this embodiment of the disclosure;

[0024] Figure 5 This is a flowchart illustrating another screen mirroring method provided in this embodiment of the disclosure;

[0025] Figure 6 This is a schematic diagram of the structure of a screen projection device provided in an embodiment of this disclosure;

[0026] Figure 7 This is a block diagram of an electronic device for a screen projection method provided in an embodiment of this disclosure. Detailed Implementation

[0027] The exemplary embodiments of this disclosure are described below with reference to the accompanying drawings, including various details of the embodiments to aid understanding, and should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of this disclosure. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description.

[0028] The collection, storage, use, processing, transmission, provision, and disclosure of user personal information involved in the technical solution disclosed herein comply with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0029] As the in-vehicle environment develops rapidly, user needs in this scenario include screen mirroring, which projects the content of the phone onto the in-vehicle display to enrich the user experience.

[0030] With the rapid development of intelligent vehicles, there are now intelligent vehicles with multiple displays installed on a single vehicle. For example, a display can be installed on the center console for front-seat users, and another display can be installed behind the headrests of the front seats or behind the center armrest of the front seats for rear-seat users.

[0031] In this scenario, if users want to project multimedia information from different mobile phones onto different displays, a dedicated vehicle infotainment system and connectivity module (such as a Wi-Fi module or Bluetooth module) needs to be configured for each display, increasing the cost of vehicle manufacturing.

[0032] To address the aforementioned problems, this disclosure provides a screen projection method for displaying multimedia information from different terminals on different display screens. This projection method is applied to in-vehicle electronic devices deployed in vehicles. The vehicle may include multiple display screens, and the in-vehicle electronic device may have multiple connection management applications (APPs) corresponding one-to-one with the multiple display screens installed on it. This projection method can be executed by the vehicle's infotainment system, or by a processor, functional module, chip, or on-chip system within the in-vehicle electronic device; this disclosure does not limit its execution in this regard. For ease of description, the following explanation uses an in-vehicle electronic device as an example.

[0033] In this screen mirroring method, after receiving terminal information from multiple terminals, for each of the multiple displays, the in-vehicle electronic device can control the display to show a connection management page of the corresponding connection management APP based on the terminal information of the multiple terminals. The connection management page can include the terminal information of the multiple terminals. Then, in response to a user's operation on the connection management page of the first display to select the terminal information of the first terminal, a screen mirroring relationship is established between the first terminal and the first display. The multiple displays include the first display.

[0034] As can be seen from the above, for vehicles equipped with multiple displays, the embodiments of this disclosure do not require a dedicated vehicle infotainment system and connection module for each display. Multimedia information from different terminals can be projected onto different displays through a single vehicle infotainment system, thereby reducing vehicle manufacturing costs.

[0035] The screen mirroring method provided in this disclosure can be applied to screen mirroring systems. Figure 1 A schematic diagram illustrating one component of a screen projection system provided in an embodiment of this disclosure is shown. Figure 1 As shown, the projection system may include: an in-vehicle electronic device 102 deployed on vehicle 101, and multiple displays ( Figure 1 (Taking three displays: display 103-1, display 103-2, and display 103-3 as an example) and multiple terminals ( Figure 1 (The following explanation uses three terminals: terminal 104-1, terminal 104-2, and terminal 104-3 as examples.) The vehicle-mounted electronic device 102 is communicatively connected to each of the multiple displays.

[0036] Optionally, the multiple displays of vehicle 101 can be deployed at any location inside vehicle 101.

[0037] For example, such as Figure 1As shown, display screen 103-1 can be deployed on the center console for use by the driver or front passenger. Display screen 103-2 can be deployed behind the headrest of the driver's seat, and display screen 103-3 can be deployed behind the headrest of the front passenger seat. Display screens 103-2 and 103-3 can be used by rear-seat passengers.

[0038] It should be understood that the in-vehicle electronic device 102 typically includes a display screen for interacting with the user. In this case, the display screen of the in-vehicle electronic device 102 can be the same display screen as any one of the multiple display screens, that is, the in-vehicle electronic device 102 can be integrated with any one of the multiple display screens, for example, the in-vehicle electronic device 102 can be integrated with the display screen 103-1 of the center console.

[0039] A vehicle infotainment system is deployed on the in-vehicle electronic device 102. The system contains multiple connection management apps, each corresponding to one of the multiple displays. Each display can show the interface of its corresponding connection management app, such as the connection management page of the connection management app in this embodiment.

[0040] Multiple connectivity management apps can be multiple software packages installed by engineers into the vehicle's infotainment system at the factory. Each software package has the same function, but the package names are different. The in-vehicle electronic device 102 can control the display of different connectivity management apps on different displays.

[0041] Optionally, the above-mentioned vehicle system can be an operating system such as Android, and this embodiment does not impose any restrictions.

[0042] For example, suppose that the multiple connection management apps include a first app, a second app, and a third app. The vehicle electronic device 102 can control: display screen 103-1 to display the app interface of the first app, display screen 103-2 to display the app interface of the second app, and display screen 103-3 to display the app interface of the third app.

[0043] Optionally, the connection management APP can be the Baidu CarLife APP, the Apple CarPlay APP, or other car networking system APPs. This disclosure does not limit the specific APP.

[0044] The vehicle-mounted electronic device 102 has a screen projection function. Executing this screen projection function can enable the multimedia content of the terminal to be projected onto the display screen. For example, by using the screen projection method described in the embodiments of this disclosure, multimedia information from different terminals can be projected onto different display screens.

[0045] For example, such as Figure 1As shown, the in-vehicle electronic device 102 can perform the screen projection function to: project the multimedia information of terminal 104-1 onto display screen 103-1, project the multimedia information of terminal 104-2 onto display screen 103-2, and project the multimedia information of terminal 104-3 onto display screen 103-3.

[0046] It should be noted that the vehicle-mounted electronic device 102 and each terminal include multiple communication modules, such as Bluetooth modules, wireless fidelity (WIFI) modules, etc., to realize information interaction between the vehicle-mounted electronic device 102 and multiple terminals.

[0047] Optionally, the aforementioned terminal may be a device that provides voice and / or data connectivity to the user, a handheld device with wireless connectivity, or other processing device connected to a wireless modem.

[0048] Wireless terminals can be mobile terminals, such as mobile phones (or "cellular" phones) and computers with mobile terminals, or portable, pocket-sized, handheld, computer-embedded, or vehicle-mounted mobile devices that exchange voice and / or data with a wireless access network, such as mobile phones, tablets, laptops, netbooks, and personal digital assistants (PDAs).

[0049] The technical solutions provided by the embodiments of this disclosure will be described in detail below with reference to the accompanying drawings.

[0050] Figure 2 This disclosure illustrates a screen mirroring method provided in an embodiment, which can be applied to... Figure 1 The vehicle-mounted electronic equipment 102. For example... Figure 2 As shown, the screen mirroring method specifically includes:

[0051] S201. The vehicle-mounted electronic equipment receives terminal information from multiple terminals.

[0052] Among them, in-vehicle electronic equipment is Figure 1 The vehicle-mounted electronic equipment 102 in the middle, multiple terminals are Figure 1 For information on the various terminals and related functions of in-vehicle electronic devices, please refer to [the relevant documentation / reference]. Figure 1 The embodiments relating to the in-vehicle electronic device 102 described herein will not be repeated here. Correspondingly, the relevant functions of the various terminals can be found in [reference needed]. Figure 1 The embodiments involving multiple terminals described herein will not be repeated here.

[0053] Specifically, after each terminal establishes a communication connection with the vehicle-mounted electronic device, each terminal and the vehicle-mounted electronic device can be on the same local area network. In this case, each terminal can send its own terminal information to the vehicle-mounted electronic device based on the aforementioned local area network.

[0054] Optionally, terminal information may include the Internet Protocol (IP) address used for interconnecting networks, the terminal's port number, the terminal's model, the terminal's brand, and the terminal's Media Access Control Address (MAC) address.

[0055] S202. For each of the multiple displays, the vehicle electronic equipment controls the display to show the connection management page of the corresponding connection management APP based on the terminal information of the multiple terminals.

[0056] The connection management page includes terminal information for multiple terminals.

[0057] Specifically, after acquiring terminal information from multiple terminals, each display screen can show the connection management page of its corresponding connection management app to facilitate user management of this information via a screen. This connection management page can include terminal information from multiple terminals.

[0058] For example, Figure 3 This diagram illustrates a connection management page displayed on a screen. Figure 3 As shown, the connection management page can include three display areas: a display area 301 for connected terminals, a display area 302 for connectable terminals, and a display area 303 for saved terminals.

[0059] The display area 301 of the connected terminal is used to display terminal information of the terminal that has established a projection relationship with the display screen. Figure 3 Let's take the terminal name as an example to illustrate, for example... Figure 3 Terminal 1 in the middle.

[0060] Optionally, the display area 301 of the connected terminals can also display a disconnection control corresponding to each connected terminal, for example... Figure 3 In the middle, there is a disconnect control 304 corresponding to terminal 1. This disconnect control 304 is used to disconnect the projection relationship between terminal 1 and the display screen in response to a trigger operation performed on the disconnect control 304.

[0061] It should be noted that when the display screen has not established a projection relationship with any terminal, the display area 301 of the connected terminal will not display any terminal information.

[0062] The display area 302 for connectable terminals is used to display terminal information of terminals that can establish a projection relationship with the display screen but have not yet established a projection relationship. Figure 3 Let's take the terminal name as an example to illustrate, for example... Figure 3 Terminal 2 and Terminal 3 in the middle.

[0063] Optionally, when the display screen is the primary display screen (e.g., a display screen deployed on the central control panel), if a terminal has already established a projection relationship with other display screens, the display area 302 of the connected terminal can also display information about the terminal's connection to the associated display screen, for example... Figure 3 In the middle, terminal 3 is connected to the left rear display screen 305.

[0064] In this case, the display area 302 of the connected terminal can also display the terminal's disconnection control, for example... Figure 3 In the middle, the terminal 3 has a disconnect control 306. This disconnect control 306 is used to disconnect the projection relationship between the terminal 3 and other displays in response to a trigger operation performed on the disconnect control 306.

[0065] The display area 303 of the saved terminals is used to display terminal information of terminals that have established a projection relationship with the display screen in the past time period, but have not established a projection relationship at the current time. Figure 3 Let's take the terminal name as an example to illustrate, for example... Figure 3 Terminal 4 in the middle.

[0066] Optionally, the display area 303 of the saved terminal can also display the terminal's delete control, for example... Figure 3 In the middle, the terminal 4 has a delete control 307. The delete control 307 is used to delete the history of the terminal 4 and the display screen that have established a projection relationship in response to a trigger operation performed on the delete control 307.

[0067] S203. The vehicle-mounted electronic device responds to the user's operation on the connection management page of the first display screen to select terminal information of the first terminal, and establishes a projection relationship between the first terminal and the first display screen.

[0068] The plurality of displays include a first display screen; the first terminal is any one of the plurality of terminals; the first display screen is any one of the plurality of displays; the projection relationship between the first terminal and the first display screen is used to indicate that the multimedia information of the first terminal is projected onto the first display screen.

[0069] Optionally, the multimedia information displayed on the screen can be videos played on the terminal, contacts stored on the terminal, or apps installed on the terminal.

[0070] Specifically, since the connection management page of the connection management app displayed on each screen includes terminal information for multiple terminals, different users can select the terminal they want to establish a screen mirroring relationship on different screens. When a user performs an operation to select the terminal information of the first terminal on the connection management page of the first screen, the in-vehicle electronic equipment can respond to the user's operation and establish a screen mirroring relationship between the first terminal and the first screen. In this way, the first screen can project and display the multimedia information of the first terminal.

[0071] based on Figure 2 The screen projection method shown in this embodiment eliminates the need for a dedicated vehicle infotainment system and connection module for each display screen in vehicles equipped with multiple displays. Multimedia information from different terminals can be projected onto different displays using a single vehicle infotainment system, thereby reducing vehicle manufacturing costs.

[0072] Figure 4 This invention illustrates yet another screen mirroring method provided in an embodiment of the present disclosure, which can also be applied to... Figure 1 The vehicle-mounted electronic equipment 102. For example... Figure 4 As shown, the screen mirroring method specifically includes:

[0073] S401. The vehicle electronic device identifies the primary connection management app and the secondary connection management app among multiple connection management apps.

[0074] Specifically, to enable communication between multiple connection management apps, during the vehicle system initialization process, the in-vehicle electronic devices can use the cross-process communication method of the Android system to bind multiple connection management apps together. This allows the multiple connection management apps to exchange terminal information from multiple terminals, and whether the display screen corresponding to each connection management app has established a projection relationship with the terminal, among other information.

[0075] Optionally, the initialization process of the vehicle system can be the initialization process each time the vehicle system is started, or the initialization process when the vehicle leaves the factory. This disclosure does not limit this.

[0076] After controlling the mutual binding of multiple connection management apps, the vehicle electronic device can designate any one of the multiple connection management apps as the primary connection management app, and designate the other connection management apps as secondary connection management apps.

[0077] In this way, when interacting with other modules or devices (such as the vehicle's communication module or terminal), only the primary connection management app needs to interact with other modules or devices among the multiple connection management apps. After obtaining information, the primary connection management app can send the obtained information to the secondary connection management apps, eliminating the need for each connection management app to interact with other modules or devices, thus improving the efficiency of information exchange.

[0078] S402, The vehicle electronic device responds to the broadcast command of the main connection management APP and sends a first broadcast message.

[0079] The first broadcast message includes the identifier of the vehicle's electronic equipment.

[0080] Optionally, the broadcast command may be generated by the primary connection management APP in response to a broadcast operation performed by the user on the display screen corresponding to the primary connection management APP, or it may be automatically generated periodically (for example, after the vehicle electronic device is started, a broadcast command is sent to the vehicle electronic device once every 1 minute). This embodiment of the disclosure does not limit this.

[0081] As can be seen from the above, when it is necessary to send the first broadcast message, only the main connection management APP needs to send a broadcast command to the vehicle electronic device. There is no need for each connection management APP to send a broadcast command to the vehicle electronic device, which reduces data interaction and reduces the data processing pressure on the vehicle electronic device.

[0082] Upon receiving a broadcast command, the vehicle-mounted electronic equipment can respond to the received broadcast command by sending a first broadcast message within the signal coverage area of ​​the vehicle's first communication module.

[0083] Optionally, the first communication module of the vehicle can be the vehicle's Bluetooth module, the first broadcast message can be a Bluetooth Low Energy (BLE) broadcast message, and the vehicle identification can be the device name of the vehicle system's Wi-Fi P2P (Wi-Fi Peer-to-Peer) system. The first communication module can also be other communication modules, such as a Wi-Fi module; this embodiment does not impose specific limitations on it.

[0084] S403. The vehicle-mounted electronic device receives connection requests sent by multiple terminals based on the identifier of the vehicle-mounted electronic device and establishes communication connections with the multiple terminals.

[0085] Specifically, after the vehicle-mounted electronic device sends the first broadcast message, multiple terminals within the signal coverage area of ​​the vehicle's first communication module can receive the first broadcast message through the terminal's first communication module.

[0086] Next, for each of the multiple terminals, a connection command can be initiated to the connection management app installed on the terminal. Upon receiving the connection command, the connection management app on the terminal can display the vehicle identification number of the in-vehicle electronic device on the terminal's screen. The user can then perform a selection operation on the vehicle identification number on the terminal's screen. Correspondingly, in response to the user's selection operation, the terminal can establish a communication connection with the in-vehicle electronic device through the terminal's second communication module, the vehicle identification number, and the vehicle's second communication module.

[0087] After the communication connection between the terminal and the vehicle electronic equipment is successfully established, the terminal and the vehicle electronic equipment will be on the same local area network.

[0088] Optionally, the first communication module of the terminal may be the terminal's Bluetooth module, the second communication module of the terminal may be the terminal's WIFI module, the second communication module of the vehicle may be the vehicle's WIFI module, and the communication connection between the terminal and the vehicle-mounted electronic equipment may be a WIFI P2P communication connection.

[0089] Furthermore, after establishing communication connections with multiple terminals, the in-vehicle electronic equipment receives terminal information from these terminals, specifically including:

[0090] S404. For each of the multiple terminals, the vehicle-mounted electronic device receives a second broadcast message sent by the terminal based on the communication connection.

[0091] The second broadcast message includes the terminal's terminal information.

[0092] Specifically, after each terminal establishes a communication connection with the vehicle-mounted electronic device, each terminal and the vehicle-mounted electronic device can be on the same local area network. In this case, each terminal can send its corresponding second broadcast message based on the communication connection.

[0093] Optionally, the second broadcast message can be a User Datagram Protocol (UDP) broadcast message. Multiple terminals and in-vehicle electronic devices located on the same local area network can agree on a port number. When multiple terminals send multiple UDP broadcast messages, the in-vehicle electronic devices can listen on the agreed port number to receive multiple UDP broadcast messages.

[0094] Since each UDP broadcast message carries terminal information, the vehicle-mounted electronic equipment can extract terminal information from multiple UDP broadcast messages.

[0095] Furthermore, after receiving terminal information from multiple terminals, for each of the multiple displays, the in-vehicle electronic equipment controls the display to show the connection management page of the corresponding connection management APP based on the terminal information from the multiple terminals, specifically including:

[0096] The in-vehicle electronic equipment transmits terminal information from multiple terminals to each of the multiple connection management apps. In this way, each connection management app can display its connection management page on its corresponding display screen, allowing the user to select the appropriate terminal to establish a screen mirroring relationship with that display screen.

[0097] In one possible implementation, the in-vehicle electronic device transmits terminal information from multiple terminals to each of the multiple connection management apps, specifically including:

[0098] S405, the vehicle-mounted electronic equipment transmits terminal information from multiple terminals to the primary connection management APP, and the primary connection management APP transmits terminal information from multiple terminals to the secondary connection management APP.

[0099] It should be understood that the in-vehicle infotainment system deployed on vehicle electronic devices can include a control layer and an application layer. The control layer can be a system layer in the in-vehicle infotainment system other than the application layer. The control layer and the application layer can interact with each other. The application layer can include the aforementioned multiple connection management apps. The control layer is responsible for sending and receiving data and controlling the display of the connection management page by each connection management app in the application layer. Multiple connection management apps can communicate with each other based on the cross-process communication method of the Android system.

[0100] The control layer can obtain terminal information from multiple terminals through the communication modules of the in-vehicle electronic devices and send this information to the application layer. After obtaining the terminal information, the application layer can transmit it to the primary connection management app. Upon receiving the terminal information, the primary connection management app can then transmit it to the secondary connection management app using the cross-process communication method of the Android system.

[0101] As can be seen from the above, when each connection management app needs to obtain terminal information from multiple terminals, this embodiment of the disclosure only requires the primary connection management app to obtain the terminal information from multiple terminals through the control layer. After obtaining the terminal information from multiple terminals, the primary connection management app can send the obtained terminal information from multiple terminals to the secondary connection management app based on the cross-process communication method of the vehicle system. This eliminates the need for each connection management app to obtain the terminal information from multiple terminals through the control layer, reducing the number of data interactions and lowering the data processing pressure on the vehicle electronic equipment.

[0102] S406. The vehicle's electronic equipment receives instruction information from each connection management app.

[0103] The indication information is used to indicate the display of the connection management page.

[0104] Specifically, after obtaining terminal information from multiple terminals, each connection management app in the application layer can send instruction information to the control layer to indicate the display of the connection management page, so that the connection management page of the corresponding connection management app can be displayed on the screen.

[0105] S407: The vehicle electronic equipment controls the display screen corresponding to each connection management APP to display the connection management page according to the instructions of each connection management APP.

[0106] Specifically, after receiving the instruction information from each connection management APP, the control layer can control the display screen to show the connection management page of the corresponding connection management APP, so that the user can select the appropriate terminal to establish a screen mirroring relationship with the display screen.

[0107] S408, the vehicle-mounted electronic device responds to the user's operation on the connection management page of the first display screen to select terminal information of the first terminal, and establishes a projection relationship between the first terminal and the first display screen.

[0108] The plurality of displays includes the first display.

[0109] It should be noted that the specific implementation of step S408 is the same as that of step S203, and will not be described again.

[0110] S409, In ​​the vehicle electronic equipment control of multiple displays, all displays except the first display update to show the connection management page of the corresponding connection management APP.

[0111] The updated connection management page includes: terminal information of other terminals besides the first terminal among multiple terminals, and / or information for indicating the associated display screen of the first terminal.

[0112] Specifically, to notify the user that a projection relationship has been established between the first terminal and the first display screen, the in-vehicle electronic equipment can control other displays to update the terminal connection management page. The updated terminal connection management page may not display the first terminal's information, or it may display information about the first terminal's associated displays. This avoids users performing association operations on a single terminal across multiple displays, improving the overall user experience across multiple displays in the vehicle.

[0113] Optionally, when the vehicle infotainment system deployed on the in-vehicle electronic device includes a control layer and an application layer, the specific implementation method for the in-vehicle electronic device to control other displays to update the connection management page is as follows:

[0114] After the first terminal establishes a screen mirroring relationship with the first display screen, the connection management APP corresponding to the first display screen can send a prompt message to the connection management APP corresponding to other displays screens. This prompt message is used to prompt the first terminal to establish a screen mirroring relationship with the first display screen.

[0115] Upon receiving the notification message, the connection management app corresponding to the display screen can update the displayed connection management page and send an update command to the control layer. Upon receiving the update command, the control layer can then control other displays to update their displayed connection management pages.

[0116] The above mainly describes the solution provided by the embodiments of this disclosure from the perspective of in-vehicle electronic devices. It is understood that, in order to achieve the above functions, the in-vehicle electronic device includes software modules that execute each function, such as a primary connection management APP and a secondary connection management APP. The embodiments of this application will be described below from the perspective of software modules. Figure 5 This illustrates yet another screen mirroring method provided by an embodiment of the present disclosure. Figure 5 This screen mirroring method is illustrated using an example of multiple connection management apps, including a primary connection management app and a secondary connection management app, and multiple terminals, including a first terminal and a second terminal. Specifically, it includes:

[0117] S501. During the initialization of the vehicle system, the primary connection management APP and the secondary connection management APP are bound together.

[0118] S502: The main connection management APP controls the vehicle's Bluetooth module to send BLE broadcast messages.

[0119] Specifically, the primary connection management APP can send broadcast commands to the processing core of the vehicle's control layer. In response to the broadcast commands, the processing core of the control layer controls the vehicle's Bluetooth module to send BLE broadcast messages through the driver core of the vehicle's Bluetooth module.

[0120] S503, the first terminal and the second terminal respond to the received BLE broadcast message and establish a communication connection with the vehicle system.

[0121] S504. The first terminal sends a UDP broadcast message to the main connection management APP.

[0122] The UDP broadcast message from the first terminal includes the terminal information of the first terminal.

[0123] Specifically, the first terminal can send a UDP broadcast message carrying its terminal information to the vehicle's Wi-Fi module via its own Wi-Fi module. Upon receiving the UDP broadcast message, the vehicle's Wi-Fi module can forward it to the control layer's processing core via its driver core. The control layer's processing core can then extract the first terminal's terminal information from the UDP broadcast message and send it to the primary connection management app.

[0124] S505, the second terminal sends a UDP broadcast message to the primary connection management APP.

[0125] The UDP broadcast message from the first terminal includes the terminal information of the first terminal.

[0126] Specifically, the second terminal can send a UDP broadcast message carrying its terminal information to the vehicle's Wi-Fi module via its own Wi-Fi module. Upon receiving the UDP broadcast message, the vehicle's Wi-Fi module can forward it to the control layer's processing core via its driver core. The control layer's processing core can then extract the second terminal's terminal information from the UDP broadcast message and send it to the primary connection management app.

[0127] S506. The primary connection management APP sends the terminal information of the first terminal and the terminal information of the second terminal to the secondary connection management APP.

[0128] S507. The primary connection management APP displays the terminal information of the first terminal and the terminal information of the second terminal on the connection management page of the primary connection management APP.

[0129] S508. The secondary connection management APP displays the terminal information of the first terminal and the terminal information of the second terminal on the connection management page of the secondary connection management APP.

[0130] S509. The primary connection management APP responds to the user's operation on the connection management page of the primary connection management APP to select the terminal information of the first terminal, establishes the projection relationship between the first terminal and the first display screen, and sends a first update message to the secondary connection management APP.

[0131] The first update message instructs the secondary connection management app to update the displayed connection management page. The updated connection management page includes terminal information for terminals other than the first terminal, or information about the associated displays of the first terminal.

[0132] S510, the secondary connection management APP responds to the first update message and updates the displayed connection management page.

[0133] S511, the secondary connection management APP responds to the operation performed on the connection management page of the secondary connection management APP for associating the second terminal and the second display screen, establishes the screen projection relationship between the second terminal and the second display screen, and sends a second update message to the primary connection management APP.

[0134] This second update message instructs the primary connection management app to update the displayed connection management page. The updated connection management page includes terminal information for terminals other than the second terminal, or information about the second terminal's associated display screen.

[0135] It should be noted that those skilled in the art will readily recognize that the screen projection method steps described in conjunction with the embodiments disclosed herein can be implemented in hardware or a combination of hardware and computer software. Whether a function is implemented in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this disclosure.

[0136] This disclosure embodiment can divide the screen projection method into functional modules or functional units according to the above method examples. For example, each function can be divided into a separate functional module or functional unit, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware or in software functional modules or functional units. The division of modules or units in this disclosure embodiment is illustrative and only represents one logical functional division; other division methods may be used in actual implementation.

[0137] like Figure 6 The diagram shown is a structural schematic of a screen projection device provided in an embodiment of this disclosure. This screen projection device is applied to an in-vehicle electronic device deployed in a vehicle; the vehicle includes multiple displays; the in-vehicle electronic device has multiple connection management applications (APPs) installed, each corresponding to one of the multiple displays; the screen projection device includes: a receiving unit 601, a control unit 602, and a processing unit 603;

[0138] The receiving unit 601 is used to receive terminal information from multiple terminals;

[0139] For each of the multiple displays, the control unit 602 is used to control the display to show the connection management page of the corresponding connection management APP based on the terminal information of the multiple terminals; the connection management page includes the terminal information of the multiple terminals;

[0140] The processing unit 603 is configured to establish a projection relationship between the first terminal and the first display screen in response to a user's operation on the connection management page of the first display screen to select terminal information of the first terminal, wherein the plurality of display screens includes the first display screen.

[0141] Optionally, the control unit 602 is also used to control the display screens other than the first display screen to update the display of the corresponding connection management APP's connection management page among the multiple display screens;

[0142] The updated connection management page includes: terminal information of the other terminals among the multiple terminals besides the first terminal, and / or information for indicating the associated display screen of the first terminal.

[0143] Optionally, the projection device may also include: a transmitting unit 604;

[0144] Processing unit 603 is also used to determine the primary connection management app and the secondary connection management app among multiple connection management apps;

[0145] The sending unit 604 is used to send a first broadcast message in response to a broadcast command from the main connection management APP; the first broadcast message includes the identifier of the vehicle electronic device;

[0146] The receiving unit 601 is also used to receive connection requests sent by multiple terminals according to the identifier of the vehicle electronic device, and to establish communication connections with the multiple terminals.

[0147] The receiving unit 601 is specifically used for:

[0148] For each of the multiple terminals, a second broadcast message is received from the terminal based on the communication connection; the second broadcast message includes the terminal information of the terminal.

[0149] Optionally, the control unit 602 is specifically used for:

[0150] Transmit terminal information from multiple terminals to each of the multiple connection management apps;

[0151] Receive instruction information from each connection management app; the instruction information is used to indicate the display of the connection management page.

[0152] Based on the instructions from each connection management app, control the display screen corresponding to the connection management app to show the connection management page.

[0153] Optionally, the control unit 602 is specifically used for:

[0154] Transmit terminal information from multiple terminals to the primary connection management app;

[0155] The primary connection management app transmits terminal information from multiple terminals to the secondary connection management app.

[0156] According to embodiments of this disclosure, this disclosure also provides an electronic device, a readable storage medium, and a computer program product.

[0157] Figure 7 A schematic block diagram of an example electronic device 1100 that can be used to implement embodiments of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0158] like Figure 7 As shown, device 1100 includes a computing unit 1101, which can perform various appropriate actions and processes according to a computer program stored in read-only memory (ROM) 1102 or a computer program loaded from storage unit 1108 into random access memory (RAM) 1103. The RAM 1103 may also store various programs and data required for the operation of device 1100. The computing unit 1101, ROM 1102, and RAM 1103 are interconnected via bus 1104. Input / output (I / O) interface 1105 is also connected to bus 1104.

[0159] Multiple components in device 1100 are connected to I / O interface 1105, including: input unit 1106, such as keyboard, mouse, etc.; output unit 1107, such as various types of monitors, speakers, etc.; storage unit 1108, such as disk, optical disk, etc.; and communication unit 1109, such as network card, modem, wireless transceiver, etc. Communication unit 1109 allows device 1100 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0160] The computing unit 1101 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 1101 include, but are not limited to, a central determination unit (CPU), a graphics determination unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any suitable processor, controller, microcontroller, etc. The computing unit 1101 performs the various methods and processes described above, such as the screen projection method. For example, in some embodiments, the screen projection method may be implemented as a computer software program tangibly contained in a machine-readable medium, such as storage unit 1108. In some embodiments, part or all of the computer program may be loaded and / or installed on device 1100 via ROM 1102 and / or communication unit 1109. When the computer program is loaded into RAM 1103 and executed by the computing unit 1101, one or more steps of the screen projection method described above may be performed. Alternatively, in other embodiments, the computing unit 1101 may be configured to perform the screen projection method by any other suitable means (e.g., by means of firmware).

[0161] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0162] The program code used to implement the methods of this disclosure may be written in any combination of one or more programming languages. This program code may be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus, such that when executed by the processor or controller, the program code causes the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The program code may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0163] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0164] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0165] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as a data server), or computing systems that include middleware components (e.g., an application server), or computing systems that include frontend components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with embodiments of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), and the Internet.

[0166] Computer systems can include clients and servers. Clients and servers are generally located far apart and typically interact via communication networks. Client-server relationships are created by computer programs running on the respective computers and having a client-server relationship with each other. Servers can be cloud servers, servers in distributed systems, or servers incorporating blockchain technology.

[0167] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this disclosure can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution disclosed in this disclosure can be achieved, and this is not limited herein.

[0168] The specific embodiments described above do not constitute a limitation on the scope of protection of this disclosure. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure should be included within the scope of protection of this disclosure.

Claims

1. A screen projection method, applied to an in-vehicle electronic device deployed in a vehicle; the vehicle includes multiple displays; the in-vehicle electronic device is equipped with multiple connection management applications (APPs) corresponding one-to-one with the multiple displays; The screen projection method includes: Identify the primary connection management app among multiple connection management apps; In response to a broadcast command from the primary connection management APP, a first broadcast message is sent within the signal coverage area of ​​the vehicle's first communication module; the first broadcast message includes the identifier of the in-vehicle electronic device. The system receives connection requests from multiple terminals within the signal coverage area of ​​the first communication module, based on the identifier of the vehicle-mounted electronic device, and establishes a communication connection between the vehicle-mounted electronic device and the multiple terminals; the connection requests are sent by the multiple terminals when they receive the first broadcast message. Receive a second broadcast message sent by each of the plurality of terminals based on the communication connection; the second broadcast message includes terminal information of the terminal; The terminal information of the multiple terminals is transmitted to each of the multiple connection management apps; The system receives instruction information from each of the connection management apps, the instruction information being used to instruct the display of a connection management page; the connection management page includes terminal information of the multiple terminals; the connection management page of the primary display screen corresponding to the primary connection management app includes the connection relationship between the terminal and other display screens and disconnection controls; Based on the instructions from each connection management app, control the display screen corresponding to the connection management app to display the connection management page; In response to a user's operation on the connection management page of the first display screen to select terminal information of the first terminal, a projection relationship between the first terminal and the first display screen is established, wherein the plurality of display screens includes the first display screen.

2. The screen projection method according to claim 1 further includes: Control the display screens other than the first display screen to update and display the connection management page of the corresponding connection management APP; The updated connection management page includes: terminal information of the other terminals among the plurality of terminals besides the first terminal, and / or information for indicating the associated display screen of the first terminal.

3. The screen projection method according to claim 2, wherein, The step of transmitting the terminal information of the plurality of terminals to each of the plurality of connection management apps includes: Transmit the terminal information of the multiple terminals to the main connection management APP; The primary connection management APP transmits the terminal information of the multiple terminals to the secondary connection management APP.

4. A screen projection device, applied to an in-vehicle electronic device deployed in a vehicle; the vehicle includes multiple displays; the in-vehicle electronic device is equipped with multiple connection management applications (APPs) corresponding one-to-one with the multiple displays; The projection device includes: a receiving unit, a sending unit, a control unit, and a processing unit; The processing unit is used to determine the primary connection management app among multiple connection management apps; The sending unit is configured to send a first broadcast message within the signal coverage area of ​​the vehicle's first communication module in response to a broadcast command from the primary connection management APP; the first broadcast message includes the identifier of the in-vehicle electronic device; The receiving unit is configured to receive connection requests sent by multiple terminals within the signal coverage area of ​​the first communication module according to the identifier of the vehicle-mounted electronic device, and establish a communication connection between the vehicle-mounted electronic device and the multiple terminals; the connection request is sent by the multiple terminals when they receive the first broadcast message; Receive a second broadcast message sent by each of the plurality of terminals based on the communication connection; the second broadcast message includes terminal information of the terminal; The control unit is configured to: transmit terminal information of the plurality of terminals to each of the plurality of connection management apps; receive instruction information from each connection management app, the instruction information being used to instruct the display of a connection management page; and, according to the instruction information of each connection management app, control the display screen corresponding to the connection management app to display the connection management page; the connection management page includes terminal information of the plurality of terminals; the connection management page of the primary display screen among the plurality of display screens includes the connection relationship between the terminal and other display screens and disconnection controls; The processing unit is configured to respond to a user's operation on the connection management page of the first display screen to select terminal information of the first terminal, and establish a projection relationship between the first terminal and the first display screen, wherein the plurality of display screens includes the first display screen.

5. The projection device according to claim 4, The control unit is also used to control the display screens other than the first display screen to update and display the connection management page of the corresponding connection management APP; in, The updated connection management page includes: terminal information of the other terminals among the plurality of terminals besides the first terminal, and / or information for indicating the associated display screen of the first terminal.

6. The projection device according to claim 5, wherein, The control unit is specifically used for: Transmit the terminal information of the multiple terminals to the main connection management APP; The primary connection management APP transmits the terminal information of the multiple terminals to the secondary connection management APP.

7. An electronic device, comprising: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-3.

8. A non-transitory computer-readable storage medium storing computer instructions, wherein, The computer instructions are used to cause the computer to perform the method according to any one of claims 1-3.

9. A computer program product comprising a computer program that, when executed by a processor, implements the method according to any one of claims 1-3.

10. A vehicle comprising the electronic device as claimed in claim 7.

Images