Multi-screen control method and system, multi-screen controller and vehicle
Through the multi-screen controller, different communication interfaces are used to connect the display screen, independent control and content sharing of multiple display screens are realized, solving the problem of difficulty in sharing and controlling information between display screens in multi-user human-computer interaction scenarios, and improving user experience.
Patent Information
- Application Number
- CN202411688316.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-22
- Publication Date
- 2025-04-08
AI Technical Summary
In multi-user human-computer interaction scenarios, information sharing and independent control between multiple display screens are difficult to achieve, resulting in poor user experience.
The multi-screen controller uses different communication interfaces to connect each display screen to realize independent control of multiple display screens, and uses different content sharing methods to share content between multiple display screens.
The same display and different displays are realized between multiple display screens, improving the user experience and meeting the information needs of different users.
Smart Images

Figure CN119781709A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of computer technology, and more specifically, to a multi-screen control method, system, multi-screen controller and vehicle. Background Art
[0002] In a multi-user human-computer interaction scenario, different users may need the same or different information. For example, in a multi-person vehicle scenario, passengers are seated in different seats, and display screens can be set up in different areas of the vehicle for passengers to use separately. In this scenario, it is crucial to ensure that the interactions of multiple users on the display screen do not affect each other and to enable interaction between multiple screens. Summary of the invention
[0003] In view of this, an embodiment of the present invention provides a multi-screen control method, system, multi-screen controller and vehicle, so that the multi-screen controller is connected to the corresponding display screens through different communication interfaces, so as to realize independent control of multiple display screens through the same multi-screen controller, and further realize the same display and different display and touch of multiple display screens. On this basis, this embodiment can adopt different content sharing methods based on needs to realize content sharing between multiple display screens, thereby improving user experience.
[0004] In a first aspect, an embodiment of the present invention provides a multi-screen control method, wherein multiple display screens are connected to the same multi-screen controller through different communication interfaces, and the method includes:
[0005] receiving a content sharing instruction through a first communication interface of the first display screen, wherein the content sharing instruction is used to share the content in the first display screen to the second display screen, and the content sharing instruction has a corresponding content sharing method;
[0006] Determine the content to be shared and the content sharing method according to the content sharing instruction;
[0007] The second display screen is controlled to display the shared content based on the content sharing method.
[0008] Furthermore, the content sharing method is determined according to the user's selection.
[0009] Furthermore, each application program run by the multi-screen controller has a corresponding content sharing method.
[0010] Further, controlling the second display screen to display the shared content based on the content sharing method includes:
[0011] In response to the content sharing mode being the first mode, controlling the second display screen to run a corresponding application to display the shared content;
[0012] In response to the content sharing mode being the second mode, the second display screen is controlled to follow the first display screen in displaying the shared content.
[0013] Furthermore, the second display screen displays the initial progress of the shared content synchronously with the first display screen.
[0014] Further, in response to the content sharing mode being the first mode, controlling the second display screen to run a corresponding application to display the shared content includes:
[0015] In response to the content sharing mode being the first mode, generating first sharing information, the first sharing information including an application corresponding to the shared content and a display progress;
[0016] determining a first display signal according to the first sharing information;
[0017] The first display signal is sent to the second display screen through the second communication interface of the second display screen, so that the second display screen displays the running of the application and displays the shared content according to the display progress.
[0018] Further, in response to the content sharing mode being the second mode, controlling the second display screen to follow the first display screen in displaying the shared content includes:
[0019] In response to the content sharing mode being the second mode, generating second sharing information, the second sharing information including the shared content and display progress;
[0020] determining a second display signal according to the second sharing information;
[0021] The second display signal is sent to the second display screen through the second communication interface of the second display screen, so that the second display screen displays the shared content according to the display progress.
[0022] In a second aspect, an embodiment of the present invention provides a multi-screen controller, the multi-screen controller comprising:
[0023] Multiple communication interfaces, each of which is used to connect to a different display screen;
[0024] The processing unit is configured to execute the multi-screen control method as described above.
[0025] In a third aspect, an embodiment of the present invention provides a multi-screen control system, the multi-screen control system comprising:
[0026] Multiple displays;
[0027] Multi-screen controller;
[0028] Wherein, the multi-screen controller includes multiple communication interfaces and a processing unit, each of the communication interfaces is used to connect to a different display screen, and the processing unit is configured to execute the multi-screen control method as described above.
[0029] Furthermore, the display screen includes a first display screen, and the first display screen is used to receive a content sharing instruction from a user, and send the content sharing instruction to the multi-screen controller through a first communication interface corresponding to the first display screen.
[0030] Furthermore, the first display screen displays a content sharing control, and the first display screen is used to display at least one screen selection control and a method selection control in response to the content sharing control being triggered, and to generate the content sharing instruction based on the screen selection control and the method selection control triggered by the user.
[0031] In a fourth aspect, an embodiment of the present invention provides a vehicle, the vehicle comprising:
[0032] Multi-screen controller;
[0033] Multiple display screens distributed in different areas of the vehicle interior;
[0034] Wherein, the multi-screen controller includes multiple communication interfaces and a processing unit, each of the communication interfaces is used to connect to a different display screen, and the processing unit is configured to execute the multi-screen control method as described above.
[0035] Furthermore, the display screen is arranged on the seat back and / or the hollow area of the front row.
[0036] In a fifth aspect, an embodiment of the present invention provides a multi-screen control device, wherein multiple display screens are connected to the same multi-screen controller via different communication interfaces, and the multi-screen control device comprises:
[0037] An instruction receiving unit is configured to receive a content sharing instruction through a first communication interface of a first display screen, wherein the content sharing instruction is used to share the content in the first display screen to a second display screen;
[0038] an information determination unit, configured to determine the content to be shared and the content sharing method according to the content sharing instruction;
[0039] The control unit is configured to control the second display screen to display the shared content based on the content sharing method.
[0040] In a sixth aspect, an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method described above is implemented.
[0041] In a seventh aspect, an embodiment of the present invention provides a computer program product, which, when executed on a computer, enables the computer to execute the method described above.
[0042] The multiple display screens of the embodiment of the present invention are connected to the same multi-screen controller through different communication interfaces. The embodiment of the present invention receives a content sharing instruction through the first communication interface of the first display screen, determines the shared content and the content sharing method according to the content sharing instruction, and controls the second display screen to display the shared content based on the content sharing method. Therefore, the multi-screen controller of the embodiment of the present invention is respectively connected to the corresponding display screens through different communication interfaces, and the independent control of multiple display screens can be achieved through the same multi-screen controller, thereby achieving the same display and different display and touch of multiple display screens. On this basis, this embodiment can adopt different content sharing methods based on demand to achieve content sharing between multiple display screens, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0043] The above and other objects, features and advantages of the present invention will become more apparent through the following description of the embodiments of the present invention with reference to the accompanying drawings, in which:
[0044] Figure 1 is a schematic diagram of a multi-screen control system according to an embodiment of the present invention;
[0045] Figure 2 is a flow chart of a multi-screen control method according to an embodiment of the present invention;
[0046] Figure 3 is a schematic diagram of the operation of a first display screen according to an embodiment of the present invention;
[0047] Figure 4 is another schematic diagram of the operation of the first display screen according to an embodiment of the present invention;
[0048] Figure 5 is a flow chart of a content sharing process according to an embodiment of the present invention;
[0049] Figure 6 is a schematic diagram of a content sharing process according to an embodiment of the present invention;
[0050] Figure 7 is a flow chart of another content sharing process according to an embodiment of the present invention;
[0051] Figure 8 is a schematic diagram of another content sharing process according to an embodiment of the present invention;
[0052] Fig. 9 is a schematic diagram of the operation of the second display screen according to an embodiment of the present invention;
[0053] Fig.10is a schematic diagram of a vehicle according to an embodiment of the present invention;
[0054] Fig.11 is a schematic diagram of a multi-screen control device according to an embodiment of the present invention;
[0055] Fig.12 is a schematic diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION
[0056] The present application is described below based on embodiments, but the present application is not limited to these embodiments. In the detailed description of the present application below, some specific details are described in detail. It is possible for those skilled in the art to fully understand the present application without the description of these details. In order to avoid confusing the essence of the present application, known methods, processes, flows, components and circuits are not described in detail.
[0057] In addition, persons of ordinary skill in the art will appreciate that the drawings provided herein are for illustration purposes and are not necessarily drawn to scale.
[0058] Unless the context clearly requires otherwise, the words "include", "comprising" and similar words throughout the application should be interpreted as including rather than exclusive or exhaustive; that is, the meaning is "including but not limited to".
[0059] In the description of this application, it should be understood that the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In addition, in the description of this application, unless otherwise specified, the meaning of "plurality" is two or more.
[0060] The solutions described in this specification and in the examples, if they involve the processing of personal information, will be processed on the premise of having a legal basis (such as obtaining the consent of the subject of personal information, or being necessary for the performance of a contract, etc.), and will only be processed within the scope of regulations or agreements. If a user refuses to process personal information other than the necessary information for basic functions, it will not affect the user's use of basic functions.
[0061] The embodiment of the present invention is described in detail by taking a vehicle that can accommodate multiple people and is provided with multiple display screens as an example. It should be understood that the embodiment of the present invention is not limited to this, and any scenario in which multiple users and multiple display screens realize independent interaction can be realized by applying the embodiment of the present invention.
[0062] In the relevant vehicle cockpit design, a separate controller is usually used to realize the scene of multiple screens in the cabin. For example, multiple tablets are installed in the cockpit, and each tablet is only connected to the vehicle by power supply. In fact, they all work separately, so that the effect of different display and touch of multiple screens is naturally formed. There is also a situation where multiple controllers are deployed in the cockpit, such as installing a controller in the front row to connect the front row screen, and installing a controller in the back row to connect the back row screen, which can also realize different display and touch of multiple screens. However, the separate controller solution is based on the independent operation of multiple controllers, and it is difficult to realize content sharing between different screens well, and multiple controllers coexist, which is more complicated in network topology, and the software development cost, layout cost and procurement cost are also higher. Therefore, the embodiment of the present invention provides a multi-screen control method, system, multi-screen controller and vehicle, so that the multi-screen controller is connected to the corresponding display screen through different communication interfaces respectively, so as to realize the independent control of multiple display screens through the same multi-screen controller, and then realize the same display and different display and touch of multiple display screens. On this basis, this embodiment can realize content sharing between multiple display screens based on demand by using different content sharing methods, thereby improving the user experience.
[0063] Figure 1 Schematic diagram of a multi-screen control system according to an embodiment of the present invention. Figure 1 As shown, the multi-screen control system of the embodiment of the present invention includes N display screens 11-1N and a multi-screen controller 10. The multi-screen controller 10 includes N communication interfaces 21-21N and a processing unit 20. The N communication interfaces 21-21N of the multi-screen controller 10 are respectively connected to the N display screens 11-1N, so that the N display screens communicate with the multi-screen controller 10 through independent data communication links. For example, the multi-screen controller 10 is connected to the display screen 11 through the communication interface 21, to the display screen 1i through the communication interface 2i, and to the display screen 1N through the communication interface 2N. Wherein, N≥1, 1≤i≤N. It should be understood that the multi-screen controller 10 of this embodiment may also include other communication interfaces (not shown in the figure) to connect other input and output devices, such as speakers, etc. This embodiment does not limit the number and type of communication interfaces of the multi-screen controller, which can be set according to the functions to be implemented in the specific application scenario.
[0064] In an optional implementation, the display screen 11-1N is connected to the communication interface 21-2N of the multi-screen controller 10 through different display interfaces 31-3N. The interface type of the display interface 31-3N is compatible with the interface type of the communication interface 21-2N. Optionally, the interface types of the display interfaces 31-3N can be the same or different.
[0065] Further optionally, in a vehicle or other application scenario, there may be no user in the area where the display screen 1i is located, for example, there are no passengers in the back row of the vehicle, etc. If the display screen 1i in the corresponding area still works synchronously in this case, useless power consumption will be increased, and the service life of the corresponding display screen 1i will also be consumed. Based on this, in this embodiment, the connection between the display interface and the communication interface corresponding to some display screens can be set to have hot-swappable characteristics, that is, the display interface and the communication interface corresponding to the part of the display screen are both interfaces with hot-swappable characteristics.
[0066] Therefore, this embodiment can first detect whether there is a user in the corresponding area of the display screen, and if not, control to disconnect the connection between the display screen and the multi-screen controller 10, and determine which display screens are in a disconnected state through hot plug detection when the same display content needs to be pushed to multiple display screens, so that the multi-screen controller 10 pushes the display content to be displayed to the display screen in a connected state for display. This allows the embodiment of the present invention to flexibly control the connection state of the display screen and reduce the overall power consumption of the system.
[0067] Furthermore, taking a vehicle as an example, if the front hollow area and the rear seat area of the vehicle are both provided with display screens, since the front row of the vehicle usually carries passengers or safety officers, the display screen in the front hollow area can remain connected, and the display screen in the rear seat area uses a hot-swappable display interface.
[0068] It should be understood that this embodiment does not limit the connection characteristics of the above-mentioned display interface 31-3N and communication interface 21-2N. They can all be set to maintain connection or have hot-plug characteristics, or partially set to maintain connection and partially set to have hot-plug characteristics. The specific settings can be determined according to the actual application scenario.
[0069] In an optional implementation, the display interfaces 31-3N may use DSI (Display Serial Interface) interfaces and / or DP (Display Port) interfaces. It should be understood that the embodiment of the present invention does not limit the specific type of display interface, as long as it can realize the transmission of display content.
[0070] Furthermore, the multi-screen control system of this embodiment also includes N serializers and deserializers (not shown in the figure). Among them, the serializer and deserializer are respectively connected between the corresponding display screen and the communication interface. The serializer in the serializer and deserializer is used to merge multiple parallel data into a serial data stream to reduce the number of cables required for transmission and the cost of communication media and improve data transmission efficiency. The deserializer in the serializer and deserializer is the inverse operation of the serializer, which is used to split the data frame into multiple data streams for subsequent data processing and storage.
[0071] Furthermore, the display screen is connected to the corresponding serializer and deserializer through a predetermined communication interface, and the serializer and deserializer are connected to the communication interface through the corresponding display interface. Thus, the display screen 1i forms a data communication link dedicated to the display screen 1i through the predetermined communication interface, the serializer and deserializer, the display interface and the communication interface, and independent data transmission between the display screen 1i and the multi-screen controller 10 can be achieved through the data communication link. Optionally, the predetermined communication interface corresponding to the display screen 1i can be a GMSL (Gigabit Multimedia Serial Link) interface to achieve high-quality video signals, audio signals and control information transmission. It should be understood that this embodiment does not limit the type of communication interface used by the display screen, and it can achieve the transmission of relevant information.
[0072] In this embodiment, the processing unit 20 in the multi-screen controller 10 is used to control the transmission of corresponding display information to the corresponding display screen 1i through the communication interface 2i, or to receive data operation requests such as content sharing requests from the display screen 1i through the communication interface 2i, and to share the display content of the display screen 1i to other corresponding display screens based on the content sharing request, thereby realizing content sharing between multiple display screens under the same controller.
[0073] Figure 2 FIG. 1 is a flow chart of a multi-screen control method according to an embodiment of the present invention. Figure 2 As shown, the multi-screen control method of the multi-screen controller of the embodiment of the present invention includes the following steps:
[0074] Step S110: receiving a content sharing instruction through the first communication interface of the first display screen. The content sharing instruction is used to share the content in the first display screen to the second display screen, and the content sharing instruction has a corresponding content sharing method.
[0075] In this embodiment, the content to be shared can be any multimedia content, such as video, audio, picture, etc. Optionally, the first display screen can be a display screen corresponding to the passenger position or a display screen corresponding to the driver position, and similarly, the second display screen can also be a display screen corresponding to the passenger position or a display screen corresponding to the driver position.
[0076] Furthermore, the first display screen receives a content sharing instruction from a user (eg, a passenger or a driver), and sends the content sharing instruction to the multi-screen controller via a first communication interface corresponding to the first display screen.
[0077] Furthermore, the content sharing instruction of this embodiment has a corresponding content sharing method. Optionally, the content sharing method can be determined according to the user's selection.
[0078] Figure 3FIG. 1 is a schematic diagram of the operation of a first display screen according to an embodiment of the present invention. Figure 3 As shown, taking the first display screen as display screen 11 as an example, when a user uses display screen 11 to watch a certain content, display screen 11 can display content sharing control 31. In response to the content sharing control 31 being triggered, display screen 11 displays at least one screen selection control 32 and mode selection control 33, and generates a content sharing instruction based on the screen selection control 32 and mode selection control 33 triggered by the user. Figure 3 As shown, if the user selects the screen selection control corresponding to the display screen 12 and the mode selection control corresponding to the first mode, a content sharing instruction is generated to share the corresponding content to the display screen 12 in the first mode.
[0079] Further optionally, the screen selection control 32 corresponding to each display screen can also display screen position prompt information around it, so that the user can easily identify the object he wants to share. For example, the position of the display screen 12 in the car (such as the left side of the back row, etc.) is displayed around the screen selection control 32 of the display screen 12. Furthermore, method prompt information can also be displayed around each mode selection control 33 to prompt the characteristics of various content sharing methods, so that the user can choose the corresponding content sharing method according to their needs. For example, the method prompt information of the first method can prompt the user to select this method for sharing, and the shared user can independently control the progress of content playback, etc.
[0080] Further optionally, when the user triggers the screen selection control 32, the display screen 11 can also display the display screen position corresponding to the screen selection control 32 triggered by it, or control the corresponding speaker through the multi-screen controller to broadcast the position of the selected display screen, so that the user can easily identify the object to be shared. Further, when the user triggers the mode selection control 33, the display screen 11 can also display the characteristics of the content sharing mode corresponding to the mode selection control 33 triggered by it, or control the corresponding speaker through the multi-screen controller to broadcast the characteristics of the selected content sharing mode, so that the user can select the corresponding content sharing mode according to his needs.
[0081] It should be understood that Figure 3 The display screen selection and content sharing mode selection methods shown in are only exemplary. In this embodiment, the user's selection can also be realized through voice interaction, which will not be described in detail here.
[0082] In another optional implementation, each application running on the multi-screen controller is pre-set with a corresponding content sharing method to avoid overly complicated operations when the user is sharing content, further improving the user experience. For example, application X is pre-set to share content in the first method, and application Y is pre-set to share content in the second method. Further optionally, the content sharing method pre-set for different applications can be determined based on the frequency of sharing method selection of each application in historical sharing operations, or can be determined based on the characteristics of the application, or can be determined based on the survey of user needs. This embodiment does not limit how each application determines the corresponding content sharing method.
[0083] Figure 4 FIG. 1 is another operation schematic diagram of the first display screen according to an embodiment of the present invention. Figure 4 As shown, taking the first display screen as display screen 11 as an example, when a user uses display screen 11 to run application X to watch a certain content, display screen 11 can display content sharing control 41. In response to the content sharing control 41 being triggered, display screen 11 displays at least one screen selection control 42, and generates a content sharing instruction based on the screen selection control 42 triggered by the user. Among them, the content sharing mode corresponding to application X is the first mode. Figure 3 As shown, if the user selects the screen selection control corresponding to the display screen 12, a content sharing instruction is generated to share the corresponding content with the display screen 12 in a first manner.
[0084] Further optionally, the screen selection control 42 corresponding to each display screen may also display display position prompt information around it, so that the user can easily identify the object to be shared. For example, the position of the display screen 12 in the car (such as the left side of the back row, etc.) is displayed around the screen selection control 42 of the display screen 12. In other optional implementations, when the user triggers the screen selection control 42, the display screen 11 may also display the display screen position corresponding to the screen selection control 42 that it triggers, or control the corresponding speaker through the multi-screen controller to broadcast the position of the selected display screen, so that the user can easily identify the object to be shared.
[0085] Furthermore, in this embodiment, after the user triggers the corresponding screen selection control 42, the content sharing method corresponding to the application X and the characteristics of the content sharing method can be displayed. In other optional implementations, the content sharing method corresponding to the application X and the characteristics of the content sharing method can also be broadcasted by controlling the corresponding speaker.
[0086] Furthermore, this embodiment can also provide a mode change control in the content sharing mode prompt information of application X, so that the user can choose whether to change the content sharing mode according to their own needs, so as to avoid the situation where the pre-set content sharing mode does not meet the user's needs, further improving the user experience.
[0087] It should be understood that Figure 4 The display screen selection and content sharing mode selection methods shown in are merely exemplary. This embodiment may also implement user selection through voice interaction, which will not be described in detail here.
[0088] Furthermore, this embodiment does not limit how to select the content sharing method. It can also allow some applications to pre-set corresponding content sharing methods, and some applications to provide users with selection controls to select sharing methods. Examples will not be given one by one here.
[0089] Step S120: determining the content to be shared and the content sharing method according to the content sharing instruction.
[0090] After receiving the content sharing instruction sent by the first display screen through the first communication interface, the multi-screen controller parses the content sharing instruction to determine the shared content and the content sharing method. Optionally, the content sharing method can be carried in the content sharing instruction, or it can be determined by the multi-screen controller based on the application corresponding to the shared content.
[0091] Step S130: Control the second display screen to display the shared content based on the content sharing method.
[0092] In this embodiment, in response to the content sharing mode being the first mode, the multi-screen controller controls the second display screen to run the corresponding application to display the shared content, and in response to the content sharing mode being the second mode, controls the second display screen to follow the first display screen to display the shared content.
[0093] Furthermore, the second display screen displays the initial progress of the corresponding shared content in synchronization with the first display screen. Assuming that the first display screen is currently used to play a certain video and receives a content sharing instruction from the user at 2 minutes into the video, the multi-screen controller controls the second display screen to start playing the video from 2 minutes into the video after receiving the content sharing instruction. In other optional implementations, the multi-screen controller of this embodiment can also cause the second display screen to start displaying from the beginning of the shared content, and this embodiment does not limit this.
[0094] Figure 5 is a flow chart of a content sharing process according to an embodiment of the present invention. Figure 5 As shown, the process of sharing content in the first manner in this embodiment includes the following steps:
[0095] Step S210, in response to the content sharing mode being the first mode, generating first sharing information. The first sharing information includes the application corresponding to the shared content and the display progress. It should be understood that if the shared content is video or audio content, the display progress may be the playback progress, and if the shared content is text content or a collection of pictures, the display progress may be the text progress (e.g., page number) or the picture progress (e.g., the number of pictures).
[0096] Step S220, determining a first display signal according to the first sharing information. In this embodiment, the first display signal includes a display instruction and display data. The display data is determined according to the display progress of the above-mentioned shared content. For example, if the shared content is a video, the display data can be the video data within a predetermined time after the corresponding playback progress of the video starts.
[0097] Step S230, sending the first display signal to the second display screen through the second communication interface of the second display screen, so that the second display screen displays the running application and displays the corresponding shared content according to the display progress. Specifically, after receiving the first display signal, the second display screen opens the corresponding application and opens the content in the application that is the same as the shared content, and displays the shared display data according to the display progress.
[0098] Further optionally, since the second display screen is also in a state of running the corresponding application when sharing in the first manner, the second display screen can receive the user's operation request to pause the currently shared display content, adjust the display progress, and other operations. Specifically, the second display screen receives the user's progress adjustment instruction, and sends the progress adjustment instruction to the multi-screen controller through the second communication interface. The multi-screen controller obtains the required display data (that is, the display data within a predetermined time from the display progress) according to the display progress corresponding to the progress adjustment instruction, and returns it to the second display screen through the second communication interface, so that the second display screen displays the corresponding display data based on the display progress corresponding to the progress adjustment instruction.
[0099] Figure 6 FIG. 1 is a schematic diagram of a content sharing process according to an embodiment of the present invention. Figure 6As shown, the display screen 11 is currently using application X to play video A, and the playing progress is t0. The first user triggers the content sharing control 61 displayed in the display screen 11, and chooses to share the video A with the display screen 12 in the first way, generates a corresponding content sharing instruction, and sends it to the multi-screen controller 10 through the corresponding communication interface 21. The multi-screen controller 10 parses the received content sharing instruction, determines that the content sharing method is the first method, and the shared display screen is the display screen 12, the shared content is video A, and the playing progress is t0. The multi-screen controller 10 obtains the to-be-played data d1 based on the video A and the playing progress t0 obtained by parsing, and generates a first display signal including the display instruction and the to-be-played data d1, and sends it to the display screen 12 through the communication interface 22. After receiving the first display signal, the display screen 12 displays and runs the corresponding application X and opens the video A to play the obtained to-be-played data d1, that is, the video A is played according to the playing progress t0.
[0100] Furthermore, if Figure 6 As shown, the display screen 12 receives the user dragging the progress bar from the playback progress t0 to the playback progress t1, that is, receives the progress adjustment instruction, and sends the progress adjustment instruction to the multi-screen controller 10 through the communication interface 22. The multi-screen controller 10 obtains the data d2 to be played based on the video A and the playback progress t1, and returns the data d2 to be played to the display screen 12 through the communication interface 22. The display screen 12 receives and plays the data d2 to be played, that is, continues to play the video A according to the playback progress t1.
[0101] Therefore, the embodiment of the present invention is connected to different display screens through different communication interfaces, thereby realizing the functions of multi-screen same display and different display. On this basis, the embodiment of the present invention can realize multiple application openings so that when content is shared on different display screens, the shared second display screen can display the same content as the first display screen by running the corresponding application program, and can independently control the display progress and playback pause and other functions of the displayed content, so that users of different display screens can share content and perform independent operations, thereby improving the user experience.
[0102] Figure 7 is a flowchart of another content sharing process according to an embodiment of the present invention. Figure 7 As shown, the process of sharing content in the second manner in this embodiment includes the following steps:
[0103] Step S310, in response to the content sharing mode being the second mode, generating second sharing information. The second sharing information includes the shared content and the display progress. It should be understood that if the shared content is video or audio content, the display progress may be the playback progress, and if the shared content is text content or a collection of pictures, the display progress may be the text progress (e.g., page number) or the picture progress (e.g., the number of pictures).
[0104] Step S320, determining a second display signal according to the second sharing information. In this embodiment, the second display signal includes a display instruction and display data. The display data is determined according to the display progress of the above-mentioned shared content. For example, if the shared content is a video, the display data can be the video data within a predetermined time after the corresponding playback progress of the video starts.
[0105] Step S330, sending the second display signal to the second display screen through the second communication interface of the second display screen, so that the second display screen displays the corresponding shared content according to the display progress. Specifically, after receiving the first display signal, the second display screen displays the same content as the shared content and displays the shared display data according to the display progress.
[0106] Furthermore, since the second display screen does not need to run the application running on the first display screen when sharing in the second method, the second display screen can only share the current display content of the first display screen and cannot independently control operations such as the display progress of the content. However, the user can control the second display screen to close the shared content when he is not interested in the shared content.
[0107] Figure 8 FIG. 1 is a schematic diagram of another content sharing process according to an embodiment of the present invention. Figure 8 As shown, the display screen 11 is currently using application Y to play video B, and the playback progress is t0'. The first user triggers the content sharing control 81 displayed in the display screen 11, and chooses to share the video B with the display screen 12 in the second mode, generates a corresponding content sharing instruction, and sends it to the multi-screen controller 10 through the corresponding communication interface 21. The multi-screen controller 10 parses the received content sharing instruction, determines that the content sharing method is the second method, and the shared display screen is the display screen 12, the shared content is video B, and the playback progress is t0'. The multi-screen controller 10 obtains the data d3 to be played based on the video B and the playback progress t0' obtained by parsing, and generates a second display signal including the display instruction and the data d3 to be played, and sends it to the display screen 12 through the communication interface 22. After receiving the second display signal, the display screen 12 plays the obtained data d3 to be played, that is, plays the video B according to the playback progress t0'.
[0108] Furthermore, if Figure 6As shown, when sharing in the second way, the second display screen does not need to run the application running on the first display screen. Although the second display screen can display the playback progress bar of video B, it cannot be dragged to change the video playback progress, that is, the second display screen can only follow the first display screen for display.
[0109] Furthermore, when sharing in the second manner, if the first display screen receives a progress adjustment instruction, the progress adjustment instruction is sent to the multi-screen controller through the corresponding first communication interface. The multi-screen controller obtains corresponding display data based on the display progress corresponding to the progress adjustment instruction, and sends the display data to the first display screen through the first communication interface, and sends it to the second display screen through the second communication interface, so that the first display screen and the second display screen synchronously display the same content.
[0110] Therefore, the embodiment of the present invention is connected to different display screens through different communication interfaces, thereby realizing the functions of multi-screen same display and different display. On this basis, the embodiment of the present invention can realize information sharing of different display screens.
[0111] In an optional implementation, after receiving the shared content, the second display screen may provide sharing prompt information to the user of the second display screen, wherein the sharing prompt information may include information such as the source display screen of the shared content, the display screen location, the content sharing method, and / or the shared content name.
[0112] Furthermore, the sharing prompt information may also include viewing controls and rejection controls, so that the user corresponding to the second display screen can choose whether to accept the shared content based on his or her own needs, further improving the user experience.
[0113] Fig. 9 FIG. 1 is a schematic diagram of the operation of the second display screen according to an embodiment of the present invention. Fig. 9 As shown, when the second display screen 12 receives a display signal (such as the first display signal or the second display signal mentioned above) sent by the multi-screen controller, a pop-up window 91 is displayed on the second display screen 12 to display sharing prompt information. The sharing prompt information includes text prompt content, viewing controls 911, and rejection controls 912. Taking the multi-screen control system in a vehicle as an example, the text prompt content may be "sharing of video A from the display screen 11 located on the left rear seat". It should be understood that this embodiment does not limit the specific information of the text prompt content, and it can be set according to specific needs.
[0114] Furthermore, in response to the viewing control 911 being triggered, the second display screen 12 displays the corresponding shared content according to the display signal.
[0115] Therefore, this embodiment can prompt the user of the shared display screen through sharing prompt information, so that the second display screen user can choose whether to accept the shared content based on his own needs, further improving the user experience.
[0116] Furthermore, the sharing prompt information may also include a waiting control so that the user can view the shared content later. For example, when the user of the second display screen does not want to be interrupted while viewing the information currently being viewed and is interested in the shared content, the user may choose to trigger the waiting control to open the shared content when he or she has time. Furthermore, in this embodiment, the waiting control may be set with a predetermined waiting time, and when the waiting time is reached, if the shared content is not viewed in time, it is controlled to disappear. Optionally, the waiting time may also be customized when the user triggers the waiting control. This embodiment is not limited to this.
[0117] Further optionally, if the first display screen adopts the first method to share content, even if the first display screen turns off the shared content, the user of the second display screen can still view the shared content based on the received display signal. If the first display screen adopts the second method to share content, and the first display screen turns off the shared content, the shared content received by the second display screen is controlled to disappear. In other optional implementations, no matter which method the first display screen adopts to share content, if the first display screen turns off the shared content before the second display screen views the shared content, the shared content received by the second display screen is controlled to disappear.
[0118] In this embodiment, since the multi-screen controller is connected to the corresponding display screens through different communication interfaces, the multi-screen controller can receive data operation requests from different display screens based on different communication interfaces, and perform corresponding data operations based on the data operation requests, such as volume adjustment, screen brightness adjustment, etc., to achieve independent control of different display screens.
[0119] Furthermore, the multi-screen controller can send target display content to the corresponding multiple display screens through different communication interfaces so that each display screen synchronously displays the target display content. For example, in a vehicle, when no passenger operates the display screen, the multi-screen controller can simultaneously control multiple display screens in the vehicle to play safety guidance videos at the same time, or when encountering a special road section during driving, when all passengers need to know or pay attention to the relevant information, the multi-screen controller can send relevant information to the display screens in different areas so that the display screens in different areas synchronously display the relevant information, etc.
[0120] Further optionally, in a vehicle application scenario, the multi-screen controller can be implemented by a cockpit domain controller. It should be understood that the multi-screen controller can also be implemented by other domain controllers or a newly added independent controller, and this embodiment does not limit this.
[0121] The multiple display screens in the multi-screen control system of the embodiment of the present invention are connected to the same multi-screen controller through different communication interfaces, and a content sharing instruction is received through the first communication interface of the first display screen, and the shared content and content sharing method are determined according to the content sharing instruction, and the second display screen is controlled to display the shared content based on the content sharing method. Therefore, the multi-screen controller of the embodiment of the present invention is respectively connected to the corresponding display screens through different communication interfaces, and the independent control of multiple display screens can be achieved through the same multi-screen controller, thereby realizing the same display and different display and touch of multiple display screens. On this basis, this embodiment can adopt different content sharing methods based on demand to realize content sharing between multiple display screens, thereby improving the user experience.
[0122] Fig.10 Schematic diagram of a vehicle according to an embodiment of the present invention. Fig.10 As shown, the vehicle 100 includes a multi-screen controller (not shown) and multiple display screens 11-13 distributed in different areas inside the vehicle. The multi-screen controller includes multiple communication interfaces and a processing unit, each communication interface is used to connect to a different display screen 11-13, and the processing unit is configured to execute the multi-screen control method of any of the above implementations, which will not be repeated here.
[0123] In an optional implementation, the display screen is arranged in the hollow area of the seat back and / or the front row. Fig.10 As shown, the display screen 11 is arranged in the hollow area of the front row, the display screen 12 is arranged in the back of the front row seat in the left area of the rear row, and the display screen 13 is arranged in the back of the front row seat in the right area of the rear row. Thus, passengers in each seat can interact with the corresponding display screen.
[0124] In an optional implementation, the vehicle further includes speakers located around the seats (not shown in the figure). In this embodiment, each passenger may play different audio and video. For example, a passenger can hear the sound corresponding to his or her own display screen more clearly without being disturbed by the sound of other display screens. In this embodiment, corresponding speakers are set in each seat area to further improve the user experience. Furthermore, the displays and speakers in the corresponding seat areas correspond to each other, so that when playing a video, the audio heard by the passenger is synchronized with the video being played.
[0125] In an optional implementation, the multi-screen controller of the vehicle 100 can be implemented by a cockpit domain controller to execute the multi-screen control method of any of the above implementations. It should be understood that the multi-screen controller can also be implemented by other domain controllers or a newly added independent controller, and this embodiment is not limited to this.
[0126] The multiple display screens in the multi-screen control system in the vehicle of the embodiment of the present invention are connected to the same multi-screen controller through different communication interfaces, and the content sharing instruction is received through the first communication interface of the first display screen, and the shared content and content sharing method are determined according to the content sharing instruction, and the second display screen is controlled to display the shared content based on the content sharing method. Therefore, the multi-screen controller of the embodiment of the present invention is respectively connected to the corresponding display screens through different communication interfaces, and the independent control of multiple display screens can be realized through the same multi-screen controller, thereby realizing the same display and different display and different touch of multiple display screens. On this basis, this embodiment can adopt different content sharing methods based on needs to realize content sharing between multiple display screens, thereby improving the user experience.
[0127] Fig.11 Schematic diagram of a multi-screen control device according to an embodiment of the present invention. Fig.11 As shown, the multi-screen control device 200 of the embodiment of the present invention is deployed in the multi-screen controller, and multiple display screens are connected to the same multi-screen controller through different communication interfaces. The multi-screen control device 200 includes an instruction receiving unit 111, an information determining unit 112 and a control unit 113.
[0128] The instruction receiving unit 111 is configured to receive a content sharing instruction through the first communication interface of the first display screen, wherein the content sharing instruction is used to share the content in the first display screen to the second display screen. The information determining unit 112 is configured to determine the shared content and the content sharing method according to the content sharing instruction. The control unit 113 is configured to control the second display screen to display the shared content based on the content sharing method.
[0129] In an optional implementation, the content sharing method is determined according to a user's selection.
[0130] In an optional implementation, each application program run by the multi-screen controller has a corresponding content sharing method.
[0131] In an optional implementation, the control unit 113 is further configured to execute: in response to the content sharing method being a first method, controlling the second display screen to run a corresponding application to display the shared content; in response to the content sharing method being a second method, controlling the second display screen to follow the first display screen to display the shared content.
[0132] In an optional implementation, the second display screen displays the initial progress of the shared content synchronously with the first display screen.
[0133] In an optional implementation, the control unit 113 is further configured to execute: in response to the content sharing method being the first method, generate first sharing information, the first sharing information including the application and display progress corresponding to the shared content, determine a first display signal based on the first sharing information, and send the first display signal to the second display through the second communication interface of the second display, so that the second display displays the running of the application and displays the shared content according to the display progress.
[0134] In an optional implementation, the control unit 113 is further configured to execute: in response to the content sharing method being the second method, generate second sharing information, the second sharing information including the shared content and display progress, determine a second display signal based on the second sharing information, and send the second display signal to the second display screen through the second communication interface of the second display screen, so that the second display screen displays the shared content according to the display progress.
[0135] The multiple display screens in the multi-screen control system in the vehicle of the embodiment of the present invention are connected to the same multi-screen controller through different communication interfaces, and the content sharing instruction is received through the first communication interface of the first display screen, and the shared content and content sharing method are determined according to the content sharing instruction, and the second display screen is controlled to display the shared content based on the content sharing method. Therefore, the multi-screen controller of the embodiment of the present invention is respectively connected to the corresponding display screens through different communication interfaces, and the independent control of multiple display screens can be realized through the same multi-screen controller, thereby realizing the same display and different display and different touch of multiple display screens. On this basis, this embodiment can adopt different content sharing methods based on needs to realize content sharing between multiple display screens, thereby improving the user experience.
[0136] Fig.12 Schematic diagram of an electronic device according to an embodiment of the present invention. Fig.12As shown, the electronic device 300 can be used as a multi-screen controller of an embodiment of the present invention, which at least includes a processor 121 and a memory 122. Among them, the processor 121 can be used as the processing unit 20 in the above-mentioned multi-screen controller 10. The processor 121 and the memory 122 are connected via a bus 123. The memory 122 is suitable for storing instructions or programs executable by the processor 121. The processor 121 can be an independent microprocessor or a collection of one or more microprocessors. Thus, the processor 121 executes the instructions stored in the memory 122, thereby executing the method flow of the embodiment of the present invention as described above to realize the processing of data and the control of other devices. The bus 123 connects the above-mentioned multiple components together, and at the same time connects the above-mentioned components to the display controller 124 and the display device and the input / output (I / O) device 125. The input / output (I / O) device 125 can be a mouse, a keyboard, a modem, a network interface, a touch input device, a somatosensory input device, a printer, and other devices known in the art. Typically, the input / output device 125 is connected to the system through an input / output (I / O) controller 126.
[0137] Furthermore, the electronic device 300 also has corresponding multiple communication interfaces (not shown in the figure), which are communicatively connected to the multiple display screens, and controls the corresponding display screens to display corresponding contents through the display controller 124 and the multiple communication interfaces.
[0138] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, devices (equipment) or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment or an embodiment combining software and hardware. Moreover, the present application may adopt a computer program product implemented on one or more computer-readable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0139] The present application is described with reference to flowcharts of methods, apparatuses (devices) and computer program products according to embodiments of the present application. It should be understood that each process in the flowchart can be implemented by computer program instructions.
[0140] These computer program instructions may be stored in a computer readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture including an instruction device that implements the process Figure 1 A function specified in a process or multiple processes.
[0141] These computer program instructions may also be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce the instructions for implementing the process Figure 1 A device that specifies functions in a process or multiple processes.
[0142] Another embodiment of the present invention relates to a non-volatile storage medium for storing a computer-readable program, wherein the computer-readable program is used for a computer to execute part or all of the above method embodiments.
[0143] That is, those skilled in the art can understand that all or part of the steps in the above-mentioned embodiment method can be completed by specifying relevant hardware through a program, and the program is stored in a storage medium, including several instructions for a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.
[0144] The above description is only a preferred embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims
1. A multi-screen control method, characterized in that: Multiple display screens are connected to the same multi-screen controller via different communication interfaces, and the method includes: receiving a content sharing instruction through a first communication interface of the first display screen, wherein the content sharing instruction is used to share the content in the first display screen to the second display screen, and the content sharing instruction has a corresponding content sharing method; Determine the content to be shared and the content sharing method according to the content sharing instruction; The second display screen is controlled to display the shared content based on the content sharing method.
2. The method according to claim 1, characterized in that The content sharing method is determined according to the user's selection.
3. The method according to claim 1, characterized in that Each application program run by the multi-screen controller has a corresponding content sharing method.
4. The method according to claim 1, characterized in that The controlling the second display screen to display the shared content based on the content sharing method includes: In response to the content sharing mode being the first mode, controlling the second display screen to run a corresponding application to display the shared content; In response to the content sharing mode being the second mode, the second display screen is controlled to follow the first display screen in displaying the shared content.
5. The method according to claim 4, characterized in that The second display screen displays the initial progress of the shared content synchronously with the first display screen.
6. The method according to claim 4, characterized in that In response to the content sharing mode being the first mode, controlling the second display screen to run a corresponding application to display the shared content includes: In response to the content sharing mode being the first mode, generating first sharing information, the first sharing information including an application corresponding to the shared content and a display progress; determining a first display signal according to the first sharing information; The first display signal is sent to the second display screen through the second communication interface of the second display screen, so that the second display screen displays the running of the application and displays the shared content according to the display progress.
7. The method according to claim 4, characterized in that In response to the content sharing mode being the second mode, controlling the second display screen to follow the first display screen in displaying the shared content includes: In response to the content sharing mode being the second mode, generating second sharing information, the second sharing information including the shared content and display progress; determining a second display signal according to the second sharing information; The second display signal is sent to the second display screen through the second communication interface of the second display screen, so that the second display screen displays the shared content according to the display progress.
8. A multi-screen controller, characterized in that: The multi-screen controller comprises: Multiple communication interfaces, each of which is used to connect to a different display screen; A processing unit, configured to execute the multi-screen control method according to any one of claims 1 to 7.
9. A multi-screen control system, characterized in that: The multi-screen control system comprises: Multiple displays; Multi-screen controller; Wherein, the multi-screen controller includes multiple communication interfaces and a processing unit, each of the communication interfaces is used to connect to a different display screen, and the processing unit is configured to execute the multi-screen control method as described in any one of claims 1-7.
10. The system according to claim 9, characterized in that The display screen includes a first display screen, and the first display screen is used to receive a content sharing instruction from a user, and send the content sharing instruction to the multi-screen controller through a first communication interface corresponding to the first display screen.
11. The system according to claim 10, characterized in that The first display screen displays a content sharing control, and the first display screen is used to display at least one screen selection control and a method selection control in response to the content sharing control being triggered, and to generate the content sharing instruction based on the screen selection control and the method selection control triggered by the user.
12. A vehicle, characterized in that: The vehicle comprises: Multi-screen controller; Multiple display screens distributed in different areas of the vehicle interior; Wherein, the multi-screen controller includes multiple communication interfaces and a processing unit, each of the communication interfaces is used to connect to a different display screen, and the processing unit is configured to execute the multi-screen control method as described in any one of claims 1-7.
13. The vehicle according to claim 12, characterized in that The display screen is arranged on the seat back and / or the hollow area of the front row.
14. A multi-screen control device, characterized in that: Multiple display screens are connected to the same multi-screen controller via different communication interfaces, and the multi-screen control device comprises: An instruction receiving unit is configured to receive a content sharing instruction through a first communication interface of a first display screen, wherein the content sharing instruction is used to share the content in the first display screen to a second display screen; an information determination unit, configured to determine the content to be shared and the content sharing method according to the content sharing instruction; The control unit is configured to control the second display screen to display the shared content based on the content sharing method.
15. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.
16. A computer program product, characterized in that When the computer program product is run on a computer, the computer is caused to execute the method according to any one of claims 1 to 7.
Citation Information
Patent Citations
Multi-screen shared equipment and method, computer readable medium and vehicle-mounted equipment
CN108556740A
Multi-screen sharing method and system based on MOST
CN109640139A
Interface sharing method and electronic equipment
CN111107222A
Vehicle-mounted information entertainment terminal, multi-screen interactive display method thereof and automobile
CN112203130A
Multi-screen interaction method, device and equipment, vehicle-mounted system and computer storage medium
CN115396706A