Human-computer interaction method, human-computer interaction device and readable storage medium
By creating a virtual screen in the vehicle and synchronously displaying the content from the first touch screen to the second touch screen, the problem of complicated operations for simultaneous display of multiple screens is solved and control efficiency is improved.
Patent Information
- Application Number
- CN202510649292.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-05-20
- Publication Date
- 2025-09-23
Smart Images
Figure CN120686999A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of new energy vehicle technology, and in particular to a human-computer interaction method, a human-computer interaction device, and a readable storage medium. Background Art
[0002] With the rapid development of in-vehicle electronic devices, modern vehicles are usually equipped with multiple display screens, such as the central control screen, instrument panel screen, co-pilot screen and rear seat entertainment screen. In traditional car computer systems, each screen usually displays different content, making it difficult to achieve simultaneous display of the same content on multiple screens. Therefore, existing human-computer interaction methods have technical problems such as complicated operation steps and low control efficiency. Summary of the Invention
[0003] The embodiments of the present application provide a human-computer interaction method, a human-computer interaction device, and a readable storage medium, which are used to solve technical problems in the prior art such as complicated operation steps and low control efficiency.
[0004] In a first aspect of an embodiment of the present application, a human-computer interaction method is provided, which is applied to a vehicle, wherein the vehicle includes a first touch screen and a second touch screen, and the method includes:
[0005] When the first touch screen displays the first content, a first instruction is received through the first touch screen, wherein the first instruction is an instruction for mapping the first content to the second touch screen;
[0006] In response to the first instruction, creating a virtual screen corresponding to the first touch screen;
[0007] storing the first content on the virtual screen;
[0008] The virtual screen is controlled to transmit the first content to the second touch screen, so that the second touch screen displays the first content.
[0009] In some embodiments, after controlling the virtual screen to transfer the first content to the second touch screen, the method further includes:
[0010] When the first touch screen displays the first content, receiving a second instruction through the first touch screen, wherein the second instruction is an instruction for synchronously updating the contents displayed on the first touch screen and the second touch screen;
[0011] In response to the second instruction, controlling the first touch screen to display the second content;
[0012] storing the second content on the virtual screen;
[0013] The virtual screen is controlled to transmit the second content to the second touch screen, so that the second touch screen displays the second content.
[0014] In some embodiments, after controlling the virtual screen to transmit the first content to the second touch screen, the method further includes:
[0015] When the first touch screen displays the first content, a third instruction is received through the first touch screen, wherein the third instruction is an instruction to update the content displayed on the first touch screen and not to update the content displayed on the second touch screen;
[0016] In response to the third instruction, the first touch screen is controlled to display the third content, and the second touch screen is controlled to continue displaying the first content.
[0017] In some embodiments, the vehicle further includes a third touch screen. After storing the first content on the virtual screen, the method further includes:
[0018] Receiving a fourth instruction via the first touch screen, wherein the fourth instruction is an instruction to map the first content to the third touch screen;
[0019] In response to the fourth instruction, the virtual screen is controlled to transmit the first content to the third touch screen, so that the third touch screen displays the first content.
[0020] In some embodiments, when the first content includes the first sub-content and the second sub-content, the method further includes:
[0021] Receiving a fifth instruction via the first touch screen, wherein the fifth instruction is an instruction to map the first sub-content to the second touch screen and to map the second sub-content to the third touch screen;
[0022] In response to a fourth instruction, storing the first sub-content and the second sub-content on the virtual screen;
[0023] controlling the virtual screen to transmit the first sub-content to the second touch screen, so that the second touch screen displays the first sub-content;
[0024] The virtual screen is controlled to transmit the second sub-content to the third touch screen, so that the third touch screen displays the second sub-content.
[0025] In some embodiments, when the first content includes the first sub-content and the second sub-content, the method further includes:
[0026] Receiving a sixth instruction via the first touch screen, wherein the sixth instruction is an instruction to map the first sub-content to the second touch screen and to map the first sub-content and the second sub-content to the third touch screen;
[0027] In response to a fifth instruction, storing the first sub-content and the second sub-content on the virtual screen;
[0028] controlling the virtual screen to transmit the first sub-content to the second touch screen, so that the second touch screen displays the first sub-content;
[0029] The virtual screen is controlled to transmit the first sub-content and the second sub-content to the third touch screen, so that the third touch screen displays the first sub-content and the second sub-content.
[0030] In some embodiments, before controlling the virtual screen to transmit the first content to the second touch screen, the method further includes:
[0031] Obtaining size information of the second touch screen;
[0032] The size of the first content is updated according to the size information to obtain updated first content.
[0033] The human-computer interaction method in this embodiment establishes a virtual screen in response to a first instruction, and realizes the synchronous display of the first content on the first touch screen and the second touch screen through the virtual screen. Compared with the conventional content synchronization method, this embodiment only needs to respond to the first instruction to achieve the synchronous display of the first touch screen and the second touch screen, which simplifies the operation steps of the first touch screen and the second touch screen and improves the control efficiency of multiple touch screens in the vehicle.
[0034] According to a second aspect of an embodiment of the present application, a human-computer interaction device is provided, which is applied to a vehicle. The vehicle includes a first touch screen and a second touch screen. The device includes:
[0035] a control unit, configured to receive a first instruction via the first touch screen when the first touch screen displays the first content, wherein the first instruction is an instruction for mapping the first content to the second touch screen;
[0036] a processing unit, configured to create a virtual screen corresponding to the first touch screen in response to the first instruction;
[0037] The processing unit is further configured to store the first content on the virtual screen;
[0038] The control unit is further configured to control the virtual screen to transmit the first content to the second touch screen so that the second touch screen displays the first content.
[0039] The human-computer interaction device in this embodiment establishes a virtual screen in response to the first instruction, and realizes the synchronous display of the first content on the first touch screen and the second touch screen through the virtual screen. Compared with the conventional content synchronization method, this embodiment only needs to respond to the first instruction to achieve the synchronous display of the first touch screen and the second touch screen, which simplifies the operation steps of the first touch screen and the second touch screen and improves the control efficiency of multiple touch screens in the vehicle.
[0040] A third aspect of the present application provides another human-computer interaction device, including a processor and a memory, wherein the memory stores a computer program that, when executed by the processor, implements the steps of the human-computer interaction method described in any of the aforementioned embodiments. Therefore, the human-computer interaction device possesses all the beneficial effects of the human-computer interaction method described in any of the aforementioned embodiments, and further description thereof is omitted.
[0041] A fourth aspect of the present application provides a readable storage medium having a program or instructions stored thereon. When executed by a processor, the program or instructions implement the steps of the human-computer interaction method described in any of the above embodiments. Therefore, the readable storage medium has all the beneficial effects of the human-computer interaction method described in any of the above embodiments, and no further description is given here. BRIEF DESCRIPTION OF THE DRAWINGS
[0042] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0043] Figure 1 A flowchart of the human-computer interaction method provided in an embodiment of the present application;
[0044] Figure 2 One of the schematic diagrams of the human-computer interaction method provided in an embodiment of the present application;
[0045] Figure 3 The second schematic diagram of the human-computer interaction method provided in an embodiment of the present application;
[0046] Figure 4 The third schematic diagram of the human-computer interaction method provided in an embodiment of the present application;
[0047] Figure 5 A functional module block diagram of the human-computer interaction device provided in an embodiment of the present application;
[0048] Figure 6 This is a structural block diagram of the human-computer interaction device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0049] In order to better understand the technical solutions provided by the embodiments of this specification, the technical solutions of the embodiments of this specification are described in detail below through the accompanying drawings and specific embodiments. It should be understood that the embodiments of this specification and the specific features in the embodiments are detailed descriptions of the technical solutions of the embodiments of this specification, rather than limitations on the technical solutions of this specification. In the absence of conflict, the embodiments of this specification and the technical features in the embodiments can be combined with each other.
[0050] In this article, relational terms such as first and second are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply the existence of any such actual relationship or order between these entities or operations. Moreover, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that the process, method, article or equipment comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also include elements inherent to such process, method, article or equipment. In the absence of further restrictions, the elements defined by the statement "comprising a ..." do not exclude the presence of other identical elements in the process, method, article or equipment comprising the elements. The term "two or more" includes two or more than two cases.
[0051] In some embodiments, as Figure 1 As shown, an embodiment of the present application provides a human-computer interaction method, including:
[0052] Step S101, receiving a first instruction via the first touch screen when the first content is displayed on the first touch screen;
[0053] Step S102, in response to the first instruction, creating a virtual screen corresponding to the first touch screen;
[0054] Step S103, storing the first content on the virtual screen;
[0055] Step S104 : controlling the virtual screen to transmit the first content to the second touch screen, so that the second touch screen displays the first content.
[0056] In this embodiment, a human-computer interaction method is proposed, which is applied to a vehicle. The vehicle includes a first touch screen and a second touch screen, wherein the first touch screen and the second touch screen are two independently arranged touch screens.
[0057] Illustratively, the vehicle may be an electric vehicle.
[0058] For example, the vehicle may be an unmanned smart car.
[0059] For example, the first touch screen may be a main screen on a vehicle console, and the second touch screen may be a secondary screen on the vehicle console.
[0060] For example, the occupants of the vehicle can operate the first touch screen and the second touch screen respectively.
[0061] Exemplarily, the first touch screen may be a central control screen of the vehicle, and the operating parameters of the vehicle are controlled and set through the central control screen. The operating parameters may include specific parameters such as vehicle speed and interior temperature.
[0062] For example, the first touch screen may be a dashboard screen of the vehicle, and parameters such as the vehicle's speed, battery level, and interior temperature may be displayed on the dashboard screen.
[0063] For example, the second touch screen may be a co-pilot screen, through which entertainment content such as videos may be displayed.
[0064] The first touch screen is controlled to display first content, wherein the first content is initial content displayed on the first touch screen.
[0065] Exemplarily, the first content may be pre-stored video content.
[0066] For example, the first content may be an operating parameter of the vehicle.
[0067] For example, the first content may be a navigation map of the vehicle.
[0068] When the first touch screen displays the first content, a first instruction is received through the first touch screen, wherein the first instruction is an instruction for mapping the first content to the second touch screen.
[0069] Exemplarily, the first instruction is an instruction input by a user operating the first touch screen.
[0070] Exemplarily, the first instruction may be a touch instruction when the user operates the first touch screen.
[0071] Exemplarily, the first instruction may be an instruction to project the first content of the first touch screen onto the second touch screen.
[0072] In response to the first instruction, a virtual screen corresponding to the first touch screen is created, and the first content is stored in the virtual screen, wherein the virtual screen is a virtual carrier capable of loading the first content.
[0073] Exemplarily, the virtual screen is obtained by calling a function for creating a virtual screen.
[0074] Exemplarily, in the process of responding to the first instruction, a virtual screen loader is enabled to create a virtual screen corresponding to the first touch screen.
[0075] The virtual screen is controlled to transmit the first content to the second touch screen, thereby controlling the second touch screen to display the first content.
[0076] Exemplarily, the content mapping function is called to transfer the first content loaded on the virtual screen to the second touch screen.
[0077] Exemplarily, when the virtual screen is controlled to transmit the first content to the second touch screen, the first touch screen and the second touch screen may synchronously display the first content.
[0078] For example, Figure 2 As shown, this embodiment can initiate and implement a multi-screen co-viewing program. Specifically, initiate a co-viewing operation, determine whether the first touch screen or the second touch screen is in the co-viewing process, if not in the co-viewing process, initiate the co-viewing process, if in the co-viewing process, determine whether to re-initiate the viewing based on the initiating screen ID and package name, if re-initiate, end the ongoing co-viewing, if no re-initiate is needed, determine that the first touch screen is in the co-viewing process, and determine that the initiating co-viewing application has not changed.
[0079] During the co-viewing operation, you can switch the first touch screen for co-viewing, or exit the first touch screen to make the first touch screen exit the co-viewing page. During the co-viewing operation, you can also add a second touch screen.
[0080] When a new co-viewing activity process is started on the first touch screen or the second touch screen, the co-viewing process can be achieved through mirroring.
[0081] For example, Figure 3 As shown, the first touch screen is the initiating screen and the second touch screen is the receiving screen. This embodiment can initiate the co-viewing process and determine whether the co-viewing process is being ended. There are delay operations in both the initiating process and the ending process, which takes a long time and has timing issues. It is necessary to ensure that the initiation of co-viewing and the ending of co-viewing are not executed at the same time. If the co-viewing process is being ended, it is necessary to end the co-viewing process. If it is not being ended, it is necessary to create a virtual screen and move the co-viewing application to the virtual screen. The callback is received through the onTaskDisplayChanged function to enable the initiating screen and the receiving screen to start the co-viewing page.
[0082] Among them, there is a 200ms delay between receiving the callback through the onTaskDisplayChanged function and starting the co-viewing page on the initiating screen and the receiving screen. The onTaskDisplayChanged function callback is early, and the activity process of the corresponding task has not yet been actually moved to the corresponding receiving screen ID. Directly starting the co-viewing page at this time will cause the video page to enter the pause process and cause it to be paused, so a 200ms delay is required.
[0083] To create a virtual screen, you need to use the displayManager.createVirtualDisplay function.
[0084] The steps for moving the application stack to the virtual screen require the use of the following functions:
[0085] ActivityTaskManager.getService().moveRootTaskToDisplay(sourceTaskld,it).
[0086] For example, Figure 4 As shown, in this embodiment, when initiating the co-viewing process, it is necessary to start the co-viewing activity process, synchronize and monitor the brightness changes of the initiating screen, and monitor the return event. If a return event is received, it is necessary to forward the first content to the virtual screen. The co-viewing application task is obtained, the getSurfaceControl function is called, and the SurfaceControl.Transaction.reparent function is used to display the screen. The scale and coordinates are calculated based on the sizes of the initiating and receiving screens so that the receiving screen can fully display the first content.
[0087] It should be noted that this embodiment establishes a virtual screen in response to the first instruction, and realizes the synchronous display of the first content on the first touch screen and the second touch screen through the virtual screen. Compared with the conventional content synchronization method, this embodiment only needs to respond to the first instruction to achieve the synchronous display of the first touch screen and the second touch screen, which simplifies the operation steps of the first touch screen and the second touch screen, and improves the control efficiency of multiple touch screens in the vehicle.
[0088] The human-computer interaction method in this embodiment simplifies the operation steps of the first touch screen and the second touch screen by establishing a virtual screen in response to the first instruction, thereby improving the control efficiency of the first touch screen and the second touch screen.
[0089] In some embodiments, an embodiment of the present application provides a human-computer interaction method, which controls the virtual screen and transmits the first content to the second touch screen, and further includes:
[0090] When the first touch screen displays the first content, receiving the second instruction through the first touch screen;
[0091] In response to the second instruction, controlling the first touch screen to display the second content;
[0092] storing the second content on the virtual screen;
[0093] The virtual screen is controlled to transmit the second content to the second touch screen, so that the second touch screen displays the second content.
[0094] In this embodiment, when the first touch screen displays the first content, the second instruction is received through the first touch screen, wherein the second instruction is an instruction for the first touch screen and the second touch screen to synchronously update the content.
[0095] For example, the second instruction may be a touch instruction for the user to operate the first touch screen to update the displayed content.
[0096] In response to the second instruction, the first touch screen is controlled to display second content, and the second content is stored in the virtual screen, wherein the second content is the updated content of the first content.
[0097] Exemplarily, the second instruction may be an instruction to update the first content to the second content.
[0098] For example, the first touch screen may display a plurality of contents such as the first content and the second content, and the second instruction may be an instruction for selecting the second content.
[0099] For example, multiple applications such as "video playback" and "map navigation" can be displayed on the first touch screen. The first content can be the video content corresponding to "video playback", and the second content can be the navigation map corresponding to "map navigation".
[0100] The virtual screen is controlled to transmit the second content to the second touch screen, so that the second touch screen displays the second content.
[0101] Exemplarily, the content mapping function is called so that the second content loaded on the virtual screen is transmitted to the second touch screen.
[0102] For example, the first content may be the video content corresponding to "video playback", and the second content may be the navigation map corresponding to "map navigation". When the virtual screen is controlled to transmit the second content to the second touch screen, the first touch screen and the second touch screen may be synchronously updated from the video content to the navigation map.
[0103] In some embodiments, an embodiment of the present application provides a human-computer interaction method, which controls the virtual screen and transmits the first content to the second touch screen, and further includes:
[0104] When the first touch screen displays the first content, receiving a third instruction through the first touch screen;
[0105] In response to the third instruction, the first touch screen is controlled to display the third content, and the second touch screen is controlled to continue displaying the first content.
[0106] In this embodiment, when the first touch screen displays the first content, a third instruction is received through the first touch screen, wherein the third instruction is an instruction for the first touch screen to update the content and the second touch screen not to update the content.
[0107] In response to the third instruction, the first touch screen is controlled to display the third content, and the second touch screen is controlled to continue displaying the first content.
[0108] Exemplarily, the first content may be video content, and the third content may be operating parameters of the vehicle. In response to the third instruction, the first touch screen is controlled to display the video content updated to the operating parameters, and the second touch screen is controlled to continue displaying the video content, so that the first touch screen and the second touch screen can display different content.
[0109] In some embodiments, an embodiment of the present application provides a human-computer interaction method, wherein after storing the first content on the virtual screen, the method further includes:
[0110] receiving a fourth instruction via the first touch screen;
[0111] In response to the fourth instruction, the virtual screen is controlled to transmit the first content to the third touch screen, so that the third touch screen displays the first content.
[0112] In this embodiment, the vehicle further includes a third touch screen, wherein the third touch screen is a touch screen independently provided in the vehicle.
[0113] A fourth instruction is received through the first touch screen, wherein the fourth instruction is an instruction to map the first content to the third touch screen.
[0114] Exemplarily, the third touch screen may be a rear-seat entertainment screen of the vehicle, for displaying content to rear-seat passengers of the vehicle.
[0115] After storing the first content on the virtual screen, in response to a fourth instruction, the virtual screen is controlled to transmit the first content to the third touch screen, so that the third touch screen displays the first content.
[0116] Exemplarily, controlling the virtual screen to transmit the first content to the third touch screen may enable the third touch screen and the first touch screen to synchronously display the same content.
[0117] In some embodiments, an embodiment of the present application provides a human-computer interaction method, where, when the first content includes the first sub-content and the second sub-content, the method further includes:
[0118] receiving a fifth instruction via the first touch screen;
[0119] In response to a fifth instruction, storing the first sub-content and the second sub-content on the virtual screen;
[0120] controlling the virtual screen to transmit the first sub-content to the second touch screen, so that the second touch screen displays the first sub-content;
[0121] The virtual screen is controlled to transmit the second sub-content to the third touch screen, so that the third touch screen displays the second sub-content.
[0122] In this embodiment, the first content includes a first sub-content and a second sub-content, wherein the first sub-content and the second sub-content are independent display contents.
[0123] For example, when the first content is various operating parameters of a vehicle, the first sub-content may be the battery level of the vehicle, and the second sub-content may be the speed of the vehicle.
[0124] For example, when the first content is a navigation map, the first sub-content may be a map of area A, and the second sub-content may be a map of area B.
[0125] Exemplarily, when the first content includes a plurality of partitioned videos, the first sub-content may be the first partitioned video, and the second sub-content may be the second partitioned video.
[0126] A fifth instruction is received through the first touch screen, wherein the fifth instruction is an instruction to map the first sub-content to the second touch screen and to map the second sub-content to the third touch screen.
[0127] For example, the fifth instruction may be an instruction for the user to select and confirm the first sub-content and the second sub-content on the first touch screen respectively.
[0128] In response to the fifth instruction, the first sub-content and the second sub-content are respectively stored in the virtual screen.
[0129] Exemplarily, in response to the fifth instruction, the virtual screen is partitioned, the first sub-content is stored in partition 1 , and the second sub-content is stored in partition 2 .
[0130] The virtual screen is controlled to transmit the first sub-content to the second touch screen so that the second touch screen displays the first sub-content, and the virtual screen is controlled to transmit the second sub-content to the third touch screen so that the third touch screen displays the second sub-content.
[0131] For example, when the first sub-content can be a map of area A and the second sub-content can be a map of area B, the second touch screen is controlled to display the map of area A, and the third touch screen is controlled to display the map of area B, thereby expanding the map display range of the first touch screen and extending the map display details of the first touch screen.
[0132] For example, when the first sub-content can be the first partition video and the second sub-content can be the second partition video, the second touch screen is controlled to display the first partition video and the third touch screen is controlled to display the second partition video, thereby expanding the video display range of the first touch screen and allowing more passengers to see the content displayed on the first touch screen.
[0133] In some embodiments, an embodiment of the present application provides a human-computer interaction method, where, when the first content includes the first sub-content and the second sub-content, the method further includes:
[0134] receiving a sixth instruction via the first touch screen;
[0135] In response to a sixth instruction, storing the first sub-content and the second sub-content on the virtual screen;
[0136] controlling the virtual screen to transmit the first sub-content to the second touch screen, so that the second touch screen displays the first sub-content;
[0137] The virtual screen is controlled to transmit the first sub-content and the second sub-content to the third touch screen, so that the third touch screen displays the first sub-content and the second sub-content.
[0138] In this embodiment, a sixth instruction is received via the first touch screen, wherein the sixth instruction is an instruction to map the first sub-content to the second touch screen and to map the first sub-content and the second sub-content to the third touch screen.
[0139] For example, the sixth instruction may be an instruction for the user to select and confirm the first sub-content and the second sub-content on the first touch screen respectively.
[0140] In response to the sixth instruction, the first sub-content and the second sub-content are respectively stored in the virtual screen.
[0141] Exemplarily, in response to the sixth instruction, the virtual screen is partitioned, the first sub-content is stored in partition 1 , and the second sub-content is stored in partition 2 .
[0142] The virtual screen is controlled to transmit the first sub-content to the second touch screen so that the second touch screen displays the first sub-content, and the virtual screen is controlled to transmit the first sub-content and the second sub-content to the third touch screen so that the third touch screen displays the first sub-content and the second sub-content.
[0143] For example, when the first sub-content can be a map of area A and the second sub-content can be a map of area B, the second touch screen is controlled to display the map of area A, and the third touch screen is controlled to display the map of area A and the map of area B at the same time. The third touch screen is a synchronous display screen of the first touch screen, and can display the same content as the first touch screen. The second touch screen displays the map of area A and can highlight the key content of the first touch screen.
[0144] In some embodiments, an embodiment of the present application provides a human-computer interaction method, which controls the virtual screen and transmits the first content to the second touch screen. The method further includes:
[0145] Obtaining size information of the second touch screen;
[0146] The size of the first content is updated according to the size information to obtain updated first content.
[0147] In this embodiment, before controlling the virtual screen to transmit the first content to the second touch screen, size information of the second touch screen is acquired, wherein the size information is the size of the display area of the second touch screen.
[0148] Exemplarily, the size information may include the number of pixels on the long side and the number of pixels on the wide side of the second touch screen.
[0149] The size of the first content is updated to the size information of the second touch screen to obtain the updated first content.
[0150] For example, the updated first content can be adapted to the size information of the second touch screen, ensuring that the first content can be fully displayed on the second touch screen, thereby avoiding a situation where the first content is not fully displayed.
[0151] In some embodiments, as Figure 5 As shown, in an embodiment of the present application, a human-computer interaction device 800 is provided, comprising:
[0152] A control unit 802 is configured to receive a first instruction via the first touch screen when the first touch screen displays the first content;
[0153] The processing unit 804 is configured to create a virtual screen corresponding to the first touch screen in response to the first instruction;
[0154] The processing unit 804 is further configured to store the first content on the virtual screen;
[0155] The control unit 802 is further configured to control the virtual screen to transmit the first content to the second touch screen, so that the second touch screen displays the first content.
[0156] In this embodiment, a human-computer interaction device 800 is proposed, which is applied to a vehicle. The vehicle includes a first touch screen and a second touch screen, wherein the first touch screen and the second touch screen are two independently arranged touch screens.
[0157] Illustratively, the vehicle may be an electric vehicle.
[0158] For example, the vehicle may be an unmanned smart car.
[0159] For example, the first touch screen may be a main screen on a vehicle console, and the second touch screen may be a secondary screen on the vehicle console.
[0160] For example, the occupants of the vehicle can operate the first touch screen and the second touch screen respectively.
[0161] Exemplarily, the first touch screen may be a central control screen of the vehicle, and the operating parameters of the vehicle are controlled and set through the central control screen. The operating parameters may include specific parameters such as vehicle speed and interior temperature.
[0162] For example, the first touch screen may be a dashboard screen of the vehicle, and parameters such as the vehicle's speed, battery level, and interior temperature may be displayed on the dashboard screen.
[0163] For example, the second touch screen may be a co-pilot screen, through which entertainment content such as videos may be displayed.
[0164] The first touch screen is controlled to display first content, wherein the first content is initial content displayed on the first touch screen.
[0165] Exemplarily, the first content may be pre-stored video content.
[0166] For example, the first content may be an operating parameter of the vehicle.
[0167] For example, the first content may be a navigation map of the vehicle.
[0168] When the first touch screen displays the first content, a first instruction is received through the first touch screen, wherein the first instruction is an instruction for mapping the first content to the second touch screen.
[0169] Exemplarily, the first instruction is an instruction input by a user operating the first touch screen.
[0170] Exemplarily, the first instruction may be a touch instruction when the user operates the first touch screen.
[0171] Exemplarily, the first instruction may be an instruction to project the first content of the first touch screen onto the second touch screen.
[0172] In response to the first instruction, a virtual screen corresponding to the first touch screen is created, and the first content is stored in the virtual screen, wherein the virtual screen is a virtual carrier capable of loading the first content.
[0173] Exemplarily, the virtual screen is obtained by calling a function for creating a virtual screen.
[0174] Exemplarily, in the process of responding to the first instruction, a virtual screen loader is enabled to create a virtual screen corresponding to the first touch screen.
[0175] The virtual screen is controlled to transmit the first content to the second touch screen, thereby controlling the second touch screen to display the first content.
[0176] Exemplarily, the content mapping function is called to transfer the first content loaded on the virtual screen to the second touch screen.
[0177] Exemplarily, when the virtual screen is controlled to transmit the first content to the second touch screen, the first touch screen and the second touch screen may synchronously display the first content.
[0178] It should be noted that this embodiment establishes a virtual screen in response to the first instruction, and realizes the synchronous display of the first content on the first touch screen and the second touch screen through the virtual screen. Compared with the conventional content synchronization method, this embodiment only needs to respond to the first instruction to achieve the synchronous display of the first touch screen and the second touch screen, which simplifies the operation steps of the first touch screen and the second touch screen, and improves the control efficiency of multiple touch screens in the vehicle.
[0179] The human-computer interaction device 800 in this embodiment establishes a virtual screen in response to the first instruction, thereby simplifying the operation steps of the first touch screen and the second touch screen and improving the control efficiency of the first touch screen and the second touch screen.
[0180] In some embodiments, an embodiment of the present application provides a human-computer interaction device 800, including:
[0181] The control unit 802 is further configured to receive a second instruction via the first touch screen when the first touch screen displays the first content;
[0182] The processing unit 804 is further configured to control the first touch screen to display second content in response to the second instruction;
[0183] The processing unit 804 is further configured to store the second content on the virtual screen;
[0184] The control unit 802 is further configured to control the virtual screen to transmit the second content to the second touch screen, so that the second touch screen displays the second content.
[0185] In some embodiments, an embodiment of the present application provides a human-computer interaction device 800, including:
[0186] The control unit 802 is further configured to receive a third instruction via the first touch screen when the first touch screen displays the first content;
[0187] The processing unit 804 is further configured to, in response to the third instruction, control the first touch screen to display the third content, and control the second touch screen to continue displaying the first content.
[0188] In some embodiments, an embodiment of the present application provides a human-computer interaction device 800, including:
[0189] The control unit 802 is further configured to receive a fourth instruction via the first touch screen;
[0190] The control unit 802 is further configured to control the virtual screen in response to the fourth instruction to transmit the first content to the third touch screen, so that the third touch screen displays the first content.
[0191] In some embodiments, an embodiment of the present application provides a human-computer interaction device 800, including:
[0192] The control unit 802 is further configured to receive a fifth instruction via the first touch screen;
[0193] The processing unit 804 is further configured to store the first sub-content and the second sub-content on the virtual screen in response to the fifth instruction;
[0194] The control unit 802 is further configured to control the virtual screen to transmit the first sub-content to the second touch screen so that the second touch screen displays the first sub-content;
[0195] The control unit 802 is further configured to control the virtual screen to transmit the second sub-content to the third touch screen, so that the third touch screen displays the second sub-content.
[0196] In some embodiments, an embodiment of the present application provides a human-computer interaction device 800, including:
[0197] The control unit 802 is further configured to receive a sixth instruction via the first touch screen;
[0198] The processing unit 804 is further configured to store the first sub-content and the second sub-content on the virtual screen in response to the sixth instruction;
[0199] The control unit 802 is further configured to control the virtual screen to transmit the first sub-content to the second touch screen so that the second touch screen displays the first sub-content;
[0200] The control unit 802 is further configured to control the virtual screen to transmit the first sub-content and the second sub-content to the third touch screen, so that the third touch screen displays the first sub-content and the second sub-content.
[0201] In some embodiments, an embodiment of the present application provides a human-computer interaction device 800, including:
[0202] The processing unit 804 is further configured to obtain size information of the second touch screen;
[0203] The processing unit 804 is further configured to update the size of the first content according to the size information to obtain updated first content.
[0204] In some embodiments, as Figure 6 As shown, a human-computer interaction device 900 is proposed. The human-computer interaction device 900 includes a processor 902 and a memory 904. The memory 904 stores a computer program. When the computer program is executed by the processor 902, the steps of the human-computer interaction method in any of the above embodiments are implemented. Therefore, the human-computer interaction device 900 has all the beneficial effects of the human-computer interaction method in any of the above embodiments, and no further details are given here.
[0205] In some embodiments, a readable storage medium is provided on which a program is stored. When the program is executed by a processor, the steps of the human-computer interaction method in any of the above embodiments are implemented, thereby having all the beneficial technical effects of the human-computer interaction method in any of the above embodiments.
[0206] It should be noted that, in the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.
[0207] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-readable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contain computer-readable program code.
[0208] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded computer, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0209] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.
[0210] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.
[0211] An embodiment of the present application further provides a computer program product, which includes computer software instructions. When the computer software instructions are executed on a processing device, the processing device executes the process of the human-computer interaction method.
[0212] A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that a computer can store or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state drive (SSD)).
[0213] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0214] In the several embodiments provided in this application, it should be understood that the disclosed devices, apparatuses and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interface, device or unit, which can be electrical, mechanical or other forms.
[0215] Units described as separate components may or may not be physically separate, and components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.
[0216] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.
[0217] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0218] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.
[0219] Although the preferred embodiments of this specification have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concepts. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of this specification.
[0220] Obviously, those skilled in the art may make various changes and modifications to this specification without departing from the spirit and scope of this specification. Thus, if such changes and modifications fall within the scope of the claims of this specification and their equivalents, this specification is intended to include such changes and modifications.
Claims
1. A human-computer interaction method, characterized in that: Applied to a vehicle, the vehicle comprising a first touch screen and a second touch screen, the method comprising: When the first touch screen displays first content, receiving a first instruction through the first touch screen, wherein the first instruction is an instruction for mapping the first content to the second touch screen; In response to the first instruction, creating a virtual screen corresponding to the first touch screen; storing the first content on the virtual screen; The virtual screen is controlled to transmit the first content to the second touch screen, so that the second touch screen displays the first content.
2. The method according to claim 1, characterized in that After controlling the virtual screen to transmit the first content to the second touch screen, the method further includes: When the first touch screen displays the first content, receiving a second instruction through the first touch screen, wherein the second instruction is an instruction for synchronously updating the contents displayed on the first touch screen and the second touch screen; In response to the second instruction, controlling the first touch screen to display second content; storing the second content on the virtual screen; The virtual screen is controlled to transmit the second content to the second touch screen, so that the second touch screen displays the second content.
3. The method according to claim 1, characterized in that After controlling the virtual screen to transmit the first content to the second touch screen, the method further includes: When the first touch screen displays the first content, receiving a third instruction through the first touch screen, wherein the third instruction is an instruction to update the content displayed on the first touch screen and not to update the content displayed on the second touch screen; In response to the third instruction, the first touch screen is controlled to display third content, and the second touch screen is controlled to continue displaying the first content.
4. The method according to claim 1, wherein The vehicle further includes a third touch screen. After storing the first content on the virtual screen, the method further includes: receiving a fourth instruction via the first touch screen, wherein the fourth instruction is an instruction to map the first content to the third touch screen; In response to the fourth instruction, the virtual screen is controlled to transmit the first content to the third touch screen, so that the third touch screen displays the first content.
5. The method according to claim 4, characterized in that In the case where the first content includes a first sub-content and a second sub-content, the method further includes: receiving a fifth instruction via the first touch screen, wherein the fifth instruction is an instruction to map the first sub-content to the second touch screen and to map the second sub-content to the third touch screen; In response to the fourth instruction, storing the first sub-content and the second sub-content on the virtual screen; controlling the virtual screen to transmit the first sub-content to the second touch screen, so that the second touch screen displays the first sub-content; The virtual screen is controlled to transmit the second sub-content to the third touch screen, so that the third touch screen displays the second sub-content.
6. The method according to claim 4, characterized in that In the case where the first content includes a first sub-content and a second sub-content, the method further includes: receiving a sixth instruction through the first touch screen, wherein the sixth instruction is an instruction to map the first sub-content to the second touch screen and to map the first sub-content and the second sub-content to the third touch screen; In response to the fifth instruction, storing the first sub-content and the second sub-content on the virtual screen; controlling the virtual screen to transmit the first sub-content to the second touch screen, so that the second touch screen displays the first sub-content; The virtual screen is controlled to transmit the first sub-content and the second sub-content to the third touch screen, so that the third touch screen displays the first sub-content and the second sub-content.
7. The method according to any one of claims 1 to 6, characterized in that Before controlling the virtual screen to transmit the first content to the second touch screen, the method further includes: Obtaining size information of the second touch screen; The size of the first content is updated according to the size information to obtain updated first content.
8. A human-computer interaction device, characterized in that: Applied to a vehicle, the vehicle includes a first touch screen and a second touch screen, and the device includes: a control unit, configured to receive a first instruction via the first touch screen when the first touch screen displays first content, wherein the first instruction is an instruction for mapping the first content to the second touch screen; a processing unit, configured to create a virtual screen corresponding to the first touch screen in response to the first instruction; The processing unit is further configured to store the first content on the virtual screen; The control unit is further configured to control the virtual screen to transmit the first content to the second touch screen, so that the second touch screen displays the first content.
9. A human-computer interaction device, characterized in that: include: processor; A memory, wherein a program or instruction is stored in the memory, and when the processor executes the program or instruction in the memory, the steps of the human-computer interaction method according to any one of claims 1 to 7 are implemented.
10. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the human-computer interaction method according to any one of claims 1 to 7 are implemented.