Method, system, vehicle, storage medium and program product for a vehicle cabin

Abstract

A method, an in-vehicle interactive system, an apparatus, a vehicle, a storage medium, and a computer program product for a vehicle cabin are provided. The method includes detecting, via an in-vehicle sensor, an interaction instruction for a first display screen of a plurality of display screens; in response to detecting the interaction instruction, determining at least one second display screen and interaction devices required for running a first application in a subset of the plurality of interaction devices associated with the at least one second display screen; and enabling the determined interaction devices such that, after a user graphical interface is transferred from the first display screen to the at least one second display screen, full functionality of the currently running first application is available to a user on a seat corresponding to the at least one second display screen.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the field of vehicles, and in particular to a method for a vehicle cabin, an in-vehicle interaction system, an apparatus, a vehicle, a storage medium, and a computer program product. BACKGROUND

[0002] In the field of vehicles, multiple display screens are usually arranged in a vehicle cabin, which communicate in a wired or wireless manner so that the same content can be shared in different display screens.

[0003] In the existing vehicle cabin interaction method, an operation on a first screen of multiple screens is recognized, and then target content is moved or shared to a second screen according to the operation, thereby improving the user experience of the user of the in-vehicle multi-screen system. Improving the user experience of the vehicle cabin interaction method is one of the important works to realize the intelligentization of the vehicle cabin.

[0004] The methods described in this section can not necessarily be the methods that have been previously conceived or employed. Unless otherwise indicated, it should not be assumed that any of the methods described in this section qualify as prior art merely by virtue of their inclusion in this section. Similarly, issues identified with respect to one or more methods should not be assumed to have been raised with respect to any prior art merely by virtue of their inclusion in this section. SUMMARY

[0005] The present disclosure provides a method for a vehicle cabin, an in-vehicle interaction system, an apparatus, a vehicle, a storage medium, and a computer program product.

[0006] According to an aspect of the present disclosure, a method for a vehicle cabin is provided, the vehicle cabin comprising a plurality of display screens arranged for different seats and a plurality of interaction devices associated with the plurality of display screens, each display screen being associated with a respective subset of the plurality of interaction devices, the method comprising detecting, via an in-vehicle sensor, an interaction instruction for a first display screen of the plurality of display screens, the first display screen being displaying a user graphical interface of a first application currently running, the interaction instruction indicating a transfer of the user graphical interface from the first display screen to at least one second display screen of the plurality of display screens, in response to detecting the interaction instruction, determining the at least one second display screen and interaction devices of the subset of the plurality of interaction devices associated with the at least one second display screen required to run the first application, and enabling the determined interaction devices such that, after the transfer of the user graphical interface from the first display screen to the at least one second display screen, full functionality of the first application currently running is available to a user on a seat corresponding to the at least one second display screen.

[0007] According to another aspect of the present disclosure, there is provided an apparatus for a vehicle cabin, the vehicle cabin comprising a plurality of display screens for different seating arrangements and a plurality of interaction devices associated with the plurality of display screens, each display screen being associated with a respective subset of the plurality of interaction devices. The apparatus comprises: a first module configured to detect, via an in-vehicle sensor, an interaction instruction for a first display screen of the plurality of display screens, the first display screen being displaying a user graphical interface of a first application currently running, the interaction instruction indicating a transfer of the user graphical interface from the first display screen to at least one second display screen of the plurality of display screens; a second module configured to, in response to detecting the interaction instruction, determine the at least one second display screen and interaction devices required for running the first application among the subset of the plurality of interaction devices associated with the at least one second display screen; and a third module configured to enable the determined interaction devices such that, after the transfer of the user graphical interface from the first display screen to the at least one second display screen, full functionalities of the first application currently running are available to a user on a seat corresponding to the at least one second display screen.

[0008] According to another aspect of the present disclosure, there is provided an in-vehicle interaction system comprising: at least one processor; and at least one memory having a computer program stored thereon, the computer program, when executed by the at least one processor, causing the at least one processor to implement the method described above.

[0009] According to yet another aspect of the present disclosure, there is provided a vehicle comprising the in-vehicle interaction system or apparatus described above.

[0010] According to still another aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing a computer program, the computer program comprising instructions which, when executed by a processor, cause the processor to perform the method described above.

[0011] According to still another aspect of the present disclosure, there is provided a computer program product comprising instructions which, when executed by a processor, cause the processor to perform the method described above.

[0012] According to embodiments of the present disclosure, the user graphical interface of an application program can be transferred between different display screens while the interaction devices associated with the application program are also transferred, so that the application program can be transferred in its entirety among passengers in a vehicle, and users can obtain a complete application program experience.

[0013] These and other aspects of the present disclosure will become clear from the embodiments described hereinafter and will be apparent from the embodiments described hereinafter. BRIEF DESCRIPTION OF DRAWINGS

[0014] More details, features and advantages of the present disclosure are disclosed in the following description of exemplary embodiments in conjunction with the accompanying drawings. The drawings show, by way of example, embodiments and constitute part of this specification, illustrating exemplary implementations of the embodiments together with the written description. The illustrated embodiments are merely examples and do not limit the scope of the claims. In all the drawings, like reference numerals refer to like elements, but not necessarily on the same scale. In the drawings:

[0015] Figure 1 is a schematic diagram illustrating an example system 100 in which various methods described herein can be implemented, according to an exemplary embodiment;

[0016] Figure 2 is a flowchart illustrating a method for a vehicle cabin, according to an exemplary embodiment;

[0017] Figure 3 is a schematic block diagram illustrating a plurality of interaction devices associated with a display screen, according to an exemplary embodiment;

[0018] Figure 4 is a flowchart illustrating a method of determining at least one second display screen, according to an exemplary embodiment;

[0019] Figure 5 is a schematic diagram illustrating a circular undirected graph and a correspondence of a plurality of display screens, according to an exemplary embodiment;

[0020] Figure 6 is a flowchart illustrating a method of determining at least one second display screen, according to an exemplary embodiment;

[0021] Figure 7 is a flowchart illustrating a method of determining a required interaction device, according to an exemplary embodiment;

[0022] Figure 8 is a schematic diagram illustrating a method of determining a required interaction device, according to an exemplary embodiment;

[0023] Figure 9 is a block diagram illustrating an apparatus for a vehicle cabin, according to an exemplary embodiment;

[0024] Figure 10 is a block diagram illustrating an example in-vehicle interaction system that can be applied to an exemplary embodiment;

[0025] Figure 11 is a block diagram illustrating a vehicle, according to an exemplary embodiment. DETAILED DESCRIPTION

[0026] In the present disclosure, the use of the terms "first", "second", etc. to describe various elements is not intended to limit the positional relationship, timing relationship or importance relationship of these elements, and such terms are only used to distinguish one element from another. In some examples, the first element and the second element can refer to the same instance of the element, and in some cases, based on the context of the description, they can also refer to different instances.

[0027] The terms used in the description of various described examples in the present disclosure are only for the purpose of describing specific examples, and are not intended to be limiting. Unless the context clearly indicates otherwise, if the number of elements is not specifically limited, the element can be one or more. As used herein, the term "plurality" means two or more, and the term "based on" should be interpreted as "at least partially based on". In addition, the terms "and / or" and "at least one of" cover any one and all possible combinations of the listed items.

[0028] In the related art, there is a method for inter-screen application interaction of an in-vehicle system, in which the application interface displayed on a first display screen can be moved or shared to a second display screen. However, when implementing the movement or sharing of the application interface, this method does not take into account the case where different cabin seats are provided with dedicated in-vehicle interaction devices, and in certain scenarios, the correct inter-screen application interaction cannot be achieved. For example, when the driver is making a video call based on a first in-vehicle display screen, he moves the application interface of the video call to a second in-vehicle display screen provided for the front passenger seat, hoping that the video call will be made by the passenger in the front passenger seat, as the video call affects driving safety. At this time, the second in-vehicle display screen will display the application interface of the video call, but the camera enabled by the video call application is still the one provided for the driver's seat, rather than the one provided for the front passenger seat. In this way, the video screen and call voice seen by the communication counterpart will come from different objects, causing the video call to not proceed normally.

[0029] To solve the above technical problem, according to one or more embodiments of the present disclosure, a new interaction method for a vehicle cabin is proposed, which not only implements the movement or sharing of the application interface between different in-vehicle display screens, but also enables the interaction device associated with the target display screen, so that the complete function of the application is available to the user in the seat corresponding to the target display screen. The exemplary embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.

[0030] Figure 1 is a schematic diagram illustrating an example system 100 in which various methods described herein can be implemented according to exemplary embodiments.

[0031] ReferringFigure 1 The system 100 includes an in-vehicle system 110, a server 120, and a network 130 communicatively coupling the in-vehicle system 110 and the server 120.

[0032] The in-vehicle system 110 includes a display screen 114 and an application (APP) 112 displayable via the display screen 114. The application 112 can be an application installed by default for the in-vehicle system 110 or downloaded and installed by the user 102, or a small program as a lightweight application. In the case that the application 112 is a small program, the user 102 can directly run the application 112 on the in-vehicle system 110 without installing the application 112 by searching for the application 112 (e.g., by the name of the application 112, etc.) in a host application or scanning a graphic code (e.g., a bar code, a QR code, etc.) of the application 112, etc. In some embodiments, the in-vehicle system 110 can include one or more processors and one or more memories (not shown), and the in-vehicle system 110 is implemented as an in-vehicle computer. In some embodiments, the in-vehicle system 110 can include more or less display screens 114 (e.g., not including the display screen 114), and / or one or more speakers or other human-machine interaction devices. In some embodiments, the in-vehicle system 110 can not communicate with the server 120.

[0033] The server 120 can represent a single server, a cluster of multiple servers, a distributed system, or a cloud server providing basic cloud services such as cloud database, cloud computing, cloud storage, cloud communication. It will be understood that, although Figure 1 Although the server 120 is shown in FIG. 1 to communicate with only one in-vehicle system 110, the server 120 can provide background services for multiple in-vehicle systems at the same time.

[0034] The network 130 allows wireless communication and information exchange between vehicles and other Xs (X means vehicles, roads, pedestrians, or the Internet, etc.) according to agreed communication protocols and data interaction standards. Examples of the network 130 include a local area network (LAN), a wide area network (WAN), a personal area network (PAN), and / or a combination of communication networks such as the Internet. The network 130 can be a wired or wireless network. In one example, the network 130 can be an in-vehicle network, an inter-vehicle network, and / or a vehicle-mounted mobile Internet.

[0035] Figure 2 is a flowchart illustrating a method 200 for a vehicle cabin according to an example embodiment. The method 200 can be performed at an in-vehicle system (e.g., the in-vehicle system 110 shown in FIG. 1), i.e., the subject performing each step of the method 200 can be the in-vehicle system 110. Figure 1 Figure 1 ​the in-vehicle system 110 shown in FIG. 1. In some embodiments, the method 200 can be performed at a server (e.g., the server 120 shown in FIG. 1). In some embodiments, the method 200 can be performed by the in-vehicle system (e.g., the in-vehicle system 110) and the server (e.g., the server 120) in combination. In the following, the steps of the method 200 are described in detail with the in-vehicle system 110 as the performing subject. Figure 1

[0036] Referring to Figure 2 , the method 200 is a method for a vehicle cabin, which includes a plurality of display screens arranged for different seats and a plurality of interaction devices associated with the plurality of display screens, each display screen being associated with a respective subset of the plurality of interaction devices. The display screens can be arranged at different positions within the vehicle cabin, such as positions in front of the driver, in front of the front passenger, behind the headrest of the front seats, inside the front and rear doors, etc. Figure 3 is a schematic block diagram illustrating a plurality of interaction devices associated with a display screen 300 according to an exemplary embodiment. Referring to Figure 3 The example interaction devices associated with the display screen 300 can include a speaker 302, a camera 304, a microphone 306, a fingerprint sensor 308, a blood pressure sensor 310, a heart rate sensor 312, etc. The display screen 300 is associated with the above-mentioned interaction devices 302-312, and they are arranged for a certain cabin seat to be dedicated to the user on the seat. In the case of a video call as the application scenario, the interaction devices required to implement the video call function can be, for example, the speaker 302, the camera 304, and the microphone 306; in the case of monitoring the health status of the passengers in the vehicle as the application scenario, the interaction devices required to implement the health monitoring function can be, for example, the blood pressure sensor 310 and the heart rate sensor 312.

[0037] Continuing to refer to Figure 2 ​At step 210, an interaction instruction for a first display screen of the plurality of display screens is detected via an in-vehicle sensor. The first display screen is displaying a user graphical interface of a first application that is currently running, and the interaction instruction indicates that the user graphical interface is to be transferred from the first display screen to at least one second display screen of the plurality of display screens. The user graphical interface can be, for example, a voice call interface when a voice call function is in progress, a video call interface when a video call function is in progress, or a health detection interface when a health status of an occupant in the vehicle is being monitored. It should be noted that the transfer of the user graphical interface can occur between two different display screens, i.e., from the first display screen to at least one second display screen that is different from the first display screen (e.g., from a display screen in front of the driver to a display screen inside the rear door), or within one display screen, i.e., from one location to another location of one display screen (e.g., from the driver side of a front row integrated center large screen to the co-driver side). Thus, the term “display screen” as used herein can refer to different display areas of the same display.

[0038] Referring back to Figure 2 At step 220, in response to detecting the interaction instruction, the interaction devices required for running the first application by the at least one second display screen and a subset of the plurality of interaction devices associated with the at least one second display screen are determined.

[0039] Figure 4 is a flowchart illustrating a method 400 of determining the at least one second display screen, in which the interaction instruction can be initiated by a gesture action of the user, such as a touch gesture, a hovering gesture, etc., and the interaction instruction includes information indicative of a direction and an acceleration of the gesture action. In embodiments in which the interaction instruction is a touch gesture, the direction in which the user’s finger slides on the display screen and the acceleration of the finger sliding can be detected by sensors within the display screen. In embodiments in which the interaction instruction is a hovering gesture, the direction in which the user’s hand moves in space and the acceleration of the hand moving can be detected by sensors arranged in the vehicle, such as a camera.

[0040] The method 400 includes step 410 of maintaining a plurality of nodes in a ring-shaped undirected graph, the plurality of nodes respectively corresponding to the plurality of display screens, and the adjacency relationship of the plurality of nodes in the ring-shaped undirected graph representing the relative positional relationship of the plurality of display screens in the vehicle cabin.

[0041] The following refers to Figure 5 The ring-shaped undirected graph and the correspondence relationship of the plurality of display screens are introduced. Figure 5A schematic diagram of a spatial layout 500 of multiple display screens 502-512 in a vehicle cabin 514 is shown. The display screen 506 is in front of the driver, the display screen 508 is in front of the co-driver, the display screens 502 and 504 are on the left side of the vehicle cabin, and the display screens 510 and 512 are on the right side of the vehicle cabin. It should be understood that the schematic diagram of the spatial layout 500 is only illustrative, and in actual application scenarios, the number and layout of the display screens can be varied. Figure 5 A schematic diagram of a circular undirected graph 520 corresponding to the spatial layout 500 of multiple display screens 502-512 in the vehicle cabin 514 is also shown. The circular undirected graph 520 includes multiple nodes 522-532, the number of which is the same as the number of the multiple display screens 502-512 in the vehicle cabin 514, and the nodes correspond to each other in spatial positions, i.e., the node 522 corresponds to the display screen 502, the node 524 corresponds to the display screen 504, and so on, and the node 532 corresponds to the display screen 512. Therefore, the adjacency relationship of the multiple nodes 522-532 in the circular undirected graph 520 represents the relative positional relationship of the multiple display screens 502-512 in the vehicle cabin 514.

[0042] Step 420, routing a loop distance from a first node corresponding to a first display screen in the circular undirected graph in a loop direction corresponding to a direction of a gesture action, the loop distance being proportional to an acceleration of the gesture action. Referring to Figure 5 In some embodiments, the first display screen can be the display screen 506. When the gesture action is a touch gesture, the user can slide a finger left or right on the display screen 506, and correspondingly, the routing endpoint in the circular undirected graph 520 will move counterclockwise or clockwise from the node 526 as the first node. The distance of the movement is proportional to the acceleration of the finger sliding, which can be personalized according to the habit of the customer. When the gesture action is a hovering gesture, the user can slide a hand left or right in space, and correspondingly, the routing endpoint in the circular undirected graph 520 will move counterclockwise or clockwise from the node 526 as the first node. The distance of the movement is proportional to the acceleration of the hand movement in space, which can be personalized according to the habit of the customer. It should be noted that in other embodiments, the first display screen can be any one of the display screens other than the display screen 506, but the above operations are equally applicable.

[0043] Step 430, determining a display screen corresponding to the node as the routing endpoint in the multiple display screens as a second display screen.

[0044] Through the above embodiments, the user can conveniently and concisely select other display screens in the vehicle cabin by gesture actions, and can select other display screens at different distances by controlling the acceleration of the gesture actions.

[0045] Figure 6 is a flow chart illustrating a method 600 of determining at least one second display screen according to an example embodiment. In the method 600, the interaction instruction can be initiated by a gesture action of a user, such as a touch gesture, a hovering gesture, etc., and the interaction instruction includes information indicating a number of fingers used by the gesture action.

[0046] With reference to Figure 6 , the method 600 includes: at step 610, in response to determining that the gesture action uses a plurality of fingers, causing the first display screen to display a target selection interface for selecting target display screens to which a user graphical interface of the first application is to be transferred. In some embodiments, the number of fingers used to make the gesture action can indicate the number of target display screens. For example, in some examples, using 1 finger indicates that the number of target display screens is 1; in other examples, using 2 fingers indicates that the number of target display screens is 2; in yet other examples, using 3 fingers indicates that the number of target display screens is 3. In actual applications, the above indication relationship can be personalized configured according to the user's usage habits. In some embodiments, the user uses 3 fingers to perform a selection operation, first performs a first sliding operation (e.g., 3 fingers are collectively slid to the right by a small distance), thereby entering the target selection interface to perform a target display screen starting phase, at this time, the icons of 3 display screens in the clockwise direction in the display screen loop are highlighted on the target selection interface, and the remaining display screens can be displayed in grayscale; in the target display screen selection phase, 3 target display screens are selected through a second sliding operation (e.g., zooming the distance between the 3 fingers), the selected display screens are highlighted in the target selection interface, and the unselected display screens are displayed in grayscale in the target selection interface; if a third sliding operation (e.g., 3 fingers leaving the display screen) is detected, the target display screen confirmation phase is entered, and the 3 selected target display screens are locked in the target selection interface. It should be noted that in other embodiments, the user can use other numbers of fingers to operate, but the above operations are also applicable.

[0047] At step 620, detecting a user selection operation on the target display screen via a vehicle-mounted sensor.

[0048] At step 630, in response to detecting the user selection operation on the plurality of target display screens, determining the plurality of target display screens as a plurality of second display screens.

[0049] Through the above embodiments, the user can select different numbers of target display screens for content sharing by using different numbers of fingers when adopting gesture actions, thereby realizing multi-screen sharing from one display screen to multiple display screens.

[0050] Then, in response to determining that at least one second display screen has been determined, a visual cue and / or a voice cue is triggered to prompt the user that the graphical interface is to be transferred from the first display screen to the at least one second display screen. In some embodiments, a visual cue can be used, which can be a text display at the first display screen of the name of the at least one second display screen that is selected. In other embodiments, virtual icons of all display screens can be displayed at the first display screen, and the icon of the at least one second display screen that is selected can be highlighted. In yet other embodiments, virtual icons of all display screens can be displayed at the first display screen, and the icon of the at least one second display screen that is selected can be made to blink a number of times within a certain time to indicate that it has been selected. In still other embodiments, a voice cue can be used, which can be activating a virtual voice assistant at the first display screen, such that the name of the at least one second display screen that is selected is voice broadcasted.

[0051] Figure 7 is a flowchart illustrating a method 700 of determining a required interaction device according to an example embodiment, the method 700 being used to determine a required interaction device for running a first application in a subset of a plurality of interaction devices associated with at least one second display screen, the method 700 comprising a step 710 of determining a category of an interaction device being used by a first application being displayed and running on the first display screen, and comprising a step 720 of selecting an interaction device having the determined category from the subset of the plurality of interaction devices associated with the at least one second display screen as the required interaction device.

[0052] Figure 8 is a schematic diagram illustrating a method of determining a required interaction device according to an example embodiment. The following refers to Figure 8 The method 700 is introduced in connection with specific embodiments.

[0053] In some embodiments, the driver wants to transfer an incoming call to the co-pilot for voice call, where the first display screen 820 is the display screen in front of the driver and the second display screen 840 is the display screen in front of the co-pilot. The first application is a voice call application program, and for the driver, the interface of the voice call application program is originally required to be displayed on the first display screen 820 and the speaker 802 and the microphone 806 associated with the first display screen 820 are required to be used. However, based on the interaction instruction 850 issued by the driver, the interface of the voice call application program is to be displayed on the second display screen 840, and the speaker 822 and the microphone 826 associated with the second display screen 840 are to be enabled. It should be understood that in other embodiments, the transfer of the voice call function described above can be initiated by any person in the cabin to transfer to another person in the cabin, or can also be initiated by any person in the cabin to transfer to several persons in the cabin.

[0054] In other embodiments, the driver wants to transfer an incoming call to the front passenger for a video call, where the first display screen 820 is the display screen in front of the driver and the second display screen 840 is the display screen in front of the front passenger. The first application is a video call application, which would normally display its interface on the first display screen 820 and use the speaker 802, microphone 806, and camera 804 associated with the first display screen 820 for the driver. However, based on the interaction instruction 850 issued by the driver, the interface of the video call application will be displayed on the second display screen 840 and the speaker 822, microphone 826, and camera 824 associated with the second display screen 840 will be enabled. It should be understood that in other embodiments, the transfer of the above-mentioned video call function can be initiated by any person in the cabin to transfer to another person in the cabin, or can also be initiated by any person in the cabin to transfer to several persons in the cabin.

[0055] In yet other embodiments, the driver wants to monitor the health status of the passengers in the vehicle, where the first display screen 820 is the display screen in front of the driver and the second display screen 840 can be the display screen behind the headrest of the front seat. The first application is a health monitoring application, based on the interaction instruction 850 issued by the driver, the health monitoring application interface originally displayed on the first display screen 820 is transferred to the second display screen 840, at the same time, because the heart rate sensor 812, blood pressure sensor 810, and fingerprint sensor 808 (for privacy protection) associated with the first display screen 820 are determined to be the required interaction devices, therefore the heart rate sensor 832, blood pressure sensor 830, and fingerprint sensor 828 (for privacy protection) associated with the second display screen 840 will be enabled. It should be understood that in other embodiments, the transfer of the above-mentioned function of monitoring the health status of the passengers in the vehicle can be initiated by any person in the cabin to transfer to another person in the cabin, or can also be initiated by any person in the cabin to transfer to several persons in the cabin.

[0056] With continued reference to Figure 2At step 230, after enabling the determined interaction devices so that the user graphical interface is transferred from the first display screen to the at least one second display screen, the full functionality of the currently running first application is available to the user in the seat corresponding to the at least one second display screen. As shown in the above-described embodiments, the interface of the first application (e.g., a voice call application, a video call application, a health monitoring application) displayed on the first display screen can be transferred from the first display screen to the at least one second display screen (e.g., a transfer between the primary driver and the secondary driver, a transfer from the primary driver to the secondary driver and the rear passengers, etc.), or from one location of one display screen to another location of another display screen (e.g., a transfer from the driver side of the front integrated center large screen to the secondary driver side), while the interaction devices required for running the first application associated with the at least one second display screen are also enabled. Thus, the functionality of the voice call application, the video call application, the health monitoring application, etc. for the driver can be fully transferred to and implemented by one or more other persons in the vehicle. It should be understood that the voice call application, the video call application, the health monitoring application, etc. can also be initiated by any person in the cabin to be transferred to another person or persons in the cabin.

[0057] According to embodiments of the present disclosure, the transfer of the user graphical interface of an application program between different display screens can be implemented while the interaction devices associated with the application program are also transferred, thus enabling the application program to be fully transferred among passengers in the vehicle and facilitating the user to obtain a full application program experience. It will be understood that while in the above-described embodiments the user graphical interface of the application program is no longer displayed on the first display screen after being transferred to the second display screen, other embodiments are possible. For example, in some embodiments, the user graphical interface of the application program can continue to be displayed on the first display screen. In other words, the term "transfer" as used herein is intended to encompass both moving and sharing.

[0058] While various operations are depicted as occurring in a particular order, this is not intended to require that the operations occur in the particular order shown or in sequential order, nor that all operations be performed, to achieve desirable results.

[0059] According to another aspect of the present disclosure, an apparatus for a vehicle cabin is provided. Figure 9 is a block diagram illustrating an apparatus 900 for a vehicle cabin according to an exemplary embodiment, wherein the vehicle cabin includes a plurality of display screens arranged for different seats and a plurality of interaction devices associated with the plurality of display screens, each display screen being associated with a respective subset of the plurality of interaction devices. Referring to Figure 9 The apparatus 900 includes a first module 910, a second module 920, and a third module 930.

[0060] The first module 910 is configured to detect, via an in-vehicle sensor, an interaction instruction for a first display screen of a plurality of display screens. The first display screen is displaying a user graphical interface of a first application that is currently running, and the interaction instruction indicates a transfer of the user graphical interface from the first display screen to at least one second display screen of the plurality of display screens.

[0061] The second module 920 is configured to determine, in response to detecting the interaction instruction, interaction devices required for running the first application in at least one second display screen and a subset of the plurality of interaction devices associated with the at least one second display screen.

[0062] The third module 930 is configured to enable the determined interaction devices such that, after the transfer of the user graphical interface from the first display screen to the at least one second display screen, full functionality of the first application that is currently running is available to a user in a seat corresponding to the at least one second display screen.

[0063] It should be appreciated that Figure 9 The various modules of the apparatus 900 shown in FIG. 9 can correspond to the various steps in the method 200 described with reference to Figure 2 The operations, features, and advantages described above for the method 200 apply equally to the apparatus 900 and its included modules, and for the sake of brevity, certain operations, features, and advantages are not described again here.

[0064] While specific functionality is discussed above with reference to particular modules, it should be noted that the functionality of the various modules discussed herein can be split among multiple modules and / or at least some functionality of multiple modules can be combined into a single module. A particular module discussed herein performing an action includes that particular module itself performing the action, or alternatively, that particular module invoking or otherwise accessing another component or module to perform the action (or to otherwise induce the performance of the action by another component or module). Thus, a particular module performing an action includes that particular module itself performing the action and / or another module invoked or otherwise accessed by that particular module performing the action. For example, the second module 920 and the third module 930 can be combined into a single module in some embodiments.

[0065] It should also be appreciated that various technologies can be described herein in the general context of software, hardware elements, or program modules. The terms "software" and "hardware" encompass any program modules, program applications, routines, processes, programs, objects, components, data structures, etc. that execute methods, create other Figure 9The various modules described can be implemented in hardware or in hardware combined with software and / or firmware. For example, the modules can be implemented as computer program code / instructions configured to execute in one or more processors and stored in a computer-readable storage medium. Alternatively, the modules can be implemented as hardware logic / circuitry. For example, in some embodiments, one or more of the first module 910, the second module 920, and the third module 930 can be implemented together in a System on Chip (SoC). The SoC can include an integrated circuit chip (which includes one or more of a processor (e.g., a Central Processing Unit (CPU), a microcontroller, a microprocessor, a Digital Signal Processor (DSP), etc.), memory, one or more communication interfaces, and / or other circuitry) and can optionally execute received program code and / or include embedded firmware to perform functions.

[0066] According to another aspect of the disclosure, there is provided a vehicle interactive system comprising a vehicle interactive system and at least one memory having stored thereon a computer program. The computer program, which when executed by a processor configured to cause the processor to perform the steps of any of the method embodiments described above.

[0067] According to yet another aspect of the disclosure, there is provided a vehicle comprising an apparatus or a vehicle interactive system as described above.

[0068] According to still another aspect of the disclosure, there is provided a non-transitory computer-readable storage medium having stored thereon a computer program, which when executed by a processor, causes the processor to perform the steps of any of the method embodiments described above.

[0069] According to still another aspect of the disclosure, there is provided a computer program product comprising a computer program, which when executed by a processor, causes the processor to perform the steps of any of the method embodiments described above.

[0070] In the following, reference will be made to Figure 10 Illustrative examples of such vehicle interactive systems, non-transitory computer- readable storage media, and computer program products are described.

[0071] Figure 10 An example configuration of a vehicle interactive system 1000 that can be used to implement the methods described herein is shown. By way of example, Figure 1 The server 120 and / or the vehicle system 110 shown in FIG. 1 can comprise an architecture similar to the vehicle interactive system 1000. The methods described above can be implemented, in whole or at least in part, by the vehicle interactive system 1000 or a similar device or system.

[0072] The in-vehicle interaction system 1000 can include at least one processor 1002, memory 1004, communication interface(s) 1006, display device 1008, other input / output (I / O) devices 1010, and one or more mass storage devices 1012, which can communicate with each other, such as by a system bus 1014 or other appropriate connection.

[0073] The processor 1002 can be a single processing unit or a plurality of processing units, all of which can include single or multiple computing units or multiple cores. The processor 1002 can be implemented as one or more microprocessors, microcomputers, microcontrollers, digital signal processors, central processing units, state machines, logic circuitries, and / or any devices that manipulate signals based on operational instructions. Among other capabilities, the processor 1002 can be configured to fetch and execute computer-readable instructions stored in the memory 1004, the mass storage device 1012, or any other computer-readable medium, such as program code for an operating system 1016, program code for applications 1018, program code for other programs 1020, and the like.

[0074] The memory 1004 and the mass storage device 1012 are examples of computer-readable storage media for storing instructions which are executed by the processor 1002 to implement the various functions described above. By way of example, the memory 1004 can generally include both volatile memory and non-volatile memory (e.g., RAM, ROM, etc.). In addition, the mass storage device 1012 can generally include hard disk drives, solid state drives, removable media, including external and removable drives, memory cards, flash memory, floppy disks, optical disks (e.g., CD or DVD), storage arrays, network attached storage, storage area networks, and the like. The memory 1004 and the mass storage device 1012 can both be collectively referred to herein as the memory or computer-readable storage media, and can be non-transitory media capable of storing computer-readable, processor-executable program instructions as computer program code that can be executed by the processor 1002 as a particular machine configured to implement the operations and functions described in the examples herein.

[0075] A number of programs can be stored on the mass storage device 1012. These programs include an operating system 1016, one or more application programs 1018, other programs 1020, and program data 1022, and they can be loaded into the memory 1004 for execution. Examples of such application programs or program modules can include, for example, computer program logic (e.g., computer program code or instructions) for implementing the methods 200, 400, 600, 700 (including any suitable steps of the methods 200, 400, 600, 700), and / or additional embodiments described herein.

[0076] Although illustrated in Figure 10 the memory 1004 of the in-vehicle interaction system 1000, the modules 1016, 1018, 1020, and 1022, or portions thereof, can be implemented using any form of computer-readable media accessible by the in-vehicle interaction system 1000. As used herein, "computer-readable media" includes both computer-readable storage media and communication media.

[0077] Computer-readable storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer-readable storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information for access by the in-vehicle interaction system. In contrast, communication media can embody computer-readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism. As defined herein, computer-readable storage media does not include communication media.

[0078] One or more communication interfaces 1006 are used to exchange data with other devices, such as over a network, direct connection, or the like. Such communication interfaces can be one or more of: any type of network interface (e.g., network interface card (NIC)), wired or wireless (such as IEEE 802.11 wireless LAN (WLAN)) wireless interface, Worldwide Interoperability Microwave Access (Wi-MAX) interface, Ethernet interface, Universal Serial Bus (USB) interface, cellular network interface, Bluetooth TMThe communication interface 1006 can facilitate communications within a variety of network and protocol types, including wired networks (e.g., LAN, cable, etc.) and wireless networks (e.g., WLAN, cellular, satellite, etc.), the Internet, etc. The communication interface 1006 can also provide communications with external storage devices (not shown) such as storage arrays, network attached storage, storage area networks, etc.

[0079] In some examples, a display device 1008 such as a monitor can be included for displaying information and images to a user. Other I / O devices 1010 can be devices that receive various inputs from a user and provide various outputs to the user, and can include touch input devices, gesture input devices, cameras, keyboards, remote controls, mice, printers, audio input / output devices (speakers, microphones, etc.), sensors (fingerprint sensors, blood pressure sensors, heart rate sensors, etc.), etc.

[0080] The technology described herein can be supported by these various configurations of the in-vehicle interaction system 1000 and is not limited to the specific examples described herein. For example, the functionality can also be implemented all or in part through use of a distributed system, which supports a "cloud" architecture. The cloud includes and / or is represented by the platform for resources. The platform abstracts underlying functionality of the hardware (e.g., servers) and software resources of the cloud. Resources can include applications and / or data that can be utilized while computer processing is executed on servers that are remote from the in-vehicle interaction system 1000. Resources can also include services provided over the Internet and / or a subscriber network, such as a cellular or Wi-Fi network. The platform can abstract resources and functionality to connect the in-vehicle interaction system 1000 with other in-vehicle interaction systems. Accordingly, the implementation of functionality described herein can be distributed throughout the cloud. For example, functionality can be implemented in part on the in-vehicle interaction system 1000 and in part by the platform that abstracts the functionality of the cloud.

[0081] Figure 11 is a block diagram illustrating a vehicle 1100, in accordance with example embodiments. Referring to Figure 11 The vehicle 1100 includes an in-vehicle interaction system 1110 or a device 1120 for a vehicle cabin. The in-vehicle interaction system 1110 can take the form of the in-vehicle interaction system 1000, and the device 1120 can take the form of the device 900 and detailed descriptions thereof are omitted herein for brevity.

[0082] While the disclosure has been illustrated and described in detail in the drawings and foregoing description, such illustration and description is to be considered illustrative or exemplary only; the disclosure is not limited to the disclosed embodiments. Variations that do not depart from the scope of the claimed subject matter are within the scope of the present disclosure. In the claims, the word "comprising" does not exclude other elements or steps, the word "a" or "an" does not exclude a plurality, the term "based on" means "based, at least in part, on" and "means for" can be interpreted as "means for at least one". The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

[0083] Some example aspects of the present disclosure will be described below.

[0084] Aspect 1, a method for a vehicle cabin, the vehicle cabin comprising a plurality of display screens for different seating arrangements and a plurality of interaction devices associated with the plurality of display screens, each display screen being associated with a respective subset of the plurality of interaction devices, the method comprising:

[0085] detecting, via an in-vehicle sensor, an interaction instruction for a first display screen of the plurality of display screens, wherein the first display screen is displaying a user graphical interface of a first application currently running, the interaction instruction indicating a transfer of the user graphical interface from the first display screen to at least one second display screen of the plurality of display screens;

[0086] in response to detecting the interaction instruction, determining the at least one second display screen and interaction devices of the subset of the plurality of interaction devices associated with the at least one second display screen that are required to run the first application; and

[0087] enabling the determined interaction devices such that, after the transfer of the user graphical interface from the first display screen to the at least one second display screen, full functionality of the first application currently running is available to a user on a seat corresponding to the at least one second display screen.

[0088] Aspect 2, the method of aspect 1, wherein the interaction instruction is issued by a gesture action, and the interaction instruction comprises information indicative of a direction and acceleration of the gesture action, and wherein determining the at least one second display screen comprises:

[0089] maintaining a plurality of nodes in a ring-shaped undirected graph, the plurality of nodes respectively corresponding to the plurality of display screens, and adjacency relations of the plurality of nodes in the ring-shaped undirected graph representing relative positional relations of the plurality of display screens within the vehicle cabin;

[0090] routing a loop distance from a first node corresponding to the first display screen in the annular undirected graph along a loop direction corresponding to a direction of the gesture action, the loop distance being proportional to an acceleration of the gesture action; and

[0091] determining a display screen corresponding to a node that is a routing end point among the plurality of display screens as the second display screen.

[0092] Aspect 3, the method of aspect 1, wherein the interaction instruction is issued by a gesture action, and the interaction instruction includes information indicative of a number of fingers used by the gesture action, and wherein determining the at least one second display screen comprises:

[0093] in response to determining that the gesture action uses multiple fingers, causing the first display screen to display a target selection interface for selecting a target display screen to which a user graphical interface of the first application is to be transferred;

[0094] detecting, via an in-vehicle sensor, a user selection operation for a target display screen; and

[0095] in response to detecting a user selection operation for multiple target display screens, determining the multiple target display screens as multiple second display screens.

[0096] Aspect 4, the method of aspect 1, wherein determining the interaction devices required for running the first application in the subset of the plurality of interaction devices associated with the at least one second display screen comprises:

[0097] determining a category of interaction devices that the first application is currently using; and

[0098] selecting, as the required interaction devices, interaction devices having the determined category from the subset of the plurality of interaction devices associated with the at least one second display screen.

[0099] Aspect 5, the method of aspect 4, wherein the first application comprises a video call application, and the required interaction devices comprise a camera and a microphone associated with the at least one second display screen.

[0100] Aspect 6, the method of any of aspects 1-5, further comprising:

[0101] in response to determining that the at least one second display screen has been determined, triggering a visual prompt and / or a voice prompt to prompt that the user graphical interface is to be transferred from the first display screen to the at least one second display screen.

[0102] Aspect 7. An apparatus for a vehicle cabin, the vehicle cabin comprising a plurality of display screens for different seating arrangements and a plurality of interaction devices associated with the plurality of display screens, each display screen being associated with a respective subset of the plurality of interaction devices, the apparatus comprising:

[0103] a first module configured to detect, via an in-vehicle sensor, an interaction instruction for a first display screen of the plurality of display screens, wherein the first display screen is displaying a user graphical interface of a first application currently running, the interaction instruction indicating a transfer of the user graphical interface from the first display screen to at least one second display screen of the plurality of display screens;

[0104] a second module configured to, in response to detecting the interaction instruction, determine the at least one second display screen and interaction devices of the subset of the plurality of interaction devices associated with the at least one second display screen that are required to run the first application; and

[0105] a third module configured to enable the determined interaction devices such that, after the transfer of the user graphical interface from the first display screen to the at least one second display screen, full functionality of the first application currently running is available to a user on a seat corresponding to the at least one second display screen.

[0106] Aspect 8. An in-vehicle interaction system comprising:

[0107] at least one processor; and

[0108] at least one memory having stored thereon a computer program which, when executed by the at least one processor, causes the at least one processor to implement the method of any one of aspects 1-6.

[0109] Aspect 9. A vehicle comprising the apparatus of aspect 7 or the in-vehicle interaction system of aspect 8.

[0110] Aspect 10. A non-transitory computer-readable storage medium storing a computer program, the computer program comprising instructions which, when executed by a processor, cause the processor to perform the method of any one of aspects 1-6.

[0111] Aspect 11. A computer program product comprising instructions which, when executed by a processor, cause the processor to perform the method of any one of aspects 1-6.

Claims

1. A method for a vehicle cockpit, the vehicle cockpit including a plurality of displays for different seating arrangements and a plurality of interactive devices associated with the plurality of displays, each display being associated with a corresponding subset of the plurality of interactive devices, the method comprising: The interaction command is detected by an onboard sensor for a first display screen among the plurality of displays. The interaction command is issued by a gesture and includes information indicating the direction and acceleration of the gesture. The first display screen is displaying a user graphical interface of a currently running first application. The interaction command instructs the user graphical interface to be transferred from the first display screen to at least one second display screen among the plurality of displays. In response to detecting the interaction command, determine the interaction devices required to run the first application from a subset of the at least one second display screen and the plurality of interaction devices associated with the at least one second display screen, wherein determining the at least one second display screen includes: Multiple nodes are maintained in the ring-shaped undirected graph, each node corresponding to a multiple display screen, and the adjacency relationship of the multiple nodes in the ring-shaped undirected graph represents the relative positional relationship of the multiple display screens in the vehicle cabin; In the undirected annular graph, a loop distance is routed from the first node corresponding to the first display screen along a loop direction corresponding to the direction of the gesture, the loop distance being proportional to the acceleration of the gesture; and The display screen corresponding to the node that serves as the route endpoint among the plurality of display screens is designated as the second display screen; and Once the determined interactive device is activated, such that after the user graphical interface is transferred from the first display screen to the at least one second display screen, the full functionality of the currently running first application becomes available to the user in the seat corresponding to the at least one second display screen.

2. The method as described in claim 1, wherein, The interaction command includes information indicating the number of fingers used in the gesture, and wherein determining the at least one second display screen includes: In response to determining that the gesture action uses multiple fingers, the first display screen displays a target selection interface, which is used to select the target display screen to which the user graphical interface of the first application is to be transferred. User selection actions on the target display screen are detected via onboard sensors; and In response to detecting a user selection operation for multiple target displays, the multiple target displays are determined as multiple second displays.

3. The method as described in claim 1, wherein, Determining the subset of the plurality of interactive devices associated with the at least one second display screen that require the interactive devices to run the first application includes: Determine the category of the interactive device currently being used by the first application; and Select an interactive device having a defined category from a subset of the plurality of interactive devices associated with the at least one second display screen as the desired interactive device.

4. The method of claim 3, wherein, The first application includes a video calling application, and the required interactive devices include a camera and microphone associated with the at least one second display screen.

5. The method according to any one of claims 1 to 4, further comprising: In response to determining that the at least one second display screen has been identified, a visual cue and / or a voice cue are triggered to prompt the user graphical interface to switch from the first display screen to the at least one second display screen.

6. An apparatus for a vehicle cockpit, the vehicle cockpit including a plurality of displays for different seating arrangements and a plurality of interactive devices associated with the plurality of displays, each display being associated with a corresponding subset of the plurality of interactive devices, the apparatus comprising: The first module is configured to detect an interaction command for a first display screen among the plurality of displays via an onboard sensor. The interaction command is issued by a gesture and includes information indicating the direction and acceleration of the gesture. The first display screen is displaying a user graphical interface of a currently running first application. The interaction command instructs the user graphical interface to be transferred from the first display screen to at least one second display screen among the plurality of displays. The second module is configured to, in response to detecting the interaction instruction, determine the interaction devices required to run the first application from a subset of the at least one second display screen and the plurality of interaction devices associated with the at least one second display screen, wherein determining the at least one second display screen includes: Multiple nodes are maintained in the ring-shaped undirected graph, each node corresponding to a multiple display screen, and the adjacency relationship of the multiple nodes in the ring-shaped undirected graph represents the relative positional relationship of the multiple display screens in the vehicle cabin; In the undirected annular graph, a loop distance is routed from the first node corresponding to the first display screen along a loop direction corresponding to the direction of the gesture, the loop distance being proportional to the acceleration of the gesture; and The display screen corresponding to the node that serves as the route endpoint among the plurality of display screens is designated as the second display screen; and The third module is configured to enable the determined interactive device such that, after the user graphical interface is transferred from the first display screen to the at least one second display screen, the full functionality of the currently running first application is available to the user in the seat corresponding to the at least one second display screen.

7. An in-vehicle interactive system, comprising: At least one processor; as well as At least one memory having a computer program stored thereon, which, when executed by the at least one processor, causes the at least one processor to implement the method as described in any one of claims 1-5.

8. A vehicle comprising the device as claimed in claim 6 or the in-vehicle interactive system as claimed in claim 7.

9. A non-transitory computer-readable storage medium storing a computer program, the computer program comprising instructions that, when executed by a processor, cause the processor to perform the method as described in any one of claims 1-5.

10. A computer program product comprising instructions that, when executed by a processor, cause the processor to perform the method as described in any one of claims 1-5.

Images