Method of configuring extended display via at least two screens

Abstract

Method for configuring an extended display via at least two screens placed in relative physical positions relative to a user and respectively displaying two portions of content, characterized in that it implements the following autonomously, at the level of a configuration module: - receive (E201) from a terminal (T), a request for configuring an extended display of the at least two screens, - receive (E202) information relating to the context of use of the screens, from said at least one capture module and / or from the terminal (T), - determine (E203) said relative physical positions from the information relating to the context of use, - determine (E204), for the at least two screens, their corresponding relative virtual position, from said relative physical positions, allowing the terminal (T) to associate with said at least two screens, their corresponding portion of content,- send (E205) to the terminal (T) the relative virtual positions. Figure for the abstract: Figure 2,

Description

Title of the invention: Method for configuring an extended display via at least two screens

[0001] Field of the invention

[0002] This invention relates to the field of computing and uses involving the use of several screens in extended mode.

[0003] More specifically, the invention relates to the simplification of the configuration of displaying content on several screens in extended mode implementing an identification of the relative physical position of the screens with respect to their user. Prior art

[0004] The democratization of laptops within companies, teleworking logic, so-called "flex office" organizations, have contributed to a multiplication of workstation configurations.

[0005] Depending on the profiles and circumstances, users can alternate between working on their mobile computer only or in configurations implementing one or more additional screens or even presentation moments involving their laptop associated with an additional shared screen, for example a large television or a video projector coupled with a projection screen.

[0006] “Multi-screen” displays have several types of configurations such as: - duplication of displays where each screen displays the same content, - exclusive display where only one of the screens displays content and the others, although connected, display nothing, - extended display where the content to be displayed is spread across several screens, each of which then displays a portion of the content.

[0007] The term "content portion" refers to the set of pixels displayed by each screen in the context of the extended display. These portions each correspond to a specific part of the overall content to be displayed.

[0008] For example, in the context of a display extended horizontally across two screens, we will speak of a portion of content on the right and a portion of content on the left. In the context of a display extended in height and width across 4 screens in total (one screen at the top left, one screen at the top right, one screen at the bottom left, one screen at the bottom right), we will speak of a portion of content, top / left, top / right, bottom / left, bottom / right.

[0009] The advantage of the extended display is to allow the user to have a larger display area and an extension of the general content (via a larger large number of pixels displayed). However, such a display requires a configuration step consisting of associating each screen with a specific portion of content based on the physical arrangement of the screens placed in front of the user.

[0010] By convention, the extended display is configured so as to match the physical layout of the screens to the virtual layout of the displayed portions of content. For example, by having the screen placed to the left of the user display the left portion of the content and the screen placed to the right of the user display the right portion, the center screen display the central portion of the content, etc. This is referred to as a "completed", "finalized" or "correct" extended display configuration.

[0011] A common problem when connecting a new screen in extended mode therefore concerns the configuration of the relative virtual position of the screens, i.e. the configuration parameter which associates a screen with a given portion of content. Indeed, the terminal displaying this portion does not have the capacity to know a priori the physical position of the screens relative to the user. As a result, the virtual position of the screens is not always consistent with their physical position.

[0012] By convention, we call the physical position of a screen relative to the user and other screens "relative physical position" (or PPR), and "relative virtual position" (or PVR) refers to the position of the screens as specified / configured in the terminal displaying the content in extended mode.

[0013] Relative virtual positions follow a particular format. For example, some graphics cards / terminals only allow screens to be configured in a limited number of positions on a horizontal axis, whereas other configurations allow screens to be placed in limited positions within a matrix consisting of a horizontal axis and a vertical axis. Generally, the format of relative virtual positions tends to be an approximation of relative physical positions.

[0014] The relative virtual position of the screens can be modified in the computer's display settings, and is generally saved for future connections to the same screens. However, when a user is traveling, going to a new meeting room, or settling into a new workstation / desk, all situations that are destined to be increasingly frequent in a context of democratization of so-called "flex office" situations, the configuration of the relative virtual position will be "random" each time, which means that the user has to manually and frequently configure the display of his computer. This situation can prove time-consuming for the user, even tedious, when the user does not master or is not sufficiently familiar with the terminal's display configuration settings.

[0015] Another limitation of existing extended display configurations concerns their lack of flexibility and responsiveness in contexts where the user and / or some screens are mobile and, consequently, the relative physical position of the screens changes during use. Such a situation arises for example when, in the case of a conference or a presentation, a user uses a portable terminal while moving from left to right or from right to left of a fixed screen.

[0016] In such configurations, unless the parameters of the extended display are updated each time the user moves, the extended display will alternate between times when the relative physical position of the screens and their relative virtual position correspond and then times when they are reversed.

[0017] Object and summary of the invention

[0018] One of the aims of the invention is to remedy the drawbacks highlighted by the aforementioned state of the art by proposing a method making it possible to configure autonomously and without user intervention, the relative virtual position of the screens in a context of extended display of content.

[0019] To this end, an object of the present invention relates to a method for configuring an extended display via at least two screens placed in relative physical positions, with respect to a user and respectively displaying two portions of content, characterized in that it implements the following autonomously, at the level of a configuration module: - receive from a terminal a request for configuration of extended display of at least two screens, - receive information relating to the context of use of the screens, from at least one capture module and / or the terminal, - determine said relative physical positions from information relating to the context of use, - determine, for the at least two screens, their corresponding relative virtual position, from said relative physical positions, allowing the terminal to associate with said at least two screens, their corresponding portion of content, - send the relative virtual positions to the terminal.

[0020] The invention offers the technical advantage of configuring an extended display on at least two screens autonomously. Unlike what is presented in the state of the art, the user is not asked to make these adjustments. The invention offers the advantage of allowing users with little or no mastery of computer tools to benefit from the advantages of the extended display without needing to know the display parameters. This invention is applicable in any work context requiring an extended display, such as the flex office, situations where the user is mobile, etc.

[0021] The details of the actions implemented within the method may vary depending on the embodiments. According to a particular embodiment, the extended display configuration method comprises the following: - the reception of information relating to the context of use includes: — a capture of the user's gaze, — the portions of content on which the user interacts, - the determination of the relative physical positions of the at least two screens includes: — an identification from the user's gaze of as many axes of fixation of the user's gaze as there are screens, — an association of said axes of fixation of the user's gaze to the screens, according to the portion of content with which the user interacts.

[0022] This embodiment offers the advantage of allowing an extended display to be configured for two screens using a single capture module, for example a single camera or webcam, and regardless of the position of said module: attached to one of the screens, located behind the user's back, etc.

[0023] According to a particular embodiment, the extended display configuration method comprises the following: - the extended display configuration request received concerns two screens, one of which is physically attached to the capture module and the terminal, - the reception of information relating to the context of use includes capturing the user's gaze, - the determination of the relative physical positions of the screens implements the following: — identify two axes of fixation of the user's gaze from the user's gaze, — identify among said gaze fixation axes the one oriented towards the capture module and associate said oriented axis with the screen physically attached to the terminal, — associate the other screen with the other gaze fixation axis.

[0024] This embodiment offers the advantage of not requiring analysis of the displayed content to configure the extended display and therefore of requiring less computing power. It is also suitable for the contexts of displaying content in extended mode commonly encountered in work situations in companies (workstation, meeting room, etc.) or elsewhere, libraries, internet cafes for example, which notably resort to the use of a laptop equipped with a webcam with a secondary screen.

[0025] According to a particular embodiment, the extended display configuration method comprises the following: - the reception of information relating to the context of use includes the portions of content on which the user interacts, - the determination of the relative physical positions of the screens implements an association of the portions of content on the basis of a connection between the movement of the display by the screens and user interactions on the portions of content.

[0026] According to the well-known cinematographic grammar, the movement connection refers to the principle according to which an element, for example a character or a moving object, leaving a foreground by one side, for example by the left or by the top, must re-enter, in the following shot, by the opposite side, for example respectively by the right or by the bottom.

[0027] This embodiment offers the advantage of not requiring a capture module but of being based solely on user interactions visible and interpretable on the screen such as for example the movements of a cursor or an application window.

[0028] According to a particular embodiment, the method of configuring the extended display of the at least two screens is iterated a plurality of times.

[0029] This embodiment offers the advantage of allowing a simplified configuration of the extended display on several screens in dynamic contexts where the screens are mobile and change position relative to each other during a given session. For example in the context of a public presentation or a demonstration, the display is extended between a first fixed screen (a projection screen or a television) and a tablet or a laptop held by a user moving relative to the first screen.

[0030] The invention also relates to a device for configuring an extended display via at least two screens placed in relative physical positions with respect to a user and respectively displaying two portions of content, characterized in that the device is configured to implement the following autonomously: - receive from a terminal, a request for configuring an extended display of the at least two screens, - receive information relating to the context of use of the screens, from at least one capture module and / or the terminal, - determine said relative physical positions from information relating to the context of use, - determine, for the at least two screens, their corresponding relative virtual position, from said relative physical positions allowing the terminal to associate with said at least two screens, their corresponding portion of content, - send the relative virtual positions to the terminal.

[0031] Such a device is particularly suitable for implementing the extended display configuration method via at least two screens according to any one of the embodiments described previously.

[0032] The invention also relates to a computer program comprising program code instructions for implementing the method of configuring extended display via at least two screens according to the invention, according to any one of the particular embodiments described previously, when this program is executed by a processor.

[0033] Such instructions can be stored permanently in a non-transitory memory medium of a communication terminal implementing the extended display configuration method via at least two screens according to the invention.

[0034] This program may use any programming language, and be in the form of source code, object code, or code intermediate between source code and object code, such as in a partially compiled form, or in any other desirable form.

[0035] The invention also relates to a recording medium or information medium readable by a computer, and comprising instructions of a computer program as mentioned above.

[0036] The recording medium may be any entity or device capable of storing the program. For example, the medium may comprise a storage means, such as a ROM (Read Only Memory), for example a CD ROM (Compact Disc Read-Only Memory), a synthetic DNA (deoxyribonucleic acid) or a microelectronic circuit ROM, or a magnetic recording means, for example a mobile medium, a hard disk or an SSD (Solid State Drive).

[0037] On the other hand, the recording medium may be a transmissible medium such as an electrical or optical signal, which may be conveyed via an electrical or optical cable, by radio or by other means, so that the computer program it contains is remotely executable. The program according to the invention may in particular be downloaded over a network, for example an Internet-type network.

[0038] Alternatively, the recording medium may be an integrated circuit in which the program is incorporated, the circuit being adapted to execute or to be used in the execution of the aforementioned secure communication method.

[0039] According to an exemplary embodiment, the present technique is implemented by means of software and / or hardware components. In this regard, the term “module” or “interface” may correspond in this document to a software component, a hardware component or a set of hardware and software components. Brief description of the drawings

[0040] Other characteristics and advantages will appear on reading particular embodiments of the invention, given as illustrative and non-limiting examples, and the appended drawings, among which:

[0041] [Fig.l] describes an example architecture in which the method of configuring the extended display is implemented;

[0042] [Fig.2] describes an embodiment of the invention;

[0043] [Fig.3] describes another embodiment of the invention;

[0044] [Fig.4a] describes another embodiment of the invention;

[0045] [Fig.4b] describes an example of deducing the relative physical positions of the screens based on the movement connection, as implemented in the embodiment of [Fig.4a];

[0046] [Fig.4c] depicts another example of deducing the relative physical positions of the screens based on the motion connection, as implemented in the embodiment of [Fig.4a];

[0047] [Fig.5] describes another example of architecture in which another embodiment of the invention is implemented;

[0048] [Fig.6] depicts an example of an extended display configuration device in one embodiment of the invention. Detailed description

[0049] Description of an example architecture in which the method of configuring the extended display is implemented

[0050] With reference to [Fig.l] an example of architecture is described in which the method of configuring extended display on at least two screens is implemented. This architecture comprises:

[0051] - a terminal T associated with a user U, for example a laptop or a tablet, to which are associated: — a video controller CV, for example a graphics card or a circuit integrated into the motherboard and dedicated to video control, — a computing unit UC, - a capture module MC, for example a webcam or any other video sensor known to those skilled in the art, which, depending on the embodiments, may be physically attached to the terminal T as in [Fig.l], a screen or constitute an independent third-party terminal connected to the terminal T, - a screen Eb, for example a laptop screen or a monitor, which, depending on the embodiments, can be physically attached to the terminal T or constitute an independent third-party terminal connected to the terminal T, - an E2 screen, connected to the video controller CV associated with the terminal T via a connection C, for example a VGA (Video Graphics Array) cable, HDMI (High-Definition Multimedia Interface) or a wireless connection based on WIFI (Wireless Fidelity) or any other form of communication known to those skilled in the art, - an extended display configuration module MCO, which, depending on the embodiments, can be integrated into the video controller CV, the computing unit UC or any other element of the terminal T or constitute an independent third-party terminal connected to the terminal T.

[0052] In figure [Fig.l], the screens are placed close to each other according to physical positions PPRi and PPR2 relative to the user U: the screen E2 is to the left of the screen Ei from the point of view of the user U, the screen Ei is to the right of the screen E2 from the point of view of the user U. Of course, other relative physical positions can be envisaged. Thus, the screen Ei could be to the left of the screen E2 from the point of view of the user U, the screen E2 could be to the right of the screen Ei from the point of view of the user U, the screen E2 could be above the screen Ei from the point of view of the user U, etc.

[0053] According to this architecture, the video controller is configured for an extended display so that each screen Eb E2 displays a corresponding distinct portion Ph P2 of the same content. By convention, the video content composed of the different display portions is called global content or general content. Within this general content, each portion has a unique specific position (e.g.: left part, top part, etc.).

[0054] In figure [Fig.l], the screen Ei (on the right) displays a portion of content Pi corresponding to the right part of the general content and the screen E2 (on the left) a portion of content P2 corresponding to the left part of the general content: the relative virtual positions PVRi, PVR2 of the screens correspond respectively to their relative physical positions PPRi, PPR2. This distribution of the portions of content with respect to the physical position of the screens constitutes the expected result of the configuration method of the invention which will be described later in the description.

[0055] Conversely, an illogical or problematic configuration refers to a case where the screen Ei (on the right) displays the portion P2 which corresponds to the left part of the content and where the screen E2 (on the left) displays the portion of content Pi which corresponds to the right part of the content. In this configuration, the relative virtual positions PVRi, PVR2 of the screens do not correspond respectively to their relative physical positions PPRi, PPR2.

[0056] When observing the screens Ei and E2, the user must orient his gaze, for example by turning his head or his eyes, according to different gaze fixation axes noted respectively ai and a2.

[0057] According to certain embodiments, at least one capture module MC is used to capture the gaze axes ai and a2 of the user.

[0058] According to the embodiments, the relative physical position of each of the screens Ei, E2 may include a dimension along a horizontal axis (for example left / right or xi / x2) and / or along a vertical axis (e.g. top / bottom or yi / y2), where (xl, yl), respectively (x2, y2), represent coordinates on the abscissa and ordinate of a position of the screen E1 in a plane PLI, respectively of a position of the screen E2 in a plane PL2.

[0059] According to other embodiments, other capture modules not shown in the figure [Fig.l], can be implemented within this architecture.

[0060] According to other embodiments, other screens not shown in the figure, can be connected to the terminal T, via respective connections, be placed close to each other according to relative physical positions and display corresponding distinct portions of the same content.

[0061] Description of an embodiment of the invention

[0062] Figure [Fig.2] represents the steps implemented by the method of configuring extended display via at least two screens, in a particular embodiment of the invention, the method taking place in accordance with the architecture of figure [Fig.l].

[0063] The method begins when the extended display configuration module MCO receives in E201 a request for extended display configuration for at least two screens.

[0064] According to the embodiments, this request can be issued by the calculation unit UC, by the video controller CV or any other element of the terminal T. Said request is triggered autonomously when a connection of at least one secondary screen to the terminal T equipped with a screen called “main screen” is detected or when an extended display request is triggered manually by the user using a user interface.

[0065] Upon receiving this request, the MCO configuration module receives information relating to the screens to be configured as well as to the available capture modules. The configuration request also includes information relating to the relative virtual positions of the screens such as the typology according to which these virtual positions are expected by the video controller CV.

[0066] Depending on the embodiments, this may be a position along a horizontal axis (left / right, Xi / x2) or along a horizontal axis and a vertical axis (top / bottom, left / right, (xb yû / (x2, y2), etc.).

[0067] In the embodiment illustrated in figure [Fig.2], the configuration module MCO receives information concerning the display terminals Eb E2 and the capture module MC.

[0068] According to other embodiments, the MCO configuration module also receives information indicating whether certain capture modules and / or certain screens are physically attached to the terminal T.

[0069] The MCO configuration module then receives at E202 from the MC capture module and / or the terminal T, information relating to the context of use.

[0070] According to the embodiments, the reception of information relating to the context of use may follow a prior request for connection of the terminal T to the capture module MC in order to access its information flow.

[0071] According to the embodiments, this connection request can trigger a request to activate said MC capture module if the latter is not activated.

[0072] The information received at E202 from the capture module MC includes a capture of the face of the user U when using the terminal T.

[0073] The information received at E202 from the terminal T includes the different portions of content concerned by the extended display.

[0074] The configuration module analyzes in E203 the information relating to the context of use in order to determine the relative physical positions PPRi and PPR2 of the screens Ei and E2.

[0075] In the context of this embodiment, this analysis step is based on the identification of the fixation axes of the user's gaze and the concomitant association of said fixation axes with the active portions of content, i.e. the portions of content displayed on the screens where user interactions are detected.

[0076] The identification of the fixation axes of the user's gaze can be obtained from the capture of the user's face received from the capture module (for example a camera or a webcam) using different face detection techniques (for example the Viola and Jones method, Eigenface) or eye tracking known to those skilled in the art.

[0077] In the case where the capture module is placed behind the user's back, the analysis 203 deduces the orientations of the gaze based on the movements of the user's head.

[0078] The user's gaze orientation data are related to a number of nominal gaze fixation axes corresponding to the number of screens to be configured. According to the embodiments, obtaining these gaze fixation axes can be achieved by implementing different data partitioning methods (e.g.: k-means, Voronoi diagram, etc.) known to those skilled in the art.

[0079] Identifying the gaze fixation axes makes it possible to position all the screens used by the user (for example, one screen on the left, one in the middle and one on the right or one screen at the top and one screen at the bottom).

[0080] In certain embodiments, the data relating to the context of use, in particular the data making it possible to extract the orientations of the user's gaze, may come from more than one capture module, for example two webcams or a webcam and a camera. In this case, the analysis of the information relating to the context of use includes a step of cross-referencing the information received from the different capture modules, with a view to determining the fixation axes of the user's gaze.

[0081] This step of cross-referencing information can be based on different principles such as: - the selection of one of the data sets produced by the capture modules (for example the data set offering the highest video quality, the viewing angle most suited to gaze analysis), - taking into account all the data produced by the capture modules, which may involve an analysis of the relative positions of the capture modules between them, - etc.

[0082] The analysis of the content portions carried out in 203 makes it possible to identify the portion with which the user is interacting at a given moment. This analysis is based on the detection, in the displayed content, of the user's interactions via different techniques, such as the detection of a cursor, the recognition of the movement of a shape, such as for example an application window or a menu, or even the detection of text entry, etc.

[0083] According to other embodiments, the information concerning the user interactions is obtained by other means, such as the identification of the coordinates of the cursor or the active window within the displayed content, etc. This information can be communicated at 202 to the MCO configuration module by the video controller, the computing unit or any other module having this information.

[0084] Based on the assumption that the user will tend to look at the screen displaying the portion of content with which he interacts, the analysis 203 of the information context results in making a connection between the gaze fixation axes and the concomitant active portions of content, which makes it possible to determine the relative physical position of the screens displaying each portion of content.

[0085] For example, if the left content portion is active when the user directs his gaze along a gaze fixation axis to his right, then the analysis 203 aims to determine that the left content portion is displayed on the screen whose relative physical position is “to the right”.

[0086] If the analysis 203 does not make it possible to determine the relative physical positions of the screens, for example due to a lack of data or due to insufficiently relevant data, the configuration process ends, otherwise it continues.

[0087] In E204 the MCO module translates the relative physical positions PPRi and PPR2 into relative virtual positions PVRi and PVR2 according to a format expected by the video controller CV.

[0088] According to certain embodiments, the expected format of the relative virtual positions will not allow the relative physical position of the screens to be accurately reflected.

[0089] For example, it may be possible to account for screen positions only on one horizontal axis (e.g. left / right) whereas analyzing usage context data may allow the relative physical position of the screens to be determined on two axes, e.g. top / bottom and left / right.

[0090] In E205 the MCO configuration module sends to the terminal T the relative virtual positions PVRi and PVR2 according to the typology expected by the video controller CV of the terminal T. This finalizes the extended display configuration process: each screen is configured to display a corresponding portion of content, the position of which in the global content corresponds to the relative physical position of a corresponding screen, modulo the format of the relative virtual position supported by the video controller.

[0091] Since the steps follow one another autonomously, this method has the advantage of not requiring any particular action on the part of the user, which simplifies the configuration of the extended display as described in the prior art.

[0092] According to other embodiments, the steps of the method may also be iterated a plurality of times, in order to allow an extended display configuration in contexts where the relative physical positions of the screens are dynamic. Description of another embodiment

[0093] Figure [Fig.3] represents the steps implemented by the extended display configuration method according to another embodiment, the method taking place in an architecture similar to that described in [Fig.l].

[0094] Alternatively, these steps can be implemented in an architecture comprising n terminals and n capture modules, where n-1 terminals are each physically attached to n-1 capture modules.

[0095] The method begins when the configuration module MCO receives at E301 a request for extended display configuration for two screens. This is similar to step E201 described in [Fig.2] except that in the present embodiment, said configuration request received by the configuration module MCO necessarily includes the information that at least one capture module MC (a camera or a webcam) and the screen E1 are physically attached to the terminal T.

[0096] The configuration module MCO then receives at E302 from the capture module MC, information relating to the context of use which includes a capture of the face of the user U during the use of the terminal T.

[0097] The configuration module analyzes in E303 the information relating to the context of use in order to determine the relative physical positions PPRi and PPR2 of the screens Ei and E2.

[0098] In the context of this embodiment, this analysis step is based on the identification of the user's gaze fixation axes and the identification, among these axes, of a camera axis oriented towards the capture module MC.

[0099] The identification of the fixation axes of the user's gaze is similar to the step of identifying the fixation axes described with reference to [Fig.2].

[0100] According to this embodiment, the association of the gaze fixation axes (corresponding to the relative physical positions of the screens) with the portions of content displayed, is based on the a priori knowledge, received in E301, of the fact that the capture module and the screen Ei are physically integral.

[0101] According to this knowledge, when the user's gaze fixation axis corresponds to a camera gaze, then the user observes the portion of content displayed by the screen Ei.

[0102] The camera gaze or gaze at the camera corresponds to the intersection of the user's gaze with the optical axis of the capture module as defined by cinematographic grammar.

[0103] By deduction, the gaze fixation axis which does not correspond to a camera gaze is associated with the second portion of content. This makes it possible to arrive at the respective relative physical positions PPR1 and PPR2 of the screens Ei and E2.

[0104] For example, the capture module being in front of the user: - if, according to MC, the axis of fixation of the gaze not corresponding to the camera gaze is oriented to the left of that oriented towards the capture module, then this means that the secondary screen E2 is to the right of the screen Eh - if, according to MC, the axis of fixation of the gaze not corresponding to the camera gaze is oriented to the right of that oriented towards the capture module, then this means that the secondary screen E2 is to the left of the screen Eb

[0105] If the analysis of the information relating to the context of use does not make it possible to determine the relative physical positions of the screens, for example due to a lack of data or due to insufficiently relevant data, the configuration process ends, otherwise it continues.

[0106] Steps E304 and E305 are respectively similar to steps E204 and E205 described with reference to [Fig.2].

[0107] According to other embodiments, the steps of the method may also be iterated a plurality of times, in order to allow an extended display configuration in contexts where the relative physical positions of the screens are dynamic. Description of another embodiment

[0108] Figure [Fig.4a] represents the steps implemented by the extended display configuration method according to another embodiment, the method taking place in an architecture similar to that described in [Fig.l].

[0109] The method begins when the MCO configuration module receives at E401 a request for extended display configuration for at least two screens. This is similar to step E201 described in [Fig.2].

[0110] The MCO configuration module receives at E402 information relating to the context of use from the terminal T. This information includes the portions of content concerned by the extended display.

[0111] According to other embodiments, the information relating to the context of use includes the position of the cursor, movements of graphic elements (windows, applications, icons, etc.), etc.

[0112] The configuration module analyzes in E403 the information relating to the context of use so as to determine the relative physical positions of the at least two screens.

[0113] This analysis includes identifying movements of graphical elements in multiple portions of content, for example a cursor or an application window moving from one portion of content to another.

[0114] The relative physical positions of the screens are determined on the basis of the principle of a movement connection.

[0115] The principle of motion matching is used to deduce the relative physical positions of the screens displaying the portions of content. If the MCO configuration module detects inconsistencies between certain user interactions, particularly in the case of movements of elements (cursor, window(s), etc.) of a portion display to another, with respect to the principle of movement connection, the MCO module deduces that the relative physical positions PPRi and PPR2 of the screens are inverted with respect to the relative virtual positions not represented received in E401.

[0116] Otherwise, it is deduced that the relative physical positions PPRi and PPR2 of the screens correspond to the relative virtual positions PVRi and PVR2 received in E401.

[0117] The principle of the movement connection used in this embodiment will be illustrated further with reference to figures 4b and 4c.

[0118] If the analysis of the information relating to the context of use does not make it possible to determine the relative physical positions of the screens, for example in the absence of movement of an element from one portion of content to another, due to inconsistent movement data, the configuration process ends, otherwise it continues.

[0119] Step E404 consists of determining the relative virtual positions PVRi and PVR2.

[0120] If the analysis of the movements of elements (for example a cursor or a window) between the content portions is consistent with the principles of motion connection, the relative virtual positions PVRi and PVR2 are returned without modification in E405. Otherwise, the values ​​of the relative virtual positions are interchanged between PVRi and PVR2.

[0121] Step E405 is similar to step E205 described with reference to [Fig.2].

[0122] According to other embodiments, the steps of the method which has just been described above may also be iterated a plurality of times, to allow for extended display configuration in contexts where the relative physical positions of the screens are dynamic.

[0123] Example of deduction of the relative physical positions of the screens on the basis of the movement connection

[0124] Figure [Fig.4b] represents a first example of implementation of deduction of the relative physical positions of the screens Ei and E2 on the basis of a movement connection. According to this first example, a user interaction is analyzed including a movement of a graphic element EG between the two screens Ei and E2 during the step E403 of determining said relative physical positions as illustrated in figure [Fig.4a].

[0125] Such a movement connection is implemented in the architecture as described in [Fig.l] in which, - the screen Eb positioned on the right of the user U (PPRi = “right”), displays a portion of image Pi corresponding to the right part of the general content to be displayed (PVRi = “right”), - screen E2, positioned on the left of user U (PPR2 = “left”), displays a portion of image P2 corresponding to the left part of the general content to be displayed (PVR2 = “left”), - the border BCG of the general content to be displayed extends across both screens so that the left border BCGg of the general content corresponds to the left edge Bg2 of the screen E2 and the right border BCGd of the general content corresponds to the right edge Bdi of the screen Eh

[0126] Instinctively, on the basis of the principle of movement connection, when he undertakes to move a graphic element EG, for example a cursor or a window, from the portion P2 to the portion Ph, the user U moves said element according to a movement Di, for example from left to right, as indicated by the arrow. It follows that said element disappears by the right edge BD2 of the screen E2 and reappears by the left edge BGi of the screen Eb

[0127] According to this first example, there is consistency between the relative physical positions of the screens Eb E2 and the position of the different portions of content Ph P2 in the overall content, taking into account the movement DI from left to right carried out by the user. During step E403, the configuration module MCO establishes that the relative physical positions PPRi and PPR2 of the screens correspond to the relative virtual positions PVRi and PVR2 received in E401.

[0128] Another example of deducing the relative physical positions of the screens based on the movement connection

[0129] Figure [Fig.4c] represents a second example of implementation of deduction of the relative physical positions of the screens Ei and E2 on the basis of a movement connection. According to this second example, a user interaction is analyzed including a movement of a graphic element EG between the two screens Ei and E2 during the step E403 of determining said relative physical positions as illustrated in figure [Fig.4a].

[0130] Such a movement connection is implemented in the architecture as described in [Fig.l] in which, - the screen EB positioned on the left of the user U (PPRi = “left”), displays a portion of image Pi corresponding to the right part of the general content to be displayed (PVRi = “right”), - screen E2, positioned on the right of user U (PPR2 = “right”), displays a portion of image P2 corresponding to the left part of the general content to be displayed (PVR2 = “left”), - the BCG border of the general content to be displayed extends across both screens so that the left border BCGg of the general content corresponds to the left edge Bg2 of the screen E2 and the right border BCGd of the general content corresponds to the right edge Bdi of the screen Eh

[0131] Instinctively, based on the principle of movement connection, when he attempts to move an element, for example a cursor or a window, from the portion Pi to the portion P2, the user U moves said element according to a movement D2 (from left to right). However, said element does not disappear from the right side of the left screen Ei to reappear from the left side of the right screen E2 but butts against the border of the general content BCG present on the right side of the screen Eb

[0132] According to this example, there is an inconsistency between the relative physical positions of the screens and the position of the different portions of content in the overall content. During step E403, the MCO configuration module detects the inconsistency of the movements of elements and the interactions of the user, with respect to the principle of movement connection and establishes that the relative physical positions PPRi and PPR2 of the screens are inverted with respect to the relative virtual positions PVRi and PVR2 received in E401.

[0133] During step E404, the MCO configuration module determines new values ​​for the relative virtual positions: PVRi= “left” and PVR2= “right”.

[0134] Description of a particular context of use of the terminal T by the user U

[0135] [Fig.5] illustrates a particular context of use of the terminal T by the user U in the architecture of [Fig.l].

[0136] The architecture of [Fig.5] being similar to that of [Fig.l], the identical or similar elements which compose it are designated with the same references. Such an architecture is distinguished from that of [Fig.l] in that the terminal T is held by the user U, who moves back and forth along a path D, so that the relative physical positions of the screens Ei and E2 change continuously as the user comes and goes.

[0137] Example: In the context of a public presentation or demonstration, the display is extended between a first fixed screen (a projection screen or a television) and a tablet or laptop held by a user moving relative to the first screen.

[0138] The embodiment within this architecture corresponds to an iterative implementation of the extended display configuration method between at least two screens as described in [Fig.2].

[0139] Another embodiment within this architecture corresponds to an iterative implementation of the method of configuring extended display between two screens as described in [Fig.3].

[0140] Another embodiment within this architecture corresponds to an iterative implementation of the extended display configuration method between at least two screens as described in [Fig.4a].

[0141] Said extended display configuration methods described with reference to figures [Fig.2] to [Fig.4c] can be iterated regularly according to a given frequency or be triggered punctually following particular events, for example the detection of movement of the user, a change detected by a sensor of the terminal T (for example an accelerometer, a gyroscope or a camera), etc.

[0142] The iteration of the extended display configuration method according to the invention has the advantage of guaranteeing that each portion of content is displayed by a screen whose relative physical position corresponds, modulo the format of the relative virtual position supported by the video controller, to the orientation of said portion in the overall content, even when at least one of the screens changes relative physical position during use.

[0143] Description of an extended display configuration device in one embodiment of the invention

[0144] [Fig.6] shows the simplified structure of an extended MCO display configuration device corresponding to a particular embodiment of the invention implemented in an architecture as illustrated in [Fig.l].

[0145] Such a device comprises, according to the invention, an E / R communication module adapted to receive and transmit information from or to the terminal T or the capture module MC.

[0146] According to a particular embodiment of the invention, the actions executed by the MCO device, within the framework of the implementation of the extended display configuration method of the present invention, are implemented by instructions of a computer program PG. For this, the MCO module has the conventional architecture of a computer and notably comprises a memory MEM, a processing unit UTR, equipped for example with a processor PROC, and controlled by the computer program PG stored in memory MEM. The computer program PG comprises instructions for implementing the steps of the extended display configuration method, in particular the aforementioned actions: - receive from a terminal T, a request for configuration of extended display of at least two screens, - receive information relating to the context of use of the screens, from at least one MC capture module and / or the terminal T, - determine said relative physical positions from the information relating to the context of use, - determine, for the at least two screens, their corresponding relative virtual position, from said relative physical positions, allowing the terminal to associate with said at least two screens, their corresponding portion of content, - send to the terminal T the relative virtual positions.

Claims

Claims

1. Method for configuring an extended display via at least two screens (El, E2) placed according to relative physical positions (PPRi, PPR2) with respect to a user and respectively displaying two portions of a content, characterized in that it implements the following autonomously, at the level of a configuration module (MCO): - receiving (E201) from a terminal (T), a request for configuring an extended display of the at least two screens, - receiving (E202) information relating to the context of use of the screens, from at least one capture module (MC) and / or the terminal (T), said information comprising: — a capture of the user's gaze, — the portions of content on which the user interacts, - determining (E203) said relative physical positions (PPRi, PPR2) from the information relating to the context of use,said determination implementing the following: — identifying from said user gaze as many user gaze fixation axes as screens, — associating said user gaze fixation axes with the screens, according to the portion of content with which the user interacts, - determining (E204), for the at least two screens, their corresponding relative virtual position (PVRi, PVR2), from said relative physical positions (PPRi, PPR2), allowing the terminal (T) to associate with said at least two screens, their corresponding portion of content (Pi, P2), - sending (E205) to the terminal (T) the relative virtual positions (PVRi, PVR2).,

2. Extended display configuration method according to claim 1, wherein: - receiving information relating to the context of use includes the portions of content on which the user interacts, - determining the relative physical positions (PPRi, PPR2) of the screens implements an association of the portions of content on the basis of a connection between the movement of the display by the screens and the user interactions on the portions of content.

3. The extended display configuration method according to claims 1 to 2, wherein the extended display configuration method of the at least two screens is iterated a plurality of times.

4. Device for configuring extended display via at least two screens (El, E2) placed according to relative physical positions (PPR1, PPR2) with respect to a user and respectively displaying two portions of content, characterized in that it is configured to implement the following autonomously: - receive from a terminal (T), a request for configuration of extended display of the at least two screens, - receive information relating to the context of use of the screens, coming from at least one capture module (MC) and / or from the terminal (T), said information comprising: — a capture of the user's gaze, — the portions of content on which the user interacts, - determine said relative physical positions (PPR1, PPR2) from the information relating to the context of use,said determination comprising: — an identification from said user's gaze of as many user gaze fixation axes as screens, — an association of said user gaze fixation axes with the screens, according to the portion of content with which the user interacts, - determining, for the at least two screens, their corresponding relative virtual position (PVR1, PVR2), from said relative physical positions (PPR1, PPR2), allowing the terminal (T) to associate with said at least two screens, their corresponding portion of content (SI, S2), - sending to the terminal (T) the relative virtual positions (PVR1, PVR2).,

5. A computer program comprising program code instructions for implementing the method of configuring extended display via at least two screens according to any one of claims 1 to 3, when executed on a computer.

6. A computer-readable information medium comprising instructions of a computer program for implementing the method of configuring an extended display via at least two screens according to any one of claims 1 to 3.

Images