METHOD FOR INTERACTING A DISPLAY DEVICE AND CONTROL WITH A THREE-DIMENSIONAL DISPLAY SYSTEM AND IMAGE ARRANGEMENT THEREBY

DE602023002829T2Active Publication Date: 2025-04-09THALES SA
View PDF 0 Cites -1 Cited by

Patent Information

Application Number
DE602023002829
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Priority Date
2022-10-20
Filing Date
2023-10-19
Publication Date
2025-04-09
Estimated Expiration
2043-10-19

AI Technical Summary

Technical Problem

Existing touch screen systems for interacting with geographic maps and three-dimensional representations are limited to two-dimensional displays, making it difficult for users to achieve a three-dimensional perception, and the use of 3D glasses can cause visual fatigue and hinder collaborative work.

Method used

An interaction process using a pointing and control device with a system representing a geographic area including a relief, where the system comprises a support and mobile elements that translate in elevation, allowing for the determination of a precise three-dimensional position and the generation of a display signal for a three-dimensional image.

Benefits of technology

This solution enables users to interact with geographic areas in a simple and effective manner, achieving a clear three-dimensional perception without the need for 3D glasses, thus reducing visual fatigue and facilitating collaborative work.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The present invention relates to a method of interaction between at least one pointing and control device and a system for representing a geographical area comprising a relief.

[0002] The invention further relates to a representation assembly comprising at least one pointing and control device and a system for representing a geographical area comprising a relief.

[0003] To interact with systems enabling the display of a stream of images, including for example a geographical map, it is known to implement touch screens. For example, for collaborative work, such screens can be arranged in the form of a table. A plurality of users located around the table are able to interact with elements displayed on the touch screen.

[0004] However, such touchscreens generally only allow a two-dimensional display. Therefore, a three-dimensional perception of, for example, a map, a terrain elevation model or a geographical location is not achieved by such screens.

[0005] Other display systems already make it possible to obtain a three-dimensional view of such a map, for example by a specific display and by using 3D glasses, for example active or passive anaglyph glasses, immersive augmented or virtual reality headsets making it possible to reproduce the perception of the third dimension. In the example of a table-shaped representation system, users located around the table then use 3D glasses to obtain a three-dimensional view. However, the use of such 3D glasses is not always easy for users. In particular, on the one hand it is not always easy to implement collaborative work using the map in the presence of 3D glasses, on the other hand users often experience visual fatigue when wearing them.

[0006] US 2020293112 A1 describes a haptic interaction system allowing a user to interact realistically with virtual objects. This system consists of a visualization unit that displays visual representations of virtual objects, such as terrain surfaces, and a haptic output unit equipped with movable elements capable of generating dynamic tactile sensations. The haptic properties of these virtual objects, such as texture or rigidity, vary depending on the position of the user and are simulated in real time by the haptic output unit.

[0007] One aim of the invention is thus to at least reduce the aforementioned drawbacks.

[0008] In particular, one aim of the invention is to obtain a method of interaction with a system for representing a geographical area, which is particularly simple to implement for a user, while making it possible to obtain an effective three-dimensional perception of the geographical area.

[0009] To this end, the subject of the invention is a method of interaction between at least one pointing and control device and a system for representing a geographical area comprising a relief, the representation system comprising a support and a plurality of elements movable in translation relative to the support in an elevation direction, each movable element comprising a head having at least one display face forming a part of said relief, the pointing and control device being movable relative to the representation system, the interaction method comprising the following steps: acquisition of a translation position of each mobile element, reception of a measurement of a position and an orientation of the pointing device and control relative to the representation system, determination, as a function of said measurement and the translation position of each mobile element, of a three-dimensional position forming an intersection of a virtual line extending from the pointing device and control with the relief, development of a display signal as a function of the three-dimensional position for a display of at least one image of the geographical area on each display face.

[0010] In fact, the interaction method allows interaction with the representation system in a particularly simple manner. By using the pointing and control device, a position pointed by the pointing and control device on the relief, namely the precise three-dimensional position, is determined, and the display signal is determined as a function of this position.

[0011] The three-dimensional position is in particular defined by three coordinates on the relief, according to an elevation direction, a transverse direction and a longitudinal direction perpendicular to each other.

[0012] Thus, the interaction method allows interaction with the representation system through the pointing and control device.

[0013] Using the pointing and control device enables rapid and efficient interaction with the representation system, for example by pointing at positions and / or objects from a user's position at a distance or next to the representation system.

[0014] According to other advantageous aspects of the invention, the interaction method comprises one or more of the following characteristics, taken in isolation or in all technically possible combinations: the step of developing the display signal comprises an image deformation calculation to obtain said image, adapted to the translation position of each mobile element, the image deformation calculation preferably comprising anamorphosis processing; the interaction method further comprises a step of calculating the virtual line, oriented from the position of said measurement and according to the orientation of said measurement of the pointing and control device; the at least one image comprises at least one object positioned at the three-dimensional position on the relief; the interaction method further comprises a first command reception step comprising the reception, from the pointing and control device, of a command to interact with said object at the three-dimensional position;the interaction command is at least one element of the list consisting of a modification of an attribute of the object positioned at the three-dimensional position, a display of information of the object positioned at the three-dimensional position, a marking of the object at the three-dimensional position and a movement of the object on the relief; the interaction method further comprises a second command reception step comprising the reception of a command to display a predetermined layer of the relief and / or a command to mark the three-dimensional position; the interaction method further comprises a step of measuring by at least two detection terminals fixed relative to the representation system, the position and the orientation of the pointing and control device to obtain said measurement of the position and / or the orientation of the pointing and control device;the detection terminals are electromagnetic terminals receiving an electromagnetic signal from the pointing device and control to obtain said measurement; the interaction method further comprises a step of transmitting the display signal to at least one video projection device, for displaying said image included in the display signal on the relief; the interaction method further comprises a step of programming the geographical area to obtain the relief of the geographical area, the programming step comprising at least the development of a command for moving the plurality of elements mobile in translation as a function of data relating to the geographical area, and the transmission of the movement command.;

[0015] The invention also relates to a representation assembly comprising at least one pointing and control device and a system for representing a geographical area comprising a relief, the representation system comprising a support and a plurality of elements movable in translation relative to the support in an elevation direction, each movable element comprising a head having at least one display face forming a part of said relief, the pointing and control device being movable relative to the representation system, the representation assembly further comprising a controller configured to: acquiring a translation position of each mobile element, receiving a measurement of a position and an orientation of the pointing and control device relative to the representation system, determining, as a function of said measurement and the translation position of each mobile element, a three-dimensional position forming an intersection of a virtual line extending from the pointing and control device with the relief, developing a display signal as a function of the three-dimensional position for a display of at least one image of the geographical area on each display face.

[0016] These characteristics and advantages of the invention will appear on reading the description which follows, given solely by way of non-limiting example and made with reference to the appended drawings, in which: [ Fig 1 ] there figure 1 is a schematic perspective view of a representation assembly comprising a representation system according to the invention; [ Fig 2 ] there figure 2 is a schematic perspective view of part of the representation system of the figure 1 ; [ Fig 3 ] there figure 3 is a schematic perspective representation of part of the representation system of the figure 1 comprising a positioning device; [ Fig 4 ] there figure 4 is a schematic view of part of the positioning device of the figure 3 ; [ Fig 5 ] There figure 5 is a schematic vertical sectional view of part of the representation system of the figure 1 comprising several moving elements, one of which is visible on the figure 5 , and an actuator configured to move this movable element; [ Fig 6 ] there figure 6 is a schematic vertical sectional view of part of the representation system of the figure 1 comprising an electromagnetic mechanism configured to force the movable elements into a rest position; [ Fig 7 ] there figure 7 is a flowchart of an interaction process implemented by the entire figure 1 .

[0017] In reference to the figures 1 And 2 , a representation assembly 10 comprises a representation system 12, at least one pointing and control device 14, for example at least two detection terminals 16 of the position and orientation of the pointing and control device 14, at least one projection device 18 and a controller 20.

[0018] The representation system 12 is configured to represent a geographic area 21 comprising a relief.

[0019] The geographic area is, for example, a geographic map. In another example, the geographic area includes urban features such as buildings.

[0020] By "geographical area including relief" is meant in particular a geographical area presenting three dimensions.

[0021] In reference to the figure 2 , the representation system 12 comprises a support 22 and a plurality of movable elements 24, which are movable in translation relative to the support 22 in an elevation direction Z.

[0022] The elevation direction Z extends perpendicular to a first direction, called the transverse direction X in the following, and a second direction, called the longitudinal direction Y in the following. When the transverse direction X and the longitudinal direction Y are oriented horizontally, the elevation direction Z is oriented vertically.

[0023] For example, when the support 22 extends in a horizontal plane, each movable element 24 is movable in vertical translation relative to the support 22.

[0024] For example, the representation system 12 comprises a table formed by the support 22 and legs, not shown, supporting the support 22.

[0025] The support 22 comprises for example a frame 26, an example of which is illustrated in the figure 2 , and a grid 28, an example of which is illustrated on the figures 5 And 6. The frame 26 and the grid 28 are in particular configured to support each movable element 24. The frame 26 preferably extends in the transverse direction X and the longitudinal direction Y. In particular, the grid 28 extends in a plane perpendicular to the elevation direction Z. The grid 28 comprises, for example, beams 29 extending parallel to the frame 26, in particular in the transverse direction X and the longitudinal direction Y, so as to form a grid having beams arranged perpendicular to each other. Preferably, each beam 29 has an identical distance from the neighboring beam, so as to form a grid having openings of identical size to each other in the elevation direction Z.

[0026] Each mobile element 24 forms in particular a “voxel” (a word composed of the word “vo” from “volume” and “xel” from “pixel”, the word “pixel” being a contraction of the English terms “picture” (for image) and “element” (for element)).

[0027] In reference to the figure 2 , each mobile element 24 comprises a head 30 having at least one display face 31, forming part of the relief of the geographical area 21. Each mobile element 24 further comprises, for example, a rod 32 extending from the head 30, preferably in a direction opposite to the elevation direction Z. For example, each rod 32 passes through the grid 28.

[0028] According to one example, each movable element 24 has a height VZ substantially equal to 200 mm, the head 30 of which has a height VE substantially equal to 30 mm. For example, each head 30 has the same size. For example, each head has the display face 31 forming a part of the relief extending in a plane perpendicular to the elevation direction Z. This display face 31 has, for example, a length VY and a width VX substantially equal to 5 mm.

[0029] According to the example, each rod 32 has, in a plane perpendicular to the elevation direction Z, a length VYB and a width VXB substantially equal to 3.5 mm.

[0030] Each movable element 24 is preferably movable between a rest position, in which each movable element 24 is positioned at the same predetermined height relative to the support 22 in the elevation direction Z, and a plurality of protruding positions distinct from the rest position. For example, in the rest position, the movable elements 24 adhere to the support 22.

[0031] For example, with reference to the figure 2 , the mobile elements 24 located in a zone A are in the rest position and the mobile elements 24 positioned in a zone B are in the projecting position.

[0032] Preferably, each movable element 24 is in frictional contact with at least one neighboring movable element 24. In particular, each movable element 24 is in contact by at least one lateral face of the head 30 with the neighboring movable element 24. Preferably, a friction force between two neighboring movable elements 24 is greater than a gravity force of said movable elements 24. This makes it possible to maintain the or each movable element 24 in the projecting position.

[0033] Preferably, each moving element 24 is manufactured by additive manufacturing.

[0034] More preferably, the support 22 is manufactured by additive manufacturing. For example, the frame 26 and the grid 28 are manufactured by additive manufacturing, preferably in a single piece.

[0035] For example, each movable element 24 and / or the support 22 is made of a plastic material, in particular a rigid and matte plastic material.

[0036] Preferably, each movable element 24 is made of the same material as the support 22.

[0037] In reference to the figure 6 , the representation system 12 further comprises, for example, an electromagnetic mechanism 34 configured to force all of the mobile elements 24 into the rest position. The electromagnetic mechanism 34 is in particular configured to force all of the mobile elements 24 into the rest position simultaneously.

[0038] The electromagnetic mechanism 34 comprises for example a metal net 36, for example a copper winding net. The electromagnetic mechanism 34 comprises for example for each movable element 24 a magnetic base 38 fixed to the head 30 of the corresponding movable element 24, in particular fixed on a face of the head 30 facing the metal net 36. When the metal net 36 receives a predetermined current, it behaves like an electromagnet and attracts each magnetic base 38 of the movable elements 24 and thus brings the movable elements 24 into the rest position.

[0039] The representation system 12 further comprises at least one actuator 40 configured to successively move different mobile elements 24 of the plurality of mobile elements in the elevation direction Z. In particular, the actuator 40 is configured to move one of the mobile elements 24, then another, respectively in the elevation direction Z.

[0040] For example, the actuator 40 is configured to receive a movement command to move the mobile element 24 concerned in the elevation direction Z, as a function of three-dimensional data of the relief, in particular received from the controller 20 via a data link.

[0041] For example, with reference to the figures 3 And 5 , the actuator 40 comprises a rack 42 configured to come into contact, optionally via a damping device 43, with the rod 32 of the movable element 24 concerned. The damping device 43 consists in particular of a material having a lower hardness than a hardness of the material of each movable element 24 and / or of the material of the rack 42.

[0042] The actuator 40 comprises for example an actuator motor 44 comprising a toothed wheel 46. The actuator motor 44 is for example an electric motor. When the actuator motor 44 generates a rotation of the toothed wheel 46, the rack 42 moves in translation, illustrated in particular in the figure 4 by an arrow F1. During such a translation, the rack 42 moves, by contact with the rod 32, the movable element 24 in the elevation direction Z.

[0043] According to an example not shown, the actuator 40 is formed by a pneumatic system configured to successively move the different mobile elements 24 of the plurality of mobile elements in the elevation direction Z.

[0044] The representation system 12 further comprises a positioning device 48 configured to position the actuator 40 relative to the movable elements 24 in a positioning plane perpendicular to the elevation direction Z.

[0045] The positioning plane is in particular defined according to the transverse direction X and the longitudinal direction Y.

[0046] For example, the positioning device 48 is configured to receive a positioning command to position the actuator 40 in the positioning plane, in particular as a function of the three-dimensional data of the relief, in particular received by a suitable data link from the controller 20.

[0047] In reference to the figure 3 , the positioning device 48 comprises for example an arm 50, a first motor 52, and a first toothed belt 54, in particular arranged along the arm 50. The arm 50 carries in particular the actuator 40, in particular by means of the first toothed belt 54. The first motor 52 is configured to move the actuator 40 in the transverse direction X in the positioning plane, in particular by means of the first toothed belt 54. This movement of the first toothed belt 54 is for example illustrated in the figure 3 by an arrow F2.

[0048] According to one example, the positioning device 48 further comprises a second motor 56 configured to move the arm 50 carrying the actuator 40 in the longitudinal direction Y in the positioning plane, in particular perpendicular to the transverse direction X. In this case, the positioning device 48, for example, a second toothed belt 58 extending in the longitudinal direction Y.

[0049] For example, the second motor 56 is configured to move the arm 50 via the second toothed belt 58. This movement of the second toothed belt 58 is for example illustrated in the figure 3 by an arrow F3.

[0050] According to one example, the positioning device 48 further comprises a metal bar 60, extending in particular in the longitudinal direction Y. In particular, the arm 50 is carried on one side by the second toothed belt 58 and on the other side by the metal bar 60.

[0051] The actuator 40 is configured to successively move some of the movable elements 24 from among the plurality of movable elements 24 in the elevation direction Z. In particular, the actuator 40 is configured to move one of the movable elements 24 to a first position of the actuator 40 in the positioning plane, then, after repositioning of the actuator 40 by the positioning device 48, another of the movable elements 24 to a second position of the actuator 40.

[0052] The actuator 40 is notably configured to move the movable element 24 to a given position relative to the positioning plane by moving the rod 32 by the actuator motor 44.

[0053] In particular, the positioning device 48 is configured to move the actuator 40 by combining the movements implemented by the first motor 52 and the second motor 56 in the positioning plane relative to the mobile elements 24, in particular by moving the arm 50 and by moving the actuator 40 on this arm 50.

[0054] According to an example not shown, the representation system 12 comprises several actuators 40. Each actuator 40 is preferably as described above.

[0055] Preferably, the representation system 12 comprises a number of actuators 40 strictly less than the number of movable elements 24 of the representation system 12. For example, the representation system 12 comprises a number N of actuators, where N is a number of power of 2, such as 2, 4, 8, 16, etc. Preferably, in this case, the representation system 12 comprises a respective positioning device 48 for each actuator 40. Each positioning device 48 is preferably as described above.

[0056] For example, when the representation system 12 comprises several actuators 40, each actuator 40 is configured to respectively move the movable elements 24 successively by a predefined portion of the plurality of movable elements 24, for example in a predefined area of ​​the positioning plane. In this case, the respective positioning device 48 is configured to move the corresponding actuator 40 in the predefined area. Preferably, each actuator 40 is incapable of moving the movable elements outside its predefined area.

[0057] The representation assembly 10 preferably comprises several pointing and control devices 14. The or each pointing and control device 14 is movable relative to the representation system 12.

[0058] The or each pointing and control device 14 is configured to point to a three-dimensional position of the relief of the representation system 12. For example, the or each pointing and control device 14 is configured to point to a position presenting at least one object 62, and is configured to interact with this object 62 on the relief of the geographical area 21, for example configured to detail or modify attributes of the object 62, display a specific layer, in particular of the geographical map, on the relief or move the object 62.

[0059] Preferably, the or each pointing and control device 14 is a COTS (Commercial Off The Shelf) component.

[0060] Preferably, the or each pointing and control device 14 is configured to emit a non-optical signal, in particular an electromagnetic signal.

[0061] Each detection terminal 16 is configured to measure a position and / or an orientation of the pointing and control device 14 relative to the representation system 12.

[0062] Each detection terminal 16 is preferably an electromagnetic terminal configured to receive an electromagnetic signal from the pointing and control device 14 to obtain said measurement. In this case, the pointing and control device 14 is in particular configured to emit the electromagnetic signal in a frequency band detectable by each detection terminal 16.

[0063] Preferably, the representation assembly 10 comprises one or more projection devices 18, for example two.

[0064] The or each projection device 18 is also called a video projection device.

[0065] The or each projection device 18 is configured to project, onto the relief, a series of images comprising several objects 62.

[0066] The objects 62 to be represented are fixed or mobile in relation to the relief.

[0067] The objects 62 are for example modeled in the representation system 12 by a combination of projected digital images (for example rendering of shape, color, texture, rapid animation) and physical relief elements by the mobile elements 24 (for example 3D rendering, slow animation).

[0068] The controller 20 comprises, for example, not shown, a reception module, a processing module, and an output module. Preferably, the input module, the processing module, and the output module are each implemented at least partially in the form of software, or a software brick, for example stored in a memory of the controller 20 and executable by a processor of the controller 20.

[0069] The controller 20 comprises, for example, a database, not shown, in which data relating to the geographical area 21 are stored, for example cartographic data when the area is a geographical map.

[0070] The controller 20 is for example provided with a human-machine interface 64 comprising for example a screen, a keyboard and / or a mouse.

[0071] In this case, according to one example, the controller 20 is configured to receive the data via the human-machine interface 64, in particular cartographic data relating to the geographical map, in particular relating to the relief, and / or relating to the objects 62.

[0072] The controller 20 is thus configured to develop the movement command for the actuator 40 and / or the positioning command for the positioning device 48 from the map data, and configured to issue this or these command(s).

[0073] The human-machine interface 64 for example is further configured to display the geographic area 21 and / or data relating to the geographic area 21 and the objects 62.

[0074] A method of interaction 100 between the pointing and control device 14 and the representation system 12 will now be described with reference to the figure 7 including a flowchart of this process.

[0075] The interaction method 100 is at least partially implemented by the controller 20, i.e. is at least partially implemented by computer.

[0076] The interaction method 100 comprises a measurement phase 110, a processing phase 120, and a display phase 130.

[0077] The measuring phase 110 comprises at least one measuring step 140 of a position and an orientation of the pointing and control device 14.

[0078] In particular, during the measurement step 140, the or each detection terminal 16, in particular fixed relative to the representation system 12, measures the position and / or the orientation of the pointing and control device 14. For example, each detection terminal 16 exchanges data wirelessly, preferably by electromagnetic signal, with the pointing and control device 14 to obtain the measurement of the position and / or the orientation of this device, for example according to a predetermined data exchange protocol, such as a protocol implementing a wireless network called “Wireless Gigabit (WiGig)”, for example at a frequency equal to 60 GHz.

[0079] Preferably, the measuring step 140 is implemented by at least two detection terminals 16, or three or four detection terminals 16.

[0080] In particular, an increased number of detection terminals 16 makes it possible to detect the position and orientation of each pointing and control device 14 located around the table, even in the presence of a user or an obstacle between one of the detection terminals and the corresponding pointing and control device 14.

[0081] Each detection terminal 16 transmits a signal comprising the measurement to the controller 20.

[0082] The processing phase 120 is preferably implemented by the controller 20.

[0083] The processing phase 120 comprises an acquisition step 142, a reception step 144, a calculation step 150, a determination step 152, a development step 154, a transmission step 155, a first command reception step 156, and a second command reception step 157.

[0084] During the acquisition step 142, the controller 20 acquires a translation position of each mobile element 24. For example, the controller 20 receives a measurement of the translation position from a sensor not shown.

[0085] According to another example, the controller 20 obtains each translation position from a non-represented database. This database includes in particular the translation position of each mobile element 24 updated as a result of recent movement according to the elevation direction Z of this mobile element 24.

[0086] In another example, the controller 20 obtains each translation position from a signal from the actuator motor 44.

[0087] By “translation position” is meant the respective position of each movable element 24 in the elevation direction Z.

[0088] During the reception step 144, the controller 20 receives the measurement of the position and orientation of the pointing and control device(s) 14 relative to the representation system 12. In particular, the controller 20 receives the signal comprising the measurement from the detection terminal(s) 16, via a suitable data link.

[0089] In the calculation step 150, the controller 20 calculates a virtual line 70 extending from the pointing device and controls 14.

[0090] In particular, the controller 20 calculates the virtual line 70 from the position of the pointing and control device 14 according to the measurement received during the reception step 144, and from the orientation of the pointing and control device 14 according to the measurement received during the step 144.

[0091] In particular, the controller 20 simulates a three-dimensional space, and calculates in this space the virtual line 70 by determining a straight line equation corresponding to a straight line with the position of the measurement and the orientation of the measurement.

[0092] The calculated virtual line 70 is thus oriented from the measured position and according to the measured orientation of the pointing and control device 14.

[0093] The calculation step 150 is an optional step. According to one example, instead of the calculation step 150, the controller 20 accesses a database to obtain a pre-calculated virtual line based on the position and orientation of the pointing device and command 14 received during the reception step 144.

[0094] During the determination step 152, the controller 20 determines, based on the measurement and the translation position of each mobile element 24, a three-dimensional position.

[0095] The three-dimensional position forms an intersection of the virtual line 70 with the relief of the geographical zone 21, for example with the head 30, in particular of the display face 31, of one of the mobile elements 24.

[0096] In particular, the controller 20 determines the three-dimensional position as a function of the mobile element 24 or the mobile elements 24 which are crossed by the virtual line 70.

[0097] For example, the controller 20 simulates the relief in three-dimensional space, and calculates the point of intersection of the virtual line 70 (in particular in the form of a straight line equation) with the simulated relief.

[0098] During the development step 154, the controller 20 develops a display signal as a function of the three-dimensional position for displaying at least one image of the geographic area 21 on the relief.

[0099] For example, the image included in the display signal includes a marking of the three-dimensional position as calculated on the relief.

[0100] In one example, the image includes the object 62 positioned at the three-dimensional position.

[0101] In reference to the figure 1 , preferably, the image comprises several objects 62.

[0102] According to the invention, the development step 154 ​​further comprises an image deformation calculation to obtain the image of the display signal, adapted to the translation position of each mobile element 24.

[0103] In particular, the controller 20 implements anamorphosis processing, preferably when the high relief and the resulting deformation of the video projection justifies it.

[0104] For example, the computer 20 distorts and / or contracts parts of the image to obtain, on the relief, the display of the image in an undistorted manner. In particular, the controller 20 compensates for aberrations due to the projection on the relief, which is non-planar and non-orthogonal to an axis of a lens of the corresponding projection device 18.

[0105] In particular, the controller 20 implements enlargements or contractions of images as a function of the translation positions of each mobile element 24, to obtain the image adapted to the translation position of each mobile element 24.

[0106] During the transmission step 155, the controller 20 transmits the display signal to the or each projection device 18 for displaying the image included in the display signal on the relief.

[0107] The first command receiving step 156 and / or the second command receiving step 157 comprises / comprise modifications or interactions with the object 62 which is pointed at by the pointing and control device 14. This pointed object 62 is positioned at the three-dimensional position.

[0108] In the first receiving step 156, the controller 20 receives, from the pointing and control device 14, a command to interact with the object 62 positioned at the three-dimensional position, for example following a press on a corresponding button on the pointing and control device 14 to send the interaction command to the controller 20.

[0109] The interaction command is for example at least one element of the list consisting of a modification of an attribute of the object 62 positioned at the three-dimensional position, a display of information of the object 62 positioned at the three-dimensional position, a marking of the object 62 at the three-dimensional position, and a movement of the object 62 on the relief.

[0110] For example, when the interaction command includes moving the object 62 on the relief, the user uses the pointing device and control 14 to move the object on the relief from the three-dimensional position to another position. This is illustrated in the figure 1 by an arrow 65.

[0111] When the interaction command includes a modification of a data item of the object 62, for example an attribute of the object is modified. For example, when the object is a vehicle, a movement or communication capability of the vehicle is modified by the interaction command.

[0112] According to one example, the controller 20 incorporates such a modification into the display signal, for displaying the modified data of the object 62.

[0113] When the interaction command comprises a marking of the object 62 at the three-dimensional position, the controller 20 incorporates for example into the display signal the marking of the object 62, for example a change in the color of the object 62, for the display of the object in this color.

[0114] During the second command reception step 157, the controller 20 receives a command to display a predetermined layer of the relief, in particular from the pointing and control device 14.

[0115] According to another example of the second command reception step 157, or in addition, this step comprises the reception by the controller 20 of a command to mark the three-dimensional position, in particular from the pointing and control device 14, for example following an entry of the corresponding button on the pointing and control device 14.

[0116] For example, with reference to the figure 1 , the marking command comprises marking in the form of a circle 66 around the three-dimensional position, in particular around the object 62.

[0117] In particular, the controller 20 incorporates into the display signal the marking corresponding to the marking command for the display of this marking on the relief.

[0118] According to one example, the interaction method 100 further comprises a programming step 158 of the geographic zone 21.

[0119] For example, during the programming step 158, the controller 21 receives, in particular via the human-machine interface 64, data relating to the geographical zone 21, such as the cartographic data relating to the geographical map.

[0120] The controller 20 develops the movement command for the actuator 40 and / or the positioning command for the positioning device 48 from the data relating to the geographical area 21, and issues this or these command(s) during the programming step 158, to obtain the relief according to the data received, forming the geographical area 21 in three dimensions.

[0121] For example, the positioning device 48 implements the movement corresponding to the positioning command by positioning the actuator 40 below the corresponding movable element 24. According to one example, the actuator 40 implements the movement corresponding to the movement command by moving the corresponding movable element 24 in translation.

[0122] Preferably, the programming step 158 is implemented at least once prior to the implementation of the measurement step 140 or the acquisition step 142.

[0123] The display phase 130 comprises a step 160 of displaying by the or each projection device 18 the image included in the display signal.

[0124] Preferably, the display step 160 is implemented by at least two projection devices 18. This makes it possible to obtain the display of the image on all the mobile elements 24, and in particular to avoid covering one of the display faces 31 of the corresponding mobile element 24 by another mobile element 24 in a projecting position, which is for example arranged between the projection device 18 and the corresponding display face 31.

[0125] The interaction method 100 is preferably implemented several times. Preferably, the measurement phase 110, the processing phase 120, and the display phase 130 are implemented successively one after the other.

[0126] Preferably, each phase 110, 120, 130 is implemented several times.

[0127] For example, at least the steps of acquiring 142, receiving 144, determining 152, and developing 154 are implemented at least once following an implementation of the programming step 158.

[0128] According to one example, the measurement phase 110, the processing phase 120, and the display phase 130 are implemented simultaneously or in parallel.

[0129] The measurement phase 110 is optional. Alternatively, the controller 20 receives the measurement of the position and the orientation in the form of a simulated measurement, for example from a database.

[0130] The calculation step 150, the transmission step 155, the first command reception step 156, the second command reception step 157 and / or the display step 160 is / are optional step(s).

[0131] Of course, other embodiments can be considered.

[0132] For example, the method 100 is implemented by several control devices 14.

[0133] For example, the interaction method 100 comprises receiving the command to move the movable elements 24 from the pointing and control device 14 instead of an input by the human-machine interface 64. In this case, for example, the pointing and control device 14 sends a suitable command to the controller 20, and the controller 20 calculates a corresponding signal for the corresponding actuator 40 and / or for the projection device 18.

[0134] It is understood that the interaction method 100 is particularly simple to implement for a user, while making it possible to obtain an effective three-dimensional perception of the geographical zone 21.

[0135] For example, if the pointed position, namely the three-dimensional position, contains the representation of a given object 62, and the user sends a command to obtain details of this object 62, the displayed signal contains the name of the object 62 and its attributes. According to another example, during a modification of the relief by a translation of the mobile elements 24 according to the elevation direction Z, the position pointed by the pointing and control device 14 is adapted.

Claims

1. A method of interaction (100) between at least one pointing and control device (14) and a system of representation (12) of a geographical area (21) comprising a terrain, the system of representation (12) comprising a support (22) and a plurality of elements (24) movable in translation with respect to the support (22) along a direction of elevation (Z), each movable element (24) comprising a head (30) having at least one display face (31) forming a part of said terrain, the pointing and control device (14) being movable with respect to the system of representation (12), the interaction method (100) comprising the following steps: - acquisition (142) of a translational position of each movable element (24), - reception (144) of a measurement of a position and of an orientation of the pointing and control device (14) with respect to the system of representation (12), - determination (152), depending on said measurement and of the translational position of each movable element (24), of a three-dimensional position forming an intersection between a virtual line (70) extending from the pointing and control device (14), and the terrain, - development (154) of a display signal according to the three-dimensional position for a display of at least one image of the geographical area (21) on each display (31), the step of developing (154) the display signal comprising a computation of image deformation in order to obtain said image, adapted to the translation position of each movable element (24), the computation of image deformation preferentially comprising an anamorphosis processing.

2. The interaction method (100) according to claim 1 or claim 2, further comprising a step of computing (150) the virtual line (70) oriented from the position of said measurement and according to the orientation of said measurement of the pointing and control device (14).

3. The interaction method (100) according to any of the preceding claims, wherein the at least one image comprises at least one object (62) positioned at the three-dimensional position on the terrain.

4. The interaction method (100) according to claim 3, further comprising a first command reception step (156) comprising the reception, from the pointing and control device (14), of a command to interact with said object (62) at the three-dimensional position.

5. The interaction method (100) according to claim 4, wherein the interaction command is at least one element of the list consisting of a modification of an attribute of the object (62) positioned at the three-dimensional position, a display of a piece of information of the object (62) positioned at the three-dimensional position, a marking of the object (62) at the three-dimensional position and a displacement of the object (62) on the terrain.

6. The interaction method (100) according to any of the preceding claims, further comprising a second command reception step (157) comprising the reception of a command to display a predetermined layer of the terrain and / or a command to mark the three-dimensional position.

7. The interaction method (100) according to any of the preceding claims, further comprising a step of measuring (140), by at least two detection terminals (16) stationary with respect to the system of representation (12), the position and orientation of the pointing and control device (14), so as to obtain said measurement of the position and / or orientation of the pointing and control device (14), the detection terminals (16) being preferentially electromagnetic terminals receiving an electromagnetic signal from the pointing and control device (14), in order to obtain said measurement.

8. The interaction method (100) according to any of the preceding claims, further comprising a step of transmitting (155) the display signal to at least one video projection device (18), for displaying on the terrain, said image comprised in the display signal.

9. The interaction method (100) according to any of the preceding claims, further comprising a step of programming (158) the geographical area (21) in order to obtain the terrain of the geographical area (21), the programming step (158) comprising at least the development of displacement command to displace the plurality of movable elements (24) according to data relating to the geographical area (21), and the transmission of the displacement command.

10. A representation assembly (10) comprising at least one pointing and control device (14) and a system of representation (12) of a geographical area (21) comprising a terrain, the system of representation (12) comprising a support (22) and a plurality of elements (24) movable in translation with respect to the support (22) along a direction of elevation (Z), each movable element (24) comprising a head (30) having at least one display face (31) forming a part of said terrain, the pointing and control device (14) being movable with respect to the system of representation (12), the representation assembly (10) further comprising a controller (20) configured for: - acquiring a translational position of each movable component (24), - receiving a measurement of a position and an orientation of the pointing and control device (14) with respect to the system of representation (12), - determining, according to said measurement and of the translational position of each movable element (24), a three-dimensional position forming an intersection between a virtual line (70) extending from the pointing and control device (14), and the relief, - developing a display signal according to the three-dimensional position for a display of at least one image of the geographical area (21) on each display face (31), the step of developing the display signal comprising a computation of image deformation in order to obtain said image, adapted to the translation position of each movable element (24), the computation of image deformation preferentially comprising an anamorphosis processing.