CONFIGURATION OF A LINE OF STREET FURNITURE IN A PUBLIC SPACE
The augmented reality system optimizes the joint configuration of street furniture by creating a 3D digital model of the environment and allowing simultaneous modification of multiple furniture instances, addressing the challenge of independent placement in existing technologies.
Patent Information
- Application Number
- FR2023006625
- Authority / Receiving Office
- FR · FR
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-06-26
- Publication Date
- 2024-12-27
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing augmented reality solutions for configuring street furniture in public spaces only allow for independent placement and configuration of individual elements without considering their combined impact, lacking a method to optimize the joint configuration of multiple furniture elements together.
An augmented reality system that allows for the creation of a 3D digital model of the environment, placement of multiple street furniture instances on a virtual line, and simultaneous modification of these instances through user interaction, utilizing a user interface to optimize the overall configuration and rendering of street furniture.
Enables users to visualize and jointly modify multiple street furniture elements, improving the overall placement and rendering in their environment, facilitating harmonious and efficient deployment.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Title of the invention: CONFIGURATION OF A LINE OF URBAN FURNITURE IN A PUBLIC PLACE Technical field
[0001] The present disclosure relates to the field of the configuration of urban furniture in public spaces. Prior art
[0002] The term "street furniture" generally refers to all objects placed in a fixed manner in urban spaces. An item of street furniture may, for example, be a bench, a shelter for travelers, or a digital or non-digital display device. Digital display devices are devices for broadcasting digital content. Digital content may, for example, include advertisements, but also information or awareness campaigns.
[0003] Digital display devices may, for example, be in the form of large screens placed in public spaces, for example in metro stations, on building fronts or integrated into passenger shelters. Digital display devices may also be in the form of devices placed on the ground.
[0004] Since the deployment of street furniture is a cumbersome operation, it is generally preferable to obtain a visualization of the street furniture in its environment, which can be validated or modified before proceeding with the physical installation of the street furniture. This makes it possible, for example, to optimize the placement of the street furniture element in its environment.
[0005] In order to optimize the configuration and deployment of street furniture elements, it is thus known to use augmented reality systems to configure a device (i.e. to define its characteristics, for example its position, size, orientation, etc.) by visualizing a virtual version of the street furniture superimposed on a real environment.
[0006] This solution makes it possible to optimize the configuration of a single piece of street furniture in relation to its environment.
[0007] However, in the state of the art this configuration can only be carried out in relation to the elements already physically present in the environment. If several elements of street furniture are to be placed in the public space, they must in the state of the art solutions be placed and configured independently of each other, without real knowledge of the combined impact of the different street furniture elements in public spaces.
[0008] There is therefore a need for an augmented reality solution making it possible to jointly optimize the configuration of a plurality of street furniture elements in the public space, in which the configuration of one element can take into account the other street furniture elements of said plurality. Summary
[0009] The present disclosure improves the situation.
[0010] A method implemented by an augmented reality system is proposed comprising: obtaining a 3D digital model of an environment of the system; obtaining at least one 3D digital model of at least one piece of street furniture; placing a plurality of instances of the at least one 3D digital model on a virtual line in the 3D digital model of the environment; displaying said plurality of instances and said virtual line superimposed on the environment, or a view of the environment, by at least one user interface of the augmented reality system; receiving at least one joint modification of the virtual line and the plurality of instances by the at least one user interface of the augmented reality system.
[0011] The term “augmented reality system” means a computer system capable of representing virtual content superimposed on a real environment, or a photorealistic representation of a real environment.
[0012] The term “system environment” means the physical environment surrounding the location of the system, for example the urban environment (ground, street furniture already present, buildings, vehicles, etc.) around the augmented reality system.
[0013] The term "street furniture item" means an object or device intended to be installed in an urban public space. A street furniture item may, for example, consist of a bench, a table, a lamppost, a bus shelter, an advertising panel, or a digital display device.
[0014] "User interface" means an interface of a computer system for displaying information to a user, and receiving input from the user.
[0015] “3D digital model” means a 3-dimensional digital model of an object, device, element or environment.
[0016] By “view of the environment” is meant a photorealistic representation of the environment resulting from a shot taken by at least one digital imaging module that can be taken in real time. For example, a view of the environment may be an image of the environment captured in real time by a digital image sensor of a tablet displayed in real time on the screen of the tablet, so that the user sees the environment on the screen of the tablet physical located on the back of the tablet.
[0017] “Placement on a virtual line” means the arrangement of instances of street furniture elements on the line, i.e. the definition of the position coordinates of the instances so that the street furniture elements are positioned on or in the immediate vicinity of the virtual line.
[0018] “Joint modification of the virtual line and the plurality of instances” means a modification of the placement parameters (for example, position and / or orientation) of the virtual line, and a corresponding modification of each of the instances of 3D models of street furniture elements placed on the virtual line.
[0019] The method according to the invention thus allows a user to view all of the instances simultaneously in the environment of the augmented reality system, and to modify all of the instances jointly. The user can thus jointly configure a set of street furniture, in order to obtain a better overall rendering of all of the furniture in its environment. In addition, the visualization and modification of the virtual line allows the user to clearly understand the logic of the placement of the street furniture elements, and therefore to improve the modifications made. The method according to the invention therefore makes it possible to optimize the placement of street furniture.
[0020] According to another aspect, there is provided a virtual reality system comprising at least one user interface, and at least one computing unit, configured to implement a method according to one of the embodiments of the disclosure.
[0021] The term “computing unit” means an electronic component capable of performing computer calculations to perform a specific function. A computing unit may designate any type of processor or electronic component capable of performing digital calculations. For example, a computing unit may be an integrated circuit, an ASIC (from the English acronym “Application-Specified Integrated Circuit”, literally in French “application-specific integrated circuit”, a microcontroller, a microprocessor, a DSP (from the English acronym “Digital Signal Processor”, literally in French “digital signal processor”), a processor, a GPU (from the English acronym “Graphics Processing Unit”, literally in French “graphics computing unit”). A computing unit according to the invention is not limited to a particular type of computing architecture. For example, a processor may implement a Harvard or Von Neumann type architecture.
[0022] The term "memory" means a digital electronic element used to store data. Different types of memories may be used in the invention, such as a read-only memory, a random access memory, a volatile memory or a flash memory. A device according to the invention may be equipped with one or more non-volatile memories which may be of different types such as mass memories, memory flash, read-only memories or SSD memories. A device according to the invention may also comprise one or more random access memories such as RAM, DRAM, SRAM, DPRREAM, VRAM, eDRAM or 1T-SRAM memories.
[0023] According to another aspect, there is provided a computer program comprising instructions for implementing the method according to one of the embodiments of the disclosure.
[0024] According to another aspect, there is provided a non-transitory recording medium readable by a computer on which is recorded a program for implementing the method according to one of the embodiments of the disclosure when this program is executed by a processor.
[0025] According to another aspect, there is provided a computer program comprising instructions for implementing all or part of a method as defined herein when this program is executed by a processor.
[0026] According to another aspect, there is provided a non-transitory, computer-readable recording medium on which such a program is recorded.
[0027] The features set out in the following paragraphs may, optionally, be implemented, independently of one another or in combination with one another:
[0028] Advantageously, said model of the environment of the system is created from at least one measurement of a sensor of the virtual reality system in said environment.
[0029] This makes it possible to obtain a 3D digital model of the environment of the augmented reality system regardless of the location of the system, and even if the model has not been previously created. This therefore makes it possible to carry out the method in any environment without prior knowledge of the environment.
[0030] Advantageously, said sensor of the augmented reality system is a lidar sensor, in which the model of the environment of the system is created from measurements made by the lidar sensor while a user of the system performs rotations of the sensor from a fixed point.
[0031] This makes it possible to obtain lidar data of the entire environment around the system, and therefore to obtain an accurate 3D representation of the entire environment of the virtual reality system.
[0032] Advantageously, the at least one 3D digital model of the at least one piece of street furniture is loaded from at least one memory of the augmented reality system.
[0033] This allows the augmented reality system to operate in “offline” mode and to allow the user to configure the street furniture without requiring a connection to a server.
[0034] Advantageously, the at least one 3D digital model of the at least one piece of furniture urban is received from a server in communication with the augmented reality system.
[0035] This allows you to benefit from a set of extended and constantly updated models on the server.
[0036] Advantageously, the method comprises: displaying, by the at least one user interface, a set of digital models of urban furniture elements; receiving, by the at least one user interface, a selection of the at least one 3D digital model of the at least one urban furniture element from said set.
[0037] This allows the user to select at least one model of street furniture to be positioned from a set of available street furniture.
[0038] Advantageously, the line is initialized in the direction of the center of a line representing the horizon.
[0039] The term “center of a line representing the horizon” means the center, relative to the screen where the line is displayed, of a line representing the horizon of the environment.
[0040] The use of a line pointing towards the center of the horizon makes it possible to obtain a harmonious rendering of the urban furniture elements in the environment.
[0041] Advantageously, the at least one user interface comprises a touch screen, and the method comprises: displaying, by said touch screen, said plurality of instances, said virtual line and the view of the environment.
[0042] This representation on the touch screen therefore allows the user to benefit from a fluid and intuitive interaction to configure the street furniture elements in their environment.
[0043] Advantageously, the detection of a twisting movement of at least two fingers on the touch screen causes a rotation of the virtual line.
[0044] This makes it possible to easily perform a rotation of the virtual line, applied to all the instances of digital models of street furniture elements associated with it.
[0045] Advantageously, the detection of a sliding movement of at least one finger on the touch screen causes a translation of the line.
[0046] This makes it possible to easily perform a translation of the virtual line, applied to all the instances of digital models of street furniture elements associated with it.
[0047] Advantageously, the detection of a sliding movement of at least one finger on the touch screen causes a translation of one end of the selected line to the position defined by the position of the finger.
[0048] This makes it possible to precisely define the position of each of the ends of the line in a manner that is intuitive for the user.
[0049] Advantageously, the method comprises: displaying, by the touch screen, an area control area comprising control sub-areas; receiving, upon detection of at least one touch of one of the control sub-areas, at least one input relating to: a change in the number of instances of 3D digital models of street furniture elements on the line; a change in the distance between the instances of 3D digital models of street furniture elements on the line; a change in the height of the instances of 3D digital models of street furniture elements; a change in a rotation angle about a vertical axis of the instances of 3D digital models of street furniture elements on the line; a duplication of the virtual line and the instances of 3D digital models of street furniture elements on the line.
[0050] This allows operations to be carried out in a harmonized manner on all the instances arranged on a virtual line. This therefore facilitates the modification of the instances and the configuration of the associated street furniture elements.
[0051] Advantageously, the method comprises: displaying, by the touch screen, a control zone linked to a selected instance of a 3D digital model of an urban furniture element comprising control sub-zones; receiving, upon detection of at least one touch of one of the control sub-zones, at least one input relating to: a modification of an angle of rotation around a vertical axis of the selected instance relative to the other instances on the line; an offset of the height of the instance relative to the other instances on the line.
[0052] This therefore makes it possible to adjust the parameters of a particular instance, while retaining the possibility of globally modifying the parameters of all instances. Brief description of the drawings
[0053] Other characteristics, details and advantages will appear on reading the detailed description below, and on analyzing the attached drawings, in which: Fig.l
[0054] [Fig.l] shows an example of an augmented reality system in a set of embodiments of the invention Fig. 2
[0055] [Fig.2] shows an example of a method according to a set of embodiments of the invention. Fig. 3
[0056] [Fig.3] shows an example of creating a virtual line of street furniture elements via a user interface of an augmented reality system in a set of embodiments of the invention. Fig. 4
[0057] [Fig.4] shows a first example of modification of a virtual line of street furniture elements via a user interface of an augmented reality system in a set of embodiments of the invention.
[0058] Fig. 5
[0059] [Fig.5] shows a second example of modification of a virtual line of street furniture elements via a user interface of an augmented reality system in a set of embodiments of the invention. Fig. 6
[0060] [Fig.6] shows a third example of modification of a virtual line of street furniture elements via a user interface of an augmented reality system in a set of embodiments of the invention. Fig. 7
[0061] [Fig.7] shows an example of duplication of a virtual line of street furniture elements via a user interface of an augmented reality system in a set of embodiments of the invention. Fig. 8
[0062] [Fig.8] shows an example of modifying activation of a modification mode of a single instance of street furniture via a user interface of an augmented reality system in a set of embodiments of the invention. Fig. 9
[0063] [Fig.9] shows an example of modifying a single instance of street furniture via a user interface of an augmented reality system in a set of embodiments of the invention. Description of the embodiments
[0064] Reference is now made to [Fig. 1].
[0065] [Fig.l] shows an example of an augmented reality system in a set of embodiments of the invention.
[0066] The Sysl augmented reality system aims to enable a user to configure a plurality of street furniture elements, i.e. to define the parameters of the street furniture elements in relation to the environment in which they will be installed.
[0067] In the present description, the Sysl augmented reality system will be described in the case of a digital tablet. The invention is however not limited to this example. The Sysl augmented reality system can in fact be of different types. It can for example be: - a digital tablet; - a smartphone; - a pair of connected glasses; - etc.
[0068] More generally, the augmented reality system may consist of any system capable of representing a 3D model of a virtual urban furniture element superimposed on the environment in which the urban furniture element could be installed, and receiving user inputs in connection with this representation. The Sysl system may be a portable or fixed system, and made up of a single virtual reality device, or a plurality of virtual reality devices connected to each other.
[0069] The Sysl virtual reality system comprises at least one user interface.
[0070] The at least one user interface may comprise: - at least one output user interface for displaying information to the user. The at least one output interface may thus comprise at least one element chosen from a group comprising a screen, a touch screen, connected glasses, etc. In addition to the interfaces for displaying elements to the user, the at least one output user interface may comprise at least one additional interface, such as a microphone, a haptic interface, etc.; - at least one input user interface for receiving input from the user. The at least one input user interface may thus comprise, for example, at least one element chosen from a group comprising a touch screen, a keyboard, a mouse, a microphone coupled with a voice analyzer, etc.
[0071] In certain embodiments of the invention, the same element can serve as both an input and an output interface. For example, in [Fig.l], the system Sysl comprises a touch screen Ecrl serving as both an input and an output interface.
[0072] The user interfaces of an augmented reality system according to an embodiment of the invention are however not limited to this example. As indicated above, numerous input and output interfaces are conceivable and can be combined.
[0073] Generally speaking, when the Sysl system is arranged in the Envi environment in which the urban furniture elements must be arranged, the at least one user interface Intl is capable of representing the 3D virtual models of the urban furniture elements superimposed on the Envi environment (for example by representing the 3D virtual models of the urban furniture elements in connected glasses superimposed on the Envi environment) or of a photorealistic view of the Envi environment (for example by representing Captl the 3D virtual models of the elements of urban furniture superimposed on an image of the Envi environment taken in real time by a digital imaging module of the Sysl system).
[0074] The superposition of the 3D virtual models of the urban furniture elements over a photorealistic rendering of the Envi environment is typically carried out when the Sysl system is a tablet comprising a digital imaging module capturing images of the Envi environment in real time. In this case, the 3D virtual models of the urban furniture elements can be placed in real time superimposed on the image of the environment, so that the user perceives in real time the rendering of the urban furniture in his environment.
[0075] The Sysl system can be equipped with motion sensors in order to know its position and / or orientation in real time, in order to carry out in real time a calibration of the 3D virtual models of the urban furniture elements in relation to the environment as seen and / or rendered by the user interface.
[0076] In a set of embodiments of the invention, the Sysl system can be connected to at least one Servi server, for example via a wireless link involving a Wi-Fi, 4G, 5G or internet link.
[0077] [Fig.l] represents, by way of non-limiting example only, an example of an augmented reality system connected to a server. However, in other embodiments, the Sysl system operates in “offline” or “standalone” mode and does not require a connection with a server such as the Servi server.
[0078] In order to represent the elements of urban furniture in relation to the Envi environment, the Sysl system comprises at least one Meml memory.
[0079] The at least one Meml memory can be used to store a 3D digital model ModEnvl of the environment Envi of the system and / or at least one 3D digital model ModMobl of at least one element of street furniture.
[0080] The 3D digital model ModEnvl therefore represents the environment Envi in 3 dimensions, and the at least one ModMobl model at least one element of urban furniture in 3 dimensions. This makes it possible to align the representation of the 3D digital models of the elements of urban furniture with the environment, or a representation of the environment, so that the user can perceive the rendering of the elements of urban furniture in the environment in which they are intended to be installed.
[0081] The Sysl system also comprises at least one calculation unit Calcl. The at least one calculation unit Calcl can be configured to implement a method according to a set of embodiments of the invention, for example the method Proc2 represented in [Fig.2].
[0082] [Fig.2] shows an example of a method according to a set of embodiments of the invention.
[0083] The method P2 is a method implemented by an augmented reality system, by example the Sysl system.
[0084] The method P2 comprises a step S21 of obtaining a 3D digital model such as the ModEnvl model of the system environment.
[0085] The 3D digital model ModEnvl of the environment can be obtained in different ways.
[0086] For example, a pre-existing model can be used. This model can for example be previously stored in the Meml memory, and directly loaded from the memory. The model can also be received from the server 1.
[0087] The model can also be created from at least one measurement of a Captl sensor of the virtual reality system in said environment.
[0088] In other words, the virtual reality system may comprise at least one sensor Captl capable of carrying out measurements of the environment, said measurements making it possible to create the ModEnvl model.
[0089] This makes it possible to implement the method in any environment, even if neither the environment nor the ModEnvl model are previously known.
[0090] The creation of the ModEnvl model can be done from different types of measurements.
[0091] For example, the sensor Captl may be a digital imaging module, and the model ModEnvl of the environment may be created from the digital images.
[0092] The Captl sensor can also be a lidar sensor, in which the model of the system's environment can be created from measurements made by the lidar sensor while a user of the system rotates the sensor from a fixed point.
[0093] In other words, a user can position himself at a fixed point, and perform rotations of the lidar sensor (for example, rotations of the system itself if the system is a device such as a tablet comprising the lidar sensor), so that a lidar mapping of the entire environment around the system is carried out.
[0094] Thus an accurate 3D model of the entire Envi environment can be created.
[0095] The method then comprises a step S22 of obtaining at least one model 3D digital model, such as the ModMobl model, of at least one piece of street furniture.
[0096] According to different embodiments of the invention: - multiple instances of the same street furniture item (e.g., multiple benches or digital display devices of the same type) must be configured. In this case, a single digital model of a single street furniture item is obtained; - multiple instances of different types of street furniture elements (e.g., multiple benches or digital display devices of the same model) are to be configured. In this case, a plurality of digital models of a plurality of street furniture elements are obtained.
[0097] The at least one 3D digital model of at least one element of street furniture can be obtained in different ways.
[0098] For example, the at least one 3D digital model may be preloaded into the memory of the augmented reality system.
[0099] The at least one 3D digital model of at least one piece of street furniture can also be received from a server such as the Servi server. In this case, the augmented reality system can benefit from a wider set of models, continuously updated by the server.
[0100] In a set of embodiments of the invention: - a set of digital models of street furniture elements can be displayed by the at least one user interface. This set can for example be preloaded onto the virtual reality system, or received from a server; - a selection of at least one 3D digital model of at least one urban furniture element from said set can be received by the at least one user interface.
[0101] For example, a set of available street furniture models can be displayed as thumbnails on the Ecrl touch screen, and the user can use the touch screen to navigate among the thumbnails, then click on the thumbnail corresponding to the furniture item of his choice.
[0102] Thus, the user can select the piece of furniture that seems most appropriate to insert into the environment.
[0103] The method P2 then comprises a step S23 of placing a plurality of instances of the at least one 3D digital model on a virtual line in the 3D digital model of the environment.
[0104] This step allows the instances of the digital models to be placed on the virtual line, so that the street furniture elements are aligned harmoniously in their environment.
[0105] The method P2 then comprises a step S24 of displaying said plurality of instances and said virtual line superimposed on the environment, or a representation of the environment, by at least one user interface of the augmented reality system.
[0106] This step may for example consist of displaying the plurality of instances of the 3D models of the street furniture elements, and the virtual line, either superimposed on the environment itself (for example, if the display is done via connected glasses through which the environment is observed), or superimposed on a representation of the environment, for example if the environment is represented in real time on a screen such as the touch screen of a digital tablet.
[0107] Thus, the user has at this stage a realistic view of the environment, of the street furniture elements according to the current parameters, and of the virtual line serving as support for the placement of the street furniture elements.
[0108] The calibration of the representation of the 3D models can in particular be done by knowing the position and orientation of the virtual reality system in its environment.
[0109] The method P2 then comprises a step S25 of receiving at least one joint modification of the virtual line and of the plurality of instances by the at least one user interface of the augmented reality system.
[0110] This step consists in practice of receiving via a user interface of the virtual reality system a modification applying both to the virtual line, and to the 3D model instances placed on the line. For example, a translation or a rotation can be applied to the line, and a translation or rotation applied jointly to the 3D model instances, depending on their location on the virtual line.
[0111] The P2 method thus allows a user to view all of the instances simultaneously in the environment of the augmented reality system, and to modify all of the instances jointly. The user can thus jointly configure a set of street furniture, in order to obtain a better overall rendering of all of the furniture in their environment. In addition, the visualization and modification of the virtual line allows the user to clearly understand the logic of the placement of the street furniture elements, and therefore to improve the modifications made. The P2 method therefore makes it possible to optimize the placement of street furniture elements.
[0112] In one set of embodiments of the invention, the steps of displaying and receiving changes may be performed iteratively.
[0113] For example, after the display step S24, a step S26 of verifying detection of the end of the process can be triggered. The process can for example end when the user considers that the result obtained is satisfactory and clicks on a “save” button.
[0114] If the method is not completed, step S25 of receiving a notification can be executed, before returning to the display step S24, and so on, iteratively, until step S26 detects the end of the method.
[0115] The instances of the 3D models can therefore be modified iteratively by the user and then the result displayed, until the user is satisfied with the result.
[0116] When the end of the process is detected in step S26, different steps may, according to certain embodiments, be triggered.
[0117] For example, a step S27 of storing parameter values (eg position, size, orientation, etc.) of the plurality of instances of 3D digital models of the street furniture elements can be performed. In practice, such a step consists of storing the values of the parameters of the instances at the end of the process, for example in one or more files and / or a server. Thus, the values of the parameters corresponding to the visualization validated by the user can be stored for future use, which may for example consist of: - a visualization of the result of the configuration of the street furniture elements; - construction of urban furniture elements and / or installation of urban furniture elements in the Envi environment according to the stored parameters.
[0118] Thus, it is for example possible to install the urban furniture elements according to the values of parameters defined by the P2 method (eg position, orientation, etc.)
[0119] The P2 method therefore allows a complete visualization of the result obtained by the installation of a plurality of street furniture elements in their environment, even before the construction or installation of a single one of the street furniture elements. The P2 method therefore allows easier and more efficient design and installation of the street furniture elements.
[0120] Reference is now made to Figures 3 to 9.
[0121] Generally speaking, Figures 3 to 9 show an example of displaying a virtual line and instances of 3D digital models of street furniture elements by a touch screen of a tablet superimposed on the environment of the tablet as captured by a digital imaging module, and the modification of the line and the instances by actions performed by the user's fingers on the touch screen. In the examples of Figures 3 to 9, the street furniture elements are digital display devices.
[0122] The invention is however not limited to these examples. For example, the street furniture may be other types of street furniture than digital display devices. It may for example be benches, fixed display devices, etc. The street furniture elements may be fixed to the ground, or suspended for example. The number of instances of 3D digital models of street furniture elements may also be variable, but is generally at least equal to two.
[0123] Reference is now made to [Fig.3].
[0124] [Fig.3] shows an example of creating a virtual line of street furniture elements via a user interface of an augmented reality system in a set of embodiments of the invention.
[0125] In the example of [Fig.3], a line LV3 is initialized from a position Pos31, in the direction of a point Horiz35 at the center of a line Horiz materializing the horizon, when the user clicks Clk3 at position Pos31.
[0126] 3 instances of 3D digital models of Mobl, Mob2 street furniture elements and Mob3 are created and placed on the line, respectively at 3 positions Pos32, Pos33 and Pos34.
[0127] In the example of [Fig.3] and the following, all the instances belong to the same type of 3D model of a digital display device. However, the invention is not restricted to this example. In particular, other models of other types of street furniture elements (benches, fixed displays, etc.) can be used, and the instances can be of different types. For example, in a set of embodiments of the invention, the same line can comprise instances of different models of different types of street furniture (for example, a digital display device and a bench).
[0128] The use of a virtual line pointing towards the center of the horizon makes it possible to obtain a harmonious rendering of the urban furniture elements in the environment.
[0129] In this example, the instances are initially arranged equidistant from each other on the line, which again allows for a more harmonious rendering.
[0130] In the example of [Fig.3] to 9, the touch screen therefore displays: - the plurality of instances mobl, Mob2, Mob3; - the virtual line LV3; - superimposed on a view of the environment in which the street furniture elements are intended to be installed, for example the environment as viewed in real time by the digital imaging module integrated into the tablet to which the touch screen belongs.
[0131] Furthermore, the touch screen allows instructions to be received from the user through finger movements on the screen.
[0132] This representation on the touch screen therefore allows the user to benefit from a fluid and intuitive interaction to configure the street furniture elements in their environment.
[0133] In the example of Figures 3 to 9, the touch screen also displays a control zone ZC. The control zone ZC comprises 6 control sub-zones SZC1, SZC2, SZC3, SZC4, SZC5 and SZC6, allowing respectively, via user inputs on each of the sub-zones: - for the SZC1 command sub-zone, to select a virtual line. In the example in [Fig.3], only one line is present and selected. The SZC1 command sub-zone can be used to select a virtual line or an instance and / or display the selected virtual line or instance; - for the SZC2 command sub-zone, to modify the number of instances of 3D digital models of street furniture elements on the line. For example, the number of instances can be incremented or decremented (and therefore an instance added or deleted) via the “+” and “-” buttons of the SZC2 command sub-zone respectively; - for the SZC3 sub-zone, to modify the distance between instances of 3D digital models of street furniture elements on the line. For example, the distance between instances can be increased or decreased via the “+” and “-” buttons of the SZC3 command sub-zone respectively; - for the SZC4 sub-zone, to modify the height (or altitude, i.e. a position on a vertical z axis) of the instances of 3D digital models of street furniture elements. For example, the height of the instances on the line can be increased or decreased via the “+” and “-” buttons of the SZC4 command sub-zone respectively; - for the SZC5 sub-zone, to modify the rotation of instances of 3D digital models of street furniture elements on the line. For example, a rotation can be carried out clockwise or counterclockwise via the “+” and “-” buttons of the SZC5 command sub-zone respectively; - for the SZC5 sub-zone, to duplicate the virtual line and all instances of 3D digital models of street furniture elements placed on it.
[0134] The ZC zone and its sub-zones therefore make it possible to carry out operations in a harmonized manner on all the instances arranged on a virtual line. This therefore facilitates the modification of the instances and the configuration of the associated street furniture elements.
[0135] The modifications presented in the example of [Fig. 3] are provided as a non-limiting example only of modifications applicable to the instances. According to other embodiments of the invention, other modifications are possible. For example, a rotation angle relative to a horizontal axis can be defined.
[0136] It should be noted that the ZC zone allows both to define the initial parameters of the line, and to modify the line. Thus, when the user can define the parameters of the desired line in the ZC zone, then click Clk3 on the Pos31 position to create the line, then modify the parameters of the line in the ZC zone. This therefore allows both easy creation and modification of the line and instances on the line.
[0137] Reference is now made to [Fig.4].
[0138] [Fig.4] shows a first example of modification of a virtual line of street furniture elements via a user interface of a reality system augmented in a set of embodiments of the invention.
[0139] The example in [Fig.4] is based on the example in [Fig.3]. In the example in [Fig.4], the user selects the previously created virtual line LV3, then performs a twisting movement Tors4 with his fingers, allowing a rotation to be imparted to the virtual line to obtain the virtual line LV4.
[0140] The user can visualize in real time the rotation of the line, and, at the end of the twisting movement Tors4 (for example, when the user lifts his fingers from the tablet), the instances Mobl, Mob2 and Mob3 can be moved from the virtual line LV3 to the virtual line LV4, depending on their location on the line.
[0141] This therefore makes it possible to easily perform a rotation of the virtual line, applied to all the instances of digital models of street furniture elements associated with it.
[0142] This rotational movement is provided as a non-limiting example only of a movement that can be applied to the entire line, and other movements can be applied.
[0143] For example, detecting a sliding movement of one or more of the user's fingers on the touchscreen may trigger a translation of the selected line.
[0144] In the same way as for rotation, initially only the line can move to follow the user's fingers then, when the translation movement is finished, the instances can be moved on the translated line.
[0145] This therefore makes it possible to easily carry out a translation of the virtual line, applied to all the instances of digital models of street furniture elements associated with it.
[0146] Each of the two ends of the line can also be moved independently, for example by translating a selected end following the user's finger, in order to obtain as fine control as possible over the location of the line.
[0147] Reference is now made to [Fig.5].
[0148] [Fig.5] shows a second example of modification of a virtual line of street furniture elements via a user interface of an augmented reality system in a set of embodiments of the invention.
[0149] In the example of [Fig.5], the user clicks Clk5 on the “+” button of the control sub-zone SZC2.
[0150] This results in the addition of a new Mob4 instance of street furniture element model, in addition to the 3 Mobl, Mob2 and Mob3 instances already present.
[0151] Similarly, clicking on the “-” button in the SZC2 control sub-zone allows you to delete one of the instances from the list.
[0152] This example demonstrates the ease of adding or removing furniture instances urban on the line, in a set of embodiments of the invention.
[0153] Reference is now made to [Fig.6].
[0154] [Fig.6] shows a third example of modification of a virtual line of street furniture elements via a user interface of an augmented reality system in a set of embodiments of the invention.
[0155] In the example of [Fig.6], the user modifies a distance parameter Dist6 between two successive instances among instances Mobl, Mob2 and Mob3. In particular, the distance value between the instances can be increased by pressing the “+” button of the sub-zone SZC3, and decreased by pressing the “-” button of the sub-zone SZC3.
[0156] In order to facilitate the definition of the distance, a scroll bar Def6 may appear, on which the user can perform a sliding movement Glis6 in order to define the distance value between the instances.
[0157] The distance value is applied to all instances on the virtual line. When modifying the distance, whether by the “+” and “-” buttons of the SZC3 sub-zone, or by sliding Glis6, the distance between successive instances can be updated in real time, in order to allow the user to interactively identify the optimal distance value.
[0158] The same principle can be applied, for example to modify the height Haut6 of all the instances simultaneously via the sub-zone SZC4, and / or a scroll bar associated with the sub-zone SZC4, or to modify a rotation angle Rot6 around a vertical axis of all the instances Mobl, Mob2 and Mob3 via the sub-zone SZC5, and / or a scroll bar associated with the sub-zone SZC5.
[0159] Reference is now made to [Fig.7].
[0160] [Fig.7] shows an example of duplication of a virtual line of street furniture elements via a user interface of an augmented reality system in a set of embodiments of the invention.
[0161] In the example of [Fig.7], a user can duplicate a line of street furniture in the following way: - a first click Clk71 on a virtual line (in this example line LV3) allows you to select the line to be duplicated. The control zone ZC then takes all the parameter values (for example number of instances, distance between instances, height, rotation) associated with the line; - a second click Clk72 on the SZC6 control sub-zone triggers the duplication; - a third click Clk73 allows you to duplicate the line, starting from the position Pos73 where the click was made. For example, the line can be created between the position Pos73 and the center of the horizon line, to obtain the virtual line LV7 on which instances of street furniture element models will be placed with the same parameters as the LV3 line.
[0162] Reference is now made to [Fig.8].
[0163] [Fig.8] shows an example of activating a modification mode of a single instance of street furniture via a user interface of an augmented reality system in a set of embodiments of the invention
[0164] In the example of [Fig.8], the user clicks Clk81 on the Mobl instance. The control zone ZC is then modified: - on the one hand to indicate in the SZC1 control sub-zone that the Mobl instance is selected; - on the other hand to display in the SZC6 control zone a button for activating a modification mode for the Mobl instance.
[0165] When the user clicks Clk82 on the SZC6 control sub-area, the Mobl instance modification mode is activated.
[0166] Reference is now made to [Fig.9].
[0167] [Fig.9] shows an example of modifying a single instance of street furniture via a user interface of an augmented reality system in a set of embodiments of the invention.
[0168] In the example of [Fig.9] the Mob3 instance has been selected, and is therefore indicated to the user in the SZC1 control sub-area. More specifically, [Fig.9] shows the modification of the Mob3 instance when the Mob3 instance modification mode is activated.
[0169] When the modification mode of a single instance is activated (in this example the Mob3 instance), the height and rotation of the instance around a vertical axis can be modified using the control sub-zones SZC4 and SZC5, and / or a scroll bar Def9, in the same way that the rotation and height of all the instances can be modified in the example of [Fig.6].
[0170] For example, the user can click Clk91 on the SZC4 control sub-area to change the height of the Mobl instance. A Def9 scroll bar may appear to make it easier to set the height.
[0171] When the modifications are made, the user can click Clk92 on the SZC6 control sub-area to complete the modification of the Mobl instance.
[0172] When single instance editing is enabled, the user sets an offset of a parameter (relative to height or rotation, but this principle is also applicable to other parameters such as position) of an instance relative to the other instances in the line.
[0173] For example, changing the height of the Mobl instance in the example of [Fig.9] allows you to define a height offset between the Mobl instance and the others instances of the line. If the user subsequently changes the overall height of the line instances, all instances will be changed, and the Mobl instance will retain its height offset from the other instances of the line.
[0174] This therefore makes it possible to adjust the parameters of a particular instance, while retaining the possibility of globally modifying the parameters of all instances.
[0175] The present disclosure is not limited to the examples of device, system, method and computer program described above, only by way of example, but it encompasses all the variants that may be envisaged by those skilled in the art within the framework of the protection sought.
Claims
Claims
1. Method (P2) implemented by an augmented reality system (Sysl) comprising: - obtaining (S21) a 3D digital model (ModEnvl) of an environment of the system; - obtaining (S22) at least one 3D digital model (ModMobl) of at least one piece of street furniture; - placing (S23) a plurality of instances of the at least one 3D digital model on a virtual line in the 3D digital model of the environment; - displaying (S24) said plurality of instances and said virtual line superimposed on the environment, or a view of the environment, by at least one user interface of the augmented reality system; - receiving (S25) at least one joint modification of the virtual line and the plurality of instances by the at least one user interface of the augmented reality system.
2. Method according to claim 1, wherein said model of the environment of the system is created from at least one measurement of a sensor (Captl) of the virtual reality system in said environment.
3. The method of claim 1, wherein said sensor of the augmented reality system is a lidar sensor, wherein the model of the system's environment is created from measurements made by the lidar sensor while a user of the system rotates the sensor from a fixed point.
4. Method according to any one of the preceding claims, in which the at least one 3D digital model of the at least one piece of urban furniture is loaded from at least one memory (Meml) of the augmented reality system.
5. Method according to any one of the preceding claims, in which the at least one 3D digital model of the at least one piece of street furniture is received from a server (Servi) in communication with the augmented reality system.
6. A method according to any preceding claim, comprising: - the display, by the at least one user interface, of a set of digital models of urban furniture elements; - the reception, by the at least one user interface, of a selection of the at least one 3D digital model of the at least one urban furniture element from said set.
7. A method according to any preceding claim, wherein the line is initialized towards the center of a line representing the horizon.
8. Method according to any one of the preceding claims, wherein the at least one user interface comprises a touch screen (Ecrl), said method comprising: - displaying, by said touch screen, said plurality of instances, said virtual line and the view of the environment; - detecting finger movements on the touch screen.
9. The method of claim 8, wherein detecting a twisting movement of at least two fingers on the touchscreen causes the virtual line to rotate.
10. Method according to one of claims 8 or 9, in which the detection of a sliding movement of at least one finger on the touch screen causes a translation of the line.
11. Method according to one of claims 9 or 10, in which the detection of a sliding movement of at least one finger on the touch screen causes a translation of one end of the selected line to the position defined by the position of the finger.
12. Method according to one of claims 8 to 11, comprising - the display, by the touch screen, of a control zone (ZC) comprising control sub-zones (SZC1, SZC2, SZC3, SZC4, SZC5, SZC6) - the reception, upon detection of at least one touch of one of the control sub-zones, of at least one relative input • a modification of the number of instances of 3D digital models of street furniture elements on the line; • a modification of the distance between instances of 3D digital models of street furniture elements on the line; • a modification of the height of instances of 3D digital models of street furniture elements; • a modification of a rotation angle around a vertical axis of instances of 3D digital models of street furniture elements on the line; • a duplication of the virtual line and instances of 3D digital models of street furniture elements on the line.
13. Method according to one of claims 8 to 12, comprising - the display, by the touch screen, of a control zone linked to a selected instance of a 3D digital model of an urban furniture element comprising control sub-zones; - the reception, upon detection of at least one touch of one of the control sub-zones, of at least one input relating to: • a modification of an angle of rotation around a vertical axis of the selected instance relative to the other instances on the line; • an offset of the height of the instance relative to the other instances on the line.
14. Virtual reality system (Sysl) comprising: - at least one user interface (Intl); and - at least one computing unit, configured to implement a method according to any one of the preceding claims.
15. Computer program comprising instructions for implementing the method according to claim 1 to 13 when this program is executed by a processor.
16. A non-transitory recording medium readable by a computer on which is recorded a program for implementing the method according to claim 15 when this program is executed by a processor.