Method and apparatus of rendering a lighting effect
The method and apparatus use hierarchical spatial subdivision to control lighting devices for synchronized effects, addressing the challenge of distributed lighting control in media environments, thereby enhancing user experience.
Patent Information
- Application Number
- EP2024185613
- Authority / Receiving Office
- EP · EP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-01
- Publication Date
- 2026-01-07
AI Technical Summary
Existing technologies struggle to effectively control and synchronize lighting effects across multiple distributed lighting devices in an environment to enhance user experience during media consumption.
A method and apparatus that utilize a hierarchical spatial subdivision of an environment to determine lighting control parameters for each device, based on their positions, to render dynamic lighting effects, including synchronized and coordinated effects.
Enables adaptive and immersive lighting experiences by ensuring synchronized lighting effects across devices, regardless of their spatial distribution, enhancing user engagement in media environments.
Smart Images

Figure IMGAF001_ABST
Abstract
Description
FIELD
[0001] The present application generally relates to the field of lighting and, in particular, to the rendering of lighting effect by one or more lighting devices. In particular, the present application relates to a method and device of transmitting lighting control parameters to the one or more lighting devices for the rendering of the lighting effect. The present application also relates to method and apparatus of setting up spatial configuration of the one or more lighting devices.BACKGROUND
[0002] The present section is intended to introduce the reader to various aspects of art, which may be related to various aspects of at least one exemplary embodiments of the present application that is described and / or claimed below. This discussion is believed to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of the present application.
[0003] To improve user experience when playing a media content such as a video content or a video game, it is known to control the lighting of one or more peripherals in the media content playback environment.
[0004] Controlling the lighting of such peripherals may for example increase the feeling of immersion while watching a movie or playing a video game. Such peripherals comprise smart LED light bulbs, RGB (Red, Green, Blue) components and accessories such as LED strips, keyboards, mice, mouse mats, speakers, screens, headsets or even the casing of the media player.
[0005] Lighting effects may be obtained by controlling the one or more light-emitting devices such as LED (Light-Emitting Diode) equipping the one or more peripherals.
[0006] Lighting effects may further be rendered in a determined environment to provide an appropriate ambient lighting
[0007] However, there is still room for improvement to control the various lighting devices, which may be distributed over various locations in a determined environment in order to generate appropriate lighting effects.SUMMARY
[0008] The following section presents a simplified summary of at least one exemplary embodiment in order to provide a basic understanding of some aspects of the present application. This summary is not an extensive overview of an exemplary embodiment. It is not intended to identify key or critical elements of an embodiment. The following summary merely presents some aspects of at least one of the exemplary embodiments in a simplified form as a prelude to the more detailed description provided elsewhere in the document.
[0009] According to a first aspect of the present application, there is provided a method of rendering a lighting effect, the method comprising: receiving first data representative of position of at least a lighting device of a set of lighting devices, the position being defined according to a hierarchical spatial subdivision of an environment comprising the set of lighting devices, the set of lighting devices comprising at least one lighting device; determining lighting control parameters for the at least a lighting device according to the first data and according to second data representative of the lighting effect; and transmitting the lighting control parameters to the at least a lighting device for the rendering of the lighting effect.
[0010] In an exemplary embodiment, the hierarchical spatial subdivision of the environment comprises a plurality of spatial subdivision hierarchical levels each comprising one or more spatial cells, a spatial cell of an upper spatial subdivision hierarchical level comprising a plurality of spatial cells of a lower spatial subdivision hierarchical level.
[0011] In an exemplary embodiment, the method further comprises transmitting second data representative of a position of each light-emitting device of a set of light-emitting devices in the dynamic lighting device, the lighting data being further according to the second data.
[0012] In a further exemplary embodiment, the set of lighting devices is distributed in a plurality of spatial cells of the lowest spatial subdivision hierarchical level of the plurality of spatial subdivision hierarchical levels, the position of the at least a lighting device being defined with respect to a reference point of the spatial cell the at least a lighting device belongs to.
[0013] In another exemplary embodiment, the method being implemented by a control device, the at least a lighting device belongs to the spatial cell comprising the control device.
[0014] In a further exemplary embodiment, the first data is received by the control device from the at least a lighting device, the at least a lighting device being wirelessly coupled to the control device.
[0015] In another exemplary embodiment, the lighting control parameters are further determined according to third data representative of position of the control device in the spatial cell comprising the control device.
[0016] In an additional exemplary embodiment, the method further comprises determining the third data by locating the control device in the spatial cell comprising the control device according to signals received by the control device from the at least a lighting device wirelessly coupled to the control device.
[0017] In another exemplary embodiment, the hierarchical spatial subdivision of the environment comprises 3 spatial subdivision hierarchical levels.
[0018] In a further exemplary embodiment, the method further comprises receiving fourth data representative of characteristics of a set of light-emitting devices comprised in the at least a lighting device, the lighting control parameters being further determined according to the fourth data.
[0019] In an additional exemplary embodiment, the set of light-emitting devices comprising a plurality of light-emitting devices, said fourth data comprises information representative of a spatial arrangement of the plurality of light-emitting devices in the at least a lighting device.
[0020] In another exemplary embodiment, the environment corresponds to a two-dimensional environment.
[0021] In another exemplary embodiment, the environment corresponds to a three-dimensional environment.
[0022] According to a second aspect of the present application, there is provided a device or an apparatus comprising a memory associated with at least a processor configured to implement the method in accordance with the first aspect of the present application.
[0023] According to a third aspect of the present application, there is provided a computer program product including instructions which, when the program is executed by one or more processors, causes the one or more processors to carry out a method according to the first aspect of the present application.
[0024] According to a fourth aspect of the present application, there is provided a non-transitory storage medium carrying instructions of program code for executing a method according to the first aspect of the present application.
[0025] The specific nature of at least one of the exemplary embodiments as well as other objects, advantages, features and uses of said at least one of exemplary embodiments will become evident from the following description of examples taken in conjunction with the accompanying drawings.BRIEF DESCRIPTION OF THE DRAWINGS
[0026] Reference will now be made, by way of example, to the accompanying drawings which show exemplary embodiments of the present application, and in which: Figure 1 shows a schematic representation of a hierarchical spatial subdivision of an environment, in accordance with at least one exemplary embodiment; Figure 2 shows a schematic representation of a hierarchical spatial subdivision of another environment, in accordance with at least one exemplary embodiment; Figure 3 shows operations of a process of rendering a lighting effect in the environment of figure 2, in accordance with at least one exemplary embodiment; Figure 4 shows an example of a system comprising a control device and a lighting device of the environment of figure 2, in accordance with at least one exemplary embodiment; Figure 5 shows the rendering of a lighting effect in another environment, in accordance with at least one exemplary embodiment; Figure 6 shows a schematic block diagram of step(s) of a method of rendering a lighting effect in the environment of figure 1, 2 or 5, in accordance with at least one exemplary embodiment; Figure 7 illustrates a schematic block diagram of an example of a system or apparatus in which various aspects and exemplary embodiments are implemented.
[0027] Similar reference numerals may have been used in different figures to denote similar components.DESCRIPTION OF EXEMPLARY EMBODIMENTS
[0028] At least one of the exemplary embodiments is described more fully hereinafter with reference to the accompanying figures, in which examples of at least one of the exemplary embodiments are illustrated. An exemplary embodiment may, however, be embodied in many alternate forms and should not be construed as limited to the examples set forth herein. Accordingly, it should be understood that there is no intent to limit exemplary embodiments to the particular forms disclosed. On the contrary, the disclosure is intended to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the present application.
[0029] Exemplary embodiments described hereinafter may be combined with each other or each of the exemplary embodiment may be individually implemented, e.g., as an alternative embodiment.
[0030] At least one of the aspects generally relates to a method and apparatus of rendering a lighting effect. The apparatus may correspond to a control device configured to determine lighting control parameters to control one or more lighting devices. A lighting device corresponds to any device configured to emit light (lamp, light bulb, strip of LEDs or any peripheral or device incorporating one or more light sources, e.g., RGB light sources (for example arrangement of LEDs)) that is configured to be controlled by the control device to render a lighting effect. The lighting effect may be dynamic, i.e., the lighting effect may vary over time and / or space.
[0031] The method comprises receiving first data representative of the position of one or more lighting devices of a set of lighting devices, the position being defined according to or with reference to a hierarchical spatial subdivision of a two-dimensional (2D) or three-dimensional (3D) environment, which comprises the set of lighting devices. The set of lighting devices is spatially distributed in various spatial cells or spaces of the environment. The first data is received from the one or more lighting devices, from a memory of the apparatus implementing the method or from a remote device corresponding for example to a server.
[0032] Lighting control parameters are determined for each of the one or more lighting devices according to the first data and according to second data representative of the lighting effect, the second data comprising lighting parameters such as brightness, color, color temperature, time or duration of lighting, etc.
[0033] The lighting control parameters are transmitted to each of the one or more lighting devices, e.g., wirelessly, enabling the one or more lighting devices to render the lighting effect.
[0034] A lighting effect corresponds to any generation of light through one or more lighting devices. The lighting effect may correspond to a simple lighting effect (e.g., involving a single light-emitting device) or a more complex lighting effect involving a single or various light-emitting devices to render a light animation with time and / or spatial control of the light source(s) incorporated in the one or more light-emitting devices. Examples of complex lighting effect comprise a synchronized lighting effect, a coordinated lighting effect, an animated lighting effect, a propagating wave lighting effect, a breathing lighting effect, and a spectrum lighting effect.
[0035] At least another one of the aspects generally relates to a method and apparatus of controlling one or more lighting devices according to the lighting control parameters to render one or more lighting effects, the lighting control parameters being according to the respective position of the one or more lighting devices, the respective position being encoded by referring to a hierarchical spatial subdivision of an environment comprising the one or more lighting devices.
[0036] Figure 1 illustrates a schematic representation of the spatial subdivision of an environment 10 in accordance with at least one exemplary embodiment.
[0037] The environment 10 corresponds to any 3D environment that can be described with various hierarchical levels of spatial subdivision. The environment 10 corresponds to any volume of any size and any form, e.g., a rectangular parallelepiped as illustrated in figure 1 or a sphere, a cube, an irregular solid.
[0038] The environment 10 corresponds for example to the world, to a country, a city, a block or district of a town, a building, a house, a floor of a house or a building, etc.
[0039] The hierarchical spatial subdivision of the environment 10 comprises a plurality of spatial subdivision hierarchical levels. Each hierarchical level of the hierarchical spatial subdivision of the environment 10 is composed of one or more spatial cells, a spatial cell corresponding to a volume of any size and any form.
[0040] A spatial cell of an upper spatial subdivision hierarchical level comprises a plurality of spatial cells of a lower spatial subdivision hierarchical level. The highest hierarchical level of the spatial subdivision levels comprises a single spatial cell.
[0041] As illustrated in Figure 1, the highest hierarchical level (called level 0) comprises the spatial cell 1 drawn with flat lines. The hierarchical level (called level 1) below the highest hierarchical level (level 0) comprises two or more spatial cells, e.g., 2 spatial cells 11 and 12 as illustrated in Figure 1. The spatial cells 11, 12 may be identical (same size and same shape or form) or different, i.e., with a different size and / or a different shape. Both spatial cells 11, 12 fill all or part of the volume of the spatial cell 1. Each spatial cell 11, 12 is subdivided into the same number of spatial cells or into different numbers of spatial cells to form the lower hierarchical level, called level 2. For example, the spatial cell 11 is subdivided into spatial cells 111, 112 while the spatial cell 12 is not subdivided, the spatial subdivision of this part of the environment 10 ending with the spatial cell 12 (level 1) while the spatial subdivision of the part of the environment comprising the spatial cell 11 proceeds further with the spatial cells 111, 112. According to another example, not illustrated in Figure 1, the spatial cell 12 may be subdivided into 2 or more spatial cells.
[0042] The hierarchical structure of the spatial representation of the environment 10 is as follows: Level 0 (highest hierarchical level) comprises a single spatial cell 1; Level 1 (hierarchical level below level 0) comprises 2 spatial cells 11, 12; Level 2(hierarchical level below level 1) comprises 2 spatial cells 111, 112.
[0043] The number of hierarchical levels of the spatial representation of the environment 10 is equal to 3 but not limited to this number. The number of hierarchical levels of a spatial representation of an environment may be equal to any number greater than or equal to 2, e.g., 2, 3, 5 or more.
[0044] Each hierarchical level is identified with a unique identifier, e.g., a value or a word. For example, level 0 may be identified as corresponding to "Universe", level 1 as corresponding to "World" and level 2 as corresponding to "Space".
[0045] Each spatial cell of a hierarchical level is identified with a unique identifier, e.g., a value encoded in 8 bits (value comprised between 0 and 255). According to this example, level 0 may comprise up to 256 spatial cells, each identified with a unique identifier. Each spatial cell of level 1 may comprise up to 256 spatial cells, each identified with a unique identifier. Each spatial cell of level 2 may comprise up to 256 spatial cells, each identified with a unique identifier, and so on.
[0046] A spatial cell may be defined or described with a set of attributes comprising the identifier of the spatial cell and the position of the spatial cell. The attributes may further comprise the number of spatial cells in said spatial cell and optionally the size of said spatial cell.
[0047] The position of each spatial cell is defined with respect to the spatial cell of the upper hierarchical it belongs to. The position of a given spatial cell may correspond to the position of a reference point belonging to this given spatial cell. The reference point may for example correspond to the bottom left front corner.
[0048] According to the example of Figure 1, the position of the spatial cell 1 of level 0 corresponds to the position of reference point O 1 . The spatial cell 1 belonging to the highest hierarchical level is for example fixed to (0,0,0).
[0049] The position of the spatial cell 11 of level 1 corresponds to the position of reference point O 11 . This position is defined in the frame of reference of the spatial cell 1 the spatial cell 11 belongs to, i.e., in the 3D coordinate system associated with the spatial cell 1. The 3D coordinate system of spatial cell 1 is represented with orthonormal axis X, Y and Z, the origin of this coordinate system corresponding for example to the reference point O 1 of spatial cell 1. The position of the spatial cell 11 is defined with 3 values corresponding to the distance between the reference point O 11 of the spatial cell 11 and the reference point O 1 of the spatial cell 1 according to each axis X, Y and Z. The position of the spatial cell 11 is expressed with a vector with 3 components, i.e., (Dx, Dy, Dz) with Dx corresponding to the distance along the X axis, Dy the distance along the Y axis and Dz the distance along the z axis. In a similar way, the position of the spatial cell 12 of level 1 corresponds to the position of reference point O 12 , this position being defined in the frame of reference of the spatial cell 1.
[0050] The position of the spatial cell 111 (respectively spatial cell 112) of level 2 corresponds to the position of reference point O 111 (respectively O 112 ). This position is defined in the frame of reference of the spatial cell 11 the spatial cell 111 (respectively spatial cell 112) belongs to, i.e., in the 3D coordinate system associated with the spatial cell 11. The 3D coordinate system of spatial cell 11 is represented with orthonormal axis X, Y and Z, the origin of this coordinate system corresponding for example to the reference point O 11 of spatial cell 11. The position of the spatial cell 111 (respectively spatial cell 112) is defined with 3 values corresponding to the distance between the reference point O 111 (respectively O 112 ) of the spatial cell 111 (respectively spatial cell 112) and the reference point O 11 of the spatial cell 11 according to each axis X, Y and Z.
[0051] The size of a spatial cell is for example defined with a set of 3 values each corresponding to a dimension of the spatial cell according to each axis X, Y and Z.
[0052] Even if not illustrated in Figure 1, each spatial cell 111, 112 of the lowest hierarchical level (i.e., level 2) comprises one or more lighting devices.
[0053] Each lighting device of a spatial cell of the lowest hierarchical level may be identified with respect to the spatial cell it belongs to and to the spatial cells of the upper hierarchical level(s) the spatial cell comprising the lighting device belong(s) to.
[0054] The position of a lighting device located in the spatial cell 111 (respectively spatial cell 112) is defined via first data representative of the position in the frame of reference of this spatial cell 111 (respectively spatial cell 112) with respect to the reference point O 111 (respectively reference point O 112 ) of this spatial cell 111 (respectively spatial cell 112). The first data may correspond to a set of values each representative of a distance between the lighting device and the reference point O 111 (respectively reference point O 112 ) along each axis X, Y and Z.
[0055] A lighting device corresponds to: a device whose primary function is to illuminate the spatial cell it belongs to; or a device configured to implement several functions, including the ability to reproduce a lighting device through the one or more light sources it embeds.
[0056] Examples of lighting devices include light fixtures, wall-mounted lights, ceiling-mounted lamps, floor-standing lamps, desk lamps, LED light strips, display devices, peripheral devices such as keyboard or mouse, gaming mat, mouse mat, palm rest, chair, desk, XR headset, headphones, bracelet, head and / or lumbar support device or chair.
[0057] The lighting device advantageously correspond to a connected lighting device, i.e., a lighting device comprising a communication interface configured to communicate (receive and / or transmit) data with a data processing device, e.g., via wired or wireless connection.
[0058] Figure 2 illustrates a schematic representation of the spatial subdivision of an environment 20 in accordance with at least one exemplary embodiment.
[0059] The environment 20 corresponds for example to a 2D environment. According to another example, the environment 20 corresponds to a 2D representation of a 3D environment, e.g., to a projection of a 3D environment, for example a projection of a part of the environment 10 according to the Z axis.
[0060] The hierarchical spatial representation of the environment 20 as illustrated in Figure 2 comprises 2 hierarchical levels, i.e., a first level (highest hierarchical level) comprising a single spatial cell and a second level (hierarchical level below the first level) comprising 3 spatial cells 21, 22, 23.
[0061] The first level may correspond to level 0 (i.e., the highest hierarchical level of the spatial representation of the environment 20) or to an intermediary hierarchical level, the environment 20 corresponding to a part only of a bigger environment (e.g., a part of the environment 10 of Figure 1).
[0062] The spatial cell 2 corresponds for example to a floor of a building and the 3 spatial cells 21, 22, 23 each correspond to a room of the floor. According to this example, the spatial cell 2 may be one of several spatial cells (each corresponding to a determined floor of the building) belonging to a spatial cell of an upper hierarchical level (corresponding for example to the building).
[0063] A set of lighting devices are spatially distributed in the different spatial cells 21, 22, 23, as follows: Spatial cell 21 comprises the lighting devices 211, 212, 213 and 214; Spatial cell 22 comprises the lighting devices 221, 222, 223 and 224; and Spatial cell 23 comprises the lighting devices 231, 232 and 233.
[0064] The number of lighting devices comprised in a spatial cell may be any number greater than or equal to 0.
[0065] Each lighting device 211 to 214, 221 to 224 and 231 to 233 comprises one or more light sources, such as LED (light-emitting diode), to generate light according to lighting control parameters received from a control device (not illustrated in Figure 2), e.g., wirelessly.
[0066] The lighting devices 211 to 214, 221 to 224 and 231 to 233 may correspond to dynamic lighting devices, i.e., lighting devices configured to emit light dynamically over time according to the received lighting control parameters or according to lighting control parameters of one or more lighting scenarios / lighting effects stored in a memory of the dynamic lighting device.
[0067] In an embodiment, the lighting devices 211 to 214, 221 to 224 and 231 to 233 each correspond to a spatial cell, the set of lighting devices forming the lowest hierarchical level of the hierarchical spatial representation of the environment 20.
[0068] The position of each lighting device 211 to 214, 221 to 224 and 231 to 233 is defined according to the hierarchical spatial subdivision of the environment 20 as describe hereinabove with reference to Figure 1.
[0069] The position of a lighting device is defined with respect to the spatial cell it belongs to. According to the example of Figure 2: The position of each of the lighting devices 211, 212, 213 and 214 is defined in the frame of reference of the spatial cell 21 they belong to, e.g., with respect to the reference point O 21 corresponding to the origin of the coordinate system of the spatial cell 21; The position of each of the lighting devices 221, 222, 223 and 224 is defined in the frame of reference of the spatial cell 22 they belong to, e.g., with respect to the reference point O 22 corresponding to the origin of the coordinate system of the spatial cell 22; and The position of each of the lighting devices 231, 232 and 233 is defined in the frame of reference of the spatial cell 23 they belong to, e.g., with respect to the reference point O 23 corresponding to the origin of the coordinate system of the spatial cell 23.
[0070] First data representative of the position of each lighting device may be stored in a memory of the considered lighting device.
[0071] According to a variant, first data representative of the position of each lighting device of the set of lighting devices is stored in a memory of a data processing device such as a smartphone, a tablet, a laptop, a computer or a server.
[0072] The first data is for example generated during a mapping of the environment 10, 20 comprising the lighting devices and / or during a setup operation of the environment 10, 20.
[0073] The mapping / setting of the environment 10, 20 comprises generating the hierarchical spatial subdivision of an environment with the various hierarchical levels and associated spatial cells. The mapping further comprises associating attributes with each of the spatial cells of the environment 10, 20 and with each lighting device comprised in the environment 10, 20.
[0074] Attributes associated with a spatial cell may comprise one or more of the followings: An identifier of the hierarchical level the spatial cell belongs to; An identifier of the spatial cell in the hierarchical level; A position of the spatial cell defined according to the hierarchical spatial subdivision of the environment, the position of the spatial cell being defined in the frame of reference of the spatial cell of the upper hierarchical level, except for the single spatial cell of the highest hierarchical level; A size of the spatial cell (e.g., width, height and depth).
[0075] Attributes associated with a lighting device may comprise one or more of the followings: An identifier of the hierarchical level / spatial cell the lighting device belongs to; An identifier of the lighting device in the spatial cell it belongs to; A position of the lighting device in the spatial cell comprising it, the position being defined according to the hierarchical spatial subdivision of the environment, the position of the lighting device being defined in the frame of reference of the spatial cell comprising the lighting device; A size of the lighting device (e.g., width, height and depth).
[0076] In an embodiment, further attributes (which may correspond to intrinsic parameters of the lighting device) are associated with the lighting device, for example one or more of the followings: The number of light-emitting device(s) comprised in the lighting device; The spatial arrangement of the light-emitting devices in the lighting device (e.g., a line, a matrix with N columns and M rows, etc.); Brightness values / interval that the lighting device is configured to render; Color associated with each light-emitting device; Color temperature associated with each light-emitting device; Update frequency or refresh rate.
[0077] The mapping / setting of the environment 10, 20 is for example performed via a mapping application running on a data processing device such as a smartphone, a tablet, a laptop, a computer or a server.
[0078] At least a part of the attributes associated with the lighting devices is transmitted to each of the lighting devices, each of the lighting devices receiving this data (among which first data representative of the position) storing it in a memory of the lighting device. The communication of the data representative of the attributes (notably the first data) is performed via a wired connection (e.g., USB) or via a wireless connection (e.g., Bluetooth ®< , Zigbee ®< , Wifi ®< ).
[0079] Figure 3 shows a process of rendering a lighting effect in the environment 20 in accordance with at least one exemplary embodiment.
[0080] The process is described according to an embodiment in which a user moves from a first spatial cell 21 (e.g., a room of an apartment or a house) to a second spatial cell 23 (e.g., another room).
[0081] According to this embodiment, each lighting device 211 to 214 and 231 to 233 stores first data representative of its position in respectively the first spatial cell 21 and the second spatial cell 23.
[0082] The process is implemented by one or more control devices 31, 32. In an embodiment, the process is implemented by one and a same control device moving with the user from the first spatial cell 21 to the second spatial cell 23. In another embodiment, the process is implemented by two different control devices, namely by a first control device 31 located in the first spatial cell 21 and by a second control device 32 located in the second spatial cell 23.
[0083] Each control device 31, 32 is configured to be communicatively coupled to lighting device(s) through wired connection (e.g., via USB (Universal Serial Bus) input terminal, via a phone connector (also known as phone jack, audio jack, headphone jack or jack plug) input terminal or via an HDMI input terminal) or through wireless connection (e.g., Bluetooth ®< , Wifi ®< or Zigbee ®< ).
[0084] Data exchange between the control device 31, 32 and the lighting devices is performed in the framework of a communication protocol, data being exchanged by way of APIs (Application Program Interface) that may be implemented both in the control device 31, 32 and in the lighting devices.
[0085] The control device 31, 32 corresponds to any processing device configured to control the rendering of lighting data by the lighting devices via the determining or generating of lighting control parameters to be transmitted to the lighting devices.
[0086] The control device 31, 32 may correspond to a personal computer, laptop, game consol, set-top box, mobile communication device such as a smartphone or a tablet. The control device 31, 32 may be configured to run one or more software applications including a chroma engine configured for the rendering of the lighting effect, i.e., by generating the lighting control parameters to be transmitted to the lighting devices.
[0087] The process starts with the user being in the first spatial cell 21.
[0088] In a first operation, the first control device 31 receives from each of the lighting devices 211, 212, 213 and 214 first data representative of the position of the considered lighting device in the first spatial cell 21.
[0089] Depending on the type of the lighting device and / or on the type of the first control device 31, the first data is transmitted by the lighting device to the first control device 31 through wired connection (e.g., USB or HDMI) or wireless connection (e.g., Bluetooth ®< ).
[0090] For example, when the first control device 31 corresponds to a computer, some of the lighting devices may be connected to the first control device via USB or HDMI. For example, such lighting devices correspond to peripheral devices such as a keyboard, a mouse, a display device. Other lighting devices may be wirelessly connected to the first control device 31. For example, such lighting devices correspond to connected lamps, light strips.
[0091] When the first control device 31 corresponds to a mobile device such as a game console, a smartphone, a tablet, all the lighting devices are wirelessly connected to the first control device 31.
[0092] The first data is for example received automatically from the lighting devices 211 to 214 when switching on the first control device 31 or when executing the software application requiring the rendering of lighting effects. For example, when connecting the lighting devices 211 to 214 to the first control device 31, the first control device 31 and each of the lighting devices 211 to 214 automatically initiate a process for communicating the first data through dedicated API(s). This process corresponds for example to a so-called "plug and play" (PnP) process, the first control device 31 and the lighting devices 211 to 214 corresponding to PnP devices.
[0093] According to another example, the first data is received in response to a request for receiving the first data, the request being transmitted by the first control device 31 to the lighting devices 211 to 214.
[0094] In an embodiment, the first control device 31 receives additional data from the lighting devices 211 to 214 with the first data. This additional data is representative of characteristics of each lighting device 211 to 214 and comprises information representative of a spatial arrangement of a plurality of light-emitting devices (e.g., LEDs) in each lighting device 211 to 214, where applicable.
[0095] The additional data comprises for example one or more of the following data, in any possible combination: data representative of a position of each light-emitting device, e.g., a LED, of a set of light-emitting devices comprised in the lighting device; the data indicates the relative position of the one or more light-emitting devices arranged in or on the lighting device; this data is for example defined in the frame of reference of the lighting device, the lighting device being seen as forming a spatial cell of the lowest hierarchical level of the spatial representation of the environment 20; and / or data representative of the number of light-emitting devices comprised in the dynamic lighting device; and / or data representative of the type and / or lighting characteristics of the light-emitting devices comprised in the lighting device; and / or data representative of the type, characteristics and / or configuration of the lighting device, e.g., the dimensions of the lighting device.
[0096] In a second operation, the first control device 31 processes the first data, and optionally the additional data where applicable, to determine lighting control parameters for each of the lighting devices 211 to 214. The determining of the lighting control parameters is further according to second data representative of the lighting effect to be rendered.
[0097] The second data is for example received or obtained by the first control device 31 from a memory of the first control device 31 or from a remote device (e.g., a server or a computer) communicatively coupled to the first control device 31.
[0098] The second data is for example representative of: a lighting content associated with a game running on the first control device 31, e.g., lighting effects to be rendered at particular times of the game or with particular events occurring when playing the game to improve the feeling of immersion and / or lighting effects derived from the video content of the game itself and / or a lighting ambience associated with the game; or a video content rendered by the first control device 31, e.g., lighting effects to be rendered at particular times of the video and / or lighting effects derived from the video content itself and / or a lighting ambience associated with the video; or an audio content rendered by the first control device 31, e.g., lighting effects to be rendered at particular times of the audio content and / or lighting effects derived from the audio content itself (derived from the characteristics of the audio signal for example) and / or a lighting ambience associated with the audio content; or a lighting effect selected by the user via an HMI (Human-Machine Interface) of the first control device 31 among a plurality of lighting effects stored in a memory of the first control device 31.
[0099] The second data is for example representative of lighting parameters corresponding to one or more of the following parameters: parameters representative of brightness or luminous intensity, for example defined in candela (cd); and / or parameters representative of color, for example specified in a determined color space like RGB (Red, Green, Blue) color model or CMYK (Cyan Magenta Yellow, Black) color model, a color value being for example coded in 8 or 10 bits for each color of the color model; and / or parameters representative of color temperature, defined in Kelvin (K); and / or timing parameters representative of the timing of the lighting effect, e.g., when the lighting effect is to be rendered or timing information for temporally controlling the lighting devices and optionally the light-emitting devices comprised in the lighting devices, e.g., for switching on or off the lighting devices and associated light-emitting devices; and / or parameters representative of the frequency of the lighting effect (e.g., for flickering lighting effect).
[0100] The lighting control parameters are determined or adjusted for each of the lighting devices 211 to 214 of the first spatial cell 21 for rendering the haptic effect according to the position of each of the lighting devices 211 to 214, and according to the position of the light-emitting devices comprised in each of the lighting devices 211 to 214, where applicable.
[0101] In an embodiment, the lighting control parameters are further determined according to third data representative of a position of the first control device 31 in the first spatial cell 21.
[0102] The position of the first control device 31 is for example stored in a memory of the first control device 31, the position being for example defined according to the hierarchical spatial subdivision of the environment 20, just like the lighting devices 211 to 214. The position of the first control device 31 is for example determining during the mapping / setting of the environment 20, especially when the first control device 31 corresponds to a static device such as a computer, a server or a set-top box.
[0103] According to another example, the position of the first control device 31 is determined from the type of the spatial cell and / or type of the lighting devices comprised in the spatial cell. For example, when the spatial cell corresponds to a living room with a sofa and a TV set, the position of the first control device 31 is likely to be between the sofa and the TV set. When the spatial cell corresponds to a gamer room with a display screen, the position of the first control device 31 is likely to be in front of the display screen.
[0104] According to another example, the position of the first control device 31 is determined from signals received from the lighting devices (e.g., when receiving the first data). Knowing the position of each of the lighting devices 211 to 214 via the received data, the position of the first control device 31 may be derived from the characteristics of the signal received from each of the lighting devices 211 to 214. According to a variant, the first control device 31 initiates a determining of its position using a method like high accuracy distance measurement (HADM) with Bluetooth LE (BLE) or similar methods.
[0105] In a third operation of the process, the first control device 31 transmits the lighting control parameters that have been determined or adjusted in the second operation to each of the lighting devices 211 to 214.
[0106] The transmission of the lighting control parameters to a considered lighting device allows the first control device 31 to control the considered lighting device and to control light emission by the considered lighting device. The transmission may be timely synchronized (according to the timing parameters) to control successively, in a temporal way, the lighting devices 211 to 214 to render or generate a complex lighting effect such as a synchronized lighting effect, a coordinated lighting effect, an animated lighting effect, a propagating wave lighting effect, a breathing lighting effect, and a spectrum lighting effect. In this respect, the present application relates to a method and system of controlling one or more lighting device by a control device for the rendering of a lighting effect according to the spatial position of the one or more dynamic lighting devices.
[0107] The process proceeds further with the moving of the user from the first spatial cell 21 to the second spatial cell 23.
[0108] When the first control device 31 corresponds to a static device such as a set-top box, a computer or a server, the process proceeds further with a second control device 32 that is different from the first control device 31.
[0109] When the first control device 31 corresponds to a mobile device such as a game controller, a laptop, a tablet or a smartphone, the process proceeds further with a second control device 32 being the first control device or with a second control device 32 different from the first control device 31.
[0110] For example, the user is playing a video game, starts playing on a computer (corresponding to the first control device 31) in the first spatial cell 21, stops the session on the computer, takes a game controller (corresponding to the second control device 32) and moves to the second spatial cell 23 to continue playing the video game on the game controller in the second spatial cell 23.
[0111] According to another example, the user is watching at a movie on a TV set in the first spatial cell 21, the data of the movie being streamed from a server to a set-top box (corresponding to the first control device 31) connected to the TV set or being part of the TV set. The user pauses the movie then moves to the second spatial cell 23, then resumes playback of the movie on a tablet (corresponding to the second control device 32) in the second spatial cell 23. According to a further example, the user is watching at a movie on a tablet (corresponding to the first control device 31) in the first spatial cell 21, then moves to the second spatial cell 23 with the tablet and continues to watch at the movie on the tablet (the second control device 32 illustrated on Figure 3 then corresponds to the first control device 31, the first and second control device 31, 32 being one and a same device).
[0112] The first, second and third operations are reiterated with the second control device 32 replacing the first control device and the lighting devices 231 to 232 of the second spatial cell 23 replacing the lighting devices 211 to 214 of the first spatial cell 21.
[0113] The storing of the attributes, especially the first data representative of the position of each of the lighting devices, in a memory of the lighting device enables a control device configured to control the rendering of a lighting effect to: receive the first data from each lighting device comprised in the spatial cell comprising the control device; adjust the lighting effect to be rendered in the spatial cell according to the position of each of the lighting device having transmitted its position, by determining lighting control parameters for each lighting device according to the first data and second data representative of the lighting effect to be rendered; and transmit the lighting control parameters to each of the lighting devices of the spatial cell to render the lighting effect.
[0114] The rendering of the lighting effect is thus adapted to the spatial cell the control device is located in and to the spatial arrangement of the lighting devices in the spatial cell, even when the control device is not a priori aware of the spatial configuration of the lighting devices in the spatial cell. When the control device moves from a spatial cell to another spatial cell of the environment 10, 20, the control device may adapt the rendering of the lighting effect to the spatial configuration of the lighting devices of the spatial cell it is moving in by receiving the position of the lighting devices in the spatial cell, for example from the lighting devices themselves.
[0115] This allows the control device (e.g., via a lighting control application running on the control device) to take into account the position of each of the lighting devices of the spatial cell comprising the control device when computing or determining lighting effect(s), especially dynamic lighting effects, to be dynamically rendered by the lighting devices. This is especially useful for complex lighting effects, i.e., lighting effects with spatially and temporally synchronized rendering between the various lighting devices. Examples of complex lighting effect comprise a synchronized lighting effect, a coordinated lighting effect, an animated lighting effect, a propagating wave lighting effect, a breathing lighting effect, and a spectrum lighting effect.
[0116] Figure 4 illustrates a system 4 comprising a control device 41 communicatively coupled to a lighting device 42 in accordance with exemplary embodiments.
[0117] The system 4 is configured to implement a communication process between the control device 41 and the lighting device 42. The communication process may be a part of a process of controlling the lighting device 42 for the rendering of a lighting effect by the lighting device 42 (or the plurality of lighting devices, where applicable).
[0118] The system 4 is illustrated on figure 4 with a single lighting device 42. However, the system 4 may comprise a plurality of lighting devices each communicatively coupled to the control device 41.
[0119] The system 4 is configured to implement the operations described in reference to figures 3 and 5 and / or the steps of the method described in referent to figure 6 according to exemplary embodiments.
[0120] Figure 5 shows a process of rendering a lighting effect in an environment 5 in accordance with at least one exemplary embodiment.
[0121] The environment 5 corresponds for example to a building with a ground floor 53 and 3 floors. The ground floor comprises for example interior lighting corresponding to a LED light strip 531 and each of the upper floors comprising a LED light strip 521 to 523 used as exterior lighting of the building. The building further comprises a display device 511 arranged on the facade of the upper part of the building.
[0122] In an embodiment, the environment 5 corresponds to a 3D environment with the following hierarchical spatial subdivision or hierarchical representation: Level 0 (highest hierarchical level) comprises a single spatial cell 50 illustrated with flat lines; Level 1 (hierarchical level below level 0) comprises 3 spatial cells 51, 52 and 53 illustrated with dotted lines, each spatial cells comprising one or more lighting devices: spatial cell 51 comprises one lighting device 511, spatial cell 52 comprises 3 lighting devices 521, 522, 523 and spatial cell 53 comprises one lighting device 531.
[0123] In another embodiment, the hierarchical spatial subdivision or hierarchical representation of environment 5 comprises 3 hierarchical levels, as follows: Level 0 (highest hierarchical level) comprises a single spatial cell 50 illustrated with flat lines; Level 1 (hierarchical level below level 0) comprises 3 spatial cells 511, 52 and 531; Level 2 (hierarchical level below level 1) comprises 3 spatial cells 521, 522 and 523 in the spatial cell 52.
[0124] According to this embodiment, the lighting devices 511, 521 to 523 and 531 are considered to be spatial cells of the lowest hierarchical level, the lowest hierarchical level corresponding to level 1 for spatial cells 511 (replacing the spatial cell 51) and 531 (replacing the spatial cell 53), the lowest hierarchical level corresponding to level 2 for spatial cells 521, 522 and 523.
[0125] The lighting devices 511, 521 to 523 and 531 are controlled by a control device, not illustrated in Figure 5.
[0126] The control device corresponds for example to a computer, or a server communicatively coupled to the lighting devices 511, 521 to 523 and 531 through a network architecture comprising wired and / or wireless links.
[0127] In a first operation, the control device receives first data representative of the position of each of the lighting devices 511, 521 to 523 and 531.
[0128] The first data is for example retrieved from a memory or register of the control device.
[0129] According to another example, the first data is received from a remote device (e.g., a server) communicatively coupled to the control device. The first data is for example received after transmission of a request by the control device to the remote device to obtain the hierarchical representation of the environment 5. The environment 5 corresponds for example to a building of a town or of a block of a town, the remote device storing data representative of the hierarchical spatial subdivision (or hierarchical representation) or all or parts of the buildings of the town or town block. The request comprises an identifier of the environment 5.
[0130] The first data is for example stored in a memory of the control device and / or in a memory of the remote device but is not stored in each of the lighting devices 511, 521 to 523 and 531. According to a variant, the first data is also stored in a memory of each of the lighting devices 511, 521 to 523 and 531.
[0131] In a second operation, the control device determines lighting control parameters for each of the lighting devices 511, 521 to 523 and 531 according to the first data describing the position of each of the lighting devices 511, 521 to 523 and 531 and according to second data representative of the lighting effect.
[0132] The second data received in input corresponds to the second data described hereinabove with respect to figure 3. The second data is for example representative of a dynamic ambient lighting to be rendered by the lighting devices 511, 521 to 523 and 531.
[0133] In an embodiment, the lighting control parameters are determined according to fourth data representative of characteristics of the light-emitting devices comprised in each of the lighting devices 511, 521 to 523 and 531, the fourth data comprises information representative of a spatial arrangement of the light-emitting devices in each of the lighting devices 511, 521 to 523 and 531 (i.e., a matrix of LED for the display device 511 and a line of LED for the LED light strips 521 to 523 and 524. The fourth data may further comprise information representative of a number of light-emitting devices comprised in each of the lighting devices 511, 521 to 523 and 531.
[0134] In a third operation, the lighting control parameters are transmitted to each of the lighting devices 511, 521 to 523 and 531.
[0135] Figure 6 shows a schematic block diagram of steps of a method of rendering a lighting effect, in accordance with at least one exemplary embodiment.
[0136] In a first step 61, first data representative of position of at least a lighting device of a set of lighting devices is received, the position being defined according to a hierarchical spatial subdivision of an environment comprising the set of lighting devices, the set of lighting devices comprising at least one lighting device.
[0137] In a second step 62, lighting control parameters are determined for the at least a lighting device according to the first data and according to second data representative of the lighting effect.
[0138] In a third step 63, the lighting control parameters are transmitted to the at least a lighting device for the rendering of the lighting effect.
[0139] According to an exemplary embodiment, the variants and examples of operations described in relation to one of Figures 1 to 5 apply to the method steps of Figure 6.
[0140] Figure 7 shows a schematic block diagram illustrating an example of an apparatus or system 7 in which various aspects and exemplary embodiments are implemented.
[0141] System 7 may be embedded as one or more devices including the various components described below. In various embodiments, the system 7 may be configured to implement one or more of the aspects described in the present application.
[0142] Examples of equipment that may form all or part of the system 7 include personal computers, laptops, smartphones, tablet computers, digital multimedia set top boxes and their associated processing systems, display devices, light-emitting devices, servers, chroma encoders, chroma decoders, video encoders, video decoders, post-processors processing output from a chroma and / or video decoder, pre-processors providing input to chroma and / or video encoder, web servers, set-top boxes, wireless (e.g., Bluetooth ®< ) connected wearable devices, game controller, mouse, mousepad, keyboard, palm rest, chairs, desk, XR headset, headphones, bracelet, head and / or lumbar support device or chair, any other device for processing chroma (lighting) data or signals, and / or video data or signals, or other communication devices. Elements of system 7, singly or in combination, may be embodied in a single integrated circuit (IC), multiple ICs, and / or discrete components. For example, in at least one embodiment, the processing and encoder / decoder elements of system 7 may be distributed across multiple ICs and / or discrete components. In various embodiments, the system 7 may be communicatively coupled to other similar systems, or to other electronic devices, via, for example, a communications bus or through dedicated input and / or output ports.
[0143] The system 7 may include at least one processor 71 configured to execute instructions loaded therein for implementing, for example, the various aspects described in the present application. Processor 71 may include embedded memory, input output interface, and various other circuitries as known in the art. The system 7 may include at least one memory 72 (for example a volatile memory device and / or a non-volatile memory device). System 7 may include a storage device 74, which may include non-volatile memory and / or volatile memory, including, but not limited to, Electrically Erasable Programmable Read-Only Memory (EEPROM), Read-Only Memory (ROM), Programmable Read-Only Memory (PROM), Random Access Memory (RAM), Dynamic Random-Access Memory (DRAM), Static Random-Access Memory (SRAM), flash, magnetic disk drive, and / or optical disk drive. The storage device 74 may include an internal storage device, an attached storage device, and / or a network accessible storage device, as non-limiting examples.
[0144] The system 7 may include an encoder / decoder module 73 configured, for example, to process data to provide encoded / decoded chroma (lighting) signal data and / or encoded / decoded video signal or data, and the encoder / decoder module 73 may include its own processor and memory. The encoder / decoder module 73 may represent module(s) that may be included in a device to perform the encoding and / or decoding functions. As is known, a device may include one or both of the encoding and decoding modules. Additionally, encoder / decoder module 73 may be implemented as a separate element of system 73 or may be incorporated within processor 71 as a combination of hardware and software as known to those skilled in the art.
[0145] Program code to be loaded onto processor 71 or encoder / decoder 73 to perform the various aspects described in the present application may be stored in storage device 74 and subsequently loaded onto memory 72 for execution by processor 71. In accordance with various embodiments, one or more of processor 71, memory 72, storage device 74, and encoder / decoder module 73 may store one or more of various items during the performance of the processes described in the present application. Such stored items may include, but are not limited to, data representative of chroma / lighting content, data representative of video content, a bitstream, matrices, variables, and intermediate or final results from the processing of equations, formulas, operations, and operational logic.
[0146] In several embodiments, memory inside of the processor 71 and / or the encoder / decoder module 73 may be used to store instructions and to provide working memory for processing that may be performed during data processing, encoding or decoding.
[0147] In other embodiments, however, a memory external to the processing device (for example, the processing device may be the processor) may be used for one or more of these functions. The external memory may be the memory 72 and / or the storage device 74, for example, a dynamic volatile memory and / or a non-volatile flash memory. In at least one embodiment, a fast external dynamic volatile memory such as a RAM may be used as working memory for data processing.
[0148] The input to the elements of system 7 may be provided through various input devices as indicated in block 75. Such input devices include, but are not limited to, (i) an RF portion that may receive an RF signal transmitted, for example, over the air by a broadcaster, (ii) a Composite input terminal, (iii) a USB input terminal, (iv) a phone connector (also known as phone jack, audio jack, headphone jack or jack plug) input terminal and / or (v) an HDMI input terminal.
[0149] In various embodiments, the input devices of block 75 may have associated respective input processing elements as known in the art. For example, the RF portion may be associated with elements necessary for (i) selecting a desired frequency (also referred to as selecting a signal, or band-limiting a signal to a band of frequencies), (ii) down-converting the selected signal, (iii) band-limiting again to a narrower band of frequencies to select (for example) a signal frequency band which may be referred to as a channel in certain embodiments, (iv) demodulating the down-converted and band-limited signal, (v) performing error correction, and (vi) demultiplexing to select the desired stream of data packets. The RF portion of various embodiments may include one or more elements to perform these functions, for example, frequency selectors, signal selectors, band-limiters, channel selectors, filters, downconverters, demodulators, error correctors, and de-multiplexers. The RF portion may include a tuner that performs various of these functions, including, for example, down-converting the received signal to a lower frequency (for example, an intermediate frequency or a near-baseband frequency) or to baseband.
[0150] Various embodiments rearrange the order of the above-described (and other) elements, remove some of these elements, and / or add other elements performing similar or different functions.
[0151] Adding elements may include inserting elements in between existing elements, such as, for example, inserting amplifiers and an analog-to-digital converter. In various embodiments, the RF portion may include an antenna.
[0152] Additionally, the USB and / or HDMI terminals may include respective interface processors for connecting system 7 to other electronic devices across USB and / or HDMI connections. It is to be understood that various aspects of input processing, for example, analog to digital conversion, time domain to frequency domain conversion, down sampling, band pass or low pass filtering, Reed-Solomon error correction, may be implemented, for example, within a separate input processing IC or within processor 71 as necessary. Similarly, aspects of USB or HDMI interface processing may be implemented within separate interface ICs or within processor 71 as necessary. The processed stream may be provided to various processing elements, including, for example, processor 71, and encoder / decoder 73 operating in combination with the memory and storage elements to process the data stream as necessary for presentation on an output device.
[0153] Various elements of system 7 may be provided within an integrated housing. Within the integrated housing, the various elements may be interconnected and transmit data therebetween using suitable connection arrangement 75, for example, an internal bus as known in the art, including the I2C bus, wiring, and printed circuit boards.
[0154] The system 7 may include communication interface 76 that enables communication with other devices via communication channel 760. The communication interface 76 may include, but is not limited to, a transceiver configured to transmit and to receive data over communication channel 760. The communication interface 76 may include, but is not limited to, a modem or network card and the communication channel 760 may be implemented, for example, within a wired and / or a wireless medium.
[0155] Data may be streamed to the system 7, in various embodiments, using a Wi-Fi network such as IEEE 802.11. The Wi-Fi signal of these embodiments may be received over the communications channel 760 and the communications interface 76 which are adapted for Wi-Fi communications. The communications channel 760 of these embodiments may be typically connected to an access point or router that provides access to outside networks including the Internet for allowing streaming applications and other over-the-top communications.
[0156] Other embodiments may provide streamed data to the system 7 using a set-top box or a computer that delivers the data over the HDMI connection of the input block 75.
[0157] Still other embodiments may provide streamed data to the system 7 using the RF connection of the input block 75.
[0158] The streamed data may be used as a way for signaling information used by the system 7. The signaling information may comprise the data encoded in a container such as a binary stream or a haptic effect file for example.
[0159] It is to be appreciated that signaling may be accomplished in a variety of ways. For example, one or more syntax elements, flags, and so forth may be used to signal information to a corresponding data processing device in various embodiments.
[0160] The system 7 may provide an output signal to various output devices, including a display 770, light-emitting devices or light sources 780, and other peripheral devices 790 like haptic devices / actuators.
[0161] In various embodiments, control signals may be communicated between the system 7 and the display 770, light-emitting devices or light sources 780, or other peripheral devices 790 using signaling such as AV.Link (Audio / Video Link), CEC (Consumer Electronics Control), Audio protocols, USB (Universal Serial Bus), HIF UHP (Haptics Industry Forum - Universal Haptic Protocol) or other communications protocols that enable device-to-device control with or without user intervention.
[0162] The output devices may be communicatively coupled to system 7 via dedicated connections through respective interfaces 77, 78, and 79.
[0163] Alternatively, the output devices may be connected to system 7 using the communications channel 760 via the communications interface 76. The display 770, light-emitting devices or light sources 780 and / or haptic device(s) (actuators) 790 may be integrated in a single unit with the other components of system 7 in an electronic device such as, for example, a television.
[0164] In various embodiments, the display interface 77 may include a display driver, such as, for example, a timing controller (T Con) chip.
[0165] The display 770, light-emitting devices or light sources 780 and / or haptic device(s) (actuators) 790 may alternatively be separate from one or more of the other components. In various embodiments in which the display 770, light-emitting devices or light sources 780 and / or haptic device(s) (actuators) 790 may be external components, the output signal may be provided via dedicated output connections, including, for example, HDMI ports, USB ports, or COMP outputs.
[0166] In Figures 1 to 7, various methods are described herein, and each of the methods includes one or more steps or actions for achieving the described method. Unless a specific order of steps or actions is required for proper operation of the method, the order and / or use of specific steps and / or actions may be modified or combined.
[0167] Some examples are described with regard to block diagrams and / or operational flowcharts. Each block represents a circuit element, module, or portion of code which includes one or more executable instructions for implementing the specified logical function(s). It should also be noted that in other implementations, the function(s) noted in the blocks may occur out of the indicated order. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks may sometimes be executed in the reverse order, depending on the functionality involved.
[0168] The implementations and aspects described herein may be implemented in, for example, a method or a process, an apparatus, a computer program, a data stream, a bitstream, or a signal. Even if only discussed in the context of a single form of implementation (for example, discussed only as a method), the implementation of features discussed may also be implemented in other forms (for example, an apparatus or computer program).
[0169] The methods may be implemented in, for example, a processor, which refers to processing devices in general, including, for example, a computer, a microprocessor, an integrated circuit, or a programmable logic device. Processors also include communication devices.
[0170] Additionally, the methods may be implemented by instructions being performed by a processor, and such instructions (and / or data values produced by an implementation) may be stored on a computer readable storage medium. A computer readable storage medium may take the form of a computer readable program product embodied in one or more computer readable medium(s) and having computer readable program code embodied thereon that is executable by a computer. A computer readable storage medium as used herein may be considered a non-transitory storage medium given the inherent capability to store the information therein as well as the inherent capability to provide retrieval of the information therefrom. A computer readable storage medium may be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. It is to be appreciated that the following, while providing more specific examples of computer readable storage mediums to which the present embodiments may be applied, is merely an illustrative and not an exhaustive listing as is readily appreciated by one of ordinary skill in the art: a portable computer diskette; a hard disk; a read-only memory (ROM); an erasable programmable read-only memory (EPROM or Flash memory); a portable compact disc read-only memory (CD-ROM); an optical storage device; a magnetic storage device; or any suitable combination of the foregoing.
[0171] The instructions may form an application program tangibly embodied on a processor-readable medium.
[0172] Instructions may be, for example, in hardware, firmware, software, or a combination. Instructions may be found in, for example, an operating system, a separate application, or a combination of the two. A processor may be characterized, therefore, as, for example, both a device configured to carry out a process and a device that includes a processor-readable medium (such as a storage device) having instructions for carrying out a process. Further, a processor-readable medium may store, in addition to or in lieu of instructions, data values produced by an implementation.
[0173] An apparatus may be implemented in, for example, appropriate hardware, software, and firmware. Examples of such apparatus include personal computers, laptops, smartphones, tablet computers, digital multimedia set top boxes, digital television receivers, personal video recording systems, connected home appliances, head mounted display devices (HMD, see-through glasses), projectors (beamers), "caves" (system including multiple displays), servers, video and / or haptic and / or chroma encoders, video and / or haptic and / or chroma decoders, haptic engine, chroma engine, post-processors processing output from a video decoder, pre-processors providing input to a video encoder, web servers, set-top boxes, wireless connected wearable haptic devices, e.g., Bluetooth ®< connected wearable haptic devices, game controller, mouse, mousepad, keyboard, palm rest, chairs, desk, XR headset, headphones, bracelet, head and / or lumbar support device or chair, any light source, and any other device for processing haptic data or signals representative of one or more haptic feedback or effect and / or for processing lighting / chroma data or signals representative of one or more lighting mode or effect, or other communication devices. As should be clear, the equipment may be mobile.
[0174] Computer software may be implemented by the processor 71 or by hardware, or by a combination of hardware and software. As a non-limiting example, the embodiments may be also implemented by one or more integrated circuits. The memory 72 may be of any type appropriate to the technical environment and may be implemented using any appropriate data storage technology, such as optical memory devices, magnetic memory devices, semiconductor-based memory devices, fixed memory, and removable memory, as non-limiting examples. The processor 71 may be of any type appropriate to the technical environment, and may encompass one or more of microprocessors, general purpose computers, special purpose computers, and processors based on a multi-core architecture, as non-limiting examples.
[0175] As will be evident to one of ordinary skill in the art, implementations may produce a variety of signals formatted to carry information that may be, for example, stored or transmitted. The information may include, for example, instructions for performing a method, or data produced by one of the described implementations. For example, a signal may be formatted to carry the bitstream of a described embodiment. Such a signal may be formatted, for example, as an electromagnetic wave (for example, using a radio frequency portion of spectrum) or as a baseband signal. The formatting may include, for example, encoding a data stream and modulating a carrier with the encoded data stream. The information that the signal carries may be, for example, analog or digital information. The signal may be transmitted over a variety of different wired or wireless links, as is known. The signal may be stored on a processor-readable medium.
[0176] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used herein, the singular forms "a", "an", and "the" may be intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "includes / comprises" and / or "including / comprising" when used in this specification, may specify the presence of stated, for example, features, integers, steps, operations, elements, and / or components but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof. Moreover, when an element is referred to as being "responsive" or "connected" to another element, it may be directly responsive or connected to the other element, or intervening elements may be present. In contrast, when an element is referred to as being "directly responsive" or "directly connected" to other element, there are no intervening elements present.
[0177] It is to be appreciated that the use of any of the symbol / term " / ", "and / or", and "at least one of", for example, in the cases of "A / B", "A and / or B" and "at least one of A and B", may be intended to encompass the selection of the first listed option (A) only, or the selection of the second listed option (B) only, or the selection of both options (A and B). As a further example, in the cases of "A, B, and / or C" and "at least one of A, B, and C", such phrasing is intended to encompass the selection of the first listed option (A) only, or the selection of the second listed option (B) only, or the selection of the third listed option (C) only, or the selection of the first and the second listed options (A and B) only, or the selection of the first and third listed options (A and C) only, or the selection of the second and third listed options (B and C) only, or the selection of all three options (A and B and C). This may be extended, as is clear to one of ordinary skill in this and related arts, for as many items as are listed.
[0178] Various numeric values may be used in the present application. The specific values may be for example purposes and the aspects described are not limited to these specific values.
[0179] It will be understood that, although the terms first, second, etc. may be used herein to describe various elements, these elements are not limited by these terms. These terms are only used to distinguish one element from another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element without departing from the teachings of this application. No ordering is implied between a first element and a second element.
[0180] Reference to "one exemplary embodiment" or "an exemplary embodiment" or "one implementation" or "an implementation", as well as other variations thereof, is frequently used to convey that a particular feature, structure, characteristic, and so forth (described in connection with the embodiment / implementation) is included in at least one embodiment / implementation. Thus, the appearances of the phrase "in one exemplary embodiment" or "in an exemplary embodiment" or "in one implementation" or "in an implementation", as well any other variations, appearing in various places throughout this application are not necessarily all referring to the same embodiment.
[0181] Similarly, reference herein to "in accordance with an exemplary embodiment / example / implementation" or "in an exemplary embodiment / example / implementation", as well as other variations thereof, is frequently used to convey that a particular feature, structure, or characteristic (described in connection with the exemplary embodiment / example / implementation) may be included in at least one exemplary embodiment / example / implementation. Thus, the appearances of the expression "in accordance with an exemplary embodiment / example / implementation" or "in an exemplary embodiment / example / implementation" in various places in the specification are not necessarily all referring to the same exemplary embodiment / example / implementation, nor are separate or alternative exemplary embodiment / examples / implementation necessarily mutually exclusive of other exemplary embodiments / examples / implementation.
[0182] Reference numerals appearing in the claims are by way of illustration only and shall have no limiting effect on the scope of the claims. Although not explicitly described, the present embodiments / examples and variants may be employed in any combination or sub-combination.
[0183] When a figure is presented as a flow diagram, it should be understood that it also provides a block diagram of a corresponding apparatus. Similarly, when a figure is presented as a block diagram, it should be understood that it also provides a flow diagram of a corresponding method / process.
[0184] Although some of the diagrams include arrows on communication paths to show a primary direction of communication, it is to be understood that communication may occur in the opposite direction to the depicted arrows.
[0185] Additionally, this application may refer to "obtaining" various pieces of information. Obtaining the information may include one or more of, for example, receiving the information, determining the information, estimating the information, calculating the information, or retrieving the information from memory.
[0186] Further, this application may refer to "accessing" various pieces of information. Accessing the information may include one or more of, for example, receiving the information, retrieving the information (for example, from memory), storing the information, moving the information, copying the information, calculating the information, determining the information, or estimating the information.
[0187] Additionally, this application may refer to "receiving" various pieces of information. Receiving is, as with "accessing", intended to be a broad term. Receiving the information may include one or more of, for example, accessing the information, or retrieving the information (for example, from memory). Further, "receiving" is typically involved, in one way or another, during operations such as, for example, storing the information, processing the information, transmitting the information, moving the information, copying the information, erasing the information, calculating the information, determining the information, or estimating the information.
[0188] A number of implementations have been described. Nevertheless, it will be understood that various modifications may be made. For example, elements of different implementations may be combined, supplemented, modified, or removed to produce other implementations. Additionally, one of ordinary skill will understand that other structures and processes may be substituted for those disclosed and the resulting implementations will perform at least substantially the same function(s), in at least substantially the same way(s), to achieve at least substantially the same result(s) as the implementations disclosed. Accordingly, these and other implementations are contemplated by this application.
Claims
1. A method of rendering a lighting effect, the method comprising: - receiving (61) first data representative of position of at least a lighting device of a set of lighting devices (211 to 214, 221 to 224, 231 to 233), said position being defined according to a hierarchical spatial subdivision of an environment (10, 20) comprising said set of lighting devices, said set of lighting devices comprising at least one lighting device; - determining (62) lighting control parameters for said at least a lighting device according to said first data and according to second data representative of said lighting effect; and - transmitting (63) said lighting control parameters to said at least a lighting device for the rendering of said lighting effect.
2. The method according to claim 1, wherein said hierarchical spatial subdivision of the environment comprises a plurality of spatial subdivision hierarchical levels each comprising one or more spatial cells (2, 21 to 23), a spatial cell (2) of an upper spatial subdivision hierarchical level comprising a plurality of spatial cells (21 to 23) of a lower spatial subdivision hierarchical level.
3. The method according to claim 2, wherein said set of lighting devices (211 to 214, 221 to 224, 231 to 233) is distributed in a plurality of spatial cells (21 to 23) of the lowest spatial subdivision hierarchical level of said plurality of spatial subdivision hierarchical levels, the position of said at least a lighting device being defined with respect to a reference point (O21, O22, O23) of the spatial cell (21, 22, 23) said at least a lighting device belongs to.
4. The method according to claim 3, wherein, said method being implemented by a control device (31, 32), said at least a lighting device (31, 32) belongs to the spatial cell (21, 23) comprising said control device (31, 32).
5. The method according to claim 4, wherein said first data is received by said control device (31, 32) from said at least a lighting device, said at least a lighting device being wirelessly coupled to said control device (31, 32).
6. The method according to claim 4 or 5, wherein said lighting control parameters are further determined according to third data representative of position of said control device (31, 32) in the spatial cell (21, 23) comprising said control device (31, 32).
7. The method according to claim 6, further comprising determining said third data by locating said control device (31, 32) in the spatial cell (21, 23) comprising said control device (31, 32) according to signals received by said control device (31, 32) from said at least a lighting device wirelessly coupled to said control device (31, 32).
8. The method according to any one of claims 2 to 7, wherein said hierarchical spatial subdivision of the environment comprises 3 spatial subdivision hierarchical levels.
9. The method according to any one of claims 1 to 8, further comprising receiving fourth data representative of characteristics of a set of light-emitting devices comprised in said at least a lighting device, said lighting control parameters being further determined according to said fourth data.
10. The method according to claim 9, wherein said set of light-emitting devices comprising a plurality of light-emitting devices, said fourth data comprises information representative of a spatial arrangement of said plurality of light-emitting devices in said at least a lighting device.
11. The method according to any one of claims 1 to 10, wherein said environment (20) corresponds to a two-dimensional environment.
12. The method according to any one of claims 1 to 10, wherein said environment (10) corresponds to a three-dimensional environment.
13. A device (7) comprising a memory (72) associated with at least a processor (71) configured to implement the method according to any one of claims 1 to 12.
14. A computer program product comprising instructions of program code for executing the method according to any one of claims 1 to 12, when said program is executed on a computer.
Citation Information
Patent Citations
Method and Apparatus for Signal Presentation
US20090051624A1
Transmission device, audio-visual environment control device, and audio-visual environment control system
US20100031298A1
Illumination content production and use
US20170142809A1
Systems and methods for connecting and controlling configurable lighting units
US20200404765A1