Method and apparatus of controlling a lighting device

Abstract

There are provided methods and apparatus of controlling a lighting device. To reach that aim, a camera perspective type associated with a rendering of an image (310) on a display device comprised in a first environment is determined. A first information identifying a spatial area of a set of spatial areas is associated with each region of a set of regions of the image (310) according to the camera perspective type. Position data representative of position of the lighting device in the first environment is received. The lighting device is associated with a part (31) of a region (312) according to the first information and the position data. The lighting device is controlled according to color data obtained from the part (31).

Description

FIELD

[0001] The present application generally relates to the field of lighting and, in particular, to the controlling of one or more lighting devices to render or emit light in a three-dimensional (3D) environment. The present application also relates to method and apparatus of controlling one or more lighting devices according to data representative of one or more images displayed on a display device comprised in the 3D environment.BACKGROUND

[0002] The present section is intended to introduce the reader to various aspects of art, which may be related to various aspects of at least one exemplary embodiment of the present application that is described and / or claimed below. This discussion is believed to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of the present application.

[0003] To improve user experience when playing a media content such as a video content or a video game, it is known to control the lighting of one or more peripherals in the media content playback environment.

[0004] Controlling the lighting of such peripherals may for example increase the feeling of immersion while watching a movie or playing a video game. Such peripherals comprise smart LED light bulbs, RGB (Red, Green, Blue) components and accessories such as LED strips, keyboards, mice, mouse mats, speakers, screens, headsets or even the casing of the media player.

[0005] Lighting or color effects may be obtained by controlling the one or more light-emitting devices such as LED (Light-Emitting Diode) equipping the one or more peripherals arranged in the media content playback environment.

[0006] Lighting or color effects may further be rendered in a determined environment to provide an appropriate ambient lighting.

[0007] However, there is still room for improvement to control the lighting of the media content playback environment, e.g., to improve the feeling of immersion.SUMMARY

[0008] The following section presents a simplified summary of at least one exemplary embodiment in order to provide a basic understanding of some aspects of the present application. This summary is not an extensive overview of an exemplary embodiment. It is not intended to identify key or critical elements of an embodiment. The following summary merely presents some aspects of at least one of the exemplary embodiments in a simplified form as a prelude to the more detailed description provided elsewhere in the document.

[0009] According to a first aspect of the present application, there is provided a method of controlling a lighting device, the method comprising: determining a camera perspective type associated with a rendering of an image on a display device comprised in a first environment; associating, with each region of a set of regions of the image, the first information identifying a spatial area of a set of spatial areas according to the camera perspective type, the set of spatial areas being defined according to a second environment adapted to comprise the display device; receiving position data representative of the position of the lighting device in the first environment; associating the lighting device with a part of a region of the set of regions according to the first information and the position data; controlling the lighting device according to color data obtained from the part of the region.

[0010] In an exemplary embodiment, the method further comprises segmenting the image to obtain the set of regions.

[0011] In an exemplary embodiment, the segmenting is according to the camera perspective type.

[0012] In an exemplary embodiment, a determined region mask being associated with the camera perspective type, the segmenting comprises applying the determined region mask to the image to obtain the set of regions.

[0013] In an exemplary embodiment, the camera perspective type belongs to a set of camera perspective types comprising: first-person perspective type; and third-person perspective type; and fixed perspective type.

[0014] In an exemplary embodiment, the position data comprises: second information identifying a determined spatial area in the first environment, the determined spatial area belonging to the set of spatial areas; and third information representative of a relative position of the lighting device in the determined spatial area.

[0015] In an exemplary embodiment, the part of the region corresponds to a group of pixels of the image.

[0016] In an exemplary embodiment, the color data is obtained from color attributes associated with the group of pixels.

[0017] In another exemplary embodiment, the position data is received wirelessly from the lighting device.

[0018] In another exemplary embodiment, the method further comprises receiving data representative of lighting characteristics of the lighting device, the color data being further determined according to the lighting characteristics.

[0019] In an additional exemplary embodiment, the method further comprises transmitting the color data to the lighting device.

[0020] In an additional exemplary embodiment, the first environment corresponds to the second environment.

[0021] According to a second aspect of the present application, there is provided a device or an apparatus comprising a memory associated with at least a processor configured to implement the method in accordance with the first aspect of the present application.

[0022] According to a third aspect of the present application, there is provided a computer program product including instructions which, when the program is executed by one or more processors, causes the one or more processors to carry out a method according to the first aspect of the present application.

[0023] According to a fourth aspect of the present application, there is provided a non-transitory storage medium carrying instructions of program code for executing a method according to the first aspect of the present application.

[0024] The specific nature of at least one of the exemplary embodiments as well as other objects, advantages, features and uses of said at least one exemplary embodiments will become evident from the following description of examples taken in conjunction with the accompanying drawings.BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Reference will now be made, by way of example, to the accompanying drawings which show exemplary embodiments of the present application, and in which: Figure 1 shows a schematic representation of a three-dimensional (3D) environment comprising one or more lighting devices, in accordance with exemplary embodiments; Figure 2 shows a schematic block diagram of blocks of a process of controlling a lighting device, in accordance with exemplary embodiments; Figure 3 shows the association between the one or more lighting devices of figure 1 with regions of an image of a scene rendered according to a first camera perspective type, in accordance with an exemplary embodiment; Figure 4 shows the association between the one or more lighting devices of figure 1 with regions of an image of a scene rendered according to a second camera perspective type, in accordance with at least one exemplary embodiment; Figure 5 shows the association between the one or more lighting devices of figure 1 with regions of an image of a scene rendered according to a third camera perspective type, in accordance with at least one exemplary embodiment; Figure 6 shows a schematic block diagram of steps of a method of controlling a lighting device, in accordance with exemplary embodiments; Figure 7 illustrates a schematic block diagram of an example of a system or apparatus in which various aspects and exemplary embodiments are implemented.

[0026] Similar reference numerals may have been used in different figures to denote similar components.DESCRIPTION OF EXEMPLARY EMBODIMENTS

[0027] At least one of the exemplary embodiments is described more fully hereinafter with reference to the accompanying figures, in which examples of at least one of the exemplary embodiments are illustrated. An exemplary embodiment may, however, be embodied in many alternate forms and should not be construed as limited to the examples set forth herein. Accordingly, it should be understood that there is no intent to limit exemplary embodiments to the particular forms disclosed. On the contrary, the disclosure is intended to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the present application.

[0028] Exemplary embodiments described hereinafter may be combined with each other or each of the exemplary embodiment may be individually implemented, e.g., as an alternative embodiment.

[0029] At least one of the aspects generally relates to a method and apparatus of controlling one or more lighting devices to render a lighting effect. The apparatus may correspond to a control device configured to determine lighting data, e.g., color data, to control the one or more lighting devices. A lighting device corresponds to any device configured to emit light (lamp, light bulb, strip of LEDs or any peripheral or device incorporating one or more light sources, e.g., RGB light sources (for example arrangement of LEDs)) that is configured to be controlled by the control device to render a lighting effect. The lighting effect may be dynamic, i.e., the lighting effect may vary over time and / or space.

[0030] The method comprises determining a camera perspective type associated with a rendering of an image on a display device comprised in a first environment, e.g., a real 3D environment like a room of a house or a building. The type of the camera perspective used to render the image (of a 3D virtual scene for example) belongs for example to a determined set of camera perspectives comprising the first-person perspective (FPP), the third-person perspective (TPP) and the fixed perspective (FP, such as side-scrolling perspective or top-down perspective). The image comprises a plurality of regions (e.g., obtained by segmenting the image or by applying a determined mask associated with the camera perspective type). A first information identifies a given spatial area being associated with the image, the association between the regions and the first information being according to the camera perspective type associated with the image. The spatial area belongs to a set of spatial areas which may correspond to spatial areas of a second environment, e.g., spatial areas of a space or room of a house or building, such as the ceiling, the floor, side walls, front wall, etc. Position data representative of the position of each of the one or more lighting devices in the first environment is received. The position data may be stored in a memory of each of the lighting devices and received wirelessly from each of the lighting devices or inputs via a peripheral device associated with the control device, e.g., a keyboard or a tactile interface of a screen of the control device or any device communicatively coupled to the control device. The lighting devices, or part of them, are each associated with a part of a region of the image using the position data and the first information. Each of the lighting devices is controlled according to color data corresponding to the color information associated with the part of the region of the image the lighting device is associated with, the color data corresponding for example to color attributes of the pixels of the image comprised in the part of the region.

[0031] A lighting effect corresponds to any generation of light through the one or more lighting devices, the lighting effect varying for example over time according to the color information associated with the part of the region of the image associated with each of the one or more lighting devices, according to the content / image displayed on the display device.

[0032] At least another one of the aspects generally relates to a method and apparatus of rendering light by one or more lighting devices according to the lighting control parameters (color data) obtained while rendering a video content (images) to be displayed on the display device, the video content varying over time, e.g., according to the move and / or movements of an avatar in a virtual environment (controlled by a user playing a video game for example) or according to the different scenes associated with a real environment (in case of a movie displayed on the display device for example).

[0033] Figure 1 illustrates a schematic representation of a first environment 10 in accordance with at least one exemplary embodiment.

[0034] Figure 1 shows a first environment 10 corresponding to a space of a real environment, e.g., a room of a house as in the example of Figure 1.

[0035] According to the non-limitative example of Figure 1, the first environment 10 corresponds to a living room comprising a couch 17, a coffee table with a laptop 18 resting on the coffee table and a display device 19 such as a TV screen mounted on a wall 102 facing the couch 17.

[0036] The first environment 10 comprises a set of spatial areas. This set of spatial areas may have been defined with reference to a generic environment, called second environment, which is adapted to comprise a display device (such as a TV screen, a monitor (screen) of a computer, a screen of a video game console, etc.). Such a second environment corresponds to a 3D real environment, e.g., a room or space of an apartment, a house, a building, etc.

[0037] In an embodiment, the first environment 10 corresponds to the second environment, the first environment 10 and the second environment corresponding to one and a same environment.

[0038] The set of spatial areas comprises areas that are adapted to receive or support one or more lighting devices, each spatial area of the set of spatial areas being identified via a unique identifier (e.g., a name or a sequence of bits, the identifier being for example coded on 4, 6 or 8 bits). Each spatial area is for example identified with a name identifying and defining its type and its relative position with reference to a reference position in the second environment. The reference position corresponds for example to the position of the center of the second environment. According to another example, the reference position corresponds to the theoretical position of a user sitting in front of the display device to watch the images and video contents displayed on the display device in the second environment.

[0039] The set of spatial areas comprises for example: a first spatial area called floor; and / or a second spatial area called front wall; and / or a third spatial area called left-hand side wall; and / or a fourth spatial area called right-hand side wall; and / or a fifth spatial area called ceiling; and / or a sixth spatial area called back wall.

[0040] The first environment 10 comprises a plurality of lighting devices 11 to 16, i.e., a first lighting device 11, a second lighting device 12, a third lighting device 13, a fourth lighting device 14, a fifth lighting device 15 and a sixth lighting device 16, according to the exemplary embodiment of Figure 1.

[0041] The first lighting device 11 and the second lighting device 12 may correspond to wall-mounted lights. The third lighting device 13, the fourth lighting device 14 and the fifth lighting device 15 may each correspond to a LED strip, e.g., a RGB (Red, Green, Blue) LED strip. The sixth lighting device 16 may correspond to a ceiling-mounted lamp. According to other examples, one or more lighting devices comprised in the first environment 10 correspond to floor-standing lamps or desk lamps.

[0042] Naturally, the number and types of lighting devices 11 to 16 are not limited to the examples described with regard to figure 1 but extend to any number (e.g., 1, 2, 3, 4, 5, 10, 20 or more) and any type of lighting devices.

[0043] According to the example of Figure 1, the first lighting device 11 and the second lighting device 12 are fixed on the front wall 102, the third lighting device 13 is fixed on the left-hand wall 103, the fourth lighting device 14 and the fifth lighting device 15 are arranged in the floor 101 and the sixth lighting device 16 is fixed on the ceiling 106. The spatial areas of the first environment 10 are for example identified with reference to a reference position corresponding to the position of a user watching the images and / or video contents displayed on the screen of the laptop 18 or on the TV screen 19. This reference point O 1 corresponds for example to the center of the couch seat.

[0044] The lighting device(s) comprised in the first environment 10 may correspond to a dynamic lighting device corresponding to: a device whose primary function is to illuminate the first environment 10 or part of the first environment 10, e.g., a connected lamp; or a device configured to implement several functions, including the ability to reproduce a lighting device through the one or more light sources it embeds, e.g.: a display device corresponding for example to the TV screen 19 configured to display images from image data received from the control device; the display device may comprise light sources for example arranged on the back of the display device and / or around the perimeter of the screen of the display device; a keyboard, e.g., a LED backlit keyboard; a mat such as a gaming mat or a mouse mat, the mat comprising for example a RGB (Red, Green, Blue) LED strip arranged around its perimeter; or a mouse, e.g., a mouse comprising RGB LEDs.

[0045] A dynamic lighting device such as lighting devices 11 to 16 corresponds to a device comprising one or more light sources, such as LED (light-emitting diode), to generate light according to lighting data transmitted by a control device to each of the lighting devices of the first environment communicatively coupled to the control device.

[0046] The type of the lighting device is not limited to the aforementioned examples but extends to any device or apparatus comprising one or more light-emitting devices or light sources and configured to be controlled by a control device to emit light. A lighting device may further correspond to a palm rest, a chair, a desk, a XR headset, headphones, a bracelet, a head and / or lumbar support device or chair, i.e., any device configured to render light including any personal computer peripheral device comprising one or more light-emitting devices such as a keyboard, a mouse, a mouse mat, headphone holder, earbuds, monitor or screen device.

[0047] The control device may also comprise one or more light sources and be part of the set of lighting devices comprised in the first environment 10 and controlled by the control device.

[0048] Some of the lighting devices correspond to interface peripheral devices of the control device, e.g., a screen or display device, a keyboard and / or a mouse may correspond to interface peripheral devices of the control device.

[0049] The control device and the lighting devices of the first environment 10 communicatively coupled to the control device are connected to each other through wired connection (e.g., via USB (Universal Serial Bus) input terminal, via a phone connector (also known as phone jack, audio jack, headphone jack or jack plug) input terminal or via an HDMI input terminal) or through wireless connection (e.g., Bluetooth ®< or Wifi ®< ).

[0050] A control device corresponds to any processing device configured to determine or generate lighting data to be transmitted to lighting devices 11 to 16 to control lighting devices 11 to 16 for the rendering of light or of a lighting effect in the first environment 10.

[0051] According to the exemplary embodiments of figure 1, the control device corresponds to laptop 18. According to other examples, the control device may correspond to a personal computer, game consol, set-top box, mobile communication device such as a smartphone or a tablet. The control device may be configured to run one or more software applications.

[0052] Figure 2 illustrates a process of controlling the one or more lighting devices 11 to 16 of the first environment 10 in accordance with at least one exemplary embodiment.

[0053] The process is implemented by one or more processors of a control device such as laptop 18 or any data processing device such as a personal computer, a game consol, a set-top box, a rendering engine, a chroma engine, a mobile communication device such as a smartphone or a tablet.

[0054] The process will be described with reference to the control of one lighting device corresponding to one of lighting devices 11 to 16 but applies similarly to the control of each of lighting devices 11 to 16. One or more of the lighting devices comprised in the first environment may not be controlled according to the process. For example, lighting devices that are not configured to communicate with the control device are not controlled by the control device. According to another example, lighting device(s) fixed on the back wall may not be controlled by the control device.

[0055] Data exchange between the control device and the lighting devices 11 to 16 is performed in the framework of a communication protocol, data being exchanged by way of APIs (Application Program Interface) that may be implemented both in the control device and in each of the lighting devices 11 to 16 of the first environment 10 communicatively coupled to the control device.

[0056] Blocks 21 to 26 represent either operations of the process or processing units implementing such operations of the process. The processing units may be implemented as a single element or as separate elements as a combination of hardware and software as known to those skilled in the art.

[0057] The operations of the process may be reiterated for each image of a sequence of images, or for each image of a part of the sequence of images (e.g., every 2, 5 or 10 images, or every 100, 250, 500 or 1000 ms) to reduce the processing costs and / or memory footprint.

[0058] At block 21, image data representative of the image displayed or to be displayed on the display device (e.g., the screen of the laptop 18) is obtained.

[0059] The image data is for example received as part of a data stream from a memory (e.g., ROM, RAM, flash), a data storing device (e.g., a hard drive, a USB key, an optical disk), a remote device (e.g., a server of the cloud) or a processing unit configured to render images at run time.

[0060] The image represented with the image data may be an image of a scene of a real environment, an image of a scene of a virtual environment (e.g., a CGI-generated environment) or an image of a scene of a mix of real and virtual environments.

[0061] Images of a real second environment may be acquired with one or more image acquisition devices (such as a camera or a plenoptic camera) according to one or different points of view, i.e., according to one or different camera perspectives. The sequence of the acquired images may form a movie to be displayed on the display device, e.g., to be watched by a user sitting on the couch 17.

[0062] Images of a virtual environment may be generated at run time, for example according to instructions received from peripheral device(s) connected to the control device or to the rendering device configured to render the images. The images are generated, for example, as a function of an avatar's (or any object of the virtual environment) movement in the virtual environment, according to commands received from the user controlling the avatar's movement, when the images are representative of a virtual environment of a video game played by the user. The images are generated according to one or more perspective cameras, the camera perspective may vary over time.

[0063] A perspective camera corresponds to a model used to represent how 3D objects are projected onto a 2D image plane, creating a sense of depth and realism. Depending on the perspective camera type, it may simulate the way human vision perceives the world, where objects appear smaller as they are farther away, thus capturing the spatial relationships and dimensions of the scene. According to at least one perspective camera type, the perspective camera corresponds to the point of view according to which the scene is rendered or acquired.

[0064] The perspective camera type associated with the image may correspond to one of the following types of perspective camera: the first-person perspective type, corresponding to the type of camera perspective where the scene is rendered and displayed from the viewpoint of the player character (in case of a video game) or through the eyes of a character (in case of a film, also known as POV (point of view) shot, first-person shot or subjective camera); or the third-person perspective type, corresponding to the type of camera perspective where the player character is visible on-screen, wherein the third-person perspective type is analogous to the first-person perspective type but displace the camera from being at the eyes of the (player) character to, for example, a point slightly above and behind the (player) character; or the fixed perspective type, corresponding to the type of camera perspective where the viewpoint is fixed to a given plane; examples of fixed perspective type are side scrollers or top-down camera perspective.

[0065] At block 22, the camera perspective type associated with the rendering of the image obtained at block 21 is determined.

[0066] The camera perspective type is for example determined by processing the image data obtained at block 21 to identify the camera perspective type used to render the image in a list of various camera perspective types comprising the first-person perspective type, the third-person perspective type and the fixed perspective type.

[0067] In another example, the camera perspective type associated with the image is received as metadata with the image data, the camera perspective type being determined while decoding the image data and associated metadata.

[0068] In another example, the camera perspective type is determined from the type of content rendered on the display device. For example, when the content corresponds to a video game, the type of video game may provide inherently the camera perspective type. Examples of video games include first-person shooter (i.e., with first-person camera type), third-person shooter (i.e., with third-person camera type), side-scrolling video game (i.e., with fixed perspective type), etc.

[0069] At block 23, a first information identifying a spatial area of a set of spatial areas is associated with each region of a set of regions of the image obtained at block 21 according to the camera perspective type of the image determined at block 22.

[0070] As described hereinabove, the set of spatial areas may be defined according to a second environment adapted to comprise the display device, the set of spatial areas comprising for example: a first spatial area called floor; a second spatial area called front wall; a third spatial area called left-hand side wall; a fourth spatial area called right-hand side wall; a fifth spatial area called ceiling; and a sixth spatial area called back wall.

[0071] A region of an image corresponds to a group of pixels of the image, a region of the image corresponding to a sub-part of the image. The shape and size of the region are variable and arbitrary.

[0072] The set of regions is for example generated and obtained by segmenting the image.

[0073] The segmenting of the image and the association of the first information with each region of the set of regions may be obtained through a single operation by applying a determined region mask, the determined region mask being according to the camera perspective type associated with the image and determined at block 22.

[0074] The determined region mask associated with the camera perspective type of the image obtained at block 21 is for example obtained from a library 231 of various region masks, a different region mask being associated with each camera perspective type, i.e., a first region mask being associated with the first-person perspective type, a second region mask being associated with the third-person perspective type and a third region mask being associated with the fixed perspective type (or a different third region mask being associated with each type of fixed perspective (e.g., side-scrolling perspective or top-down perspective).

[0075] Since the camera perspective type is associated with the image obtained at block 21, the region mask corresponding to this camera perspective type is for example identified in a LUT (Look-Up Table) mapping camera perspective type with region mask identifiers (a unique region mask identified being mapped with a different camera perspective type). Once the region mask identifier corresponding to the camera perspective type obtained at block 21 has been retrieved from the LUT, the mask data representative of the region mask to be applied to the image are retrieved using the region mask identifier.

[0076] A region mask corresponds to an image with various specific portions each corresponding to a region of the set of regions to be identified in the image obtained at block 21. A label or an identifier is associated with each specific portion to identify the spatial area that is associated with each specific portion, each specific portion having a determined shape and size.

[0077] Figures 3, 4 and 5 each show the set of regions that are obtained by applying various region masks to various images 310, 410, 510 in accordance with exemplary embodiments.

[0078] More specifically, Figure 3 shows a set of regions 311, 312, 313, 314 and 315 obtained for an image 310 of the first-person perspective type. Figure 4 shows a set of regions 411L, 411R, 412, 413, 414 and 415 obtained for an image 410 of the third-person perspective type. Figure 5 shows a set of regions 511, 512, 513, 514 and 515 obtained for an image 510 of the fixed perspective type.

[0079] Image 310 of Figure 3 comprises: a first region 311 with a rectangular shape covering a lower portion of image 310, the first information associated with the first region 311 identifying the first spatial area of the set of spatial areas, i.e., the spatial area of the type 'floor'; a second region 312 with a rectangular shape covering a central portion of image 310, the first information associated with the second region 312 identifying the second spatial area of the set of spatial areas, i.e., the spatial area of the type 'front wall'; a third region 313 with a rectangular shape covering a left-hand side central portion of image 310, the first information associated with the third region 313 identifying the third spatial area of the set of spatial areas, i.e., the spatial area of the type `left-hand side wall'; a fourth region 314 with a rectangular shape covering a right-hand side central portion of image 310, the first information associated with the fourth region 314 identifying the fourth spatial area of the set of spatial areas, i.e., the spatial area of the type 'right-hand side wall'; and a fifth region 315 with a rectangular shape covering an upper portion of image 310, the first information associated with the fifth region 315 identifying the fifth spatial area of the set of spatial areas, i.e., the spatial area of the type 'ceiling'.

[0080] Each region of the set of regions 311, 312, 313, 314 and 315 and the associated first information is obtained or generated as a result of the applying of a first region mask corresponding to (or associated with) the first-person perspective type, the first region mask having the size of image 310 and comprising a set of portions corresponding to the set of regions, the location, shape and size of each portion in the first region mask being used to obtain the location, shape and size of the corresponding region in image 310.

[0081] Image 410 of Figure 4 comprises: a first region 411L with a trapezoidal shape covering a left-hand side lower portion of image 410 located on the left of an avatar 400, the first information associated with the first region 411L identifying the first spatial area of the set of spatial areas, i.e., the spatial area of the type 'floor' or another spatial area of the type 'left part of the floor'; a second region 411R with a trapezoidal shape covering a right-hand side lower portion of image 410 located on the right of the avatar 400, the first information associated with the second region 411R identifying the first spatial area of the set of spatial areas, i.e., the spatial area of the type 'floor' or another spatial area of the type `right part of the floor'; a third region 412 with a rectangular shape covering a central portion of image 410, the first information associated with the third region 412 identifying the second spatial area of the set of spatial areas, i.e., the spatial area of the type 'front wall'; a fourth region 413 with a rectangular shape covering a left-hand central portion of image 410, the first information associated with the fourth region 413 identifying the third spatial area of the set of spatial areas, i.e., the spatial area of the type `left-hand side wall'; a fifth region 414 with a rectangular shape covering a right-hand central portion of image 410, the first information associated with the fifth region 414 identifying the fourth spatial area of the set of spatial areas, i.e., the spatial area of the type 'right-hand side wall'; and a sixth region 415 with a rectangular shape covering an upper portion of image 410, the first information associated with the sixth region 415 identifying the fifth spatial area of the set of spatial areas, i.e., the spatial area of the type 'ceiling'.

[0082] Each region of the set of regions 411L, 411R, 412, 413, 414 and 415 and the associated first information is obtained or generated as a result of the applying of a second region mask corresponding to (or associated with) the third-person perspective type, the second region mask having the size of the image 410 and comprising a set of portions corresponding to the set of regions, the location, shape and size of each portion in the first region mask being used to obtain the location, shape and size of the corresponding region in image 410.

[0083] Image 510 of Figure 5 comprises: a first region 511 with a rectangular shape covering a lower portion of image 510, the first information associated with the first region 511 identifying the first spatial area of the set of spatial areas, i.e., the spatial area of the type 'floor'; a second region 512 with a rectangular shape covering a central portion of image 510, the first information associated with the second region 512 identifying the second spatial area of the set of spatial areas, i.e., the spatial area of the type 'front wall'; a third region 513 with a rectangular shape covering a left-hand side central portion of image 510, the first information associated with the third region 513 identifying the third spatial area of the set of spatial areas, i.e., the spatial area of the type `left-hand side wall'; a fourth region 514 with a rectangular shape covering a right-hand side central portion of image 510, the first information associated with the fourth region 514 identifying the fourth spatial area of the set of spatial areas, i.e., the spatial area of the type 'right-hand side wall'; and a fifth region 515 with a rectangular shape covering a upper portion of image 510, the first information associated with the fifth region 515 identifying the fifth spatial area of the set of spatial areas, i.e., the spatial area of the type 'ceiling'.

[0084] Each region of the set of regions 511, 512, 513, 514 and 515 and the associated first information is obtained or generated as a result of the applying of a first region mask corresponding to (or associated with) the first-person perspective type, the first region mask having the size of image 510 and comprising a set of portions corresponding to the set of regions, the location, shape and size of each portion in the first region mask being used to obtain the location, shape and size of the corresponding region in image 510.

[0085] The number of portions comprised in a region mask and their respective location, shape and size may vary from one region mask to another region mask.

[0086] In a variant, the regions of images 310, 410 or 510 are obtained through a segmenting process based on features of the image 310, 41 or 51, e.g., based on color attributes or depth attributes associated with the pixels of the image 310, 410 or 510.

[0087] For example, the segmenting process is based on the depth attributes associated with the pixels, each region being segmented using depth intervals, e.g., the region associated with the spatial area of the type 'floor' comprising the pixels of the image having a depth attribute comprised in a first depth interval, the first depth interval being associated with the type 'floor', the region associated with the spatial area of the type 'ceiling' comprising the pixels of the image having a depth attribute comprised in a second depth interval, the second depth interval being associated with the type 'floor', etc.

[0088] In another variant, the regions of the image 31, 41 and 51 are obtained by applying a region mask corresponding to the camera perspective type, as explained hereinabove, the shape and size of the region being further adapted / adjusted using depth and / or color attributes of the pixels of the image 31, 41 and 51, e.g., using depth and / or color attributes of the pixels located in the neighborhood of the limits of each region of the regions obtained from the applying of the region mask. The neighborhood of a limit comprises, for example, all pixels located in a band around the limit, the band having a determined width (e.g., a width of 10, 20, 50 or 100 pixels). Such a variant makes it possible to adjust the limits of a region in a way that the region encompasses all pixels having similar features (e.g., color and / or depth).

[0089] At block 24, position data representative of the position of the lighting device in the first environment 10 is received. Position data is received for each lighting device 11 to 16 to be controlled by the control device.

[0090] The position data is for example received from a memory of the control device. According to this example, the position of the lighting device may be input via a user interface, e.g., by the user watching the image. The image may correspond to an image generated when playing a video game run on laptop 18 or on a game console acting as the control device, or to an image of a movie displayed on TV screen 19, TV screen 19 being for example wirelessly controlled by laptop 18 or by a set-top box connected to the TV screen through a wired connection such as HDMI connector for example, laptop 18 or the set-top box acting as the control device.

[0091] According to another example, the first data is stored in the memory of a data processing device 241 such as a smartphone, a tablet, a server communicatively coupled to the control device.

[0092] According to a further example, the position data is received from the lighting device itself. According to this example, the position data is stored in the memory of each lighting device.

[0093] The position data is for example received automatically by the control device from the lighting device when connecting the lighting device to the control device. The connection of the lighting device to the control device triggers the transmission of the position data by the lighting device to the control device through the connection that may correspond to a wireless connection, e.g., Bluetooth ®< or Wifi ®< . When connecting the lighting device to the control device, the control device and the lighting device automatically initiate a process for communicating the position data through dedicated API(s). This process corresponds for example to a so-called "plug and play" (PnP) process, the control device and the lighting device corresponding to PnP devices.

[0094] According to a variant, the control device transmits a request to the lighting device to obtain the position data from the lighting device receiving this request, the transmission of the request occurring after having connected the lighting device to the control device. According to this variant, the lighting device transmits the position data stored in its memory to the control device in response to the received request.

[0095] According to a non-limitative exemplary embodiment, the position data is generated during a mapping of the first environment 10 comprising the lighting device(s) 11 to 16 and / or during a setup operation of the first environment 10.

[0096] The mapping comprises associating the position data with lighting devices 11 to 16 arranged in the first environment 10, or at least with the lighting devices to be controlled by the control device. The associating is for example performed for each lighting device that the user performing the mapping wants to be used for rendering light or lighting effect(s) in the first environment 10. The mapping may be performed for a plurality of first environments, for example in every room of a house or building where the user is likely to consume video content, or in every room comprising one or more connected lighting devices controllable by the control device.

[0097] The mapping is for example performed via a mapping application running on a processing device 241 (such as a mobile phone, tablet or laptop) or on the control device. To reach that aim, the position data to be associated with each lighting device is input to the mapping application by the user through one or more user interfaces such as for example a tactile interface associated with the screen of processing device 241 or through a peripheral device such as a keyboard and / or a mouse coupled to the control device, when applicable.

[0098] The position data may be stored in a file on processing device 241 and / or control device and the file can be edited by the user, e.g., to update the position data through specific application(s).

[0099] The position data comprises for example: second information identifying a determined spatial area in the first environment 10, the determined spatial area belonging to the set of spatial areas; and third information representative of a relative position of the lighting device in the determined spatial area.

[0100] According to this example, a 2D or 3D map of the first environment 10 may be generated with the mapping application and used to locate the one or more lighting devices 11 to 16. Using the mapping application, the user may position each lighting device on the 3D map, which makes it possible to automatically obtain the second information, each spatial area of the set of spatial areas being identified and located in the 3D map.

[0101] In a variant, the user may select the spatial area comprising the lighting device he / she wants to associate with this spatial area (to obtain the second information) in a list of spatial areas comprised in the first environment, reiterating the operation for each lighting device 11 to 16.

[0102] The third information may correspond to a rough or approximate position of the lighting device in reference to the spatial area the lighting device belongs to, this rough or approximate information being for example obtained by positioning the lighting device in the spatial area in the 3D map of the first environment.

[0103] In a variant, the third information may correspond to a precise location, e.g., to a set of coordinates in a (2D) cartesian coordinate system associated with the spatial area the lighting device is associated with (identified with the second information). According to this variant, the third information defining the position of the lighting device is expressed in the space of the spatial area.

[0104] According to another example, the position data comprises coordinates of the position of the lighting device, the coordinates being defined in a coordinate system associated with the first environment 10. The coordinate system corresponds for example to a 3D cartesian coordinate system represented with orthonormal axis or vectors X 1 , Y 1 and Z 1 , the origin of the coordinate system corresponding to a determined point in the first environment 10, e.g., a corner of a rectangular parallelepiped when the first environment 10 is represented with a bounding box or a reference point of the first environment, called first reference point 'O 1 ' and corresponding to a point of the first environment from which the image is watched by a user (e.g., the middle point of the couch). When the coordinate system corresponds to a 3D cartesian coordinate system, the position data comprises the coordinates of a point representing the position of the lighting device in the first environment 10, the position data corresponding to a triplet of values (x,y,z).

[0105] In an embodiment, the position data is received by the control device with additional data, which may be stored in the memory of each lighting device or in processing device 241. The additional data comprises for example one or more of the following data, in any possible combination: data representative of a position of each light-emitting device, e.g., a LED, of a set of light-emitting devices comprised in the lighting device, when applicable; the data indicating the relative position of each of the light-emitting devices arranged in the lighting device, e.g., in a local space associated with the lighting device; in this respect, the second information may represent the position of a reference point of the lighting device, or the position of a reference light-emitting device of the lighting device; and / or data representative of the number of light-emitting devices comprised in the lighting device; and / or data representative of the type and / or lighting characteristics of the light-emitting devices comprised in the lighting device; and / or data representative of the type, characteristics and / or configuration of the lighting device, e.g., the dimensions of the lighting device.

[0106] The position data and additional data are formatted in a determined format and transmitted according to a determined standard.

[0107] At block 25, the lighting device is associated with a part of a region of the set of regions according to the first information associated with the set of regions of the image and according to the position data obtained at block 24.

[0108] When the position data comprises the second information and the third information, the second information is compared with the first information associated with each region of the image to determine which region of the image the lighting device is to be associated with. As a result of the comparison, the lighting device is associated with the region of the image having the first information representative of the spatial area indicated by the second information. The part of the region to be associated with the lighting device is determined or obtained from the third information, i.e., the relative position of the lighting device with reference to the spatial area of the first information the lighting device belongs to.

[0109] As illustrated in Figure 3, the first lighting device 11 is associated with a part 31 of the second region 312 of image 310. Indeed, the first lighting device 11 is fixed on the front wall 102 in the first environment 10, i.e., the first lighting device 11 belongs to or is associated with the front wall 102 in the first environment 10, and the first information associated with the second region 312 is representative of the second spatial part, i.e., the spatial part of the type 'front wall'. Part 31 of the second region 312 corresponds to the upper left portion of the second region 312 as the first lighting device 11 is fixed on the upper left part of the front wall 102, as indicated by the third information. When the third information is representative of coordinates of the position of the first lighting device 11 in the coordinate system associated with the front wall 102, a change of reference is implemented to map the position of the first lighting device 11 in the first environment 10 (relatively to the front wall 102) to a position in the second region 312.

[0110] A part of a region may correspond to a pixel or to a group of pixels.

[0111] Similarly, the second lighting device 12 is associated with a part 32 of the second region 312 of image 310, part 32 corresponding to (or belonging to) the upper right portion of the second region 312 of image 310. The third lighting device 13 is associated with a part 33 of the third region 313 of image 31. Part 33 may correspond to a group of pixels of the third region 313 comprised in a bounding box, the size and shape of the bounding box being determined from the additional data received with the position data, when applicable. The fourth lighting device 14 is associated with a part 34 of the first region 311 of image 310, the part 34 being in (or belonging to) a left portion of the first region 311. Part 34 may correspond to a group of pixels of the first region 311 comprised in a bounding box, the size and shape of the bounding box being determined from the additional data received with the position data, when applicable. The fifth lighting device 15 is associated with a part 35 of the first region 311 of image 310, the part 35 being in (or belonging to) a right portion of the first region 311. Part 35 may correspond to a group of pixels of the first region 311 comprised in a bounding box, the size and shape of the bounding box being determined from the additional data received with the position data, when applicable. The sixth lighting device 16 is associated with a part 36 of the fifth region 315 of image 310, the part 36 corresponding to (or belonging to) the central portion of the fifth region 315 of image 310.

[0112] Similarly, as illustrated on figure 4, the first lighting device 11 is associated with a part 41 of the third region 412 of image 410, part 42 corresponding to (or belonging to) the upper left portion of the third region 412 of image 410. The second lighting device 12 is associated with a part 42 of the third region 412 of image 410, the part 42 corresponding to (or belonging to) the upper right portion of the third region 412 of image 410. The third lighting device 13 is associated with a part 43 of the fourth region 413 of image 410. Part 43 may correspond to a group of pixels of the fourth region 413 comprised in a bounding box, the size and shape of the bounding box being determined from the additional data received with the position data, when applicable. The fourth lighting device 14 is associated with a part 44 of the first region 411L, part 44 being in (or belonging to) a left portion of the first region 411L of image 410. Part 44 may correspond to a group of pixels of the first region 411L comprised in a bounding box, the size and shape of the bounding box being determined from the additional data received with the position data, when applicable. The fifth lighting device 15 is associated with a part 45 of the second region 411R, part 45 being in (or belonging to) a right portion of the first region 411R of image 410. Part 45 may correspond to a group of pixels of the second region 411R comprised in a bounding box, the size and shape of the bounding box being determined from the additional data received with the position data, when applicable. The sixth lighting device 16 is associated with a part 46 of the sixth region 415 of image 410, part 46 corresponding to (or belonging to) the central portion of the sixth region 415 of image 410.

[0113] Similarly, as illustrated in figure 5, the first lighting device 11 is associated with a part 51 of the second region 512 of image 510, part 51 corresponding to (or belonging to) the upper left portion of the second region 512 of image 510. The second lighting device 12 is associated with a part 52 of the second region 512 of image 510, part 42 corresponding to (or belonging to) the upper right portion of the second region 512 of image 510. The third lighting device 13 is associated with a part 53 of the third region 513 of image 510. Part 53 may correspond to a group of pixels of the third region 513 comprised in a bounding box, the size and shape of the bounding box being determined from the additional data received with the position data, when applicable. The fourth lighting device 14 is associated with a part 54 of the first region 511, part 54 being in (or belonging to) a left portion of the first region 511 of image 510. Part 54 may correspond to a group of pixels of the first region 511 comprised in a bounding box, the size and shape of the bounding box being determined from the additional data received with the position data, when applicable. The fifth lighting device 15 is associated with a part 55 of the first region 511, part 55 being in (or belonging to) a right portion of first region 511 of image 510. Part 55 may correspond to a group of pixels of the second region 411R comprised in a bounding box, the size and shape of the bounding box being determined from the additional data received with the position data, when applicable. The sixth lighting device 16 is associated with a part 56 of the fifth region 515 of image 510, part 56 corresponding to (or belonging to) the central portion of the fifth region 515 of image 510.

[0114] The use of the position data and the first information, with optionally the additional data, enables a mapping between the location of each lighting device 11 to 16 in the first environment 10 and a part of image 310, 410 or 510. The use of the spatial areas identified with similar identifiers in the position data (i.e., in the second information) and in the first information associated with the regions of image 310, 410, 510 enables to speed up the mapping process, which may be implemented at run time when rendering images 310, 410, 510 and / or processing the image data of images 310, 410, 510.

[0115] When the position data corresponds to the coordinates of a point representing the position of the lighting device in the first environment 10 (e.g., the position data corresponding to a triplet of values (x,y,z)), the second information and the third information by processing the position data to determine information representative of the orientation of each lighting device 11 to 16 relative to the reference point O 1 (using the coordinates of O 1 when necessary). The orientation may be defined with a first angle representative of latitude (latitude angle or colatitude angle) and a second angle representative of longitude. The distance between the reference point O 1 and each lighting device may be further used to determine the second information and the third information for each lighting device.

[0116] At block 26, the lighting device is controlled according to color data obtained from the part of the region in image 310, 410, 510 the lighting device has been associated with at block 25.

[0117] Based on the example of Figure 3, the first lighting device 11 is controlled according to color data obtained from part 31, the second lighting device 12 is controlled according to color data obtained from part 32, the third lighting device 13 is controlled according to color data obtained from part 33, the fourth lighting device 14 is controlled according to color data obtained from part 34, the fifth lighting device 15 is controlled according to color data obtained from part 35 and the sixth lighting device 16 is controlled according to color data obtained from part 36.

[0118] Color data corresponds to the color attributes of the one or more pixels forming each part 31 to 36. The color attributes may correspond to color values associated with each channel of a color space like RGB (Red, Green, Blue) color space or CMYK (Cyan Magenta Yellow, Black) color space, a color value being for example coded in 8 or 10 bits for each color of the color space. According to variants, the color attributes may further comprise information representative of color temperature, defined in Kelvin (K) and / or an information representative of brightness or luminous intensity, for example defined in candela (cd).

[0119] When a part corresponds to a single pixel, the lighting device is controlled with the color data associated with this single pixel. When a part corresponds to a group of pixels, the lighting device is controlled with the color data determined from the color attributes of all the pixels forming the group of pixels, the color data being determined as the average of the color attributes associated with the plurality of pixels.

[0120] The control device determines the color data and transmits the color data to the considered lighting device wirelessly or via a wired connection depending on the type of connection between the control device and the lighting device.

[0121] When the lighting device corresponds to a LED strip (i.e., a lighting device comprising a plurality of light-emitting devices, e.g., the third lighting device 13, the fourth lighting device 14 and the fifth lighting device 15 according to the example of Figure 1), each light-emitting device may be controlled individually using the color attributes of the pixels of the part associated with each light-emitting device. In a variant, every light-emitting device is controlled with the same color data to obtain a uniform lighting.

[0122] In an embodiment, the color data determined for the lighting device, and for each light-emitting device of the lighting device when applicable, is further determined according to lighting characteristics of the lighting device. The lighting characteristics are for example received as additional data with the position, as described previously. The lighting characteristics comprise for example the color or range of color that a lighting device is configured to render and / or the color temperature or range of color temperature the lighting device is configured to render.

[0123] Such a process enables to control the lighting of a space into which a user is consuming a video content (e.g., a film or a video content of a video game) by increasing the consistency between the location of the lighting devices relative to their location in the space comprising the display device, i.e., the first information 10, and corresponding parts of the video content. This enables to increase the feeling of immersion while consuming the video content.

[0124] Such a process enables a dynamic control of the lighting of every space the user is moving to while consuming the video content on a mobile device, especially when the position data is received automatically by the control device (corresponding to or implemented in the mobile device) from the lighting devices of the space the user is moving to.

[0125] Figure 6 shows a schematic block diagram of steps of a method of controlling a lighting device, in accordance with at least one exemplary embodiment.

[0126] In a first step 61, a camera perspective type associated with a rendering of an image on a display device comprised in a first environment is determined.

[0127] In a second step 62, first information identifying a spatial area of a set of spatial areas is associated with each region of a set of regions of the image according to the camera perspective type, the set of spatial areas being defined according to a second environment adapted to comprise the display device.

[0128] In a third step 63, position data representative of position of the lighting device in the first environment is received.

[0129] In a fourth step 64, the lighting device is associated with a part of a region of the set of regions according to the first information and the position data.

[0130] In a fifth step 65, the lighting device is controlled according to color data obtained from the part of the region

[0131] According to exemplary embodiments, the variants and examples of operations described in relation to one of Figures 1 to 5 apply to the method steps of Figure 6. The steps of the method may be performed for each lighting device of the first environment, or at least for each lighting device of a set of lighting devices comprised in the first environment, and more specifically for each dynamic lighting device or connected lighting device.

[0132] Figure 7 shows a schematic block diagram illustrating an example of an apparatus or system 7 in which various aspects and exemplary embodiments are implemented.

[0133] System 7 may be embedded as one or more devices including the various components described below. In various embodiments, system 7 may be configured to implement one or more of the aspects described in the present application.

[0134] Examples of equipment that may form all or part of the system 7 include personal computers, laptops, smartphones, tablet computers, digital multimedia set top boxes and their associated processing systems, display devices, light-emitting devices, servers, chroma encoders, chroma decoders, video encoders, video decoders, post-processors processing output from a chroma and / or video decoder, pre-processors providing input to chroma and / or video encoder, web servers, set-top boxes, wireless (e.g., Bluetooth ®< ) connected wearable devices, game controller, mouse, mousepad, keyboard, palm rest, chairs, desk, XR headset, headphones, bracelet, head and / or lumbar support device or chair, any other device for processing chroma (lighting) data or signals, and / or video data or signals, or other communication devices. Elements of system 7, singly or in combination, may be embodied in a single integrated circuit (IC), multiple ICs, and / or discrete components. For example, in at least one embodiment, the processing and encoder / decoder elements of system 7 may be distributed across multiple ICs and / or discrete components. In various embodiments, the system 7 may be communicatively coupled to other similar systems, or to other electronic devices, via, for example, a communication bus or through dedicated input and / or output ports.

[0135] System 7 may include at least one processor 71 configured to execute instructions loaded therein for implementing, for example, the various aspects described in the present application. Processor 71 may include embedded memory, input output interface, and various other circuitries as known in the art. System 7 may include at least one memory 72 (for example a volatile memory device and / or a non-volatile memory device). System 7 may include a storage device 74, which may include non-volatile memory and / or volatile memory, including, but not limited to, Electrically Erasable Programmable Read-Only Memory (EEPROM), Read-Only Memory (ROM), Programmable Read-Only Memory (PROM), Random Access Memory (RAM), Dynamic Random-Access Memory (DRAM), Static Random-Access Memory (SRAM), flash, magnetic disk drive, and / or optical disk drive. Storage device 74 may include an internal storage device, an attached storage device, and / or a network accessible storage device, as non-limiting examples.

[0136] System 7 may include an encoder / decoder module 73 configured, for example, to process data to provide encoded / decoded chroma (lighting) signal data and / or encoded / decoded video signal or data, and encoder / decoder module 73 may include its own processor and memory. Encoder / decoder module 73 may represent module(s) that may be included in a device to perform the encoding and / or decoding functions. As is known, a device may include one or both of the encoding and decoding modules. Additionally, encoder / decoder module 73 may be implemented as a separate element of system 7 or may be incorporated within processor 71 as a combination of hardware and software as known to those skilled in the art.

[0137] Program code to be loaded onto processor 71 or encoder / decoder 73 to perform the various aspects described in the present application may be stored in storage device 74 and subsequently loaded onto memory 72 for execution by processor 71. In accordance with various embodiments, one or more of processor 71, memory 72, storage device 74, and encoder / decoder module 73 may store one or more of various items during the performance of the processes described in the present application. Such stored items may include, but are not limited to, data representative of chroma / lighting content, data representative of video content, a bitstream, matrices, variables, and intermediate or final results from the processing of equations, formulas, operations, and operational logic.

[0138] In several embodiments, the memory inside processor 71 and / or encoder / decoder module 73 may be used to store instructions and to provide working memory for processing that may be performed during data processing, encoding or decoding.

[0139] In other embodiments, however, a memory external to the processing device (for example, the processing device may be the processor) may be used for one or more of these functions. The external memory may be memory 72 and / or storage device 74, for example, a dynamic volatile memory and / or a non-volatile flash memory. In at least one embodiment, a fast external dynamic volatile memory such as a RAM may be used as working memory for data processing.

[0140] The input to the elements of system 7 may be provided through various input devices as indicated in block 75. Such input devices include, but are not limited to, (i) an RF portion that may receive an RF signal transmitted, for example, over the air by a broadcaster, (ii) a Composite input terminal, (iii) a USB input terminal, (iv) a phone connector (also known as phone jack, audio jack, headphone jack or jack plug) input terminal and / or (v) an HDMI input terminal.

[0141] In various embodiments, the input devices of block 75 may have associated respective input processing elements as known in the art. For example, the RF portion may be associated with elements necessary for (i) selecting a desired frequency (also referred to as selecting a signal, or band-limiting a signal to a band of frequencies), (ii) down-converting the selected signal, (iii) band-limiting again to a narrower band of frequencies to select (for example) a signal frequency band which may be referred to as a channel in certain embodiments, (iv) demodulating the down-converted and band-limited signal, (v) performing error correction, and (vi) demultiplexing to select the desired stream of data packets. The RF portion of various embodiments may include one or more elements to perform these functions, for example, frequency selectors, signal selectors, band-limiters, channel selectors, filters, downconverters, demodulators, error correctors, and de-multiplexers. The RF portion may include a tuner that performs various of these functions, including, for example, down-converting the received signal to a lower frequency (for example, an intermediate frequency or a near-baseband frequency) or to baseband.

[0142] Various embodiments rearrange the order of the above-described (and other) elements, remove some of these elements, and / or add other elements performing similar or different functions.

[0143] Adding elements may include inserting elements in between existing elements, such as, for example, inserting amplifiers and an analog-to-digital converter. In various embodiments, the RF portion may include an antenna.

[0144] Additionally, the USB and / or HDMI terminals may include respective interface processors for connecting system 7 to other electronic devices across USB and / or HDMI connections. It is to be understood that various aspects of input processing, for example, analog to digital conversion, time domain to frequency domain conversion, down sampling, band pass or low pass filtering, Reed-Solomon error correction, may be implemented, for example, within a separate input processing IC or within processor 71 as necessary. Similarly, aspects of USB or HDMI interface processing may be implemented within separate interface ICs or within processor 71 as necessary. The processed stream may be provided to various processing elements, including, for example, processor 71, and encoder / decoder 73 operating in combination with the memory and storage elements to process the data stream as necessary for presentation on an output device.

[0145] Various elements of system 7 may be provided within an integrated housing.

[0146] Within the integrated housing, the various elements may be interconnected and transmit data therebetween using suitable connection arrangement, for example, an internal bus as known in the art, including the I2C bus, wiring, and printed circuit boards.

[0147] System 7 may include communication interface 76 that enables communication with other devices via communication channel 760. Communication interface 76 may include, but is not limited to, a transceiver configured to transmit and to receive data over communication channel 760. Communication interface 76 may include, but is not limited to, a modem or network card and communication channel 760 may be implemented, for example, within a wired and / or a wireless medium.

[0148] Data may be streamed to system 7, in various embodiments, using a Wi-Fi network such as IEEE 802.11. The Wi-Fi signal of these embodiments may be received over communication channel 760 and communications interface 76 which are adapted for Wi-Fi communications. Communication channel 760 of these embodiments may be typically connected to an access point or router that provides access to outside networks including the Internet for allowing streaming applications and other over-the-top communications.

[0149] Other embodiments may provide streamed data to system 7 using a set-top box or a computer that delivers the data over the HDMI connection of block 75.

[0150] Still other embodiments may provide streamed data to system 7 using the RF connection of block 75.

[0151] The streamed data may be used as a way for signaling information used by system 7. The signaling information may comprise the data encoded in a container such as a binary stream for example.

[0152] It is to be appreciated that signaling may be accomplished in a variety of ways. For example, one or more syntax elements, flags, and so forth may be used to signal information to a corresponding data processing device in various embodiments.

[0153] System 7 may provide an output signal to various output devices, including a display 770, lighting devices or light sources 780, and other peripheral devices 790 like haptic devices / actuators.

[0154] In various embodiments, control signals may be communicated between system 7 and display 770, light-emitting devices or light sources 780, or other peripheral devices 790 using signaling such as AV.Link (Audio / Video Link), CEC (Consumer Electronics Control), Audio protocols, USB (Universal Serial Bus), HID (Human Interface Design) for USB, HIF UHP (Haptics Industry Forum - Universal Haptic Protocol) or other communications protocols that enable device-to-device control with or without user intervention.

[0155] The output devices may be communicatively coupled to system 7 via dedicated connections through respective interfaces 77, 78, and 79.

[0156] Alternatively, the output devices may be connected to system 7 using communications channel 760 via communication interface 76. Display 770, lighting devices or light sources 780 and / or peripheral devices 790 such as haptic device(s) (actuators) may be integrated in a single unit with the other components of system 7 in an electronic device such as, for example, a television.

[0157] In various embodiments, display interface 77 may include a display driver, such as, for example, a timing controller (T Con) chip.

[0158] Display 770, lighting devices or light sources 780 and / or peripheral devices 790 such as haptic device(s) (actuators) may alternatively be separate from one or more of the other components. In various embodiments in which display 770, lighting devices or light sources 780 and / or peripheral devices 790 such as haptic device(s) (actuators) may be external components, the output signal may be provided via dedicated output connections, including, for example, HDMI ports, USB ports, or COMP outputs.

[0159] In Figures 1 to 7, various methods are described herein, and each of the methods includes one or more steps or actions for achieving the described method. Unless a specific order of steps or actions is required for proper operation of the method, the order and / or use of specific steps and / or actions may be modified or combined.

[0160] Some examples are described with regard to block diagrams and / or operational flowcharts. Each block represents a circuit element, module, or portion of code which includes one or more executable instructions for implementing the specified logical function(s). It should also be noted that in other implementations, the function(s) noted in the blocks may occur out of the indicated order. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks may sometimes be executed in the reverse order, depending on the functionality involved.

[0161] The implementations and aspects described herein may be implemented in, for example, a method or a process, an apparatus, a computer program, a data stream, a bitstream, or a signal. Even if only discussed in the context of a single form of implementation (for example, discussed only as a method), the implementation of features discussed may also be implemented in other forms (for example, an apparatus or computer program).

[0162] The methods may be implemented in, for example, a processor, which refers to processing devices in general, including, for example, a computer, a microprocessor, an integrated circuit, or a programmable logic device. Processors also include communication devices.

[0163] Additionally, the methods may be implemented by instructions being performed by a processor, and such instructions (and / or data values produced by an implementation) may be stored on a computer readable storage medium. A computer readable storage medium may take the form of a computer readable program product embodied in one or more computer readable medium(s) and having computer readable program code embodied thereon that is executable by a computer. A computer readable storage medium as used herein may be considered a non-transitory storage medium given the inherent capability to store the information therein as well as the inherent capability to provide retrieval of the information therefrom. A computer readable storage medium may be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. It is to be appreciated that the following, while providing more specific examples of computer readable storage mediums to which the present embodiments may be applied, is merely an illustrative and not an exhaustive listing as is readily appreciated by one of ordinary skill in the art: a portable computer diskette; a hard disk; a read-only memory (ROM); an erasable programmable read-only memory (EPROM or Flash memory); a portable compact disc read-only memory (CD-ROM); an optical storage device; a magnetic storage device; or any suitable combination of the foregoing.

[0164] The instructions may form an application program tangibly embodied on a processor-readable medium.

[0165] Instructions may be, for example, in hardware, firmware, software, or a combination. Instructions may be found in, for example, an operating system, a separate application, or a combination of the two. A processor may be characterized, therefore, as, for example, both a device configured to carry out a process and a device that includes a processor-readable medium (such as a storage device) having instructions for carrying out a process. Further, a processor-readable medium may store, in addition to or in lieu of instructions, data values produced by an implementation.

[0166] An apparatus may be implemented in, for example, appropriate hardware, software, and firmware. Examples of such apparatus include personal computers, laptops, smartphones, tablet computers, digital multimedia set top boxes, digital television receivers, personal video recording systems, connected home appliances, head mounted display devices (HMD, see-through glasses), projectors (beamers), "caves" (system including multiple displays), servers, video and / or haptic and / or chroma encoders, video and / or haptic and / or chroma decoders, haptic engine, chroma engine, post-processors processing output from a video decoder, pre-processors providing input to a video encoder, web servers, set-top boxes, wireless connected wearable haptic devices, e.g., Bluetooth ®< connected wearable haptic devices, game controller, mouse, mousepad, keyboard, palm rest, chairs, desk, XR headset, headphones, bracelet, head and / or lumbar support device or chair, any light source, and any other device for processing haptic data or signals representative of one or more haptic feedback or effect and / or for processing lighting / chroma data or signals representative of one or more lighting mode or effect, or other communication devices. As should be clear, the equipment may be mobile.

[0167] Computer software may be implemented by processor 71 or by hardware, or by a combination of hardware and software. As a non-limiting example, the embodiments may be also implemented by one or more integrated circuits. Memory 72 may be of any type appropriate to the technical environment and may be implemented using any appropriate data storage technology, such as optical memory devices, magnetic memory devices, semiconductor-based memory devices, fixed memory, and removable memory, as non-limiting examples. Processor 71 may be of any type appropriate to the technical environment, and may encompass one or more of microprocessors, general purpose computers, special purpose computers, and processors based on a multi-core architecture, as non-limiting examples.

[0168] As will be evident to one of ordinary skill in the art, implementations may produce a variety of signals formatted to carry information that may be, for example, stored or transmitted. The information may include, for example, instructions for performing a method, or data produced by one of the described implementations. For example, a signal may be formatted to carry the bitstream of a described embodiment. Such a signal may be formatted, for example, as an electromagnetic wave (for example, using a radio frequency portion of spectrum) or as a baseband signal. The formatting may include, for example, encoding a data stream and modulating a carrier with the encoded data stream. The information that the signal carries may be, for example, analog or digital information. The signal may be transmitted over a variety of different wired or wireless links, as is known. The signal may be stored on a processor-readable medium.

[0169] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used herein, the singular forms "a", "an", and "the" may be intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "includes / comprises" and / or "including / comprising" when used in this specification, may specify the presence of stated, for example, features, integers, steps, operations, elements, and / or components but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof. Moreover, when an element is referred to as being "responsive" or "connected" to another element, it may be directly responsive or connected to the other element, or intervening elements may be present. In contrast, when an element is referred to as being "directly responsive" or "directly connected" to other element, there are no intervening elements present.

[0170] It is to be appreciated that the use of any of the symbol / term " / ", "and / or", and "at least one of", for example, in the cases of "A / B", "A and / or B" and "at least one of A and B", may be intended to encompass the selection of the first listed option (A) only, or the selection of the second listed option (B) only, or the selection of both options (A and B). As a further example, in the cases of "A, B, and / or C" and "at least one of A, B, and C", such phrasing is intended to encompass the selection of the first listed option (A) only, or the selection of the second listed option (B) only, or the selection of the third listed option (C) only, or the selection of the first and the second listed options (A and B) only, or the selection of the first and third listed options (A and C) only, or the selection of the second and third listed options (B and C) only, or the selection of all three options (A and B and C). This may be extended, as is clear to one of ordinary skill in this and related arts, for as many items as are listed.

[0171] Various numeric values may be used in the present application. The specific values may be for example purposes and the aspects described are not limited to these specific values.

[0172] It will be understood that, although the terms first, second, etc. may be used herein to describe various elements, these elements are not limited by these terms. These terms are only used to distinguish one element from another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element without departing from the teachings of this application. No ordering is implied between a first element and a second element.

[0173] Reference to "one exemplary embodiment" or "an exemplary embodiment" or "one implementation" or "an implementation", as well as other variations thereof, is frequently used to convey that a particular feature, structure, characteristic, and so forth (described in connection with the embodiment / implementation) is included in at least one embodiment / implementation. Thus, the appearances of the phrase "in one exemplary embodiment" or "in an exemplary embodiment" or "in one implementation" or "in an implementation", as well any other variations, appearing in various places throughout this application are not necessarily all referring to the same embodiment.

[0174] Similarly, reference herein to "in accordance with an exemplary embodiment / example / implementation" or "in an exemplary embodiment / example / implementation", as well as other variations thereof, is frequently used to convey that a particular feature, structure, or characteristic (described in connection with the exemplary embodiment / example / implementation) may be included in at least one exemplary embodiment / example / implementation. Thus, the appearances of the expression "in accordance with an exemplary embodiment / example / implementation" or "in an exemplary embodiment / example / implementation" in various places in the specification are not necessarily all referring to the same exemplary embodiment / example / implementation, nor are separate or alternative exemplary embodiment / examples / implementation necessarily mutually exclusive of other exemplary embodiments / examples / implementation.

[0175] Reference numerals appearing in the claims are by way of illustration only and shall have no limiting effect on the scope of the claims. Although not explicitly described, the present embodiments / examples and variants may be employed in any combination or sub-combination.

[0176] When a figure is presented as a flow diagram, it should be understood that it also provides a block diagram of a corresponding apparatus. Similarly, when a figure is presented as a block diagram, it should be understood that it also provides a flow diagram of a corresponding method / process.

[0177] Although some of the diagrams include arrows on communication paths to show a primary direction of communication, it is to be understood that communication may occur in the opposite direction to the depicted arrows.

[0178] Additionally, this application may refer to "obtaining" various pieces of information. Obtaining the information may include one or more of, for example, receiving the information, determining the information, estimating the information, calculating the information, or retrieving the information from memory.

[0179] Further, this application may refer to "accessing" various pieces of information. Accessing the information may include one or more of, for example, receiving the information, retrieving the information (for example, from memory), storing the information, moving the information, copying the information, calculating the information, determining the information, or estimating the information.

[0180] Additionally, this application may refer to "receiving" various pieces of information. Receiving is, as with "accessing", intended to be a broad term. Receiving the information may include one or more of, for example, accessing the information, or retrieving the information (for example, from memory). Furthermore, "receiving" is typically involved, in one way or another, during operations such as, for example, storing the information, processing the information, transmitting the information, moving the information, copying the information, erasing the information, calculating the information, determining the information, or estimating the information.

[0181] A number of implementations have been described. Nevertheless, it will be understood that various modifications may be made. For example, elements of different implementations may be combined, supplemented, modified, or removed to produce other implementations. Additionally, one of ordinary skill will understand that other structures and processes may be substituted for those disclosed and the resulting implementations will perform at least substantially the same function(s), in at least substantially the same way(s), to achieve at least substantially the same result(s) as the implementations disclosed. Accordingly, these and other implementations are contemplated by this application.

Examples

Embodiment Construction

[0027]At least one of the exemplary embodiments is described more fully hereinafter with reference to the accompanying figures, in which examples of at least one of the exemplary embodiments are illustrated. An exemplary embodiment may, however, be embodied in many alternate forms and should not be construed as limited to the examples set forth herein. Accordingly, it should be understood that there is no intent to limit exemplary embodiments to the particular forms disclosed. On the contrary, the disclosure is intended to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the present application.

[0028]Exemplary embodiments described hereinafter may be combined with each other or each of the exemplary embodiment may be individually implemented, e.g., as an alternative embodiment.

[0029]At least one of the aspects generally relates to a method and apparatus of controlling one or more lighting devices to render a lighting effect. The apparatus...

FIELD

[0001] The present application generally relates to the field of lighting and, in particular, to the controlling of one or more lighting devices to render or emit light in a three-dimensional (3D) environment. The present application also relates to method and apparatus of controlling one or more lighting devices according to data representative of one or more images displayed on a display device comprised in the 3D environment.BACKGROUND

[0002] The present section is intended to introduce the reader to various aspects of art, which may be related to various aspects of at least one exemplary embodiment of the present application that is described and / or claimed below. This discussion is believed to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of the present application.

[0003] To improve user experience when playing a media content such as a video content or a video game, it is known to control the lighting of one or more peripherals in the media content playback environment.

[0004] Controlling the lighting of such peripherals may for example increase the feeling of immersion while watching a movie or playing a video game. Such peripherals comprise smart LED light bulbs, RGB (Red, Green, Blue) components and accessories such as LED strips, keyboards, mice, mouse mats, speakers, screens, headsets or even the casing of the media player.

[0005] Lighting or color effects may be obtained by controlling the one or more light-emitting devices such as LED (Light-Emitting Diode) equipping the one or more peripherals arranged in the media content playback environment.

[0006] Lighting or color effects may further be rendered in a determined environment to provide an appropriate ambient lighting.

[0007] However, there is still room for improvement to control the lighting of the media content playback environment, e.g., to improve the feeling of immersion.SUMMARY

[0008] The following section presents a simplified summary of at least one exemplary embodiment in order to provide a basic understanding of some aspects of the present application. This summary is not an extensive overview of an exemplary embodiment. It is not intended to identify key or critical elements of an embodiment. The following summary merely presents some aspects of at least one of the exemplary embodiments in a simplified form as a prelude to the more detailed description provided elsewhere in the document.

[0009] According to a first aspect of the present application, there is provided a method of controlling a lighting device, the method comprising: determining a camera perspective type associated with a rendering of an image on a display device comprised in a first environment; associating, with each region of a set of regions of the image, the first information identifying a spatial area of a set of spatial areas according to the camera perspective type, the set of spatial areas being defined according to a second environment adapted to comprise the display device; receiving position data representative of the position of the lighting device in the first environment; associating the lighting device with a part of a region of the set of regions according to the first information and the position data; controlling the lighting device according to color data obtained from the part of the region.

[0010] In an exemplary embodiment, the method further comprises segmenting the image to obtain the set of regions.

[0011] In an exemplary embodiment, the segmenting is according to the camera perspective type.

[0012] In an exemplary embodiment, a determined region mask being associated with the camera perspective type, the segmenting comprises applying the determined region mask to the image to obtain the set of regions.

[0013] In an exemplary embodiment, the camera perspective type belongs to a set of camera perspective types comprising: first-person perspective type; and third-person perspective type; and fixed perspective type.

[0014] In an exemplary embodiment, the position data comprises: second information identifying a determined spatial area in the first environment, the determined spatial area belonging to the set of spatial areas; and third information representative of a relative position of the lighting device in the determined spatial area.

[0015] In an exemplary embodiment, the part of the region corresponds to a group of pixels of the image.

[0016] In an exemplary embodiment, the color data is obtained from color attributes associated with the group of pixels.

[0017] In another exemplary embodiment, the position data is received wirelessly from the lighting device.

[0018] In another exemplary embodiment, the method further comprises receiving data representative of lighting characteristics of the lighting device, the color data being further determined according to the lighting characteristics.

[0019] In an additional exemplary embodiment, the method further comprises transmitting the color data to the lighting device.

[0020] In an additional exemplary embodiment, the first environment corresponds to the second environment.

[0021] According to a second aspect of the present application, there is provided a device or an apparatus comprising a memory associated with at least a processor configured to implement the method in accordance with the first aspect of the present application.

[0022] According to a third aspect of the present application, there is provided a computer program product including instructions which, when the program is executed by one or more processors, causes the one or more processors to carry out a method according to the first aspect of the present application.

[0023] According to a fourth aspect of the present application, there is provided a non-transitory storage medium carrying instructions of program code for executing a method according to the first aspect of the present application.

[0024] The specific nature of at least one of the exemplary embodiments as well as other objects, advantages, features and uses of said at least one exemplary embodiments will become evident from the following description of examples taken in conjunction with the accompanying drawings.BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Reference will now be made, by way of example, to the accompanying drawings which show exemplary embodiments of the present application, and in which: Figure 1 shows a schematic representation of a three-dimensional (3D) environment comprising one or more lighting devices, in accordance with exemplary embodiments; Figure 2 shows a schematic block diagram of blocks of a process of controlling a lighting device, in accordance with exemplary embodiments; Figure 3 shows the association between the one or more lighting devices of figure 1 with regions of an image of a scene rendered according to a first camera perspective type, in accordance with an exemplary embodiment; Figure 4 shows the association between the one or more lighting devices of figure 1 with regions of an image of a scene rendered according to a second camera perspective type, in accordance with at least one exemplary embodiment; Figure 5 shows the association between the one or more lighting devices of figure 1 with regions of an image of a scene rendered according to a third camera perspective type, in accordance with at least one exemplary embodiment; Figure 6 shows a schematic block diagram of steps of a method of controlling a lighting device, in accordance with exemplary embodiments; Figure 7 illustrates a schematic block diagram of an example of a system or apparatus in which various aspects and exemplary embodiments are implemented.

[0026] Similar reference numerals may have been used in different figures to denote similar components.DESCRIPTION OF EXEMPLARY EMBODIMENTS

[0027] At least one of the exemplary embodiments is described more fully hereinafter with reference to the accompanying figures, in which examples of at least one of the exemplary embodiments are illustrated. An exemplary embodiment may, however, be embodied in many alternate forms and should not be construed as limited to the examples set forth herein. Accordingly, it should be understood that there is no intent to limit exemplary embodiments to the particular forms disclosed. On the contrary, the disclosure is intended to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the present application.

[0028] Exemplary embodiments described hereinafter may be combined with each other or each of the exemplary embodiment may be individually implemented, e.g., as an alternative embodiment.

[0029] At least one of the aspects generally relates to a method and apparatus of controlling one or more lighting devices to render a lighting effect. The apparatus may correspond to a control device configured to determine lighting data, e.g., color data, to control the one or more lighting devices. A lighting device corresponds to any device configured to emit light (lamp, light bulb, strip of LEDs or any peripheral or device incorporating one or more light sources, e.g., RGB light sources (for example arrangement of LEDs)) that is configured to be controlled by the control device to render a lighting effect. The lighting effect may be dynamic, i.e., the lighting effect may vary over time and / or space.

[0030] The method comprises determining a camera perspective type associated with a rendering of an image on a display device comprised in a first environment, e.g., a real 3D environment like a room of a house or a building. The type of the camera perspective used to render the image (of a 3D virtual scene for example) belongs for example to a determined set of camera perspectives comprising the first-person perspective (FPP), the third-person perspective (TPP) and the fixed perspective (FP, such as side-scrolling perspective or top-down perspective). The image comprises a plurality of regions (e.g., obtained by segmenting the image or by applying a determined mask associated with the camera perspective type). A first information identifies a given spatial area being associated with the image, the association between the regions and the first information being according to the camera perspective type associated with the image. The spatial area belongs to a set of spatial areas which may correspond to spatial areas of a second environment, e.g., spatial areas of a space or room of a house or building, such as the ceiling, the floor, side walls, front wall, etc. Position data representative of the position of each of the one or more lighting devices in the first environment is received. The position data may be stored in a memory of each of the lighting devices and received wirelessly from each of the lighting devices or inputs via a peripheral device associated with the control device, e.g., a keyboard or a tactile interface of a screen of the control device or any device communicatively coupled to the control device. The lighting devices, or part of them, are each associated with a part of a region of the image using the position data and the first information. Each of the lighting devices is controlled according to color data corresponding to the color information associated with the part of the region of the image the lighting device is associated with, the color data corresponding for example to color attributes of the pixels of the image comprised in the part of the region.

[0031] A lighting effect corresponds to any generation of light through the one or more lighting devices, the lighting effect varying for example over time according to the color information associated with the part of the region of the image associated with each of the one or more lighting devices, according to the content / image displayed on the display device.

[0032] At least another one of the aspects generally relates to a method and apparatus of rendering light by one or more lighting devices according to the lighting control parameters (color data) obtained while rendering a video content (images) to be displayed on the display device, the video content varying over time, e.g., according to the move and / or movements of an avatar in a virtual environment (controlled by a user playing a video game for example) or according to the different scenes associated with a real environment (in case of a movie displayed on the display device for example).

[0033] Figure 1 illustrates a schematic representation of a first environment 10 in accordance with at least one exemplary embodiment.

[0034] Figure 1 shows a first environment 10 corresponding to a space of a real environment, e.g., a room of a house as in the example of Figure 1.

[0035] According to the non-limitative example of Figure 1, the first environment 10 corresponds to a living room comprising a couch 17, a coffee table with a laptop 18 resting on the coffee table and a display device 19 such as a TV screen mounted on a wall 102 facing the couch 17.

[0036] The first environment 10 comprises a set of spatial areas. This set of spatial areas may have been defined with reference to a generic environment, called second environment, which is adapted to comprise a display device (such as a TV screen, a monitor (screen) of a computer, a screen of a video game console, etc.). Such a second environment corresponds to a 3D real environment, e.g., a room or space of an apartment, a house, a building, etc.

[0037] In an embodiment, the first environment 10 corresponds to the second environment, the first environment 10 and the second environment corresponding to one and a same environment.

[0038] The set of spatial areas comprises areas that are adapted to receive or support one or more lighting devices, each spatial area of the set of spatial areas being identified via a unique identifier (e.g., a name or a sequence of bits, the identifier being for example coded on 4, 6 or 8 bits). Each spatial area is for example identified with a name identifying and defining its type and its relative position with reference to a reference position in the second environment. The reference position corresponds for example to the position of the center of the second environment. According to another example, the reference position corresponds to the theoretical position of a user sitting in front of the display device to watch the images and video contents displayed on the display device in the second environment.

[0039] The set of spatial areas comprises for example: a first spatial area called floor; and / or a second spatial area called front wall; and / or a third spatial area called left-hand side wall; and / or a fourth spatial area called right-hand side wall; and / or a fifth spatial area called ceiling; and / or a sixth spatial area called back wall.

[0040] The first environment 10 comprises a plurality of lighting devices 11 to 16, i.e., a first lighting device 11, a second lighting device 12, a third lighting device 13, a fourth lighting device 14, a fifth lighting device 15 and a sixth lighting device 16, according to the exemplary embodiment of Figure 1.

[0041] The first lighting device 11 and the second lighting device 12 may correspond to wall-mounted lights. The third lighting device 13, the fourth lighting device 14 and the fifth lighting device 15 may each correspond to a LED strip, e.g., a RGB (Red, Green, Blue) LED strip. The sixth lighting device 16 may correspond to a ceiling-mounted lamp. According to other examples, one or more lighting devices comprised in the first environment 10 correspond to floor-standing lamps or desk lamps.

[0042] Naturally, the number and types of lighting devices 11 to 16 are not limited to the examples described with regard to figure 1 but extend to any number (e.g., 1, 2, 3, 4, 5, 10, 20 or more) and any type of lighting devices.

[0043] According to the example of Figure 1, the first lighting device 11 and the second lighting device 12 are fixed on the front wall 102, the third lighting device 13 is fixed on the left-hand wall 103, the fourth lighting device 14 and the fifth lighting device 15 are arranged in the floor 101 and the sixth lighting device 16 is fixed on the ceiling 106. The spatial areas of the first environment 10 are for example identified with reference to a reference position corresponding to the position of a user watching the images and / or video contents displayed on the screen of the laptop 18 or on the TV screen 19. This reference point O 1 corresponds for example to the center of the couch seat.

[0044] The lighting device(s) comprised in the first environment 10 may correspond to a dynamic lighting device corresponding to: a device whose primary function is to illuminate the first environment 10 or part of the first environment 10, e.g., a connected lamp; or a device configured to implement several functions, including the ability to reproduce a lighting device through the one or more light sources it embeds, e.g.: a display device corresponding for example to the TV screen 19 configured to display images from image data received from the control device; the display device may comprise light sources for example arranged on the back of the display device and / or around the perimeter of the screen of the display device; a keyboard, e.g., a LED backlit keyboard; a mat such as a gaming mat or a mouse mat, the mat comprising for example a RGB (Red, Green, Blue) LED strip arranged around its perimeter; or a mouse, e.g., a mouse comprising RGB LEDs.

[0045] A dynamic lighting device such as lighting devices 11 to 16 corresponds to a device comprising one or more light sources, such as LED (light-emitting diode), to generate light according to lighting data transmitted by a control device to each of the lighting devices of the first environment communicatively coupled to the control device.

[0046] The type of the lighting device is not limited to the aforementioned examples but extends to any device or apparatus comprising one or more light-emitting devices or light sources and configured to be controlled by a control device to emit light. A lighting device may further correspond to a palm rest, a chair, a desk, a XR headset, headphones, a bracelet, a head and / or lumbar support device or chair, i.e., any device configured to render light including any personal computer peripheral device comprising one or more light-emitting devices such as a keyboard, a mouse, a mouse mat, headphone holder, earbuds, monitor or screen device.

[0047] The control device may also comprise one or more light sources and be part of the set of lighting devices comprised in the first environment 10 and controlled by the control device.

[0048] Some of the lighting devices correspond to interface peripheral devices of the control device, e.g., a screen or display device, a keyboard and / or a mouse may correspond to interface peripheral devices of the control device.

[0049] The control device and the lighting devices of the first environment 10 communicatively coupled to the control device are connected to each other through wired connection (e.g., via USB (Universal Serial Bus) input terminal, via a phone connector (also known as phone jack, audio jack, headphone jack or jack plug) input terminal or via an HDMI input terminal) or through wireless connection (e.g., Bluetooth ®< or Wifi ®< ).

[0050] A control device corresponds to any processing device configured to determine or generate lighting data to be transmitted to lighting devices 11 to 16 to control lighting devices 11 to 16 for the rendering of light or of a lighting effect in the first environment 10.

[0051] According to the exemplary embodiments of figure 1, the control device corresponds to laptop 18. According to other examples, the control device may correspond to a personal computer, game consol, set-top box, mobile communication device such as a smartphone or a tablet. The control device may be configured to run one or more software applications.

[0052] Figure 2 illustrates a process of controlling the one or more lighting devices 11 to 16 of the first environment 10 in accordance with at least one exemplary embodiment.

[0053] The process is implemented by one or more processors of a control device such as laptop 18 or any data processing device such as a personal computer, a game consol, a set-top box, a rendering engine, a chroma engine, a mobile communication device such as a smartphone or a tablet.

[0054] The process will be described with reference to the control of one lighting device corresponding to one of lighting devices 11 to 16 but applies similarly to the control of each of lighting devices 11 to 16. One or more of the lighting devices comprised in the first environment may not be controlled according to the process. For example, lighting devices that are not configured to communicate with the control device are not controlled by the control device. According to another example, lighting device(s) fixed on the back wall may not be controlled by the control device.

[0055] Data exchange between the control device and the lighting devices 11 to 16 is performed in the framework of a communication protocol, data being exchanged by way of APIs (Application Program Interface) that may be implemented both in the control device and in each of the lighting devices 11 to 16 of the first environment 10 communicatively coupled to the control device.

[0056] Blocks 21 to 26 represent either operations of the process or processing units implementing such operations of the process. The processing units may be implemented as a single element or as separate elements as a combination of hardware and software as known to those skilled in the art.

[0057] The operations of the process may be reiterated for each image of a sequence of images, or for each image of a part of the sequence of images (e.g., every 2, 5 or 10 images, or every 100, 250, 500 or 1000 ms) to reduce the processing costs and / or memory footprint.

[0058] At block 21, image data representative of the image displayed or to be displayed on the display device (e.g., the screen of the laptop 18) is obtained.

[0059] The image data is for example received as part of a data stream from a memory (e.g., ROM, RAM, flash), a data storing device (e.g., a hard drive, a USB key, an optical disk), a remote device (e.g., a server of the cloud) or a processing unit configured to render images at run time.

[0060] The image represented with the image data may be an image of a scene of a real environment, an image of a scene of a virtual environment (e.g., a CGI-generated environment) or an image of a scene of a mix of real and virtual environments.

[0061] Images of a real second environment may be acquired with one or more image acquisition devices (such as a camera or a plenoptic camera) according to one or different points of view, i.e., according to one or different camera perspectives. The sequence of the acquired images may form a movie to be displayed on the display device, e.g., to be watched by a user sitting on the couch 17.

[0062] Images of a virtual environment may be generated at run time, for example according to instructions received from peripheral device(s) connected to the control device or to the rendering device configured to render the images. The images are generated, for example, as a function of an avatar's (or any object of the virtual environment) movement in the virtual environment, according to commands received from the user controlling the avatar's movement, when the images are representative of a virtual environment of a video game played by the user. The images are generated according to one or more perspective cameras, the camera perspective may vary over time.

[0063] A perspective camera corresponds to a model used to represent how 3D objects are projected onto a 2D image plane, creating a sense of depth and realism. Depending on the perspective camera type, it may simulate the way human vision perceives the world, where objects appear smaller as they are farther away, thus capturing the spatial relationships and dimensions of the scene. According to at least one perspective camera type, the perspective camera corresponds to the point of view according to which the scene is rendered or acquired.

[0064] The perspective camera type associated with the image may correspond to one of the following types of perspective camera: the first-person perspective type, corresponding to the type of camera perspective where the scene is rendered and displayed from the viewpoint of the player character (in case of a video game) or through the eyes of a character (in case of a film, also known as POV (point of view) shot, first-person shot or subjective camera); or the third-person perspective type, corresponding to the type of camera perspective where the player character is visible on-screen, wherein the third-person perspective type is analogous to the first-person perspective type but displace the camera from being at the eyes of the (player) character to, for example, a point slightly above and behind the (player) character; or the fixed perspective type, corresponding to the type of camera perspective where the viewpoint is fixed to a given plane; examples of fixed perspective type are side scrollers or top-down camera perspective.

[0065] At block 22, the camera perspective type associated with the rendering of the image obtained at block 21 is determined.

[0066] The camera perspective type is for example determined by processing the image data obtained at block 21 to identify the camera perspective type used to render the image in a list of various camera perspective types comprising the first-person perspective type, the third-person perspective type and the fixed perspective type.

[0067] In another example, the camera perspective type associated with the image is received as metadata with the image data, the camera perspective type being determined while decoding the image data and associated metadata.

[0068] In another example, the camera perspective type is determined from the type of content rendered on the display device. For example, when the content corresponds to a video game, the type of video game may provide inherently the camera perspective type. Examples of video games include first-person shooter (i.e., with first-person camera type), third-person shooter (i.e., with third-person camera type), side-scrolling video game (i.e., with fixed perspective type), etc.

[0069] At block 23, a first information identifying a spatial area of a set of spatial areas is associated with each region of a set of regions of the image obtained at block 21 according to the camera perspective type of the image determined at block 22.

[0070] As described hereinabove, the set of spatial areas may be defined according to a second environment adapted to comprise the display device, the set of spatial areas comprising for example: a first spatial area called floor; a second spatial area called front wall; a third spatial area called left-hand side wall; a fourth spatial area called right-hand side wall; a fifth spatial area called ceiling; and a sixth spatial area called back wall.

[0071] A region of an image corresponds to a group of pixels of the image, a region of the image corresponding to a sub-part of the image. The shape and size of the region are variable and arbitrary.

[0072] The set of regions is for example generated and obtained by segmenting the image.

[0073] The segmenting of the image and the association of the first information with each region of the set of regions may be obtained through a single operation by applying a determined region mask, the determined region mask being according to the camera perspective type associated with the image and determined at block 22.

[0074] The determined region mask associated with the camera perspective type of the image obtained at block 21 is for example obtained from a library 231 of various region masks, a different region mask being associated with each camera perspective type, i.e., a first region mask being associated with the first-person perspective type, a second region mask being associated with the third-person perspective type and a third region mask being associated with the fixed perspective type (or a different third region mask being associated with each type of fixed perspective (e.g., side-scrolling perspective or top-down perspective).

[0075] Since the camera perspective type is associated with the image obtained at block 21, the region mask corresponding to this camera perspective type is for example identified in a LUT (Look-Up Table) mapping camera perspective type with region mask identifiers (a unique region mask identified being mapped with a different camera perspective type). Once the region mask identifier corresponding to the camera perspective type obtained at block 21 has been retrieved from the LUT, the mask data representative of the region mask to be applied to the image are retrieved using the region mask identifier.

[0076] A region mask corresponds to an image with various specific portions each corresponding to a region of the set of regions to be identified in the image obtained at block 21. A label or an identifier is associated with each specific portion to identify the spatial area that is associated with each specific portion, each specific portion having a determined shape and size.

[0077] Figures 3, 4 and 5 each show the set of regions that are obtained by applying various region masks to various images 310, 410, 510 in accordance with exemplary embodiments.

[0078] More specifically, Figure 3 shows a set of regions 311, 312, 313, 314 and 315 obtained for an image 310 of the first-person perspective type. Figure 4 shows a set of regions 411L, 411R, 412, 413, 414 and 415 obtained for an image 410 of the third-person perspective type. Figure 5 shows a set of regions 511, 512, 513, 514 and 515 obtained for an image 510 of the fixed perspective type.

[0079] Image 310 of Figure 3 comprises: a first region 311 with a rectangular shape covering a lower portion of image 310, the first information associated with the first region 311 identifying the first spatial area of the set of spatial areas, i.e., the spatial area of the type 'floor'; a second region 312 with a rectangular shape covering a central portion of image 310, the first information associated with the second region 312 identifying the second spatial area of the set of spatial areas, i.e., the spatial area of the type 'front wall'; a third region 313 with a rectangular shape covering a left-hand side central portion of image 310, the first information associated with the third region 313 identifying the third spatial area of the set of spatial areas, i.e., the spatial area of the type `left-hand side wall'; a fourth region 314 with a rectangular shape covering a right-hand side central portion of image 310, the first information associated with the fourth region 314 identifying the fourth spatial area of the set of spatial areas, i.e., the spatial area of the type 'right-hand side wall'; and a fifth region 315 with a rectangular shape covering an upper portion of image 310, the first information associated with the fifth region 315 identifying the fifth spatial area of the set of spatial areas, i.e., the spatial area of the type 'ceiling'.

[0080] Each region of the set of regions 311, 312, 313, 314 and 315 and the associated first information is obtained or generated as a result of the applying of a first region mask corresponding to (or associated with) the first-person perspective type, the first region mask having the size of image 310 and comprising a set of portions corresponding to the set of regions, the location, shape and size of each portion in the first region mask being used to obtain the location, shape and size of the corresponding region in image 310.

[0081] Image 410 of Figure 4 comprises: a first region 411L with a trapezoidal shape covering a left-hand side lower portion of image 410 located on the left of an avatar 400, the first information associated with the first region 411L identifying the first spatial area of the set of spatial areas, i.e., the spatial area of the type 'floor' or another spatial area of the type 'left part of the floor'; a second region 411R with a trapezoidal shape covering a right-hand side lower portion of image 410 located on the right of the avatar 400, the first information associated with the second region 411R identifying the first spatial area of the set of spatial areas, i.e., the spatial area of the type 'floor' or another spatial area of the type `right part of the floor'; a third region 412 with a rectangular shape covering a central portion of image 410, the first information associated with the third region 412 identifying the second spatial area of the set of spatial areas, i.e., the spatial area of the type 'front wall'; a fourth region 413 with a rectangular shape covering a left-hand central portion of image 410, the first information associated with the fourth region 413 identifying the third spatial area of the set of spatial areas, i.e., the spatial area of the type `left-hand side wall'; a fifth region 414 with a rectangular shape covering a right-hand central portion of image 410, the first information associated with the fifth region 414 identifying the fourth spatial area of the set of spatial areas, i.e., the spatial area of the type 'right-hand side wall'; and a sixth region 415 with a rectangular shape covering an upper portion of image 410, the first information associated with the sixth region 415 identifying the fifth spatial area of the set of spatial areas, i.e., the spatial area of the type 'ceiling'.

[0082] Each region of the set of regions 411L, 411R, 412, 413, 414 and 415 and the associated first information is obtained or generated as a result of the applying of a second region mask corresponding to (or associated with) the third-person perspective type, the second region mask having the size of the image 410 and comprising a set of portions corresponding to the set of regions, the location, shape and size of each portion in the first region mask being used to obtain the location, shape and size of the corresponding region in image 410.

[0083] Image 510 of Figure 5 comprises: a first region 511 with a rectangular shape covering a lower portion of image 510, the first information associated with the first region 511 identifying the first spatial area of the set of spatial areas, i.e., the spatial area of the type 'floor'; a second region 512 with a rectangular shape covering a central portion of image 510, the first information associated with the second region 512 identifying the second spatial area of the set of spatial areas, i.e., the spatial area of the type 'front wall'; a third region 513 with a rectangular shape covering a left-hand side central portion of image 510, the first information associated with the third region 513 identifying the third spatial area of the set of spatial areas, i.e., the spatial area of the type `left-hand side wall'; a fourth region 514 with a rectangular shape covering a right-hand side central portion of image 510, the first information associated with the fourth region 514 identifying the fourth spatial area of the set of spatial areas, i.e., the spatial area of the type 'right-hand side wall'; and a fifth region 515 with a rectangular shape covering a upper portion of image 510, the first information associated with the fifth region 515 identifying the fifth spatial area of the set of spatial areas, i.e., the spatial area of the type 'ceiling'.

[0084] Each region of the set of regions 511, 512, 513, 514 and 515 and the associated first information is obtained or generated as a result of the applying of a first region mask corresponding to (or associated with) the first-person perspective type, the first region mask having the size of image 510 and comprising a set of portions corresponding to the set of regions, the location, shape and size of each portion in the first region mask being used to obtain the location, shape and size of the corresponding region in image 510.

[0085] The number of portions comprised in a region mask and their respective location, shape and size may vary from one region mask to another region mask.

[0086] In a variant, the regions of images 310, 410 or 510 are obtained through a segmenting process based on features of the image 310, 41 or 51, e.g., based on color attributes or depth attributes associated with the pixels of the image 310, 410 or 510.

[0087] For example, the segmenting process is based on the depth attributes associated with the pixels, each region being segmented using depth intervals, e.g., the region associated with the spatial area of the type 'floor' comprising the pixels of the image having a depth attribute comprised in a first depth interval, the first depth interval being associated with the type 'floor', the region associated with the spatial area of the type 'ceiling' comprising the pixels of the image having a depth attribute comprised in a second depth interval, the second depth interval being associated with the type 'floor', etc.

[0088] In another variant, the regions of the image 31, 41 and 51 are obtained by applying a region mask corresponding to the camera perspective type, as explained hereinabove, the shape and size of the region being further adapted / adjusted using depth and / or color attributes of the pixels of the image 31, 41 and 51, e.g., using depth and / or color attributes of the pixels located in the neighborhood of the limits of each region of the regions obtained from the applying of the region mask. The neighborhood of a limit comprises, for example, all pixels located in a band around the limit, the band having a determined width (e.g., a width of 10, 20, 50 or 100 pixels). Such a variant makes it possible to adjust the limits of a region in a way that the region encompasses all pixels having similar features (e.g., color and / or depth).

[0089] At block 24, position data representative of the position of the lighting device in the first environment 10 is received. Position data is received for each lighting device 11 to 16 to be controlled by the control device.

[0090] The position data is for example received from a memory of the control device. According to this example, the position of the lighting device may be input via a user interface, e.g., by the user watching the image. The image may correspond to an image generated when playing a video game run on laptop 18 or on a game console acting as the control device, or to an image of a movie displayed on TV screen 19, TV screen 19 being for example wirelessly controlled by laptop 18 or by a set-top box connected to the TV screen through a wired connection such as HDMI connector for example, laptop 18 or the set-top box acting as the control device.

[0091] According to another example, the first data is stored in the memory of a data processing device 241 such as a smartphone, a tablet, a server communicatively coupled to the control device.

[0092] According to a further example, the position data is received from the lighting device itself. According to this example, the position data is stored in the memory of each lighting device.

[0093] The position data is for example received automatically by the control device from the lighting device when connecting the lighting device to the control device. The connection of the lighting device to the control device triggers the transmission of the position data by the lighting device to the control device through the connection that may correspond to a wireless connection, e.g., Bluetooth ®< or Wifi ®< . When connecting the lighting device to the control device, the control device and the lighting device automatically initiate a process for communicating the position data through dedicated API(s). This process corresponds for example to a so-called "plug and play" (PnP) process, the control device and the lighting device corresponding to PnP devices.

[0094] According to a variant, the control device transmits a request to the lighting device to obtain the position data from the lighting device receiving this request, the transmission of the request occurring after having connected the lighting device to the control device. According to this variant, the lighting device transmits the position data stored in its memory to the control device in response to the received request.

[0095] According to a non-limitative exemplary embodiment, the position data is generated during a mapping of the first environment 10 comprising the lighting device(s) 11 to 16 and / or during a setup operation of the first environment 10.

[0096] The mapping comprises associating the position data with lighting devices 11 to 16 arranged in the first environment 10, or at least with the lighting devices to be controlled by the control device. The associating is for example performed for each lighting device that the user performing the mapping wants to be used for rendering light or lighting effect(s) in the first environment 10. The mapping may be performed for a plurality of first environments, for example in every room of a house or building where the user is likely to consume video content, or in every room comprising one or more connected lighting devices controllable by the control device.

[0097] The mapping is for example performed via a mapping application running on a processing device 241 (such as a mobile phone, tablet or laptop) or on the control device. To reach that aim, the position data to be associated with each lighting device is input to the mapping application by the user through one or more user interfaces such as for example a tactile interface associated with the screen of processing device 241 or through a peripheral device such as a keyboard and / or a mouse coupled to the control device, when applicable.

[0098] The position data may be stored in a file on processing device 241 and / or control device and the file can be edited by the user, e.g., to update the position data through specific application(s).

[0099] The position data comprises for example: second information identifying a determined spatial area in the first environment 10, the determined spatial area belonging to the set of spatial areas; and third information representative of a relative position of the lighting device in the determined spatial area.

[0100] According to this example, a 2D or 3D map of the first environment 10 may be generated with the mapping application and used to locate the one or more lighting devices 11 to 16. Using the mapping application, the user may position each lighting device on the 3D map, which makes it possible to automatically obtain the second information, each spatial area of the set of spatial areas being identified and located in the 3D map.

[0101] In a variant, the user may select the spatial area comprising the lighting device he / she wants to associate with this spatial area (to obtain the second information) in a list of spatial areas comprised in the first environment, reiterating the operation for each lighting device 11 to 16.

[0102] The third information may correspond to a rough or approximate position of the lighting device in reference to the spatial area the lighting device belongs to, this rough or approximate information being for example obtained by positioning the lighting device in the spatial area in the 3D map of the first environment.

[0103] In a variant, the third information may correspond to a precise location, e.g., to a set of coordinates in a (2D) cartesian coordinate system associated with the spatial area the lighting device is associated with (identified with the second information). According to this variant, the third information defining the position of the lighting device is expressed in the space of the spatial area.

[0104] According to another example, the position data comprises coordinates of the position of the lighting device, the coordinates being defined in a coordinate system associated with the first environment 10. The coordinate system corresponds for example to a 3D cartesian coordinate system represented with orthonormal axis or vectors X 1 , Y 1 and Z 1 , the origin of the coordinate system corresponding to a determined point in the first environment 10, e.g., a corner of a rectangular parallelepiped when the first environment 10 is represented with a bounding box or a reference point of the first environment, called first reference point 'O 1 ' and corresponding to a point of the first environment from which the image is watched by a user (e.g., the middle point of the couch). When the coordinate system corresponds to a 3D cartesian coordinate system, the position data comprises the coordinates of a point representing the position of the lighting device in the first environment 10, the position data corresponding to a triplet of values (x,y,z).

[0105] In an embodiment, the position data is received by the control device with additional data, which may be stored in the memory of each lighting device or in processing device 241. The additional data comprises for example one or more of the following data, in any possible combination: data representative of a position of each light-emitting device, e.g., a LED, of a set of light-emitting devices comprised in the lighting device, when applicable; the data indicating the relative position of each of the light-emitting devices arranged in the lighting device, e.g., in a local space associated with the lighting device; in this respect, the second information may represent the position of a reference point of the lighting device, or the position of a reference light-emitting device of the lighting device; and / or data representative of the number of light-emitting devices comprised in the lighting device; and / or data representative of the type and / or lighting characteristics of the light-emitting devices comprised in the lighting device; and / or data representative of the type, characteristics and / or configuration of the lighting device, e.g., the dimensions of the lighting device.

[0106] The position data and additional data are formatted in a determined format and transmitted according to a determined standard.

[0107] At block 25, the lighting device is associated with a part of a region of the set of regions according to the first information associated with the set of regions of the image and according to the position data obtained at block 24.

[0108] When the position data comprises the second information and the third information, the second information is compared with the first information associated with each region of the image to determine which region of the image the lighting device is to be associated with. As a result of the comparison, the lighting device is associated with the region of the image having the first information representative of the spatial area indicated by the second information. The part of the region to be associated with the lighting device is determined or obtained from the third information, i.e., the relative position of the lighting device with reference to the spatial area of the first information the lighting device belongs to.

[0109] As illustrated in Figure 3, the first lighting device 11 is associated with a part 31 of the second region 312 of image 310. Indeed, the first lighting device 11 is fixed on the front wall 102 in the first environment 10, i.e., the first lighting device 11 belongs to or is associated with the front wall 102 in the first environment 10, and the first information associated with the second region 312 is representative of the second spatial part, i.e., the spatial part of the type 'front wall'. Part 31 of the second region 312 corresponds to the upper left portion of the second region 312 as the first lighting device 11 is fixed on the upper left part of the front wall 102, as indicated by the third information. When the third information is representative of coordinates of the position of the first lighting device 11 in the coordinate system associated with the front wall 102, a change of reference is implemented to map the position of the first lighting device 11 in the first environment 10 (relatively to the front wall 102) to a position in the second region 312.

[0110] A part of a region may correspond to a pixel or to a group of pixels.

[0111] Similarly, the second lighting device 12 is associated with a part 32 of the second region 312 of image 310, part 32 corresponding to (or belonging to) the upper right portion of the second region 312 of image 310. The third lighting device 13 is associated with a part 33 of the third region 313 of image 31. Part 33 may correspond to a group of pixels of the third region 313 comprised in a bounding box, the size and shape of the bounding box being determined from the additional data received with the position data, when applicable. The fourth lighting device 14 is associated with a part 34 of the first region 311 of image 310, the part 34 being in (or belonging to) a left portion of the first region 311. Part 34 may correspond to a group of pixels of the first region 311 comprised in a bounding box, the size and shape of the bounding box being determined from the additional data received with the position data, when applicable. The fifth lighting device 15 is associated with a part 35 of the first region 311 of image 310, the part 35 being in (or belonging to) a right portion of the first region 311. Part 35 may correspond to a group of pixels of the first region 311 comprised in a bounding box, the size and shape of the bounding box being determined from the additional data received with the position data, when applicable. The sixth lighting device 16 is associated with a part 36 of the fifth region 315 of image 310, the part 36 corresponding to (or belonging to) the central portion of the fifth region 315 of image 310.

[0112] Similarly, as illustrated on figure 4, the first lighting device 11 is associated with a part 41 of the third region 412 of image 410, part 42 corresponding to (or belonging to) the upper left portion of the third region 412 of image 410. The second lighting device 12 is associated with a part 42 of the third region 412 of image 410, the part 42 corresponding to (or belonging to) the upper right portion of the third region 412 of image 410. The third lighting device 13 is associated with a part 43 of the fourth region 413 of image 410. Part 43 may correspond to a group of pixels of the fourth region 413 comprised in a bounding box, the size and shape of the bounding box being determined from the additional data received with the position data, when applicable. The fourth lighting device 14 is associated with a part 44 of the first region 411L, part 44 being in (or belonging to) a left portion of the first region 411L of image 410. Part 44 may correspond to a group of pixels of the first region 411L comprised in a bounding box, the size and shape of the bounding box being determined from the additional data received with the position data, when applicable. The fifth lighting device 15 is associated with a part 45 of the second region 411R, part 45 being in (or belonging to) a right portion of the first region 411R of image 410. Part 45 may correspond to a group of pixels of the second region 411R comprised in a bounding box, the size and shape of the bounding box being determined from the additional data received with the position data, when applicable. The sixth lighting device 16 is associated with a part 46 of the sixth region 415 of image 410, part 46 corresponding to (or belonging to) the central portion of the sixth region 415 of image 410.

[0113] Similarly, as illustrated in figure 5, the first lighting device 11 is associated with a part 51 of the second region 512 of image 510, part 51 corresponding to (or belonging to) the upper left portion of the second region 512 of image 510. The second lighting device 12 is associated with a part 52 of the second region 512 of image 510, part 42 corresponding to (or belonging to) the upper right portion of the second region 512 of image 510. The third lighting device 13 is associated with a part 53 of the third region 513 of image 510. Part 53 may correspond to a group of pixels of the third region 513 comprised in a bounding box, the size and shape of the bounding box being determined from the additional data received with the position data, when applicable. The fourth lighting device 14 is associated with a part 54 of the first region 511, part 54 being in (or belonging to) a left portion of the first region 511 of image 510. Part 54 may correspond to a group of pixels of the first region 511 comprised in a bounding box, the size and shape of the bounding box being determined from the additional data received with the position data, when applicable. The fifth lighting device 15 is associated with a part 55 of the first region 511, part 55 being in (or belonging to) a right portion of first region 511 of image 510. Part 55 may correspond to a group of pixels of the second region 411R comprised in a bounding box, the size and shape of the bounding box being determined from the additional data received with the position data, when applicable. The sixth lighting device 16 is associated with a part 56 of the fifth region 515 of image 510, part 56 corresponding to (or belonging to) the central portion of the fifth region 515 of image 510.

[0114] The use of the position data and the first information, with optionally the additional data, enables a mapping between the location of each lighting device 11 to 16 in the first environment 10 and a part of image 310, 410 or 510. The use of the spatial areas identified with similar identifiers in the position data (i.e., in the second information) and in the first information associated with the regions of image 310, 410, 510 enables to speed up the mapping process, which may be implemented at run time when rendering images 310, 410, 510 and / or processing the image data of images 310, 410, 510.

[0115] When the position data corresponds to the coordinates of a point representing the position of the lighting device in the first environment 10 (e.g., the position data corresponding to a triplet of values (x,y,z)), the second information and the third information by processing the position data to determine information representative of the orientation of each lighting device 11 to 16 relative to the reference point O 1 (using the coordinates of O 1 when necessary). The orientation may be defined with a first angle representative of latitude (latitude angle or colatitude angle) and a second angle representative of longitude. The distance between the reference point O 1 and each lighting device may be further used to determine the second information and the third information for each lighting device.

[0116] At block 26, the lighting device is controlled according to color data obtained from the part of the region in image 310, 410, 510 the lighting device has been associated with at block 25.

[0117] Based on the example of Figure 3, the first lighting device 11 is controlled according to color data obtained from part 31, the second lighting device 12 is controlled according to color data obtained from part 32, the third lighting device 13 is controlled according to color data obtained from part 33, the fourth lighting device 14 is controlled according to color data obtained from part 34, the fifth lighting device 15 is controlled according to color data obtained from part 35 and the sixth lighting device 16 is controlled according to color data obtained from part 36.

[0118] Color data corresponds to the color attributes of the one or more pixels forming each part 31 to 36. The color attributes may correspond to color values associated with each channel of a color space like RGB (Red, Green, Blue) color space or CMYK (Cyan Magenta Yellow, Black) color space, a color value being for example coded in 8 or 10 bits for each color of the color space. According to variants, the color attributes may further comprise information representative of color temperature, defined in Kelvin (K) and / or an information representative of brightness or luminous intensity, for example defined in candela (cd).

[0119] When a part corresponds to a single pixel, the lighting device is controlled with the color data associated with this single pixel. When a part corresponds to a group of pixels, the lighting device is controlled with the color data determined from the color attributes of all the pixels forming the group of pixels, the color data being determined as the average of the color attributes associated with the plurality of pixels.

[0120] The control device determines the color data and transmits the color data to the considered lighting device wirelessly or via a wired connection depending on the type of connection between the control device and the lighting device.

[0121] When the lighting device corresponds to a LED strip (i.e., a lighting device comprising a plurality of light-emitting devices, e.g., the third lighting device 13, the fourth lighting device 14 and the fifth lighting device 15 according to the example of Figure 1), each light-emitting device may be controlled individually using the color attributes of the pixels of the part associated with each light-emitting device. In a variant, every light-emitting device is controlled with the same color data to obtain a uniform lighting.

[0122] In an embodiment, the color data determined for the lighting device, and for each light-emitting device of the lighting device when applicable, is further determined according to lighting characteristics of the lighting device. The lighting characteristics are for example received as additional data with the position, as described previously. The lighting characteristics comprise for example the color or range of color that a lighting device is configured to render and / or the color temperature or range of color temperature the lighting device is configured to render.

[0123] Such a process enables to control the lighting of a space into which a user is consuming a video content (e.g., a film or a video content of a video game) by increasing the consistency between the location of the lighting devices relative to their location in the space comprising the display device, i.e., the first information 10, and corresponding parts of the video content. This enables to increase the feeling of immersion while consuming the video content.

[0124] Such a process enables a dynamic control of the lighting of every space the user is moving to while consuming the video content on a mobile device, especially when the position data is received automatically by the control device (corresponding to or implemented in the mobile device) from the lighting devices of the space the user is moving to.

[0125] Figure 6 shows a schematic block diagram of steps of a method of controlling a lighting device, in accordance with at least one exemplary embodiment.

[0126] In a first step 61, a camera perspective type associated with a rendering of an image on a display device comprised in a first environment is determined.

[0127] In a second step 62, first information identifying a spatial area of a set of spatial areas is associated with each region of a set of regions of the image according to the camera perspective type, the set of spatial areas being defined according to a second environment adapted to comprise the display device.

[0128] In a third step 63, position data representative of position of the lighting device in the first environment is received.

[0129] In a fourth step 64, the lighting device is associated with a part of a region of the set of regions according to the first information and the position data.

[0130] In a fifth step 65, the lighting device is controlled according to color data obtained from the part of the region

[0131] According to exemplary embodiments, the variants and examples of operations described in relation to one of Figures 1 to 5 apply to the method steps of Figure 6. The steps of the method may be performed for each lighting device of the first environment, or at least for each lighting device of a set of lighting devices comprised in the first environment, and more specifically for each dynamic lighting device or connected lighting device.

[0132] Figure 7 shows a schematic block diagram illustrating an example of an apparatus or system 7 in which various aspects and exemplary embodiments are implemented.

[0133] System 7 may be embedded as one or more devices including the various components described below. In various embodiments, system 7 may be configured to implement one or more of the aspects described in the present application.

[0134] Examples of equipment that may form all or part of the system 7 include personal computers, laptops, smartphones, tablet computers, digital multimedia set top boxes and their associated processing systems, display devices, light-emitting devices, servers, chroma encoders, chroma decoders, video encoders, video decoders, post-processors processing output from a chroma and / or video decoder, pre-processors providing input to chroma and / or video encoder, web servers, set-top boxes, wireless (e.g., Bluetooth ®< ) connected wearable devices, game controller, mouse, mousepad, keyboard, palm rest, chairs, desk, XR headset, headphones, bracelet, head and / or lumbar support device or chair, any other device for processing chroma (lighting) data or signals, and / or video data or signals, or other communication devices. Elements of system 7, singly or in combination, may be embodied in a single integrated circuit (IC), multiple ICs, and / or discrete components. For example, in at least one embodiment, the processing and encoder / decoder elements of system 7 may be distributed across multiple ICs and / or discrete components. In various embodiments, the system 7 may be communicatively coupled to other similar systems, or to other electronic devices, via, for example, a communication bus or through dedicated input and / or output ports.

[0135] System 7 may include at least one processor 71 configured to execute instructions loaded therein for implementing, for example, the various aspects described in the present application. Processor 71 may include embedded memory, input output interface, and various other circuitries as known in the art. System 7 may include at least one memory 72 (for example a volatile memory device and / or a non-volatile memory device). System 7 may include a storage device 74, which may include non-volatile memory and / or volatile memory, including, but not limited to, Electrically Erasable Programmable Read-Only Memory (EEPROM), Read-Only Memory (ROM), Programmable Read-Only Memory (PROM), Random Access Memory (RAM), Dynamic Random-Access Memory (DRAM), Static Random-Access Memory (SRAM), flash, magnetic disk drive, and / or optical disk drive. Storage device 74 may include an internal storage device, an attached storage device, and / or a network accessible storage device, as non-limiting examples.

[0136] System 7 may include an encoder / decoder module 73 configured, for example, to process data to provide encoded / decoded chroma (lighting) signal data and / or encoded / decoded video signal or data, and encoder / decoder module 73 may include its own processor and memory. Encoder / decoder module 73 may represent module(s) that may be included in a device to perform the encoding and / or decoding functions. As is known, a device may include one or both of the encoding and decoding modules. Additionally, encoder / decoder module 73 may be implemented as a separate element of system 7 or may be incorporated within processor 71 as a combination of hardware and software as known to those skilled in the art.

[0137] Program code to be loaded onto processor 71 or encoder / decoder 73 to perform the various aspects described in the present application may be stored in storage device 74 and subsequently loaded onto memory 72 for execution by processor 71. In accordance with various embodiments, one or more of processor 71, memory 72, storage device 74, and encoder / decoder module 73 may store one or more of various items during the performance of the processes described in the present application. Such stored items may include, but are not limited to, data representative of chroma / lighting content, data representative of video content, a bitstream, matrices, variables, and intermediate or final results from the processing of equations, formulas, operations, and operational logic.

[0138] In several embodiments, the memory inside processor 71 and / or encoder / decoder module 73 may be used to store instructions and to provide working memory for processing that may be performed during data processing, encoding or decoding.

[0139] In other embodiments, however, a memory external to the processing device (for example, the processing device may be the processor) may be used for one or more of these functions. The external memory may be memory 72 and / or storage device 74, for example, a dynamic volatile memory and / or a non-volatile flash memory. In at least one embodiment, a fast external dynamic volatile memory such as a RAM may be used as working memory for data processing.

[0140] The input to the elements of system 7 may be provided through various input devices as indicated in block 75. Such input devices include, but are not limited to, (i) an RF portion that may receive an RF signal transmitted, for example, over the air by a broadcaster, (ii) a Composite input terminal, (iii) a USB input terminal, (iv) a phone connector (also known as phone jack, audio jack, headphone jack or jack plug) input terminal and / or (v) an HDMI input terminal.

[0141] In various embodiments, the input devices of block 75 may have associated respective input processing elements as known in the art. For example, the RF portion may be associated with elements necessary for (i) selecting a desired frequency (also referred to as selecting a signal, or band-limiting a signal to a band of frequencies), (ii) down-converting the selected signal, (iii) band-limiting again to a narrower band of frequencies to select (for example) a signal frequency band which may be referred to as a channel in certain embodiments, (iv) demodulating the down-converted and band-limited signal, (v) performing error correction, and (vi) demultiplexing to select the desired stream of data packets. The RF portion of various embodiments may include one or more elements to perform these functions, for example, frequency selectors, signal selectors, band-limiters, channel selectors, filters, downconverters, demodulators, error correctors, and de-multiplexers. The RF portion may include a tuner that performs various of these functions, including, for example, down-converting the received signal to a lower frequency (for example, an intermediate frequency or a near-baseband frequency) or to baseband.

[0142] Various embodiments rearrange the order of the above-described (and other) elements, remove some of these elements, and / or add other elements performing similar or different functions.

[0143] Adding elements may include inserting elements in between existing elements, such as, for example, inserting amplifiers and an analog-to-digital converter. In various embodiments, the RF portion may include an antenna.

[0144] Additionally, the USB and / or HDMI terminals may include respective interface processors for connecting system 7 to other electronic devices across USB and / or HDMI connections. It is to be understood that various aspects of input processing, for example, analog to digital conversion, time domain to frequency domain conversion, down sampling, band pass or low pass filtering, Reed-Solomon error correction, may be implemented, for example, within a separate input processing IC or within processor 71 as necessary. Similarly, aspects of USB or HDMI interface processing may be implemented within separate interface ICs or within processor 71 as necessary. The processed stream may be provided to various processing elements, including, for example, processor 71, and encoder / decoder 73 operating in combination with the memory and storage elements to process the data stream as necessary for presentation on an output device.

[0145] Various elements of system 7 may be provided within an integrated housing.

[0146] Within the integrated housing, the various elements may be interconnected and transmit data therebetween using suitable connection arrangement, for example, an internal bus as known in the art, including the I2C bus, wiring, and printed circuit boards.

[0147] System 7 may include communication interface 76 that enables communication with other devices via communication channel 760. Communication interface 76 may include, but is not limited to, a transceiver configured to transmit and to receive data over communication channel 760. Communication interface 76 may include, but is not limited to, a modem or network card and communication channel 760 may be implemented, for example, within a wired and / or a wireless medium.

[0148] Data may be streamed to system 7, in various embodiments, using a Wi-Fi network such as IEEE 802.11. The Wi-Fi signal of these embodiments may be received over communication channel 760 and communications interface 76 which are adapted for Wi-Fi communications. Communication channel 760 of these embodiments may be typically connected to an access point or router that provides access to outside networks including the Internet for allowing streaming applications and other over-the-top communications.

[0149] Other embodiments may provide streamed data to system 7 using a set-top box or a computer that delivers the data over the HDMI connection of block 75.

[0150] Still other embodiments may provide streamed data to system 7 using the RF connection of block 75.

[0151] The streamed data may be used as a way for signaling information used by system 7. The signaling information may comprise the data encoded in a container such as a binary stream for example.

[0152] It is to be appreciated that signaling may be accomplished in a variety of ways. For example, one or more syntax elements, flags, and so forth may be used to signal information to a corresponding data processing device in various embodiments.

[0153] System 7 may provide an output signal to various output devices, including a display 770, lighting devices or light sources 780, and other peripheral devices 790 like haptic devices / actuators.

[0154] In various embodiments, control signals may be communicated between system 7 and display 770, light-emitting devices or light sources 780, or other peripheral devices 790 using signaling such as AV.Link (Audio / Video Link), CEC (Consumer Electronics Control), Audio protocols, USB (Universal Serial Bus), HID (Human Interface Design) for USB, HIF UHP (Haptics Industry Forum - Universal Haptic Protocol) or other communications protocols that enable device-to-device control with or without user intervention.

[0155] The output devices may be communicatively coupled to system 7 via dedicated connections through respective interfaces 77, 78, and 79.

[0156] Alternatively, the output devices may be connected to system 7 using communications channel 760 via communication interface 76. Display 770, lighting devices or light sources 780 and / or peripheral devices 790 such as haptic device(s) (actuators) may be integrated in a single unit with the other components of system 7 in an electronic device such as, for example, a television.

[0157] In various embodiments, display interface 77 may include a display driver, such as, for example, a timing controller (T Con) chip.

[0158] Display 770, lighting devices or light sources 780 and / or peripheral devices 790 such as haptic device(s) (actuators) may alternatively be separate from one or more of the other components. In various embodiments in which display 770, lighting devices or light sources 780 and / or peripheral devices 790 such as haptic device(s) (actuators) may be external components, the output signal may be provided via dedicated output connections, including, for example, HDMI ports, USB ports, or COMP outputs.

[0159] In Figures 1 to 7, various methods are described herein, and each of the methods includes one or more steps or actions for achieving the described method. Unless a specific order of steps or actions is required for proper operation of the method, the order and / or use of specific steps and / or actions may be modified or combined.

[0160] Some examples are described with regard to block diagrams and / or operational flowcharts. Each block represents a circuit element, module, or portion of code which includes one or more executable instructions for implementing the specified logical function(s). It should also be noted that in other implementations, the function(s) noted in the blocks may occur out of the indicated order. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks may sometimes be executed in the reverse order, depending on the functionality involved.

[0161] The implementations and aspects described herein may be implemented in, for example, a method or a process, an apparatus, a computer program, a data stream, a bitstream, or a signal. Even if only discussed in the context of a single form of implementation (for example, discussed only as a method), the implementation of features discussed may also be implemented in other forms (for example, an apparatus or computer program).

[0162] The methods may be implemented in, for example, a processor, which refers to processing devices in general, including, for example, a computer, a microprocessor, an integrated circuit, or a programmable logic device. Processors also include communication devices.

[0163] Additionally, the methods may be implemented by instructions being performed by a processor, and such instructions (and / or data values produced by an implementation) may be stored on a computer readable storage medium. A computer readable storage medium may take the form of a computer readable program product embodied in one or more computer readable medium(s) and having computer readable program code embodied thereon that is executable by a computer. A computer readable storage medium as used herein may be considered a non-transitory storage medium given the inherent capability to store the information therein as well as the inherent capability to provide retrieval of the information therefrom. A computer readable storage medium may be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. It is to be appreciated that the following, while providing more specific examples of computer readable storage mediums to which the present embodiments may be applied, is merely an illustrative and not an exhaustive listing as is readily appreciated by one of ordinary skill in the art: a portable computer diskette; a hard disk; a read-only memory (ROM); an erasable programmable read-only memory (EPROM or Flash memory); a portable compact disc read-only memory (CD-ROM); an optical storage device; a magnetic storage device; or any suitable combination of the foregoing.

[0164] The instructions may form an application program tangibly embodied on a processor-readable medium.

[0165] Instructions may be, for example, in hardware, firmware, software, or a combination. Instructions may be found in, for example, an operating system, a separate application, or a combination of the two. A processor may be characterized, therefore, as, for example, both a device configured to carry out a process and a device that includes a processor-readable medium (such as a storage device) having instructions for carrying out a process. Further, a processor-readable medium may store, in addition to or in lieu of instructions, data values produced by an implementation.

[0166] An apparatus may be implemented in, for example, appropriate hardware, software, and firmware. Examples of such apparatus include personal computers, laptops, smartphones, tablet computers, digital multimedia set top boxes, digital television receivers, personal video recording systems, connected home appliances, head mounted display devices (HMD, see-through glasses), projectors (beamers), "caves" (system including multiple displays), servers, video and / or haptic and / or chroma encoders, video and / or haptic and / or chroma decoders, haptic engine, chroma engine, post-processors processing output from a video decoder, pre-processors providing input to a video encoder, web servers, set-top boxes, wireless connected wearable haptic devices, e.g., Bluetooth ®< connected wearable haptic devices, game controller, mouse, mousepad, keyboard, palm rest, chairs, desk, XR headset, headphones, bracelet, head and / or lumbar support device or chair, any light source, and any other device for processing haptic data or signals representative of one or more haptic feedback or effect and / or for processing lighting / chroma data or signals representative of one or more lighting mode or effect, or other communication devices. As should be clear, the equipment may be mobile.

[0167] Computer software may be implemented by processor 71 or by hardware, or by a combination of hardware and software. As a non-limiting example, the embodiments may be also implemented by one or more integrated circuits. Memory 72 may be of any type appropriate to the technical environment and may be implemented using any appropriate data storage technology, such as optical memory devices, magnetic memory devices, semiconductor-based memory devices, fixed memory, and removable memory, as non-limiting examples. Processor 71 may be of any type appropriate to the technical environment, and may encompass one or more of microprocessors, general purpose computers, special purpose computers, and processors based on a multi-core architecture, as non-limiting examples.

[0168] As will be evident to one of ordinary skill in the art, implementations may produce a variety of signals formatted to carry information that may be, for example, stored or transmitted. The information may include, for example, instructions for performing a method, or data produced by one of the described implementations. For example, a signal may be formatted to carry the bitstream of a described embodiment. Such a signal may be formatted, for example, as an electromagnetic wave (for example, using a radio frequency portion of spectrum) or as a baseband signal. The formatting may include, for example, encoding a data stream and modulating a carrier with the encoded data stream. The information that the signal carries may be, for example, analog or digital information. The signal may be transmitted over a variety of different wired or wireless links, as is known. The signal may be stored on a processor-readable medium.

[0169] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used herein, the singular forms "a", "an", and "the" may be intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "includes / comprises" and / or "including / comprising" when used in this specification, may specify the presence of stated, for example, features, integers, steps, operations, elements, and / or components but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof. Moreover, when an element is referred to as being "responsive" or "connected" to another element, it may be directly responsive or connected to the other element, or intervening elements may be present. In contrast, when an element is referred to as being "directly responsive" or "directly connected" to other element, there are no intervening elements present.

[0170] It is to be appreciated that the use of any of the symbol / term " / ", "and / or", and "at least one of", for example, in the cases of "A / B", "A and / or B" and "at least one of A and B", may be intended to encompass the selection of the first listed option (A) only, or the selection of the second listed option (B) only, or the selection of both options (A and B). As a further example, in the cases of "A, B, and / or C" and "at least one of A, B, and C", such phrasing is intended to encompass the selection of the first listed option (A) only, or the selection of the second listed option (B) only, or the selection of the third listed option (C) only, or the selection of the first and the second listed options (A and B) only, or the selection of the first and third listed options (A and C) only, or the selection of the second and third listed options (B and C) only, or the selection of all three options (A and B and C). This may be extended, as is clear to one of ordinary skill in this and related arts, for as many items as are listed.

[0171] Various numeric values may be used in the present application. The specific values may be for example purposes and the aspects described are not limited to these specific values.

[0172] It will be understood that, although the terms first, second, etc. may be used herein to describe various elements, these elements are not limited by these terms. These terms are only used to distinguish one element from another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element without departing from the teachings of this application. No ordering is implied between a first element and a second element.

[0173] Reference to "one exemplary embodiment" or "an exemplary embodiment" or "one implementation" or "an implementation", as well as other variations thereof, is frequently used to convey that a particular feature, structure, characteristic, and so forth (described in connection with the embodiment / implementation) is included in at least one embodiment / implementation. Thus, the appearances of the phrase "in one exemplary embodiment" or "in an exemplary embodiment" or "in one implementation" or "in an implementation", as well any other variations, appearing in various places throughout this application are not necessarily all referring to the same embodiment.

[0174] Similarly, reference herein to "in accordance with an exemplary embodiment / example / implementation" or "in an exemplary embodiment / example / implementation", as well as other variations thereof, is frequently used to convey that a particular feature, structure, or characteristic (described in connection with the exemplary embodiment / example / implementation) may be included in at least one exemplary embodiment / example / implementation. Thus, the appearances of the expression "in accordance with an exemplary embodiment / example / implementation" or "in an exemplary embodiment / example / implementation" in various places in the specification are not necessarily all referring to the same exemplary embodiment / example / implementation, nor are separate or alternative exemplary embodiment / examples / implementation necessarily mutually exclusive of other exemplary embodiments / examples / implementation.

[0175] Reference numerals appearing in the claims are by way of illustration only and shall have no limiting effect on the scope of the claims. Although not explicitly described, the present embodiments / examples and variants may be employed in any combination or sub-combination.

[0176] When a figure is presented as a flow diagram, it should be understood that it also provides a block diagram of a corresponding apparatus. Similarly, when a figure is presented as a block diagram, it should be understood that it also provides a flow diagram of a corresponding method / process.

[0177] Although some of the diagrams include arrows on communication paths to show a primary direction of communication, it is to be understood that communication may occur in the opposite direction to the depicted arrows.

[0178] Additionally, this application may refer to "obtaining" various pieces of information. Obtaining the information may include one or more of, for example, receiving the information, determining the information, estimating the information, calculating the information, or retrieving the information from memory.

[0179] Further, this application may refer to "accessing" various pieces of information. Accessing the information may include one or more of, for example, receiving the information, retrieving the information (for example, from memory), storing the information, moving the information, copying the information, calculating the information, determining the information, or estimating the information.

[0180] Additionally, this application may refer to "receiving" various pieces of information. Receiving is, as with "accessing", intended to be a broad term. Receiving the information may include one or more of, for example, accessing the information, or retrieving the information (for example, from memory). Furthermore, "receiving" is typically involved, in one way or another, during operations such as, for example, storing the information, processing the information, transmitting the information, moving the information, copying the information, erasing the information, calculating the information, determining the information, or estimating the information.

[0181] A number of implementations have been described. Nevertheless, it will be understood that various modifications may be made. For example, elements of different implementations may be combined, supplemented, modified, or removed to produce other implementations. Additionally, one of ordinary skill will understand that other structures and processes may be substituted for those disclosed and the resulting implementations will perform at least substantially the same function(s), in at least substantially the same way(s), to achieve at least substantially the same result(s) as the implementations disclosed. Accordingly, these and other implementations are contemplated by this application.

Examples

Embodiment Construction

[0027]At least one of the exemplary embodiments is described more fully hereinafter with reference to the accompanying figures, in which examples of at least one of the exemplary embodiments are illustrated. An exemplary embodiment may, however, be embodied in many alternate forms and should not be construed as limited to the examples set forth herein. Accordingly, it should be understood that there is no intent to limit exemplary embodiments to the particular forms disclosed. On the contrary, the disclosure is intended to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the present application.

[0028]Exemplary embodiments described hereinafter may be combined with each other or each of the exemplary embodiment may be individually implemented, e.g., as an alternative embodiment.

[0029]At least one of the aspects generally relates to a method and apparatus of controlling one or more lighting devices to render a lighting effect. The apparatus...

Claims

1. A method of controlling a lighting device (11), the method comprising: - determining (61) a camera perspective type associated with a rendering of an image (310) on a display device comprised in a first environment (10); - associating (62), with each region of a set of regions (311 to 315) of said image (310), first information identifying a spatial area of a set of spatial areas according to said camera perspective type, said set of spatial areas being defined according to a second environment adapted to comprise said display device; - receiving (63) position data representative of position of said lighting device (11) in said first environment (10); - associating (64) said lighting device (11) with a part (31) of a region (312) of said set of regions (311 to 315) according to said first information and said position data; - controlling (65) said lighting device (11) according to color data obtained from said part (31) of said region (312).

2. The method according to claim 1, further comprising segmenting said image (310) to obtain said set of regions (311 to 315).

3. The method according to claim 2, wherein said segmenting is according to said camera perspective type.

4. The method according to claim 3, wherein a determined region mask being associated with said camera perspective type, said segmenting comprises applying said determined region mask to said image (310) to obtain said set of regions (311 to 315).

5. The method according to any one of claims 1 to 4, wherein said camera perspective type belongs to a set of camera perspective types comprising: - first-person perspective type; and - third-person perspective type; and - fixed perspective type.

6. The method according to any one of claims 1 to 5, wherein the position data comprises: - second information identifying a determined spatial area in said first environment (10), said determined spatial area belonging to said set of spatial areas; and - third information representative of a relative position of said lighting device (11) in said determined spatial area.

7. The method according to any one of claims 1 to 6, wherein said part (31) of said region (312) corresponds to a group of pixels of said image (310).

8. The method according to claim 7, wherein said color data is obtained from color attributes associated with said group of pixels.

9. The method according to any one of claims 1 to 8, wherein the position data is received wirelessly from said lighting device (11).

10. The method according to any one of claims 1 to 9, further comprising receiving data representative of lighting characteristics of said lighting device, said color data being further determined according to said lighting characteristics11. The method according to any one of claims 1 to 10, further comprising transmitting said color data to said lighting device (11).

12. The method according to any one of claims 1 to 11, wherein said first environment (10) corresponds to said second environment.

13. A device comprising a memory associated with at least a processor configured to implement the method according to any one of claims 1 to 12.

14. A computer program product comprising instructions of program code for executing the method according to any one of claims 1 to 12, when said program is executed on a computer.

Images