Generation of lighting settings based on additional text descriptions generated for the lighting scene

Abstract

A method for generating light settings for an array of individually controllable light sources includes: obtaining light scene information, which includes a text description of the light scene and indicates one or more light settings for the light scene (101); determining an additional text description for the light scene based on the text description of the light scene (103); determining a target level of dynamics and / or a target level of detail based on the additional text description (105); generating at least one light setting for each of the light sources based on the one or more light settings indicated by the light scene information, wherein the generated light setting has a target level of dynamics and / or a target level of detail (107); and controlling each of the light sources to render the light setting(s) generated for each light source (109).

Description

Technical Field

[0001] The present invention relates to a system for generating a light setting for an array of individually controllable light sources.

[0002] The present invention further relates to a method for generating a light setting for an array of individually controllable light sources.

[0003] The present invention also relates to a computer program product that enables a computer system to execute such a method.

Background Art

[0004] The introduction of LED technology has made it possible to manufacture light strips for illuminating homes and offices. The advantage of light strips is that they can illuminate relatively large and wide spaces relatively uniformly. Initially, all the LEDs in a light strip could emit only one color, for example, white. Later, some light strips made it possible for the user to change the color emitted by the LED nodes, but all the LED nodes still emitted the same color. The next advancement in light strips was the pixelated light strip. A pixelated light strip includes a plurality of individually controllable segments, and each segment is generally called a "pixel" whose emitted light color and / or intensity can be controlled. Each segment includes one LED, or a plurality of LEDs of the same or different colors.

[0005] A popular light effect rendered with light strips and other one-dimensional light source arrays is a color gradient. For example, US 2019 / 335560 A1 discloses a lighting device comprising an array of controllable light-emitting pixels, each pixel having an adjustable light-output color. A controller is configured to receive a limited set of light-output colors and process these light-output colors locally to form a color gradient pattern displayed across the pixels of the array.

[0006] The advantage of rendering color gradients as lighting effects is that users can easily create their own lighting effects by, for example, selecting 3 to 5 colors. Such color gradients can also be rendered as arrays of light sources with two or more dimensions, such as a twinkly curtain. Low-resolution images can also be rendered as arrays of light sources with two or more dimensions, but creating these lighting effects requires more effort from the user. The disadvantage of rendering color gradients is that they are relatively simple lighting effects, and users may want to create a variety of lighting effects.

[0007] WO 2019238834 A1 is a method and controller for selecting media content based on a lighting scene, the method comprising the steps of: selecting a lighting scene, wherein the lighting scene has properties including one or more lighting properties; determining one or more properties of the selected lighting scene; selecting media content based on the determined one or more properties, wherein the media content includes audio content; controlling a media device to output the selected media content; and adjusting one or more lighting properties based on the audio content of the selected media content. The lighting scene may also have descriptive properties that describe the lighting scene. [Overview of the project] [Problems that the invention aims to solve]

[0008] The first object of the present invention is to provide a system that can be used to relatively easily produce advanced optical effects for an array of light sources.

[0009] A second object of the present invention is to provide a method that can be used to relatively easily produce advanced optical effects for an array of light sources. [Means for solving the problem]

[0010] In a first aspect of the present invention, a system for generating light settings for an array of individually controllable light sources includes at least one control interface and at least one processor configured to obtain light scene information, the light scene information including one or more light settings for a light scene, and determine an additional textual description for the light scene based on the textual description of the light scene, determine a target level of dynamicity and / or a target level of detail based on the additional textual description for the light scene, generate at least one light setting for each of the light sources based on the one or more light settings indicated by the light scene information, the generated light setting having the target level of dynamicity and / or the target level of detail, and control each of the light sources of the light sources via the at least one control interface to render the at least one light setting generated for each of the light sources.

[0011] The text description of a lighting scene may include, for example, the name of the lighting scene or keywords related to the lighting scene, and / or labels related to sound, music, or images associated with the lighting scene. By determining additional text descriptions for the lighting scene based on the text description of the lighting scene, and by determining target levels of dynamics and / or detail based on the additional text descriptions, users can create advanced lighting effects for an array of light sources with relatively little effort. One or more lighting settings shown in a lighting scene are independent of the text description of the lighting scene.

[0012] For example, if a user selects only 3 to 5 colors, for instance, for a color gradient, using a text description of the lighting scene can result in more sophisticated lighting effects. For instance, if a lighting scene is named "Tokyo," the system may look for other words or descriptors that describe Tokyo (e.g., "buzzing," "crowded," "dynamic," etc.) and use them to determine the target level of dynamics and / or detail.

[0013] If the generated light setting is considered to form an image, the frequencies present in this image, which can be determined by the Fast Fourier Transform, represent the level of detail in this image, and therefore the level of detail in the generated light setting. Higher frequencies mean more detail in the image / generated light setting. Therefore, the target level of detail may also be called the target (spatial) frequency of the effect. A higher level of detail usually means more difference between adjacent pixels in a given color space.

[0014] The one or more lighting settings indicated by the lighting scene information may include one or more colors, and the at least one processor is configured to generate a color for each of the light sources based on the one or more colors, and the generated color may be the lighting setting of the generated lighting setting. For example, the one or more colors indicated by the lighting scene information may include multiple colors. In this case, the scene color, i.e., the scene palette, defines the color of the lighting effect, and the additional text description defines one or more different parameters of the lighting effect, including at least the level of dynamicity and / or detail of the lighting effect (in the case of a dynamic effect).

[0015] The generated colors may be generated such that the generated lighting settings do not include any colors that are not included in the plurality of colors and are not interpolated from at least two of the plurality of colors. This ensures that there is a clear link between the plurality of colors indicated by the lighting scene information and the generated lighting settings.

[0016] The at least one processor may be configured to determine the additional text description for the light scene based on the text description of the light scene by asking a large language model a question about the subject described by the text description, and determining the additional text description from the large language model's answer to the question. For example, if the light scene is named "Tokyo", the large language model may be asked about Tokyo. For example, the question may ask for a description of the subject, or it may ask specifically how dynamic the subject described by the text description is. In the former case, the additional text description may include, for example, other words or descriptors that describe Tokyo (e.g., "lively", "crowded", "dynamic", etc.).

[0017] The at least one processor may be configured to generate the light settings for the light source by generating one or more images. This may be beneficial for multidimensional arrays of light sources and may allow existing tools to be reused.

[0018] The at least one processor may be configured to determine a target level of detail based on the additional text description of the light scene, the target level of detail including a target frequency for the one or more images, and to generate the one or more images based on the one or more light settings indicated by the light scene information, the one or more images generated including no frequencies other than the target frequency. For example, these one or more images may be generated by a Perlin noise algorithm, or determined based on one or more images generated by a Perlin noise algorithm.

[0019] The one or more generated images may include one or more color images. In this case, the at least one processor may be configured to generate one or more noise images and to generate the one or more color images by converting the noise values ​​of pixels in the one or more noise images to the color values ​​of corresponding pixels in the one or more color images. These one or more noise images may be, for example, (black and white) noise images generated by a Perlin noise algorithm.

[0020] The at least one processor may be configured to determine a target contrast based on the additional text description for the light scene, and to generate the at least one light setting for each of the light sources based on the one or more light settings indicated by the light scene information, the generated light settings further having the target contrast. For example, if the additional text description indicates that the subject is dynamic, a higher color contrast between pixels may be used, and if the additional text description does not indicate that the subject is dynamic or indicates that the subject is not dynamic, a lower color contrast between pixels may be used. For example, if a lower color contrast is used, one or more colors indicated by the light scene information may not be rendered.

[0021] The at least one processor may be configured to obtain a plurality of current light settings for a plurality of lighting devices adjacent to the array, determine the current contrast between the plurality of current light settings, and determine the target level of detail based on the additional text description for the light scene, the target level of detail being further based on the current contrast. This may be used to fit the light settings rendered by the array of light sources with the light settings rendered by adjacent light sources.

[0022] In a second aspect of the present invention, a method for generating a light setting for an array of individually controllable light sources includes obtaining light scene information, the light scene information including a text description of the light scene and indicating one or more light settings for the light scene; determining an additional text description for the light scene based on the text description of the light scene; determining a target level of dynamics and / or a target level of detail based on the additional text description for the light scene; generating at least one light setting for each of the light sources based on the one or more light settings indicated by the light scene information, the generated light setting having the target level of dynamics and / or the target level of detail; and controlling each of the light sources to render the at least one light setting generated for each of the light sources. The method may be performed by software running on a programmable device. The software may be provided as a computer program product.

[0023] Furthermore, a computer program for implementing the methods described herein, as well as a non-temporary computer-readable storage medium storing the computer program, are provided. The computer program may, for example, be downloaded by an existing device, uploaded to an existing device, or stored at the time of manufacture of these systems.

[0024] A non-temporary computer-readable storage medium stores at least one software code portion, which, when executed or processed by a computer, is configured to perform executable operations to generate light settings for an array of individually controllable light sources.

[0025] The executable operations are to obtain optical scene information, where the optical scene information indicates one or more light settings of an optical scene and includes a text description of the optical scene, and to determine additional text descriptions for the optical scene based on the text description of the optical scene, and to determine a target level of dynamics and / or a target level of detail based on the additional text descriptions for the optical scene, and to generate at least one light setting for each of the light sources based on the one or more light settings indicated by the optical scene information, where the generated light settings have the target level of dynamics and / or the target level of detail, and to control each of the light sources of the light sources to render the at least one light setting generated for each of the light sources.

[0026] As will be understood by those skilled in the art, aspects of the present invention may be embodied as a device, method, or computer program product. Accordingly, aspects of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, microcode, etc.), or an embodiment combining software aspects and hardware aspects, all of which may be generally referred to herein as a "circuit," "module," or "system." The functions described in this disclosure may be implemented as an algorithm executed by a computer's processor / microprocessor. Further, aspects of the present invention may take the form of a computer program product embodied in one or more computer-readable media, where the one or more computer-readable media may have computer-readable program code embodied thereon, e.g., stored thereon.

[0027] Any combination of one or more computer-readable media may be used. The computer-readable media may be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any preferred combination of the above. More specific examples of computer-readable storage media include, but not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), optical storage device, magnetic storage device, or any preferred combination of the above. In the context of the present invention, the computer-readable storage medium may be any tangible medium capable of containing or storing a program for use by or in connection with an instruction execution system, apparatus, or device.

[0028] Examples of computer-readable signaling media include propagating data signals having computer-readable program code embodied within them, for example, within the baseband or as part of a carrier wave. Such propagating signals may take any of various forms, including, but not limited to, electromagnetic, optical, or any preferred combination thereof. The computer-readable signaling medium may not be a computer-readable storage medium, but any computer-readable medium capable of communicating, propagating, or transmitting programs for use by or in connection with instruction execution systems, apparatus, or devices.

[0029] Program code embodied on a computer-readable medium may be transmitted using any appropriate medium including, but not limited to, wireless, wired, fiber optic, cable, RF, etc., or any suitable combination of the foregoing. The computer program code for performing the operations regarding the aspects of the present invention may be written in any combination of one or more programming languages including object-oriented programming languages such as Java (trademark), Smalltalk, C++, and conventional procedural programming languages such as the "C" programming language or similar programming languages. This program code may be executed entirely on the user's computer as a stand-alone software package, partially on the user's computer, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network including a local area network (LAN) or a wide area network (WAN), or this connection may be implemented to an external computer (e.g., through the Internet using an Internet service provider).

[0030] Aspects of the present invention are described below with reference to flowcharts and / or block diagrams of methods, apparatuses (systems), and computer program products according to embodiments of the present invention. It will be understood that each block in a flowchart and / or block diagram, and combinations of blocks within a flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions may be provided to a processor, particularly a microprocessor or central processing unit (CPU), of a general-purpose computer, a dedicated computer, or other programmable data processing device, in order to create a machine, thereby creating means for instructions executed via the processor of a computer, other programmable data processing device, or other device to perform the functions / actions specified within the blocks of the flowchart and / or block diagram.

[0031] These computer program instructions may also be stored in a computer-readable medium capable of instructing a computer, other programmable data processing device, or other device to function in a particular manner, thereby creating a product in which the instructions stored in the computer-readable medium include instructions that perform functions / actions specified in the blocks of a flowchart and / or block diagram.

[0032] Computer program instructions may also be loaded onto a computer, other programmable data processing device, or other device to create a computer execution process, causing a series of operational steps to be executed on that computer, other programmable data processing device, or other device, thereby providing a process for instructions executed on a computer or other programmable device to perform a function / action specified within a block of a flowchart and / or block diagram.

[0033] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of devices, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for performing a specified logical function. It should also be noted that in some alternative implementations, the functions described within a block may be performed in an order different from that shown in the diagram. For example, two blocks shown consecutively may actually be executed substantially simultaneously, or they may be executed in reverse order depending on the functionality they are involved in. It should also be noted that each block in a block diagram and / or flowchart, and any combination of blocks in such block diagrams and / or flowcharts, may be implemented by a dedicated hardware-based system or a combination of dedicated hardware and computer instructions that performs a specified function or action. [Brief explanation of the drawing]

[0034] These and other aspects of the present invention are evident from the following drawings and will be further illustrated by reference to those drawings, as an example. Corresponding elements in the drawings are indicated by the same reference numerals. [Figure 1] This is a block diagram of one embodiment of the system. [Figure 2] This is a flowchart of the first embodiment of the method. [Figure 3] This is a flowchart of the second embodiment of the method. [Figure 4] This is a flowchart of the third embodiment of the method. [Figure 5] This is a flowchart of the fourth embodiment of the method. [Figure 6] This is a flowchart of the fifth embodiment of the method. [Figure 7] This is a flowchart of the sixth embodiment of the method. [Figure 8]This is a block diagram of an exemplary data processing system for carrying out the method of the present invention. [Modes for carrying out the invention]

[0035] Figure 1 shows one embodiment of a system for generating light settings for an array of individually controllable light sources. In this embodiment, the system is a bridge 1. Bridge 1 may be, for example, a Philips Hue bridge. In the example of Figure 1, light sources 51-66 are organized into a two-dimensional (4x4) array 41, which further includes a controller 42. For example, each of the light sources 51-66 may contain one or more LEDs. In the example of Figure 1, for simplification, the array 41 has only 16 light sources. In practice, an array of light sources will typically have more light sources. The light sources 51-66 can be controlled individually. Thus, different light sources in the array 41 may have different light settings (on / off, color, light output level).

[0036] Bridge 1 is connected to a wireless LAN access point 17, for example, via Ethernet® or Wi-Fi®. The wireless LAN access point 17 is connected to the Internet 11. Internet servers 13 and 14 are also connected to the Internet 11. Internet server 13 may be configured, for example, to run a large-scale language model, allowing users to query the large-scale language model. Internet server 14 may be configured, for example, to run a Perlin noise algorithm based on parameters entered by the user.

[0037] The mobile device 36 is also connected to the internet 11, if possible, via the wireless LAN access point 17. The mobile device 36 may run a lighting control application. The user may use this application to select a light scene to be rendered by the array 41. In the embodiment of Figure 1, the light scene information associated with this light scene is stored in the bridge 1. In an alternative embodiment, this light scene information may be stored in the cloud. When the user selects a light scene, the mobile device 36 sends a command to the bridge 1. The bridge 1 determines the light settings for the light sources 51-66 based on the stored light scene information and specifies these light settings in a command to send to the array 41.

[0038] Bridge 1 includes a receiver 3, a transmitter 4, a processor 5, and a memory 7. The processor 5 is configured to obtain light scene information, including a text description of the light scene, indicating one or more light settings for the light scene; determine an additional text description for the light scene based on the text description of the light scene; determine a target level of dynamics and / or a target level of detail based on the additional text description for the light scene; generate at least one light setting for each of the light sources 51 to 66 based on the one or more light settings indicated by the light scene information, the generated light setting having a target level of dynamics and / or a target level of detail; and control each of the light sources 51 to 66 via the transmitter 4 to render at least one light setting generated for each light source.

[0039] In the embodiment of bridge 1 shown in Figure 1, bridge 1 includes one processor 5. In an alternative embodiment, bridge 1 includes multiple processors. The processor 5 of bridge 1 may be, for example, an ARM-based general-purpose processor or an application-specific processor. The processor 5 of bridge 1 may run, for example, a Unix-based operating system. Memory 7 may include one or more memory units. Memory 7 may include, for example, solid memory. Memory 7 may be used to store, for example, a table of connected lights.

[0040] The receiver 3 and transmitter 4 may use one or more wired or wireless communication technologies, such as Ethernet® for communication with the wireless LAN access point 17 and Zigbee® for communication with the lighting device. In an alternative embodiment, multiple receivers and / or multiple transmitters are used instead of a single receiver and a single transmitter. In the embodiment shown in Figure 1, separate receivers and separate transmitters are used. In an alternative embodiment, the receiver 3 and transmitter 4 are combined into a transceiver. The bridge 1 may include other components typical of network devices, such as power connectors. The present invention may be implemented using a computer program executed on one or more processors.

[0041] In the embodiment shown in Figure 1, the system of the present invention includes a bridge. In alternative embodiments, the system of the present invention is a different type of device, such as a mobile device or a cloud computer. In the embodiment shown in Figure 1, the system of the present invention includes a single device. In alternative embodiments, the system of the present invention includes multiple devices.

[0042] A first embodiment of a method for generating a light setting for an array of individually controllable light sources is shown in Figure 2. This method may be performed, for example, by bridge 1 in Figure 1. Step 100 includes enabling a user to select a light scene, for example on a mobile device 36 in Figure 1.

[0043] Step 101 includes obtaining light scene information. The light scene information indicates one or more light settings of the light scene selected in step 100 and includes a text description of this light scene. These one or more light settings may include, for example, one or more colors. For example, the light scene information may include a color palette, or it may include or show an image from which a color palette can be extracted, and a text description.

[0044] For example, in the Hue system, each lighting scene is represented by an image, palette, title, and theme or set (for instance, the scene "Tokyo" is part of the "Party Vibes" set). The palette is first generated using a color extraction algorithm and then manually fine-tuned by the light designer. Therefore, there is no direct algorithmic connection between the image and the palette, and thus both can convey useful information for generating the lighting settings.

[0045] Step 103 includes determining an additional text description for the light scene based on the text description of the light scene obtained in Step 101. The text description of the light scene may include the name of the light scene and / or keywords related to the light scene. For example, in the Hue app, each scene in the scene gallery has a name, as well as keywords(s) used for keyword-based searches within the light scene gallery. Users may also add keywords when creating light scenes.

[0046] Alternatively or additionally, the text description of a light scene may include labels relating to the audio, music, or images associated with the light scene. Alternatively or additionally, the text description may include keywords extracted directly from the audio, music, or images with the help of machine learning. For example, the text description may be acquired based on images by using a pretrained image-to-text model Pix2Struct. This is particularly useful when the scene palette indicated by the light scene corresponds to the images used to represent the light scene. In this case, the text description will capture the image meaning. Alternatively or additionally, the text description may be derived from one or more lighting settings indicated by the light scene information. For example, it may be "energizing" for a bright scene with cool white or bluish light, or "cozy" for a scene with low dimming levels and warm colors.

[0047] Step 105 includes determining the target levels of dynamism and / or detail based on the additional text descriptions determined in Step 103. For example, a mapping in which keywords are mapped to levels of dynamism and / or detail may be consulted in Step 105. Alternatively, a large-scale language model may be used (see, for example, Figure 4).

[0048] Step 107 includes generating at least one light setting for each light source based on one or more light settings indicated by the light scene information obtained in step 101, wherein the generated light settings have target levels of dynamics and / or detail determined in step 105. If the light scene is a dynamic light scene, step 107 includes generating consecutive light settings for each light source. For example, the transitions between the consecutive light settings to be rendered may be faster if additional text descriptions indicate that the subject described by the text descriptions is very dynamic, or slower otherwise.

[0049] If one or more light settings obtained in step 101 include one or more colors, step 107 may include generating colors for each of the light sources based on these one or more colors, and further may include generating additional light settings for each of the light sources, such as light output levels. If colors are generated based on one or more light settings indicated by the light scene information, the additional light settings do not need to be generated based on one or more light settings indicated by the light scene information. The light settings may be generated such that the colors and / or additional light settings have a target level of dynamics, and / or the colors and / or additional light settings have a target level of detail.

[0050] If one or more colors obtained in step 101 include multiple colors, it is preferable that the light settings generated in step 107 do not include any colors that are not included in the multiple colors and do not include any colors that are not interpolated from at least two of the multiple colors.

[0051] In one implementation, step 107 includes using machine learning (e.g., a deep neural network) to generate a light setting for a light source, using as input data a light setting indicated by light scene information such as a color palette, and a target level of dynamics and / or a target level of detail. In another implementation, step 107 includes a Perlin noise algorithm generating one or more noise images (see, for example, Figure 5). Step 107 may additionally or alternatively include generating one or more other types of images.

[0052] If an image is already associated with a lighting scene, it is usually not possible to use this scene image to generate lighting settings for a light source; therefore, even in this case, generating one or more images may be beneficial. Due to the difference in resolution between the scene image and the desired image, it is usually not possible to simply scale down the scene image. Using machine learning, the contrast and dynamics of the scene image may be rendered using a text description and the scene image itself as input.

[0053] For example, the initial light settings may first be generated in step 107 without considering the exact characteristics of the array of light sources, and then modified in step 107 to fit the array of light sources, or they may be generated directly to precisely fit the characteristics of the array of light sources. The former may be useful when there are multiple pixelated light arrays. The characteristics of the array of light sources may be obtained in a separate step (not shown in Figure 2). Characteristics may include, for example, resolution (for a 2D array), size, location of each pixel in a free-form device (e.g., a string-based flexible lighting device), location and orientation of the device in space, etc. These characteristics may be obtained, for example, when the array is added to the lighting system and configured. This separate step may simply involve retrieving stored parameters.

[0054] Alternatively, the exact characteristics of the array of light sources may not be considered at all in step 107. For example, it may only be known whether the array is a one-dimensional, two-dimensional, or three-dimensional controllable LED array, in which case the light settings may be generated according to the required number of dimensions and then mapped to the individual pixels of the array, for example, by the array (i.e., the pixelated lighting device) itself. Step 107 may further include modifying the generated light settings to fit with the light settings (e.g., orientation, color switching) of other light sources present in the area.

[0055] Step 109 includes controlling each light source to render at least one light setting generated for each light source in step 107. Additionally, one or more steps from one or more embodiments of the embodiments shown in Figures 3-7 may be added to the embodiment shown in Figure 2.

[0056] A second embodiment of a method for generating light settings for an array of individually controllable light sources is shown in Figure 3. This method may be performed, for example, by bridge 1 in Figure 1.

[0057] Step 101 includes obtaining light scene information. The light scene information indicates one or more lighting settings for the light scene and includes a text description of this light scene. Step 103 includes determining an additional text description for the light scene based on the text description of the light scene obtained in step 101. Step 105 includes determining a target level of dynamics and / or a target level of detail based on the additional text description determined in step 103.

[0058] Step 107 includes generating at least one light setting for each of the light sources based on one or more light settings indicated by the light scene information obtained in step 101, wherein the generated light settings have target levels of dynamics and / or detail determined in step 105. Step 121 includes storing the light settings generated in step 107 in relation to the light scene, for example, as part of the light scene information.

[0059] Step 100 includes enabling the user to select a light scene for which light settings were generated in step 107, for example on a mobile device 36 in Figure 1. Step 100 may be performed considerably later than steps 101-121. Step 123 includes retrieving the light settings stored in step 121 in relation to the light scene, for example by obtaining updated light scene information.

[0060] Step 109 includes controlling each light source to render at least one light setting generated for each light source in step 107. Additionally, one or more steps from one or more embodiments of the embodiments in Figures 2, 4-7 may be added to the embodiment in Figure 3.

[0061] In the embodiment shown in Figure 3, steps 101-107 only need to be performed once, for example, when the light scene is invoked for the first time, or when the light scene is invoked for the first time for this particular array of light sources. The light settings are stored and linked to the light scene so that they can be used directly when the light scene is invoked again. In the embodiment shown in Figure 2, steps 101-107 are repeated each time the light scene is invoked. This allows for some change to be made to the light settings, for example, by using a stochastic algorithm.

[0062] If the lighting scene is a dynamic lighting scene and step 105 in Figure 3 involves determining a target level of detail based on the additional text description determined in step 103, then step 109 in Figure 3 may involve rendering in a loop the continuous lighting settings generated for each light source in step 107. If the lighting scene is a dynamic lighting scene and step 105 in Figure 2 involves determining a target level of detail based on the additional text description determined in step 103, then steps 107 and 109 in Figure 2 may be repeated multiple times so that different sets of continuous lighting settings are generated and rendered each time (for example, by using a probabilistic algorithm), resulting in a continuous generation of new content.

[0063] A third embodiment of a method for generating light settings for an array of individually controllable light sources is shown in Figure 4. This method may be performed, for example, by bridge 1 in Figure 1.

[0064] Step 101 includes obtaining light scene information. The light scene information indicates one or more light settings of a light scene and includes a text description of this light scene. Step 103 includes determining an additional text description for the light scene based on the text description of the light scene obtained in step 101. In the embodiment shown in Figure 4, step 103 is carried out by substeps 141 and 143.

[0065] Step 141 involves asking a large-scale language model, such as ChatGPT, Google Bard, or Microsoft Bing Chat, questions about the subject described by the text description obtained in Step 101. For example, if the light scene is named "Tokyo," the large-scale language model may be asked about Tokyo. For example, the question may ask about the subject description, e.g., Tokyo, or it may specifically ask how dynamic the subject described by the text description is, e.g., "how dynamic is Tokyo?" For example, the internet server 13 in Figure 1 may be configured to run this large-scale language model.

[0066] Step 143 includes determining additional text descriptions from the large-scale language model's responses to the questions asked in Step 141. Step 105 includes determining target levels for dynamics and / or detail based on the additional text descriptions determined in Step 143.

[0067] Step 107 includes generating at least one light setting for each of the light sources based on one or more light settings indicated by the light scene information obtained in step 101, wherein the generated light settings have target levels of dynamics and / or detail determined in step 105. Step 109 includes controlling each of the light sources to render at least one light setting generated for each light source in step 107. Additionally, one or more steps from one or more embodiments of the embodiments in Figures 2-3 and 5-7 may be added to the embodiment in Figure 4.

[0068] A fourth embodiment of a method for generating a light setting for an array of individually controllable light sources is shown in Figure 5. This method may be performed, for example, by bridge 1 in Figure 1. In the embodiment of Figure 5, the light sources are organized into a two-dimensional array.

[0069] Step 101 includes obtaining light scene information. The light scene information indicates one or more light settings of a light scene and includes a text description of this light scene. Step 103 includes determining an additional text description for the light scene based on the text description of the light scene obtained in step 101. Step 161 includes determining at least a target level of detail based on the additional text description determined in step 103. In the embodiment of Figure 5, the target level of detail includes a target image frequency. As a first example, if the text description includes the word "sunset", the additional description may include the words "relax, soft, quiet", and the target frequency may include only low frequencies. As a second example, if the text description includes the word "Osaka", the additional description may include the words "busy, city, urban", and the target frequency may include high frequencies.

[0070] Step 163 includes generating at least one light setting for each of the light sources based on one or more light settings indicated by the light scene information obtained in step 101, wherein the generated light settings have the target level of detail determined in step 161. The light settings for the light sources are generated by generating one or more images. In the embodiment of Figure 5, the light settings for the light sources are generated such that the one or more generated images do not contain frequencies other than the target frequencies determined in step 161. As the light settings for the light sources, the pixel values ​​at the same positions in the images as the positions of the light sources in the array are used.

[0071] If the color of the light source needs to have a target level of detail, the one or more generated images may include one or more color images. In this case, step 161 may first include generating one or more noise images (black and white images) based on the target level of detail, for example by using the Perlin noise algorithm, and then converting the noise values ​​of pixels in the one or more noise images to the color values ​​of corresponding pixels in the one or more color images. For example, the internet server 14 in Figure 1 may be configured to execute this Perlin noise algorithm based on parameters entered by the user. When the Perlin noise algorithm is used, the determined target level of detail may be converted to one or more parameters from scale, octave, and persistence.

[0072] If only the light output level of the light source needs to have the target level of detail, it is not necessary to generate one or more color images. In this case, for example, step 161 may include generating a noise image (black and white image) by, for example, using a Perlin noise algorithm, and using the pixel value at the same position in the noise image as the position of the light source in the array as the light output level of the light source. The color of the light source may be determined in a different way, for example, based on a color palette specified by light scene information.

[0073] Step 109 includes controlling each light source to render at least one light setting generated for each light source in step 163. Additionally, one or more steps from one or more embodiments of the embodiments in Figures 2-4 and 6-8 may be added to the embodiment in Figure 5.

[0074] A fifth embodiment of a method for generating light settings for an array of individually controllable light sources is shown in Figure 6. This method may be performed, for example, by bridge 1 in Figure 1.

[0075] Step 101 includes obtaining light scene information. The light scene information indicates one or more light settings for the light scene selected in step 100 and includes a text description of this light scene. Step 103 includes determining an additional text description for the light scene based on the text description of the light scene obtained in step 101.

[0076] Steps 105 and 171 are performed after step 103. Step 105 includes determining the target level of dynamics and / or the target level of detail based on the additional text description determined in step 103. Step 171 includes determining the target contrast and the total contrast over all pixels based on the additional text description determined in step 103.

[0077] Step 173 is performed after steps 105 and 171 have been performed. Step 173 generates at least one light setting for each of the light sources based on one or more light settings indicated by the light scene information obtained in step 101, wherein the generated light setting has a target level of dynamics and / or a target level of detail determined in step 105, and further has a target contrast determined in step 173.

[0078] Step 109 includes controlling each light source to render at least one light setting generated for each light source in step 107. Additionally, one or more steps from one or more embodiments of the embodiments in Figures 2-5, 7 may be added to the embodiment in Figure 6.

[0079] A sixth embodiment of a method for generating a light setting for an array of individually controllable light sources is shown in Figure 7. This method may be performed, for example, by bridge 1 in Figure 1. The method in Figure 7 is an extension of the method in Figure 2. Step 100 includes enabling a user to select a light scene, for example on mobile device 36 in Figure 1.

[0080] Steps 101 and 181 are performed after step 100. Step 101 includes obtaining light scene information. The light scene information indicates one or more light settings of the light scene and includes a text description of this light scene. Next, step 103 includes determining an additional text description for the light scene based on the text description of the light scene obtained in step 101.

[0081] Step 181 includes obtaining multiple current light settings for multiple lighting devices adjacent to the array. Step 181 may also include obtaining the location of the lighting devices in space, for example, from a general configuration in a light control app or scanned, for example, with a lidar. Step 183 includes determining the current contrast between the multiple current light settings obtained in Step 181.

[0082] Step 185 is performed after steps 103 and 183 have been performed. Step 185 includes determining a target level of detail based on the additional text description determined in step 103 and further based on the current contrast determined in step 183. For example, the higher the contrast between adjacent lighting devices, the higher the contrast between adjacent light sources in the array. Step 185 optionally includes determining a target level of dynamics based on the additional text description determined in step 103.

[0083] Step 107 includes generating at least one light setting for each of the light sources based on one or more light settings indicated by the light scene information obtained in step 101, wherein the generated light settings have a target level of detail and, optionally, a target level of dynamics, as determined in step 185. Step 109 includes controlling each of the light sources to render at least one light setting generated for each light source in step 107. Additionally, one or more steps from one or more embodiments of the embodiments in Figures 3-6 may be added to the embodiment in Figure 7.

[0084] Thus, in the embodiment of Figure 7, the state of other lighting devices in the area is additionally determined before generating the content, and this information is used to ensure that the generated content fits well with other lighting devices in the area, for example, depending on the location of the lighting devices.

[0085] Figure 8 shows a block diagram illustrating an exemplary data processing system that can perform the methods described with reference to Figures 2-7.

[0086] As shown in Figure 8, the data processing system 300 may include at least one processor 302 coupled to the memory element 304 via a system bus 306. Therefore, the data processing system may store program code in the memory element 304. Furthermore, the processor 302 may execute program code accessed from the memory element 304 via the system bus 306. In one embodiment, the data processing system may be implemented as a computer suitable for storing and / or executing program code. However, it should be understood that the data processing system 300 may be implemented in the form of any system including a processor and memory capable of performing the functions described herein.

[0087] The memory element 304 may include one or more physical memory devices, such as local memory 308 and one or more mass storage devices 310. Local memory may refer to random access memory or other non-persistent memory devices commonly used during the actual execution of program code. Mass storage devices may be implemented as hard drives or other persistent data storage devices. The processing system 300 may also include one or more cache memories (not shown) that provide temporary storage for at least some of the program code to reduce the number of times the program code must be retrieved from the mass storage device 310 during execution. Furthermore, the processing system 300 may use memory elements of another processing system, for example, if the processing system 300 is part of a cloud computing platform.

[0088] Input / output (I / O) devices, indicated as input device 312 and output device 314, can optionally be coupled to the data processing system. Examples of input devices, but not limited to, include keyboards, pointing devices such as mice, and microphones (e.g., for voice and / or speech recognition). Examples of output devices, but not limited to, include monitors or displays and speakers. The input and / or output devices may be coupled to the data processing system directly or via an intermediary I / O controller.

[0089] In one embodiment, the input and output devices may be implemented as a combined input / output device (shown in Figure 8 by dashed lines surrounding input device 312 and output device 314). An example of such a combined device is a touch-sensitive display, sometimes referred to as a “touchscreen display” or simply a “touchscreen.” In such embodiments, input to the device may be provided by the movement of a physical entity, such as a stylus or a user’s finger, on or near the touchscreen display.

[0090] The network adapter 316 may also be coupled to the data processing system, enabling the data processing system to be coupled to other systems, computer systems, remote network devices, and / or remote storage devices via an intervening private or public network. The network adapter may include a data receiver for receiving data transmitted to the data processing system 300 by the aforementioned systems, devices, and / or networks, and a data transmitter for transmitting data from the data processing system 300 to the aforementioned systems, devices, and / or networks. Modems, cable modems, and Ethernet cards are examples of various types of network adapters that may be used with the data processing system 500.

[0091] As shown in Figure 8, the memory element 304 may store the application 318. In various embodiments, the application 318 may be stored in local memory 308, one or more mass storage devices 310, or separately from those local memory and mass storage devices. It should be understood that the data processing system 300 may further run an operating system (not shown in Figure 8) that facilitates the execution of the application 318. The application 318 is implemented in the form of executable program code and can be executed by the data processing system 300, for example, by a processor 302. In response to the execution of the application, the data processing system 300 may be configured to perform one or more operation or method steps described herein.

[0092] Various embodiments of the present invention may be implemented as program products for use with computer systems, and the program(s) of the program product may define the functions of the embodiments (including the methods described herein). In one embodiment, the program may be contained on various non-temporary computer-readable storage media, and as used herein, the expression “non-temporary computer-readable storage media” includes all computer-readable media, with the sole exception being temporary propagating signals. In another embodiment, the program may be contained on various temporary computer-readable storage media. Exemplary computer-readable storage media include, but are not limited to, (i) non-writable storage media on which information is stored permanently (e.g., read-only memory devices inside a computer, such as CD-ROM disks, ROM chips, or any type of non-volatile solid-state semiconductor memory readable by a CD-ROM drive), and (ii) writable storage media on which modifiable information is stored (e.g., flash memory, floppy disks inside a diskette drive or hard disk drive, or any type of random-access solid-state semiconductor memory). The computer program may be executed on the processor 302 described herein.

[0093] The terminology used herein is intended solely to describe specific embodiments and is not intended to limit the invention. Where used herein, the singular forms “a,” “an,” and “the” are intended to include the plural form unless the context explicitly indicates otherwise. Where used herein, the terms “comprises” and / or “comprising” specify the presence of a described feature, integer, step, operation, element, and / or component, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0094] The corresponding structures, materials, actions, and equivalents of all means-plus-function or step-plus-function elements in the following claims are intended to include any structures, materials, or actions for performing a function in combination with other claimed elements specifically claimed. The description of embodiments of the present invention has been presented for illustrative purposes only and is not intended to be exhaustive or to limit implementations of the disclosed forms. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the invention. The embodiments have been selected and described to best illustrate the principles and some practical applications of the present invention and to enable those other skilled in the art to understand the invention with respect to various embodiments having various modifications suitable for specific applications conceivable.

Claims

1. A system for generating light settings for an array of individually controllable light sources, the system is At least one control interface, Light scene information is obtained, and the light scene information includes one or more light settings of the light scene and a text description of the light scene. Based on the text description of the aforementioned light scene, an additional text description for the light scene is determined. Based on the additional text description for the aforementioned light scene, a target level of dynamics and / or a target level of detail is determined. Based on the one or more light settings indicated by the light scene information, at least one light setting is generated for each of the light sources, the generated light setting has a target level of dynamics and / or a target level of detail, and Controlling each of the light sources to render the at least one light setting generated for each of the light sources via the at least one control interface, A processor configured as follows: A system that includes this.

2. The system according to claim 1, wherein the one or more light settings indicated by the light scene information include one or more colors, and the at least one processor is configured to generate a color for each of the light sources based on the one or more colors, and the generated color is the light setting of the generated light setting.

3. The system according to claim 2, wherein the one or more colors indicated by the light scene information include a plurality of colors.

4. The system according to claim 3, wherein the generated light settings do not include any colors that are not included in the plurality of colors and are not interpolated from at least two of the plurality of colors.

5. The at least one processor generates the additional text description for the light scene based on the text description of the light scene. To make a large-scale language model of the questions concerning the subject described by the aforementioned text description, and The additional text description is determined from the answers of the large-scale language model to the aforementioned questions. The system according to any one of claims 1 to 4, configured to determine by

6. The system according to any one of claims 1 to 5, wherein the at least one processor is configured to generate the light settings for the light source by generating one or more images.

7. The aforementioned at least one processor is Based on the additional text description for the light scene, the target level of detail is determined, and the target level of detail includes a target frequency for one or more images, and One or more images are generated based on the one or more light settings indicated by the light scene information, and the one or more generated images do not include frequencies other than the target frequency. The system according to claim 6, configured as described above.

8. The system according to claim 6 or 7, wherein the generated one or more images include one or more color images.

9. The system according to claim 8, wherein the at least one processor is configured to generate one or more noise images and to generate one or more color images by converting the noise values ​​of pixels in the one or more noise images into the color values ​​of corresponding pixels in the one or more color images.

10. The system according to any one of claims 1 to 9, wherein the text description of the light scene includes the name of the light scene or keywords related to the light scene.

11. The system according to any one of claims 1 to 10, wherein the text description of the light scene includes a label relating to sound, music, or images associated with the light scene.

12. The aforementioned at least one processor is The target contrast is determined based on the additional text description for the aforementioned light scene, and Based on the one or more light settings indicated by the light scene information, at least one light setting is generated for each of the light sources, and the generated light setting further has the target contrast. The system according to any one of claims 1 to 11, configured as described above.

13. The aforementioned at least one processor is To obtain multiple current light settings for multiple lighting devices adjacent to the array, Determine the current contrast between the plurality of current light settings, and Based on the additional text description for the light scene, the target level of detail is determined, and the target level of detail is further based on the current contrast. The system according to any one of claims 1 to 12, configured as follows.

14. A method for generating a light setting for an array of individually controllable light sources, the method being: The objective is to obtain light scene information, wherein the light scene information includes one or more light settings for the light scene and a text description of the light scene. Determining an additional text description for the light scene based on the text description of the light scene, Determining the target level of dynamics and / or the target level of detail based on the additional text description for the aforementioned light scene, Based on the one or more light settings indicated by the light scene information, at least one light setting is generated for each of the light sources, and the generated light setting has a target level of dynamics and / or a target level of detail. Controlling each of the aforementioned light sources to render the at least one light setting generated for each of the aforementioned light sources, Methods that include...

15. A computer program for a computing device, which, when the computer program is executed on a processing unit of the computing device, includes computer program code for performing the method described in claim 14.

Images