Using different communication protocols to control different groups of lighting devices in entertainment mode

Abstract

A system (11, 21) is configured to: identify a plurality of lighting devices (31-34) included in an entertainment group; assign a first subset (31, 32) of the plurality of lighting devices to a first subgroup and a second subset (33, 34) of the plurality of lighting devices to a second subgroup according to one or more grouping criteria; control the first subset of lighting devices using a first communication protocol to present a first subset of multiple dynamic light effects in an entertainment mode; and control the second subset of lighting devices using a second communication protocol to present a second subset of multiple dynamic light effects in an entertainment mode. The first subset and the second subset of lighting devices do not completely overlap. At least one processor (15, 25, 85) of the system (11, 21) is configured to determine the distance between the system (11, 21) and each of the plurality of lighting devices (31-34), and assign the plurality of lighting devices to the subgroup based on the distance.

Description

Technical Field

[0001] The present invention relates to a system for controlling a plurality of lighting devices included in an entertainment group, wherein the plurality of lighting devices are controlled in an entertainment mode to present dynamic lighting effects corresponding to audio and / or video content being presented on a media presentation device.

[0002] The present invention also relates to a method for controlling a plurality of lighting devices included in an entertainment group, the plurality of lighting devices being controlled in an entertainment mode to present dynamic lighting effects corresponding to audio and / or video content being presented on a media presentation device.

[0003] The present invention also relates to a computer program product that enables a computer system to execute this method. Background Technology

[0004] Philips' Hue Entertainment and Hue Sync are gaining popularity. Hue Sync can render lighting effects based on the content being played on a computer, such as video games. Dynamic lighting systems can significantly impact the experience and impression of audiovisual materials, especially when the color sent to the light matches the content to be seen in the synthetic environment surrounding the screen.

[0005] This new use of light can appropriately bring the atmosphere of a video game or movie into the user's room. For example, gamers can immerse themselves in the atmosphere of the game environment and enjoy the flashes of weapon fire or magical spells, and sit in the glow of a force field as if they were real. Tone synchronization works by observing an analytical area of ​​the video content and calculating the light output parameters presented on the tone lights around the screen. When entertainment mode is active, the selected lighting devices in the created entertainment group will play lighting effects according to the content.

[0006] Recently, an HDMI module called the Hue Player HDMI Sync Box has been added to the Hue Entertainment suite. This new device addresses one of the main limitations of tone synchronization and is designed for use with streaming and gaming devices connected to TVs. It will utilize the same principles and mechanisms used for transmitting information as the entertainment suite.

[0007] Currently, Tone Entertainment supports up to ten addressable (Zigbee) light sources in an entertainment group. With the introduction of HDMI modules and (upcoming) pixelated LED stripes, this limitation could become a bottleneck. In Zigbee, a group of light sources can be controlled as a single light source, and a similar principle is disclosed in US2019 / 036721A1. While this allows for the control of more than ten light sources in entertainment mode, controlling all light sources in a group to produce the same lighting effect is generally undesirable.

[0008] US2020029411A1 discloses a lighting system having a client device and a hub device, the client device having a first type of wireless equipment and the hub device having a second type of wireless equipment.

[0009] US20131473951A1 discloses a dynamic ambient lighting system that extracts lighting schemes from video data and resolves the lighting schemes into individual lighting effects to control the light source. Summary of the Invention

[0010] The first objective of this invention is to provide a system that can control a considerable number of lighting devices to present various dynamic lighting effects in an entertainment mode.

[0011] A second objective of this invention is to provide a method for controlling a considerable number of lighting devices to present various dynamic lighting effects in an entertainment mode.

[0012] In a first aspect of the invention, a system is provided for controlling a plurality of lighting devices included in an entertainment group, the plurality of lighting devices being controlled in an entertainment mode to present dynamic lighting effects corresponding to audio and / or video content being presented on a media presentation device. The system includes at least one input interface, at least one output interface, and at least one processor. The at least one processor is configured to: identify the plurality of lighting devices included in the entertainment group via the at least one input interface; assign a first subset of the plurality of lighting devices to a first group and a second subset of the plurality of lighting devices to a second group according to one or more grouping criteria, wherein the first subset of the lighting devices does not completely overlap with the second subset of the lighting devices; control the lighting devices of the first group via the at least one output interface using a first communication protocol to present a first subset of the dynamic lighting effects in the entertainment mode; and control the lighting devices of the second group via the at least one output interface using a second communication protocol to present a second subset of the dynamic lighting effects in the entertainment mode.

[0013] By dividing the entertainment group into two (sub)groups, one receiving commands via a communication protocol (e.g., RF) and the other via a second communication protocol (e.g., Zigbee), a greater number of lighting devices can be controlled to present unique dynamic lighting effects in entertainment mode. These two groups can be controlled by the same system component or by different system components. For example, a bridge can use Zigbee to control lighting devices, and an HDMI module can use Bluetooth to control lighting devices.

[0014] Typically, the first group and / or the second group has the maximum number of lighting devices that can be assigned to the group. As a first example, Hue Entertainment currently supports up to 10 addressable Zigbee light sources in an Entertainment group. Due to the constant flow of dynamic lighting effects in Entertainment mode, supporting more than ten Zigbee light sources, or more than ten groups of Zigbee lighting devices with the same performance, may cause performance issues. As a second example, the Bluetooth specification defines seven as the maximum number of Bluetooth devices that can connect simultaneously. In practice, devices typically use the lower maximum number of Bluetooth devices that can connect simultaneously.

[0015] When the first group may include at most a first number of the plurality of lighting devices, and the first communication protocol and / or the spectrum used by the first communication protocol is more suitable for delivering dynamic lighting effects than the second communication protocol and / or the spectrum used by the second communication protocol, the at least one processor may be configured to assign the first number of the plurality of lighting devices to the first group. For example, the first communication protocol may be Bluetooth, and the second communication protocol may be Zigbee. Typically, Bluetooth is more suitable for delivering dynamic lighting effects, and therefore it may be advantageous to assign as many lighting devices as possible to the Bluetooth group. This can be even more advantageous if the Zigbee channel is also used by one or more other devices (e.g., via a Wi-Fi access point).

[0016] Entertainment mode is a mode in which one or more lighting devices (usually multiple lighting devices) are controlled to present dynamic light effects corresponding to the audio and / or video content being presented on the media presentation device. To inform the system which lighting devices are controlled in entertainment mode, these devices are included in an entertainment group. The first subset of lighting devices does not completely overlap with the second subset, but typically there is no overlap at all.

[0017] The at least one processor can be configured to control either the first group of lighting devices or the second group of lighting devices via a bridge. Furthermore, the at least one processor can be configured to control the lighting devices from the first and second groups via one of the communication protocols when the entertainment mode is inactive.

[0018] The at least one processor can be configured to determine the distance between the system and each of the plurality of lighting devices, and to allocate the plurality of lighting devices to the group based on the distance. This is advantageous, for example, if the system comprises multiple components. For example, the allocation can be performed such that a first subset includes lighting devices that are closer to a first component of the system than a second component of the system, and a second subset includes lighting devices that are closer to a second component of the system than the first component of the system.

[0019] Optionally, the assignment can be performed such that the first subset includes only lighting devices whose distance from at least one other lighting device in the first subset does not exceed a threshold, and the second subset of the lighting devices includes only lighting devices whose distance from any one of the lighting devices in the first subset exceeds the threshold. Lighting devices located next to each other are preferably assigned to a group to avoid visible mismatches affecting the presentation of the effect.

[0020] Typically, system components use one or more high-bandwidth communication protocols, such as Wi-Fi, to communicate with each other, and use one or more short-range RF communication protocols to communicate with lighting equipment. For longer-distance communication, reducing the use of short-range RF communication allows for more optimized use of network bandwidth and reduces latency.

[0021] The at least one processor can be configured to determine the distance by determining the number of hops between the system and each of the plurality of lighting devices. By determining the distance as the number of hops, the number of hops can be minimized. This is advantageous because each hop typically requires more resources and increases latency.

[0022] The first subset of the lighting devices may include at least one lighting device that does not support the second communication protocol, and / or the second subset of the lighting devices may include at least one lighting device that does not support the first communication protocol. Typically, some lighting devices will support one of the communication protocols, and other lighting devices will support both. In this case, only one group will apply to the lighting devices that support only one of the communication protocols.

[0023] The second subset of the lighting devices may include two or more lighting devices that can be controlled with a single command. For example, when the second communication protocol is Zigbee, the second subset of the lighting devices may include two or more lighting devices that have already been assigned to a single Zigbee group. When the lighting devices are regularly controlled with a single command and therefore regularly present the same lighting effects, these lighting devices are then preferably assigned to the same entertainment subgroup.

[0024] The at least one processor can be configured to select at least one grouping standard from a set of grouping standards based on the type of the audio and / or video content. For example, for dynamic content, it is often beneficial to present dynamic lighting effects with low latency, and therefore more grouping standards that minimize latency can be selected.

[0025] The at least one processor can be configured to: when the entertainment mode is active, reassign at least one of a first subset of lighting devices from the first group to the second group according to the one or more grouping criteria, and / or reassign at least one of a second subset of lighting devices from the second group to the first group. For example, it would be advantageous if the at least one processor were configured to determine differences between the dynamic lighting effects and assign the plurality of lighting devices to the groups based on those differences.

[0026] In a second aspect of the invention, a method is provided for controlling a plurality of lighting devices included in an entertainment group, the plurality of lighting devices being controlled in an entertainment mode to present dynamic lighting effects corresponding to audio and / or video content being presented on a media presentation device. The method includes: identifying the plurality of lighting devices included in the entertainment group; assigning a first subset of the plurality of lighting devices to a first group according to one or more grouping criteria, and assigning a second subset of the plurality of lighting devices to a second group, the first subset and the second subset of the lighting devices not completely overlapping; controlling the lighting devices of the first group using a first communication protocol to present a first subset of the dynamic lighting effects in the entertainment mode; and controlling the lighting devices of the second group using a second communication protocol to present a second subset of the dynamic lighting effects in the entertainment mode. The method can be performed by software running on a programmable device. The software can be provided as a computer program product.

[0027] In addition, a computer program for performing the methods described herein is provided, as well as a non-transitory computer-readable storage medium for storing the computer program. The computer program may be downloaded or uploaded to an existing device, for example, or stored during the manufacture of these systems.

[0028] A non-transitory computer-readable storage medium storing at least one portion of software code that, when executed or processed by a computer, is configured to perform executable operations for controlling a plurality of lighting devices included in an entertainment group, the plurality of lighting devices being controlled in an entertainment mode to present dynamic lighting effects corresponding to audio and / or video content being presented on a media presentation device.

[0029] The executable operations include: identifying the plurality of lighting devices included in the entertainment group; assigning a first subset of the plurality of lighting devices to a first group and a second subset of the plurality of lighting devices to a second group according to one or more grouping criteria, wherein the first subset of the lighting devices does not completely overlap with the second subset of the lighting devices; using a first communication protocol to control the first group of lighting devices to present a first subset of the dynamic light effect in the entertainment mode; and using a second communication protocol to control the second group of lighting devices to present a second subset of the dynamic light effect in the entertainment mode.

[0030] As those skilled in the art will understand, various aspects of the present invention can be embodied as an apparatus, method, or computer program product. Therefore, various aspects of the present invention can take the form of a completely hardware implementation, a completely software implementation (including firmware, resident software, microcode, etc.), or a combination of software and hardware aspects, the hardware aspects of which may generally be referred to herein as "circuit," "module," or "system." The functionality described in this disclosure can be implemented as an algorithm executed by a computer's processor / microprocessor. Furthermore, various aspects of the present invention can take the form of a computer program product embodied in one or more computer-readable media having computer-readable program code embodied thereon (e.g., stored thereon).

[0031] Any combination of one or more computer-readable media can be used. A computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium can be, for example, but not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any suitable combination of the foregoing. More specific examples of computer-readable storage media may include, but are not limited to, electrical connectors having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable optical disc read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing. In the context of this invention, a computer-readable storage medium can be any tangible medium capable of containing or storing a program for use by or connection to an instruction execution system, apparatus, or device.

[0032] Computer-readable signal media may include propagated data signals having computer-readable program code embodied therein, the propagated data signals being, for example, in baseband or as part of a carrier wave. Such propagated signals may take any of a variety of forms, including, but not limited to, electromagnetic, optical, or any suitable combination thereof. A computer-readable signal medium may be any of the following computer-readable media that is not a computer-readable storage medium and can deliver, propagate, or transmit a program for use by or connected to an instruction execution system, apparatus, or device.

[0033] Program code implemented on a computer-readable medium may be transmitted using any suitable medium, including but not limited to wireless, wired, fiber optic, cable, RF, etc., or any suitable combination thereof. Computer program code for performing the operations of various aspects of this invention may be written in any combination of one or more programming languages, including: object-oriented programming languages ​​such as JAVA™, Smalltalk, C++, etc.; and conventional procedural programming languages ​​such as the "C" programming language or similar programming languages. The program code may be executed entirely on a local computer, partially on a local computer, as a standalone software package, partially on a local computer and partially on a remote computer, or entirely on a remote computer or server. In the latter case, the remote computer may be connected to the local computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet provided by an Internet service provider).

[0034] The following description of various aspects of the invention is based on flowcharts and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus, particularly a microprocessor or central processing unit (CPU), to generate a machine, thereby enabling the instructions, other programmable data processing apparatus, or other devices, executable via the processor of the computer, to create means for implementing the functions / actions specified in one or more blocks of the flowcharts and / or block diagrams.

[0035] These computer program instructions may also be stored in a computer-readable medium that can instruct a computer, other programmable data processing device or other device to function in a particular manner such that the instructions stored in the computer-readable medium produce an article of writing comprising instructions that implement the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0036] Computer program instructions may also be loaded onto a computer, other programmable data processing apparatus or other apparatus to cause a series of operational steps to be performed on the computer, other programmable apparatus or other apparatus to produce a computer-implemented process, such that the instructions, which execute on the computer or other programmable apparatus, provide a process for implementing the function / action specified in one or more boxes of a flowchart and / or block diagram.

[0037] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of devices, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code, comprising one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative embodiments, the functions marked in the blocks may occur in a non-linear order. For example, two blocks shown consecutively may actually be executed substantially simultaneously, or these blocks may sometimes be executed in reverse order, depending on the functions involved. It will also be noted that each block illustrated in the block diagrams and / or flowcharts, and combinations of the various blocks illustrated in the block diagrams and / or flowcharts, may be implemented by a system based on dedicated hardware or a combination of dedicated hardware and computer instructions that performs the specified function or action. Attached Figure Description

[0038] These and other aspects of the invention will be apparent and further illustrated by way of example and with reference to the accompanying drawings, in which:

[0039] Figure 1 This is a block diagram of the first embodiment of the system;

[0040] Figure 2 Depicting the use Figure 1 An example of the space of the system;

[0041] Figure 3 An example of a connection established in entertainment mode is shown;

[0042] Figure 4 This is a block diagram of the second embodiment of the system;

[0043] Figure 5 This is a flowchart of the first embodiment of the method;

[0044] Figure 6This is a flowchart of the second embodiment of the method;

[0045] Figure 7 It shows Figure 2 Representation of the distance between the system and lighting equipment in the space;

[0046] Figure 8 It shows Figure 2 The representation of the distances between various lighting devices in a space;

[0047] Figure 9 This is a flowchart of the third embodiment of the method; and

[0048] Figure 10 This is a block diagram of an exemplary data processing system for performing the methods of the present invention.

[0049] Corresponding elements in the accompanying drawings are indicated by the same reference numerals. Detailed Implementation

[0050] Figure 1 A first embodiment of a system for controlling multiple lighting devices included in an entertainment group is shown: System 1. The multiple lighting devices, including lighting devices 31-34, are controlled by System 1 in entertainment mode to present dynamic lighting effects corresponding to audio and / or video content being presented on a media presentation device (e.g., a television). Figure 1 In this example, audio and / or video content is presented on media presentation device 46. Alternatively, audio and / or video content may be presented on multiple media presentation devices (e.g., a video wall).

[0051] exist Figure 1 In one embodiment, system 1 includes an HDMI module 11 and a bridge 21. The HDMI module 11 may be, for example, a tone playback HDMI sync box. The bridge 21 may be, for example, a tone bridge. The HDMI module 11 can control lighting devices 31-34 via the bridge 21, and can directly control lighting devices 31-32 using a first communication protocol (e.g., Bluetooth). The bridge 21 communicates with lighting devices 31-34 using a second communication protocol (e.g., Zigbee).

[0052] Bridge 21 can communicate with other lighting devices (not shown) not in the entertainment group. Bridge 21 can communicate directly with lighting devices in the entertainment group (i.e., lighting devices 31-34) or via other (lighting) devices (e.g., using Zigbee). For lighting devices within a single hop distance from bridge 21, unicast (without hopping) and interPAN communication can be used, for example. For devices further away, unicast communication (with hopping) can be used, for example. For all lighting devices, multicast / multi-cast and broadcast communication can be used, for example.

[0053] HDMI module 11 connects to wireless LAN access point 41, for example, via Wi-Fi. Bridge 21 also connects to wireless LAN access point 41, for example, via Wi-Fi or Ethernet. Figure 1 In this example, HDMI module 11 communicates with bridge 21 via Wi-Fi, for example, through wireless LAN access point 41. Alternatively or additionally, HDMI module 11 may communicate directly with bridge 21, for example, using Zigbee, Bluetooth, or Wi-Fi technology, and / or may communicate with bridge 21 via the Internet / cloud. Wireless LAN access point 41 is connected to the Internet 48. Media server 49 is also connected to the Internet 48. Media server 49 may be a server for a video-on-demand service, such as Netflix, Amazon Prime Video, Hulu, Disney+, or Apple TV+.

[0054] HDMI module 11 is connected via HDMI to media presentation device 46 and local media receivers 43 and 44. Local media receivers 43 and 44 may include one or more streaming or content generating devices, such as Apple TV, Microsoft's Xbox I, and / or Sony's PlayStation 4, and / or one or more cable or satellite TV receivers. Each of local media receivers 43 and 44 may be able to receive content from media server 49 and / or from a media server in the home network.

[0055] HDMI module 11 includes receiver 13, transmitter 14, processor 15, and memory 17. Bridge 21 includes receiver 23, transmitter 24, processor 25, and memory 27. Processor 15 and / or processor 25 are configured to: identify multiple lighting devices, namely lighting devices 31-34, included in the entertainment group via receiver 13 and / or receiver 23; and assign a first subset (e.g., lighting devices 31 and 32) of lighting devices 31-34 to a first group and a second subset (e.g., lighting devices 33 and 34) of lighting devices 31-34 to a second group according to one or more grouping criteria.

[0056] For example, during commissioning, bridge 21 can notify HDMI module 11 of lighting device attributes important to the group, and processor 15 of HDMI module 11 can assign lighting devices to (sub)groups. A first subset of lighting devices does not completely overlap with a second subset of lighting devices. In an alternative embodiment, the assignment of lighting devices to groups is performed elsewhere (e.g., in an app or in the cloud).

[0057] exist Figure 1In the example, lighting devices 33 and 34 do not support the first communication protocol and are therefore assigned to the second group. Lighting devices 31 and 32 can each be assigned to either the first or the second group. If the first communication protocol is Bluetooth, then the second communication protocol is Zigbee, and multiple lighting devices 31-34 have already been assigned to a single Zigbee group, preferably, these multiple lighting devices are assigned to the second group. For example, if lighting devices 32 and 33 are assigned to a single Zigbee group, then lighting devices 32-34 can be assigned to the second group.

[0058] Processor 15 is configured to control a first set of lighting devices via transmitter 14 using a first communication protocol to present a first subset of dynamic light effects in entertainment mode. Processors 15 and 25 are configured to control a second set of lighting devices via transmitters 14 and 24 using a second communication protocol to present a second subset of dynamic light effects in entertainment mode. Therefore, the second set of lighting devices is controlled via bridge 21.

[0059] For example, the processor 15 of the HDMI module 11 can transmit the color values ​​of the lighting devices controlled via a second communication protocol (e.g., Zigbee) and a list of lighting devices directly controlled by the HDMI module 11 (using the first communication protocol) to the bridge 21. The HDMI module 11 then transmits the color values ​​of the lighting devices controlled via the first communication protocol (e.g., Bluetooth) to these subsequent lighting devices themselves.

[0060] One or more of the following grouping criteria can be used.

[0061] Distance between system components and lighting devices: For example, in the case of Zigbee, it can be considered whether the lighting device is directly accessible or requires a hop via another Zigbee device. If the desired amount of dropped commands exceeds a threshold due to the distance between the system components and the lighting devices, making the large distance noticeable to the user, then another system component / group may be preferred. Lighting devices can be grouped based on their proximity to bridge 21 and HDMI module 11.

[0062] The capabilities of the lighting devices: For example, one can consider whether the lighting devices are capable of Bluetooth communication. Furthermore, if the pixelated light strip is modeled as multiple lighting devices, all of these devices are preferably assigned to a single group and not separated between the two groups (for transmission efficiency and effect synchronization). Some lighting devices are capable of having "richer" light effects, which can only be triggered via Bluetooth, but not via Zigbee, and are therefore preferably assigned to a Bluetooth group. If the lighting devices are Bluetooth (e.g., BLE) reachable, but too far from the HDMI module 11 to be reachable, these lighting devices may need to be controlled via Zigbee through bridge 21.

[0063] Relative Position of Lighting Devices: If a communication protocol is faster than others (i.e., its communication and processing steps have a lower total latency), then lighting devices expected to produce faster light effects (e.g., lighting devices near a television screen) can be assigned to the group using the faster communication protocol. Furthermore, if the system cannot use two different communication protocols (e.g., Zigbee and Bluetooth) to synchronize the presentation of transmitted light effects, it is preferable to assign lighting devices positioned adjacent to each other (or perceived as adjacent from the user's viewpoint) to a group to avoid visible mismatches in the presentation of effects.

[0064] The network interferes with or is used in different parts of the space where the lighting equipment is located.

[0065] The processor 25 is configured to control the lighting devices (i.e., lighting devices 31-34) of a first subset and a second subset via a second communication protocol when the entertainment mode is inactive. In an alternative embodiment, the bridge 25 may control some of the lighting devices via the HDMI module 11 even when the entertainment mode is inactive.

[0066] The allocation to one group or another can be dynamic and changes based on the light effect being presented and the required synchronization (i.e., how the light effect is synchronized across the various lighting devices). Lighting devices that require synchronization are preferably included in the same group. If one group uses a communication protocol with a lower latency than the other group, that group can be used to present "fast" effects, such as explosions, and the other group can be used for effects with lower time sensitivity.

[0067] When the second communication protocol is the default or preferred protocol (e.g., Zigbee for hue systems), lighting devices already assigned to that group (the group using the first communication protocol (e.g., Bluetooth)) can still be notified via the second communication protocol already assigned to the first group. Alternatively or additionally, for example, where the second communication protocol is more secure, triggers can be sent to these lighting devices for synchronized light effect activation using the second communication protocol, and / or credentials can be transmitted to these lighting devices using the second communication protocol, which allows these lighting devices to display dynamic light effects transmitted using the first communication protocol.

[0068] exist Figure 1 In one embodiment, bridge 21 supports only the second communication protocol (e.g., Zigbee). In an alternative embodiment, bridge 21 also supports the first communication protocol (e.g., Bluetooth). In this alternative embodiment, three groups can be created: a group having one or more lighting devices controlled by bridge 21 using the first communication protocol; a group having one or more lighting devices controlled by bridge 21 using the second communication protocol; and a group having one or more lighting devices controlled by HDMI module 11 using the first communication protocol.

[0069] exist Figure 1 In the embodiment of the HDMI module 11 shown, the HDMI module 11 includes a processor 15. In alternative embodiments, the HDMI module 11 includes multiple processors. The processor 15 of the HDMI module 11 may be a general-purpose processor, such as an ARM-based processor or a dedicated processor. The processor 15 of the HDMI module 11 may run an operating system, such as a Unix-based operating system. The memory 17 may include one or more memory cells. For example, the memory 17 may include solid-state memory.

[0070] For example, receiver 13 and transmitter 14 can use one or more wired or wireless communication technologies (such as Wi-Fi) to communicate with wireless LAN access point 41 and HDMI to communicate with media presentation device 46 and local media receivers 43 and 44. In alternative embodiments, multiple receivers and / or multiple transmitters are used instead of a single receiver and a single transmitter. Figure 1 In the embodiment shown, a separate receiver and a separate transmitter are used. In an alternative embodiment, receiver 13 and transmitter 14 are combined into a transceiver. HDMI module 11 may include other components typically used in consumer electronics devices, such as power connectors. The invention can be implemented using a computer program running on one or more processors.

[0071] exist Figure 1In the embodiment of bridge 21 shown, bridge 21 includes a processor 25. In alternative embodiments, bridge 21 includes multiple processors. The processor 25 of bridge 21 may be a general-purpose processor, such as an ARM-based processor or a dedicated processor. For example, the processor 25 of bridge 21 may run a Unix-based operating system. Memory 27 may include one or more memory cells. For example, memory 27 may include one or more hard disks and / or solid-state storage. For example, memory 27 may be used to store tables of connected lights.

[0072] For example, receiver 23 and transmitter 24 may use one or more wired or wireless communication technologies (such as Zigbee) to communicate with lighting devices 31-34 and Ethernet, thereby communicating with wireless LAN access point 41. In alternative embodiments, multiple receivers and / or multiple transmitters are used instead of a single receiver and a single transmitter. Figure 1 In the illustrated embodiment, a separate receiver and a separate transmitter are used. In an alternative embodiment, receiver 23 and transmitter 24 are combined into a transceiver. Bridge 21 may include other components typically used in network devices, such as power connectors. The invention can be implemented using a computer program running on one or more processors.

[0073] exist Figure 1 In one embodiment, the system of the present invention includes an HDMI module and a bridge. In an alternative embodiment, the system may include another type of device, such as a mobile device or a local media receiver (e.g., Apple TV or Amazon's Fire TV media player), without an HDMI module, or include the other type of device described above in addition to an HDMI module. If the system is a mobile device, the system may communicate with the media presentation device 46, for example, via HDMI, MHL, or a wireless connection. Figure 1 In one embodiment, the system of the present invention includes multiple devices. In an alternative embodiment, the system includes a single device.

[0074] exist Figure 1 In one embodiment, the system of the present invention includes only local devices. In an alternative embodiment, the system of the present invention includes one or more Internet / cloud servers. For example, if the lighting effect is determined from a light script, all processing including assigning lighting devices to groups can be performed in the cloud, and the light commands can then be streamed to the lighting devices, for example via an Internet / cloud server, such streaming being achieved via one or more intermediate devices (such as bridges), local media receivers (e.g., Apple TV or Amazon Fire TV media players), HDMI modules, Internet routers, or smart speakers (which may communicate with the lighting devices, for example, via Bluetooth).

[0075] If the light commands are streamed via multiple intermediate devices, they may not even be aware of each other's roles in the presentation of the light effects, because the cloud system can connect to the two devices separately and stream two separate sets of light commands: one set for the intermediate device (which communicates with the lighting device using a first communication protocol); and another set for the other intermediate device (which communicates with the lighting device using a second communication protocol).

[0076] Figure 2 Describing the use of Figure 1 An example of a spatial system. The floor 61 of the home includes a hallway 63, a kitchen 64, and a living room 65. Lighting fixtures 31-33 are installed in the living room 65, and lighting fixture 34 is installed in the (open) kitchen 64. Lighting fixture 33 is installed above the dining table. Lighting fixtures 31 and 32 are installed to the left and right of a media presentation device 46, which may be, for example, a television.

[0077] Wireless LAN access point 41 is installed in hallway 63, HDMI module 11 is installed next to media presentation device 46 in living room 65, and bridge 21 is installed in living room 65 near wireless LAN access point 41a. Person 69 is watching television. Lighting devices 31-34 are part of the entertainment system and are controlled to present light effects corresponding to the audio and / or video content displayed on media presentation device 46. Lighting devices 31 and 32 are in the direct field of vision of person 69. Although lighting devices 33 and 34 are not in the direct field of vision of person 69, person 69 can see at least a portion of the lighting effects presented by lighting devices 33 and 34.

[0078] Figure 3 An example of a connection established in entertainment mode is shown. In this example, HDMI module 11 directly controls lighting devices 31 and 32 via Bluetooth, and controls lighting devices 33 and 34 via bridge 21. To control lighting devices 33 and 34, HDMI module 11 transmits commands to bridge 21 using Wi-Fi. Bridge 21 then sends further commands to lighting devices 33 and 34 using Zigbee based on these commands.

[0079] Optionally, the HDMI module 11 can also send commands to the lighting devices 31 and 32 via the bridge 21 to synchronize the presentation of dynamic lighting effects across all four lighting devices. For example, the lighting devices 31 and 32 can be included in a Zigbee group, and the HDMI module 11 can send trigger commands to that Zigbee group via the bridge 21. These trigger commands will use Bluetooth to enable the lighting devices 31 and 32 to present the dynamic lighting effects previously received from the HDMI module 11. This can be advantageous if synchronized lighting effect presentation is more important than low-latency lighting effect presentation.

[0080] Figure 4 A second embodiment of a system for controlling multiple lighting devices included in an entertainment group is shown: a light controller 81. Figure 4 In this embodiment, the light controller 81 combines the functionality of the HDMI module with that of the bridge. The light controller 81 can control each of the lighting devices 31-34 via a first communication protocol (e.g., Bluetooth) and / or via a second communication protocol (e.g., Zigbee). The light controller 81 is connected to a wireless LAN access point 41, for example, via Wi-Fi or Ethernet.

[0081] The light controller 81 includes a receiver 83, a transmitter 84, a processor 85, and a memory 87. The processor 85 is configured to: identify multiple lighting devices (i.e., lighting devices 31-34) included in an entertainment group via the receiver 83; and, according to one or more grouping criteria, assign a first subset of lighting devices 31-34 (e.g., lighting devices 31 and 32) to a first group and assign a second subset of lighting devices 31-34 (e.g., lighting devices 33 and 34) to a second group. The first subset of lighting devices does not completely overlap with the second subset of lighting devices.

[0082] The processor 85 is configured to control a first set of lighting devices via transmitter 84 using a first communication protocol to present a first subset of dynamic light effects in entertainment mode, and to control a second set of lighting devices via transmitter 84 using a second communication protocol to present a second subset of dynamic light effects in entertainment mode.

[0083] exist Figure 4 In the illustrated embodiment of the optical controller 81, the optical controller 81 includes a processor 85. In alternative embodiments, the optical controller 81 includes multiple processors. The processor 85 of the optical controller 81 may be a general-purpose processor, such as an ARM-based processor or a dedicated processor. The processor 85 of the optical controller 81 may run an operating system such as Unix. The memory 87 may include one or more memory cells. For example, the memory 87 may include solid-state memory.

[0084] For example, receiver 83 and transmitter 84 may use one or more wired or wireless communication technologies (such as Wi-Fi or Ethernet) to communicate with wireless LAN access point 41 and HDMI, thereby communicating with media presentation device 46 and local media receivers 43 and 44. In alternative embodiments, multiple receivers and / or multiple transmitters are used instead of a single receiver and a single transmitter. Figure 4 In the embodiment shown, a separate receiver and a separate transmitter are used. In an alternative embodiment, receiver 83 and transmitter 84 are combined into a transceiver. Optical controller 81 may include other components typically used in optical controllers, such as power connectors. This invention can be implemented using a computer program running on one or more processors.

[0085] exist Figure 5 The image illustrates a first embodiment of a method for controlling multiple lighting devices included in an entertainment group. In entertainment mode, the multiple lighting devices are controlled to present dynamic lighting effects corresponding to audio and / or video content being presented on a media presentation device.

[0086] Step 101 involves identifying multiple lighting devices included in the entertainment group. For example, step 101 can be performed when entertainment mode is activated. Figure 5 In this embodiment, two different communication protocols can be used to control the lighting devices. Lighting devices controlled using a first communication protocol are assigned to a first group. Lighting devices controlled using a second communication protocol are assigned to a second group. For example, the first communication protocol could be Bluetooth, and the second communication protocol could be Zigbee.

[0087] exist Figure 5 In one embodiment, the first group may include at most a first number of multiple lighting devices, and the first communication protocol and / or the spectrum used by the first communication protocol is more suitable for transmitting dynamic light effects than the second communication protocol and / or the spectrum used by the second communication protocol.

[0088] The suitability of a communication protocol for delivering dynamic light effects depends typically on the busyness of the RF channel at the expected streaming moment, which can affect Wi-Fi, Zigbee, and Bluetooth communications by varying degrees. The maximum or preferred number of devices in the first and / or second group can be based on the actual or expected capacity of the RF channel. Furthermore, a communication protocol with higher bandwidth, better synchronization control, and / or lower latency can be considered more suitable for delivering dynamic light effects. As a first example, Zigbee unicast with hopping is required to reach more distant lighting devices, which increases latency. In this case, Bluetooth is preferred if the lighting devices are within range. As a second example, BLE is point-to-point and cannot perform synchronized control of multiple lighting devices, while Zigbee can. Other aspects of the communication protocol may also exist that make it more suitable for delivering dynamic light effects.

[0089] When determining which group is preferred, one or more factors besides the communication protocol can also be considered. An example of such a factor is the distance between the system (component) and the lighting equipment. For instance, a tone bridge might be located far from the lighting equipment, giving the possibility that some commands might be dropped during streaming, thus impacting the user experience, while the HDMI module might be located closer to the TV and therefore closer to the lighting equipment as part of the entertainment group—that is, for the entertainment experience. In this case, the Bluetooth group might be preferred because the HDMI module uses Bluetooth to communicate with the lighting equipment.

[0090] The number of devices that can be assigned to a Bluetooth group can be limited to a maximum value, as the Bluetooth specification stipulates that seven is the maximum number of Bluetooth devices that can connect simultaneously. In practice, devices typically use the lower maximum number of Bluetooth devices that can connect at the same time.

[0091] However, to circumvent the maximum number of simultaneous Bluetooth connections, Bluetooth Low Energy (BLE) ads or similar messages can be used, where the light command is within the body of the ad (newer BLE versions expand the available space within the ad for this). In this case, it may not be necessary to limit the size of the Bluetooth group.

[0092] Alternatively or additionally, the number of devices that can be assigned to a Zigbee group can be limited to a maximum value. For example, Tone Entertainment currently supports up to 10 addressable Zigbee light sources in an Entertainment group. Due to the constant flow of dynamic lighting effects in Entertainment mode, supporting more than ten Zigbee lighting devices, or more than ten groups of Zigbee lighting devices with the same performance, may cause performance issues.

[0093] Next, step 111 includes determining which communication protocols(s) each lighting device supports. Then, step 112 includes determining whether to split the entertainment group into subgroups by determining whether the number of lighting devices identified in step 101 exceeds a first number, and by determining whether one or more lighting devices do not support the first communication protocol based on the determination in step 111.

[0094] If it is determined in step 112 that the number of identified lighting devices does not exceed a first number, and all lighting devices support the first communication protocol, then step 113 is executed. In step 113, all lighting devices identified in step 101 are assigned to the first group.

[0095] If not, then step 103 is performed after step 112. Step 103 includes assigning a first subset of the multiple lighting devices to a first group according to one or more grouping criteria, and assigning a second subset of the multiple lighting devices to a second group. The first subset of lighting devices does not completely overlap with the second subset of lighting devices. Figure 5 In one embodiment, lighting devices that do not support the first communication protocol (and do not support the second communication protocol) are first assigned to the second group. If the number of lighting devices that support the first communication protocol does not exceed a first quantity, all of these lighting devices can be assigned to the first group.

[0096] Alternatively, a second grouping standard can be applied, and this may result in only some lighting devices supporting the first communication protocol being assigned to the first group, even if the first group is not fully populated. In any case, lighting devices assigned to the second group support the second communication protocol.

[0097] Step 115 is performed after step 103 or step 113. Step 115 includes determining a set of dynamic lighting effects, for example, based on analysis of audio and / or video content or based on a light script. This set of dynamic lighting effects includes the dynamic lighting effects for each lighting fixture. Figure 5 In one embodiment, step 115 includes analyzing screen or audio content to extract features important for generating light effects, and generating light effects based on these features (e.g., using an algorithm implemented in a tone synchronization application).

[0098] Next, steps 105 and 117 are performed in parallel, at least partially. In an alternative embodiment, step 117 is performed before or after step 105, whereby step 105 includes controlling a first group of lighting devices using a first communication protocol to present a first subset of dynamic lighting effects in entertainment mode. This first subset of dynamic lighting effects includes dynamic lighting effects determined for the lighting devices in the first group.

[0099] Step 117 includes determining whether the second group includes at least one lighting device. If not, step 115 is repeated after step 105 has been performed. If yes, step 107 is performed. Step 107 includes controlling the second group of lighting devices using a second communication protocol to present a second subset of dynamic lighting effects in entertainment mode. This second subset of dynamic lighting effects includes dynamic lighting effects determined for the lighting devices in the second group.

[0100] In steps 105 and 107, light commands are transmitted from the system or the corresponding system component to the assigned group of lighting devices. If the difference in latency is more significant than a lower latency, the commands can be synchronized so that the lighting devices receive and process the commands simultaneously, unless the two groups present different types of effects (which requires different levels of synchronization with the content, such as specific effects relative to the atmosphere). Step 115 is repeated after steps 105 and 107 have been performed, and the method then proceeds as follows. Figure 5 The next set of dynamic lighting effects will then be shown.

[0101] exist Figure 6 The illustration shows a second embodiment of a method for controlling multiple lighting devices included in an entertainment group, wherein the multiple lighting devices are controlled in an entertainment mode to present dynamic light effects corresponding to audio and / or video content being presented on a media presentation device. Figure 6 The embodiment is Figure 5 An extension of the embodiments.

[0102] exist Figure 6 In one embodiment, if step 112 determines that the number of lighting devices identified in step 101 exceeds a first number, or one or more lighting devices do not support the first communication protocol, then step 131 is executed. Step 131 includes determining the type of audio and / or video content. Next, step 133 includes selecting one or more grouping criteria from a set of grouping criteria. Figure 6 In this embodiment, the grouping criteria are:

[0103] One or more communication protocols supported by the lighting equipment;

[0104] The distance between the lighting equipment and the system (the system as a whole, or a specific component);

[0105] The distance between one lighting device and other lighting devices;

[0106] The difference between the dynamic light effect to be presented by one lighting device and the dynamic light effect to be presented by other lighting devices.

[0107] In step 133, one or more of the grouping criteria can be selected based on the type of audio and / or video content determined in step 131. For example, if the content being reproduced on the media presentation device is an action movie (i.e., very dynamic), the determined lighting effects will also be very dynamic, and low latency and low variation will therefore be important. In this case, one or more of criteria a) and criteria bd) can be selected. For example, if the content is not very dynamic, only criterion a) can be selected. Depending on which grouping criteria(s) have been selected, one or more of steps 135, 137, and 139 can then be performed.

[0108] Step 135 includes determining the distance between the system and each of the plurality of lighting devices. This distance can be determined by determining the number of hops between the system and each of the plurality of lighting devices and / or based on the signal quality (e.g., RSSI) of the signals received by the system from the lighting devices. Step 137 includes determining the distance between each lighting device and each other lighting device.

[0109] Step 139 includes determining the differences between the various dynamic lighting effects before the content is presented on the media presentation device. For example, step 139 can be performed if the dynamic lighting effects are determined by a lighting script, rather than based on real-time analysis of the audio and / or video content. For example, the script may be streamed or pre-loaded into the bridge and / or HDMI module.

[0110] Next, step 103 includes assigning a first subset of the multiple lighting devices to a first group and a second subset of the multiple lighting devices to a second group according to one or more selected grouping criteria. For example, if the content being reproduced on the media presentation device is an action movie, the lighting devices can first be grouped based on whether they support a first communication protocol (criteria a), and if the number of lighting devices supporting the first communication protocol exceeds a maximum value (i.e., a first number), then grouping criteria b), c), or d) can then be applied.

[0111] For example, if the content is not very dynamic, lighting devices can be grouped based on whether they support a first communication protocol (Standard a), and then lighting devices that support both the first and second communication protocols can be arbitrarily assigned to one of the two groups.

[0112] exist Figure 6 In this embodiment, step 103 is implemented by step 141. If criterion b) is selected in step 133 and step 135 is performed, then in step 141, lighting devices supporting both the first and second communication protocols are assigned to the first and second groups based on the distance between the system and each of the plurality of lighting devices, as determined in step 135.

[0113] Figure 7 It shows Figure 2 The representation of the distance between lighting fixtures and systems in a space. Figure 7 In the example, distance is the shortest distance between the system and each lighting device, measured, for example, in meters. Figure 7 In the example, the system includes two components: HDMI module 11 and bridge 21, so the distance between each component of the system and each lighting device is represented.

[0114] exist Figure 7 In the example, HDMI module 11 uses a first communication protocol to control the lighting device, and bridge 21 uses a second communication protocol to control the lighting device. Therefore, each system component corresponds to a set. Figure 7 One method for assigning lighting fixtures 31-34 to a group is to assign each lighting fixture to the nearest system component.

[0115] exist Figure 7 In the example, the distances 201-204 between HDMI module 11 and lighting devices 31-34 are 0.3m, 2.9m, 5.9m, and 4.9m, respectively, and the distances 206-209 between bridge 21 and lighting devices 31-34 are 4.9m, 8m, 4.2m, and 2.5m, respectively. If lighting devices 31-34 all support both communication protocols, then lighting devices 31 and 32 will be assigned to HDMI module 11 and thus to the first group, and lighting devices 33 and 34 will be assigned to bridge 21 and thus to the second group.

[0116] If criterion c) is selected in step 133 and step 137 is performed, then in step 141, based on the distance determined in step 137, lighting devices supporting both the first and second communication protocols are assigned to a first group and a second group, such that the first group includes only lighting devices whose distance from at least one other lighting device in the first group does not exceed a threshold, and the second group includes only lighting devices whose distance from any one of the lighting devices in the first group exceeds the threshold.

[0117] Figure 8 It shows Figure 2 The distance between various lighting fixtures in a space. Figure 8 In the example, distance is the shortest distance between each lighting device and every other lighting device, measured in meters, for example. If lighting devices 31-34 all support both communication protocols, then lighting devices 31, 32, and 34 will be assigned to one group, and lighting device 33 will be assigned to the other group.

[0118] exist Figure 8 In the example, the threshold is not predetermined and a threshold between 4.3m and 6.1m is used. The distances between lighting device 31 and lighting devices 32, 33, and 34 (i.e., distances 225, 224, and 221) are 4.3m, 6.1m, and 3.6m, respectively. The distances between lighting device 32 and lighting devices 31, 33, and 34 (i.e., distances 225, 226, and 222) are 4.3m, 6.1m, and 8.1m, respectively. The distances between lighting device 33 and lighting devices 31, 32, and 34 (i.e., distances 224, 226, and 223) are 6.1m, 6.1m, and 6.4m, respectively. The distances between lighting device 34 and lighting devices 31, 32, and 33 (i.e., distances 221, 222, and 223) are 3.6m, 8.1m, and 6.4m, respectively. The shortest distance between lighting device 33 and any one of lighting devices 31, 32 and 34 is 6.1 meters, while the distance 225 between lighting devices 31 and 32 is 4.3 meters, and the distance 221 between lighting devices 31 and 34 is 3.6 meters.

[0119] If standard d) is selected in step 133 and step 139 is performed, then in step 141, lighting devices that support both the first and second communication protocols and present similar dynamic light effects (as determined in step 139) are assigned to the same group. Figure 6 Other steps indicated in the text are related to... Figure 5 The description is the same.

[0120] exist Figure 7 and Figure 8 In the example, physical distances have been determined and used to group the lighting devices. However, it is preferable to determine distances based on signal quality, since throughput and latency typically depend more on signal quality than on physical distance, and signal quality may not be proportional to distance (e.g., due to walls).

[0121] exist Figure 9 A third embodiment of a method for controlling multiple lighting devices included in an entertainment group is shown, wherein in an entertainment mode, the multiple lighting devices are controlled to present dynamic light effects corresponding to audio and / or video content being presented on a media presentation device. Figure 9 The embodiment is Figure 5 An extension of the embodiments.

[0122] exist Figure 9 In one embodiment, if it is determined in step 112 that the number of lighting devices identified in step 101 exceeds a first number, or one or more lighting devices do not support the first communication protocol, then step 151 is executed.

[0123] Step 151 includes determining the differences between dynamic lighting effects when the content is presented on a media presentation device. For example, it can be determined what degree of dynamic and synchronization differences are required for the presented effects. For example, if the dynamic lighting effects are determined based on real-time analysis of the audio and / or video content, step 151 can be performed.

[0124] Step 103 is performed after step 151, and step 103 includes assigning a first subset of the plurality of lighting devices to a first group and assigning a second subset of the plurality of lighting devices to a second group according to one or more selected grouping criteria. Figure 9 In this embodiment, step 103 is implemented by step 153. In step 153, the lighting devices that exhibit similar dynamic light effects, as determined in step 151, are assigned to the same group.

[0125] After performing step 107, step 151 is repeated. Therefore, when the entertainment mode is active, one or more lighting devices can be reassigned from the first group to the second group or vice versa. To achieve this, all lighting devices in the entertainment group can be categorized into three static subgroups: 1) lighting devices that should be controlled using only the first communication protocol (e.g., due to various reasons such as lack of support for the second communication protocol or being too far from devices using the second communication protocol); 2) lighting devices that are controlled using only the second communication protocol; and 3) lighting devices that can be controlled using both communication protocols, for example, if each communication protocol is used by different devices, then the lighting devices are controlled by two devices. In this embodiment, step 151 includes dynamically assigning a third static subgroup to two dynamic subgroups based on the type of light effect to be presented.

[0126] If the lighting effects are determined based on a light script, the following steps can be performed beforehand: Lighting fixtures are redistributed into two groups according to the type of lighting effect to be presented, because the script describes all lighting effects and when to present them. This has already been combined with... Figure 6 Step 139 is described.

[0127] Figure 9 Other steps indicated in the text are related to... Figure 5 The description is the same, therefore, in Figure 9 In this embodiment, the allocation of lighting devices to groups is dynamic and is based on the type of light effect to be presented.

[0128] exist Figure 5 , Figure 6 and Figure 9In one embodiment, the two groups do not overlap at all. In an alternative embodiment, the two groups partially overlap, and for each lighting device in the two groups, the system determines on the fly which group to use to control that lighting device. For example, if Figure 1 The lighting device 32 is divided into two groups. The lighting device 32 can be controlled via group 1 (by HDMI module 11) for game content / mode control and via group 2 (by bridge 21) for audio content / mode control. Alternatively, the lighting device 32 can be controlled via group 1 or group 2 depending on the busy level of the RF channel at a given time.

[0129] This is generally faster and / or more flexible than having to reassign nodes from one group to another, and it is also advantageous if certain useful dedicated commands are only available via one of the communication protocols. For example, if BLE has dedicated commands for simulating explosions and this is not available on Zigbee, it is advantageous to send those explosion commands via BLE, even for other entertainment light controls of the same lighting equipment, rather than via Zigbee.

[0130] In the latter example, lighting devices can also be temporarily reassigned to Zigbee groups, but very frequent reassignments may cause interruptions in the light command flow, resulting in interruptions or longer periods without new lighting effects.

[0131] exist Figure 5 , Figure 6 and Figure 9 In one embodiment, one or more of the multiple lighting devices support only a second communication protocol, such as Zigbee, while the other lighting devices support both a first and a second communication protocol (e.g., Bluetooth and Zigbee). In an alternative embodiment, all lighting devices support both the first and second communication protocols, and step 111 is omitted. In this alternative embodiment, step 112 only needs to include determining whether the number of lighting devices identified in step 101 exceeds a first number. Figure 5 In embodiments 6 and 9, only two (main) groups are used. In alternative embodiments, more than two (main) groups are used.

[0132] Figure 10 The drawn block diagram illustrates what can be performed as shown in the reference. Figure 5 An exemplary data processing system of the methods described in 6 and 9.

[0133] like Figure 10As shown, the data processing system 300 may include at least one processor 302 coupled to a memory element 304 via a system bus 306, thus allowing the data processing system to store program code within the memory element 304. Furthermore, the processor 302 may execute program code accessed from the memory element 304 via the system bus 306. On one hand, the data processing system may be implemented as a computer suitable for storing and / or executing program code. However, it should be understood that the data processing system 300 may be implemented in the form of any system including a processor and memory capable of performing the functions described herein.

[0134] Memory element 304 may include one or more physical memory devices, such as local memory 308 and one or more mass storage devices 3109. Local memory may refer to random access memory or other non-persistent memory devices typically used during the actual execution of program code. Mass storage devices may be implemented as hard disk drives or other persistent data storage devices. Processing system 300 may also include one or more cache memories (not shown) that provide temporary storage for at least some program code to reduce the number of times program code must be retrieved from mass storage device 310 during execution. For example, if processing system 300 is part of a cloud computing platform, processing system 300 may also be able to use memory elements of another processing system.

[0135] The input / output (I / O) devices, depicted as input device 312 and output device 314, may optionally be coupled to a data processing system. Examples of input devices may include, but are not limited to, a keyboard, a pointing device such as a mouse, a microphone (e.g., for voice and / or speech recognition), etc. Examples of output devices may include, but are not limited to, a monitor or display, a speaker, etc. Input and / or output devices may be coupled to the data processing system directly or via an intermediate I / O controller.

[0136] In one embodiment, the input device and the output device can be implemented as a combined input / output device (in... Figure 10 (Seen in the middle with dashed lines surrounding input device 312 and output device 314). An example of such a combined device is a touch-sensitive display, sometimes referred to as a "touchscreen display" or simply a "touchscreen". In such embodiments, input to the device can be provided by the movement of a physical object on or near the touchscreen display, such as a stylus or a user's finger.

[0137] Network adapter 316 can also be coupled to the data processing system to enable it to couple to other systems, computer systems, remote network devices, and / or remote storage devices via an intermediate private or public network. The network adapter may include: a data receiver for receiving data sent to the data processing system 300 by the systems, devices, and / or networks; and a data transmitter for transmitting data from the data processing system 300 to the systems, devices, and / or networks. Modems, cable modems, and Ethernet cards are examples of different types of network adapters that can be used with the data processing system 300.

[0138] like Figure 10 As shown, memory element 304 can store application program 318. In various embodiments, application program 318 can be stored in local memory 308, one or more mass storage devices 310, or separately from local memory and mass storage devices. It should be understood that data processing system 300 can also execute an operating system that facilitates the execution of application program 318. Figure 10 (Not shown in the image). The application program 318, implemented as executable program code, can be executed by the data processing system 300 (e.g., by the processor 302). In response to the execution of the application program, the data processing system 300 can be configured to perform one or more operational or method steps described herein.

[0139] Various embodiments of the present invention can be implemented as a program product for use with a computer system, wherein the program of the program product defines the functionality of the embodiments (including the methods described herein). In one embodiment, the program may be contained on a variety of non-transitory computer-readable storage media, wherein, as used herein, the expression “non-transitory computer-readable storage media” includes all computer-readable media, with the sole exception being transient propagation signals. In another embodiment, the program may be contained on a variety of transient computer-readable storage media. Exemplary computer-readable storage media include, but are not limited to: (i) non-writable storage media on which information is permanently stored (e.g., read-only storage devices within a computer, such as CD-ROM discs readable by a CD-ROM drive, ROM chips, or any type of solid-state non-volatile semiconductor memory); and (ii) writable storage media on which changeable information is stored (e.g., flash memory, floppy disk drives, or floppy disks within hard disk drives, or any type of solid-state random access semiconductor memory). The computer program may run on the processor 302 described herein.

[0140] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the invention. As used herein, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that, when used in this specification, the terms "comprising" and / or "including" indicate the presence of the stated features, integrals, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components, and / or groups of these items.

[0141] The equivalents or steps of the corresponding structures, materials, actions, and all devices in the following claims, plus functional elements, are intended to include any structure, material, or action (as specifically claimed in the claims) for performing a function in combination with other claimed elements. Descriptions of embodiments of the invention have been set forth for illustrative purposes, but are not intended to be exhaustive or limited to implementations of the disclosed forms. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the invention. The embodiments were chosen and described to best explain the principles of the invention and some practical applications, and to enable others skilled in the art to understand that the invention is used in various embodiments and has various modifications suitable for the particular purpose conceived.

Claims

1. A system (1, 81) for controlling a plurality of lighting devices (31-34) included in an entertainment group, the plurality of lighting devices (31-34) being controlled in an entertainment mode to present dynamic lighting effects corresponding to audio and / or video content being presented on a media presentation device (46), the system (1, 81) comprising: At least one input interface (13, 23, 83); At least one output interface (14, 24, 84). At least one processor (15, 25, 85) is configured as follows: The plurality of lighting devices (31-34) included in the entertainment group are identified via the at least one input interface (13, 23, 83). A first subset of the plurality of lighting devices (31-34) is assigned to a first group and a second subset of the plurality of lighting devices (31-34) is assigned to a second group according to one or more grouping criteria, wherein the first subset and the second subset of the lighting devices do not completely overlap. The first set of lighting devices is controlled via a first communication protocol using at least one output interface (14, 24, 84) to present a first subset of the dynamic light effects in the entertainment mode, and The second group of lighting devices is controlled via a second communication protocol through at least one output interface (14, 24, 84) to present a second subset of the dynamic light effects in the entertainment mode. The at least one processor (15, 25, 85) is configured to determine the distance between the system (1, 81) and each of the plurality of lighting devices (31-34), and to assign the plurality of lighting devices to the group based on the distance.

2. The system (1, 81) according to claim 1, wherein at least one of the first group and the second group has the maximum number of lighting devices that can be allocated to the group.

3. The system (1, 81) according to claim 2, wherein The first group can include up to a first number of the plurality of lighting devices (31-34), the first communication protocol and / or the spectrum used by the first communication protocol is more suitable for delivering dynamic light effects than the second communication protocol and / or the spectrum used by the second communication protocol, and the at least one processor (15, 25, 85) is configured to assign the first number of the plurality of lighting devices (31-34) to the first group.

4. The system (1, 81) of claim 1, wherein the at least one processor (15, 25, 85) is configured to determine the distance by determining the number of hops between the system (1, 81) and each of the plurality of lighting devices (31-34).

5. The system (1, 81) according to claim 1 or 2, wherein, The first subset includes only lighting devices whose distance from at least one other lighting device in the first subset does not exceed a threshold, and the second subset of the lighting devices includes only lighting devices whose distance from any one of the lighting devices in the first subset exceeds the threshold.

6. The system (1, 81) according to claim 1 or 2, wherein the first subset of the lighting devices includes at least one lighting device that does not support the second communication protocol, and / or the second subset of the lighting devices includes at least one lighting device that does not support the first communication protocol.

7. The system (1, 81) according to claim 1 or 2, wherein the second subset of the lighting devices comprises at least two lighting devices that can be controlled by a single command.

8. The system (1, 81) according to claim 1 or 2, wherein the at least one processor (15, 25, 85) is configured to select at least one of the one or more grouping criteria from a set of grouping criteria based on the type of the audio and / or video content.

9. The system (1, 81) according to claim 1 or 2, wherein the at least one processor (15, 25, 85) is configured to: when the entertainment mode is active, reallocate at least one of the lighting devices of the first subset from the first group to the second group, and / or reallocate at least one of the lighting devices of the second subset from the second group to the first group, according to the one or more grouping criteria.

10. The system (1, 81) of claim 1 or 9, wherein the at least one processor (15, 25, 85) is configured to determine differences between the dynamic light effects and to assign the plurality of lighting devices to the group based on the differences.

11. The system (1, 81) according to claim 1 or 2, wherein the at least one processor (15, 25, 85) is configured to control the lighting devices of the first group or the lighting devices of the second group via a bridge.

12. The system (1, 81) according to claim 1 or 2, wherein the at least one processor (15, 25, 85) is configured to control the lighting devices from the first group and the second group via one of the communication protocols when the entertainment mode is inactive.

13. A method for controlling a plurality of lighting devices included in an entertainment group using a control system, the plurality of lighting devices being controlled in an entertainment mode to present dynamic lighting effects corresponding to audio and / or video content being presented on a media presentation device, the method comprising: Identify (101) the plurality of lighting devices included in the entertainment group; Determine the distance between the control system (1, 81) and each of the plurality of lighting devices (31-34); A first subset (103) of the plurality of lighting devices is assigned to a first group according to one or more grouping criteria, and a second subset of the plurality of lighting devices is assigned to a second group, wherein the first subset of the lighting devices and the second subset of the lighting devices do not completely overlap, and wherein the plurality of lighting devices are assigned to the group based on the distance; The first communication protocol is used to control (105) the lighting devices of the first group to present a first subset of the dynamic light effects in the entertainment mode; as well as The second communication protocol is used to control (107) the second set of lighting devices to present a second subset of the dynamic light effects in the entertainment mode.

14. A computer program product that stores at least one software code portion that, when run on a computer system, causes the computer system to perform the method as described in claim 13.

Images