A light control method, system, and electronic device

Abstract

A light control method, system and electronic device. The method is applied to a first device, which is an audio device, and includes: the first device being connected with a second device; the first device being connected with a third device; the second device and the third device both being light devices; in the process of the first device playing audio, the second device is controlled to emit light in a first manner, and the third device is controlled to emit light in a second manner; wherein the first manner and the second manner are different, and when the second device emits light in the first manner, there is a corresponding relationship with a first channel of the audio, and when the third device emits light in the second manner, there is a corresponding relationship with a second channel of the audio, which is different from the first channel. In this way, when the first device plays audio, each light device can flash in different ways to correspond to different channels of the audio, improving the atmosphere.

Description

Technical Field

[0001] This application relates to the field of electronic technology, and in particular to a lighting control method, system, and electronic device. Background Technology

[0002] To attract customers, bars, KTVs and other similar venues typically install a large number of lighting devices to enhance the atmosphere. Moreover, the lights can flash and change in sync with the music (in short: lights move with the music).

[0003] Currently, the common way for lights to move with music is for all the lights to flash in the same way as the music plays. This method is rather monotonous and doesn't provide a good user experience. Summary of the Invention

[0004] The purpose of this application is to provide a lighting control method, system, and electronic device to enhance the experience of lights moving with music.

[0005] In a first aspect, a lighting control method is provided, applied to a first device, the first device being an audio device. The method includes: connecting the first device to a second device; connecting the first device to a third device; both the second device and the third device being lighting devices; during the playback of audio by the first device, controlling the second device to emit light in a first manner and the third device to emit light in a second manner; wherein the first manner and the second manner are different, and when the second device emits light in the first manner, there is a correspondence with the first channel of the audio, and when the third device emits light in the second manner, there is a correspondence with the second channel of the audio, the second channel being different from the first channel.

[0006] In this way, when the first device plays audio, each light device can emit light in different ways, and the light emission mode of each light device corresponds to different audio channels, which enhances the flexibility of the lights moving with the music and also enhances the atmosphere.

[0007] In one possible design, the second device emits light in the first manner, including: the second device performing at least one of the following: flashing at a first frequency, emitting light with a first brightness, emitting light with a first color temperature, and emitting light with a first color; the third device emits light in the second manner, including: the third device performing at least one of the following: flashing at a second frequency, emitting light with a second brightness, emitting light with a second color temperature, and emitting light with a second color.

[0008] In other words, when the first device plays audio, each lighting device has at least one different frequency, brightness, color temperature, or color, and each lighting device emits light in a way that corresponds to a different audio channel, thus enhancing the sense of atmosphere.

[0009] In one possible design, the first channel includes at least one of the following: left channel, left surround, right channel, right surround, and center channel; the second channel includes at least one of the following: left channel, left surround, right channel, right surround, and center channel. It should be noted that the above are examples of channels, and more channels may be included, such as overhead sounds, etc., which are not listed in this application.

[0010] In one possible design, the first audio channel is related to a first positional relationship between the first device and the second device, or to a second positional relationship between the second device and the user, or is set by the user, or is a system default setting; the second audio channel is related to a first positional relationship between the first device and the third device, or to a second positional relationship between the third device and the user, or is set by the user, or is a default setting.

[0011] For example, when the second device is located to the user's left, the first channel is the left channel, and the lighting pattern of the second device corresponds to the left channel. When the third device is located to the user's right, the second channel is the right channel, and the lighting pattern of the third device corresponds to the right channel. Controlling the lighting equipment in this way better reflects the user's actual experience in their current location.

[0012] In one possible design, during the playback of audio by the first device, controlling the second device to emit light in a first manner and the third device to emit light in a second manner includes: the first device determining to start playing the audio at a first moment; the first device sending a first instruction to the second device, the first instruction being used to instruct the second device to emit light in the first manner starting from the first moment; and the first device sending a second instruction to the third device, the second instruction being used to instruct the third device to emit light in the second manner starting from the first moment.

[0013] In other words, the audio playback on the first device is synchronized with the flashing lights on the second and third devices, enhancing the user experience.

[0014] In one possible design, before the first device determines to start playing the audio at a first moment, the method further includes: the first device determining the current moment as a second moment, at which time the audio has not yet been played; the first device determining to start playing the audio at the first moment includes: the first device determining to start playing the audio at the first moment, the first moment being equal to the second moment plus a preset duration, the preset duration being related to a first transmission delay between the first device and the second device, and / or a second transmission delay between the first device and the third device.

[0015] In other words, the current moment is the second moment. The first device will not play music immediately because of the transmission delay. If the music is played immediately, the music and lights will be out of sync. Therefore, the first device waits for a preset time before playing the audio. During this waiting period, it is sufficient to ensure that the second and third devices successfully receive the instructions so that when the first device plays the audio, the second and third devices also start to light up, thus achieving synchronization between the music and the lights.

[0016] In one possible design, the second moment includes the moment when the first device receives the first operation, the first operation being used to instruct the first device to control the second device and the third device to emit light according to the played audio.

[0017] In other words, when the first device receives the first operation, it will not play music immediately, but will wait for a preset time before playing audio. During this waiting period, it is sufficient to ensure that the second and third devices successfully receive the instruction, so that when the first device plays audio, the second and third devices also start to light up, achieving synchronization between music and light.

[0018] In one possible design, the preset duration satisfies at least one of the following: greater than or equal to a first transmission delay between the first device and the second device; greater than or equal to a second transmission delay between the first device and the second device; or greater than or equal to the average or weighted average of the first transmission delay and the second transmission delay.

[0019] In this method, the first device waits for a preset time before playing audio. The preset waiting time is greater than or equal to the first transmission delay, the second transmission delay, or the average of the first and second transmission delays, to ensure that there is enough time for the second and third devices to successfully receive the instructions and achieve synchronization between music and lights.

[0020] In one possible design, the audio includes a first segment and a second segment. During the playback of the audio by the first device, the second device is controlled to emit light in a first manner, and the third device is controlled to emit light in a second manner. This includes: when the first device plays the first segment, the second device is controlled to emit light in the first manner, and the third device emits light in the second manner; wherein, when the second device emits light in the first manner, there is a correspondence with the first channel of the first segment, and when the third device emits light in the second manner, there is a correspondence with the second channel of the first segment; when the first device plays the second segment, the second device is controlled to emit light in a third manner, and the third device emits light in a fourth manner; wherein, when the second device emits light in the third manner, there is a correspondence with the third channel of the second segment, and when the third device emits light in the fourth manner, there is a correspondence with the fifth channel of the second segment.

[0021] In other words, the audio played by the first device includes multiple segments, and the technical solution of this application is applied to each segment separately. For example, the audio includes two segments, a first segment and a second segment. For the first segment, the technical solution of this application is used to determine the first and second channels, corresponding to the first and second light emission methods. The second device emits light using the first light emission method, and the third device emits light using the second light emission method. For the second segment, the technical solution of this application is used to determine the third and fourth channels, corresponding to the third and fourth light emission methods. The second device emits light using the third and fourth light emission methods. That is, when the first device plays different segments of the audio, the light emission method of the second device dynamically changes from the first to the third light emission method, and the light emission method of the third device also dynamically changes from the second to the fourth light emission method. This method is more flexible and diverse. Moreover, the atmosphere of different segments in some songs is different. For example, the opening part is relatively calm and the volume is low, while the climax part has a higher pitch and is more cheerful. Therefore, using the method of processing different segments separately will make the light flashing mode more consistent with the song.

[0022] In one possible design, when the second device emits light in the first manner, it corresponds to the first channel of the audio, including: when the second device emits light in the first manner, at least one of the flashing frequency, color, color temperature, and brightness of the second device corresponds to the first musical characteristic of the first channel; when the third device emits light in the second manner, it corresponds to the second channel of the audio, including: when the third device emits light in the second manner, at least one of the flashing frequency, color, color temperature, and brightness of the third device corresponds to the second musical characteristic of the second channel; wherein, the musical characteristic includes at least one of pitch, tone, and timbre.

[0023] For example, when a speaker (the first device) plays a song, a spotlight in the living room (the second device) emits light in one way, for example, flashing at a frequency of 2 seconds and displaying a yellow color; the chandelier in the living room (the third device) emits light in another way, for example, flashing at a frequency of 3 seconds and displaying a green color. Visually and aurally, the light emission pattern of the spotlight (the second device) corresponds to the first channel (e.g., the left channel) of the song. For example, a user visually perceives the spotlight's flashing frequency as slow and its color as warm, while the melody of the first channel (e.g., changes in pitch, tone, or timbre) is gentle; that is, the spotlight's light emission pattern corresponds to the first channel of the song. Similarly, the chandelier's light emission pattern corresponds to the second channel (e.g., the right channel) of the song. For example, a user might visually perceive the chandelier as having a faster frequency and a cooler color, while the second channel's melody (e.g., changes in pitch, tone, or timbre) is lighter and more lively. In other words, the chandelier's lighting pattern corresponds to the song's second channel. Therefore, when the speaker plays music, each lighting element can emit light in different ways, corresponding to different channels of the music, creating a more atmospheric and artistic effect.

[0024] In one possible design, before controlling the second device to emit light in a first manner and the third device to emit light in a second manner during the process of the first device playing audio, the method further includes: the first device determining the first manner corresponding to the first channel and the second manner corresponding to the second channel based on a first correspondence between the audio channel and the light emission mode.

[0025] In other words, the first device stores a first correspondence between audio channels and light emission methods. Based on this first correspondence, it determines the first light emission method corresponding to the first audio channel and the second light emission method corresponding to the second audio channel. Using this method, when the first device plays a song, it controls each light device to emit light in different light emission methods according to the different audio channels of the song, which improves the flexibility of the lights moving with the music to a certain extent.

[0026] In one possible design, before controlling the second device to emit light in a first manner and the third device to emit light in a second manner during the process of the first device playing audio, the method further includes: the first device determining a first phonological feature of the first channel of the audio and a second phonological feature of the second channel of the audio; the first device determining a first manner corresponding to the first phonological feature and a second manner corresponding to the second phonological feature based on a second correspondence between the phonological feature and the light emission mode.

[0027] In other words, the first device can extract the first rhythmic feature corresponding to the first channel based on the first channel, and the second rhythmic feature corresponding to the second channel based on the second channel. Then, based on the second correspondence between the rhythmic features and the light emission method, it determines the first light emission method corresponding to the first rhythmic feature and the second light emission method corresponding to the second rhythmic feature. For different songs, even if the determined first channel is the same, the extracted first rhythmic features will not be the same. Therefore, based on the second correspondence between the rhythmic features and the light emission method, the determined first light emission method is different. Thus, the light emission method of the second device changes with different songs, resulting in a better user experience. Similarly, for different songs, even if the determined second channel is the same, the extracted second rhythmic features will not be the same. Therefore, based on the second correspondence between the rhythmic features and the light emission method, the determined second light emission method is different. That is, the light emission method of the third device changes with different songs, resulting in a better user experience.

[0028] Secondly, a communication system is also provided, comprising:

[0029] The first device is used to play audio;

[0030] The second and third devices are used to emit light;

[0031] The first device includes a processor, a memory, and one or more programs; the one or more programs are stored in the memory, and the one or more programs include instructions that, when executed by the processor, cause the first device to perform the steps of the method described in the first aspect above.

[0032] Thirdly, an electronic device is also provided, comprising:

[0033] Processor, memory, and one or more programs;

[0034] The one or more programs are stored in the memory, and the one or more programs include instructions that, when executed by the processor, cause the electronic device to perform the steps of the method described in the first aspect above.

[0035] Fourthly, a computer-readable storage medium is also provided for storing a computer program that, when run on a computer, causes the computer to perform the method described in the first aspect above.

[0036] Fifthly, a computer program product is also provided, comprising a computer program that, when run on a computer, causes the computer to perform the steps of the method described in the first aspect above.

[0037] In a sixth aspect, embodiments of this application also provide a chip coupled to a memory in an electronic device, used to call a computer program stored in the memory and execute the technical solution of the first aspect of embodiments of this application. In embodiments of this application, "coupling" means that two components are directly or indirectly combined with each other.

[0038] The beneficial effects of the second to sixth aspects mentioned above are the same as those of the first aspect, and will not be repeated here. Attached Figure Description

[0039] Figure 1 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application;

[0040] Figure 2 This is a schematic diagram illustrating an application scenario provided in one embodiment of this application;

[0041] Figure 3 A schematic flowchart illustrating a lighting control method provided in an embodiment of this application;

[0042] Figure 4 A schematic diagram illustrating the musical characteristics of different audio channels provided in an embodiment of this application;

[0043] Figure 5 A schematic diagram of lighting control provided in an embodiment of this application;

[0044] Figure 6 Another schematic diagram of lighting control provided in an embodiment of this application;

[0045] Figure 7 Another schematic diagram of lighting control provided in an embodiment of this application;

[0046] Figure 8 Another schematic diagram of lighting control provided in an embodiment of this application;

[0047] Figure 9 A schematic diagram illustrating another application scenario provided by an embodiment of this application;

[0048] Figure 10A schematic diagram of the software structure of an electronic device provided in an embodiment of this application;

[0049] Figure 11 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0050] The following explanations of some terms used in the embodiments of this application are provided to facilitate understanding by those skilled in the art.

[0051] The embodiments of this application involve at least one, including one or more; where "multiple" means two or more. Furthermore, it should be understood that in the description of this specification, terms such as "first" and "second" are used only for descriptive purposes and should not be construed as indicating relative importance or order. For example, "first device" and "second device" do not represent the degree of importance of the two or their order, but are merely for descriptive distinction. In the embodiments of this application, "and / or" merely describes an association relationship, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. Additionally, the character " / " in this document generally indicates that the preceding and following related objects have an "or" relationship.

[0052] In the description of the embodiments of this application, it should be noted that, unless otherwise explicitly specified and limited, the terms "installation" and "connection" should be interpreted broadly. For example, "connection" can be a detachable connection or a non-detachable connection; it can be a direct connection or an indirect connection through an intermediate medium. The directional terms mentioned in the embodiments of this application, such as "upper," "lower," "left," "right," "inner," and "outer," are only for reference to the directions in the accompanying drawings. Therefore, the directional terms used are for better and clearer explanation and understanding of the embodiments of this application, and are not intended to indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the embodiments of this application.

[0053] References to "one embodiment" or "some embodiments" as used in this specification mean that one or more embodiments of this specification include a particular feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0054] The lighting control method provided in this application is applicable to a communication system (hereinafter referred to as the "system"). The system includes a first device, a second device, and a third device. The first device is an audio device, i.e., a device capable of playing audio. For example, the first device can be a portable electronic device such as a mobile phone, tablet, or laptop; it can also be a wearable device such as a watch or bracelet; or it can be a smart home device such as a television or refrigerator; or it can be an in-vehicle device, or it can be a virtual reality (VR) device, augmented reality (AR) device, mixed reality (MR) device, etc. In short, this application does not limit the specific type of the first device. The second and third devices are both lighting devices, and the second and third devices can be connected to the first device. The connection can be wireless or wired, such as through a wireless router. The lighting device can be, for example, a ribbon, chandelier, spotlight, or other light-emitting devices, or it can be an indicator light located on various devices, such as an indicator light on a laptop, mobile phone, or vehicle. This application does not limit the specific type of the lighting device. When the first device plays audio, it can control the second and third devices to light up in a certain way, so as to achieve the experience of lights moving with the music. The specific control method will be introduced later.

[0055] Figure 1 A schematic diagram of an electronic device is shown. The electronic device can be a primary device, such as a speaker, television set, or mobile phone. Figure 1As shown, the electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0056] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, memory, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). Different processing units may be independent devices or integrated into one or more processors. The controller may serve as the nerve center and command center of the electronic device. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution. Processor 110 may also include memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that processor 110 has just used or is recurring. If processor 110 needs to reuse an instruction or data, it can directly retrieve it from the memory. This avoids repeated access, reduces the waiting time of processor 110, and thus improves system efficiency.

[0057] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0058] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180K, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, thereby realizing the touch function of the electronic device 100.

[0059] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface to enable the function of answering phone calls through a Bluetooth headset.

[0060] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0061] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to enable music playback through Bluetooth headphones.

[0062] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the electronic device 100 to capture images. The processor 110 and the display screen 194 communicate via the DSI interface to enable the electronic device 100 to display images.

[0063] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 193, a display screen 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0064] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.

[0065] It is understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0066] The wireless communication function of the electronic device can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor, and baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in conjunction with a tuning switch.

[0067] The mobile communication module 150 can provide solutions for wireless communication applications including 2G / 3G / 4G / 5G in electronic devices. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0068] The wireless communication module 160 can provide solutions for wireless communication applications in electronic devices, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0069] In some embodiments, antenna 1 of the electronic device is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling the electronic device to communicate with networks and other devices via wireless communication technology.

[0070] The display screen 194 is used to display the application's interface, etc. The display screen 194 includes a display panel. In some embodiments, the electronic device may include one or N display screens 194, where N is a positive integer greater than 1.

[0071] The electronic device 100 can perform shooting functions through an ISP, a camera 193, a video codec, a GPU, a display 194, and an application processor. The ISP is used to process the data fed back by the camera 193.

[0072] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of the electronic device by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system and software code for at least one application program. The data storage area may store data generated during the use of the electronic device (e.g., images, videos, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, general-purpose flash memory, etc.

[0073] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, images, videos, and other files can be saved on the external memory card.

[0074] Electronic devices can implement audio functions such as music playback and recording through audio modules 170, speakers 170A, receivers 170B, microphones 170C, headphone jacks 170D, and application processors.

[0075] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0076] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls and other external playback scenarios through one or more speakers 170A.

[0077] The receiver 170B, also known as a "handpiece," can be one or more, and is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a telephone call or voice message, the receiver 170B can be brought close to the ear to listen to the voice.

[0078] The microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals.

[0079] The 170D headphone jack is used to connect wired headphones.

[0080] The pressure sensor 180A is used to sense pressure signals and can convert the pressure signals into electrical signals. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194.

[0081] The gyroscope sensor 180B can be used to determine the motion attitude of an electronic device. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the electronic device about three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization.

[0082] The barometric pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device calculates altitude using the air pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.

[0083] The magnetic sensor 180D includes a Hall effect sensor. Electronic devices can use the magnetic sensor 180D to detect the opening and closing of a flip cover.

[0084] The 180E accelerometer can detect the magnitude of acceleration in various directions (typically three axes) of electronic devices. When the electronic device is stationary, it can detect the magnitude and direction of gravity.

[0085] The 180F distance sensor is used to measure distance. Electronic devices can measure distance using infrared or laser.

[0086] The proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The electronic device emits infrared light outward through the LED. The electronic device uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that an object is near the electronic device. When insufficient reflected light is detected, the electronic device can determine that no object is near the electronic device.

[0087] An ambient light sensor 180L is used to detect ambient light levels. Electronic devices can adaptively adjust the brightness of the display screen 194 based on the detected ambient light levels.

[0088] The fingerprint sensor 180H is used to collect fingerprints.

[0089] The 180J temperature sensor is used to detect temperature.

[0090] Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180K is used to detect touch operations applied to or near it. The touch sensor can then transmit the detected touch operation to the application processor to determine the type of touch event.

[0091] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals from the vibrating bone segments of the human vocal cords.

[0092] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. The electronic device can receive button input and generate key signal inputs related to user settings and function control. Motor 191 can generate vibration prompts.

[0093] Indicator 192 can be an indicator light, used to indicate charging status, battery level changes, or to indicate messages, missed calls, notifications, etc. SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with the electronic device.

[0094] Understandable, Figure 1 The components shown do not constitute a specific limitation on the electronic device. The electronic device in the embodiments of the present invention may include components such as... Figure 1 More or fewer parts. Furthermore, Figure 1 The combination / connection relationships between the components can also be adjusted and modified.

[0095] The technical solution of this application will be described below with reference to the accompanying drawings.

[0096] For example, please see Figure 2 This is a schematic diagram illustrating an application scenario provided in an embodiment of this application, using a living room at home as an example. Figure 2As shown, the scene includes a first device, a second device, and a third device. The first device is exemplified by a speaker in the living room, the second by a spotlight, and the third by a light strip (or chandelier). When the first device (the speaker) plays music, the second device (the spotlight) and the third device (the chandelier) can be controlled to emit light in specific ways, creating an experience where the lights move in sync with the music.

[0097] One method of lighting that moves in sync with music involves controlling multiple lighting devices in the same way when the first device plays audio. Figure 2 For example, when the first device (i.e., the speaker) plays a song, the spotlights and chandeliers are controlled to flash at the same frequency and display the same color. In short, all the lighting devices emit light in the same way. Obviously, this method is rather rigid, not flexible enough, and lacks a strong sense of atmosphere.

[0098] This application provides a lighting control method applicable to a communication system including a first device, a second device, and a third device. The first device is an audio device, for example... Figure 2 The speakers, the second device, and the third device are all lighting devices, for example... Figure 2 The system includes spotlights and chandeliers. A first device (e.g., a speaker) is connected to a second device (e.g., a spotlight) and a third device (e.g., a chandelier). When the first device plays audio (e.g., a song), it controls the second device to emit light in a first manner and the third device to emit light in a second manner. The first and second methods are different; when the second device emits light in the first method, it corresponds to the first channel of the first audio, and when the second device emits light in the second method, it corresponds to the second channel of the first audio. In other words, when the first device plays audio, it controls each light-emitting device to emit light in a different manner based on the different channels of the audio, creating a more atmospheric effect compared to all light-emitting devices emitting light in the same manner.

[0099] For example, with Figure 2Taking a scenario as an example, when a speaker (the first device) plays a song, the spotlights in the living room (the second device) emit light in one way, for example, flashing at a frequency of 2 seconds and displaying a yellow color; the chandelier in the living room (the third device) emits light in another way, for example, flashing at a frequency of 3 seconds and displaying a green color. Visually and aurally, the light emission pattern of the spotlights (the second device) corresponds to the first channel (e.g., the left channel) of the song. For example, the user visually perceives the spotlights as flashing slowly and displaying a warm color, while the melody of the first channel (e.g., changes in pitch, tone, or timbre) is smooth; that is, the light emission pattern of the spotlights corresponds to the first channel of the song. Similarly, the light emission pattern of the chandelier (the third device) corresponds to the second channel (e.g., the right channel) of the song. For example, a user might visually perceive a chandelier with a faster frequency and a cooler color, while the second channel's melody (e.g., changes in pitch, tone, or timbre) is brisk; that is, there is a correspondence between the chandelier's lighting pattern and the song's second channel. Therefore, if... Figure 2 If the scenario adopts the technical solution provided in the embodiments of this application, then when the speaker plays music, each light device can emit light in different ways and correspond to different channels of the music, which is more atmospheric and artistic.

[0100] It should be noted that, Figure 2 This is merely an example of an application scenario listed for the purpose of facilitating understanding of the technical solution in this application. The technical solution of this application embodiment can also be applied to other application scenarios, such as bars, KTVs, and any other scenarios with lighting equipment. This application will not list them all.

[0101] The implementation principle of the technical solution of this application will be described in detail below with reference to the accompanying drawings.

[0102] Example 1

[0103] Figure 3 This is a flowchart illustrating the lighting control method provided in an embodiment of this application. This method can be applied to... Figure 2 The communication system shown or a similar communication system. For example... Figure 3 As shown, the process includes:

[0104] S1, the first device is connected to the second device.

[0105] For example, the first device and the second device can be connected via wired or wireless means. For instance, the second device is... Figure 2 The spotlights in the living room can be connected to the speakers (i.e., the first device) via the home router.

[0106] S2, the first device is connected to the third device.

[0107] For example, the first device and the third device can be connected via wired or wireless means. For instance, the third device is... Figure 2 The chandelier in the living room can be connected to the speakers (i.e., the first device) via the home router. The execution order of S1 and S2 is not specified.

[0108] S3, the first device plays audio.

[0109] For example, the audio can be various types of songs, dramas, radio broadcasts, storytelling, crosstalk, etc., and can be local audio or audio played online. This application embodiment does not limit the scope. It is understood that the execution order of S1-S3 is not limited; the audio can be played first, and then the connection to the second device and the third device can be made respectively.

[0110] S4, the first device controls the second device to emit light in a first manner, and when the second device emits light in the first manner, there is a corresponding relationship with the first channel of the audio.

[0111] S5, the first device controls the third device to emit light in a second manner, and when the third device emits light in the second manner, there is a corresponding relationship with the second channel of the audio.

[0112] Optionally, before S4, the process includes the step of determining the first channel. Before S5, the process includes the step of determining the second channel. For example, the first channel includes any one of the following channels: left channel, right channel, left surround, right surround, center channel, pop, and sky channel. The second channel can be a channel different from the first channel among the following channels: left channel, right channel, left surround, right surround, center channel, pop, and sky channel. For example, the first channel is the left channel and the second channel is the right channel; or, the first channel is left surround and the second channel is right surround, and so on.

[0113] For ease of understanding, the following explanation uses the first channel as an example to illustrate the process of determining the first channel. For example, the methods for determining the first channel include, but are not limited to, at least one of the following:

[0114] In method A, the first device determines the first audio channel based on the first positional relationship between the second device and the first device. It should be understood that prior to method A, the first device needs to obtain the first positional relationship between the second device and the first device. This can be achieved in various ways, such as through laser detection, image capture, or manual input. For example, the second device may be located to the left, right, front left, or front right of the first device. Assuming the second device is located to the left of the first device, the first audio channel can be determined to be the left channel or left surround; or, assuming the second device is located to the right of the first device, the first audio channel can be determined to be the right channel or right surround.

[0115] In method B, the first device determines the first audio channel based on the second positional relationship between the second device and the user. It should be understood that prior to method B, the first device needs to obtain the second positional relationship between the second device and the user. For example, the same method for obtaining the first positional relationship can be used, and will not be repeated here. For instance, the second device may be located to the user's left, right, left front, or right front. Assuming the second device is located to the user's left, the first audio channel can be determined to be the left channel or left surround; or, assuming the second device is located to the user's right, the first audio channel can be determined to be the right channel or right surround. Using method B to control the lighting equipment better reflects the user's actual experience in their current position.

[0116] Method C: The first device determines the first audio channel based on user settings. In other words, the first audio channel is set by the user. For example, the first device provides a settings interface or buttons to facilitate user settings of the first audio channel. Using this method, users can set the audio channel according to their needs and then control the lighting equipment based on that channel.

[0117] In Method D, the first channel is set to the default setting. This default setting can be understood as the settings configured at the factory when the device is shipped, or the software settings configured by default after installation or upgrade. For example, the first channel is the left channel by default.

[0118] Methods A through D above are listed methods for determining the first channel, but this application is not limited to them; other methods for determining the first channel are also feasible. Furthermore, methods A through D can be used individually or in combination. When used in combination, any two of the four methods can be combined. For example, the first device determines that the first channel includes the left channel and left surround sound according to method A, and then, according to method B, finally selects the first channel as the left channel from these two channels.

[0119] The above describes how the first channel is determined. The method for determining the second channel is similar, including at least one of the following:

[0120] In method E, the first device determines the second channel based on the third positional relationship between the third device and the first device. The principle is the same as that of method A above, and will not be repeated.

[0121] In method F, the first device determines the second channel based on the fourth positional relationship between the third device and the user. The principle is the same as in method B, and will not be repeated here.

[0122] Method G involves the first device determining the second audio channel based on user settings. The principle is the same as in Method C, and will not be repeated here.

[0123] In mode H, the second channel is set to the default. For example, the second channel is the right channel by default.

[0124] It should be noted that the above embodiments mainly focus on Figure 1 Taking application scenarios as an example, Figure 1 In this scenario, the first device is connected to two lighting devices (i.e., the second and third devices), so the first device determines two distinct audio channels: channel one and channel two. Understandably, if the first device is currently connected to more lighting devices, such as five, then it can determine five distinct audio channels, for example, channels one through five, each corresponding to one lighting device. That is, the number of audio channels determined by the first device is the same as the number of lighting devices currently connected to it. If the first device is currently connected to N lighting devices, then it determines N audio channels, where N is an integer greater than or equal to 2. In this case, there is a one-to-one correspondence between lighting devices and audio channels.

[0125] However, considering that in some scenarios there are a large number of lighting devices, for example Figure 1 Since there are a large number of spotlights, if each light fixture were to correspond one-to-one with a sound channel, the first device would need to determine a large number of different sound channels. Therefore, in some embodiments, the light fixtures and sound channels do not need to be matched one-to-one; multiple light fixtures can correspond to the same sound channel. For example, the first device may connect to five light fixtures but determine two different sound channels: three light fixtures correspond to one sound channel, and the remaining two light fixtures correspond to another sound channel. Specifically, which light fixtures correspond to which sound channels can be automatically determined by the first device or specified by the user. Taking automatic determination by the first device as an example, one feasible approach is for the first device to determine light fixtures of the same type among all currently connected light fixtures, and all light fixtures of the same type correspond to one sound channel; for example, all spotlights correspond to the same sound channel. Another feasible approach is for the first device to determine light fixtures that are close in location among all currently connected light fixtures, and all light fixtures that are close in location correspond to the same sound channel. Of course, there are other feasible approaches, which are not listed in detail in this embodiment.

[0126] After determining the first and second audio channels, the first device can further perform the following steps: determining the first light emission mode (hereinafter referred to as the first mode) corresponding to the first audio channel and the second light emission mode (hereinafter referred to as the second mode) corresponding to the second audio channel. For example, the light emission mode includes at least one of the device's flashing frequency, color, color temperature, and brightness. Wherein, the second device emits light in the first mode, including: the second device emits light using at least one of the first frequency, first color, first color temperature, and first brightness. Similarly, the third device emits light in the second mode, including: the third device emits light using at least one of the second frequency, second color, second color temperature, and second brightness. Wherein, the first mode and the second mode are different. For example, in the first mode, the first frequency is 3 times / s, the first color is yellow, and the first color temperature is warm. In the second mode, the second frequency is 5 times / s, the second color is blue, and the second color temperature is cool. That is, the second device flashes 3 times per second and the color is yellow, presenting a warm hue. The third device flashes 5 times per second and the color is blue, presenting a cool hue.

[0127] For example, the determination of the first light emission mode and / or the second light emission mode includes, but is not limited to, at least one of the following:

[0128] Method 1: The first device stores a first correspondence between audio channels and light emission methods. Based on this first correspondence, the first light emission method corresponding to the first audio channel and the second light emission method corresponding to the second audio channel are determined. For example, the first correspondence between the audio channels and light emission methods is shown in Table 1 below:

[0129] Table 1: First Correspondence Between Audio Channels and Light Emission Modes

[0130] Left channel Frequency 1, Color 1, Color Temperature 1 Right channel Frequency 2, Color 2, Color Temperature 2 Left turn Frequency 3, Color 3, Color Temperature 3

[0131] For example, if the first channel is the left channel, then the first device determines, according to Table 1 above, that the first mode corresponding to the first channel includes: frequency 1, color 1, and color temperature 1. If the second channel is the right channel, the first device determines, according to Table 1 above, that the second mode corresponding to the second channel includes: frequency 2, color 2, and color temperature 2. It should be noted that the first correspondence between the aforementioned channels and light emission modes can be pre-stored in the electronic device, for example, it may exist by default when the electronic device leaves the factory, or it can be user-defined; this embodiment of the application does not limit this.

[0132] Therefore, it can be seen that using Method 1, where the first device controls the lighting devices to emit light in different ways according to the different channels of a song, improves the flexibility of the lights moving with the music to some extent. However, it should be noted that when using this method, if the first channel is always the left channel when the first device plays different songs, then the first method determined according to Table 1 above is the same, meaning the flashing mode of the lights on the second device is the same. In other words, when the first device plays different songs, the flashing mode of the second device remains unchanged because the first channel is the same. Similarly, when the first device plays different songs, if the second channel is always the right channel, then the second method determined according to Table 1 above is the same, meaning the flashing mode of the lights on the third device is the same. In other words, when the first device plays different songs, the flashing mode of the lights on the third device remains unchanged because the second channel is the same. Therefore, although this method can achieve the goal of controlling the lighting devices to emit light in different ways according to different channels, there is a possibility that the lighting mode of the lighting devices will remain unchanged when different songs are played, resulting in relatively poor flexibility.

[0133] Method Two: The first device can also extract the first rhythmic feature corresponding to the first channel based on the first channel, and extract the second rhythmic feature corresponding to the second channel based on the second channel. Then, based on the second correspondence between the rhythmic features and the light emission mode, it determines the first light emission mode corresponding to the first rhythmic feature and the second light emission mode corresponding to the second rhythmic feature. Let's briefly introduce rhythmic features. Rhythmic features include changes in at least one of the following: pitch, tone, and timbre. Rhythmic features can be represented from the pulse image of the sound. For an example, please refer to 4. Figure 4 The illustration demonstrates the sound pulse diagrams for the first and second channels after audio is split into a first channel and a second channel. As shown, the sound pulse diagrams for the two different channels are not entirely identical. For example, the pitch changes (i.e., the vertical axis) in the pulse diagram for the first channel differ from those in the pulse diagram for the second channel; that is, the pitch characteristics of the first and second channels are different. It should be noted that the pitch characteristics corresponding to the same channel may differ for different songs. For example, when the first device plays songs A and B, if the first channel is always the left channel, the corresponding pitch characteristics are different; that is, the pitch characteristics of the left channel in song A are different from those in the left channel in song B.

[0134] Therefore, the difference between Method 1 and Method 2 is as follows: In Method 1, if the first channel is determined to be the same for different songs, the first method determined according to Table 1 will be the same, so the flashing mode of the second device will be the same. In Method 2, even if the first channel is determined to be the same for different songs, the extracted rhythmic features will not be the same. Therefore, based on the second correspondence between rhythmic features and light emission modes, the determined first light emission mode will be different. Compared to Method 1, in Method 2, the changes in the lighting device vary with the different songs, resulting in a better user experience.

[0135] For example, a second correspondence between musical characteristics and light emission patterns is shown in Table 2 below:

[0136] Table 2: Second Correspondence Between Pitch Characteristics and Light Emission Modes

[0137]

[0138] For example, assuming the first device determines that the first channel is the left channel, it extracts the first musical feature of the left channel. Then, it searches for a musical feature that matches the first musical feature (e.g., the one with the closest similarity) among all the musical features corresponding to the left channel in Table 2 above. Finally, it determines the light emission mode corresponding to this musical feature as the first light emission mode. Similarly, assuming the first device determines that the second channel is the right channel, it extracts the second musical feature of the right channel. Then, it selects a musical feature that matches the second musical feature (e.g., the one with the closest similarity) among all the musical features corresponding to the right channel in Table 2 above, and finally determines the light emission mode corresponding to this musical feature as the second light emission mode.

[0139] It should be noted that the above are examples of methods for determining the first and second light emission methods. Other methods are also feasible, and the embodiments of this application are not limited to them.

[0140] After the first device determines the first light-emitting method, it controls the second device to emit light in the first light-emitting method. After determining the second light-emitting method, it controls the third device to emit light in the second light-emitting method. One possible implementation method is as follows, please refer to [link to relevant documentation]. Figure 5 After the first device determines the first light emission mode corresponding to the first channel, it can send a first command to the second device. This first command specifies the second device's first light emission mode (e.g., frequency of 2 seconds, color of color 1, such as yellow, and brightness of 3 watts). Upon receiving the first command, the second device emits light in the first light emission mode, that is, flashing once every 2 seconds, with the color being color 1 (yellow) and the brightness (vertical axis) corresponding to 3 watts. It should be noted that... Figure 5In the diagram, the first light emission mode of the second device is represented by a bar graph. The vertical axis of the bar graph corresponds to brightness, the horizontal axis represents time, and the fill color represents color. It should be understood that the bar graph is an example of the first light emission mode drawn for ease of understanding; the first light emission mode can also be described in other ways, and this application does not limit this. Similarly, see... Figure 5 After the first device determines the second light emission mode corresponding to the second channel, it sends a second command to the third device, instructing the third device on the second light emission mode (e.g., frequency of 3 seconds, color 2, such as green, and brightness corresponding to 1 watt). Upon receiving the second command, the third device emits light in the second light emission mode, that is, flashing once every 3 seconds, with the color being color 2 (green) and the brightness (vertical axis) corresponding to 1 watt. Figure 5 It can be seen that when the first device plays a certain audio, it controls each lighting device to emit light in different ways according to different channels, thereby improving the flexibility of the lights moving with the music.

[0141] Example 2

[0142] It should be noted that in Example 1 (e.g.) Figure 5 After determining the first light-emitting mode, the first device sends a first command to the second device to instruct the second device to use the first light-emitting mode. After determining the second light-emitting mode, the first device sends a second command to the third device to instruct the third device to use the second light-emitting mode. This method does not consider the transmission delay between the devices. Therefore, it is possible that the first device starts playing audio at time T0, but due to the transmission delay between the first and second devices, the second device only receives the first command at time T1, after T0, and then emits light according to the first light-emitting mode indicated by the first command. Obviously, T1 is after T0, which causes the audio playback of the first device and the light blinking of the second device to be out of sync. The same applies to the third device; due to the transmission delay between the first and third devices, there is also a possibility that the audio playback of the first device and the light blinking of the third device will be out of sync.

[0143] To ensure synchronization between the audio playback of the first device and the light flashing of the second and third devices, in this second embodiment, the start time of audio playback of the first device is the same as the start time of light emission of the second and third devices. In this way, the audio playback of the first device is synchronized with the light emission of the second and third devices.

[0144] One possible approach is to refer to [link / reference needed]. Figure 6If the first device determines that it will start playing audio at time T0, then after determining the first and second light-emitting methods, it sends a first instruction to the second device and a second instruction to the third device. The first instruction specifies the start time T0 for the second device's light-emitting activity and the first light-emitting method, ensuring that the second device's light emission is synchronized with the first device's audio playback. The second instruction specifies the start time T0 for the third device's light emission and the second light-emitting method, ensuring that the third device's light emission is synchronized with the first device's audio playback.

[0145] In the above method, the first device needs to determine the audio playback start time T0. See also... Figure 6 Assuming the current time is T2 (T2 is earlier than T0, and audio playback has not yet started), then T0 = T2 + preset duration. The preset duration is reserved to ensure that the first instruction has sufficient time to be transmitted to the second device, and the second instruction has sufficient time to be transmitted to the third device. Therefore, the preset duration is related to the first transmission delay between the first and second devices, and / or the second transmission delay between the first and third devices. For example, the preset duration can be greater than or equal to the first transmission delay, or greater than or equal to the second transmission delay, or greater than or equal to the average or weighted average of the first and second transmission delays.

[0146] In some embodiments, see continue to see Figure 6 The current time T2 could be, for example, the moment when the first device receives the first operation. The first operation instructs the second and third devices to flash in sync with the music being played by the first device. In other words, after receiving the first operation, the first device will not immediately play the music because of transmission delays. Playing the music immediately would cause the music and lights to be out of sync. Therefore, the first device waits a preset time before playing the audio. This waiting period is sufficient to ensure that the second and third devices successfully receive the instruction, so that when the first device plays the audio, the second and third devices also begin to light up, achieving synchronization between the music and the lights.

[0147] In the above embodiments (e.g.) Figure 5 and Figure 6 In this scenario, when the first device plays a certain audio signal, the frequency, color, brightness, etc., of the first light emission mode of the second device and the second light emission mode of the third device remain unchanged. For example, Figure 5In the first light emission mode, the frequency, color, and brightness remain constant. The second light emission mode is the same. In other embodiments, to enhance versatility, when the first device plays audio, the parameters of the first light emission mode of the second device can dynamically change, and the parameters of the second light emission mode of the third device can also dynamically change. For example, at least one of the frequency, color, and brightness in the first light emission mode may dynamically change. At least one of the frequency, color, and brightness in the second light emission mode may also dynamically change.

[0148] One possible implementation is that the audio played by the first device includes multiple segments, and the technical solution of this application is applied to each different segment. For example, please refer to... Figure 7 The audio includes two segments: a first segment and a second segment. For the first segment, the first and second channels are determined using the technical solution of this application, corresponding to a first light emission method and a second light emission method. Specifically, the second device emits light using the first light emission method, and the third device emits light using the second light emission method. Continuing as... Figure 7 For the second segment, using the technical solution of this application, the third and fourth channels are determined, corresponding to the third and fourth light emission methods. The second device emits light using the third light emission method, and the third device emits light using the fourth light emission method. That is, when the first device plays different segments of audio, the light emission method of the second device dynamically changes from the first to the third light emission method, and the light emission method of the third device also dynamically changes from the second to the fourth light emission method. This method is more flexible and diverse. Furthermore, different segments of some songs have different atmospheres; for example, the opening is relatively calm and the volume is low, while the climax is higher and more cheerful. Therefore, using a method of processing different segments separately makes the light flashing pattern more consistent with the song.

[0149] exist Figure 7 In the embodiments, the first segment and the second segment can be audio within a certain duration, for example, every 3 seconds as a segment, or every frame (e.g., 20ms) as a segment, etc. The specific duration is not limited in the embodiments of this application.

[0150] It should be understood that, in order to ensure that the playback of each segment is synchronized with the lighting, one possible approach is for the first device to determine the start time of each segment. For example, the start time of the first segment is T1, and the start time of the second segment is T2. T2 follows T1, such as... Figure 8As shown. The first device sends a first instruction to the second device and a second instruction to the third device. The first instruction instructs the second device to start emitting light in a first light-emitting mode at time T1 and in a third light-emitting mode at time T2. The second instruction instructs the third device to start emitting light in a second light-emitting mode at time T1 and in a fourth light-emitting mode at time T2. Therefore, the first device needs to determine the start time of the first segment as T1 and the start time of the second segment as T2. Figure 8 For example, assuming the current time is T3, T1 = T3 + preset duration. The preset duration can be found in the previous description and will not be repeated here. For instance, the current time T3 can be the time when the first device receives the first operation. The first operation can be found in the previous description.

[0151] Example 3

[0152] In Embodiments 1 and 2, when the first device plays audio, the lighting of the second and third devices is controlled separately based on different audio channels. This method is applicable when the number of audio devices (i.e., the first device) is equal to one. There are other scenarios where there are multiple audio devices in the environment, for example, two audio devices (e.g., one is a main speaker, and the other is a secondary speaker) playing the same song. In this case, the technical solution provided in this application is also applicable. For ease of description, we will take the first and fourth audio devices as an example.

[0153] For example, please see Figure 9 This is a schematic diagram of an application scenario provided in Embodiment 3. This application scenario includes a first device to a fourth device. The first and fourth devices are audio devices, for example, one is a main speaker and the other is a secondary speaker. The second and third devices are lighting devices.

[0154] In some embodiments, to enhance the stereo effect, the first device and the fourth device play the same song using different channels. For example, the first device plays the song's first channel, such as the left channel, and the fourth device plays the song's second channel, such as the right channel. Therefore, the first device can determine a first lighting mode based on the first channel and control the second device to emit light using the first lighting mode. The fourth device determines a second lighting mode based on the second channel and controls the third device to emit light using the second lighting mode. That is, one audio device corresponds to one channel, and one lighting device is controlled based on that channel. Of course, in other embodiments, one audio device corresponds to one channel, and multiple lighting devices can be controlled based on that channel. For example, one audio device corresponding to one channel can control all lighting devices of the same type, such as... Figure 2 In the middle, the first device corresponds to the left channel and controls all spotlights, while the fourth device corresponds to the right channel and controls all chandeliers.

[0155] Example 4

[0156] This fourth embodiment refines the internal structures of the first, second, and third devices described in the previous embodiments. For example, such as... Figure 10 The first device includes a channel splitting module, a rhythm extraction module, a light emission mapping module, a timestamp marking module, a speaker, a delay determination module, and a communication module. The second and third devices each include a communication module, a delay determination module, and a lighting control module.

[0157] The following is based on Figure 10 Taking an example, the implementation process of the technical solution of this application will be explained.

[0158] The first device is connected to the second and third devices respectively via a communication module. Optionally, the first device can also synchronize its clock with the second and third devices.

[0159] The channel splitting module in the first device acquires audio and splits the audio into channels. For example, it splits it into a first channel and a second channel. The method for determining the first and second channels is described in Embodiment 1, as is the method for splitting the channels.

[0160] The channel splitting module sends the split first and second channels to the rhythm extraction module. The rhythm extraction module extracts the first rhythm feature of the first channel and the second audio feature of the second channel, and then sends the first and second rhythm features to the light emission mode mapping module.

[0161] The light emission mode mapping module determines the first light emission mode corresponding to the first musical feature and the second light emission mode corresponding to the second musical feature based on the correspondence between musical features and light emission modes (for example, Table 2 in Embodiment 1 above).

[0162] The timestamp module is used to mark the start time of audio playback and to identify the start time of the second and third devices' lights. The start time of audio playback is the same as the start time of the second and third devices' lights to ensure audio-light synchronization. Transmission delays are used during the marking process, such as the first transmission delay between the first and second devices, and / or the second transmission delay between the first and third devices. The delay determination modules in the first and second devices can determine the first transmission delay. For example, the delay determination module in the first device sends a probe signal to the second device through its communication module, recording the transmission time of the probe signal. The delay determination module in the second device sends a return signal to the first device through its communication module, and the first device records the reception time of the return signal. The first device can determine the first transmission delay based on the transmission time of the probe signal and the reception time of the return signal. The determination method for the second transmission delay is the same and will not be repeated.

[0163] After determining the first light-emitting mode and the start time, the first device sends a first command to the second device via the communication module, indicating the start time and the first light-emitting mode. Upon receiving the first command, the second device's lighting control module controls the light to emit light in the first light-emitting mode when the start time is reached. Similarly, after determining the second light-emitting mode and the start time, the first device sends a second command to the third device via the communication module, indicating the start time and the second light-emitting mode. Upon receiving the second command, the third device's lighting control module controls the light to emit light in the second light-emitting mode when the start time is reached.

[0164] Figure 11 This is a schematic diagram of the structure of the electronic device 1100 provided in an embodiment of this application. The electronic device 1100 may be the first device, second device, or third device mentioned above. Figure 11 As shown, electronic device 1100 may include: one or more processors 1101; one or more memories 1102; a communication interface 1103; and one or more computer programs 1104. These devices can be connected via one or more communication buses 1105. The one or more computer programs 1104 are stored in the memory 1102 and configured to be executed by the one or more processors 1101. The one or more computer programs 1104 include instructions. For example, when electronic device 1100 is the first device mentioned above, the instructions can be used to perform the relevant steps of the first device as described in the corresponding embodiments above. Figure 3 The steps of the first device in the illustrated embodiment. Communication interface 1103 is used to enable communication between electronic device 1100 and other devices, such as a transceiver.

[0165] In the embodiments provided above, the methods provided by the present application are described from the perspective of an electronic device (e.g., a speaker) as the executing entity. To implement the functions of the methods provided in the embodiments of the present application, the electronic device may include hardware structures and / or software modules, implementing the above functions in the form of hardware structures, software modules, or a combination of hardware structures and software modules. Whether a particular function is executed in the form of hardware structures, software modules, or a combination of hardware structures and software modules depends on the specific application and design constraints of the technical solution.

[0166] In the above embodiments, the terms "when..." or "after..." can be interpreted, depending on the context, as meaning "if...", "after...", "in response to determining...", or "in response to detecting...". Similarly, the phrases "when..." or "if (the stated condition or event) is detected" can be interpreted, depending on the context, as meaning "if...", "in response to determining...", "when (the stated condition or event) is detected", or "in response to detecting (the stated condition or event)". Furthermore, in the above embodiments, relational terms such as "first" and "second" are used to distinguish one entity from another, without limiting any actual relationship or order between these entities.

[0167] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0168] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially as a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present invention are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)). Where there is no conflict, the solutions in the above embodiments can be combined.

[0169] It should be noted that a portion of this patent application contains copyrighted material. The copyright holder retains all rights except for making copies of the contents of patent documents or records from the patent office.

Claims

1. A lighting control method, characterized in that, Applied to a first device, wherein the first device is an audio device, the method includes: The first device is connected to the second device; The first device is connected to the third device; both the second device and the third device are lighting devices. While the first device is playing audio, the second device is controlled to emit light in a first manner, and the third device is controlled to emit light in a second manner; During the playback of audio by the first device, controlling the second device to emit light in a first manner and the third device to emit light in a second manner includes: The first device determines the current time as the second time, at which time the audio has not yet been played; The first device determines to start playing the audio at a first moment, the first moment being equal to the second moment plus a preset duration, the preset duration being related to a first transmission delay between the first device and the second device, and / or a second transmission delay between the first device and the third device, the first transmission delay being determined by the first device, and the second transmission delay being determined by the first device; The first device sends a first instruction to the second device, the first instruction being used to instruct the second device to emit light in the first manner starting from the first moment; The first device sends a second instruction to the third device, the second instruction being used to instruct the third device to emit light in the second manner starting from the first moment; The first method is different from the second method. When the second device emits light in the first method, it corresponds to the first channel of the audio. When the third device emits light in the second method, it corresponds to the second channel of the audio. The second channel is different from the first channel.

2. The method according to claim 1, characterized in that, The second device emits light in the first manner, including: the second device performing at least one of the following: flashing at a first frequency, emitting light with a first brightness, emitting light with a first color temperature, and emitting light with a first color; The third device emits light in the second manner, including: the third device performing at least one of the following: flashing at a second frequency, emitting light at a second brightness, emitting light at a second color temperature, and emitting light at a second color.

3. The method according to claim 1, characterized in that, The first channel includes at least one of the following: left channel, left surround, right channel, right surround, and center channel; The second channel includes at least one of the following: left channel, left surround, right channel, right surround, and center channel.

4. The method according to claim 1, characterized in that, The first audio channel is related to a first positional relationship between the first device and the second device, or to a second positional relationship between the second device and the user, or is set by the user, or is a system default setting; The second audio channel is related to the first positional relationship between the first device and the third device, or to the second positional relationship between the third device and the user, or is set by the user, or is a system default setting.

5. The method according to claim 1, characterized in that, The second moment includes: When the first device receives the first operation, the first operation is used to instruct the first device to control the second device and the third device to emit light according to the played audio.

6. The method according to claim 1, characterized in that, The preset duration satisfies at least one of the following: Greater than or equal to the first transmission delay between the first device and the second device; The second transmission delay between the first device and the third device is greater than or equal to the second transmission delay between the first device and the third device; It is greater than or equal to the average or weighted average of the first transmission delay and the second transmission delay.

7. The method according to any one of claims 1 to 6, characterized in that, The audio includes a first segment and a second segment. During the playback of the audio by the first device, the second device is controlled to emit light in a first manner, and the third device is controlled to emit light in a second manner. The system also includes: When the first device plays the first segment, it controls the second device to emit light in the first manner, and the third device to emit light in the second manner; wherein, when the second device emits light in the first manner, there is a correspondence with the first channel of the first segment, and when the third device emits light in the second manner, there is a correspondence with the second channel of the first segment; When the first device plays the second segment, it controls the second device to emit light in a third manner, and the third device to emit light in a fourth manner; wherein, when the second device emits light in the third manner, there is a correspondence with the third channel of the second segment, and when the third device emits light in the fourth manner, there is a correspondence with the fifth channel of the second segment.

8. The method according to any one of claims 1 to 6, characterized in that, When the second device emits light in the first manner, it corresponds to the first channel of the audio, including: When the second device emits light in the first manner, at least one of the flashing frequency, color, color temperature, and brightness of the second device corresponds to the first pitch characteristic of the first channel. When the third device emits light in the second manner, there is a correspondence with the second channel of the audio, including: When the third device emits light in the second manner, at least one of the flashing frequency, color, color temperature, and brightness of the third device corresponds to the second pitch characteristic of the second channel. The musical characteristics include at least one of pitch, tone, and timbre.

9. The method according to any one of claims 1 to 6, characterized in that, Before controlling the second device to emit light in a first manner and the third device to emit light in a second manner while the first device is playing audio, the process further includes: The first device determines a first mode corresponding to the first channel and a second mode corresponding to the second channel based on a first correspondence between the sound channel and the light emission mode.

10. The method according to any one of claims 1 to 6, characterized in that, Before controlling the second device to emit light in a first manner and the third device to emit light in a second manner while the first device is playing audio, the process further includes: The first device determines a first pitch feature of the first channel of the audio and a second pitch feature of the second channel of the audio; The first device determines a first mode corresponding to the first musical feature and a second mode corresponding to the second musical feature based on a second correspondence between musical features and light emission modes.

11. A communication system, characterized in that, include: The first device is used to play audio; The second and third devices are used to emit light; The first device includes a processor, a memory, and one or more programs; the one or more programs are stored in the memory, and the one or more programs include instructions that, when executed by the processor, cause the first device to perform the steps of the method as described in any one of claims 1-10.

12. An electronic device, characterized in that, include: Processor, memory, and one or more programs; The one or more programs are stored in the memory, and the one or more programs include instructions that, when executed by the processor, cause the electronic device to perform the steps of the method as described in any one of claims 1-10.

13. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store a computer program that, when run on a computer, causes the computer to perform the method as described in any one of claims 1 to 10.

Images