Lighting effect acquisition and lighting device control method and system for remote location environment optimization based thereon

Abstract

According to the light emitting device control method, the shape information and the rendering color code information of the image data are stored in association with the device identification information as a data set, the image analysis model is trained by using the data set, the image analysis model is applied to the image data to automatically determine the device identification information of each of the light emitting devices, the light emitting mode information corresponding to the determined device identification information is extracted, the time stamp representing the collection time point of the extracted light emitting mode information is matched, and the light emitting mode information is accumulated as the collection information, at least one parameter of the accumulated collection information is corrected, and the control signal including the instruction for controlling the light emitting devices to emit light based on the corrected collection information is sent to the light emitting devices through the repeater.

Description

Technical Field

[0001] This invention relates to a method and system for capturing on-site effects based on light-emitting devices using an AI camera, and controlling multiple light-emitting devices located on-site or in multiple remote locations in a screening room to emit light synchronously according to the on-site effects based on light-emitting devices. Background Technology

[0002] Illumination devices can display various colors and achieve gorgeous effects in dark spaces. They are not only used as support tools for concerts and exhibitions, but also widely used in nighttime events such as sports events, celebrations, and parades.

[0003] In recent years, light-up devices have gone beyond simple cheering tools. Administrators can control the light-up devices carried by people to achieve various effects during events, such as combining multiple light-up devices together to display specific letters and shapes.

[0004] In particular, with the global popularity of K-POP (Korean pop music), live streaming services that broadcast artists' concerts in remote locations such as cinemas are becoming increasingly popular, and attempts to recreate the live experience in remote locations by using centrally controlled lighting devices are continuing to advance.

[0005] However, the light-emitting device is currently only used to achieve partial effects in concert venues. Due to limitations in transmission distance, venue limitations, and lack of management personnel, it is difficult to use it when the venue changes or when the number of audience members is less than the number of concert staff.

[0006] Moreover, even when complex performance effects and other controls are not required, at least one operator must be stationed at an external location (e.g., a remote location different from the actual performance venue), thus resulting in a waste of human resources.

[0007] Current methods for achieving remote location effects are limited to simply controlling the lighting or playback of all seats. Therefore, it's difficult to recreate the brilliance of a live performance where tens of thousands of seats move organically in a remote setting. In particular, due to differences in seating layout and size between the original performance venue and the remote screening room, manually reprocessing the original effects data to adapt to the remote environment is not only time-consuming and costly, but also makes it difficult to accurately convey the performers' intentions.

[0008] In addition, due to limitations in the broadcasting equipment and network conditions at various locations in Yancheng, there are frequent issues with the viewing experience, such as misalignment of the synchronized effects.

[0009] Therefore, there is an urgent need to utilize AI cameras to collect (pick-up) the lighting patterns on site in real time. This can not only automatically optimize and convert to adapt to various remote location environments, but also achieve centralized monitoring of the status quo of multiple remote locations without the need for professional personnel intervention, and precisely synchronize images with performance effects.

[0010] Prior technology documents

[0011] Patent documents

[0012] (Patent Document 1) KR 10-2669121 B1

[0013] (Patent Document 2) KR 2402370 B1

[0014] (Patent Document 3) KR 2097751 B1 Summary of the Invention

[0015] The problem to be solved

[0016] The purpose of this invention is to solve the problems in the prior art. One embodiment of this invention provides a method and system for controlling a light-emitting device, which picks up the light-emitting patterns by photographing the light-emitting device installed on site, accumulates the light-emitting patterns extracted by the acquisition in sequence, and sends them as control signals after synchronizing the timecode with the image played at a remote location.

[0017] In addition, the present invention provides a method and system for controlling a light-emitting device, which pre-learns the shapes of different support props and the light-emitting color codes presented by different support props.

[0018] In addition, the present invention provides a method and system for controlling light-emitting devices, which can capture the light-emitting patterns presented by multiple light-emitting devices paired with different seats according to time differences.

[0019] In addition, the present invention provides a method and system for controlling a light-emitting device, which provides a light-emitting mode management interface that allows modification of real-time accumulated acquisition data before the streaming transmission time point.

[0020] In addition, the present invention provides a method and system for controlling a light-emitting device, which can automatically scale and resample the collected data based on the physical seating layout and scale information of a remote location.

[0021] In addition, the present invention provides a method and system for controlling a light-emitting device, which monitors the current status of streaming transmission at multiple remote locations and provides an integrated dashboard for effect control based on playlists.

[0022] However, the technical problems to be solved by the present invention and its embodiments are not limited to the above-mentioned technical problems, and other technical problems may also exist.

[0023] Problem Solution

[0024] According to an embodiment of the present invention, a method for controlling a light-emitting device is a method for a computing system to control a light-emitting device, comprising the following steps: acquiring image data containing shape information and color code information of multiple light-emitting devices paired with different seats; associating and storing the shape information and color code information with device identification information of each light-emitting device as a dataset; using the dataset to train an image analysis model configured to extract shape information and color code information and output device identification information when receiving image data; applying the image analysis model to the image data to automatically determine the device identification information of each of the multiple light-emitting devices; extracting light emission mode information corresponding to the determined device identification information, wherein the light emission mode information includes at least one of color parameters, brightness parameters, and effect parameters; matching it with a timestamp representing the pickup time point of the extracted light emission mode information, and accumulating the light emission mode information as pickup information; correcting at least one parameter of the accumulated pickup information through a light emission mode management interface; and sending control signals to the multiple light-emitting devices through a repeater located at a remote location, wherein the control signals include instructions to control the light-emitting devices to emit light based on the corrected pickup information.

[0025] In addition, the light emission mode information includes color parameters, HSL parameters, and effect parameters; based on multiple of these parameters, at least one of the following is represented: light emission color, light emission time, light emission brightness, and light emission effect.

[0026] Furthermore, the image analysis model is pre-trained using shape information mapped to the light-emitting device and a dataset of predefined color codes corresponding to that shape. The steps of training the image analysis model also include the following steps: extracting light emission pattern information from the first light-emitting device among multiple light-emitting devices a preset number of times and setting it as a general label; and training the image analysis model based on the general label.

[0027] Furthermore, the control signal includes a device ID. Multiple light-emitting devices that receive the control signal from a repeater located at a remote location will emit light only when the device ID contained in the control signal matches a device ID they have pre-stored.

[0028] The light emission mode management interface displays a timeline view of light emission mode information accumulated in chronological order at different collection time points. When the difference between the collected information and the pre-stored standard data exceeds a threshold, the collected information is highlighted. When the highlighted collected information is selected, at least one artificial intelligence model automatically determines and provides a correction value based on a preset presentation color code.

[0029] Furthermore, the step of sending control signals to multiple light-emitting devices includes the following steps: extracting the local timestamp included in the acquired information; extracting the streaming media timestamp mapped to the live video played at a remote location; calculating the offset between the extracted local timestamp and the streaming media timestamp to calculate the synchronization time point; and sending the control signal at the calculated synchronization time point.

[0030] On the other hand, according to an embodiment of the present invention, a method for controlling a light-emitting device by a computing system includes the following steps: acquiring original seating information of an original performance; acquiring remote position seating information of a first remote location of the streaming original performance; determining and displaying at least one or more target seats in the original seating information for performing effects intended to be applied to the first remote location; converting the original effect data of the at least one or more target seats into remote position effect data optimized for the first remote location; and remotely controlling repeaters located at at least one or more remote locations, including the first remote location, based on the converted remote position effect data.

[0031] Furthermore, the step of determining and representing the target seat includes the following steps: analyzing the morphological similarity between at least a portion of the original seat information and the remote location seat information, wherein the morphological similarity is determined based on at least one of the following: the angle of each remote location seat, the number of seats, the seat density of a remote location block including multiple remote location seats, and the aspect ratio; and for a block that is a set of at least two or more seats, among multiple candidate blocks in the original seat information, determining the first block whose morphological similarity is greater than or equal to a preset ratio as the target seat.

[0032] Furthermore, the step of converting the original effect data of the target seats into remote position effect data includes the following steps: comparing the seat parameters of the original blocks including multiple target seats of the original performance and the remote position blocks including multiple remote position blocks of the remote position performance to perform effect shape scaling calculation, wherein the seat parameters include at least one of the number of seats, rows and columns of the original seat information or the remote position seat information.

[0033] In addition, the step of performing effect shape scaling calculation includes the following steps: calculating a resampling ratio based on the differences between the seating parameters; and proportionally deleting or copying at least a portion of the row or column data included in the original effect data according to the calculated resampling ratio.

[0034] In addition, the step of performing effect shape scaling calculation also includes the following steps: extracting effect values ​​from the original effect data of data adjacent to the deleted or copied row or column data; and correcting the original effect data based on the extracted effect values ​​to generate remote location effect data, wherein the effect values ​​include at least one of the light emission color, light emission brightness, and light emission effect of the light emission device emitting light according to the effect data.

[0035] Furthermore, the step of converting the original effect data of the target seat into remote location effect data includes the following steps: performing a 1:1 mapping between multiple seats in the original block including the target seat and multiple seats in the remote location block; and applying the effect values ​​of each of the multiple seats in the original block to the effect values ​​of each of the multiple seats in the remote location block mapped by seat, to generate remote location effect data, wherein the remote location effect data is provided with area control, for executing the effect mode of the original block in the remote location block according to the mapping relationship.

[0036] Furthermore, the step of converting the original effect data into remote location effect data includes the following steps: detecting the dark interval included in the original effect data of the target seat; generating a corrected effect value based on the duration of the detected dark interval and the effect values ​​before and after the dark interval; and replacing the dark interval with the corrected effect value to generate remote location effect data.

[0037] Furthermore, the step of replacing the value with a correction effect value to generate remote location effect data includes the following steps: determining the luminous effect value before the black field interval as a first effect value; determining the luminous effect value after the black field interval as a second effect value; generating a correction effect value that continuously converts from the first effect value to the second effect value throughout the entire duration of the black field interval; and replacing the black field interval with the generated correction effect value to generate remote location effect data.

[0038] On the other hand, according to an embodiment of the present invention, a control system for a light-emitting device is characterized in that: in a central control terminal that is linked with at least one camera; at least one repeater; at least one light-emitting device; and includes at least one memory and at least one processor that reads at least one application stored in the memory and controls multiple light-emitting devices using an AI camera, the processor of the central control terminal operates according to instructions configured to perform the following operations: acquiring image data containing shape information and color code information of multiple light-emitting devices paired with different seats; associating and storing the shape information and color code information with device identification information of each of the light-emitting devices as a dataset; using the dataset, extracting the shape information and color code information when receiving image data and training an image analysis model configured to output device identification information; applying the image analysis model to the image data to automatically determine the device identification information of each of the multiple light-emitting devices; and extracting the determined device identification information. The corresponding luminous mode information, wherein the luminous mode information includes at least one of color parameters, brightness parameters, and effect parameters; it is matched with a timestamp representing the pickup time point of the extracted luminous mode information, and the luminous mode information is accumulated as pickup information; the original seating information of the original performance and the remote position seating information of the first remote position of the streaming original performance are obtained; at least one or more target seats in the original seating information are identified and displayed to perform the effect to be applied to the first remote position; the original effect data of the at least one or more target seats or the pickup information are converted into remote position effect data optimized for the first remote position; at least one parameter of the accumulated pickup information is corrected through the luminous mode management interface; and control signals are sent to multiple luminous devices through repeaters located at remote positions, the control signals including instructions to control the luminous devices to emit light based on the corrected pickup information or the remote position effect data.

[0039] In addition, the repeater includes: a receiving unit that acquires at least one of remote location effect data, streaming video, and a light-emitting performance control signal corresponding to the video from the central control terminal or a server connected to the central control terminal; and a transmitting unit that transmits the playback status information of the streaming video being transmitted by the effect linkage device and the light-emitting effect control signal corresponding to the video to the terminal or a server connected to the terminal.

[0040] In addition, when the repeater detects a preset abnormal signal in the playback status information, it generates a trigger signal and sends it to the central control terminal or a server connected to the central control terminal.

[0041] In addition, the application is used to: when receiving the trigger signal from the repeater, display the status information of the repeater that sent the trigger signal as a warning on the administrator interface; and perform remote control on the repeater that displays the warning, the remote control including at least one of power control, network reconnection, or synchronization control commands.

[0042] In addition, the repeater acquires a remote control command including a synchronization control command, which performs synchronization between the current playback time of the streaming video and the current transmission time of the illumination effect control signal.

[0043] Invention Effects

[0044] According to an embodiment of the present invention, a light-emitting device control method and system are used to capture the light-emitting modes of the light-emitting devices installed on site. The captured light-emitting modes are accumulated sequentially and then synchronized with the timecode of the video played at a remote location and sent as a control signal. The light-emitting color, brightness and effect presented on site can be realized at the same time at the remote location, thereby maximizing the sense of immersion and liveness of the performance.

[0045] Furthermore, according to the light-emitting device control method and system of the present invention, the light-emitting color codes of different support props and different cinema props are learned in advance, so that even when multiple devices are used in combination, a stable and consistent light-emitting effect can be supported.

[0046] Furthermore, the light-emitting device control method and system according to the embodiments of the present invention can capture the light-emitting patterns presented by multiple light-emitting devices paired with different seats according to time differences, accurately digitize the effect of multiple areas unfolding in sequence (e.g., crowd waves, sequential lighting), and synchronize it with remote streaming media data, thereby naturally reproducing the effect timeline of each seat.

[0047] Furthermore, the light-emitting device control method and system according to embodiments of the present invention provide a light-emitting mode management interface that can modify the real-time accumulated acquisition data before the streaming media time point. Operators can pre-check and improve light-emitting mode or image information, including light-emitting color, brightness, and effects, thereby improving the completion of the final performance data and achieving the required special effects or color correction according to the planning intention.

[0048] Furthermore, the light-emitting device control method and system according to embodiments of the present invention automatically scales and resampling the collected data based on the physical seating layout and scale information of remote locations, thereby ensuring optimal effect quality from small screening rooms to large stadiums.

[0049] Furthermore, the light-emitting device control method and system according to embodiments of the present invention can grasp the current status of streaming transmission at multiple remote locations and provide an integrated dashboard for effect control based on playlists, so that even if a fault occurs at a remote location, it can respond flexibly and instantly, minimizing the time, manpower and economic losses incurred in the problem-solving process.

[0050] However, the effects that can be obtained by the present invention are not limited to those mentioned above, and other effects not mentioned will become clear from the following content. Attached Figure Description

[0051] Figure 1 This is a conceptual diagram of a remote position lighting control system according to an embodiment of the present invention.

[0052] Figure 2 This is an internal block diagram of the central control terminal according to an embodiment of the present invention;

[0053] Figure 3 This is an internal block diagram of a light-emitting device according to an embodiment of the present invention;

[0054] Figure 4 This is an internal block diagram of a repeater according to an embodiment of the present invention.

[0055] Figure 5 and Figure 6 This is an enlarged flowchart illustrating the provision of remote location-based illumination control services using an AI camera, according to an embodiment of the present invention.

[0056] Figure 7 This is a schematic diagram of the setup site according to an embodiment of the present invention;

[0057] Figure 8 This is a schematic diagram illustrating an example of information collection according to an embodiment of the present invention;

[0058] Figure 9 This is a schematic diagram illustrating an example of a light emission mode management interface according to an embodiment of the present invention;

[0059] Figure 10 This is a flowchart illustrating a method for converting raw effect data into remote location effect data according to an embodiment of the present invention;

[0060] Figure 11 This is a schematic diagram of an example of an interface displaying a seat list according to an embodiment of the present invention;

[0061] Figure 12 This is a schematic diagram of an example of the display interface for candidate blocks according to an embodiment of the present invention;

[0062] Figure 13 and Figure 14This is a schematic diagram illustrating an example of shape scaling according to an embodiment of the present invention;

[0063] Figure 13 and Figure 15 A flowchart illustrating the effect shape scaling calculation according to an embodiment of the present invention;

[0064] Figure 16 and Figure 17 This is a schematic diagram illustrating the functionality of an integrated dashboard in an administrator interface according to an embodiment of the present invention;

[0065] Figure 18 and Figure 19 This is a schematic diagram illustrating an example of the repeater management function of the administrator interface according to an embodiment of the present invention;

[0066] Figure 20 This is a schematic diagram illustrating an example of a synchronization process according to an embodiment of the present invention. Detailed Implementation

[0067] This invention can be modified and has various embodiments, and specific embodiments are illustrated below with reference to the accompanying drawings and described in detail. The effects, features, and prior methods of this invention will become clear in conjunction with the accompanying drawings and the embodiments to be described in detail. However, this invention is not limited to the embodiments described below and can be implemented in various forms. In the embodiments described below, terms such as "first," "second," etc., are non-limiting and are used to distinguish one constituent element from other constituent elements. Furthermore, where there is no obvious distinction in the context, the singular remark includes the meaning of the plural. In addition, terms such as "comprising" or "possessing" do not indicate the presence of the features or constituent elements described in the specification, but exclude the possibility of adding more than one other feature or constituent element. Furthermore, the size of the constituent elements in the drawings may be exaggerated or reduced for ease of explanation. For example, for ease of explanation, the size and thickness of the structures shown in the drawings are arbitrarily represented; therefore, this invention is not limited to the drawings.

[0068] The embodiments of the present invention will now be described in detail with reference to the accompanying drawings. When describing the invention with reference to the accompanying drawings, the same corresponding constituent elements will be given the same reference numerals and repeated descriptions will be omitted.

[0069] The following describes in detail, with reference to the accompanying drawings, an exemplary system (hereinafter referred to as the "remote location light emission control system") that uses an AI camera to capture the effect of light emission devices performed on-site, and controls multiple light emission devices to achieve synchronous light emission based on the effect of light emission devices performed on-site (hereinafter referred to as the remote light emission control service).

[0070] In this embodiment, the remote location illumination control system may include, in addition to the remote location illumination control service, an effect data conversion service and a live streaming service.

[0071] Effects data conversion service refers to the service of converting different seating effect data used in actual performance venues into smaller environments suitable for remote locations such as screening rooms.

[0072] Live streaming service refers to the service of remotely controlling live performances from various remote locations.

[0073] In this embodiment, "remote location" refers to a venue other than the actual performance location, which can be a private space such as a home and / or a public place such as a theater or cinema. Performance images can be streamed in real time at the remote location, and on-site lighting effects can be implemented simultaneously.

[0074] Furthermore, the remote position lighting control service is not limited to real-time streaming; it can also store recorded images on specified recording media (e.g., CD, DVD, HD-DVD, Blu-ray DISC, etc.) after the performance and provide services when playing the stored images.

[0075] Specifically, according to the embodiment, the remote location light emission control service identifies the light emission mode (e.g., color, effect) of the light emission device captured by the AI ​​camera momentarily or continuously and transmits the control signal including the identified light emission mode to the relay station located at a remote location. This service can control the light emission of the light emission device at a remote location even when on-site operators such as performers / demonstrators are absent.

[0076] For ease of explanation, the operation of using an AI camera to extract the light emission patterns of multiple light-emitting devices installed on site will be referred to as "pick-up".

[0077] Figure 1 This is a conceptual diagram of a remote position lighting control system according to an embodiment of the present invention.

[0078] See Figure 1 The system for remote location-based light emission control services can be connected via a central control terminal 100, a service providing server 200, a light emission device 300, a repeater 400, and a network 10.

[0079] In this embodiment, network 10 refers to a connection structure that enables information exchange between nodes such as the central control terminal 100, service providing server 200, light-emitting device 300, and repeater 400. Examples of network 10 include 3GPP (3rd Generation Partnership Project) network, LTE (Long Term Evolution) network, WIMAX (World Interoperability for Microwave Access) network, Internet, LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network), Bluetooth network, satellite broadcasting network, analog broadcasting network, DMB (Digital Multimedia Broadcasting) network, etc., but are not limited thereto.

[0080] The following is a detailed description, with reference to the accompanying drawings, of the central control terminal 100, the service providing server 200, the light-emitting device 300, and the repeater 400 that realize the remote location light-emitting control system.

[0081] ——Central Control Terminal 100

[0082] According to an embodiment of the present invention, the central control terminal 100 may be a specified computing device equipped with a remote location illumination control application (hereinafter referred to as the "application") that provides remote location illumination control services.

[0083] Specifically, in terms of hardware, the central control terminal 100 may include a mobile computing device 100-1 and / or a desktop computing device 100-2, etc., with applications installed.

[0084] The mobile computing device 100-1 can be a mobile device such as a smartphone or tablet with applications installed.

[0085] For example, the mobile computing device 100-1 may include a smartphone, mobile phone, digital broadcasting equipment, PDA (personal digital assistant), PMP (portable multimedia player), tablet PC, etc.

[0086] Additionally, the desktop computing device 100-2 may include personal computers such as desktop computers, laptop computers, and ultrabooks with applications installed, as well as devices with programs that provide remote location lighting control services based on wired / wireless communication.

[0087] In addition, according to different embodiments, the central control terminal 100 may also include a specified server computing device that provides a remote location lighting control service environment.

[0088] Figure 2 This is an internal block diagram of the central control terminal according to an embodiment of the present invention;

[0089] See Figure 2 From a functional point of view, the central control terminal 100 may include a memory 110, a processor assembly 120, a communication processor 130, an interface module 140, an input system 150, a sensor system 160, and a display system 170. These components may be housed within the casing of the central control terminal 100.

[0090] Specifically, memory 110 stores application program 111, which may store one or more of various applications, data and instructions for providing a remote location lighting control service environment.

[0091] That is, the memory 110 can store commands and data that can be used to generate a remote location lighting control service environment.

[0092] In addition, the memory 110 may include a program area and a data area.

[0093] In this embodiment, the program area can be connected between the operating system (OS) and functional components of the central control terminal 100, while the data area can store the data generated by the use of the central control terminal 100.

[0094] In addition, the memory 110 may include at least one non-volatile computer-readable storage medium and a volatile computer-readable storage medium.

[0095] For example, the memory 110 may include various storage devices such as ROM, EPROM, flash drive, hard disk, etc., and may also include web storage that performs the storage function of the memory 110 on the Internet.

[0096] Processor component 120 may include at least one or more processors capable of executing application 111 stored in memory 110 to perform various tasks that generate a remote location lighting control service environment.

[0097] In an embodiment, the processor component 120 can control the overall operation of the component through the application program 111 in the memory 110 to provide remote location lighting control services.

[0098] The processor component 120 may be a system-on-a-chip (SoC) suitable for the central control terminal 100, including a central processing unit (CPU) and / or a graphics processing unit (GPU), which can execute an operating system (OS) and / or applications stored in the memory 110 and control the various components mounted on the central control terminal 100.

[0099] In addition, the processor component 120 can communicate with other components internally via a system bus, which may include one or more defined bus structures, including a local bus.

[0100] In addition, the processor component 120 may include at least one of ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays), controllers, micro-controllers, microprocessors, and other electrical units for function execution.

[0101] The communication processor 130 may include one or more means for communicating with external devices. The communication processor 130 may communicate via a wireless network.

[0102] Specifically, the communication processor 130 can communicate with a terminal that stores content sources for implementing a remote location lighting control service environment, and can communicate with various user input components such as controllers that receive user input.

[0103] In this embodiment, the communication processor 130 can send and receive various data related to the remote location light emission control service with other terminals and / or external servers.

[0104] The communication processor 130 can wirelessly send and receive data with at least one of a base station, an external terminal, or any server on a mobile communication network constructed using a communication device that can execute technical standards or communication methods for mobile communication (e.g., LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), 5G NR (New Radio), WIFI, or short-range communication methods).

[0105] The interface module 140 can connect the central control terminal 100 to one or more other devices for communication. Specifically, the interface module 140 may include wired and / or wireless communication devices compatible with one or more different communication protocols.

[0106] The central control terminal 100 can be connected to various input devices through these interface modules 140.

[0107] For example, interface module 140 can be connected to audio output devices such as headphone jacks or speakers to output audio.

[0108] While the example described is an audio output device connected via interface module 140, embodiments may also include those installed inside the central control terminal 100.

[0109] In addition, for example, the interface module 140 can also be connected to an input device such as a keyboard and / or mouse to obtain user input.

[0110] The interface module 140 may include at least one of the following: a wired / wireless port, an external charging port, a wired / wireless data port, a memory card port, a port for connecting a device with an identification module, an audio I / O port, a video I / O port, a headphone port, a power amplifier, an RF circuit, a transceiver, and other communication circuits.

[0111] Input system 150 can detect user input (e.g., gestures, voice commands, key operations, or other types of input) related to remote location illumination control services.

[0112] Specifically, the input system 150 may include defined buttons, touch sensors, and / or image sensors 161 that receive user motion input, etc.

[0113] In addition, the input system 150 can be connected to an external controller via the interface module 140 to receive user input.

[0114] The sensor system 160 may include various sensors such as an image sensor 161, a position sensor 163 (IMU), an audio sensor 165, a distance sensor, a proximity sensor, and a contact sensor.

[0115] The image sensor 161 can capture images and / or videos of the physical space surrounding the central control terminal 100.

[0116] In an embodiment, the image sensor 161 can capture and acquire various images and / or videos related to the remote location illumination control service.

[0117] In addition, the image sensor 161 can be installed in front of and / or behind the central control terminal 100 to capture images from one side of its orientation, and can also capture images of the physical space through a camera installed outside the central control terminal 100.

[0118] The image sensor 161 may include an image sensor device and an image processing module. Specifically, the image sensor 161 can process still images or videos acquired by the image sensor device (e.g., CMOS or CCD).

[0119] In addition, the image sensor 161 can process still images or videos acquired by the image sensor device using an image recognition process (e.g., OCR) and / or an image processing module, extract the required information, and transmit the extracted information to the processor.

[0120] The image sensor 161 may be a camera assembly including at least one camera. The camera assembly may include a regular camera that captures visible light, or a special camera such as an infrared camera or a stereo camera.

[0121] Furthermore, depending on the specific implementation, the aforementioned image sensor 161 may be included in the central control terminal 100, or in an external device (e.g., an external server) and may be operated in conjunction with the aforementioned communication processor 130 and / or interface module 140.

[0122] In one embodiment, the image sensor 161 may include a first camera for capturing images of the performance venue and / or a second camera for capturing images of the venue for remote location illumination control services. In this case, the second camera may be an AI camera.

[0123] That is, in the embodiments, the AI ​​camera may be included in the central control terminal 100 or exist independently of the central control terminal 100 but be connected to it for linkage operation.

[0124] The position sensor 163 (IMU) can detect one or more of the movement and acceleration of the central control terminal 100. For example, it can be composed of a combination of various position sensors such as accelerometers, gyroscopes, and magnetometers.

[0125] In addition, the position sensor 163 (IMU) can be linked with the GPS and other location communication processors 130 of the communication processor 130 to identify spatial information of the physical space surrounding the central control terminal 100.

[0126] The audio sensor 165 can identify sounds around the central control terminal 100.

[0127] Specifically, the audio sensor 165 may include a sound acquisition microphone for detecting sound output from the field.

[0128] In one embodiment, the audio sensor 165 can receive voice data from the user required for remote location lighting control services.

[0129] In one embodiment, the audio sensor 165 may be located inside the central control terminal 100, but in other embodiments, multiple sound acquisition microphones may exist independently of the central control terminal 100 and be located at multiple locations on site.

[0130] The display system 170 can output graphic images of various information related to remote position illumination control services.

[0131] As an example, the display system 170 may represent various user interfaces for remote location illumination control services.

[0132] The display may include at least one of the following: liquid crystal display (LCD), thin film transistor-liquid crystal display (TFT LCD), organic light-emitting diode (OLED), flexible display, 3D display, and e-ink display.

[0133] The components may be housed within the housing of these central control terminals 100, and the user interface may include a touch sensor 173 on a display 171 that can receive user touch input.

[0134] Specifically, the display system 170 may include a display 171 that outputs images and a touch sensor 173 that detects user touch input.

[0135] For example, the display 171 and the touch sensor 173 form a layered structure or an integrated structure to realize a touch screen. The touch screen serves as a user input section, acting as an input interface between the central control terminal 100 and the user, and also provides an output interface between the central control terminal 100 and the user.

[0136] The central control terminal 100, which includes the aforementioned components, may, according to different embodiments, store at least one or more captured images, acquisition information, illumination mode information, and / or standard data in the memory 110.

[0137] In this embodiment, the central control terminal 100 may include a module with a specified relay function within the terminal, or may send control signals to the light-emitting devices located on site by linking with repeaters set up in multiple locations on site, thereby enabling the sending and receiving of control signals with multiple light-emitting devices.

[0138] In this embodiment, the central control terminal 100 can obtain information in advance about the shape and / or lighting mode (color, effect, etc.) of the light-emitting device 300 that needs to be identified for each performance.

[0139] Furthermore, in this embodiment, the central control terminal 100 can pre-train a prescribed artificial intelligence model based on pre-acquired information and the shape and / or light emission mode (color, effect, etc.) of the light-emitting device 300 actually captured by the AI ​​camera.

[0140] Furthermore, in this embodiment, the central control terminal 100 can pre-learn the first light-emitting mode of the first light-emitting device that needs to be frequently collected.

[0141] On the other hand, according to different embodiments, the central control terminal 100 may also perform at least a portion of the functions performed in the light emission control server 200, which will be described later.

[0142] —Service Providing Server 200

[0143] Furthermore, the service providing server 200 according to embodiments of the present invention can execute a series of processes for providing remote location illumination control services.

[0144] Specifically, in this embodiment, the service providing server 200 can exchange data with the external device required for the light emission control process driven by the external device such as the central control terminal 100, in order to provide the remote location light emission control service.

[0145] More specifically, in an embodiment, the central server 200 can provide an environment for the application 111 to execute on an external device (in an embodiment, a mobile computing device 100-1 and / or a desktop computing device 100-2, etc.).

[0146] For this purpose, the service providing server 200 may include applications, data and / or instructions for running application 111, and send and receive various data based thereon with the external device.

[0147] Furthermore, in this embodiment, the service providing server 200 may be linked with a deep-learning neural network to perform various deep learning operations for remote location illumination control services.

[0148] The deep learning neural network described in this embodiment may include Convolutional Neural Network (CNN), R-CNN (Regions with CNN features), Fast R-CNN, Faster R-CNN, Mask R-CNN, etc., and may include any deep learning neural network capable of executing the algorithms of the embodiments described later. The embodiments of the present invention do not limit or restrict the deep learning neural network itself.

[0149] At this time, depending on the different embodiments, the deep learning neural network may be directly installed on the service provider server 200, or run as a device independent of the service provider server 200 to perform deep learning for remote location light emission control services.

[0150] In addition, in one embodiment, the service providing server 200 may store at least one machine learning model.

[0151] For example, the service provider server 200 may include multiple machine learning models such as multiple neural networks (e.g., deep neural networks) that perform remote location illumination control service provisioning methods based on qualitative / quantitative data, or other types of machine learning models including nonlinear models and / or linear models, and may be composed of combinations thereof.

[0152] As an example, machine learning models can store linear regression, decision trees, random forests, gradient boosting pre-trained language models, and / or deep learning models, etc. Furthermore, neural networks can include one or more of feed-forward neural networks, recurrent neural networks (e.g., long short-term memory recurrent neural networks), convolutional neural networks, and / or other forms of neural networks.

[0153] To train this machine learning, in an embodiment, the service providing server 200 may also include a model trainer.

[0154] For example, the model trainer can update the machine learning model parameters for the remote location illumination control service through backpropagation based on a defined loss function.

[0155] In some embodiments, backpropagation of the execution error may include truncated backpropagation through time. The model trainer may perform various generalization techniques (e.g., weight decay, dropout, and / or knowledge distillation) to improve the generalization ability of the machine learning model being trained.

[0156] Furthermore, the model trainer can train the machine learning model based on a series of training data. This training data can include different forms of data, such as audio samples and / or text.

[0157] Furthermore, according to different embodiments, the service providing server 200 may also store models for each process and prompt templates as the basis for model input, so as to perform at least a portion of the scene recognition-based remote location illumination control service providing method through a large language model (LLM).

[0158] In one embodiment, the central control terminal 100 can receive at least one machine learning model from the service provider server 200 via a network, store it in the memory 110, and then the processor component 120 executes the stored machine learning model to perform a remote location light emission control service provision method, etc.

[0159] In other embodiments, the central control terminal 100 may be linked with the service provider server 200 to perform actions through at least one machine learning model and provide remote location lighting control services to users (in this embodiment, users of the central control terminal 100) in a manner that communicates with external entities.

[0160] For example, the central control terminal 100 can enable the service provider server 200 to perform remote location lighting control services by using a machine learning model to output user input via a network.

[0161] In addition, artificial intelligence models can also be implemented in the following way: at least part of the machine learning model is executed in the central control terminal 100, and the rest of the model is executed in the service providing server 200.

[0162] In the following embodiments, an example will be described based on an embodiment in which a deep learning neural network and / or machine learning model is directly installed and executed in the service provider server 200.

[0163] Furthermore, in an embodiment, the service providing server 200 may read from memory a specified deep learning neural network driver built for performing deep learning, and perform the following deep learning based on the read specified deep learning neural network system.

[0164] Specifically, in the embodiments, the service providing server 200 may further include a data storage computing system (hereinafter referred to as "data storage") that continuously stores and manages the raw data that forms the basis of the remote location light emission control service.

[0165] This data storage can include various forms of data repositories, ranging from file systems to cloud storage. For example, data storage can be at least one of the following databases: relational databases that use Structured Query Language (SQL) to define and manipulate data; NoSQL databases designed for flexibility and scalability to handle unstructured and semi-structured data; data warehouses that centralize large-scale datasets from multiple sources as systems for reporting and data analysis, optimizing them for querying and analysis; data warehouses used to store massive amounts of raw data as structured, semi-structured, and unstructured data; and local storage devices or NAS (Network Attached Storage) that typically store data in files in a form accessible to the computer's operating system.

[0166] Additionally, in this embodiment, the service providing server 200 may store and manage various applications, instructions, and / or data used to implement remote location lighting control services.

[0167] For example, the service provider server 200 can store and manage live video, captured video, acquired information, illumination mode information, standard data and / or illumination mode management interface, etc.

[0168] However, in this embodiment of the invention, the functional operations that the service providing server 200 can perform are not limited to the content described above, and may also perform other functional operations.

[0169] In addition, see also Figure 1 In an embodiment, the service providing server 200 may be implemented as a specified computing device, which includes at least one or more processor modules 210 for data processing, at least one or more communication modules 220 for data exchange with external devices, and at least one or more memory modules 230 for storing various applications, data and / or instructions for providing remote location lighting control services.

[0170] The memory module 230 can store one or more of the following: operating system (OS), various applications, data, and instructions used to provide remote location lighting control services.

[0171] In addition, the memory module 230 may include a program area and a data area.

[0172] In this embodiment, the program area can be connected between the operating system (OS) and functional components of the boot server, while the data area can store data generated during the use of the server.

[0173] In this embodiment, the memory module 230 may be various storage devices such as ROM, RAM, EPROM, flash drive, hard disk, etc. On the Internet, it may also include web storage that performs the storage function of the memory module 230.

[0174] Alternatively, the memory module 230 can be a storage medium that can be removably mounted on the server.

[0175] In addition, the processor module 210 can control the overall operation of the aforementioned units to realize remote location light emission control services.

[0176] The processor module 210 may be a system-on-a-chip (SoC) suitable for a server, including a central processing unit (CPU) and / or a graphics processing unit (GPU), which can execute an operating system (OS) and / or applications stored in the memory module 230 and control the various components mounted on the server.

[0177] In addition, the processor module 210 can communicate with various components internally via a system bus, which may include one or more defined bus structures, including a local bus.

[0178] In addition, the processor module 210 may utilize at least one implementation of ASICs (application-specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays), controllers, micro-controllers, microprocessors, or other electrical units for function execution.

[0179] In the above description, the functional actions are performed by the service providing server 200 according to the embodiments of the present invention. However, according to different embodiments, at least a portion of the functional actions performed by the service providing server 200 may also be performed in an external device (e.g., a central control terminal 100), and at least a portion of the functional actions performed in the external device may also be performed in the service providing server 200, and so on.

[0180] In this embodiment, the service provider server 200 acts as an administrator (admin) for managing the entire remote control system and can acquire live video footage in real time from the central control terminal 100 and / or a separate device used for filming the performance and stream it.

[0181] Specifically, in this embodiment, the service providing server 200 can sequentially accumulate and temporarily store the collected light emission pattern information according to a preset cycle when the AI ​​camera performs shooting.

[0182] Furthermore, in this embodiment, the service providing server 200 can determine the actual implementation status of the accumulated light emission mode information by setting a specific time point as the start time point and / or the end time point.

[0183] Furthermore, in this embodiment, the service providing server 200 can correct errors in the accumulated light emission pattern information by verifying the collected light emission pattern information. For example, errors in the light emission pattern information include discrepancies between the extracted light emission color and the actual light emission color at the scene, or incorrect effect settings.

[0184] Specifically, the verification of the collected emission pattern information is based on a pre-trained artificial intelligence model, which is pre-trained according to the type of emission device and based on the color code. Therefore, the service providing server 200 according to the embodiment can easily detect situations where colors not used by the emission device are extracted.

[0185] ——Lighting device 300

[0186] In an embodiment of the present invention, the light-emitting device 300 may be a prescribed device that emits light based on a control signal receiving a terminal located at a local and / or remote location (in an embodiment, a central control terminal 100 and / or a repeater 400) that includes set values ​​for brightness, hue, saturation, effect, etc.

[0187] Figure 3 This is an internal block diagram of a light-emitting device according to an embodiment of the present invention;

[0188] See Figure 3 In one embodiment, the light-emitting device 300 includes a near-field communication unit 310, an information receiving unit 320, a light-emitting unit 330, a storage unit 340, a battery 350, a charging unit 360, a sensor unit 370, an input unit 380, and a processor 390.

[0189] The proximity communication unit 310 may include one or more devices for communicating with external devices. The proximity communication unit 310 may communicate via wireless and / or wired networks.

[0190] In this embodiment, the near-field communication unit 310 can send and receive various data related to the remote location illumination control service with other terminals and / or external servers. Specifically, in this embodiment, the near-field communication unit 310 can receive control signals including predetermined control commands.

[0191] The near-field communication unit 310 may include a wireless communication module (e.g., at least one of an infrared communication module, NFC, IR transceiver, RF transceiver, Zigbee, Bluetooth and WIFI module).

[0192] As an example, the light-emitting device 300 may receive control signals based on each predetermined period (e.g., 10ms) of the near-field communication unit 310.

[0193] The information receiving unit 320 may include a broadcast receiver for receiving information transmitted in a broadcasting manner in a transmitter and other devices. Specifically, the broadcast receiver may receive radio waves emitted from the transmitter via an antenna and obtain control signals by filtering the received radio waves.

[0194] In other words, the information receiving unit 320 is able to receive specified information (as an example, light emission mode information) included in the control signals transmitted from the central control terminal 100 and / or the repeater 400.

[0195] The light-emitting unit 330 emits light based on the control signal received by the information receiving unit 320.

[0196] The light-emitting part 330 may include one or more light source elements, and the light source may be a light-emitting diode (LED) for example. In addition, the light-emitting part 330 may include LEDs of different colors, for example, one or more of red LEDs, green LEDs, blue LEDs and white LEDs.

[0197] A wide range of colors can be obtained by mixing the light emitted by each of the LEDs. The mixed color depends on the ratio of the intensities of the light emitted by each LED, and the intensity of the light emitted by each LED can be proportional to the driving current of each LED.

[0198] The multiple LEDs included in the light-emitting unit 330 can be arranged in a dot pattern, and the multiple LEDs can selectively emit light under the control of the processor 390, which will be described later, to display specific sentences (text), images, or videos.

[0199] The above description uses an LED as an example for the light source of the light-emitting part 330, but the type of light source is not limited to LED. According to another embodiment, an organic light-emitting diode (OLED) can also be used as the light source.

[0200] Storage unit 340 can store one or more of various applications, data, and instructions used to provide a remote location lighting control service environment.

[0201] In addition, the storage unit 340 can store data received or generated from other components of the remote position lighting control system. The storage unit 340 can be various storage devices such as ROM, EPROM, flash drive, hard disk and / or USB drive, and may include memory, cache and buffer.

[0202] In this embodiment, the storage unit 340 may pre-store information required to realize the light-emitting function of the light-emitting device 300.

[0203] In this embodiment, the storage unit 340 may store at least one or more effect data and / or light emission mode information of the light emission mode of the light emission device 300.

[0204] Additionally, in this embodiment, the storage unit 340 may store information required for performing remote location light emission control services.

[0205] The battery 350 can obtain external and / or internal power through the control of the processor 390 to supply the power required for operation to each component of the light-emitting device 300.

[0206] The battery 350 may also include a DC / DC converter that can convert the received power into a voltage level usable by the carrier of the light-emitting device 300.

[0207] In addition, battery 350 may include more than one battery cell. The type of each battery cell is not particularly limited, as long as it is a rechargeable and rechargeable cell such as a lithium-ion battery cell.

[0208] The charging unit 360 may include a wired and wireless charging module for providing power for the operation of the light-emitting device 300 via wired and wireless processes.

[0209] The sensor unit 370 may include at least one of the following sensors: position sensor (IMU), accelerometer, gyroscope, distance sensor, proximity sensor, contact sensor, and illuminance detection sensor.

[0210] Specifically, the position sensor (IMU) included in the sensor unit 370 can detect at least one of the motion and acceleration of the light-emitting device 300. For example, it can be composed of a combination of various position sensors such as accelerometers, gyroscopes, and magnetometers.

[0211] The input unit 380 is capable of detecting input (e.g., gestures, button operations or other types of input) from users (e.g., viewers using the light-emitting device 300) related to the remote position light-emitting control service.

[0212] Specifically, the input unit 380 may include specified buttons and / or touch sensors, etc.

[0213] In addition, the input unit 380 is connected to an external controller to receive user input.

[0214] The processor 390 can control the overall operation of the light-emitting device 300, including power supply control, and can also perform data processing functions such as controlling signal flow between the internal components of the light-emitting device 300 and processing data. The processor 390 may include at least one processor.

[0215] In addition, the processor 390 can communicate with various components internally via a system bus, which may include more than one defined bus structure, including a local bus.

[0216] Additionally, the processor 390 may include at least one of ASICs (application-specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays), controllers, micro-controllers, microprocessors, and other electrical units for function execution.

[0217] In this embodiment, the processor 390 controls the light emission mode of the light output from the light-emitting unit 330 by controlling the driving current of each LED in the light-emitting unit 330.

[0218] Thus, in this embodiment, the processor 390 can control a light-emitting device 300 including multiple LEDs to form a specified sentence, image, or video.

[0219] The light-emitting device 300, including the aforementioned structure, can operate under the control of the processor 390 based on at least one piece of data stored in the storage unit 340.

[0220] Furthermore, in this embodiment, the light-emitting device 300 may emit light based on the light-emitting section 330, according to control signals received from the central control terminal 100, a designated repeater, and / or a transmitter.

[0221] At this time, the control signal may include the light emission mode information included in the control signal itself, or command data to activate the light emission based on the effect data stored in the light emission device 300.

[0222] Furthermore, in the embodiments, the light-emitting device 300 can detect the motion and acceleration of the light-emitting device 300 based on the sensor unit 370.

[0223] Furthermore, in this embodiment, the light-emitting device 300 can identify ambient sounds based on the sensor unit 370 and control the performance according to the identified sounds. For example, the louder the sound detected, the brighter the light emitted can be correspondingly increased.

[0224] Furthermore, in this embodiment, the light-emitting device 300 can transmit the data detected by the sensor unit 370 and / or the input unit to other devices (e.g., the central control terminal 100).

[0225] Furthermore, in one embodiment, the light-emitting device 300 can be passively operated by a command signal (control signal) transmitted from an external source. In another embodiment, the light-emitting device 300 can also operate autonomously based on an input section 380 (e.g., a designated button).

[0226] The concept of action is diverse and not limited to a certain form. For example, various forms of action can be realized depending on the type of light-emitting device 300, such as light-emitting action, generating action, mechanical action, etc. (e.g., cheering stick, light-emitting device, light stick, wearable wristband and / or wearable device).

[0227] ——Repeater 400

[0228] According to an embodiment of the present invention, the repeater 400 may be a computing device that receives light emission mode data from the remote location light emission control application 111 and / or service providing server 200 of the central control terminal 100 that provides remote location light emission control services, and sends control signals containing the received light emission mode data to control multiple light emission devices within a specified distance.

[0229] Specifically, in the embodiments, the repeater 400 can communicate with the central control terminal 100 and / or the service provider server 200 via a wired or wireless network to obtain at least one light emission mode data and send a control signal to activate the light emission device to emit light according to the obtained light emission mode data.

[0230] In one embodiment, the repeater 400 may be a device that is pre-installed at a predetermined remote location different from the actual performance venue for the live performance and sends predetermined control signals to at least one light-emitting device detected within a preset range.

[0231] In an embodiment, repeater 400 may include a repeater terminal and / or an antenna.

[0232] The repeater terminal and antenna can have a 1:1 and / or 1:n relationship. In this case, the antenna can be a directional antenna.

[0233] The repeater terminal can be installed indoors, and the antenna can be installed outdoors. For example, the repeater terminal can be installed on a wall or ceiling indoors, and the antenna can be installed on the exterior wall or railing of a building outdoors.

[0234] In addition, the repeater terminal may include an LCD display. In this case, the LCD display may display the specified information for providing remote location illumination control services.

[0235] The advantage of the repeater 400 is that it can send control signals simply by installing the repeater at a designated location, without having to detect the position of each light-emitting device individually, thus making it easy to control multiple light-emitting devices without having to pair them one by one.

[0236] Furthermore, in this embodiment, the repeater 400 can send a specified control signal to at least one light-emitting device detected within a preset range according to the setting information.

[0237] In this embodiment, the configuration information may include the signal radius and / or propagation direction. This configuration information may be preset by the remote location-based light emission control server administrator (hereinafter referred to as the "administrator").

[0238] Figure 4 This is an internal block diagram of a repeater according to an embodiment of the present invention.

[0239] like Figure 4 As shown, the repeater 400 may include a control signal transmitting unit 410, a control signal receiving unit 420, an input module 430, and a control unit 440. These components may be housed within the repeater 400's casing.

[0240] Specifically, the control signal transmitting unit 410 may include one or more means for communicating with the central control terminal 100 and / or the service providing server 200.

[0241] In addition, the control signal transmitting unit 410 can also communicate with other terminals to realize a control signal communication environment.

[0242] In this embodiment, the control signal transmitting unit 410 can send and receive various data related to control signal communication with other terminals and / or external servers.

[0243] The control signal transmitting unit 410 can wirelessly transmit and receive data with at least one of a base station, an external terminal, an arbitrary server, or an antenna on a mobile communication network constructed using a communication device that can execute technical standards or communication methods for mobile communication (e.g., LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), 5G NR (New Radio), WIFI, or short-range communication methods (e.g., NFC, RFID) and / or wireless communication methods (RF, IR).

[0244] Furthermore, in this embodiment, the control signal transmitting unit 410 may transmit information based on a short-range communication method.

[0245] Therefore, in this embodiment, the control signal transmitting unit 410 may include a wireless communication module for near-field communication (e.g., at least one of NFC, RF transmitter / receiver, Zigbee, Bluetooth, and WIFI modules).

[0246] Furthermore, in an embodiment, the control signal transmitting unit 410 can transmit control signals received from the central control terminal 100 and / or the service providing server 200 to at least one other device (as an example, a light-emitting device) in a one-to-many manner.

[0247] For example, the control signal transmitting unit 410 can transmit a control signal to at least one light-emitting device via broadcasting (an all-to-all communication method that transmits traffic to an unspecified number of people without specifying a recipient).

[0248] Specifically, the control signal transmitting unit 410 can transmit control signals to nearby light-emitting devices via a preset broadcast protocol. The nearby light-emitting devices, which are configured to receive broadcast signals of the preset broadcast protocol, can receive the transmitted control signals and operate according to the received control signals.

[0249] At this time, the preset broadcast protocol may refer to frequency band, control signal encoding / decoding method, etc. The control signal transmitting unit 410 may include a broadcast transmitter. In addition, the broadcast transmitter may include an exciter composed of an oscillator and a modulator to modulate the control signal received from the terminal 100 into radio waves of a specified frequency band according to the preset broadcast protocol and transmit the RF signal through an antenna.

[0250] The control signal transmitting unit 410 can overcome the shortcomings of Bluetooth (BLE) technology, such as low transmission speed, short transmission distance, small data capacity, and excessive power consumption, by using a broadcast method. It can easily control multiple light-emitting devices, save the time required for users to pair the control signal repeater 400 with each light-emitting device individually, and improve the speed of data transmission.

[0251] Furthermore, in the embodiments, when the control signal transmitting unit 410 acquires a specific event and / or trigger, it may also need to send a control signal to activate the specified effect data (e.g., infinite loop).

[0252] On the other hand, the control signal receiving unit 420 can receive control signals from other terminals and / or servers, including the terminal 100.

[0253] The control signal receiving unit 420, like the control signal sending unit 410, may include one or more devices for communicating with the terminal 100, and its contents are the same as those described above, so they will not be repeated here.

[0254] The input module 430 can detect user input (e.g., gestures, voice commands, key operations or other types of input) related to lighting device control services.

[0255] Therefore, the input module 430 may include specified buttons, controllers, touch sensors, and / or image sensors that receive user motion input.

[0256] In addition, the input module 430 can be connected to an external controller via an interface to receive user input.

[0257] In addition, the input module 430 can also receive user input (e.g., touch input, mouse input, keyboard input, gesture input, action input using a guide tool, etc.).

[0258] For example, repeater 400 can use various communication protocols to wire and / or wirelessly connect input module 430 to at least one device such as a numeric keypad or IR remote control to obtain user input.

[0259] At this time, repeater 400 may include an interface (e.g., a USB connection port) to obtain user input via a wired connection.

[0260] That is, the types of input modules 430 that are input to repeater 400 may include inputs that are operated directly, wired inputs, and / or wireless inputs.

[0261] For example, the input can be performed based on a series of wired and wireless input devices (e.g., keyboard, numeric keypad, mouse, remote control, etc.) connected to the USB connection port of repeater 400.

[0262] In the case of wired input, control can be performed over a distance equal to the cable length. Furthermore, in the case of wireless input, input can be made using IR, RF, NFC, Bluetooth, and / or a remote control linked to repeater 400. In this case, there must be no obstructions in front of the IR sensor of repeater 400 and / or the remote control.

[0263] Furthermore, in embodiments, the repeater 400 may also include an output system (e.g., a display, etc.) for displaying information specified according to the remote location light control suit.

[0264] The control unit 440 may include at least one processor capable of executing commands for sending and receiving at least one control signal to perform various tasks for generating a remote location lighting control service environment.

[0265] Furthermore, in this embodiment, the repeater 400 may include at least one location sensor (e.g., GPS). Therefore, the control unit 440 may provide the location information of the repeater obtained by the location sensor to the linked terminal 100 and / or the service providing server 300.

[0266] Furthermore, in this embodiment, the repeater 400 may include at least one image sensor (e.g., a camera). Therefore, the control unit 440 provides images and / or video of the physical space surrounding the repeater 400 to the linked central control terminal 100 and / or service provider server 200.

[0267] Furthermore, in this embodiment, the repeater 400 may include at least one illuminance sensor. Therefore, the control unit 440 periodically measures the brightness at a remote location using the illuminance sensor and provides this information to the terminal 100 and / or the service providing server 200.

[0268] In this embodiment, the control unit 440 can control the overall operation of each component of the repeater 400 to provide remote location lighting control services. For an explanation of the implementation of the control unit 440, please refer to the description in the contents of the processor component 120 of the central control terminal 100.

[0269] —A method for controlling multiple light-emitting devices using an AI camera

[0270] The following will describe in detail a method for implementing remote position light emission control services for controlling multiple light emission devices using an AI camera, or a remote position light emission control system (hereinafter referred to as "computing system 1000") or at least one component included in the system, according to an embodiment of the present invention.

[0271] Figure 5 and Figure 6 This is an enlarged flowchart illustrating the provision of remote location-based illumination control services using an AI camera, according to an embodiment of the present invention. Figure 5 The flowchart is based on the service provider server 200. Figure 6 This is a flowchart illustrating the division of the main components into the various devices that make up the remote position lighting control system.

[0272] See Figure 5 and Figure 6 In one embodiment, the computing system 1000 can activate an AI camera to capture the scene (S101).

[0273] An AI camera is a camera that performs real-time analysis of captured images and / or videos based on a defined artificial intelligence model / algorithm.

[0274] In this embodiment, the AI ​​camera can capture images of multiple light-emitting devices 300 set up on-site for remote location light-emitting control services, and perform real-time analysis of the captured images and / or videos based on a preset image analysis artificial intelligence model / algorithm, thereby collecting and generating the data required for the remote location light-emitting control services.

[0275] Therefore, in this embodiment, the administrator may set up at least two light-emitting devices 300 on site to collect a specified light-emitting pattern from captured images and / or videos.

[0276] Figure 7 This is a schematic diagram of the setup site according to an embodiment of the present invention.

[0277] See Figure 7 In one embodiment, the scene setting (SP) may consist of an AI camera 161-A that aggregates multiple light-emitting devices 300 paired with different seats into a spacing that can be included in a single frame and captures the scene.

[0278] At this time, each light-emitting device 300 can be mounted on a dedicated charging cradle to prevent battery discharge. Furthermore, the AI ​​camera 161-A can be positioned at a fixed angle or continuously aiming at the light-emitting device 300 for shooting.

[0279] Furthermore, the "different seats" may refer to seats located in different main areas that are assigned to different lighting times during the presentation of dynamic effects. This is intended to facilitate administrators in easily visually confirming the lighting time differences between the various lighting devices 300 when the dynamic effects are achieved.

[0280] In one embodiment, the computing system 1000 can activate the AI ​​camera 161-A to capture images of the scene based on user input to the AI ​​camera 161-A.

[0281] Therefore, the user (specifically the field operator) can activate the AI ​​camera 161-A through the application 111 of the central control terminal 100 and / or the designated button on the AI ​​camera 161-A, thereby starting to capture images of the light-emitting device 300 at the setup site (SP).

[0282] For example, a field operator can activate the AI ​​camera 161-A by clicking the “send” button on the remote location light control application 111 or by pressing the “record” button on the AI ​​camera 161-A.

[0283] It should be noted that on-site operators can be deployed only at the performance venue, without needing to be deployed in a remote location. Furthermore, the activation time of the AI ​​camera 161-A does not need to coincide with the start time of the performance; it can also be set to a specified time before or after the performance.

[0284] Furthermore, in this embodiment, the computing system 1000 can acquire the acquisition information of the light-emitting device from the activated AI camera 161-A (S103).

[0285] At this time, the acquired information may refer to the light emission mode information of the light emission device 300 extracted (i.e. acquired) from the images and / or videos (hereinafter referred to as "captured images") captured by the AI ​​camera 161-A.

[0286] Figure 8 This is a schematic diagram illustrating an example of information collection according to an embodiment of the present invention.

[0287] See Figure 8 In this embodiment, the computing system 1000 can acquire acquisition information PI, which includes light emission mode information of at least one light-emitting device 300. Specifically, first acquisition information PI-1 can be acquired for the first light-emitting device 300-1, and second acquisition information PI-2 can be acquired for the second light-emitting device (300-2).

[0288] According to different embodiments, the light emission mode information refers to the information specified by the light emission device 300 regarding the light emission pattern of the light emission component operating according to the light emission mode (e.g., ON mode, OFF mode and / or sound recognition mode), light emission color, light emission time, light emission brightness and / or light emission effect.

[0289] In this embodiment, the emission mode information may include color parameters, HSL parameters, and / or effect parameters.

[0290] Color parameters can be parameters that represent the emitted color through RGB, HEX, CMYK values ​​and / or values ​​of each color channel.

[0291] The color of emitted light can be represented by converting the values ​​of each color channel into a sequence number through calculation. For example, when the differences between the values ​​of each color channel are large, it can represent a high-saturation color, and when the differences between the values ​​of each color channel are small, it can represent a low-saturation color.

[0292] As another example, the emission color can also be represented by a prescribed color code (for example, red, blue, purple, etc.). As yet another example, the emission color can be represented by a serial number pre-assigned to a prescribed color, taking convenience or security into consideration. Furthermore, when an artist and / or team has a proprietary color, that proprietary color can be automatically set as the emission color of a specific emission device 300.

[0293] For ease of explanation, the emission colors in the examples described below will be based on color codes using preset letters.

[0294] HSL parameters can be parameters that represent luminescence properties through hue, saturation, and lightness.

[0295] The HSL parameter, used to represent luminescence properties, can determine the luminescence mode and / or luminescence brightness. For example, the detailed properties of the color parameter can be described by hue and saturation, or by determining and representing the luminescence mode (e.g., determining the luminescence mode as OFF when the saturation is 0%).

[0296] The HSL parameter can be expressed in terms of luminescence properties, for example, (60°, 100%, 50%).

[0297] Effect parameters can be parameters that represent the light-emitting effect. They are set to change various light-emitting components within a specified time to generate dynamic visual effects.

[0298] Glowing effects can be represented by effect names (e.g., Blink, Gradation, Fade In, Fade Out) or by specific values ​​that refer to each effect.

[0299] For example, the light-emitting effects include: 1) Blink effect, in which the light-emitting part 330 is quickly turned off and on by setting different settings for different times within a specified time; 2) Gradation effect, in which the color is gradually changed by setting different settings for different times within a specified time; 3) Fade In / Out effect, in which the brightness is gradually reduced or increased by setting different settings for different times.

[0300] In addition, the duration of the luminescence effect (i.e., the luminescence time) can be determined based on the effect parameters.

[0301] In an embodiment, the computing system 1000 can acquire the acquisition information PI of the light-emitting device from the AI ​​camera 161-A, which performs real-time analysis based on a prescribed artificial intelligence model and / or algorithm (hereinafter referred to as the "image analysis model").

[0302] At this time, the AI ​​camera 161-A can simultaneously extract and generate the acquisition information PI of each of the multiple light-emitting devices 300 included in the captured image.

[0303] Specifically, according to the embodiment, the AI ​​camera 161-A can calculate the average RGB value and / or HSL value of pixels within the ROI. Furthermore, it detects color parameters and / or HSL parameters by determining the closest color name based on similarity to user- and system-defined colors. Additionally, it detects effect parameters by analyzing brightness fluctuation patterns and color change cycles between consecutive frames.

[0304] In other words, in the embodiment, the computing system 1000 can acquire light emission mode information, including color parameters, HSL parameters, and / or effect parameters of the light emission device 300 captured by the AI ​​camera 161-A, as acquisition information PI.

[0305] In this embodiment, by acquiring the collected information PI, the AI ​​camera 161-A can also acquire the shape of the light-emitting device 300 and the color code of the light-emitting device (based on color parameters and / or HSL parameters).

[0306] In this embodiment, the computing system 1000 can pre-train the AI ​​camera 161-A (i.e., the image analysis model) based on the shape of the light-emitting device detected by the acquisition information PI and the color code corresponding to each light-emitting device shape (collectively referred to as feature information).

[0307] In this embodiment, the reason for using the color codes corresponding to the shapes of each light-emitting device for image analysis model pre-training is that even with the same color parameters, the actual emitted color can deviate due to differences in the design schemes and hardware of different artists. Furthermore, in joint concerts featuring multiple artists performing simultaneously, the function of activating only the light-emitting device corresponding to the currently performing artist can also be implemented.

[0308] For example, even though the first and second light-emitting devices, which are designed for different artists, emit light in the color specified as "RED", the actual color emitted may still vary depending on the differences in hardware and the structure of the light-emitting part.

[0309] Therefore, the AI ​​camera 161-A according to the embodiment needs to learn in advance the specific color values ​​(i.e., color codes) used by each light-emitting device according to the shape of each light-emitting device.

[0310] Specifically, according to the embodiment, the AI ​​camera 161-A can identify the shape of the light-emitting device based on an image analysis model employing a prescribed object recognition algorithm (e.g., object recognition CNN).

[0311] At this point, the image analysis model can map the corresponding device ID to the shape of a specific light-emitting device. This allows the artist to be identified based on the mapped device ID. The device ID can also be pre-stored in each light-emitting device 300.

[0312] Furthermore, according to the embodiment, the AI ​​camera 161-A can extract and display color codes based on the shape of a specific light-emitting device and its color parameters and / or HSL parameters.

[0313] That is, in the embodiment, the AI ​​camera 161-A can map and store the shape and color code of the light-emitting device, and train an image analysis model based on the stored mapping data.

[0314] In summary, in the embodiments, the computing system 1000 can acquire the acquisition information PI based on the AI ​​camera 161-A, which is pre-trained to take captured images as input data and acquire acquisition information PI, including the color code corresponding to the shape of the light-emitting device, as output data.

[0315] Furthermore, in this embodiment, the central control terminal 100 can set frequently collected information PIs that are collected more than a preset number of times from the first emission as common tags, and pre-train the set common tags. This can effectively reduce the error rate during actual collection.

[0316] For example, if the artist-specific color of the first light-emitting device is "Rose Quartz" and the commonly used light-emitting effect is "Breath", then the light-emitting mode information including "Rose Quartz" + "Breath" can be set as the commonly used label of the first light-emitting device for pre-learning.

[0317] Furthermore, in this embodiment, the computing system 1000 can sequentially accumulate the acquired collection information PI to the service providing server 200 in chronological order. In this case, to accumulate the collection information PI in chronological order, a timestamp of the emission (pattern) detection time can be mapped to each collection information PI.

[0318] That is, the collected information PI according to the embodiment may include timestamp, device ID, light emission mode information (specifically, the light emission color, light emission time, light emission brightness and / or light emission effect, etc. according to the color code corresponding to each light emission device) and / or common tags.

[0319] Furthermore, in this embodiment, the computing system 1000 can correct the accumulated acquisition information based on the light emission mode management interface (S105).

[0320] In this embodiment, the light emission mode management interface can refer to the interface that displays the collected information PI analyzed and collected by the AI ​​camera 161-A in real time and then transmitted to the service provider server 200.

[0321] Specifically, in this embodiment, the light emission mode management interface refers to an interface that allows administrators to make modifications during the time difference between the acquisition time of the acquisition information PI and the streaming transmission time of the live video played at a remote location.

[0322] Figure 9 This is a schematic diagram of an example of a light emission mode management interface according to an embodiment of the present invention.

[0323] See Figure 9 In this embodiment, the computing system 1000 can correct the real-time accumulated acquisition information PI based on the light emission mode management interface 5000.

[0324] The illumination mode management interface 5000 may consist of a collection information list 5100, a timeline view 5200, and / or a modification panel 5300.

[0325] The information collection list 510 can be a list displaying timestamps, device IDs, and light emission mode information (specifically, light emission color, light emission time, light emission brightness, and / or light emission effect, etc.).

[0326] At this point, the collected information PIs can be continuously accumulated and displayed line by line in chronological order. Furthermore, checkboxes and / or drop-down menus can be set to display only the collected information PIs that meet the specified conditions.

[0327] In this embodiment, when an administrator clicks on a specific data collection information PI, the detailed content of that data collection information PI can be displayed in the timeline view 5200 and / or the modification panel 5300.

[0328] In addition, on the side of the information collection list 5100, to support the administrator in intuitively confirming the actual luminous status of the luminous device, a real-time image 511, including real-time captured images and / or videos of the setup site, can be displayed.

[0329] The timeline view 5200 can be a timeline chart visualization panel that shows which data points (PIs) were collected at specific points in time according to the flow of time.

[0330] In this embodiment, the computing system 1000 can generate independent trajectories (in other words, horizontal time axes) for each of the different light-emitting devices that are collected when multiple light-emitting device shapes are detected.

[0331] That is, the timeline view 5200 can display a number of tracks corresponding to the number of light-emitting devices (in other words, a horizontal timeline).

[0332] In addition, the timeline view 5200 can visually present to the administrator how the light emission mode information of the light emission device 300 changes over time by displaying blocks on the generated track that reflect the emission color of the acquired information PI.

[0333] At this time, black blocks can be displayed in the black area. In this embodiment, the computing system 1000 may further provide a UI so that when an administrator clicks on a black block, they can select the black effect processing method.

[0334] For example, black screen effect processing methods may include: first, setting the glow mode to OFF mode; second, maintaining the glow color that matches the previous blocks in the black screen block; and third, using the color obtained by mixing the glow colors of two or more glow devices in a non-black screen state.

[0335] In addition, the timeline view 5200 can display the playhead indicating the current playback position.

[0336] In this embodiment, when an administrator clicks on a designated location, the corresponding data collection information PI can be displayed in the timeline view 5200 and / or the modification panel 5300.

[0337] The modification panel 5300 can display the currently selected first acquisition information PI in the acquisition information list 5100 and / or time axis view 5200.

[0338] In addition, the modification panel 5300 can provide a UI for modifying at least one of the components (hereinafter referred to as "light emission mode components") that constitute the first acquisition information PI.

[0339] In this embodiment, the administrator can confirm the actual light emission mode through the real-time screen 5110 included in the information collection list 5100. If it is determined that there is a difference between the collected information PI and the actual light emission mode, the administrator can click on the collected information PI to modify the specified light emission mode component value.

[0340] Therefore, in this embodiment, the computing system 1000 can correct the value of the light emission mode component contained in at least one accumulated acquisition information PI based on the specified input detected in the light emission mode management interface.

[0341] Therefore, in an embodiment, the computing system 1000 can determine the corrected acquisition information PI as final emission mode information to be included in the control signal to be sent to the repeater.

[0342] On the other hand, based on the light emission mode management interface, the administrator makes modifications during the specified time difference between the acquisition time point and the streaming transmission time point. Since the time difference is relatively short within a preset range (from a few seconds to a few minutes), functions that can improve the accuracy and speed of modification may be needed.

[0343] Therefore, in this embodiment, the computing system 1000 can provide AI-based modification assistance and one-click modification functions in the light emission mode management interface, enabling administrators to accurately and efficiently complete the correction of the collected information PI within a limited time.

[0344] To provide the aforementioned functionality, in an embodiment, the AI ​​camera 161-A may pre-store information on the illumination patterns used, based on the artist and / or performance, as standard data, based on pre-learned feature information.

[0345] Furthermore, in this embodiment, the AI ​​camera 161-A can compare the light emission pattern information collected during the shooting process with the standard data in real time to calculate the difference value.

[0346] In this embodiment, the computing system 1000 can obtain the calculated difference value from the AI ​​camera 161-A. When the difference value exceeds a set threshold, the collected information PI is highlighted in the light emission mode management interface 5000.

[0347] At this time, the highlighting can be achieved, for example, by using visually easily distinguishable forms such as independent icons or color highlighting in the information collection list 5100 and / or timeline view 5200.

[0348] In this embodiment, the administrator can click on the highlighted acquisition information PI in the light emission mode management interface 500 to view the details immediately. The light emission mode management interface 5000 can also automatically display the optimal correction value suggested by the prescribed artificial intelligence model (AI).

[0349] At this point, the optimal correction value can be output by a specified artificial intelligence model and recommended to include color values ​​(i.e., color codes) in standardized feature information and standard data with the highest similarity.

[0350] Furthermore, in this embodiment, the computing system 1000 can provide a one-click modification function for the highlighted acquisition information PI. This function can be implemented by setting a one-click application button on the luminescence mode management interface 5000, allowing the administrator to immediately adopt the correction value recommended by the AI.

[0351] At this time, when the administrator clicks the one-click application button, in this embodiment, the computing system 1000 can update the collected information PI, including the recommended correction value, in real time to update the accumulated collected information PI, and convert the updated collected information PI into a control signal, and immediately enter the ready-to-send state.

[0352] Therefore, in this embodiment, the computing system 1000 integrates AI-based modification assistance and one-click modification functions into the light emission mode management interface, enabling administrators to accurately and quickly modify the collected information PI within a short modification time (e.g., 15 seconds).

[0353] Furthermore, in this embodiment, the computing system 1000 can synchronize the timestamp of the control signal, which includes the corrected and determined light emission mode information, with the live video (S107).

[0354] Specifically, in an embodiment, the computing system 1000 may consider the error between the actual on-site time point acquired by the acquisition information PI and the live video streaming time point at a remote location, and synchronize the timestamp of the control signal, including the corrected light emission mode information, with the live video.

[0355] Therefore, in this embodiment, the computing system 1000 can extract the timestamp (hereinafter referred to as "local timestamp") representing the actual on-site time point at which the collected information PI was acquired, which is included in each collected information PI.

[0356] Furthermore, in this embodiment, the computing system 1000 may receive live video feeds that are streamed in real time to a remote location and mapped with timestamps on a frame-by-frame basis from the service providing server 200.

[0357] Therefore, in this embodiment, the computing system 1000 can also extract the timestamp of the frame unit mapped in the received live video (hereinafter referred to as "streaming timestamp").

[0358] Furthermore, in an embodiment, the computing system 1000 can calculate an offset used to correct the difference between the local timestamp and the streaming timestamp.

[0359] In an embodiment, the offset may represent the time difference between the time point when the control signal, which includes a command to control the light-emitting device to emit light according to the light emission mode information determined on the video frame, is sent and the actual acquisition time point. For example, this offset can be obtained by calculating network latency, image processing delay, and other transmission delay factors.

[0360] Furthermore, in an embodiment, the computing system 1000 can apply the calculated offset to the local timestamp to calculate a synchronization time point that accurately matches the streaming timestamp.

[0361] Furthermore, in an embodiment, the computing system 1000 may include the calculated synchronization time point in a control signal that includes luminescence mode information.

[0362] That is, in the embodiment, the computing system 1000 can control the repeater 400 and / or the light-emitting device 300 at a remote location to receive control signals at an accurate synchronized time point, thereby achieving the light-emitting effect.

[0363] Furthermore, in this embodiment, the computing system 1000 can periodically update the streaming timestamp during live video streaming and improve synchronization accuracy by re-measuring the corresponding local timestamp. This allows for real-time monitoring of network environment fluctuations and latency changes during live stream transmission.

[0364] Therefore, in this embodiment, the computing system 1000 can achieve the same lighting pattern as the actual performance site at a remote location without any time error by precisely synchronizing the timestamp of the control signal including the lighting pattern information with the timestamp of the image frame transmission.

[0365] Therefore, in this embodiment, the computing system 1000 can control the transmission of a control signal including the light emission mode information at a synchronization time point (S109).

[0366] In one embodiment, the computing system 1000 can control the system components to continuously transmit live video and synchronization control signals by continuously performing polling with the service provider server 200 at fixed intervals while transmitting live video.

[0367] On the other hand, in an embodiment, the computing system 1000 may perform filtering based on the device ID matched by each light-emitting device to set the device ID of the light-emitting device located at a remote location to not respond to control signals sent to other light-emitting devices.

[0368] This could be an additional feature provided in a remote location lighting control service for joint concerts featuring multiple artists performing simultaneously, allowing only the lighting devices corresponding to the currently performing artist to be activated.

[0369] In an embodiment, the computing system 1000 may perform device ID-based filtering so that the device ID among the plurality of light-emitting devices 300 reacts only to a specific light-emitting device with the same device ID.

[0370] For this purpose, each of the multiple light-emitting devices 300 can be pre-assigned and stored with its own unique device ID, which is distinguished according to the shape of the light-emitting device.

[0371] Furthermore, in the embodiment, when the computing system 1000 learns in advance the hardware shape and / or color code of each light-emitting device 300 by the AI ​​camera 161-A, it can automatically map the device ID of each light-emitting device 300.

[0372] That is, in the embodiment, when the computing system 1000 generates a control signal including the acquisition information PI, it may include the device ID used to identify a specific light-emitting device in the control signal during the generation process.

[0373] When the control signal is sent to a remote location, in this embodiment, the repeater 400 can filter based on the device ID included in the sent control signal, transmitting the signal only to the light-emitting device 300 whose control signal matches the device ID. Conversely, for light-emitting devices 300 whose device IDs do not match, signal transmission can be blocked.

[0374] Alternatively, repeater 400 may receive control signals and forward them directly, in which case only the light-emitting device 300 that has pre-stored the control signal device ID in the light-emitting device 300 will react and emit light.

[0375] In this case, in the embodiment, the light-emitting device 300 can perform control signal filtering by comparing the pre-stored device ID with the device ID in the received control signal.

[0376] By performing device ID-based filtering, in this embodiment, the computing system 1000 can ensure that each device responds selectively to a specified signal in a performance environment where multiple light-emitting devices 300 belonging to different artists and teams coexist, thereby achieving a precise light-emitting effect without interference.

[0377] As described above, after the AI ​​camera collects (pick-up) the actual lighting pattern information presented on site in real time and digitizes it, the computing system 1000 can execute an optimization process to reproduce the data in the same way to multiple remote locations that are different from the physical environment of the original performance venue.

[0378] The raw effect data acquired through AI cameras will be automatically scaled and transformed according to the seating layout and shape of each remote location, thereby breaking through spatial limitations and optimizing the on-site dynamic effects to be realized in the remote location screening room environment.

[0379] Below, please refer to Figures 10 to 15 This document details specific implementation methods for converting raw effect data collected into customized data for different remote locations and uniformly controlling repeaters located at multiple remote locations.

[0380] —Methods for converting raw effect data into remote location effect data

[0381] Figure 10 This is a flowchart illustrating a method for converting raw effect data into remote location effect data according to an embodiment of the present invention.

[0382] See Figure 10 In this embodiment, the computing system 1000 can obtain the original seating information included in the effect information (S201).

[0383] In this embodiment, the performance is divided into the main performance (hereinafter referred to as the "original performance"), which is actually performed by the artist in a concert hall or stadium, and the performance provided by filming the original performance and playing it in real time at a remote location (hereinafter referred to as the "remote location performance").

[0384] Therefore, in the embodiments, although the effect information shares most of the content of the original effect information and the remote location effect information, there are still specific differences between the two depending on the physical characteristics of the site.

[0385] Specifically, performance information may include basic performance information such as performance name, artist information, performance date and time, as well as technical information such as device information and control protocols for different devices. This information is shared by both original performance information and remote location performance information.

[0386] Conversely, performance information can include performance venue, seating information, and effect data, which are formed independently from original performance information and remote location information. In the case of effect data, the effect data of the original performance is the original version, while the effect data of the remote location performance can be data that has been converted, compressed, and optimized for the remote location environment.

[0387] At this time, the seating information may include the number of seats, seat names, and / or a seating layout diagram. The seating layout diagram may be a vector or bitmap format drawing data that includes the unique ID of each seat and its physical location within the performance venue (e.g., x, y, z coordinates).

[0388] In this embodiment, the seating layout diagram can serve as a reference for spatial analysis and / or mapping of the original performance or a remote location performance.

[0389] That is, in the embodiment, the computing system 1000 can extract and obtain the original performance seating information (hereinafter referred to as "original seating information") included in the performance information.

[0390] Furthermore, in an embodiment, the computing system 1000 may acquire remote location seating information of a first remote location among at least one or more remote locations (S203).

[0391] The original performance can be streamed to multiple remote locations. In this embodiment, the first remote location refers to the remote location determined by the administrator as the target for conversion.

[0392] The remote location seat information is only the seat information for the "remote location", and its basic framework is the same as the content of the original seat information. Therefore, it will not be described again here.

[0393] In this embodiment, the title of the original seat information and / or the remote seat information can be set to the name of the performance venue for easy differentiation.

[0394] Furthermore, in this embodiment, the computing system 1000 may determine and display at least one or more seats (or blocks) based on the original seat information and the remote location seat information (S205).

[0395] Specifically, in this embodiment, the computing system 1000 can analyze the seating information and effect data of the original performance and the remote location performance, and display at least one or more seats or blocks on the effect interface so that the user (in this embodiment, the performer) can select a seat as the conversion reference.

[0396] Hereinafter, the seat set as the conversion reference will be called the "target seat", the set of seats will be called the "region", and the set of target seats will be called the "target block".

[0397] In this embodiment, a block is a set of seats in the audience seating area where the effect is achieved using the light-emitting device 300 in the original performance, and which also performs the desired effect in a remote location, referring to the seats that serve as the conversion reference.

[0398] In this embodiment, a seat or block can be determined by 1) manually specifying it or by 2) a recommended method based on remote location seat information.

[0399] 1) In the manual specification method, users (e.g., performers) can manually specify the seats and / or blocks that need to be converted to adapt to the performance in the original performance effect data and / or seating information.

[0400] In this embodiment, the computing system 1000 may display a seat list in text form and / or a seat layout diagram in image form based on the effect interface to display at least one or more seats or blocks.

[0401] Figure 11 This is a schematic diagram of an example of a user interface displaying a seat list according to an embodiment of the present invention.

[0402] See Figure 11 According to the embodiment, the user can manually select at least one or more targets as 620 on the seat list 610 of the effect interface 600.

[0403] Therefore, in this embodiment, the computing system 1000 can convert the individual seats included in the original venue into a list 610 with attributes such as inherent ID, coordinate value, and region by parsing the original seat information.

[0404] That is, users can select the target seat 620 by clicking and / or dragging based on the original seat information displayed in the seat list 610.

[0405] At this time, to assist the user in making a selection, in this embodiment, the computing system 1000 can pre-analyze the original effect data and automatically recommend at least one or more target seats 620 based on the automatic process of effect complexity, effect type and / or effect capacity, etc.

[0406] In another embodiment, the effect interface 600 may also display the original seating layout diagram, so the application 111 may also determine the detected input seat as the target seat.

[0407] In addition, in the recommendation method based on remote location seat information 2), the application 111 can automatically recommend candidate blocks based on the effect data and / or seat data of the original performance and the remote location performance respectively.

[0408] In this embodiment, a candidate block refers to a set of at least two or more seats that have the highest similarity in shape to the seating layout of the remote location screening room among all the seats in the original performance, and are therefore determined to be suitable for effect data conversion.

[0409] The candidate blocks can be extracted either because they match the shape, or because the area control effect pattern implemented in the original performance can be directly applied. In the former case, the number of seats at the original and remote locations may be different, while in the latter case, the number of seats at the original and remote locations may be the same.

[0410] Therefore, in this embodiment, the computing system 1000 can execute a candidate block filtering process.

[0411] Specifically, application 111 can analyze the layout of remote locations based on remote location seating information (e.g., the aspect ratio of blocks, the angle of each seat, the number of seats, the seat density, etc.).

[0412] In addition, application 111 can display blocks that have a morphological similarity to remote location seating information greater than or equal to a preset threshold (e.g., 80%) as candidate blocks on the effect interface 600.

[0413] Figure 12 This is a schematic diagram of an example of the display interface for candidate blocks according to an embodiment of the present invention.

[0414] See Figure 12 In this embodiment, the computing system 1000 can, based on the effect interface 600, display the original seating layout. Figure 6 Overlay remote seating layout Figure 7 This displays at least one or more candidate blocks B1, B2, B3, B4, B5, and B6.

[0415] Therefore, the user can determine the block to be converted from the at least one candidate block as the target block.

[0416] Now, assuming the first candidate block B1 has been determined, the original seating layout will be... Figure 10 The blocks on the map are called "original blocks," and the remote location seating layout is as follows. Figure 7 The blocks on the map are called "remote location blocks".

[0417] In addition, application 111 can compile and display a list of multiple raw seat information and remote location seat information included in the selected target block. Specifically, it can automatically extract seats that match the number of columns and seat numbers.

[0418] In this embodiment, the user can determine one of the control methods: area control and / or overall control.

[0419] Specifically, zone control refers to the control method of transplanting the effect mode of the target block of the original performance to the remote seats as is. Overall control refers to the method of uniformly applying the effect data of specific seats in the original performance to all seats in the remote location.

[0420] When area control is determined, application 111 can perform a 1:1 mapping between seat numbers between the original seat information and the remote location seat information. Furthermore, the mapping result is displayed on the effect interface 600.

[0421] When determined to be overall control, application 111 can directly apply the effect data of the target seats to the remote location seat information in batches without mapping.

[0422] Furthermore, in this embodiment, the computing system 1000 can perform calculations on the determined target seats (blocks) (S207).

[0423] Specifically, in an embodiment, the computing system 1000 may perform a performance form scaling operation when the target block is determined solely by conforming to the form, in order to adapt the effect data performed on the original seat to the scale of the remote seat by scaling up or scaling down.

[0424] This is an operation performed to optimize the size of the effect shape to the remote location while preserving the visual pattern of the original effect shape to the greatest extent possible, when the seating parameters of the target block determined in the original performance (e.g., the number of seats, rows, or columns) are inconsistent with the seating parameters of the remote location seating information.

[0425] Figure 13 and Figure 14 This is a schematic diagram illustrating an example of shape scaling according to an embodiment of the present invention. As an example, Figure 13 This indicates the case where a reduced calculation is performed.

[0426] See Figure 13 and Figure 14 On the effect interface 600, the original block B1 and the original effect shape SH executed in that block are displayed on the original seat information 10. Additionally, the remote position block RB1 and the remote position effect shape RSH executed in that block are displayed on the remote position seat information 20.

[0427] In an embodiment, the computing system 1000 can perform effect shape scaling calculations to convert the original effect shape SH of the original block B1 into the remote position effect shape RSH of the remote position block RB1.

[0428] Figure 15 A flowchart illustrating the effect shape scaling calculation according to an embodiment of the present invention.

[0429] See Figure 15In an embodiment, the computing system 1000 can calculate the resampling ratio by comparing the seating parameters of the original block with the seating parameters of the remote location block (S301).

[0430] Different calculations are performed depending on whether the coordinate parameters of the original block or the remote location block have a larger value.

[0431] First, when the parameter value of the original block B1 is greater than the parameter value of the remote location block RB1, a) shrinking calculation can be performed.

[0432] Specifically, in an embodiment, the computing system 1000 can calculate a resampling ratio for proportionally deleting data based on the difference between the seating parameters of the original block B1 and the seating parameters of the remote location block RB1.

[0433] For example, when the original block B1 contains 20 rows of data and the remote location block RB1 contains 15 rows of data, the application 111 can extract 15 rows of data from the original block B1 by sampling and removing 1 row of data from every 4 rows of data, thereby deleting 5 rows of data.

[0434] The calculations can be performed independently for each seat parameter.

[0435] Conversely, when the parameter value of the original block B1 is less than the parameter value of the remote location block RB1, amplification calculation can be performed (b).

[0436] Specifically, in an embodiment, the computing system 1000 can calculate the resampling ratio for proportionally replicating data based on the difference between the seating parameters of the original block B1 and the seating parameters of the remote location block RB1.

[0437] For example, when the original block B1 contains 20 rows of data and the remote location block RB1 contains 25 rows of data, the application 111 can generate 25 rows of data for the original block B1 by sampling and inserting 1 row of data for every 4 rows of data, thereby increasing the data by 5 rows.

[0438] Furthermore, in an embodiment, the computing system 1000 can determine the basic effect shape based on the calculated resampling ratio (S303).

[0439] After the reduction calculation is performed, application 111 can generate a reduced dataset that conforms to the seat parameters of the remote location block based on the deletion ratio.

[0440] After the magnification calculation is performed, application 111 can generate a magnified dataset that conforms to the seating parameters of the remote location block based on the magnification ratio.

[0441] Here, the scaled-down or scaled-up dataset refers to the basic effect shape.

[0442] Although the basic effect shape has a size optimized for remote location blocks, the continuity of effect data values ​​is reduced, resulting in an unnatural effect.

[0443] Therefore, application 111 can correct the determined basic effect shape to improve visual quality (S305).

[0444] Specifically, in an embodiment, the calculation system 1000 may make corrections based on mathematical interpolation, referencing the effect values ​​of adjacent seats for the deleted or added seat parameters.

[0445] Among them, the effect value refers to the elements that determine the light-emitting attributes of the light-emitting device 300, such as the light-emitting mode setting value including the light-emitting color, light-emitting brightness and / or light-emitting effect.

[0446] For deleted seat parameters, application 111 can infer the effect value of the deleted row or column from the neighboring data and reflect it to the effect value correction of the surrounding data, thereby mitigating drastic changes.

[0447] Conversely, for the added seating parameter, application 111 can replace the effect value of a simply copied row or column with the average or weighted average of the original data values ​​on either side, thus achieving a smooth transformation.

[0448] Therefore, the basic effect shape can be converted into a remote position seating layout. Figure 7 The optimized correction effect shape is RSH.

[0449] Furthermore, in this embodiment, the computing system 1000 can generate seat mapping data for the corrected effect shape (S307).

[0450] Therefore, in this embodiment, the computing system 1000 can map seats within the original block to seats within the remote location block.

[0451] Each seat mapping data may include source information and value modification information.

[0452] The source information can be the inherent ID of the seat within the original block that affects the effect value of the seat at this remote location.

[0453] The value modification information may include whether the effect value of the remote location seat is the same, or whether it has been modified by calculation, as well as the algorithm or weight value information used for the calculation.

[0454] Finally, in an embodiment, the computing system 1000 can transform the final effect data based on the seat mapping data (S309).

[0455] This step is in Figure 10 The flowchart shows the same steps as step S209. That is, in the embodiment, the computing system 1000 can convert the original effect data of the target block into remote location effect data according to the calculation (S109).

[0456] In this embodiment, the computing system 1000 can generate remote location effect data according to the control method.

[0457] Specifically, in the area control mode, remote location effect data can be generated based on the mapping data between the seats of the original block and the blocks of the remote locations, including the effect values ​​of each remote location as the timeline of the scaled original effect data.

[0458] For example, the performance data of seat "Shangyan Stadium, 3rd Floor, Section A, Row 1, No. 1" for the original performance can be mapped to the performance data of seat "Yongshan IMAX Cinema, Row A, No. 3" for the streaming performance.

[0459] On the other hand, in the case of batch application control, the effect data corresponding to the seats of the selected original blocks can be extracted and applied to all seats of the remote location blocks to generate remote location effect data.

[0460] In an embodiment, the application 111 may utilize raw effect data of at least one individual seat to enable batch application control of seats in remote location blocks. Specifically, as an example of batch application control, when based on a part of a complex area control effect, deliberately inserted dark intervals may be applied in batches to maintain the continuity of the effect or to enhance the performance.

[0461] In this case, in an embodiment, the computing system 1000 may additionally perform calculations to automatically correct the black field intervals, thereby transforming the effect data that is ultimately applied to all seats at the remote location.

[0462] More specifically, application 111 can first detect black intervals in the raw effect data and measure the duration of those intervals. Then, one of the following values ​​can be determined as the correction effect value: (1) a first effect value before the black interval (e.g., the previous color value), (3) a second effect value after the black interval (e.g., the subsequent color value), or (3) an intermediate value between the first and second effect values ​​(e.g., the interpolated color value).

[0463] At this time, the determination of (1) to (3) can be selected based on the elapsed time within the duration of the black field interval.

[0464] For example, application 111 can add color effects during the conversion from a first effect value to a second effect value to generate correction effect data. Specifically, application 111 can generate correction effect data by applying a color transition to convert the first effect value into a second effect value that visually presents a smooth gradient effect in the black area.

[0465] More specifically, in an embodiment, application 111 can detect black screen intervals from raw effect data and detect the duration of the interval, a first effect value before the black screen, and a second effect value after the black screen.

[0466] Then, during this duration of the black field interval, application 111 can perform a continuous color transition or gradation calculation that naturally connects the first effect value to the second effect value.

[0467] That is, the correction effect data is generated by starting with the first effect value at the beginning of the black field interval and reaching a color value close to the second effect value (i.e., the subsequent continuous color values) at the end of the black field interval.

[0468] The corrected black area data can then be applied to at least one or more seats in a remote location area. This prevents interruptions in the effect that may occur when converting area control data to overall control, and provides a continuous and stable effect experience even in remote location environments.

[0469] The transformed remote location effect data can then be configured as a control signal data packet including a timestamp. In this case, the data packet may include the effect value of the remote location effect data.

[0470] The remote location effect data can be sent to repeaters 400 located at each remote location.

[0471] Furthermore, in this embodiment, the computing system 1000 can remotely control multiple repeaters located at multiple remote locations based on the converted remote location effect data (S211).

[0472] To this end, application 111 can generate data on the illumination of the light-emitting device 300 within a defined radius (i.e., synchronized illumination effect data) to correspond to the remote location effect data. In this case, the synchronized illumination effect data can map at least one or more of the following: artist name, performance name, performance time, and / or performance number.

[0473] In addition, application 111 can remotely control repeaters 400 located at various remote locations to send light control signals including generated light effect synchronization data.

[0474] At this time, application 111 can pre-set and register the remote locations that need to be remotely controlled and the image / control signal transmission time of each remote location (i.e., the performance start time of the remote location).

[0475] Therefore, the repeater 400 can be adapted to the start time of the performance video played at a remote location and send the lighting effect synchronization data to multiple lighting devices 300.

[0476] Then the light-emitting devices 300 located at each remote position can be activated to emit light according to the light-emitting effect synchronization data.

[0477] The remote location effect data, which is optimized and transformed according to the physical characteristics of each remote location, is sent via network to repeaters 400 set up in various locations and controls the lighting devices 300 of the actual audience.

[0478] At this point, in addition to sending data, it is also necessary to integrate the monitoring process of the status of each repeater 400 in real time at the central location to ensure the stability of the live broadcast service that is being conducted simultaneously at multiple remote locations.

[0479] Therefore, the computing system 1000 maximizes the completion of the live streaming service by building a management environment that allows for intuitive understanding of the current status of the projection and the operating status of the equipment at each remote location, and immediate response to potential synchronization errors or equipment failures.

[0480] Below, please refer to Figures 16 to 20 The specific embodiments for efficient unified management and remote control of the multiple remote location devices are described in detail.

[0481] — Remote control method for repeaters located in multiple remote locations

[0482] In one embodiment, the computing system 1000 can provide an administrator interface for unified management of live streaming services executed at multiple program locations.

[0483] In this embodiment, the administrator interface 500 provided by application 111 can not only monitor a single performance provided by the live streaming service, but also provide a unified dashboard function for unified management of multiple performances (events) that are about to take place or are in progress within a preset period.

[0484] The events described below refer to streaming events of the same performance played at different remote locations. Furthermore, the live streaming service refers to a service that provides the streaming events in real time.

[0485] Figure 16 and Figure 17 This is a schematic diagram illustrating the functionality of an integrated dashboard in an administrator interface according to an embodiment of the present invention.

[0486] See Figure 16 The administrator interface (500) can display multiple events from the first performance. Furthermore, detailed information can be displayed for each event.

[0487] Event details may include the venue name at the remote location, screening number, repeater model, performance schedule, repeater status information, etc.

[0488] When selecting the event to be controlled from the multiple displayed events, the administrator interface 500 can, as follows: Figure 17 As shown, this displays the performance timeline based on the playlist.

[0489] The performance timeline 510 refers to the arrangement of scenes presented sequentially throughout the entire performance. These scenes may include, for example, multiple songs, but may also include the time of performance and / or the time of events.

[0490] Specifically, when an administrator clicks on the first scene in the playlist, an adjustment bar is provided to control operations such as moving forward n seconds, playing, pausing, and moving backward n seconds within that scene. Furthermore, the administrator can force a switch to the second scene while the first scene is playing, based on the progress of the performance at a remote location.

[0491] That is, the administrator can input adjustment commands for the playback status information of multiple repeaters through the administrator interface 500, thereby monitoring and remotely controlling each repeater.

[0492] Each scene can simultaneously display the playback time information of that scene. When the administrator selects a specific scene in the playlist, in this embodiment, the computing system 1000 can immediately adjust the image transmission time point and / or the light effect control signal transmission time point of that event to the start time point of that scene.

[0493] Furthermore, in this embodiment, the computing system 1000 can also batch control the image transmission time points and / or the light effect control signal transmission time points of multiple events of the first performance displayed on the administrator interface 500.

[0494] Multiple events in the first performance can be batch controlled by the administrator as a series.

[0495] For example, when an administrator enters a batch control button, a series of events within the same performance can be controlled in batches. For this, the venues, screening times, and relay equipment at each remote location must be pre-registered.

[0496] Furthermore, in this embodiment, the computing system 1000 may provide the ability to manage repeaters located in multiple remote locations based on an administrator interface.

[0497] Figure 18 and Figure 19 This is a schematic diagram illustrating the repeater management function of the administrator interface according to an embodiment of the present invention.

[0498] See Figure 18 In this embodiment, the computing system 1000 can display the status information of multiple repeaters 400.

[0499] In this embodiment, the status information may be information indicating whether the repeater 400 is in a state of normal operation according to the light emission effect control signal.

[0500] In an embodiment, the status information may include at least one of the following: the repeater's inherent ID, the repeater's power status, the repeater's location, the repeater's internet connection status, the repeater's operating status, and / or the number of light-emitting devices connected to the repeater.

[0501] For example, the repeater's power status can be displayed as On, Off, and / or Connected or Disconnected. The repeater's internet connection status can be displayed as "Good," "Normal," or "Slow" based on a preset standard internet connection speed. The repeater's operating status can be displayed as Connected, Disconnected, or Error, depending on whether the repeater is faulty. In the case of an Error message, the repeater's number can also be displayed. The number of LEDs connected to the repeater refers to the number of LEDs that are normally receiving the repeater's control signals, and can be displayed as a specified number.

[0502] In addition, the status information can also represent the status of the effect data to be sent to the repeater as Upload and / or Ready. Furthermore, the status of remote control can be represented as start, finish, etc.

[0503] Furthermore, in this embodiment, the repeater location included in the status information can be represented as repeater location information MP. In this embodiment, repeater location information MP can refer to content that roughly represents the location of repeater 400 within a remote location.

[0504] For example, application 111 can obtain the location information of each repeater based on the GPS built into the repeater, thereby displaying the repeater location 200-C.

[0505] In addition, see Figure 19 In this embodiment, the computing system 1000 can display the performance status information of multiple repeaters 400.

[0506] In this embodiment, the performance status information can be an intuitive display of the actual performance status at the venue and the live broadcast status of the remote location of the repeater 400.

[0507] Furthermore, in this embodiment, the performance status information may include basic information about the currently ongoing performance, its progress, the status information of the control signals, and / or the progress and status information of the live video provided by each of the multiple repeaters 400.

[0508] Specifically, in this embodiment, the computing system 1000 can display performance status information based on the administrator interface 500, which includes basic information 710 of the currently ongoing performance, performance progress 711, and performance venue control signals 712.

[0509] In addition, specifically, in the embodiment, the computing system 1000 can display performance status information based on the administrator interface 500, which includes the remote location information 720, 730 of each repeater in the live performance that is being conducted at multiple remote locations, the live performance progress 721, 731, and the remote location control signals 722, 732.

[0510] Although Figure 19 Only the first and second repeaters are shown in the image, but in this embodiment, the computing system 1000 may display all the multiple repeaters connected to the server 200 based on the administrator interface 500.

[0511] Basic information 710 is information about an ongoing performance obtained from server 200, which may include at least one of the following: the performer, the performance location, the performance date, and the performance time.

[0512] The performance progress 711 can be information indicating the current point in time within the performance running time. This point in time can be represented as performance progress time 51. For example, performance progress time 51 can be represented as a time consisting of hours, clocks, and seconds, or it can be represented as a percentage (%) of the total running time.

[0513] The performance venue control signal 712 can be information representing the current time point in the execution time of the control signals sent in the performance venue. This time point can be represented as the performance venue control signal transmission time point 52.

[0514] At this time, the performance start time 51 and the performance venue control signal transmission time 52 can be the same. This is because there is no delay caused by external transmission of images and notification signals within the performance venue.

[0515] The live performance progress 721 can be information indicating the point in time during the live performance's runtime. This point in time can be represented as live performance time point 53. Similarly, live performance time point 53 can also be represented as time and / or percentage.

[0516] The performance start time 51 and the live broadcast time 53 may be different. This is because delays may occur depending on the connection status of the central control terminal 100, repeater 400, and / or server 200, and the performance may be pre-recorded rather than a live broadcast.

[0517] The remote position control signal 722 can be information representing the current time point of transmission of the remote position control signal within the runtime of the control signal transmitted at the remote position. This time point can be represented as the remote position control signal transmission time point 54.

[0518] At this point, the performance start time 51 and the live broadcast time 53 can be different. Because the real-time performance is based on the server 200 sending data to the repeater 400, a delay may occur depending on factors such as the internet connection status.

[0519] Similarly, the live broadcast time point 53 and the remote location control signal transmission time point 54 can be different. This is because the transmission locations of the live video playback signal and the live video illumination effect control signal may be different.

[0520] In addition, the live broadcast times 53 and 55 of the first and second repeaters, as well as the remote location control signal transmission times 54 and 56, may vary depending on the Internet connection status of the remote location of each repeater.

[0521] Furthermore, in this embodiment, the computing system 1000 can display remote location field information 720, 730 based on the administrator interface 500.

[0522] The first remote location field information 720 of the first repeater and the second remote location field information 730 of the second repeater can be images and / or videos of each remote location captured by the cameras contained in each repeater.

[0523] The first and second remote location field information 720 and 730 may include live video being played at each remote location and / or the lighting effects of the lighting device 300. This allows the administrator to understand the field situation at each remote location.

[0524] Furthermore, in this embodiment, the computing system 1000 can remotely control the first repeater based on the acquired status information and / or performance status information.

[0525] More specifically, in the embodiments, the computing system 1000 can remotely control at least one of: 1) the power supply of the repeater; 2) the internet connection status of the repeater; and 3) the synchronization of live video and live control signals.

[0526] To perform the remote control, in one embodiment, the computing system 1000 may utilize a dedicated monitoring channel connected to each repeater 400.

[0527] Specifically, each repeater 400 can periodically send the playback status (e.g., playing, paused, etc.) of the streaming video it sends to the central control terminal 100 or the service provider server 200 through the dedicated monitoring channel.

[0528] Therefore, the application 111 receives the playback status of each remote location in real time through a dedicated monitoring channel. When a preset abnormal signal such as "pause" or "buffering" is detected, a trigger signal can be generated and obtained from the repeater 400.

[0529] When the trigger signal is received, the problem at the remote location can be immediately displayed as an alert on the administrator interface 500.

[0530] In an embodiment, the computing system 1000 can remotely control the power supply of the first repeater to On and / or Off based on the status information of the first repeater.

[0531] For example, if an administrator determines that a fault has occurred in the first repeater based on its status information, they can remotely control the power supply of the first repeater to restart it.

[0532] Furthermore, in this embodiment, the computing system 1000 can remotely control the Internet connection between the first repeater and the server 200 based on the status information of the first repeater.

[0533] At this time, the first repeater can also be remotely controlled to execute the recovery process itself. For example, it can perform tasks such as restarting the internal process responsible for sending control signals, reconnecting the network, or restarting the system.

[0534] Furthermore, in an embodiment, the computing system 1000 can detect at least one repeater that has a time error between the actual performance time point and the live video time point and / or between the live video and the remote position control signal, based on status information.

[0535] Furthermore, in this embodiment, the computing system 1000 can remotely control each repeater to synchronize the performance time point - live video time point and / or the live video - remote location control signal (Sync, the execution time between synchronization tasks).

[0536] Therefore, in this embodiment, the computing system 1000 can execute the process of transmitting live video and remote location control signals based on the status information.

[0537] Figure 20 This is a schematic diagram illustrating an example of a synchronization process according to an embodiment of the present invention.

[0538] In one embodiment, the computing system 1000 can receive the current playback time PT of the streaming video 3000 being played in the first repeater.

[0539] At this time, the first repeater may be sending streaming light effect data 2000 that matches the live video 3000 being played. The streaming light effect data 2000 refers to light effect data synchronized with the streaming video (light effect synchronization data).

[0540] The streaming light effect data 2000 being transmitted can be a transmission signal that is either slower or faster than the current playback time PT of the streaming image 3000 by a specified time. For example, application 111 can be transmitting a transmission signal that is at the current transmission time ST, which is a time 601 slower than the current playback time PT.

[0541] Furthermore, in an embodiment, the computing system 1000 can determine the luminous effect block as a first future time point T1, which is later than the current playback time point PT.

[0542] In this embodiment, the light-emitting effect block refers to the interval contained in the streaming light-emitting effect synchronization data 2000 and which realizes the light-emitting pattern per unit time.

[0543] Furthermore, in this embodiment, the computing system 1000 can determine whether the current playback time point PT and the first future time point T1 are consistent.

[0544] At the instant when the previous playback time point PT and the first future time point T1 coincide, in this embodiment, the computing system 1000 can remotely control the light emission effect control signal to play the first light emission effect block BK1 at the first future time point T1, thereby minimizing the time deviation between the image and the effect.

[0545] Furthermore, when the repeater restarts according to the self-recovery process, the application 111 can calculate the duration of the system's stagnation due to the fault by comparing the timestamp recorded at the time the error occurred with the current time, and immediately move the playback time point to that time interval of the illuminated performance synchronization data.

[0546] On the other hand, in other embodiments, the computing system 1000 may convert the raw effect data into remote location effect data based on environmental information (e.g., seating layout and / or illuminance) at the remote location where the repeater 400 is located.

[0547] The environmental information may include the playback status information and / or operating status information of the repeater 400. The playback status information displays the playback status of the streaming video and streaming light effect control signals being transmitted by the repeater 400; the operating status information displays the physical environmental status of the repeater 400, such as power supply, communication, number of connected light-emitting devices, structure of the remote location, seating, and illuminance.

[0548] In particular, in other embodiments, the computing system 1000 can periodically measure the ambient brightness of a remote location using an illuminance sensor mounted on the repeater 400, and automatically convert and correct the original effect data based on the measured illuminance values. The automatically converted and corrected data can then be used as effect data for the remote location.

[0549] More specifically, after the repeater 400 measures the illuminance value, it sends it along with the repeater 400's unique ID to the central control terminal 100 and / or server 200 in real time. Therefore, in other embodiments, the computing system 1000 can perform a comparative analysis with a pre-stored illumination-effect conversion matrix, and convert, correct, and determine the luminous effect synchronization data of the remote location of the repeater 400.

[0550] At this point, the illuminance-effect conversion matrix can define multiple illuminance thresholds and corresponding effect data conversion rules for each threshold. Furthermore, the illuminance-effect conversion matrix may also include an alternative effect library and / or a specific parameter adjustment process.

[0551] More specifically, in other embodiments, when the measured illuminance value exceeds a preset threshold, the computing system 1000 can determine that the remote location is in a bright state and change at least one parameter in the luminous effect synchronization data.

[0552] For example, in the case described above, the effect data can be automatically corrected by removing the conversion value of "color" from the glow effect synchronization data and adding a value for "effect" to represent a clear pattern rather than subtle color changes (i.e., replacing the effect library). Alternatively, correction can be performed by adjusting the brightness of "color" (i.e., a specific parameter adjustment process).

[0553] Conversely, when the measured illuminance value is less than a preset threshold, it can be determined that the remote location is in a dim state, and at least one parameter in the luminous effect synchronization data can be changed accordingly.

[0554] For example, the effect data can be automatically corrected by increasing the "brightness" value in the illumination effect synchronization data.

[0555] All processes and results of converting or adjusting effect data based on illuminance values ​​can be displayed in real time in the administrator interface 500 of application 111.

[0556] Therefore, managers can intuitively grasp and manage the conversion of performance data at various remote locations through the interface.

[0557] The method of the embodiments can be implemented as program commands executable by various computer devices and recorded on a computer-readable recording medium. The computer-readable recording medium may include program commands, data files, data structures, etc., individually or in combination. The program commands recorded on the storage medium may be specifically designed and configured for this invention, or may be publicly available in the software field. Computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical media such as CD-ROMs and DVDs; magneto-optical media such as floppy disks; and hardware devices such as ROMs, RAMs, and flash memory capable of storing and executing program commands. Program commands include not only machine language code generated by a compiler, but also high-level language code executed in a computer using a translator or similar means. The hardware device may consist of one or more software modules that implement the actions of this invention, and vice versa.

[0558] The specific embodiments described in this invention are merely examples and are not intended to limit the scope of the invention in any way. For the sake of brevity, descriptions of existing electronic structures, control systems, software, and other functions of said systems are omitted. Furthermore, the connections between lines or functional and / or physical or circuit connections between components shown in the drawings are exemplary, and various functional, physical, or circuit connections may be substituted or added in actual devices. Additionally, unless specifically stated as "essential" or "important," these are not essential components for implementing this invention.

[0559] The embodiments described are for illustrative purposes only and are not intended to limit the invention. Those skilled in the art should understand that modifications, variations, or equivalent substitutions can be made to the invention. Any modifications, alterations, or equivalent substitutions made without departing from the spirit and scope of the invention should be covered by the claims of this invention.

Claims

1. A method for controlling a light-emitting device, comprising a method for controlling a light-emitting device using a computing system, characterized in that, The method for controlling the light-emitting device includes the following steps: Acquire image data containing shape information and color code information of multiple light-emitting devices paired with different seats; The shape information and color code information are associated with the device identification information of each of the light-emitting devices and stored as a dataset; Using the dataset, an image analysis model configured to extract shape information and present color code information and output device recognition information when receiving image data is trained; The image analysis model is applied to the image data to automatically determine the device identification information of each of the multiple light-emitting devices. Extract the light emission mode information corresponding to the determined device identification information, wherein the light emission mode information includes at least one of color parameters, brightness parameters, and effect parameters; The timestamp representing the acquisition time point of the extracted optical emission mode information is matched, and the optical emission mode information is accumulated as acquisition information; At least one parameter of the accumulated collected information is corrected through the light emission mode management interface; and Control signals are sent to multiple light-emitting devices via repeaters located at remote locations. The control signals include instructions to control the light-emitting devices to emit light based on the corrected acquisition information.

2. The light-emitting device control method according to claim 1, characterized in that: The emission mode information includes color parameters, HSL parameters, and effect parameters. Based on multiple parameters, at least one of the following is represented: emission color, emission time, emission brightness, and emission effect.

3. The light-emitting device control method according to claim 1, characterized in that: The image analysis model is pre-trained using shape information mapped to the light-emitting device and a dataset of predefined color codes corresponding to that shape. The steps for training the image analysis model also include the following steps: For the first light-emitting device among multiple light-emitting devices, extract the light emission pattern information more than a preset number of times and set it as a general tag; and The image analysis model is trained based on the general labels.

4. The light-emitting device control method according to claim 1, characterized in that: The control signal includes the device ID. Multiple light-emitting devices that receive the control signal from a repeater located at a remote location will emit light only if the device ID contained in the control signal matches the device ID they have pre-stored.

5. The light-emitting device control method according to claim 1, characterized in that: The light emission mode management interface displays a timeline view of light emission mode information accumulated chronologically at different acquisition time points, presented in a timeline format. When the difference between the collected information and the pre-stored standard data exceeds a threshold, the collected information is highlighted. When the highlighted information is selected, at least one artificial intelligence model automatically determines and provides a correction value based on a preset color code.

6. The light-emitting device control method according to claim 1, characterized in that: The step of sending control signals to multiple light-emitting devices includes the following steps: Extract the local timestamp included in the collected information; Extract the streaming timestamps mapped to the live video being played at a remote location; The offset between the extracted local timestamp and the streaming media timestamp is calculated to determine the synchronization time point; as well as The control signal is sent at the calculated synchronization time point.

7. A method for controlling a light-emitting device, which is a method for a computing system to control a light-emitting device, characterized in that the method includes the following steps: Obtain the original seating information for the original performance; Obtain the remote position seating information of the first remote location of the original performance being streamed; Identify and display at least one or more target seats in the original seat information from which the effect to be applied to the first remote location is to be executed; The raw effect data of the at least one or more target seats is converted into remote position effect data optimized for the first remote position; and Based on the converted remote location effect data, repeaters located at at least one or more remote locations, including the first remote location, are remotely controlled.

8. The light-emitting device control method according to claim 7, characterized in that: The step of determining and representing the target seat includes the following steps: Analyze the morphological similarity between at least a portion of the original seat information and the remote location seat information, wherein the morphological similarity is determined based on at least one of the following: the angle of each remote location seat, the number of seats, the seat density of a remote location block including multiple remote location seats, and the aspect ratio; and For a block that is a set of at least two or more seats, among multiple candidate blocks in the original seat information, the first block with a morphological similarity greater than or equal to a preset ratio is determined as the target seat.

9. The light-emitting device control method according to claim 7, characterized in that: The step of converting the raw effect data of the target seat into remote position effect data includes the following steps: The seat parameters of the original blocks including multiple target seats of the original performance and the remote position blocks including multiple remote position performances are compared to perform an effect shape scaling calculation. The seating parameters include at least one of the number of seats, rows, and columns in the original seating information or remote location seating information.

10. The light-emitting device control method according to claim 9, characterized in that: The steps for performing shape scaling calculations include the following: Calculate the resampling ratio based on the differences between the seat parameters; and Based on the calculated resampling ratio, at least a portion of the row or column data included in the original effect data is deleted or copied proportionally.

11. The light-emitting device control method according to claim 9, characterized in that: The step of performing the shape scaling calculation for the effect also includes the following steps: Extract the effect values ​​of data adjacent to the deleted or copied rows or columns from the original effect data; and Based on the extracted effect values, the original effect data is corrected to generate remote location effect data. The effect value includes at least one of the following: the luminous color, luminous brightness, and luminous effect of the luminous device that emits light according to the effect data.

12. The light-emitting device control method according to claim 9, characterized in that: The step of converting the raw effect data of the target seat into remote position effect data includes the following steps: Perform a 1:1 mapping between multiple seats within the original block including the target seat and multiple seats within the remote location block; and The effect values ​​of multiple seats within the original block are applied to the effect values ​​of multiple seats within the remote location block mapped by seat, to generate remote location effect data. The remote location effect data includes a region control mechanism, which, based on the mapping relationship, enables the effect mode of the original block to be executed in the remote location block.

13. The light-emitting device control method according to claim 7, characterized in that: The step of converting the raw effect data into remote location effect data includes the following steps: The black area included in the original effect data of the target seat is detected; A correction effect value is generated based on the duration of the detected black field interval and the effect values ​​before and after the black field interval; and Replace the black area with the correction effect value to generate remote location effect data.

14. The light-emitting device control method according to claim 13, characterized in that: The step of replacing the values ​​with correction effect values ​​to generate remote location effect data includes the following steps: The luminous effect value before the black field interval is determined as the first effect value; The luminescence effect value after the black field interval is determined as the second effect value; Throughout the entire duration of the black screen interval, a correction effect value is generated that continuously transitions from a first effect value to a second effect value; and Replace the black field interval with the generated correction effect value to generate remote location effect data.

15. A control system for a light-emitting device, characterized in that: In a central control terminal that is linked to at least one camera; at least one repeater; at least one light-emitting device; and includes at least one memory, and at least one processor that reads at least one application stored in the memory and uses the AI ​​camera to control multiple light-emitting devices, The processor of the central control terminal operates according to instructions configured to perform the following operations: Acquire image data containing shape information and color code information of multiple light-emitting devices paired with different seats; The shape information and color code information are associated with the device identification information of each of the light-emitting devices and stored as a dataset; Using the dataset, shape information and color code information are extracted when receiving image data, and an image analysis model configured as the recognition information for the output device is trained. The image analysis model is applied to the image data to automatically determine the device identification information of each of the multiple light-emitting devices. Extract the light emission mode information corresponding to the determined device identification information, wherein the light emission mode information includes at least one of color parameters, brightness parameters, and effect parameters; The timestamp representing the acquisition time point of the extracted optical emission mode information is matched, and the optical emission mode information is accumulated as acquisition information; Obtain the original seating information of the original performance and the remote seating information of the first remote location of the original performance in the streaming; Identify and display at least one or more target seats in the original seat information from which the effect to be applied to the first remote location is to be executed; The raw effect data or the collected information of the at least one or more target seats are converted into remote position effect data optimized for the first remote position; At least one parameter of the accumulated collected information is corrected through the light emission mode management interface; Control signals are sent to multiple light-emitting devices via repeaters located at remote locations. The control signals include instructions to control the light-emitting devices to emit light based on the corrected acquisition information or the remote location effect data.

16. The light-emitting device control system according to claim 15, characterized in that: The repeater includes: The receiving unit acquires at least one of the following from the central control terminal or a server connected to the central control terminal: remote location effect data, streaming video, and a lighting performance control signal corresponding to the video; and The sending unit sends the streaming video being transmitted by the effect linkage device and the playback status information of the corresponding light effect control signal to the terminal or a server connected to the terminal.

17. The light-emitting device control system according to claim 16, characterized in that: When the repeater detects a preset abnormal signal in the playback status information, it generates a trigger signal and sends it to the central control terminal or a server connected to the central control terminal.

18. The light-emitting device control system according to claim 17, characterized in that: The application is used for: When the trigger signal is received from the repeater, the status information of the repeater that sent the trigger signal is displayed as a warning on the administrator interface; Perform remote control on the repeater that displays a warning, the remote control including at least one of power control, network reconnection, or synchronization control commands.

19. The light-emitting device control system according to claim 18, characterized in that: The repeater acquires a remote control command including a synchronization control command, which performs synchronization between the current playback time of the streaming video and the current transmission time of the illumination effect control signal.

Images