A control method, device, electronic device and storage medium for functional equipment

Abstract

The present application discloses a control method for a functional device, which involves virtualization technology. The present application includes obtaining a device binding relationship for a gateway device; establishing a communication connection between the gateway device and N functional devices based on the device binding relationship; obtaining a target orchestration file, which is a file generated after orchestration processing of K functional devices, and the target orchestration file carries K device identifiers; if the K device identifiers match the N device identifiers successfully, the K functional devices are controlled according to the target orchestration file. The present application also provides an apparatus, an electronic device, and a storage medium. The present application uses a target orchestration file to control functional devices, which can not only achieve the pre-arranged functional device coordination effect, but also reduce the cost of implementing the performance effect.

Description

Technical Field

[0001] The present application relates to the field of Internet and cloud computing technology, and in particular to a control method, device, electronic device and storage medium for a functional device. Background Art

[0002] With the rapid development of science and technology, the stage lighting control technology that keeps pace with the times is developing towards diversification, intelligence and humanization, and the stage equipment is also more diverse and complex. In order to achieve a beautiful stage performance effect, it is often necessary for multiple stage equipment to work together, for example, to achieve the collaborative work between lighting equipment and playback equipment.

[0003] During a stage performance, various stage equipment needs to work together with the performers to present a colorful performance effect. For example, the lighting designer is mainly responsible for controlling the lighting equipment, while the mechanical controller is mainly responsible for controlling the ground lifting device and the hanging device above the stage.

[0004] Since different devices often have different control consoles, users are required to communicate with each other to coordinate. However, the existing device control methods are difficult to achieve seamless coordination, which may cause discontinuity in the stage performance during the performance. On the other hand, they require the participation of multiple users, resulting in high labor costs. Summary of the invention

[0005] The embodiments of the present application provide a control method, device, electronic device and storage medium for a functional device. The present application uses a target arrangement file to control the functional device, which can not only achieve the pre-arranged functional device coordination effect, but also reduce the cost of achieving the performance effect.

[0006] In view of this, the present application provides, on one hand, a control method for a functional device, comprising:

[0007] Obtaining a device binding relationship for the gateway device, wherein the device binding relationship includes a binding relationship between a gateway device identifier and N device identifiers, the gateway device identifier is used to indicate the gateway device, each device identifier is used to indicate a functional device, and N is an integer greater than or equal to 1;

[0008] Based on the device binding relationship, establish a communication connection between the gateway device and N functional devices;

[0009] Obtain a target orchestration file, wherein the target orchestration file is a file generated after orchestration processing is performed on K functional devices, and the target orchestration file carries K device identifiers, where K is an integer greater than or equal to 1;

[0010] If the K device identifiers are matched with the N device identifiers successfully, the K functional devices are controlled according to the target arrangement file.

[0011] On the other hand, the present application provides a functional device control device, comprising:

[0012] An acquisition module, used to acquire a device binding relationship for a gateway device, wherein the device binding relationship includes a binding relationship between a gateway device identifier and N device identifiers, the gateway device identifier is used to indicate a gateway device, each device identifier is used to indicate a functional device, and N is an integer greater than or equal to 1;

[0013] An establishment module is used to establish a communication connection between the gateway device and N functional devices based on the device binding relationship;

[0014] The acquisition module is further used to acquire a target orchestration file, wherein the target orchestration file is a file generated after orchestration processing is performed on K functional devices, and the target orchestration file carries K device identifiers, where K is an integer greater than or equal to 1;

[0015] The control module is used to control the K functional devices according to the target arrangement file if the K device identifiers are matched with the N device identifiers successfully.

[0016] In one possible design, in another implementation of another aspect of the embodiment of the present application, the functional device control apparatus further includes a display module and a generation module;

[0017] A display module, used for displaying K device controls corresponding to the gateway device in the device selection area before acquiring the target arrangement file, wherein each device control corresponds to a functional device;

[0018] The acquisition module is further used to respond to an editing operation on any device control among the K device controls and acquire arrangement information of a functional device corresponding to any device control;

[0019] The generating module is used to generate a target orchestration file according to the orchestration information of the K functional devices if the orchestration information of the K functional devices is obtained.

[0020] In one possible design, in another implementation of another aspect of the embodiment of the present application,

[0021] An acquisition module, specifically configured to respond to a selection operation on any device control and display an arrangement fragment of a functional device corresponding to any device control in the device arrangement area;

[0022] In response to a selection operation for an arrangement segment, displaying an input item control set on the editing tool area;

[0023] In response to an input operation on the input item control set, the arrangement information of the functional device corresponding to any device control is obtained.

[0024] In a possible design, in another implementation of another aspect of the embodiment of the present application, the functional device corresponding to any device control is a lighting device, the arrangement information of the functional device corresponding to any device control is the arrangement information of the lighting device, the arrangement information of the lighting device includes at least one of brightness information, color information, angle information, linear speed information and angular speed information of the lighting device, and the arrangement segment is a first lighting arrangement segment;

[0025] The display module is further configured to display the first lighting choreography segment after the duration adjustment on the device choreography area when a duration adjustment operation for the first lighting choreography segment is detected;

[0026] The display module is further used to display the second lighting arrangement segment on the device arrangement area when a segment adding operation is detected;

[0027] The display module is further configured to display the second lighting choreography segment after the duration adjustment on the device choreography area when a duration adjustment operation for the second lighting choreography segment is detected, wherein the second lighting choreography segment does not overlap with the first lighting choreography segment;

[0028] The display module is further configured to cancel display of the second lighting arrangement segment in the device arrangement area when a deletion operation on the second lighting arrangement segment is detected.

[0029] In a possible design, in another implementation of another aspect of the embodiment of the present application, the functional device corresponding to any device control is an audio device, the arrangement information of the functional device corresponding to any device control is the arrangement information of the audio device, the arrangement information of the audio device includes at least one of volume information, fade-in duration information, fade-out duration information, and playback ratio information, and the arrangement segment is a first audio arrangement segment;

[0030] A display module, specifically configured to display an audio import list in response to a selection operation on the audio import control, wherein the audio import list includes at least one audio file information;

[0031] In response to a selection operation on the first audio information, displaying a first audio arrangement segment corresponding to the audio device in the device arrangement area, wherein the first audio information corresponds to the first audio arrangement segment;

[0032] The display module is further configured to display the second audio arrangement segment on the device arrangement area when a selection operation for the second audio information is detected, wherein the second audio information corresponds to the second audio arrangement segment;

[0033] The display module is further used to display the second audio arrangement segment after position adjustment in the device arrangement area when a moving operation for the second lighting arrangement segment is detected, wherein the second audio arrangement segment and the first audio arrangement segment may overlap.

[0034] In a possible design, in another implementation of another aspect of the embodiment of the present application, the functional device corresponding to any device control is a video device, the arrangement information of the functional device corresponding to any device control is the arrangement information of the video device, the arrangement information of the video device includes at least one of start time information, time upper limit information, play mode information and brightness information, and the arrangement segment is a first video arrangement segment;

[0035] A display module, specifically used to respond to a selection operation on a video import control and display a video import list, wherein the video import list includes at least one video file information;

[0036] In response to a selection operation on the first video information, displaying a first video arrangement segment corresponding to the video device in the device arrangement area, wherein the first video information corresponds to the first video arrangement segment;

[0037] The display module is further configured to display the second video arrangement segment on the device arrangement area when a selection operation for the second video information is detected, wherein the second video information corresponds to the second video arrangement segment;

[0038] The display module is further configured to cancel display of the second video arrangement segment in the device arrangement area when a deletion operation on the second video arrangement segment is detected;

[0039] The display module is also used to display the editing information of the first video arrangement segment on the device arrangement area when an editing operation for the first video arrangement segment is detected, wherein the editing information includes at least one of name information, description information and sorting information.

[0040] In one possible design, in another implementation of another aspect of the embodiment of the present application,

[0041] The display module is further used to display the main control corresponding to the gateway device in the device list and display the sub-control corresponding to each functional device in the K functional devices before generating the target arrangement file according to the arrangement information of the K functional devices;

[0042] The display module is further configured to display a first arrangement result according to the arrangement information of the K functional devices when a preview operation for the main control is detected;

[0043] The display module is also used to display a second arrangement result according to the arrangement information of the P functional devices when a preview operation for the P sub-controls is detected, wherein the P functional devices are included in the K functional devices, and P is an integer greater than or equal to 1 and less than or equal to K.

[0044] In one possible design, in another implementation of another aspect of the embodiment of the present application, the functional device control apparatus further includes a storage module;

[0045] A storage module, configured to store the target orchestration file in the gateway device in response to a storage operation on the target orchestration file after the target orchestration file is generated;

[0046] or,

[0047] The storage module is further configured to respond to a storage operation on the target arrangement file and send the target arrangement file to the server so that the server stores the target arrangement file in the server.

[0048] In one possible design, in another implementation of another aspect of the embodiment of the present application,

[0049] The acquisition module is also used to acquire the first object model file;

[0050] The acquisition module is further used to identify the functional device based on the first object model file to obtain an identification result when the gateway device establishes a communication connection with the functional device;

[0051] The acquisition module is further used to acquire the device identification of the functional device if the recognition result indicates that the recognition is successful;

[0052] The establishment module is also used to establish a binding relationship between the gateway device identification and the device identification.

[0053] In one possible design, in another implementation of another aspect of the embodiment of the present application,

[0054] The display module is further used to display the object model management interface if the user account verification is successful;

[0055] The acquisition module is further used to acquire the first object model through the object model management interface, wherein the first object model includes at least one of device category information, communication protocol information, business information and event information;

[0056] The generating module is further used to generate a first physical model file according to the first physical model, or to send the first physical model to the server so that the server generates the first physical model file.

[0057] In one possible design, in another implementation of another aspect of the embodiment of the present application,

[0058] The acquisition module is further used to modify the first physical model through the physical model management interface to obtain the second physical model if the recognition result indicates that the recognition fails, wherein the first physical model is used to generate the first physical model file;

[0059] The generating module is further used to generate a second physical model file according to the second physical model, or to send the second physical model to the server so that the server generates the second physical model file.

[0060] In one possible design, in another implementation of another aspect of the embodiment of the present application, the functional device control apparatus further includes a sending module and a receiving module;

[0061] A sending module, used for sending device test data to a functional device;

[0062] A receiving module, used for receiving test response data sent by the functional device;

[0063] The acquisition module is further used to modify the first physical model through the physical model management interface to obtain the second physical model if the test response data fails to match the first physical model corresponding to the first physical model file, wherein the first physical model is used to generate the first physical model file;

[0064] The generating module is further used to generate a second physical model file according to the second physical model, or to send the second physical model to the server so that the server generates the second physical model file.

[0065] On the other hand, the present application provides an electronic device, including: a memory, a processor, and a bus system;

[0066] Wherein, the memory is used to store programs;

[0067] The processor is used to execute the program in the memory, and the processor is used to execute the above-mentioned methods according to the instructions in the program code;

[0068] The bus system is used to connect the memory and the processor so that the memory and the processor can communicate with each other.

[0069] Another aspect of the present application provides a computer-readable storage medium, in which instructions are stored. When the computer-readable storage medium is run on a computer, the computer is enabled to execute the above-mentioned methods.

[0070] Another aspect of the present application provides a computer program product or a computer program, the computer program product or the computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium. A processor of an electronic device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the electronic device executes the methods provided by the above aspects.

[0071] It can be seen from the above technical solutions that the embodiments of the present application have the following advantages:

[0072] In an embodiment of the present application, a control method for a functional device is provided. First, a device binding relationship for a gateway device is obtained. The device binding relationship includes a binding relationship between a gateway device identifier and N device identifiers. The gateway device identifier is used to indicate a gateway device. Then, based on the device binding relationship, a communication connection between the gateway device and the N functional devices is established. Next, a target orchestration file is obtained. The target orchestration file is a file generated after orchestration processing of K functional devices, and the target orchestration file carries K device identifiers. If the K device identifiers match the N device identifiers successfully, the K functional devices are controlled according to the target orchestration file. Through the above method, it supports the orchestration and linkage of one or more functional devices, and generates corresponding target orchestration files. Therefore, after the gateway device uses the object model protocol to establish a communication relationship with the functional device, the target orchestration file can be used to control the functional device. Based on this, not only can the pre-arranged functional device coordination effect be achieved, but also the implementation cost of the performance effect can be reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0073] Figure 1 A schematic diagram of an implementation environment of a functional device control system in an embodiment of the present application;

[0074] Figure 2 A schematic diagram of the architecture of a functional device control system in an embodiment of the present application;

[0075] Figure 3 A schematic diagram of a flow chart of a functional device control method in an embodiment of the present application;

[0076] Figure 4 A schematic diagram of a communication relationship between a functional device and a gateway device in an embodiment of the present application;

[0077] Figure 5 A schematic diagram of a stage arrangement interface in an embodiment of the present application;

[0078] Figure 6 Another schematic diagram of the stage arrangement interface in the embodiment of the present application;

[0079] Figure 7This is a schematic diagram of an interface for implementing a duration adjustment operation based on a lighting device in an embodiment of the present application;

[0080] Figure 8 This is a schematic diagram of an interface for implementing a fragment adding operation based on a lighting device in an embodiment of the present application;

[0081] Fig. 9 This is a schematic diagram of an interface for implementing a clip deletion operation based on a lighting device in an embodiment of the present application;

[0082] Fig.10 A schematic diagram of an interface showing multiple arrangement clips in an embodiment of the present application;

[0083] Fig.11 Another schematic diagram of the stage arrangement interface in the embodiment of the present application;

[0084] Fig.12 This is a schematic diagram of an interface for implementing a duration adjustment operation based on an audio device in an embodiment of the present application;

[0085] Fig.13 This is a schematic diagram of an interface for implementing a clip adding operation based on an audio device in an embodiment of the present application;

[0086] Fig.14 It is another schematic diagram of an interface showing multiple arrangement clips in an embodiment of the present application;

[0087] Fig.15 Another schematic diagram of the stage arrangement interface in the embodiment of the present application;

[0088] Fig.16 This is a schematic diagram of an interface for implementing a clip adding operation based on a video device in an embodiment of the present application;

[0089] Fig.17 A schematic diagram of an interface for creating a stage preview effect in an embodiment of the present application;

[0090] Fig.18 A schematic diagram of an interface for managing and arranging files in an embodiment of the present application;

[0091] Fig.19 A schematic diagram of a flow chart for realizing an editing effect based on an editing and control software system in an embodiment of the present application;

[0092] Fig. 20 A schematic diagram of a functional device control device in an embodiment of the present application;

[0093] Fig.21 A schematic diagram of the structure of an electronic device in an embodiment of the present application;

[0094] Fig. 22Schematic diagram of another structure of the electronic device in the embodiment of the present application. DETAILED DESCRIPTION

[0095] The embodiments of the present application provide a control method, device, electronic device and storage medium for a functional device. The present application uses a target arrangement file to control the functional device, which can not only achieve the pre-arranged functional device coordination effect, but also reduce the cost of achieving the performance effect.

[0096] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein, for example. In addition, the terms "including" and "corresponding to" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0097] As science and technology change with each passing day, the equipment control technology that keeps pace with the times is developing towards diversification, intelligence and humanization, and the functional equipment is also more diverse and complex. The functional equipment involved in this application includes but is not limited to stage equipment, fountain performance equipment and light-emitting diode (LED) equipment. The following will be introduced in combination with different scenarios.

[0098] Scenario 1: The stage effects of large venues are created through complex debugging of multiple stage equipment and systems. Most of these stage equipment are digitally controlled, that is, the stage equipment is controlled through a console. Since there is no unified communication protocol and communication interface between stage equipment, the installation, connection, debugging and arrangement of stage equipment are inefficient, making it difficult to form a reusable effect library. The method of arranging stage equipment one by one further increases the implementation costs of both parties.

[0099] Scene 2: Fountain performances often involve a lot of equipment. For musical fountains, the performance of the fountain also needs to be coordinated with the ups and downs of the music. When people feel various sounds, they will unconsciously link these auditory feelings with the performance of the fountain, integrating visual feelings with auditory feelings. Therefore, when arranging fountain performances, it is necessary to arrange sound effect equipment and water spraying equipment (for example, submersible pumps, solenoid valves, underwater colored lights, and inverters and other actuators) to achieve better performance effects.

[0100] Scenario 3: LED devices with various colors and lighting effects can be set outside the commercial building. Most of these LED devices are digitally controlled, that is, the control of the LED devices is achieved through the console. For example, the light show starts at 8 o'clock in the evening, so the LED devices on each commercial building can be automatically started at this time and the light show can be displayed according to the pre-arranged effect. The arrangement method can be independent arrangement for the LED devices set up in each commercial building, or independent arrangement for the LED devices set up in multiple commercial buildings.

[0101] This application proposes a control method for functional devices, which is based on a unified object model protocol, abstracts the functions of functional devices through an object description language, and maps the information of functional devices to a unified editing and control software system. The editing and control software system supports the arrangement and linkage of various functional device effects, and supports real-time effect preview. This application is applied to Figure 1 The functional device control system shown in the figure, as shown in the figure, the functional device control system may include a terminal device, a gateway device, a functional device and a server. Among them, the client of the editing and control software system is deployed on the terminal device, and the client can be run on the terminal device in the form of a browser, or can be run on the terminal device in the form of an independent application (application, APP), etc., which is not limited here. The server of the editing and control software system is deployed on the server. The server involved in this application can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks (Content Delivery Network, CDN), and big data and artificial intelligence platforms. The terminal device can be a smart phone, a tablet computer, a laptop, a PDA, a personal computer, a smart TV, a smart watch, a vehicle-mounted device, a wearable device, etc., but is not limited thereto. The terminal device and the server can be directly or indirectly connected by wired or wireless communication, and this application is not limited here. The number of servers and terminal devices is also not limited. The solution provided in this application can be completed independently by a terminal device, can be completed independently by a server, or can be completed by a terminal device and a server in cooperation. This application does not make any specific limitations on this.

[0102] The following will be combined Figure 1 , introducing the methods of offline control of functional devices and online control of functional devices.

[0103] 1. An offline scenario;

[0104] The user logs in to the editing and control software system provided by the terminal device, edits the functional devices, and saves the editing files locally on the terminal device.

[0105] Functional device A and functional device B can establish a communication connection with gateway device A via wired or wireless means, and at the same time, the terminal device can also establish a communication connection with gateway device A via wired or wireless means. Based on this, the user sends the arrangement file saved locally on the terminal device to gateway device A, and gateway device A controls functional device A and functional device B according to the arrangement file, thereby achieving the effect on the functional device.

[0106] 2. Another offline scenario;

[0107] The user logs in to the editing and control software system provided by the terminal device, and after editing the functional devices, sends the editing file to the gateway device, which saves the editing file.

[0108] Functional device A and functional device B can establish a communication connection with gateway device A in a wired or wireless manner. Based on this, gateway device A controls functional device A and functional device B according to the arrangement file, thereby achieving the effect on the functional device.

[0109] 3. An online scenario;

[0110] The user logs into the editing and control software system provided by the terminal device, and after editing the functional devices, sends the editing file to the server, which saves the editing file.

[0111] Functional device A and functional device B can establish communication connection with gateway device A through wired or wireless means. At the same time, gateway device A and terminal device also establish communication connection with the server respectively. Based on this, the user sends a transmission instruction to the server through the terminal device, and the server responds to the transmission instruction and then sends the arrangement file to gateway device A. Gateway device A controls functional device A and functional device B according to the arrangement file, thereby achieving the effect on the functional device.

[0112] It should be noted that the editing and control software system can adopt a browser and server (Browser / Server, B / S) architecture and be deployed in the cloud in the form of Software as a Service (SaaS). Users can log in to the editing and control software system and use the corresponding services provided by the software by entering the SaaS software address, account number and password in the browser.

[0113] It is understandable that SaaS involves cloud computing technology. Among them, cloud computing is a computing model that distributes computing tasks on a resource pool composed of a large number of computers, so that various application systems can obtain computing power, storage space and information services as needed. The network that provides resources is called a "cloud". The resources in the "cloud" are infinitely expandable in the eyes of users, and can be obtained at any time, used on demand, expanded at any time, and paid for by use. As a basic capability provider of cloud computing, a cloud computing resource pool (referred to as a cloud platform, generally referred to as an Infrastructure as a Service (IaaS) platform) will be established, and various types of virtual resources will be deployed in the resource pool for external customers to choose to use. The cloud computing resource pool mainly includes: computing devices (virtualized machines, including operating systems), storage devices, and network devices.

[0114] According to the logical function division, the Platform as a Service (PaaS) layer can be deployed on the IaaS layer, and the SaaS layer can be deployed on the PaaS layer, or SaaS can be deployed directly on IaaS. PaaS is a platform for software operation, such as databases, web containers, etc. SaaS is a variety of business software, such as web portals, SMS mass senders, etc. Generally speaking, SaaS and PaaS are upper layers relative to IaaS.

[0115] based on Figure 1 The functional equipment control system shown, further see Figure 2 , Figure 2 This is a schematic diagram of the architecture of the functional device control system in the embodiment of the present application. As shown in the figure, the present application mainly includes two parts: a gateway device and an editing and controlling software system. The gateway device connects various functional devices to the gateway device with a unified object model protocol, and realizes communication between functional devices and communication between functional devices and the editing and controlling software system through the gateway device. The editing and controlling software system supports various editing and controlling functions such as object model management, device management, arrangement management, control management, material management, preview management, and synchronization management, and realizes the arrangement and control of performance effects through the editing and controlling software system.

[0116] In combination with the above introduction, the control method of the functional device in this application will be introduced below. Figure 3 , an embodiment of the functional device control method in the embodiment of the present application includes:

[0117] 110. Obtain a device binding relationship for the gateway device, wherein the device binding relationship includes a binding relationship between a gateway device identifier and N device identifiers, the gateway device identifier is used to indicate the gateway device, each device identifier is used to indicate a functional device, and N is an integer greater than or equal to 1;

[0118] In one or more embodiments, the functional device control device may obtain a device binding relationship, which may be in the form of a list, that is, the list includes a binding relationship between a gateway device identifier of a gateway device and N device identifiers. Assuming that the gateway device identifier of the gateway device is "111", for ease of understanding, please refer to Table 1, which is a schematic diagram of a device binding relationship.

[0119] Table 1

[0120]

[0121] Take the device binding relationship shown in Table 1 as an example, that is, the gateway device has a binding relationship with 7 functional devices, and N can be 7 at this time.

[0122] It should be noted that the functional device control device can be deployed on a gateway device, can be deployed on a terminal device, and can also be deployed on a system composed of a gateway device and a terminal device. In steps 110 to 140, the functional device control device is deployed on a gateway device as an example for introduction, however, this should not be understood as a limitation on the present application. Functional devices include but are not limited to lighting equipment, audio equipment, video equipment and mechanical equipment. Lighting equipment includes but is not limited to computer lights, halogen lamps, bubble lamps, effect lights and LEDs. Audio equipment includes but is not limited to microphones, speakers, reverberators, frequency dividers, amplifiers and modulators. Video equipment includes but is not limited to LED screens, projectors, projection screens and plasma TV walls. Mechanical equipment includes but is not limited to lifting platforms, rotating platforms and snow sprayers.

[0123] 120. Establish a communication connection between the gateway device and N functional devices based on the device binding relationship;

[0124] In one or more embodiments, the gateway device can determine the connectable functional devices according to the device binding relationship, based on which the gateway device can establish a communication connection with N functional devices through a physical model protocol. The physical model protocol includes at least one communication protocol supported by the gateway device, and the communication protocols involved in this application include but are not limited to the Message Queuing Telemetry Transport (MQTT) protocol, Modbus protocol, Hyper Text Transfer Protocol (HTTP), Hyper Text Transfer Protocol over Secure Socket Layer (HTTPS), Open Network Video Interface Forum (ONVIF) protocol and Recommended Standard (RS)-485 protocol, etc.

[0125] Based on this, the gateway device can provide RS-485 serial port, Modbus interface and RJ-45 Ethernet port, etc. Functional devices access the interface on the gateway device to achieve physical connection and realize communication based on the object model protocol.

[0126] 130. Obtain a target orchestration file, wherein the target orchestration file is a file generated after orchestration processing is performed on K functional devices, and the target orchestration file carries K device identifiers, where K is an integer greater than or equal to 1;

[0127] In one or more embodiments, the gateway device obtains a target orchestration file, which is an orchestration file generated after a user orchestrates K functional devices through an orchestration software system, wherein the target orchestration file carries K device identifiers, and K is an integer greater than or equal to 1.

[0128] Exemplarily, the target orchestration file is stored in the terminal device, and thus, the user can send the target orchestration file to the gateway device, and based on this, the gateway device receives the target orchestration file.

[0129] Exemplarily, the target orchestration file is stored in the gateway device, based on which the gateway device directly extracts the corresponding target orchestration file.

[0130] Exemplarily, the target orchestration file is stored in a server (or a cloud server), and a user selects the target orchestration file to be issued through the editing and control software system. The server (or a cloud server) sends the selected target orchestration file to the gateway device, and based on this, the gateway device receives the target orchestration file.

[0131] 140. If the K device identifiers are successfully matched with the N device identifiers, the K functional devices are controlled according to the target arrangement file.

[0132] In one or more embodiments, after parsing the target orchestration file, the gateway device can obtain K device identifiers, where the K device identifiers refer to the device identifiers of the K functional devices that have been programmed. Based on this, the gateway device also needs to detect whether the K device identifiers match the N device identifiers. If the N device identifiers include the K device identifiers, it means that the match is successful. Therefore, the K functional devices that can be controlled by the gateway device all establish communication connections with the gateway device. At this time, the gateway device can control the K functional devices according to the target orchestration file.

[0133] If the N device identifiers include T device identifiers among the K device identifiers, it means that the partial match is successful. Therefore, the T functional devices that can be controlled by the gateway device all establish communication connections with the gateway device. At this time, the gateway device can only control the T functional devices according to the target arrangement file.

[0134] If the N device identifiers do not include the K device identifiers, it indicates that the matching fails. Therefore, the gateway device cannot identify the K functional devices. At this time, the gateway device cannot control the T functional devices according to the target orchestration file.

[0135] Specifically, for ease of understanding, see Figure 4 , Figure 4 This is a schematic diagram of the communication relationship between the functional device and the gateway device in the embodiment of the present application. As shown in the figure, the functional device accesses the gateway device through the unified connection management service module in the gateway device, and the gateway device interacts with the connection management service through the device access software development kit (SDK) for data and command interaction, and then interacts with the editing and control software system with the object model of each type of functional device. The gateway device is used as an edge device to achieve the effect of cloud-side orchestration, edge-site execution, and cloud-edge collaboration, thereby improving real-time performance, stability, and orchestration efficiency.

[0136] The following will be combined Figure 4 , introduces the processing modules built into the gateway device.

[0137] Connection management service module: Functional devices and gateway devices establish communication connections through this module. The connection management service module has built-in various standard communication protocols, such as MQTT, Modbus, HTTP, HTTPS, ONVIF, and RS-485, etc. It also supports developers to embed private communication protocols. Private protocols are stored in the form of libraries in the gateway device for calling, thereby achieving dual compatibility between standard protocols and private protocols. Some device manufacturers use self-developed private communication protocols that can only be recognized by the manufacturer. In order to be more compatible with various types of devices, the gateway device supports developers to embed private protocols to achieve normal communication with such devices using private protocols.

[0138] Device access SDK: used to complete device registration, data reporting, method calling, and establish communication with the programming and control software system. SDK supports different programming languages ​​such as C, node.js, and Python, making it easy for developers to choose the appropriate language to complete the development of gateway device functions.

[0139] Object model: When a functional device is registered in the cloud (or locally on the terminal device), an object model describing the properties of the functional device is generated for the functional device, and the object model is sent to the gateway device in the JavaScript Object Notation (JSON) format. Among them, the object model is a description of "what is the device", "what the device can do", and "what services the device can provide to the outside world". It digitizes the physical device in the physical space and builds a data model of the entity. The description language of the object (Thing Specification Language, TSL) adopts the JSON format. In the functional device scenario, defining the object model means defining the device function. After completing the device function definition, the platform can automatically generate the object model of the functional device (that is, TSL in JSON format).

[0140] When a functional device communicates with a gateway device, the physical model converts the device data into a data format that complies with the physical model specification in the gateway device, and then reports it to the programming and control software system. The physical model includes the following data fields:

[0141] (1) Device category information: used to describe the device type, such as lighting equipment or audio equipment.

[0142] (2) Communication protocol information: used to describe the communication protocol between the functional device and the gateway device, such as the MQTT protocol, HTTPS, or ONVIF protocol.

[0143] (3) Service information: This is used to describe the service data fields of functional devices, such as brightness, color, horizontal angle, vertical angle, and speed.

[0144] (4) Event information: used to describe the event field of the device, such as online status, fault status, etc.

[0145] In the embodiment of the present application, a control method for a functional device is provided. Through the above method, one or more functional devices are supported to be arranged and linked, and a corresponding target arrangement file is generated. Therefore, after the gateway device uses the object model protocol to establish a communication relationship with the functional device, the target arrangement file can be used to control the functional device. Based on this, not only can the pre-arranged functional device coordination effect be achieved, but also the realization cost of the performance effect can be reduced.

[0146] Optionally, in the above Figure 3 On the basis of the corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, before obtaining the target arrangement file, the following may also be included:

[0147] Displaying K device controls corresponding to the gateway device in the device selection area, wherein each device control corresponds to a functional device;

[0148] In response to an editing operation on any device control among the K device controls, obtaining arrangement information of a functional device corresponding to any device control;

[0149] If the arrangement information of K functional devices is obtained, a target arrangement file is generated according to the arrangement information of the K functional devices.

[0150] In one or more embodiments, a method for generating a target orchestration file based on an orchestration software system is introduced. As can be seen from the aforementioned embodiments, the orchestration software system provides a client, based on which a user can select K functional devices to be orchestrated through a device selection area provided by the client, wherein each functional device obtains corresponding orchestration information after being orchestrated. After the orchestration is completed, the orchestration information of the K functional devices is synthesized to obtain a target orchestration file.

[0151] Specifically, for ease of understanding, see Figure 5 , Figure 5 This is a schematic diagram of the stage arrangement interface in the embodiment of the present application. As shown in the figure, it is assumed that the gateway device is "Gateway Device 1". Among them, A1 is used to indicate the device selection area, and the gateway device control indicated by A11 is displayed in the device selection area. After clicking the gateway device control, the device controls corresponding to the K functional devices associated with the gateway device can be displayed. For example, the device control indicated by A12 is the "lighting device b". The user clicks on a device control, or directly drags a device control to the device arrangement area indicated by A2, so that the user can arrange the functional device through the editing tool area indicated by A3.

[0152] The following will be combined Figure 5 Further introduction to the stage arrangement interface.

[0153] (1) Device selection area: A tree list is used to display the registered gateway devices and their connected functional devices.

[0154] (2) Equipment arrangement area: After selecting the functional equipment to be arranged in the equipment selection area, you can directly click the equipment control corresponding to the functional equipment, or drag the equipment control to the equipment arrangement area to start arranging the functional equipment in time sequence. The display content of the equipment arrangement area is related to the equipment type.

[0155] (3) Editing tool area: Displays the timing scale adjustment tool indicated by A31. This tool is a resident tool. By clicking "-" and "+" or dragging the slider, you can dynamically adjust the timing scale of the editing clip in the device editing area. In addition to the resident tools, different tool options are also provided for editing for different types of functional devices.

[0156] It should be noted that Figure 5 The interface shown is only a schematic diagram. In actual applications, the layout and display content of the interface can be flexibly adjusted and should not be construed as a limitation on the present application.

[0157] Secondly, in an embodiment of the present application, a method for generating a target editing file based on an editing and controlling software system is provided. Through the above method, a user can use the editing and controlling software system to uniformly edit one or more functional devices, thereby achieving efficient editing of the performance effects and effectively reducing the cost of realizing the performance effects.

[0158] Optionally, in the above Figure 3 On the basis of the corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, in response to an editing operation on any device control among the K device controls, obtaining arrangement information of a functional device corresponding to any device control may specifically include:

[0159] In response to a selection operation on any device control, displaying an arrangement fragment of a functional device corresponding to any device control in the device arrangement area;

[0160] In response to a selection operation for an arrangement segment, displaying an input item control set on the editing tool area;

[0161] In response to an input operation on the input item control set, the arrangement information of the functional device corresponding to any device control is obtained.

[0162] In one or more embodiments, a method for setting arrangement information for a functional device is introduced. As can be seen from the aforementioned embodiments, after the user clicks on a device control in the device selection area, the selection operation of the device control is triggered. Based on this, the arrangement fragment of the functional device corresponding to the device control can be displayed in the device arrangement area. Next, after the user selects the arrangement fragment, an input item control set can be displayed in the editing tool area. Among them, the input item control set includes at least one input item control, and the user needs to input relevant information through the input item control. In combination with the information entered by the user, the corresponding arrangement information can be generated.

[0163] Again, in the embodiment of the present application, a method for setting arrangement information for functional devices is provided. Through the above method, users can use the relevant interface provided by the editing and control software system to uniformly edit the functional devices, and can arrange the functional devices in a fragmented form, thereby improving the flexibility of arrangement. For users, the entire arrangement process is visualized, so they can understand the arrangement more intuitively, thereby improving the efficiency of functional device arrangement and effectively reducing the cost of achieving the performance effect.

[0164] Optionally, in the above Figure 3 On the basis of the corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, the functional device corresponding to any device control is a lighting device, the arrangement information of the functional device corresponding to any device control is the arrangement information of the lighting device, the arrangement information of the lighting device includes at least one of the brightness information, color information, angle information, linear speed information and angular speed information of the lighting device, and the arrangement segment is a first lighting arrangement segment;

[0165] It may also include:

[0166] When a duration adjustment operation for the first lighting choreography segment is detected, the first lighting choreography segment after the duration adjustment is displayed in the device choreography area;

[0167] When a clip adding operation is detected, displaying a second lighting arrangement clip on the device arrangement area;

[0168] When a duration adjustment operation for the second lighting choreography segment is detected, the second lighting choreography segment after the duration adjustment is displayed in the device choreography area, wherein the second lighting choreography segment does not overlap with the first lighting choreography segment;

[0169] When a deletion operation for the second lighting choreography clip is detected, the second lighting choreography clip is cancelled from being displayed in the device choreography area.

[0170] In one or more embodiments, a method for programming lighting equipment is introduced. As can be seen from the above embodiments, different types of functional equipment need to program different types of information. Taking lighting equipment as an example, the programming information of lighting equipment includes at least one of brightness information, color information, angle information, linear speed information and angular speed information of the lighting equipment.

[0171] Specifically, for ease of understanding, see Figure 6 , Figure 6 This is another schematic diagram of the stage arrangement interface in the embodiment of the present application. As shown in the figure, B1 is used to indicate a functional device selected by the user (for example, "lighting device b").

[0172] B2 is used to indicate the editing tool area corresponding to the lighting device, among which B21 is used to indicate the switch control, which is used to program the switch status of the lighting device. B22 is used to indicate the "Brightness" input item control to input brightness information. The "Brightness" input item control is used to program the brightness value of the lighting device. It supports manual input of numbers or clicking the up and down buttons to increase or decrease. B23 is used to indicate the "Color" input item control to input color information. The "Color" input item control is used to program the color value of the lighting device. Single selection is made from the given color value in the form of a drop-down box. B24 is used to indicate the "Angle" input item control to input angle information. The "Angle" input item control is used to program the angle of the lighting device, including the horizontal angle and the vertical angle. The two angle values ​​are edited through the drop-down box. B25 is used to indicate the "Linear Speed" input item control to input linear speed information. The "Linear Speed" input item control is used to program the linear speed of the movement of the lighting device. B26 is used to indicate the "Angular Speed" input item control to input angular speed information. The "Angular Speed" input item control is used to program the angular speed of the movement of the lighting device.

[0173] B3 is used to indicate the first lighting arrangement segment. After dragging the device control corresponding to "Lighting Device B" to the device arrangement area, a first lighting arrangement segment with a duration of 5 minutes can be created by default. For example, the first lighting arrangement segment is represented as a dark rectangular segment with a light symbol. When the first lighting arrangement segment is in a selected state (i.e., the selected or unselected state is switched by clicking), it is in an arrangeable state.

[0174] Based on this, the following will introduce the operation method in the programmable state.

[0175] 1. Adjust the duration of the lighting arrangement clip;

[0176] For example, see Figure 7 , Figure 7This is a schematic diagram of an interface for implementing a duration adjustment operation based on lighting equipment in an embodiment of the present application. As shown in the figure, the user shortens the duration of the first lighting arrangement segment by stretching the first lighting arrangement segment to the left, or lengthens the duration of the first lighting arrangement segment by stretching the first lighting arrangement segment to the right.

[0177] 2. Add lighting arrangement clips;

[0178] For example, see Figure 8 , Figure 8 This is a schematic diagram of an interface for implementing a segment adding operation based on lighting equipment in an embodiment of the present application. As shown in the figure, the user can long press the device arrangement area to call out the segment adding control as indicated by C1. After the user clicks the segment adding control, the segment adding operation is triggered, thereby displaying the second lighting arrangement segment on the device arrangement area.

[0179] 3. Delete the lighting arrangement clips;

[0180] For example, see Fig. 9 , Fig. 9 This is a schematic diagram of an interface for implementing a segment deletion operation based on lighting equipment in an embodiment of the present application. As shown in the figure, the user can long press the second lighting arrangement segment to call out the segment deletion control as indicated by D1. After the user clicks the segment deletion control, the deletion operation for the second lighting arrangement segment is triggered, thereby canceling the display of the second lighting arrangement segment in the device arrangement area.

[0181] 4. Display multiple lighting arrangement clips;

[0182] For example, see Fig.10 , Fig.10 This is a schematic diagram of an interface showing multiple choreography segments in an embodiment of the present application. As shown in the figure, each lighting device supports adding multiple lighting choreography segments, and there is no intersection between the lighting choreography segments, and each lighting choreography segment can be choreography separately. For example, the first lighting choreography segment indicated by E1 and the second lighting choreography segment indicated by E2 after the duration is adjusted do not overlap, that is, there is no overlapping area.

[0183] It should be noted that Figure 6 , Figure 7 , Figure 8 , Fig. 9 and Fig.10 The interfaces shown are only for illustration. In actual applications, the layout and display content of the interfaces can be flexibly adjusted and should not be construed as limitations on the present application.

[0184] Furthermore, in the embodiment of the present application, a method for arranging lighting equipment is provided. Through the above method, users can use the relevant interface provided by the editing and control software system to uniformly edit the lighting equipment, and can arrange the lighting equipment in a fragmented form, thereby improving the flexibility of arrangement. For users, the entire arrangement process is visualized, so they can understand the arrangement more intuitively, thereby improving the efficiency of lighting equipment arrangement and effectively reducing the cost of achieving performance effects. In addition, users can also customize the lighting arrangement fragments, thereby increasing the diversity and richness of the performance effects of lighting equipment.

[0185] Optionally, in the above Figure 3 On the basis of the corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, the functional device corresponding to any device control is an audio device, the arrangement information of the functional device corresponding to any device control is the arrangement information of the audio device, the arrangement information of the audio device includes at least one of volume information, fade-in duration information, fade-out duration information and playback ratio information, and the arrangement segment is a first audio arrangement segment;

[0186] The arrangement fragment of the functional device corresponding to any device control is displayed in the device arrangement area, which may include:

[0187] In response to a selection operation on an audio import control, displaying an audio import list, wherein the audio import list includes at least one audio file information;

[0188] In response to a selection operation on the first audio information, displaying a first audio arrangement segment corresponding to the audio device in the device arrangement area, wherein the first audio information corresponds to the first audio arrangement segment;

[0189] It may also include:

[0190] When a selection operation for the second audio information is detected, displaying the second audio arrangement segment on the device arrangement area, wherein the second audio information corresponds to the second audio arrangement segment;

[0191] When a moving operation for the second lighting arrangement segment is detected, a second audio arrangement segment after position adjustment is displayed in the device arrangement area, wherein the second audio arrangement segment and the first audio arrangement segment may overlap.

[0192] In one or more embodiments, a method for arranging audio devices is introduced. It can be seen from the above embodiments that different types of functional devices need to arrange different types of information. Taking audio devices as an example, the arrangement information of audio devices includes at least one of the volume information, fade-in duration information, fade-out duration information and playback magnification information of the audio devices.

[0193] Specifically, for ease of understanding, see Fig.11 , Fig.11 This is another schematic diagram of the stage arrangement interface in the embodiment of the present application. As shown in the figure, F1 is used to indicate a functional device selected by the user (for example, "audio device a").

[0194] F2 is used to indicate the editing tool area corresponding to the audio device, among which F21 is used to indicate the switch control, which is used to program the switch status of the audio device. F22 is used to indicate the audio import control, which is used to import the audio file material to be edited. F23 is used to indicate the "volume" input item control to enter the volume information. The "volume" input item control is used to program the audio playback volume. It supports manual input of numbers or clicking the up and down buttons to increase or decrease adjustments. F24 is used to indicate the "multiplier" input item control to enter the multiplier information. The "multiplier" input item control is used to program the audio playback speed multiplier. The higher the multiplier, the faster the playback speed. F25 is used to indicate the "fade-in duration" input item control to enter the fade-in duration information. The "fade-in duration" input item control is used to program the fade-in duration when the audio starts to play, in seconds. F26 is used to indicate the "fade-out duration" input item control to enter the fade-out duration information. The "fade-out duration" input item control is used to program the fade-out duration before the audio playback ends, in seconds.

[0195] F3 is used to indicate the first audio arrangement segment. After the user selects the device control corresponding to "audio device a", click the audio import control, thereby displaying the audio import list, which includes at least one audio file information (e.g., file name) that can be imported into the audio file. The user can select the first audio information (e.g., song A), that is, select the audio file that needs to be played on "audio device a". Among them, the imported audio file is presented in the form of an audio arrangement segment in the device arrangement area. After importing the audio file, an audio arrangement segment will be created according to the actual duration of the audio. For example, the first audio arrangement segment is represented as a dark rectangular segment carrying a speaker logo. When the first audio arrangement segment is in a selected state (i.e., switching between selected and unselected states by clicking), it is in an arrangeable state.

[0196] Based on this, the following will introduce the operation method in the programmable state.

[0197] 1. Adjust the duration of the audio arrangement clip;

[0198] For example, see Fig.12 , Fig.12 This is a schematic diagram of an interface for implementing a duration adjustment operation based on an audio device in an embodiment of the present application. As shown in the figure, the user shortens the duration of the first audio arrangement segment by stretching it to the left or to the right.

[0199] 2. Add audio arrangement clips;

[0200] For example, see Fig.13 , Fig.13 This is a schematic diagram of an interface for implementing a clip adding operation based on an audio device in an embodiment of the present application. As shown in the figure, the user clicks the audio import control again, thereby displaying an audio import list as indicated by G1. Assuming that the user selects the second audio information (e.g., song C), the selection operation for the second audio information is triggered. Based on this, the imported audio file is presented in the form of an audio arrangement clip in the device arrangement area, that is, the first audio arrangement clip and the second audio arrangement clip are displayed simultaneously in the device arrangement area.

[0201] 3. Delete the lighting arrangement clips;

[0202] It should be noted that the method of deleting audio arrangement clips is similar to the method of deleting lighting arrangement clips, so it will not be repeated here.

[0203] 4. Display multiple audio arrangement clips;

[0204] For example, see Fig.14 , Fig.14 Another interface diagram showing multiple arrangement clips in an embodiment of the present application is shown in the figure. As shown in the figure, each audio device supports adding multiple audio arrangement clips, and the audio arrangement clips are allowed to intersect to achieve a mixing effect, and each audio arrangement clip can be arranged separately. For example, the first audio arrangement clip indicated by H1 overlaps with the second audio arrangement clip indicated by H2 after the length is adjusted, that is, there is an overlapping area.

[0205] It should be noted that Fig.11 , Fig.12 , Fig.13 and Fig.14 The interfaces shown are only for illustration. In actual applications, the layout and display content of the interfaces can be flexibly adjusted and should not be construed as limitations on the present application.

[0206] Furthermore, in an embodiment of the present application, a method for arranging audio devices is provided, through which a user can use the relevant interface provided by the editing and control software system to uniformly edit the audio devices, and can arrange the audio devices in a fragmented form, thereby improving the flexibility of the arrangement. For the user, the entire arrangement process is visualized, so the arrangement can be understood more intuitively, thereby improving the efficiency of the audio device arrangement and effectively reducing the cost of achieving the performance effect. In addition, the user can also customize the audio arrangement fragments to increase the diversity and richness of the audio device performance effects.

[0207] Optionally, in the above Figure 3 On the basis of the corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, the functional device corresponding to any device control is a video device, the arrangement information of the functional device corresponding to any device control is the arrangement information of the video device, the arrangement information of the video device includes at least one of the start time information, the time upper limit information, the play mode information and the brightness information, and the arrangement segment is the first video arrangement segment;

[0208] The arrangement fragment of the functional device corresponding to any device control is displayed in the device arrangement area, which may include:

[0209] In response to a selection operation on a video import control, displaying a video import list, wherein the video import list includes at least one video file information;

[0210] In response to a selection operation on the first video information, displaying a first video arrangement segment corresponding to the video device in the device arrangement area, wherein the first video information corresponds to the first video arrangement segment;

[0211] It may also include:

[0212] When a selection operation for the second video information is detected, displaying the second video arrangement segment on the device arrangement area, wherein the second video information corresponds to the second video arrangement segment;

[0213] When a deletion operation on the second video arrangement segment is detected, canceling display of the second video arrangement segment in the device arrangement area;

[0214] When an editing operation on the first video arrangement segment is detected, editing information of the first video arrangement segment is displayed in the device arrangement area, wherein the editing information includes at least one of name information, description information and sorting information.

[0215] In one or more embodiments, a method for arranging video devices is introduced. As can be seen from the above embodiments, different types of functional devices need to arrange different types of information. Taking video devices as an example, the arrangement information of video devices includes at least one of the start time information, time upper limit information, play mode information and brightness information of the video devices.

[0216] Specifically, for ease of understanding, see Fig.15 , Fig.15 This is another schematic diagram of the stage arrangement interface in the embodiment of the present application. As shown in the figure, I1 is used to indicate a functional device selected by the user (for example, "video device a").

[0217] F2 is used to indicate the editing tool area corresponding to the video device, wherein I21 is used to indicate the switch control, which is used to arrange the switch state of the video device. I22 is used to indicate the video import control, which is used to import the video file material to be arranged. I23 is used to indicate the "start time" input item control to input the start time information. The "start time" input item control is used to arrange the time when the video starts playing. This time is a relative time. After the arrangement file is started, the video starts playing after the relative time. I24 is used to indicate the "play mode" input item control to input the play mode information. The "play mode" input item control is used to select loop play or single play, etc. I25 is used to indicate the "time limit" input item control to input the time limit information. The "time limit" input item control is used to arrange the total duration of the video list playback. If the total duration of the video files in the video list exceeds the time limit, the timeout part will be cut off and not played. If the total duration of the video files in the video list does not reach the time limit, it will be played according to the actual total duration. That is, the time limit refers to the duration limit of the video file. I26 is used to indicate the "brightness" input item control to input brightness information. The "brightness" input item control is used to edit the brightness value of the video. I31 is used to indicate the "delete" control to delete the video. I32 is used to indicate the "sort" control to sort the video.

[0218] After the user selects the device control corresponding to "video device a", click the video import control, thereby displaying a video import list, which includes at least one video file information (e.g., file name) that can be imported into a video file. The user can select the first video information (e.g., video A), that is, select the video file that needs to be played on "video device a". Among them, the imported video files are presented in the form of a list in the device arrangement area. For example, the first video arrangement segment is represented as a row of data (including file name, description, and duration, etc.). The video files are played in the order of the list. When the first video arrangement segment is in a selected state (i.e., switching between selected and unselected states by clicking), it is in an editable state.

[0219] Based on this, the following will introduce the operation method in the programmable state.

[0220] 1. Add video editing clips;

[0221] For example, see Fig.16 , Fig.16This is a schematic diagram of an interface for implementing a segment adding operation based on a video device in an embodiment of the present application. As shown in the figure, the user clicks the video import control again, thereby displaying a video import list as indicated by J1. Assuming that the user selects the second video information (for example, video song C), the selection operation for the second video information is triggered, based on which the first video arrangement segment and the second video arrangement segment are displayed in the device arrangement area.

[0222] 2. Delete the video editing clips;

[0223] For example, please refer again to Fig.15 , the user clicks the "delete" control indicated by I31, that is, deletes the corresponding video arrangement segment. Assuming that the "delete" control corresponding to the second video arrangement segment is clicked, the second video arrangement segment is cancelled from being displayed in the device arrangement area.

[0224] 3. Edit the video and arrange the clips;

[0225] For example, please refer again to Fig.15 The user can perform editing operations on the first video arrangement segment, for example, input name information, description information, and sorting information, thereby obtaining editing information of the first video arrangement segment.

[0226] It should be noted that Fig.15 and Fig.16 The interfaces shown are only for illustration. In actual applications, the layout and display content of the interfaces can be flexibly adjusted and should not be construed as limitations on the present application.

[0227] Furthermore, in an embodiment of the present application, a method for arranging video devices is provided. Through the above method, users can use the relevant interface provided by the editing and control software system to uniformly edit the video devices, and can arrange the video devices in a fragmented form, thereby improving the flexibility of the arrangement. For users, the entire arrangement process is visualized, so they can understand the arrangement more intuitively, thereby improving the efficiency of video device arrangement and effectively reducing the cost of achieving the performance effect. In addition, users can also customize the video arrangement fragments to increase the diversity and richness of the video device performance effects.

[0228] Optionally, in the above Figure 3 On the basis of the corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, before generating the target orchestration file according to the orchestration information of the K functional devices, the following may also be included:

[0229] Display the main control corresponding to the gateway device in the device list, and display the sub-control corresponding to each functional device in the K functional devices;

[0230] When a preview operation for the main control is detected, displaying a first arrangement result according to the arrangement information of the K functional devices;

[0231] When a preview operation for P sub-controls is detected, a second arrangement result is displayed according to arrangement information of the P functional devices, wherein the P functional devices are included in the K functional devices, and P is an integer greater than or equal to 1 and less than or equal to K.

[0232] In one or more embodiments, a method for previewing the arrangement effects of different functional devices is introduced. As can be seen from the above embodiments, after completing the arrangement of the functional devices, the user can also browse the arrangement effects through the editing and control software system.

[0233] Specifically, for ease of understanding, see Fig.17 , Fig.17 This is a schematic diagram of an interface for creating a stage preview effect in an embodiment of the present application. As shown in the figure, K1 is used to indicate the device list, K11 is used to indicate the main control corresponding to the gateway device, K12 is used to indicate the sub-control corresponding to the functional device, K2 is used to indicate the "Create Preview" control, K3 is used to indicate the preview list, and K4 is used to indicate the "Preview" control.

[0234] After the functional equipment is arranged, users can preview the effect according to a single functional equipment or a combination of functional equipment. After clicking the "Create Preview" control, first, fill in the preview file name. Then select the functional equipment to be previewed in the shuttle box. The left side of the shuttle box is the list of arranged devices, and the right side is the selected preview list. In this component, you can select a single functional equipment or a combination of functional equipment and add it to the preview list on the right. Finally, click the "Preview" control to preview the effect of the selected functional equipment. If the preview effect meets the requirements, the preview file can be saved as a formal file; if the preview effect does not meet the requirements, it can be rearranged.

[0235] Exemplarily, after the user clicks a main control (eg, gateway device 1), a preview operation is triggered, and then a first orchestration result associated with gateway device 1 may be displayed, wherein the first orchestration result is obtained based on orchestration information of K functional devices.

[0236] Exemplarily, after the user clicks P sub-controls (eg, audio device a and lighting device a), a preview operation is triggered, and then the second arrangement result associated with audio device a and lighting device a may be displayed.

[0237] Again, in an embodiment of the present application, a method for previewing the editing and arrangement effects of different functional devices is provided. Through the above method, users can use the relevant interface provided by the editing and control software system to uniformly manage and arrange the functional devices. Considering that the functional devices need to cooperate with each other to reproduce the on-site adjustment effects, the editing and control software system can realize visual preview, thereby effectively reducing the equipment editing time and improving the editing effect. After the editing is completed, the editing effect is solidified into the form of a configuration file, which is convenient for subsequent multiple debugging and other processing.

[0238] Optionally, in the above Figure 3 On the basis of the corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, after generating the target arrangement file, the following may also be included:

[0239] In response to a storage operation for a target orchestration file, the target orchestration file is stored in the gateway device;

[0240] or,

[0241] In response to the storage operation for the target orchestration file, the target orchestration file is sent to the server, so that the server stores the target orchestration file in the server.

[0242] In one or more embodiments, two methods of storing the target orchestration file are introduced. As can be seen from the aforementioned embodiments, after the orchestration file is generated, it can also be stored. The target orchestration file will be taken as an example for introduction below. The target orchestration file whose preview effect meets the requirements can be directly saved in the gateway device, or saved in the terminal device, or the target orchestration file is uploaded to the server and saved by the server.

[0243] Specifically, for ease of understanding, see Fig.18 , Fig.18 This is a schematic diagram of an interface for managing orchestration files in an embodiment of the present application. As shown in the figure, the orchestration files are uniformly stored in the orchestration file list indicated by L1, where L2 is used to indicate the "Delete" control. After clicking the "Delete" control, the corresponding orchestration file can be deleted. L3 is used to indicate the "Synchronize" control. It is assumed that the user clicks the "Synchronize" control corresponding to the target orchestration file to call up the online gateway device list. After selecting a single or multiple gateway devices, click the "Confirm" control to start synchronizing the target orchestration file to the selected gateway device. After receiving the target orchestration file, the gateway device will control the functional devices on site according to the description of the target orchestration file to achieve the expected orchestration effect.

[0244] Again, in the embodiment of the present application, two methods of storing the target orchestration file are provided. Through the above methods, if the orchestration file is stored locally, the control of the functional device can be realized even in an offline state. If the orchestration file is stored in the cloud, not only the loss of the orchestration file can be avoided, but also the reuse of the orchestration file can be realized.

[0245] Optionally, in the above Figure 3 On the basis of the corresponding embodiments, another optional embodiment provided by the embodiment of the present application may further include:

[0246] Obtain the first object model file;

[0247] When the gateway device establishes a communication connection with the functional device, the functional device is identified based on the first object model file to obtain an identification result;

[0248] If the recognition result indicates that the recognition is successful, obtaining the device identification of the functional device;

[0249] Establish a binding relationship between the gateway device ID and the device ID.

[0250] In one or more embodiments, a method for establishing a binding relationship between devices is introduced. A user can select a first object model file in the editing and control software system and synchronize the first object model file to a gateway device. After the gateway device receives the first object model file, it can convert the first object model file into an executable file and install it. After the installation is complete, the gateway device can identify the functional device connected to the gateway device and report the functional device status information to the editing and control software system.

[0251] Specifically, when the gateway device establishes a communication connection with the functional device through the RS-485 serial port, Modbus interface or RJ-45 Ethernet port, the gateway device identifies the functional device based on the first physical model file. If the connected functional device can be identified, it means that the identification is successful. Based on this, the gateway device uploads the identified device identification to the editing and control software system. The editing and control software system will automatically register these functional devices and logically mount the functional devices to the name of the gateway device, forming a topological relationship network between the gateway device and the functional device, which is represented by the binding relationship between the gateway device identification and the device identification.

[0252] Secondly, in an embodiment of the present application, a method for establishing a binding relationship between devices is provided. Through the above method, considering that different functional devices often come from different manufacturers and each has an independent control system, the gateway device communicates with the functional device based on the object model file, thereby achieving the effect of debugging, linkage and orchestration between functional devices, thereby reducing labor costs.

[0253] Optionally, in the above Figure 3 On the basis of the corresponding embodiments, another optional embodiment provided by the embodiment of the present application may further include:

[0254] If the user account is successfully verified, the object model management interface will be displayed;

[0255] Acquire a first object model through an object model management interface, wherein the first object model includes at least one of device category information, communication protocol information, service information, and event information;

[0256] Generate a first physical model file according to the first physical model, or send the first physical model to the server so that the server generates the first physical model file.

[0257] In one or more embodiments, a method for generating a model file is introduced. Before arranging functional devices, a gateway device needs to be registered first. Among them, the gateway device first connects to the Internet through Ethernet, and the color of the indicator light can be used to determine whether it is connected to the network. For example, green indicates that it is connected, red indicates that it is not connected, and orange indicates that it is connecting. After the gateway device successfully connects to the network, the user can fill in the device identification of the gateway device in the editing and control software system, and register the gateway device to the user account. After the registration is completed, the gateway device will be uniquely managed by the user account.

[0258] Specifically, the user can log in to the editing and control software system with a user account. If the user account is successfully verified, the editing and control software system will display the physical model management interface, and define the physical model of each functional device in the physical model management interface. The following will introduce the definable contents respectively.

[0259] (1) Device category information: defines the category of functional devices, such as audio equipment or lighting equipment.

[0260] (2) Communication protocol information: defines the standard protocols and custom protocols used by functional devices. Standard protocols refer to protocols that are natively supported, such as HTTP. For custom protocols, it is necessary to upload the server version of the protocol file and the client version of the protocol file separately. The server version of the protocol file is hosted on the server of the editing and control software system. When receiving a client request using the protocol, the server uses the protocol to communicate with it. The client version of the protocol file can be saved in the cloud database or locally on the terminal device for synchronization to the gateway device using the protocol, so that the gateway device has the ability to use the protocol to communicate with the cloud editing and control software.

[0261] (3) Business information: defines the business data fields of the functional device. The field types supported include but are not limited to Boolean, integer, string, floating point, enumeration, time, structure, and array. The corresponding fields can be selected according to the specific situation of the functional device.

[0262] (4) Event information: defines the status events of functional devices, including online status and fault status. When a functional device is online or normal, it will not trigger event reporting. Once a functional device is offline or faulty, it will trigger event reporting, and the editing and control software system will actively push messages to the user for intervention.

[0263] After the physical model is defined, the terminal device generates a first physical model file based on the first physical model, saves it locally in the form of a JSON file, and supports synchronizing the physical model file to the specified gateway device. Alternatively, it saves it in the form of a JSON file in the cloud file library, and supports synchronizing the physical model file to the specified gateway device.

[0264] Again, in an embodiment of the present application, a method for generating a physical model file is provided. Through the above method, the user can also input information related to the physical model in the physical model management interface, thereby achieving efficient orchestration of the presentation effects through a unified physical model protocol, effectively reducing the cost of implementing the presentation effects.

[0265] Optionally, in the above Figure 3 On the basis of the corresponding embodiments, another optional embodiment provided by the embodiment of the present application may further include:

[0266] If the recognition result indicates that the recognition fails, modifying the first physical model through the physical model management interface to obtain a second physical model, wherein the first physical model is used to generate a first physical model file;

[0267] Generate a second physical model file according to the second physical model, or send the second physical model to the server so that the server generates the second physical model file.

[0268] In one or more embodiments, a method for modifying a physical model based on the recognition result is introduced. If the gateway device cannot recognize the connected functional device, the user can modify the first physical model through the physical model management interface to obtain a second physical model, based on which the terminal device generates a second physical model file according to the second physical model, or the terminal device sends the second physical model to the server so that the server generates the second physical model file.

[0269] Again, in the embodiment of the present application, a method for correcting the physical model based on the recognition result is provided. Through the above method, the user can modify the physical model that failed to be recognized so that the modified physical model can match the functional device connected, thereby improving the reliability of device access. In addition, not only can the updated physical model file be generated locally, but also in the cloud, so that the physical model file can be updated offline or online, thereby increasing the flexibility of the solution.

[0270] Optionally, in the above Figure 3 On the basis of the corresponding embodiments, another optional embodiment provided by the embodiment of the present application further includes:

[0271] Sending device test data to functional devices;

[0272] receiving test response data sent by the functional device;

[0273] If the test response data fails to match the first physical model corresponding to the first physical model file, modify the first physical model through the physical model management interface to obtain a second physical model, wherein the first physical model is used to generate the first physical model file;

[0274] Generate a second physical model file according to the second physical model, or send the second physical model to the server so that the server generates the second physical model file.

[0275] In one or more embodiments, a method for modifying the physical model based on test data is introduced. After the functional device is registered, the editing and control software system automatically sends test data to determine whether the functional device mounted on the gateway device matches the installed physical model file. Based on this, there are the following two situations:

[0276] 1. Matching failed;

[0277] After the gateway device sends the device test data to the functional device, if the editing and control software system does not receive or cannot parse the test response data responded by the functional device, the test response data fails to match the first physical model corresponding to the first physical model file. Therefore, the user can modify the first physical model through the physical model management interface to obtain the second physical model. Based on this, the terminal device generates a second physical model file according to the second physical model, or the terminal device sends the second physical model to the server so that the server generates the second physical model file. Finally, the second physical model file is synchronized to the gateway device for installation.

[0278] 2. Matching is successful;

[0279] After the gateway device sends the device test data to the functional device, if the editing and control software system receives and parses the test response data responded by the functional device, there is no need to modify the first object model.

[0280] Again, in the embodiment of the present application, a method for correcting the physical model based on the test data is provided. Through the above method, the user can modify the physical model that cannot respond to accurate data, so that the modified physical model can match the functional device connected, thereby improving the reliability of device access. In addition, not only can the updated physical model file be generated locally, but also in the cloud, so that the physical model file can be updated offline or online, thereby improving the flexibility of the solution.

[0281] Based on the introduction of the above embodiments, Fig.19 For further explanation, see Fig.19 , Fig.19 This is a flow chart of realizing the arrangement effect based on the arrangement control software system in the embodiment of the present application, as shown in the figure, specifically:

[0282] In step S1, the gateway device is registered.

[0283] In step S2, after registration is completed, the object model is defined through the object model management interface provided by the editing and control software system;

[0284] In step S3, the defined object model is synchronized to the gateway device.

[0285] In step S4, when the gateway device establishes a communication connection with the functional device, the connected functional device is identified using the object model, and the successfully identified functional device is registered.

[0286] In step S5, the gateway device determines whether the functional device conforms to the description of the object model. If so, the process proceeds to step S6. If not, the process proceeds to step S2 and redefines the object model.

[0287] In step S6 , the gateway device tests the functional device.

[0288] In step S7, the gateway device determines whether the functional device can report data and whether the gateway device can issue instructions. If the functional device can report data and the gateway device can issue instructions, step S9 is executed. If the functional device cannot report data or the gateway device cannot issue instructions, step S8 is executed.

[0289] In step S8 , commissioning of the functional device continues.

[0290] In step S9, the functional devices are arranged through the editing and control software system to obtain corresponding arrangement performance effects.

[0291] In step S10, the user can preview the performance effect after editing.

[0292] In step S11, the user determines whether the performance effect after the arrangement is satisfied. If satisfied, step S12 is executed; if not satisfied, step S13 is executed.

[0293] In step S12, the target layout file is saved.

[0294] In step S13, the performance effect is rearranged.

[0295] In step S14, the target orchestration file is synchronized to the gateway device.

[0296] In step S15, the gateway device controls the operation effect of the functional device according to the target arrangement file.

[0297] The functional device control device in this application is described in detail below. Fig. 20 , Fig. 20 This is a schematic diagram of an embodiment of a functional device control device in an embodiment of the present application. The functional device control device 20 includes:

[0298] An acquisition module 210 is used to acquire a device binding relationship for a gateway device, wherein the device binding relationship includes a binding relationship between a gateway device identifier and N device identifiers, the gateway device identifier is used to indicate a gateway device, each device identifier is used to indicate a functional device, and N is an integer greater than or equal to 1;

[0299] An establishing module 220, configured to establish a communication connection between the gateway device and N functional devices based on the device binding relationship;

[0300] The acquisition module 210 is further used to acquire a target orchestration file, wherein the target orchestration file is a file generated after orchestration processing is performed on K functional devices, and the target orchestration file carries K device identifiers, where K is an integer greater than or equal to 1;

[0301] The control module 230 is configured to control the K functional devices according to the target arrangement file if the K device identifiers match the N device identifiers successfully.

[0302] In the embodiment of the present application, a functional device control device is provided. The above device is used to support the arrangement and linkage of one or more functional devices and generate corresponding target arrangement files. Therefore, after the gateway device uses the object model protocol to establish a communication relationship with the functional device, the target arrangement file can be used to control the functional device. Based on this, not only can the pre-arranged functional device coordination effect be achieved, but also the realization cost of the performance effect can be reduced.

[0303] Optionally, in the above Fig. 20 On the basis of the corresponding embodiment, in another embodiment of the functional device control device 20 provided in the embodiment of the present application, the functional device control device 20 further includes a display module 240 and a generation module 250;

[0304] The display module 240 is used to display K device controls corresponding to the gateway device in the device selection area before obtaining the target arrangement file, wherein each device control corresponds to a functional device;

[0305] The acquisition module 210 is further used to respond to an editing operation on any device control among the K device controls and acquire arrangement information of a functional device corresponding to any device control;

[0306] The generating module 250 is configured to generate a target orchestration file according to the orchestration information of the K functional devices if the orchestration information of the K functional devices is obtained.

[0307] In an embodiment of the present application, a functional device control device is provided. By using the above device, a user can use the editing and control software system to uniformly edit one or more functional devices, thereby achieving efficient arrangement of performance effects and effectively reducing the cost of achieving the performance effects.

[0308] Optionally, in the above Fig. 20 On the basis of the corresponding embodiment, in another embodiment of the functional device control device 20 provided in the embodiment of the present application,

[0309] The acquisition module 210 is specifically configured to respond to a selection operation on any device control and display an arrangement segment of a functional device corresponding to any device control in the device arrangement area;

[0310] In response to a selection operation for an arrangement segment, displaying an input item control set on the editing tool area;

[0311] In response to an input operation on the input item control set, the arrangement information of the functional device corresponding to any device control is obtained.

[0312] In the embodiment of the present application, a functional device control device is provided. With the above device, users can use the relevant interface provided by the editing and control software system to uniformly edit the functional devices, and can arrange the functional devices in a fragmented form, thereby improving the flexibility of arrangement. For users, the entire arrangement process is visualized, so they can understand the arrangement more intuitively, thereby improving the efficiency of functional device arrangement and effectively reducing the cost of achieving the performance effect.

[0313] Optionally, in the above Fig. 20 On the basis of the corresponding embodiment, in another embodiment of the functional device control device 20 provided by the embodiment of the present application, the functional device corresponding to any device control is a lighting device, the arrangement information of the functional device corresponding to any device control is the arrangement information of the lighting device, the arrangement information of the lighting device includes at least one of the brightness information, color information, angle information, linear speed information and angular speed information of the lighting device, and the arrangement segment is a first lighting arrangement segment;

[0314] The display module 240 is further configured to display the first lighting arrangement segment after the duration adjustment in the device arrangement area when a duration adjustment operation for the first lighting arrangement segment is detected;

[0315] The display module 240 is further configured to display a second lighting arrangement segment on the device arrangement area when a segment adding operation is detected;

[0316] The display module 240 is further configured to display the second lighting choreography segment after the duration adjustment in the device choreography area when a duration adjustment operation for the second lighting choreography segment is detected, wherein the second lighting choreography segment does not overlap with the first lighting choreography segment;

[0317] The display module 240 is further configured to cancel display of the second lighting arrangement segment in the device arrangement area when a deletion operation on the second lighting arrangement segment is detected.

[0318] In the embodiment of the present application, a functional device control device is provided. With the above device, users can use the relevant interface provided by the editing and control software system to uniformly edit the lighting equipment, and can arrange the lighting equipment in a fragmented form, thereby improving the flexibility of arrangement. For users, the entire arrangement process is visualized, so they can understand the arrangement more intuitively, thereby improving the efficiency of lighting equipment arrangement and effectively reducing the cost of achieving performance effects. In addition, users can also customize the lighting arrangement fragments, thereby increasing the diversity and richness of the performance effects of lighting equipment.

[0319] Optionally, in the above Fig. 20On the basis of the corresponding embodiment, in another embodiment of the functional device control apparatus 20 provided in the embodiment of the present application, the functional device corresponding to any device control is an audio device, the arrangement information of the functional device corresponding to any device control is the arrangement information of the audio device, the arrangement information of the audio device includes at least one of volume information, fade-in duration information, fade-out duration information and playback ratio information, and the arrangement segment is a first audio arrangement segment;

[0320] The display module 240 is specifically configured to display an audio import list in response to a selection operation on the audio import control, wherein the audio import list includes at least one audio file information;

[0321] In response to a selection operation on the first audio information, displaying a first audio arrangement segment corresponding to the audio device in the device arrangement area, wherein the first audio information corresponds to the first audio arrangement segment;

[0322] The display module 240 is further configured to display the second audio arrangement segment on the device arrangement area when a selection operation for the second audio information is detected, wherein the second audio information corresponds to the second audio arrangement segment;

[0323] The display module 240 is further configured to display the second audio arrangement segment after position adjustment in the device arrangement area when a moving operation for the second lighting arrangement segment is detected, wherein the second audio arrangement segment may overlap with the first audio arrangement segment.

[0324] In an embodiment of the present application, a functional device control device is provided. With the above device, users can use the relevant interface provided by the editing and control software system to uniformly edit audio devices, and can arrange audio devices in a fragmented form, thereby improving the flexibility of arrangement. For users, the entire arrangement process is visualized, so they can understand the arrangement more intuitively, thereby improving the efficiency of audio device arrangement and effectively reducing the cost of achieving performance effects. In addition, users can also customize the audio arrangement fragments to increase the diversity and richness of the performance effects of audio devices.

[0325] Optionally, in the above Fig. 20 On the basis of the corresponding embodiment, in another embodiment of the functional device control device 20 provided in the embodiment of the present application, the functional device corresponding to any device control is a video device, the arrangement information of the functional device corresponding to any device control is the arrangement information of the video device, the arrangement information of the video device includes at least one of the start time information, the time upper limit information, the play mode information and the brightness information, and the arrangement segment is the first video arrangement segment;

[0326] The display module 240 is specifically configured to display a video import list in response to a selection operation on a video import control, wherein the video import list includes at least one video file information;

[0327] In response to a selection operation on the first video information, displaying a first video arrangement segment corresponding to the video device in the device arrangement area, wherein the first video information corresponds to the first video arrangement segment;

[0328] The display module 240 is further configured to display the second video arrangement segment on the device arrangement area when a selection operation for the second video information is detected, wherein the second video information corresponds to the second video arrangement segment;

[0329] The display module 240 is further configured to cancel display of the second video arrangement segment in the device arrangement area when a deletion operation on the second video arrangement segment is detected;

[0330] The display module 240 is further used to display the editing information of the first video arrangement segment in the device arrangement area when an editing operation on the first video arrangement segment is detected, wherein the editing information includes at least one of name information, description information and sorting information.

[0331] In the embodiment of the present application, a functional device control device is provided. With the above device, users can use the relevant interface provided by the editing and control software system to uniformly edit video devices, and can arrange video devices in a fragmented form, thereby improving the flexibility of arrangement. For users, the entire arrangement process is visualized, so they can understand the arrangement more intuitively, thereby improving the efficiency of video device arrangement and effectively reducing the cost of achieving performance effects. In addition, users can also customize the video arrangement fragments to increase the diversity and richness of the video device performance effects.

[0332] Optionally, in the above Fig. 20 On the basis of the corresponding embodiment, in another embodiment of the functional device control device 20 provided in the embodiment of the present application,

[0333] The display module 240 is further used to display the main control corresponding to the gateway device in the device list and display the sub-control corresponding to each functional device in the K functional devices before generating the target arrangement file according to the arrangement information of the K functional devices;

[0334] The display module 240 is further configured to display a first arrangement result according to the arrangement information of the K functional devices when a preview operation for the main control is detected;

[0335] The display module 240 is also used to display a second arrangement result according to the arrangement information of the P functional devices when a preview operation for P sub-controls is detected, wherein the P functional devices are included in the K functional devices, and P is an integer greater than or equal to 1 and less than or equal to K.

[0336] In an embodiment of the present application, a functional device control device is provided. By adopting the above device, a user can use the relevant interface provided by the editing and control software system to uniformly manage and arrange the functional devices. Considering that the functional devices need to cooperate with each other to reproduce the on-site adjustment effect, the editing and control software system can realize visual preview, thereby effectively reducing the equipment arrangement time and improving the arrangement effect. After the arrangement is completed, the arrangement effect is solidified into the form of a configuration file, which is convenient for subsequent multiple debugging and other processing.

[0337] Optionally, in the above Fig. 20 On the basis of the corresponding embodiment, in another embodiment of the functional device control device 20 provided in the embodiment of the present application, the functional device control device 20 further includes a storage module 260;

[0338] The storage module 260 is used to store the target orchestration file in the gateway device in response to a storage operation for the target orchestration file after the target orchestration file is generated;

[0339] or,

[0340] The storage module 260 is further configured to respond to a storage operation on the target orchestration file and send the target orchestration file to the server so that the server stores the target orchestration file in the server.

[0341] In the embodiment of the present application, a functional device control device is provided. By using the above device, if the arrangement file is saved locally, the functional device can be controlled even in an offline state. If the arrangement file is saved in the cloud, not only can the loss of the arrangement file be avoided, but the arrangement file can also be reused.

[0342] Optionally, in the above Fig. 20 On the basis of the corresponding embodiment, in another embodiment of the functional device control device 20 provided in the embodiment of the present application,

[0343] The acquisition module 210 is further used to acquire a first object model file;

[0344] The acquisition module 210 is further configured to identify the functional device based on the first object model file to obtain an identification result when the gateway device establishes a communication connection with the functional device;

[0345] The acquisition module 210 is further configured to acquire a device identification of the functional device if the recognition result indicates that the recognition is successful;

[0346] The establishing module 220 is further used to establish a binding relationship between the gateway device identifier and the device identifier.

[0347] In an embodiment of the present application, a functional device control device is provided. Using the above device, considering that different functional devices often come from different manufacturers and each has an independent control system, the gateway device communicates with the functional device based on the object model file, thereby achieving the effect of debugging, linkage and orchestration between the functional devices, thereby reducing labor costs.

[0348] Optionally, in the above Fig. 20 On the basis of the corresponding embodiment, in another embodiment of the functional device control device 20 provided in the embodiment of the present application,

[0349] The display module 240 is further used to display the object model management interface if the user account verification is successful;

[0350] The acquisition module 210 is further configured to acquire a first object model through the object model management interface, wherein the first object model includes at least one of device category information, communication protocol information, service information, and event information;

[0351] The generating module 250 is further configured to generate a first physical model file according to the first physical model, or to send the first physical model to the server so that the server generates the first physical model file.

[0352] In an embodiment of the present application, a functional device control device is provided. By using the above device, the user can also input information related to the physical model in the physical model management interface, thereby achieving efficient orchestration of the presentation effects through a unified physical model protocol, effectively reducing the cost of implementing the presentation effects.

[0353] Optionally, in the above Fig. 20 On the basis of the corresponding embodiment, in another embodiment of the functional device control device 20 provided in the embodiment of the present application,

[0354] The acquisition module 210 is further configured to modify the first physical model through the physical model management interface to obtain a second physical model if the recognition result indicates that the recognition fails, wherein the first physical model is used to generate a first physical model file;

[0355] The generating module 250 is further configured to generate a second physical model file according to the second physical model, or to send the second physical model to the server so that the server generates the second physical model file.

[0356] In the embodiment of the present application, a functional device control device is provided. With the above device, the user can modify the physical model that failed to be identified, so that the modified physical model can match the functional device connected, thereby improving the reliability of device access. In addition, not only can the updated physical model file be generated locally, but also in the cloud, so that the physical model file can be updated offline or online, thereby improving the flexibility of the solution.

[0357] Optionally, in the above Fig. 20 On the basis of the corresponding embodiment, in another embodiment of the functional device control device 20 provided in the embodiment of the present application, the functional device control device 20 further includes a sending module 270 and a receiving module 280;

[0358] A sending module 270, configured to send device test data to a functional device;

[0359] The receiving module 280 is used to receive the test response data sent by the functional device;

[0360] The acquisition module 210 is further configured to modify the first physical model through the physical model management interface to obtain a second physical model if the test response data fails to match the first physical model corresponding to the first physical model file, wherein the first physical model is used to generate the first physical model file;

[0361] The generating module 250 is further configured to generate a second physical model file according to the second physical model, or to send the second physical model to the server so that the server generates the second physical model file.

[0362] In the embodiment of the present application, a functional device control device is provided. By using the above device, the user can modify the physical model that cannot respond to accurate data, so that the modified physical model can match the functional device connected, thereby improving the reliability of device access. In addition, not only can the updated physical model file be generated locally, but also in the cloud, so that the physical model file can be updated offline or online, thereby improving the flexibility of the solution.

[0363] The present application also provides another functional device control device, such as Fig.21 As shown, Fig.21: is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. The electronic device 300 may have relatively large differences due to different configurations or performances, and may include one or more central processing units (CPU) 322 (for example, one or more processors) and a memory 332, and one or more storage media 330 (for example, one or more mass storage devices) storing application programs 342 or data 344. Among them, the memory 332 and the storage medium 330 may be short-term storage or permanent storage. The program stored in the storage medium 330 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations in the electronic device. Furthermore, the central processing unit 322 may be configured to communicate with the storage medium 330 to execute a series of instruction operations in the storage medium 330 on the electronic device 300.

[0364] The electronic device 300 may also include one or more power supplies 326, one or more wired or wireless network interfaces 350, one or more input and output interfaces 358, and / or one or more operating systems 341, such as Windows Server 2008. TM , Mac OS X TM , Unix TM , Linux TM , FreeBSD TM etc.

[0365] The steps performed by the electronic device in the above embodiments can be based on the Fig.21 The electronic device structure shown.

[0366] The present application also provides another functional device control device, such as Fig. 22 For the sake of convenience, only the parts related to the embodiments of the present application are shown. For specific technical details not disclosed, please refer to the method part of the embodiments of the present application. The electronic device can be any electronic device including a mobile phone, a tablet computer, a personal digital assistant (PDA), a point of sales (POS), a car computer, etc., taking the mobile phone as an example:

[0367] Fig. 22 FIG. 1 is a block diagram showing a partial structure of a mobile phone related to an electronic device provided in an embodiment of the present application. Fig. 22The mobile phone includes components such as a radio frequency (RF) circuit 410, a memory 420, an input unit 430, a display unit 440, a sensor 450, an audio circuit 460, a wireless fidelity (WiFi) module 470, a processor 480, and a power supply 490. Those skilled in the art will appreciate that Fig. 22 The mobile phone structure shown in the figure does not constitute a limitation on the mobile phone, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0368] Combine the following Fig. 22 A detailed introduction to the various components of the mobile phone:

[0369] The RF circuit 410 can be used for receiving and sending signals during the process of sending and receiving information or making calls. In particular, after receiving the downlink information of the base station, it is sent to the processor 480 for processing; in addition, the designed uplink data is sent to the base station. Generally, the RF circuit 410 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (Low Noise Amplifier, LNA), a duplexer, etc. In addition, the RF circuit 410 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communication can use any communication standard or protocol, including but not limited to the Global System of Mobile communication (Global System of Mobile communication, GSM), General Packet Radio Service (General Packet Radio Service, GPRS), Code Division Multiple Access (Code Division Multiple Access, CDMA), Wideband Code Division Multiple Access (Wideband Code Division Multiple Access, WCDMA), Long Term Evolution (Long Term Evolution, LTE), email, Short Messaging Service (SMS), etc.

[0370] The memory 420 can be used to store software programs and modules. The processor 480 executes various functional applications and data processing of the mobile phone by running the software programs and modules stored in the memory 420. The memory 420 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 420 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0371] The input unit 430 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the mobile phone. Specifically, the input unit 430 may include a touch panel 431 and other input devices 432. The touch panel 431, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 431 or near the touch panel 431 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. Optionally, the touch panel 431 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the processor 480, and can receive and execute commands sent by the processor 480. In addition, the touch panel 431 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 431, the input unit 430 may also include other input devices 432. Specifically, other input devices 432 may include but are not limited to one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, etc.

[0372] The display unit 440 may be used to display information input by the user or information provided to the user and various menus of the mobile phone. The display unit 440 may include a display panel 441. Optionally, the display panel 441 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. Further, the touch panel 431 may cover the display panel 441. When the touch panel 431 detects a touch operation on or near it, it is transmitted to the processor 480 to determine the type of touch event. Subsequently, the processor 480 provides a corresponding visual output on the display panel 441 according to the type of touch event. Although in Fig. 22 In the embodiment, the touch panel 431 and the display panel 441 are used as two independent components to realize the input and output functions of the mobile phone, but in some embodiments, the touch panel 431 and the display panel 441 can be integrated to realize the input and output functions of the mobile phone.

[0373] The mobile phone may also include at least one sensor 450, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 441 according to the brightness of the ambient light, and the proximity sensor may turn off the display panel 441 and / or the backlight when the mobile phone is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can be configured in the mobile phone, such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.

[0374] The audio circuit 460, the speaker 461, and the microphone 462 can provide an audio interface between the user and the mobile phone. The audio circuit 460 can transmit the received audio data to the speaker 461 after converting the received audio data into an electrical signal, which is converted into a sound signal for output; on the other hand, the microphone 462 converts the collected sound signal into an electrical signal, which is received by the audio circuit 460 and converted into audio data, and then the audio data is output to the processor 480 for processing, and then sent to another mobile phone through the RF circuit 410, or the audio data is output to the memory 420 for further processing.

[0375] WiFi is a short-range wireless transmission technology. The mobile phone can help users send and receive emails, browse web pages and access streaming media through the WiFi module 470. It provides users with wireless broadband Internet access. Fig. 22A WiFi module 470 is shown, but it is understandable that it is not an essential component of the mobile phone and can be omitted as needed without changing the essence of the invention.

[0376] Processor 480 is the control center of the mobile phone. It uses various interfaces and lines to connect various parts of the entire mobile phone. It executes various functions of the mobile phone and processes data by running or executing software programs and / or modules stored in memory 420, and calling data stored in memory 420, so as to monitor the mobile phone as a whole. Optionally, processor 480 may include one or more processing units; optionally, processor 480 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application programs, etc., and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into processor 480.

[0377] The mobile phone also includes a power source 490 (such as a battery) for supplying power to various components. Optionally, the power source can be logically connected to the processor 480 through a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system.

[0378] Although not shown, the mobile phone may also include a camera, a Bluetooth module, etc., which will not be described in detail here.

[0379] The steps performed by the electronic device in the above embodiments can be based on the Fig. 22 The electronic device structure shown.

[0380] A computer-readable storage medium is also provided in an embodiment of the present application. The computer-readable storage medium stores a computer program, which, when executed on a computer, enables the computer to execute the methods described in the aforementioned embodiments.

[0381] The present application also provides a computer program product including a program, which, when executed on a computer, enables the computer to execute the methods described in the aforementioned embodiments.

[0382] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0383] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0384] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0385] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0386] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable an electronic device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0387] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A control method for a functional device, characterized in that: include: Acquire a device binding relationship for a gateway device, wherein the device binding relationship includes a binding relationship between a gateway device identifier and N device identifiers, the gateway device identifier is used to indicate the gateway device, each device identifier is used to indicate a functional device, and N is an integer greater than or equal to 1; Based on the device binding relationship, establishing a communication connection between the gateway device and N functional devices; Obtaining a target orchestration file, wherein the target orchestration file is a file generated after orchestration processing is performed on K functional devices, and the target orchestration file carries K device identifiers, where K is an integer greater than or equal to 1; If the K device identifiers match the N device identifiers successfully, controlling the K functional devices according to the target arrangement file; Before obtaining the target arrangement file, the method further includes: Displaying K device controls corresponding to the gateway device in the device selection area, wherein each device control corresponds to a functional device; In response to a selection operation on any device control, displaying an arrangement fragment of a functional device corresponding to any device control in the device arrangement area; In response to a selection operation on the arrangement segment, displaying an input item control set on the editing tool area; In response to an input operation on the input item control set, obtaining arrangement information of a functional device corresponding to any one of the device controls; If the orchestration information of the K functional devices is obtained, the target orchestration file is generated according to the orchestration information of the K functional devices.

2. The control method according to claim 1, characterized in that: The functional device corresponding to any one of the device controls is a lighting device, the arrangement information of the functional device corresponding to any one of the device controls is the arrangement information of the lighting device, the arrangement information of the lighting device includes at least one of brightness information, color information, angle information, linear speed information and angular speed information of the lighting device, and the arrangement segment is a first lighting arrangement segment; The method further comprises: When a duration adjustment operation for the first lighting choreography segment is detected, displaying the first lighting choreography segment after the duration adjustment in the device choreography area; When a clip adding operation is detected, displaying a second lighting choreography clip on the device choreography area; When a duration adjustment operation for the second lighting choreography segment is detected, the second lighting choreography segment after the duration adjustment is displayed in the device choreography area, wherein the second lighting choreography segment does not overlap with the first lighting choreography segment; When a deletion operation for the second lighting choreography segment is detected, the second lighting choreography segment is cancelled from being displayed in the device choreography area.

3. The control method according to claim 2, characterized in that: The functional device corresponding to any one of the device controls is an audio device, the arrangement information of the functional device corresponding to any one of the device controls is the arrangement information of the audio device, the arrangement information of the audio device includes at least one of volume information, fade-in duration information, fade-out duration information, and playback ratio information, and the arrangement segment is a first audio arrangement segment; The displaying the arrangement fragment of the functional device corresponding to any one of the device controls in the device arrangement area includes: In response to a selection operation on an audio import control, displaying an audio import list, wherein the audio import list includes at least one audio file information; In response to a selection operation on first audio information, displaying the first audio arrangement segment corresponding to the audio device in the device arrangement area, wherein the first audio information corresponds to the first audio arrangement segment; The method further comprises: When a selection operation for second audio information is detected, displaying a second audio arrangement segment on the device arrangement area, wherein the second audio information corresponds to the second audio arrangement segment; When a moving operation for the second audio arrangement segment is detected, the second audio arrangement segment after position adjustment is displayed on the device arrangement area, wherein the second audio arrangement segment and the first audio arrangement segment may overlap.

4. The control method according to claim 2, characterized in that: The functional device corresponding to any one of the device controls is a video device, the arrangement information of the functional device corresponding to any one of the device controls is the arrangement information of the video device, the arrangement information of the video device includes at least one of start time information, time upper limit information, play mode information and brightness information, and the arrangement segment is a first video arrangement segment; The displaying the arrangement fragment of the functional device corresponding to any one of the device controls in the device arrangement area includes: In response to a selection operation on a video import control, displaying a video import list, wherein the video import list includes at least one video file information; In response to a selection operation on first video information, displaying the first video arrangement segment corresponding to the video device in the device arrangement area, wherein the first video information corresponds to the first video arrangement segment; The method further comprises: When a selection operation for second video information is detected, displaying a second video arrangement segment on the device arrangement area, wherein the second video information corresponds to the second video arrangement segment; When a deletion operation for the second video arrangement segment is detected, canceling display of the second video arrangement segment in the device arrangement area; When an editing operation on the first video arrangement segment is detected, editing information of the first video arrangement segment is displayed on the device arrangement area, wherein the editing information includes at least one of name information, description information and sorting information.

5. The control method according to claim 1, characterized in that: Before generating the target orchestration file according to the orchestration information of the K functional devices, the method further includes: Displaying a main control corresponding to the gateway device in the device list, and displaying a sub-control corresponding to each of the K functional devices; When a preview operation for the main control is detected, displaying a first arrangement result according to the arrangement information of the K functional devices; When a preview operation for P sub-controls is detected, a second arrangement result is displayed according to the arrangement information of the P functional devices, wherein the P functional devices are included in the K functional devices, and P is an integer greater than or equal to 1 and less than or equal to K.

6. The control method according to claim 1, characterized in that: After generating the target arrangement file, the method further includes: In response to a storage operation for the target orchestration file, storing the target orchestration file in the gateway device; or, In response to a storage operation for the target orchestration file, the target orchestration file is sent to a server, so that the server stores the target orchestration file in the server.

7. The control method according to any one of claims 1 to 6, characterized in that: The method further comprises: Obtain the first object model file; When the gateway device establishes a communication connection with the functional device, the functional device is identified based on the first object model file to obtain an identification result; If the recognition result indicates that the recognition is successful, obtaining a device identification of the functional device; A binding relationship between the gateway device identifier and the device identifier is established.

8. The control method according to claim 7, characterized in that: The method further comprises: If the user account is successfully verified, the object model management interface will be displayed; Acquire a first object model through the object model management interface, wherein the first object model includes at least one of device category information, communication protocol information, service information, and event information; Generate the first physical model file according to the first physical model, or send the first physical model to a server so that the server generates the first physical model file.

9. The control method according to claim 7, characterized in that: The method further comprises: If the recognition result indicates that the recognition fails, modifying the first physical model through the physical model management interface to obtain a second physical model, wherein the first physical model is used to generate the first physical model file; Generate a second physical model file according to the second physical model, or send the second physical model to a server so that the server generates a second physical model file.

10. The control method according to claim 7, characterized in that: The method further comprises: sending device test data to the functional device; receiving test response data sent by the functional device; If the test response data fails to match the first physical model corresponding to the first physical model file, modifying the first physical model through the physical model management interface to obtain a second physical model, wherein the first physical model is used to generate the first physical model file; Generate a second physical model file according to the second physical model, or send the second physical model to a server so that the server generates a second physical model file.

11. A functional equipment control device, characterized in that: include: An acquisition module, configured to acquire a device binding relationship for a gateway device, wherein the device binding relationship includes a binding relationship between a gateway device identifier and N device identifiers, the gateway device identifier is used to indicate the gateway device, each device identifier is used to indicate a functional device, and N is an integer greater than or equal to 1; An establishing module, used to establish a communication connection between the gateway device and N functional devices based on the device binding relationship; The acquisition module is further used to acquire a target orchestration file, wherein the target orchestration file is a file generated after orchestration processing is performed on K functional devices, and the target orchestration file carries K device identifiers, where K is an integer greater than or equal to 1; A control module, configured to control the K functional devices according to the target arrangement file if the K device identifiers match the N device identifiers successfully; A display module, used for displaying K device controls corresponding to the gateway device in a device selection area before acquiring the target arrangement file, wherein each device control corresponds to a functional device; An acquisition module, specifically configured to respond to a selection operation on any device control and display an arrangement fragment of a functional device corresponding to any device control in the device arrangement area; In response to a selection operation on the arrangement segment, displaying an input item control set on the editing tool area; In response to an input operation on the input item control set, obtaining arrangement information of a functional device corresponding to any one of the device controls; A generating module is configured to generate the target orchestration file according to the orchestration information of the K functional devices if the orchestration information of the K functional devices is acquired.

12. An electronic device, characterized in that: include: Memory, processor, and bus system; Wherein, the memory is used to store programs; The processor is used to execute the program in the memory, and the processor is used to execute the control method according to any one of claims 1 to 10 according to the instructions in the program code; The bus system is used to connect the memory and the processor so that the memory and the processor can communicate with each other.

13. A computer-readable storage medium comprising instructions, which, when executed on a computer, causes the computer to execute the control method according to any one of claims 1 to 10.

Images