Control method, device, system, and storage medium

Abstract

Embodiments of the present application provide a control method, device, system and storage medium. In the control system, a first user can provide device art design information to a server through a design terminal, and the server can determine a design object for displaying a corresponding artistic effect based on the device art design information, generate a control instruction corresponding to the design object, and control the design object to enter a corresponding working state based on the control instruction. Further, the intelligent device art display mode of automatically displaying the set artistic effect of the device art according to the device art design information provided by the art designer is realized, the configuration efficiency and flexibility of the design object are improved, and the technical difficulty of the device art designer in device art design is reduced.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of Internet of Things, and in particular to a control method, device, system and storage medium. BACKGROUND

[0002] Device art refers to an artistic form in which an artist effectively selects, utilizes, transforms and combines material cultural entities in human daily life in a specific space-time environment to display rich spiritual and cultural implications.

[0003] To achieve a specific artistic effect, a device art work usually includes an intelligent control process of a large number of sound, light and electrical devices. However, the intelligent control process has great implementation difficulty for a designer of the device art. Therefore, a new solution is needed. SUMMARY

[0004] Aspects of the present application provide a control method, device, system and storage medium to automatically display a set artistic effect of device art according to device art design information provided by a user, thereby reducing the technical difficulty of a designer of the device art when designing the device art.

[0005] An embodiment of the present application provides a control system, comprising a design terminal, a server and a design object group. The design terminal is configured to acquire device art design information corresponding to a set artistic effect provided by a first user and send the device art design information to the server. The server is configured to determine at least one design object and respective action instructions corresponding to the at least one design object for displaying the set artistic effect from the design object group according to the device art design information, and send the respective action instructions to the at least one design object. The design objects in the design object group are configured to enter respective working states according to the action instructions sent by the server to display the set artistic effect.

[0006] An embodiment of the present application also provides a control system, comprising a design terminal and a design object group. The design terminal is configured to acquire device art design information corresponding to a set artistic effect provided by a first user. The design terminal is further configured to determine at least one design object and respective action instructions corresponding to the at least one design object for displaying the set artistic effect from the design object group according to the device art design information, and send the respective action instructions to the at least one design object. The design objects in the design object group are configured to enter respective working states according to the action instructions sent by the design terminal to display the set artistic effect.

[0007] The embodiment of the present application further provides a control method, which is suitable for a design terminal and comprises the following steps: displaying a device art design interface; obtaining device art design information corresponding to a set artistic effect provided by a first user through the device art design interface; and sending the device art design information to a server, so that the server controls at least one design object to display the set artistic effect according to the device art design information.

[0008] The embodiment of the present application further provides a control method, which is suitable for a design terminal and comprises the following steps: displaying a device art design interface; obtaining device art design information corresponding to a set artistic effect provided by a first user through the device art design interface; and sending the device art design information to a server, so that the server controls at least one design object to display the set artistic effect according to the device art design information.

[0009] The embodiment of the present application further provides a control method, which is suitable for a design terminal and comprises the following steps: obtaining device art design information corresponding to a set artistic effect provided by a first user; determining at least one design object and respective action instructions of the at least one design object for displaying the set artistic effect from the design object group according to the device art design information; and sending the respective action instructions to the at least one design object, so that the at least one design object displays the set artistic effect.

[0010] The embodiment of the present application further provides a server, which comprises a memory, a processor and a communication component; the memory is used for storing one or more computer instructions; and the processor is used for executing the one or more computer instructions to execute steps of a control method provided by the embodiment of the present application on a server side.

[0011] The embodiment of the present application further provides a design terminal, which comprises a memory, a processor and a communication component; the memory is used for storing one or more computer instructions; and the processor is used for executing the one or more computer instructions to execute steps of a control method provided by the embodiment of the present application on a terminal side.

[0012] The embodiment of the present application further provides a computer readable storage medium storing a computer program, which is executed to implement steps of a control method provided by the embodiment of the present application on a server side or steps of a control method provided by the embodiment of the present application on a terminal side.

[0013] In the control system provided by the embodiment of the application, the first user can provide device art design information to the server through the design terminal, the server can determine a design object for displaying a corresponding artistic effect based on the device art design information, generate a control instruction corresponding to the design object, and control the design object to enter a corresponding working state based on the control instruction. Further, the intelligent device art display mode of automatically displaying the set artistic effect of the device art according to the device art design information provided by the art designer is realized, the configuration efficiency and flexibility of the design object are improved, and the technical difficulty of the device art designer in device art design is reduced. BRIEF DESCRIPTION OF DRAWINGS

[0014] The accompanying drawings, which are included to provide a further understanding of the application and constitute a part of this application, illustrate embodiments of the application and together with the description serve to explain the application. In the drawings:

[0015] Figure 1a A structural schematic diagram of a control system provided by an example embodiment of the application;

[0016] Figure 1b A structural schematic diagram of a control system provided by an example application scenario of the application;

[0017] Figure 2 A structural schematic diagram of a control system provided by another example embodiment of the application;

[0018] Figure 3a A schematic diagram of a device art design interface provided by an example embodiment of the application;

[0019] Figure 3b A schematic diagram in which the device art design interface displays multiple design objects;

[0020] Figure 3c A schematic diagram in which the device art design interface displays multiple configuration items of a design object provided by an example embodiment of the application;

[0021] Figure 3d A schematic diagram of a device art design interface provided by another example embodiment of the application;

[0022] Figure 4 A flowchart of a control method provided by an example embodiment of the application;

[0023] Figure 5a A flowchart of a control method provided by another example embodiment of the application;

[0024] Figure 5b A flowchart of a control method provided by still another example embodiment of the application;

[0025] Figure 6 A schematic diagram of the server structure provided in an exemplary embodiment of this application;

[0026] Figure 7 A schematic diagram of the structure of a design terminal provided for an exemplary embodiment of this application. Detailed Implementation

[0027] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0028] In view of the technical problem that it is difficult for designers of installation art to implement control operations in the design of installation art works in the prior art, this application provides a solution in some embodiments. The technical solutions provided by the embodiments of this application are described in detail below with reference to the accompanying drawings.

[0029] Figure 1a A schematic diagram of the structure of a control system provided for an exemplary embodiment of this application is shown below. Figure 1a As shown, the control system 100 includes: a design terminal 10, a server 20, and a design object group 30.

[0030] In the control system 100, the terminal 10 is designed to: obtain the installation art design information provided by the first user that corresponds to the set art effect, and send the installation art design information to the server 20.

[0031] The design terminal 10 refers to a device capable of providing design requirement input operations to the first user and possessing communication functions. In some embodiments, the design terminal 10 may be a user-side device such as a mobile phone, tablet computer, or computer, depending on the application scenario. The first user can input installation art design information corresponding to the set artistic effect through plugins, applications, or browsers provided by the aforementioned device.

[0032] In some optional embodiments, the design terminal 10 may include a touch panel that can receive input signals from a first user to obtain installation art design information provided by the first user; in other optional embodiments, the design terminal 10 may include physical buttons or a voice input device, etc., and the first user may provide installation art design information based on the physical buttons or voice input device, which will not be elaborated here.

[0033] The first user refers to a designer of the installation art. In some scenarios, the first user can be an artist who designs the installation art, and the artist can design the installation art work based on the design terminal 10. In other scenarios, the first user can be an audience or an experimenter of the installation art, and the audience or the experimenter can customize the installation art or modify the designed installation art based on the design terminal 10 to experience the interest.

[0034] Generally, the design terminal 10 can display an installation art design interface, and the first user can input installation art design information in the installation art design interface. In some scenarios, the design terminal 10 can display different installation art design interfaces according to design styles or different types of design contents to meet the needs of different users. For example, after the user logs in the design terminal 10, the user can select a style or a type. The design terminal 10 can display a corresponding installation art design interface according to the selected style or type. The installation art design interface corresponding to each style or type can provide different configuration services of design objects.

[0035] In other scenarios, the design terminal 10 can display an installation art design interface customized by an artist according to the personalized needs of the artist. For example, after the first user logs in the design terminal 10 through a user account, the first user can customize a personalized installation art interface. The design terminal 10 can save the user account and the customized installation art interface. When the first user logs in through the user account, the design terminal 10 can display the installation art interface corresponding to the user account to provide personalized design services for the first user. The installation art design information is used to describe the installation art work from the perspective of artistic expression, and can express the design concept of the installation art designer and the set artistic effect that the artistic designer wants to achieve. For example, the installation art design information can include the composition of the installation art work, the display form of the installation art work, the interaction mode between the installation art work and the audience, and the like, which are not described herein.

[0036] In the control system 100, the server 20 can be implemented as a cloud platform or a server device, such as a conventional server, a cloud server, a cloud host, a virtual center, and the like, which are not limited in the embodiment. The server 20 is mainly used to receive the installation art design information sent by the design terminal 10, determine at least one design object used to display the set artistic effect and the respective action instructions of the at least one design object from the design object group 30 according to the installation art design information, and send the respective action instructions to the at least one design object.

[0037] In the control system 100, the design object group 30 can include one or more design objects, each of which is mainly configured to receive an action instruction sent by the service end 20 and enter a corresponding working state according to the action instruction to show the set artistic effect.

[0038] The design objects in the design object group 30 can have various implementation forms and can be personalized according to actual device artistic design requirements. In some embodiments, the design objects can include output-type design objects. The output-type design objects are mainly configured to perform visualized and perceptible actions to present the set artistic effect. In other embodiments, the design objects can also include input-type design objects. The input-type design objects can collect various information of users or the surrounding environment, and the collected information can be used to update the action performance content of the output-type design objects to further enrich the artistic effect.

[0039] In the control system 100, a communication connection is established between the design terminal 10 and the service end 20, and each design object 30 establishes a communication connection with the service end 20. The communication connection mode can include wired communication mode or wireless communication mode, which can be determined according to actual application scenarios.

[0040] The wireless communication mode includes, but is not limited to, short-distance communication modes such as Bluetooth, ZigBee (a low-speed short-distance wireless network protocol), infrared, WiFi (WIreless-Fidelity, wireless fidelity technology), and can also include long-distance wireless communication modes such as LORA and wireless communication modes based on mobile networks. When the mobile network is used for communication connection, the network standard of the mobile network can be any one of 2G (GSM), 2.5G (GPRS), 3G (WCDMA, TD-SCDMA, CDMA2000, UTMS), 4G (LTE), 4G+ (LTE+), 5G, WiMax, etc.

[0041] In this embodiment, the first user can provide device artistic design information to the service end through the design terminal. The service end can determine a design object for showing a corresponding artistic effect based on the device artistic design information, generate a control instruction corresponding to the design object, and control the design object to enter a corresponding working state based on the control instruction. Thus, an intelligent device artistic display mode of automatically displaying a set artistic effect of device art according to device artistic design information provided by an artistic designer is realized, the configuration efficiency and flexibility of the design objects are improved, and the technical difficulty of device artistic designers in device artistic design is reduced.

[0042] In the technical solution described in the above embodiment, the design objects in the design object group 30 can include design objects of an output type. Alternatively, the design objects of the output type can be implemented as at least one artistic display object. The artistic display object can be obtained by intelligently designing a material and cultural entity in actual life according to the design requirements of device art. Each artistic display object can include an object body and a control module connected to the object body. The object body can include any material and cultural entity, which can be re-created by a device art designer to perform a new artistic form. For example, the object body can be implemented as an electronic device such as a display screen, an LED lamp, a fan, a loudspeaker, a robot, and the like, can also include a table, a chair, an animal model, a natural scenery model, a building model, a totem model, and the like, can further include a cloth, a bead curtain, an art display piece, a paper folding, a woven fabric, and the like, and the present embodiment includes but is not limited to the above.

[0043] Each object body can be connected to a corresponding control module, which can be implemented by an intelligent control chip, a hardware circuit, and a communication module, and can be used to receive a control instruction sent by the server 20, execute the control instruction, and control the object body to enter a corresponding working state.

[0044] The communication module can include but is not limited to a GPRS (General Packet Radio Service) module, an NFC (Near Field Communication) module, an RFID (Radio Frequency Identification) module, an IrDA (Infrared Data Association) module, a UWB (Ultra Wideband) module, a BT (Bluetooth) module, and a WiFi module.

[0045] The intelligent control chip can include but is not limited to an MCU (Microcontroller Unit) chip, a CPU (Central Processing unit) chip, a DSP (Digital Signal Processing) chip, and the like.

[0046] The hardware circuit can include peripheral circuits of each intelligent control chip and hardware circuits for controlling each object body to perform various actions, such as a relay control circuit, a motor control circuit, an intelligent switch circuit, a walking driving circuit, a propeller control circuit, and the like, which will not be listed one by one.

[0047] The working state of the object body is different when the implementation form of the object body is different. For example, the working state of the display screen can include the working state of deducing different image or video content; the working state of the LED lamp can include the working state of the LED lamp being always on, flickering, or emitting light of different colors; the working state of the animal model can include the working state of simulating running or simulating flying, and the like, which will not be listed one by one.

[0048] It should be noted that in some embodiments, the control module corresponding to each object body can be customized according to the functions that can be implemented by the object body, and each standardized customized function can be triggered by a corresponding action instruction. For example, for an animal model, a walking control circuit and a voice control circuit can be customized for it; the walking control circuit can execute a walking action at a specified speed and in a specified direction according to a walking action instruction, and the voice control circuit can emit a voice at a specified sound intensity and frequency according to a voice instruction. For example, for a cloud prop, a moving guide rail and a guide rail control circuit, and a water storage bucket and a water spraying control circuit can be customized for it; the guide rail and the guide rail control circuit can move to a specified position at a specified speed according to a moving instruction, and the water storage bucket and the water spraying control circuit can spray water according to a specified water spraying amount according to a water spraying control instruction. Based on this way of standardizing and customizing the control module of the design object, the technical difficulty of the designer in developing device art is greatly reduced, so that the designer can focus more on the artistic design itself. The design object described above is usually implemented as an entity that actually exists in the material world.

[0049] It should be noted that in some other optional embodiments, the design object can be implemented as a virtual object. The virtual object is located in a computer virtual world, for example, can be implemented as a virtual animated prop, a virtual animation character, a virtual artwork, a modeling work of various physical objects, and the like, which are not limited in the present embodiment.

[0050] In some scenarios, based on the virtual object, a user can design a virtual device art work. The virtual device art work can be made into a VR (Virtual Reality) video or a VR panorama. The user can remotely experience a device art display effect with stronger immersion by wearing a VR device.

[0051] In some other scenarios, the virtual object can be modeled from a design object of an entity. After an artist provides device art design information through the design terminal 10, the design terminal 10 can allocate and combine virtual objects according to the device art design information to simulate the display effect of the entity design object according to the virtual object. After the design terminal 10 outputs the display effect of the virtual object, the artist can adjust the device art design information according to the display effect. Based on the above process, the design effect is previewed by means of the virtual object, which can effectively reduce the action frequency of the entity design object, save energy, and improve the control efficiency.

[0052] In some example embodiments, the action instructions determined by the server 20 for the art display object can include action instructions that can be executed immediately and action instructions triggered by a specific event. The action instructions that can be executed immediately are used to control the art display object to immediately respond to the instruction content and enter the corresponding working state. The action instructions triggered by a specific event are used to control the art display object to respond to the instruction content when the specific event occurs.

[0053] Optionally, the specific event that can trigger the action instruction can be a timing event. Based on the action instruction triggered by the timing event, the art display object can display the set artistic effect at a timing. Optionally, the specific event that can trigger the action instruction can be a linkage event. Based on the action instruction triggered by the linkage event, the art display object can display the artistic effect linked with the event.

[0054] Optionally, to realize the artistic effect of the art display object linked with the event, in some example embodiments, the server 20 can be further used to: acquire a linkage event, determine an art display object used to respond to the linkage event, and control the art display object to execute an action instruction matched with the linkage event to display the linkage artistic effect. The following will be exemplarily described in combination with different linkage events.

[0055] In some example embodiments, Example A In some example embodiments,

[0056] After receiving the action progress of the first artistic display object, the server 20 can determine, according to the device artistic design information provided by the first user, an artistic display object in the at least one artistic display object that is linked with the first artistic display object. For the sake of description, the artistic display object linked with the first artistic display object is described as a second artistic display object. Then, when the action progress of the first artistic display object reaches a set progress node, the server 20 can control the second artistic display object to execute an action instruction adapted to the progress node.

[0057] For example, the device artistic design information indicates that the artistic effect designed by the first user is that the LED array displays a flashing light effect when the display content of the display screen is switched from video V1 to video V2. To achieve the above effect, the display screen can send its video display progress to the server in real time. When the server 20 determines that the display progress of the display screen reaches the progress node at which video V1 is switched to video V2, the server 20 can control the LED array to enter a flashing light working state.

[0058] It should be noted that, in some optional embodiments, the action instruction adapted to the progress node can be stored at the server 20. When the server 20 determines that the action progress of the first artistic display object reaches the set progress node, the server 20 can issue the action instruction to the second artistic display object, so that the second artistic display object executes the action instruction in real time. In other optional embodiments, the action instruction adapted to the progress node can be stored at the second artistic display object. When the server 20 determines that the action progress of the first artistic display object reaches the set progress node, the server 20 can issue the action node to the second artistic display object, so as to trigger the second artistic display object to execute the action instruction adapted to the progress node.

[0059] In some exemplary Example B In some exemplary

[0060] In this implementation, optionally, the design objects in the design object group 30 can also include a design object of an input type. The design object of the input type can be implemented as an interactive detection device. In the control system 100, the interactive detection device is mainly used to acquire interactive data provided by the second user and send the interactive data to the server 20.

[0061] Based on the above, the server 20 can identify the interactive operation of the second user according to the received interactive data, determine, according to the device artistic design information provided by the first user, an artistic display object in the at least one artistic display object that is used to respond to the interactive operation, and for the sake of description, the artistic display object that responds to the interactive operation is described as a third artistic display object. Then, the server 20 can control the third artistic display object to execute an action instruction matched with the interactive operation.

[0062] The deployment position of the interaction detection device is determined according to different application scenarios, and the embodiments are not limited. In some scenarios, the interaction detection device can be deployed at the artistic display object for detecting the close-range interaction of the audience with the artistic display object; in other scenarios, the interaction detection device can also be deployed at a position away from the artistic display object for detecting the remote interaction of the audience with the display object to break through the space limitation and realize cross-regional display device art.

[0063] The interaction detection device can be implemented as at least one of an audio collection device, an image collection device, a human proximity sensing device, a touch sensing device, a motion detection device, a gesture recognition device, a distance detection device, a heart rate detection device, and a weight detection device. Correspondingly, the interaction operation of the second user can include a voice interaction operation, a facial expression interaction operation, a close-remote interaction operation, a touch interaction operation, a motion interaction operation, a gesture interaction operation, a distance input interaction operation, a heart rate input interaction operation, and a weight input interaction operation, and the like.

[0064] For example, the device art design information indicates that the artistic effect designed by the first user is that when the audience approaches the display screen, the display screen displays video V1, when the audience shows a sad emotion, the display screen displays video V2, and when the audience makes a "heart" gesture, the display screen displays a dynamic picture of "heart". To achieve the above effect, the human proximity sensing device can detect the proximity data of the audience and send the proximity data to the server; the server recognizes that the audience approaches the display screen based on the proximity data, and controls the display screen to display video V1. The image collection device can collect the face image of the audience and send the face image to the server; the server 20 can perform facial expression recognition based on the face image, and control the display screen to display video V2 when a sad expression of the audience is recognized. The gesture recognition device can recognize the gesture of the audience and send the gesture to the server. When the server receives the "heart" gesture sent by the gesture recognition device, it controls the display screen to display a dynamic picture of "heart".

[0065] Based on the above embodiments, the device art work can bring stronger immersion and more interactive interest to the audience.

[0066] It also needs to be explained that in some optional embodiments, the action instruction adapted to the interaction operation can be stored at the server 20, and the server 20 can issue the action instruction to the third artistic display object when the interaction operation is recognized, so that the action instruction is executed immediately. In other optional embodiments, the action instruction adapted to the interaction operation can be stored at the third artistic display object, and the server 20 can issue the interaction operation to the third artistic display object when the interaction operation is recognized, to trigger the execution of the action instruction adapted to the interaction operation.

[0067] In some exemplary cases Example C In this implementation, the linked event can be generated by a specified environment. Optionally, the design objects in the design object group 30 may also include input-type design objects. The input-type design object can be implemented as an environmental detection device. The environmental detection device can be used to: acquire environmental data within a set detection range and send the environmental data to the server 20.

[0068] Environmental monitoring equipment can be deployed in the environment where the art display objects are located to monitor the environment where the art display objects are located; or, environmental monitoring equipment can be deployed in other environments, depending on the different application scenarios.

[0069] When the server 20 receives the environmental data, it can determine, based on the installation art design information provided by the first user, an art display object that is linked to the environmental changes indicated by the environmental data within the at least one design object. For ease of description, this art display object is described as a fourth art display object. Then, the server 20 can control the fourth art display object to execute the action instructions matched by the environmental data.

[0070] Optionally, the environmental monitoring equipment may be at least one of the following: temperature monitoring equipment, humidity monitoring equipment, magnetic field monitoring equipment, gas monitoring equipment, wind speed and direction monitoring equipment, and soil monitoring equipment.

[0071] For example, the installation art design information instructs the first user to design the following artistic effect: when the air humidity is greater than 60%, play the sound of falling rain and display a dense cloud effect. To achieve this effect, a humidity detection device can monitor the humidity in the environment in real time and report it to the server. When the server determines that the air humidity is greater than 60%, it controls the speaker to play the recording of falling rain and controls the cloud prop to move to a designated position. Therefore, based on the above implementation method, the installation art can achieve environmental perception, bringing a stronger sense of realism to the audience.

[0072] It should also be noted that, in some optional embodiments, the action instructions adapted to the environmental data can be stored on the server 20. Upon receiving the environmental data, the server 20 can send the action instructions to the second art display object, causing it to execute the action instructions immediately. In other optional embodiments, the action instructions adapted to the environmental data can be stored on the fourth art display object. Upon receiving the environmental data, the server 20 can send the environmental data to the fourth art display object, triggering it to execute the action instructions adapted to the environmental data.

[0073] It is worth noting that the above Implementation A , Implementation B as well as Implementation CThe above-mentioned embodiments can be implemented independently or in any combination according to the design requirements of the first user, and the embodiments are not limited in this regard.

[0074] The above-mentioned embodiments will be described below in combination with Figure 1b The combination of the embodiments A, B and C will be described below in combination with a specific application scenario.

[0075] Suppose that an artist designs a device art work "Emotion Studio", which provides device art design information through a design terminal: capturing the facial image of the audience through a camera to identify the emotion of the audience; if the audience is in high spirits, simulating a sunny day through a sun prop and a white cloud prop, displaying a bird language and flower fragrance animation on a display screen, and controlling a loudspeaker to play bird chirping and insect calling sounds; if the audience is in low spirits, simulating a rainy day through a cloud prop to spray water drops, displaying a thunder and rain animation on the display screen, controlling the loudspeaker to play thunder and raindrop sounds, and detecting the air humidity through a humidity sensor to control the cloud prop to stop spraying water drops when the air humidity is greater than 80%.

[0076] The design terminal sends the above-mentioned device art design information to the server, which can generate an instruction for the camera to capture the facial image of the audience, and sends the instruction to the camera. When the camera returns the captured facial image of the audience, the server can analyze the emotion of the audience based on the facial image.

[0077] If the analysis result shows that the audience is in high spirits, a motion instruction corresponding to the sun prop is generated to move the sun prop to the display area; a motion instruction corresponding to the white cloud prop is generated to move the white cloud prop to the display area; an instruction corresponding to the display screen is generated to play the bird language and flower fragrance animation; and an instruction corresponding to the loudspeaker is generated to play the bird chirping and insect calling sounds.

[0078] If the analysis result shows that the audience is in low spirits, a water droplet spraying instruction corresponding to the cloud prop, a thunder and rain animation display instruction corresponding to the display screen, a thunder and raindrop sound playing instruction corresponding to the loudspeaker, and an air humidity detection instruction corresponding to the humidity sensor are generated. When the above-mentioned design objects receive the corresponding instructions, the artistic effect as shown in Figure 1b is displayed.

[0079] The humidity sensor continuously detects the air humidity and sends the detected air humidity data to the server. When the server determines that the air humidity is greater than 80%, it can generate an instruction corresponding to the cloud prop to stop spraying water droplets to achieve the "rain stop" technical effect.

[0080] In the above-mentioned embodiments of the present application, the implementation of the server 20 determining at least one design object and its respective motion instruction according to the device art design information is described, which will be described in detail below.

[0081] In some example embodiments, the server 20 can obtain the action description information corresponding to each of the at least one design object according to the device art design information, and generate the action instruction corresponding to each of the at least one design object according to the action description information corresponding to each of the at least one design object.

[0082] For any design object, the action description information corresponding to the design object obtained by the server 20 from the device art design information can include at least one of action content description information, action trigger mode description information, action execution mode description information, action cycle period description information, action effective time description information, action end time description information, action sequence description information, and action linkage logic description information.

[0083] Optionally, for any design object, the server 20 can generate multiple action instructions according to multiple action description information corresponding to the design object, or generate one action instruction according to multiple mutually associated action description information corresponding to the design object, which is not limited in the present embodiment. For any design object, the first user can provide one or more action description information of the design object in the device art design information according to design requirements, which is not limited in the present embodiment according to specific scenarios. The above action description information will be described exemplarily as follows.

[0084] The action content description information is used to describe what kind of action is performed by the design object, for example, describing that the design object B1 performs action M and the design object B2 performs action N.

[0085] The action trigger mode description information is used to describe the trigger mode of each action of the design object, for example, timing trigger, trigger by user's interactive operation, or trigger by action progress of other design objects, etc. For example, describing that action M is timing trigger and action N is triggered by user's interactive operation, etc.

[0086] The action execution mode description information is used to describe the execution mode of each action of the design object, for example, cyclic execution according to a certain period, single execution, continuous execution for several times, etc. For example, describing that action M is single execution and action N is cyclic execution, etc.

[0087] The action cycle period description information is used to describe the cycle period of each action of the design object, for example, describing that action M has a cycle of two minutes and action N has a cycle of 30 seconds, etc.

[0088] The action effective time description information is used to describe the start time of the action of the design object, for example, describing that action M is effective after 3 minutes of booting and action N is effective at 15:00.

[0089] The action end time description information is used to describe the action end time of the design object, for example, describing that the action M ends the action in 20 seconds after taking effect, and the action N ends the action at 15:30.

[0090] The action sequence description information is used to describe the execution sequence of the design object when executing multiple actions, for example, describing that the execution sequence of the three actions is X, Y, and Z.

[0091] The action linkage logic description information is used to describe the linkage logic of the design object and other design objects, for example, describing that the design object B1 starts to execute the action M when the design object B2 finishes executing the action N.

[0092] Of course, in addition to the above-mentioned action description information, the device art design information provided by the first user can also include other action description information, which is not listed here.

[0093] Optionally, in some embodiments, a correspondence between different action description information and different action instructions can be set in advance, and after the action description information of a design object is acquired, the corresponding action instruction of the design object can be acquired based on the above-mentioned correspondence.

[0094] In another embodiment, an action instruction template can be set for different smart hardware, and the content corresponding to the specific action description information in the template is in a to-be-assigned state; after the action description information of the design object is acquired, the part in the to-be-assigned state in the template can be assigned to obtain the action instruction corresponding to the design object. For example, the action instruction template of the LED lamp can be: execute b action with a as the cycle period at t1; wherein t1, a, and b are in a to-be-assigned state. After the action description information of the LED lamp is acquired, t1, a, and b can be assigned, for example, t1=14:50, a=30 seconds, and b=red and blue light alternating flashing.

[0095] In the above and the following embodiments of the present application, the performance form of the device art design information provided by the first user is different when the application scenarios are different, which will be further exemplarily described below.

[0096] Optionally, the design terminal 10 can include a display screen, and the device art design interface can be displayed on the display screen to enable the first user to input the device art design information.

[0097] In an optional Example DIn this design, the installation art design information provided by the first user can be presented as configuration information for at least one design object. Optionally, the design terminal 10 can display a selection box for the design object and multiple configuration items on the installation art design interface, allowing the first user to select a design object and configure its configuration items. Figure 3a As shown, the first user can select LED lights and configure their artistic expression and specific actions as installation art design information, which will not be elaborated further.

[0098] In this implementation, optionally, such as Figure 3b As shown, the design terminal 10 can display multiple design objects on the installation art design interface for the first user to select. In response to the first user's selection of any one of the multiple design objects, the design terminal 10 can display at least one action configuration item corresponding to that design object, such as... Figure 3c As stated above.

[0099] Specifically, for some action configuration items, the design terminal 10 can display at least one configuration content option pre-set for each action configuration item for the first user to select; for other action configuration items, the design terminal 10 can display a custom input box corresponding to each action configuration item for the first user to input. After the first user completes the configuration operation for at least one of the multiple design objects, the design terminal 10 can obtain the configuration content provided by the first user for each of the at least one design object's corresponding action configuration items and send it to the server 20 as installation art design information.

[0100] After obtaining the configuration content of the action configuration items corresponding to at least one design object, the server 20 can obtain the action description information corresponding to at least one design object based on the configuration content of the action configuration items corresponding to at least one design object, and generate the action instructions corresponding to at least one design object based on the action description information corresponding to at least one design object.

[0101] Optionally, for any one of the multiple design objects, the design terminal 10 may display at least one of the following action configuration items for that design object: action content description configuration item, action triggering method configuration item, action execution mode configuration item, action cycle configuration item, action effective time configuration item, action end time configuration item, action sequence configuration item, and action linkage logic configuration item. Each of the above action configuration items will be described with examples below.

[0102] The action content description configuration item is used for configuring what kind of action the design object specifically performs, for example, configuring the constant-on action of the LED lamp, the flickering action, or configuring the action of displaying content A on the display screen, the action of displaying content B, or configuring the action of capturing the motion picture of the user by the image collector, configuring the action of collecting the specific voice instruction of the user by the microphone, and the like.

[0103] The action trigger mode configuration item is used for configuring the action trigger mode of the design object, for example, the timing trigger, the interactive operation trigger of the user, or the action progress trigger of other design objects, and the like. For example, the voice collection action of the microphone is configured as the timing trigger mode, the shooting action of the camera is configured as the motion trigger mode, and the action of displaying a certain content on the display screen is configured as the user proximity trigger mode. When the action content description configuration item of a design object is configured with multiple actions, the trigger mode configuration item corresponding to each action can be displayed to separately configure the trigger mode of each action of the design object. For example, the constant-on action of the LED lamp is configured as the timing trigger, and the flickering action of the LED lamp is configured as the interactive operation trigger of the user.

[0104] The action execution mode configuration item is used for configuring the action execution mode of the design object, for example, the periodic cycle execution, the single execution, the continuous execution for several times, and the like. Similarly, when the action content description configuration item of a design object is configured with multiple actions, the action execution mode configuration item corresponding to each action can be displayed to separately configure the execution mode of each action of the design object.

[0105] The action cycle period configuration item is used for configuring the cycle period of the design object, for example, one period is two minutes, one period is 30 seconds, and the like. Similarly, when the execution mode of multiple actions of a design object is the periodic cycle execution, the action cycle period configuration item corresponding to each action can be displayed to separately configure the cycle period of each action of the design object.

[0106] The action effective time configuration is used for configuring the action start time of the design object, for example, the action is effective after 3 minutes of starting, or the action is effective at 15:00. Similarly, when the action content description configuration item of a design object is configured with multiple actions, the action effective time configuration corresponding to each action can be displayed to separately configure the effective time of each action of the design object.

[0107] The action end time configuration item is used for configuring the action end time of the design object, for example, the action ends 20 seconds after the action is effective, or the action ends at 15:30. Similarly, when the action content description configuration item of a design object is configured with multiple actions, the action end time configuration corresponding to each action can be displayed to separately configure the end time of each action of the design object.

[0108] The action sequence configuration item is configured to configure the execution sequence of the multiple actions when the design object executes the multiple actions. For example, when a water-spraying cloud prop is configured with a water-spraying action, a water-stopping action, and a moving-to-the-center-of-the-room action, the execution sequence of the multiple actions can be configured as: the moving-to-the-center-of-the-room action, the water-spraying action, and the water-stopping action.

[0109] The action linkage logic configuration item is configured to configure the linkage logic between the design object and other design objects. For example, a speaker is configured to play a set of audio when a display screen displays a certain picture, a cloud prop is configured to move after a hairdryer starts blowing and to start spraying water drops after a speaker plays a thunder sound. For another example, an LED lamp is configured to reduce the light brightness when the wind power of the hairdryer reaches a set threshold.

[0110] In an optional Example E embodiment, the device art design information provided by the first user can be expressed as art effect description text.

[0111] Optionally, as shown in Figure 3d , the design terminal 10 can display a text input box for setting the art effect on the device art design interface for the first user to input. After the first user finishes inputting, the design terminal 10 acquires the art effect description text input by the first user in the text input box as the device art design information and sends the device art design information to the server 20. The art effect description text input by the first user can be an art effect statement in a paragraph format.

[0112] For example, when the first user designs an indoor sun shower simulation device, the first user can input the art effect description text as shown in Figure 1b b: the indoor sun prop displays a continuous light effect; at a timing moment T, the display screen displays an image of dense clouds and plays a thunder sound; 10 seconds later, the hairdryer plays a raindrop sound and moves to the center of the room to spray a small amount of water drops; 15 seconds later, the cloud prop sprays a large amount of water drops; when the audience reaches the center of the room, the cloud prop stops spraying and moves to a hidden area, and the rainbow prop moves to the upper space of the room.

[0113] Optionally, as shown in Figure 3d , the design terminal 10 can display a voice input icon on the device art design interface for the first user to input the device art design requirement. In response to a triggering operation on the voice input icon, the design terminal 10 acquires the art effect description voice input by the first user and converts the art effect description voice into corresponding art effect description text as the device art design information.

[0114] After receiving the artistic effect description text sent by the design terminal 10, the server 20 can perform semantic recognition on the artistic effect description text to identify the at least one design object and the respective action description information corresponding to each of the at least one design object from the artistic effect description text, and generate the respective action instruction corresponding to each of the at least one design object according to the respective action description information corresponding to each of the at least one design object. The semantic recognition can be implemented by using a keyword extraction algorithm, a template matching algorithm, or a semantic recognition model based on deep learning, which will not be described here.

[0115] For example, taking the above example of the sunshower simulation device, the server 20 can identify from the above description text that the design objects for displaying artistic effects are: a display screen, a loudspeaker, a cloud prop, a human body proximity detection device, a sun prop, and a rainbow prop. The action description information corresponding to the sun prop identified by the server 20 can be: a constant light action; the action description information corresponding to the display screen can be: an action of displaying an image of a cloud cover at time T; the action description information corresponding to the loudspeaker can be: an action of triggering a thunder sound at time T and an action of playing a raindrop sound; the action description information corresponding to the human body proximity detection device can be: an action of detecting an audience approaching the center of the room; the action description information corresponding to the cloud prop can be: an action of moving to the upper air of the room and spraying a small amount of water droplets at time T+10s, an action of spraying a large amount of water droplets at time T+15s, and an action of moving to a hidden area when the human body proximity detection device detects that the audience approaches the center of the room; and the action description information corresponding to the rainbow prop can be: an action of moving to the upper air of the room when the cloud prop moves to the hidden area.

[0116] It should be noted that in the above embodiments, when the server 20 generates the action instruction corresponding to the design object according to the device artistic description information provided by the first user, the server 20 can also obtain some network data according to the needs to assist the artistic display object in displaying the artistic effect. For example, the server 20 can obtain audio and video data, image data, weather data, geographic location data, and the like by accessing a third-party platform.

[0117] For example, in a typical application scenario, the device art design information indicates that the artistic effect designed by the first user can be: according to the weather expressed by the audience with body movements and the real-time weather, the artistic effect of "man and nature in harmony" is displayed through the weather display props. To achieve the above technical effect, the server 20 can obtain the real-time weather state through the accessed third-party weather platform. At the same time, the server 20 can generate movement instructions for the image collection device to collect the movement images of the audience, and receive the movement images of the audience collected by the image collection device. Then, the server 20 can identify the movement of the audience, and infer the type of weather that the audience wants to express according to the identified movement, such as wind, rain, thunder, lightning, snow, rainbow, lightning, etc. Assuming that the real-time weather state is sunny, and the type of weather that the audience wants to express is rainbow, the server 20 can generate a high-light-emitting movement instruction for the sun display prop, and a movement instruction for the rainbow display prop to move to the display area. Based on this, the sun display prop can emit light in high light, and the rainbow prop can move to the display area to display the rainbow weather.

[0118] In addition to the control system 100 shown in the foregoing embodiments, the embodiments of the present application also provide a control system 200 as shown in the following. Figure 1a As shown in the following, the control system 200 includes a design terminal 40 and a design object group 50. Figure 2 As shown in the following, the control system 200 includes a design terminal 40 and a design object group 50. Figure 2 As shown in the following, the control system 200 includes a design terminal 40 and a design object group 50.

[0119] The design terminal 40 is configured to: obtain device art design information corresponding to a set artistic effect provided by a first user; determine at least one design object and its respective movement instruction for displaying the set artistic effect from the design object group 50 according to the device art design information, and send the respective movement instruction to the at least one design object.

[0120] The design object in the design object group 50 is configured to: enter a corresponding working state according to the movement instruction sent by the design terminal 40 to display the set artistic effect.

[0121] The communication mode between the design terminal 40 and the design object can be a wireless communication mode, which is specifically described in the foregoing embodiments, and the present embodiment is not limited.

[0122] The optional implementation mode of the design terminal 40 performing the above control process can refer to the description of the design terminal 10 and the server 20 in the foregoing embodiments, which will not be repeated here. Compared with the control system 100 described in the foregoing embodiments, the control system 200 provided by the present embodiment reduces the dependence on the server, and the design terminal 40 can directly communicate with the design object, further improving the design flexibility of the device art.

[0123] It is worth mentioning that the control system 100 and the control system 200 described in the foregoing embodiments can further include a monitoring device, which is not shown. The monitoring device is configured to monitor the display effect of the design object and send the monitored display effect to the design terminal. Further, the design terminal can output the display effect sent by the monitoring device, so that the first user can adjust the device artistic design information. Optionally, the monitoring device can be implemented as an image acquisition device, or an existing camera monitoring device can be reused, and the present embodiment is not limited thereto.

[0124] In addition to the control system described above, the present application also provides a control method, which will be described below in conjunction with the accompanying drawings.

[0125] Figure 4 FIG. 1 is a flowchart of a control method provided by an exemplary embodiment of the present application. When the method is executed on the server side, it can include the steps shown in FIG. 1. Figure 4

[0126] Step 401: Obtain device artistic design information provided by a design terminal and adapted to a set artistic effect.

[0127] Step 402: Determine at least one design object and its respective action instruction for displaying the set artistic effect according to the device artistic design information.

[0128] Step 403: Send the respective action instruction to the at least one design object, respectively, to control the at least one design object to display the set artistic effect in the corresponding working state.

[0129] In some exemplary embodiments, the method further includes obtaining a linkage event and controlling an artistic display object in the at least one design object for responding to the linkage event to execute an action instruction matched with the linkage event, so as to display a linkage artistic effect.

[0130] In some exemplary embodiments, one way of obtaining a linkage event and controlling an artistic display object in the at least one design object for responding to the linkage event to execute an action instruction matched with the linkage event includes: obtaining an action progress of a first artistic display object in the at least one design object; determining a second artistic display object in the at least one design object linked with the first artistic display object according to the device artistic design information; and if the action progress of the first artistic display object reaches a set progress node, controlling the second artistic display object to execute an action instruction adapted to the progress node.

[0131] ​In some example embodiments, the way of acquiring a linkage event and controlling an artistic display object in the at least one design object for responding to the linkage event to execute an action instruction matched with the linkage event comprises: acquiring interaction data of a second user sent by an interaction detection device in the at least one design object; identifying an interaction operation of the second user according to the interaction data; determining a third artistic display object in the at least one artistic display object for responding to the interaction operation according to the device artistic design information; and controlling the third artistic display object to execute an action instruction matched with the interaction operation.

[0132] In some example embodiments, the interaction data comprises at least one of voice data, image data, human body proximity data, touch sensing data, motion data, gesture data, distance data, heart rate data, and weight data generated by the interaction operation of the second user.

[0133] In some example embodiments, the way of acquiring a linkage event and controlling an artistic display object in the at least one design object for responding to the linkage event to execute an action instruction matched with the linkage event further comprises: acquiring environmental data in a set detection range detected by an environmental detection device in the at least one design object; determining a fourth artistic display object in the at least one design object linked with an environmental change indicated by the environmental data according to the device artistic design information; and controlling the fourth artistic display object to execute an action instruction matched with the environmental data.

[0134] In some example embodiments, the environmental data comprises at least one of temperature data, humidity data, magnetic field intensity data, gas concentration data, wind speed and direction data, and soil moisture data.

[0135] In some example embodiments, the way of determining the at least one design object for displaying the set artistic effect and the respective action instruction thereof according to the device artistic design information comprises: acquiring action description information of the at least one design object respectively according to the device artistic design information; and generating the respective action instruction of the at least one design object according to the respective action description information of the at least one design object.

[0136] In some example embodiments, the way of acquiring the respective action description information of the at least one design object according to the device artistic design information comprises: acquiring configuration content of an action configuration item of the at least one design object respectively from the device artistic design information; and acquiring the respective action description information of the at least one design object according to the configuration content of the action configuration item of the at least one design object.

[0137] In some example embodiments, a manner of obtaining the respective action description information of the at least one design object according to the device art design information comprises: obtaining the art effect description text sent by the design terminal from the device art design information; and performing semantic recognition according to the art effect description text to identify the at least one design object and the respective action description information thereof from the art effect description text.

[0138] In some example embodiments, the action description information comprises at least one of action trigger mode description information, action execution mode description information, action cycle period description information, action effective time description information, action end time description information, action sequence description information, and action linkage logic description information.

[0139] In this embodiment, after obtaining the device art design information provided by the first user, the device art design information is used to determine the design object for displaying the corresponding art effect, generate the control instruction corresponding to the design object, and control the design object to enter the corresponding working state based on the control instruction. In this way, the intelligent device art display manner of automatically displaying the set art effect of the device art according to the device art design information provided by the art designer is realized, the configuration efficiency and flexibility of the design object are improved, and the technical difficulty of the device art designer in device art design is reduced.

[0140] Figure 5a is a flowchart of a control method provided by another example embodiment of the present application. When executed on the design terminal side, the method can include the steps as shown in Figure 5a

[0141] Step 501a: display a device art design interface.

[0142] Step 502a: obtain the device art design information corresponding to the set art effect provided by the first user through the device art design interface.

[0143] Step 503a: send the device art design information to the server, so that the server controls at least one design object to display the set art effect according to the device art design information.

[0144] ​In some example embodiments, a manner of obtaining the device art design information corresponding to the set artistic effect provided by the first user via the device art design interface includes: displaying a plurality of design objects on the device art design interface; in response to a triggering operation on any one of the design objects, displaying an action configuration item corresponding to the design object; and obtaining configuration content provided by the first user for the action configuration item of the design object as the device art design information.

[0145] In some example embodiments, a manner of displaying the action configuration item corresponding to the design object includes: displaying at least one of the following action configuration items of the design object: an action content configuration item, an action trigger mode configuration item, an action execution mode configuration item, an action cycle period configuration item, an action effective time configuration item, an action end time configuration item, an action sequence configuration item, and an action linkage logic configuration item.

[0146] In some example embodiments, a manner of obtaining the device art design information corresponding to the set artistic effect provided by the first user via the configuration interface includes: obtaining artistic effect description text input by the first user in a text input box displayed on the device art design interface as the device art design information; and / or obtaining artistic effect description voice input by the first user via a voice input icon displayed on the device art design interface, and obtaining artistic effect description text corresponding to the artistic effect description voice as the device art design information.

[0147] In this embodiment, the device art design information provided by the first user can be obtained, so that the server determines the design object for displaying the corresponding artistic effect based on the device art design information, generates a control instruction corresponding to the design object, and controls the design object to enter a corresponding working state based on the control instruction. Furthermore, an intelligent device art display manner of automatically displaying a set artistic effect of device art according to device art design information provided by an artistic designer can be assisted to be realized, which is beneficial to reducing the technical difficulty of device art designers when designing device art.

[0148] Figure 5b FIG. 1 is a flowchart of a control method according to another example embodiment of the present application. The method is executed on the design terminal side and can include the steps shown in FIG. 1. Figure 5b

[0149] Step 501b: obtaining device art design information corresponding to a set artistic effect provided by a first user.

[0150] Step 502b: determining at least one design object and a respective action instruction corresponding to the design object for displaying the set artistic effect from the design object group according to the device art design information.​

[0151] Step 503b, respectively sending each corresponding action instruction to the at least one design object, so that the at least one design object displays the set artistic effect.

[0152] In the embodiment, after the design terminal acquires the device artistic design information, based on the device artistic design information, the design object used to display the corresponding artistic effect can be determined, and the control instruction corresponding to the design object can be generated. Based on the control instruction, the design terminal can control the design object to enter the corresponding working state. When the first user has a design requirement, the operation on the design terminal can complete the device artistic design process, greatly enriching the design flexibility of the device artistic, reducing the design difficulty of the device artistic, and effectively improving the configuration efficiency of the design object.

[0153] It should be noted that the execution subject of each step of the method provided in the above embodiments can be the same device, or the method can also be executed by different devices as the execution subject. For example, the execution subject of steps 401 to 403 can be device A; for another example, the execution subject of steps 401 and 402 can be device A, and the execution subject of step 403 can be device B; and the like.

[0154] In addition, in some of the processes described in the above embodiments and the accompanying drawings, a plurality of operations appearing in a specific order are included, but it should be clearly understood that these operations can be executed or executed in parallel without the order in which they appear in this text. The serial numbers of the operations, such as 401, 402, etc., are only used to distinguish different operations, and the serial numbers themselves do not represent any execution order. In addition, these processes can include more or fewer operations, and these operations can be executed in sequence or in parallel. It should be noted that the "first", "second", etc. described herein are used to distinguish different messages, devices, modules, etc., and do not represent the order of precedence. Also, "first" and "second" are not of different types.

[0155] Figure 6 is a structural schematic diagram of a design terminal provided by an exemplary embodiment of the present application, which is suitable for the control system provided by the foregoing embodiments. As shown in the figure, the design terminal includes a memory 601, a processor 602, and a communication component 603. Figure 6

[0156] The memory 601 is used to store computer programs and can be configured to store other various data to support operations on the design terminal. Examples of these data include instructions for any application program or method operating on the design terminal, contact data, phonebook data, messages, pictures, videos, etc.

[0157] ​The processor 602 is coupled with the memory 601 and is configured to execute a computer program in the memory 601 to: display a device art design interface; acquire device art design information corresponding to a set artistic effect provided by a first user through the device art design interface; and send the device art design information to a server through the communication component 603, so that the server controls at least one design object to display the set artistic effect according to the device art design information.

[0158] Further optionally, when the processor 602 acquires the device art design information corresponding to the set artistic effect provided by the first user through the device art design interface, the processor 602 is specifically configured to: display a plurality of design objects in the device art design interface; in response to a triggering operation on any design object in the plurality of design objects, display an action configuration item corresponding to the design object; and acquire configuration content provided by the first user for the action configuration item of the design object as the device art design information.

[0159] Further optionally, when the processor 602 displays the action configuration item corresponding to the design object, the processor 602 is specifically configured to: for any design object in the plurality of design objects, display at least one of the following action configuration items of the design object: an action content configuration item, an action trigger mode configuration item, an action execution mode configuration item, an action cycle period configuration item, an action effective time configuration item, an action end time configuration item, an action sequence configuration item, and an action linkage logic configuration item.

[0160] Further optionally, when the processor 602 acquires the device art design information corresponding to the set artistic effect provided by the first user through the configuration interface, the processor 602 is specifically configured to: acquire artistic effect description text input by the first user in a text input box displayed in the device art design interface as the device art design information; and / or acquire artistic effect description voice input by the first user through a voice input icon displayed in the device art design interface, and acquire artistic effect description text corresponding to the artistic effect description voice as the device art design information.

[0161] Further, as shown in Figure 6 The design terminal further includes a display 604, a power component 605, an audio component 606, and other components. Figure 6 Some components are only schematically shown in the design terminal, and it does not mean that the design terminal only includes Figure 6 the components shown.

[0162] In this embodiment, the terminal can obtain the device art design information provided by the first user, so that the server determines the design object for displaying the corresponding artistic effect based on the device art design information, generates the control instruction corresponding to the design object, and controls the design object to enter the corresponding working state based on the control instruction. Further, it can assist to realize the intelligent device art display mode of automatically displaying the set artistic effect of the device art according to the device art design information provided by the art designer, which is beneficial to reduce the technical difficulty of the device art designer in device art design.

[0163] It is worth noting that, Figure 6 The design terminal shown can execute the method logic described in the foregoing embodiments, and can also execute the following method logic: the processor 602 obtains the device art design information corresponding to the set artistic effect provided by the first user; at least one design object and its respective action instruction for displaying the set artistic effect are determined from the design object group according to the device art design information; and the respective action instructions are sent to the at least one design object through the communication component 603, so that the at least one design object displays the set artistic effect.

[0164] Correspondingly, the embodiment of the application also provides a computer readable storage medium storing a computer program, which can implement each step that can be executed by the design terminal in the method embodiment when the computer program is executed.

[0165] Figure 7 The structure of the server provided by an example embodiment of the application is shown, and the server is suitable for the control system provided by the foregoing embodiments. As Figure 7 The design terminal includes a memory 701, a processor 702, and a communication component 703.

[0166] The memory 701 is used to store computer programs and can be configured to store various data to support operations on the server. Examples of these data include instructions for any application or method operating on the server, contact data, phonebook data, messages, pictures, videos, and the like.

[0167] The processor 702 is coupled to the memory 701 and is used to execute the computer program in the memory 701, so as to: obtain the device art design information provided by the design terminal and adapted to the set artistic effect through the communication component 703; determine at least one design object and its respective action instruction for displaying the set artistic effect according to the device art design information; and send the respective action instructions to the at least one design object, so as to control the at least one design object to display the set artistic effect in the corresponding working state.

[0168] Further, the processor 702 is further configured to acquire a linkage event, and control an artistic display object in the at least one design object for responding to the linkage event to execute an action instruction matched with the linkage event, so as to display a linkage artistic effect.

[0169] Further, when acquiring the linkage event and controlling the artistic display object in the at least one design object for responding to the linkage event to execute the action instruction matched with the linkage event, the processor 702 is specifically configured to acquire an action progress of a first artistic display object in the at least one design object; determine a second artistic display object in the at least one design object linked with the first artistic display object according to the device artistic design information; and if the action progress of the first artistic display object reaches a set progress node, control the second artistic display object to execute an action instruction adapted to the progress node.

[0170] Further, when acquiring the linkage event and controlling the artistic display object in the at least one design object for responding to the linkage event to execute the action instruction matched with the linkage event, the processor 702 is specifically configured to acquire interaction data of a second user sent by an interaction detection device in the at least one design object; identify an interaction operation of the second user according to the interaction data; determine a third artistic display object in the at least one artistic display object for responding to the interaction operation according to the device artistic design information; and control the third artistic display object to execute an action instruction matched with the interaction operation.

[0171] Further, the interaction data includes at least one of voice data, image data, human body proximity data, touch sensing data, motion data, gesture data, distance data, heart rate data and weight data generated by the interaction operation of the second user.

[0172] Further, when acquiring the linkage event and controlling the artistic display object in the at least one design object for responding to the linkage event to execute the action instruction matched with the linkage event, the processor 702 is further configured to acquire environment data in a set detection range detected by an environment detection device in the at least one design object; determine a fourth artistic display object in the at least one design object linked with an environment change indicated by the environment data according to the device artistic design information; and control the fourth artistic display object to execute an action instruction matched with the environment data.

[0173] Further, the environment data includes at least one of temperature data, humidity data, magnetic field intensity data, gas concentration data, wind speed and direction data and soil humidity data.

[0174] Further optionally, the processor 702, in determining the at least one design object and the respective action instruction for displaying the set artistic effect according to the device artistic design information, is specifically configured to: acquire the respective action description information of the at least one design object according to the device artistic design information; and generate the respective action instruction of the at least one design object according to the respective action description information of the at least one design object.

[0175] Further optionally, the processor 702, in acquiring the respective action description information of the at least one design object according to the device artistic design information, is specifically configured to: acquire the configuration content of the action configuration item of the at least one design object from the device artistic design information; and acquire the respective action description information of the at least one design object according to the configuration content of the action configuration item of the at least one design object.

[0176] Further optionally, the processor 702, in acquiring the respective action description information of the at least one design object according to the device artistic design information, is specifically configured to: acquire the artistic effect description text sent by the design terminal from the device artistic design information; and perform semantic recognition according to the artistic effect description text to identify the at least one design object and the respective action description information of the at least one design object from the artistic effect description text.

[0177] Further optionally, the action description information includes at least one of action trigger mode description information, action execution mode description information, action cycle period description information, action effective time description information, action end time description information, action sequence description information, and action linkage logic description information.

[0178] Further, as shown in Figure 7 the server also includes: a power component 704 and other components. Figure 7 Some components are only schematically shown in the server, and it does not mean that the server only includes Figure 7 the components shown.

[0179] In this embodiment, after the server acquires the device artistic design information provided by the first user, the server can determine the design object for displaying the corresponding artistic effect based on the device artistic design information, generate the control instruction corresponding to the design object, and control the design object to enter the corresponding working state based on the control instruction. Further, the intelligent device artistic display method of automatically displaying the set artistic effect of the device art according to the device artistic design information provided by the artistic designer is realized, and the technical difficulty of the device artistic designer in device artistic design is reduced.

[0180] Accordingly, the embodiments of the present application also provide a computer readable storage medium storing a computer program, the computer program being executed to implement each step performed by the server in the method embodiments.

[0181] The memory in the above Figure 6 and Figure 7 may be implemented by any type of volatile or nonvolatile storage devices or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable programmable read only memory (EPROM), programmable read only memory (PROM), read only memory (ROM), magnetic storage, flash memory, magnetic or optical disk.

[0182] The communication component in the above Figure 6 and Figure 7 is configured to facilitate communication between the device where the communication component is located and other devices in a wired or wireless manner. The device where the communication component is located can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component can be implemented based on near field communication (NFC) technology, radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0183] The display in the above Figure 6 includes a screen, which can include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes the touch panel, the screen can be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense a touch, a slide, and a gesture on the touch panel. The touch sensor can not only sense a boundary of a touching or a sliding action, but also detect a duration and a pressure related to the touching or sliding action.

[0184] The power supply component in the above Figure 6 and Figure 7 supplies power to various components of the device where the power supply component is located. The power supply component can include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device where the power supply component is located.

[0185] Those skilled in the art will appreciate that embodiments of the present application can be readily used as a method, a system, or a computer program product. A present application can be implemented in hardware- only embodiments, software- only embodiments, or embodiments combining software and hardware aspects. Furthermore, present application can take the form of a computer program product on one or more computer- readable storage media (including, but not limited to, disk storage, CD-ROMs, optical storage devices, etc.) embodying computer program instructions thereon.

[0186] The present application is described in reference to the flowchart and / or block diagrams of the method, apparatus (system) and computer program product according to embodiments of the present application. It will be understood that each block of the flowchart and / or block diagrams, and combinations of blocks in the flowchart and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processing device, or other programmable hardware device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable hardware device, create means for implementing the functions specified in the flowchart and / or block diagram block or blocks.

[0187] These computer program instructions can also be stored in a computer- readable memory that can direct a computer or other programmable hardware device to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions means which implement the function specified in the flowchart and / or block diagram block or blocks.

[0188] These computer program instructions can also be loaded onto a computer or other programmable hardware device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process such that the instructions which execute on the computer or other programmable device provide steps for implementing the functions specified in the flowchart and / or block diagram block or blocks.

[0189] In one typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory. The memory can include non-persistent memory, random access memory (RAM), and / or non-volatile memory such as read-only memory (ROM) or flash memory, among others, in a computer-readable medium. The memory is an example of computer-readable media.

[0190] Computer-readable media includes permanent and non-permanent, movable and non-movable media that can implement information storage by any method or technology. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information accessible to a computing device. According to the definition herein, computer-readable media does not include transitory media such as modulated data signals and carriers.

[0191] It should also be noted that the terms "comprising", "containing", or any other variant thereof are intended to cover a non-exclusive inclusion, such that a process, method, article or apparatus that comprises a list of elements does not only include those elements, but can also include other elements not expressly listed or inherent to such process, method, article or apparatus. Without more limitations, the element defined by the statement "comprising a" does not exclude the presence of additional identical elements in the process, method, article or apparatus that includes the element.

[0192] The above only describes the embodiments of the present application and is not intended to limit the present application. For those skilled in the art, the present application can have various modifications and changes. Any modification, equivalent replacement, improvement, etc. within the spirit and principle of the present application shall be included in the scope of claims of the present application.

Claims

1. A control system, characterized by, The application relates to a design terminal, a service end and a design object group. The design terminal is used for obtaining device art design information corresponding to a set artistic effect provided by a first user and sending the device art design information to the service end; the device art design information is artistic effect description text used for describing a device art work from the perspective of artistic expression; the service end is used for determining at least one design object for displaying the set artistic effect from the design object group according to the device art design information. According to the device art design information, action description information corresponding to each of the at least one design object is obtained by adopting a semantic recognition model based on deep learning to perform semantic recognition according to the artistic effect description text and recognizing the at least one design object and the action description information corresponding to each of the at least one design object from the semantic recognition result; the action description information includes at least one of action content description information, action trigger mode description information, action execution mode description information, action cycle period description information, action effective time description information, action end time description information, action sequence description information and action linkage logic description information; and action instructions corresponding to each of the at least one design object are generated according to the action description information corresponding to each of the at least one design object; and the action instructions corresponding to each of the at least one design object are respectively sent to the at least one design object. The design objects in the design object group are used for entering corresponding working states according to the action instructions sent by the service end to display the set artistic effect. The design objects in the design object group include at least one artistic display object, each artistic display object includes an object body and a control module connected with the object body; the control module is used for receiving the control instructions sent by the service end and controlling the object body to enter a corresponding working state.

2. The system of claim 1, wherein, The service end is also used for obtaining a linkage event and controlling an artistic display object for responding to the linkage event to execute an action instruction matched with the linkage event to display a linkage artistic effect.

3. The system of claim 2, wherein, A first artistic display object in the at least one artistic display object is used for sending an action progress of the first artistic display object to the service end.

4. The system of claim 3, wherein, The service end is also used for determining a second artistic display object in the at least one artistic display object linked with the first artistic display object according to the device art design information and controlling the second artistic display object to execute an action instruction matched with a set progress node when the action progress of the first artistic display object reaches the progress node. The design objects in the design object group also include an interaction detection device.

5. The system of claim 3, wherein, The interaction detection device is used for obtaining interaction data provided by a second user and sending the interaction data to the service end. ​ The server is further configured to: identify an interactive operation of the second user according to the interactive data, determine a third artistic display object in the at least one artistic display object for responding to the interactive operation according to the device artistic design information, and control the third artistic display object to execute a motion instruction matched with the interactive operation.

6. The system of claim 5, wherein, The interactive detection device comprises at least one of an audio collection device, an image collection device, a human body proximity sensing device, a touch sensing device, a motion detection device, a gesture recognition device, a distance detection device, a heart rate detection device, and a weight detection device.

7. The system according to any of claims 4-6, characterized in that, The design object in the design object group further comprises an environment detection device. The environment detection device is configured to: acquire environment data in a set detection range, and send the environment data to the server. The server is further configured to: determine a fourth artistic display object in the at least one design object linked with an environment change indicated by the environment data according to the device artistic design information, and control the fourth artistic display object to execute a motion instruction matched with the environment data.

8. The system of claim 7, wherein, The environment detection device comprises at least one of a temperature detection device, a humidity detection device, a magnetic field detection device, a gas detection device, a wind speed and direction detection device, and a soil detection device.

9. The system according to any of claims 1-6, characterized in that, The design terminal is specifically configured to: acquire configuration content provided by the first user to the motion configuration item corresponding to each of the at least one design object, and send the configuration content to the server as the device artistic design information. The server is specifically configured to: acquire motion description information corresponding to each of the at least one design object according to the configuration content of the motion configuration item corresponding to each of the at least one design object.

10. A control system characterized by, Comprise: a design terminal and a design object group; The design terminal is configured to: acquire device artistic design information corresponding to a set artistic effect provided by a first user; the device artistic design information is artistic effect description text used for describing a device artistic work from an artistic form; determine at least one design object for displaying the set artistic effect from the design object group according to the device artistic design information; acquire motion description information corresponding to each of the at least one design object according to the device artistic design information, including: performing semantic recognition according to the artistic effect description text by using a semantic recognition model based on deep learning, and recognizing the at least one design object and motion description information corresponding to each of the at least one design object from a result of the semantic recognition; the motion description information comprises at least one of motion content description information, motion trigger mode description information, motion execution mode description information, motion cycle period description information, motion effective time description information, motion end time description information, motion sequence description information, and motion linkage logic description information; and generate motion instructions corresponding to each of the at least one design object according to the motion description information corresponding to each of the at least one design object; and send the motion instructions corresponding to each of the at least one design object respectively to the at least one design object. The design object in the design object group is configured to enter a corresponding working state according to the action instruction sent by the design terminal to display the set artistic effect.

11. The system of claim 10, wherein, Further comprising: a monitoring device; The monitoring device is configured to monitor the display effect of the design object and send the display effect to the design terminal; The design terminal is further configured to output the display effect sent by the monitoring device to allow the first user to adjust the device artistic design information.

12. A control method, applicable to a server, characterized in that, Further comprising: obtaining device artistic design information provided by the design terminal and adapted to the set artistic effect; The device artistic design information is artistic effect description text for describing a device artistic work from the perspective of artistic expression form; According to the device artistic design information, at least one design object and its respective corresponding action instruction for displaying the set artistic effect are determined, including: obtaining the respective corresponding action description information of the at least one design object according to the device artistic design information, including: using a deep learning-based semantic recognition model to perform semantic recognition according to the artistic effect description text, and identifying the at least one design object and its respective corresponding action description information from the result of the semantic recognition, the action description information including at least one of action content description information, action trigger mode description information, action execution mode description information, action cycle period description information, action effective time description information, action end time description information, action sequence description information, and action linkage logic description information; and generating the respective corresponding action instruction of the at least one design object according to the respective corresponding action description information of the at least one design object; Respective corresponding action instructions are sent to the at least one design object to control the at least one design object to display the set artistic effect in the corresponding working state.

13. The method of claim 12, wherein, Further comprising: obtaining a linkage event and controlling an artistic display object in the at least one design object for responding to the linkage event to execute an action instruction matched with the linkage event to display a linkage artistic effect.

14. The method of claim 13, wherein, Obtaining a linkage event and controlling an artistic display object in the at least one design object for responding to the linkage event to execute an action instruction matched with the linkage event, including: obtaining the action progress of a first artistic display object in the at least one design object; According to the device artistic design information, a second artistic display object in the at least one design object that is linked with the first artistic display object is determined; If the action progress of the first artistic display object reaches a set progress node, the second artistic display object is controlled to execute an action instruction adapted to the progress node.

15. The method of claim 13, wherein, Obtaining a linkage event and controlling an artistic display object in the at least one design object for responding to the linkage event to execute an action instruction matched with the linkage event, including: obtaining interaction data of a second user sent by an interaction detection device in the at least one design object; According to the interaction data, an interaction operation of the second user is identified; According to the device art design information, a third art display object in the at least one art display object for responding to the interactive operation is determined; The third art display object is controlled to execute the action instruction matched with the interactive operation.

16. The method of claim 15, wherein, The interactive data includes at least one of voice data, image data, human body proximity data, touch sensing data, motion data, gesture data, distance data, heart rate data and weight data generated by the interactive operation of the second user.

17. The method according to any one of claims 14-16, characterized by, The linkage event is acquired, and an art display object in the at least one design object for responding to the linkage event is controlled to execute an action instruction matched with the linkage event, and the method further includes: Acquiring environment data in a set detection range detected by an environment detection device in the at least one design object; According to the device art design information, a fourth art display object in the at least one design object linked with the environment change indicated by the environment data is determined; The fourth art display object is controlled to execute the action instruction matched with the environment data.

18. The method of claim 17, wherein, The environment data includes at least one of temperature data, humidity data, magnetic field intensity data, gas concentration data, wind speed and direction data and soil moisture data.

19. The method of claim 12, wherein, According to the device art design information, the action description information corresponding to each of the at least one design object is acquired, including: From the device art design information, the configuration content of the action configuration item corresponding to each of the at least one design object is acquired; According to the configuration content of the action configuration item corresponding to each of the at least one design object, the action description information corresponding to each of the at least one design object is acquired.

20. A control method suitable for a design terminal, characterized by, Including: Displaying a device art design interface; Acquiring device art design information corresponding to a set artistic effect provided by a first user through the device art design interface; The device art design information is an artistic effect description text for describing a device art work from the perspective of artistic form; The device art design information is sent to a server, and the device art design information is used to: make the server determine at least one design object for displaying the set artistic effect from a design object group according to the device art design information, and obtain respective action description information of the at least one design object, including: using a semantic recognition model based on deep learning, performing semantic recognition according to the artistic effect description text, and identifying the at least one design object and respective action description information thereof from a result of the semantic recognition, the action description information including at least one of action content description information, action trigger mode description information, action execution mode description information, action cycle period description information, action effective time description information, action end time description information, action sequence description information, and action linkage logic description information; generating respective action instructions of the at least one design object according to the respective action description information of the at least one design object, and sending the respective action instructions to the at least one design object respectively; and the respective action instructions of the at least one design object are used to make the at least one design object enter a corresponding working state according to the action instructions sent by the server, to display the set artistic effect.

21. The method of claim 20, wherein, The device art design information corresponding to the set artistic effect provided by the first user through the device art design interface is obtained, including: A plurality of design objects are displayed on the device art design interface; In response to a triggering operation on any design object in the plurality of design objects, a corresponding action configuration item of the design object is displayed; The configuration content provided by the first user for the action configuration item of the design object is obtained as the device art design information.

22. The method of claim 20, wherein, Displaying the action configuration item corresponding to the design object includes: Displaying at least one of the following action configuration items of the design object: action content configuration item, action trigger mode configuration item, action execution mode configuration item, action cycle period configuration item, action effective time configuration item, action end time configuration item, action sequence configuration item, and action linkage logic configuration item.

23. The method of claim 20, wherein, The device art design information corresponding to the set artistic effect provided by the first user through the device art design interface is obtained, including: The artistic effect description text input by the first user in the text input box displayed on the device art design interface is obtained as the device art design information; and / or, The artistic effect description voice input by the first user through the voice input icon displayed on the device art design interface is obtained, and the artistic effect description text corresponding to the artistic effect description voice is obtained as the device art design information.

24. A control method suitable for a design terminal, characterized by, Including: Obtaining device art design information corresponding to the set artistic effect provided by the first user; The device art design information is artistic effect description text used to describe the artistic effect of the device art work from the perspective of artistic form; According to the device art design information, at least one design object for displaying the set artistic effect is determined from a design object group, and respective corresponding action description information of the at least one design object is acquired, including: adopting a semantic recognition model based on deep learning, performing semantic recognition according to the artistic effect description text, and recognizing the at least one design object and respective corresponding action description information from a result of the semantic recognition; the action description information includes at least one of action content description information, action trigger mode description information, action execution mode description information, action cycle period description information, action effective time description information, action end time description information, action sequence description information, and action linkage logic description information; and respective corresponding action instructions of the at least one design object are generated according to respective corresponding action description information of the at least one design object; Respective corresponding action instructions of the at least one design object are respectively sent to the at least one design object, so that the at least one design object displays the set artistic effect.

25. A server, comprising: Comprise: a memory, a processor and a communication component; the memory is used to store one or more computer instructions; the processor is used to execute the one or more computer instructions to execute the steps in the control method of any one of claims 12-19.

26. A design terminal, characterized by comprising: Comprise: a memory, a processor and a communication component; the memory is used to store one or more computer instructions; the processor is used to execute the one or more computer instructions to execute the steps in the control method of any one of claims 20-24.

27. A computer readable storage medium storing a computer program, wherein the computer program comprises instructions that, when executed by a computer, cause the computer to perform the method of any one of claims 1-26. The computer program is executed to implement the steps in the control method of any one of claims 12-19; or the steps in the control method of any one of claims 20-24.

Images