Device control method for display screen control scene and related assembly

Abstract

The invention is suitable for the technical field of display screens, and provides an equipment control method for a display screen control scene and related components. The equipment control method for the display screen control scene comprises the steps that in a model display interface, a display screen three-dimensional control model corresponding to the display screen control scene is displayed, and a three-dimensional virtual environment and virtual equipment located in the three-dimensional virtual environment are displayed in the display screen three-dimensional control model; each virtual device is bound with a physical device, and the physical device comprises a display screen, and a control device and / or an environment control device connected with the display screen; and in response to an operation instruction of a user on the target virtual equipment in the model display interface, controlling target physical equipment bound with the target virtual equipment. According to the embodiment of the invention, visual equipment control can be realized, and the method is adaptive to a display screen control scene.

Description

Technical Field

[0001] The present application belongs to the technical field of display screens, and in particular, relates to a device control method and related components for a display screen control scene. Background Art

[0002] With the development of digital modeling technology, visualization is increasingly used in various industries. In some related technologies, in order to facilitate users to understand the on-site layout of the visualization screen, a three-dimensional model is designed through three-dimensional (3D) display technology to present the on-site layout of the display screen to users. However, at present, this three-dimensional model is only used for layout display and has limited usage scenarios. Summary of the invention

[0003] The embodiments of the present application provide a device control method and related components for a display screen control scene, which can solve the problem that the usage scenes of three-dimensional models in related technologies are limited.

[0004] A first aspect of an embodiment of the present application provides a device control method for a display screen control scenario of a display screen control scenario, which is applied to a terminal device, wherein the terminal device is installed with visualization control software, and the visualization control software includes a model display interface. The device control method for the display screen control scenario includes: in the model display interface, a three-dimensional control model of a display screen corresponding to the display screen control scenario is displayed, wherein a three-dimensional virtual environment and virtual devices located in the three-dimensional virtual environment are displayed in the three-dimensional control model of the display screen, wherein each of the virtual devices is respectively bound to one of the physical devices, and the physical devices include a display screen, a control device connected to the display screen, and / or an environmental control device; in response to a user's operation instruction on a target virtual device in the model display interface, a target physical device bound to the target virtual device is controlled.

[0005] In some embodiments of the first aspect, the three-dimensional control model of the display screen corresponding to the display screen control scene is displayed in the model display interface, including: displaying the functional operation interface of the target physical device in the model display interface; controlling the target physical device bound to the target virtual device includes: controlling the target physical device bound to the target virtual device through the functional operation interface of the target physical device displayed in the model display interface, and then realizing device control by using the functional operation interface.

[0006] In some embodiments of the first aspect, the function operation interface of the target physical device is displayed in the model display interface, including: displaying the function operation interface displayed by the panel component of the target physical device on the target virtual device in the model display interface; and / or, in response to a user's click operation on the target virtual device, displaying the function control interface of the target physical device in a pop-up window of the model display interface; and / or, displaying the function operation interface of the application of the control terminal of the target physical device on the target virtual device in the model display interface. In this way, the user can view and operate the function operation interface in different ways.

[0007] In some embodiments of the first aspect, the target physical device bound to the target virtual device is controlled according to the functional operation interface of the target physical device displayed in the model display interface, including: responding to user operation instructions triggered by the user in the functional operation interface displayed in the model display interface, generating and sending control instructions to the target physical device, the control instructions including one or more of screen configuration instructions, display screen display parameter adjustment instructions, display screen power on and off instructions, layer configuration instructions, and picture playback control instructions, so that the user can perform different control operations on the display screen.

[0008] In some embodiments of the first aspect, the target physical device is the display screen; the functional operation interface of the target physical device is the screen configuration operation interface of the display screen; the response to the user operation instruction triggered by the functional operation interface displayed in the model display interface by the user, so as to generate and send control instructions to the target physical device through the functional operation interface, includes: responding to the user's operation instruction on the screen configuration operation interface, generating the screen configuration instruction, the screen configuration instruction is used to control the screen of the display screen to be displayed in a corresponding order; sending the screen configuration instruction to the display screen through the control device, so as to control the display screen through the control device according to the screen configuration instruction. Furthermore, the user can implement the screen configuration operation through the target three-dimensional model.

[0009] According to a second aspect of an embodiment of the present application, there is provided a device control apparatus for a display screen control scene of a display screen control scene, which is configured on a terminal device, wherein the terminal device is installed with visualization control software, wherein the visualization control software includes a model display interface, and the device control apparatus for the display screen control scene includes: a display unit, which is used to display a three-dimensional control model of a display screen corresponding to the display screen control scene in the model display interface, wherein a three-dimensional virtual environment and virtual devices located in the three-dimensional virtual environment are displayed in the three-dimensional control model of the display screen, wherein each of the virtual devices is respectively bound to one of the physical devices, wherein the physical devices include a display screen, a control device connected to the display screen, and / or an environmental control device; and a control unit, which is used to respond to a user's operating instructions on a target virtual device in the model display interface, and control a target physical device bound to the target virtual device.

[0010] A third aspect of an embodiment of the present application provides a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the steps of the device control method for the display screen control scenario described in the first aspect above are implemented.

[0011] The fourth aspect of an embodiment of the present application provides a control system for a display screen, including a display screen, a control device and a terminal device, wherein the control device is connected to the display screen and the terminal device respectively; the terminal device is used to execute the steps of the device control method for the display screen control scene as described in the first aspect.

[0012] A fifth aspect of an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the device control method for the display screen control scenario described in the first aspect are implemented.

[0013] A sixth aspect of an embodiment of the present application provides a computer program product. When the computer program product is run on a terminal device, the terminal device executes the device control method for the display screen control scenario described in the first aspect above.

[0014] In an embodiment of the present application, in a model display interface of a visualization control software, a three-dimensional control model of a display screen corresponding to a display screen control scene is displayed, and a three-dimensional virtual environment and virtual devices located in the three-dimensional virtual environment are displayed in the three-dimensional control model of the display screen, and each virtual device is respectively bound to a physical device, and the physical devices include a display screen, a control device connected to the display screen, and / or an environmental control device; in response to a user's operating instructions on a target virtual device in the model display interface, a target physical device bound to the target virtual device is controlled, and the target virtual device is any virtual device displayed in the model display interface, which can realize visualized device control, is adapted to display screen control scenes, and improves the convenience for users to control physical devices such as display screens. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0016] Figure 1 It is a schematic diagram of the implementation flow of a device control method for a display screen control scenario provided in an embodiment of the present application;

[0017] Figure 2 is a schematic diagram of gesture magnification provided in an embodiment of the present application;

[0018] Figure 3 It is a schematic diagram of a click pop-up window provided in an embodiment of the present application;

[0019] Figure 4 is a schematic diagram of a display operation interface provided by an embodiment of the present application;

[0020] Figure 5 It is a structural schematic diagram of a device control device for a display screen control scenario provided in an embodiment of the present application;

[0021] Figure 6 is a schematic diagram of the structure of a terminal device provided in an embodiment of the present application;

[0022] Figure 7 It is a structural schematic diagram of a control system of a display screen provided in an embodiment of the present application. DETAILED DESCRIPTION

[0023] In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work are protected by the present application.

[0024] With the development of display technology, visualization large screens are increasingly used in various industries. In some related technologies, in order to facilitate users to understand the on-site layout of the visualization large screen, a three-dimensional model is designed through three-dimensional display technology to present the on-site layout of the display screen to users. However, at present, this three-dimensional model is only used for layout display and has limited usage scenarios.

[0025] In view of this, the present application proposes a device control method for a display screen control scene, which can enable users to control physical devices within a three-dimensional model through visual configuration software.

[0026] In order to illustrate the technical solution of the present application, a specific embodiment is provided below for illustration.

[0027] Figure 1 The present invention provides a schematic diagram of the implementation process of a device control method for a display screen control scenario provided by an embodiment of the present invention. The method can be applied to a terminal device and can be applied to situations where the actual needs of the display screen control scenario need to be met. The terminal device can be a computer, a smart phone, a display screen control device or other smart device, and the present invention does not limit this.

[0028] Among them, the terminal device is installed with visualization configuration software, which may include a model display interface for visually presenting a three-dimensional model of a display screen control scene and serving as an operation interface for a user.

[0029] Specifically, the device control method of the display screen control scene may include the following steps S101 to S102.

[0030] Step S101: displaying a three-dimensional control model of a display screen corresponding to a display screen control scene in a model display interface.

[0031] In an embodiment of the present application, the three-dimensional control model of a display screen may be used to simulate a display screen control scenario, in which a three-dimensional virtual environment and virtual devices located in the three-dimensional virtual environment are displayed.

[0032] Among them, the three-dimensional virtual environment is obtained based on the environmental information of the display screen control scene, and is used to simulate the environment of the display screen control scene. For example, the three-dimensional virtual environment can represent the spatial three-dimensional shape, wall, column, etc. of the display screen control scene. The virtual device is a virtual control in the three-dimensional control model of the display screen, which is used to simulate the physical device. Specifically, each virtual device is respectively bound to a physical device in the display screen control scene, and the virtual device is configured in the three-dimensional virtual environment. The physical device may include a display screen, a control device connected to the display screen, and / or an environmental control device. The control device can be used to control the display screen, and may refer to a sending card, a receiving card, etc. The environmental control device is other equipment other than the display screen and the control device, and may refer to a light source, a curtain, an audio device, etc.

[0033] Specifically, the user can edit the display screen 3D control model in the terminal device based on the environment information in the display screen control scene and the device information of each physical device. When the user starts the visual control software, the terminal device can load and display the display screen 3D control model in the model display interface.

[0034] Step S102, responding to the user's operation instruction on the target virtual device in the model display interface, controlling the target physical device bound to the target virtual device.

[0035] The target virtual device is any virtual device displayed in the model display interface.

[0036] Specifically, the user can select the target virtual device in the model display interface to trigger the operation instruction of the target virtual device. In response to the operation instruction, the terminal device can control the target physical device bound to the target virtual device. Among them, controlling the target physical device refers to information management of the target physical device, or controlling the target physical device to perform any one or more control operations. Taking the display screen as an example, the brightness of the display screen can be adjusted, the display screen can be controlled to display a specific picture, or other control operations of the display screen can be performed. Taking the control device as an example, the application configured in the control device can be controlled, the configuration parameters of the control device can be viewed, or other control operations of the display control device can be performed. Taking the environmental control device as an example, the lighting effect of the light source can be adjusted, the curtain can be controlled to be expanded or tightened, the volume of the audio equipment can be controlled, and so on.

[0037] In an embodiment of the present application, in a model display interface of a visualization control software, a three-dimensional control model of a display screen corresponding to a display screen control scene is displayed, and a three-dimensional virtual environment and virtual devices are displayed in the three-dimensional control model of the display screen. Each virtual device is respectively bound to a physical device, and the virtual device is configured in a three-dimensional virtual environment. The physical device includes a display screen, a control device connected to the display screen, and / or an environmental control device; in response to a user's operating instructions on a target virtual device in the model display interface, a target physical device bound to the target virtual device is controlled. The target virtual device is any virtual device displayed in the model display interface, which can realize visualized device control, is adapted to display screen control scenes, and improves the convenience for users to control physical devices such as display screens.

[0038] In order to load and display the three-dimensional control model of the display screen, the terminal device may first obtain device information of each physical device in the display screen control scene.

[0039] Specifically, the terminal device may send request information to each physical device in the display screen usage site. The request information may be used to instruct each of the physical devices to feedback its own device information. The device information may include one or more of the device status, device identification, device type, and display information of the corresponding physical device. By receiving the device information fed back by each physical device according to the request information, the corresponding bound virtual device may be displayed in the display screen three-dimensional control model based on the corresponding device information.

[0040] Specifically, after the display information is obtained, the data can be assembled as the information of the virtual device and rendered to the model display interface. When the user clicks to enlarge the virtual device, the device information of the physical device bound to the virtual device is displayed on the virtual device.

[0041] In some implementations, the terminal device can determine the target display style according to the device state of the physical device, and then display the virtual device of the physical device in the model display interface according to the target display style. For example, the normal working state, fault state, and shutdown state can be displayed in different target display styles, so that the device state of the physical device can be visually presented in the three-dimensional control model of the display screen.

[0042] The target display style is a display style corresponding to the device state, including but not limited to color, pattern or text mark, transparency change, etc.

[0043] In this way, the anomalies of the physical equipment can be seen in the three-dimensional model and the position of the abnormal physical equipment can be located.

[0044] In some implementations, the terminal device can load and display the initial three-dimensional model in the editing interface. In response to the user's configuration operation instruction for the virtual device in the editing interface, the virtual device is loaded and displayed in the corresponding position of the initial three-dimensional model. Then, in response to the user's binding operation instruction for the virtual device, the virtual device is bound to the device information of the corresponding physical device to generate a three-dimensional control model of the display screen.

[0045] The initial 3D model can be used to represent the 3D virtual environment of the display screen control scene. Specifically, based on the environmental information of the display screen control scene, the environmental information can be used as the environmental information of the 3D virtual environment in the initial 3D model, thereby simulating the on-site environment and generating the initial 3D model.

[0046] Since the initial three-dimensional model only simulates the environmental information of the display screen control scene, the terminal device needs to further simulate the physical devices in the display screen control scene within the initial three-dimensional model.

[0047] Specifically, the virtual device may include a virtual display screen, a virtual control device connected to the virtual display screen, and / or a virtual environment control device. The virtual display screen corresponds to the display screen in the display screen control scene. The virtual control device corresponds to a control device connected to the display screen in the display screen control scene and used to control the display screen. The virtual environment control device corresponds to an environment control device in the display screen control scene.

[0048] In the implementation of the present application, the user can trigger the configuration operation instruction for the virtual device in the editing interface, load and display the virtual device to the corresponding position of the initial three-dimensional model, and simulate the position of the physical device in the display screen control scene. Specifically, the user can drag the virtual device to the corresponding position of the initial three-dimensional model to trigger the configuration operation instruction, or after clicking the virtual device, enter the three-dimensional coordinates of the virtual device in the initial three-dimensional model to trigger the configuration operation instruction, and the present application does not limit this.

[0049] The terminal device can receive the binding operation instruction triggered by the user in the editing interface, bind the virtual device with the device information of the corresponding physical device, thereby forming a one-to-one correspondence between the virtual device and the physical device to generate a three-dimensional control model of the display screen.

[0050] Of course, the above device information can be obtained on another device, and the user can generate a three-dimensional control model of the display screen on the other device. In this case, the terminal device only needs to obtain the generated three-dimensional control model of the display screen from the other device.

[0051] After completing the display of the three-dimensional control model of the display screen, the terminal device can control the physical device.

[0052] In some implementations, when the three-dimensional control model of the display screen corresponding to the display screen control scene is displayed, the functional operation interface of the target physical device can be displayed in the model display interface. The functional operation interface can be a display screen on the panel component of the physical device or an operation interface of an application currently displayed on the physical device, or it can be an operation interface developed for different types of physical devices based on the three-dimensional control model of the display screen.

[0053] Specifically, in some implementations, the terminal device can display the functional operation interface displayed by the panel component of the target physical device on the target virtual device in the model display interface; it can also display the functional operation interface of the application program of the control terminal of the target physical device on the target virtual device in the model display interface. The functional operation interface displayed by the panel component is the screen displayed by the panel component. Figure 2 For example, the user can use a zoom gesture to zoom in on the model display interface to zoom in on the screen displayed on the target virtual device or the functional operation interface of the application.

[0054] In some other implementations, in response to a user clicking on a target virtual device, the terminal device may display a function control interface of the target physical device in a pop-up window of the model display interface, wherein the function control interface displayed in the pop-up window may be an interface corresponding to a panel component of the target physical device, or an interface of an application program of a control terminal of the target physical device, or an interface customized by the terminal device based on the target physical device. Figure 3 For example, after the user clicks on the target virtual device, a pop-up window displaying a function operation interface may pop up, and the function operation interface in the pop-up window may be used to control the target physical device to perform specific function operations.

[0055] Correspondingly, the terminal device can control the target physical device bound to the target virtual device through the function operation interface of the target physical device displayed in the model display interface.

[0056] Specifically, in response to a user operation instruction triggered by a user in a function operation interface displayed in the model display interface, a control instruction is generated and sent to a target physical device.

[0057] Among them, the control instructions include one or more of the following: screen configuration instructions, display screen display parameter adjustment instructions, display screen power on and off instructions, layer configuration instructions, and picture playback control instructions. Among them, the screen configuration instructions can be used to configure the display screen; the display screen display parameter adjustment instructions can be used to adjust the display screen's brightness, display mode and other parameters; the display screen power on and off instructions are used to control the display screen to power on or off; the layer configuration instructions are used to control the corresponding relationship between the layer and the input source, output interface, or the relationship between the position, size and priority of the layer. It should be noted that in some scenarios, such as rental scenarios, the layer can also be called a window, but the function is the same as the layer function described above; the picture playback control instructions are used to control the display screen to play pictures.

[0058] In some implementations, the aforementioned target physical device is a display screen, and the functional operation interface of the target physical device is a screen configuration operation interface of the display screen. Accordingly, the terminal device can respond to the user's operation instruction on the screen configuration operation interface, generate a screen configuration instruction, and send the screen configuration instruction to the display screen through the control device, so as to control the display screen according to the screen configuration instruction through the control device.

[0059] Among them, the screen configuration instruction is used to control the screen images of the display screen to be displayed in a corresponding order. Specifically, the display screen can display the screen configuration image in a specific order under the control of the screen configuration instruction. The screen configuration image can refer to a solid color image, an image showing the number of rows and columns of each display unit in the display screen, an image showing the interface identifier of the transmission interface used by each display unit and the receiving card identifier of the connected receiving card, etc., and this application does not limit this.

[0060] The terminal device can obtain the screen configuration instruction of the display screen based on the screen configuration operation interface of the display screen in the model display interface. The screen configuration information carried by the screen configuration instruction can be used to control the screen display of the display screen, which may include the total load size of the display screen, the number of display units loaded on a single transmission interface, the wiring method of the display unit, the resolution size of a single display unit, etc.

[0061] For example, the user can click to enlarge the current display screen of the display screen, manually trigger the screen connection operation, and after clicking Save, the terminal device can obtain the screen configuration instruction according to the connection information (i.e., the wiring method) between the display unit and the transmission interface corresponding to the screen connection operation, and send the screen configuration instruction to the control device of the display screen through the screen protocol to complete the screen configuration. After the control device receives the screen configuration instruction, it can control the display unit connected to each transmission interface separately according to the screen configuration information carried therein to realize the display of the display screen.

[0062] In some other embodiments, the aforementioned target physical device is a control device for a display screen, and the functional operation interface of the target physical device is an operation interface of a screen configuration application of the control device. The screen configuration application is used to control the display screen to complete the screen configuration operation. Accordingly, the terminal device can receive a user operation triggered by the user in the operation interface of the application displayed in the model display interface, and then control the control device according to the user operation to generate and send screen configuration information to the display screen through the screen configuration application.

[0063] Exemplarily, a terminal device may install a service that can be used to obtain the operating interface of the screen application in the control device, as well as the control instructions and responses of the keyboard and mouse of the control device. Specifically, the terminal device may retrieve the data stream of the control device desktop image or obtain a screenshot of the control device desktop through the D3D (Direct3D) hook interface to obtain display information, and fuse the display information with the display screen control three-dimensional model for rendering. At the same time, the terminal device may input keyboard and mouse instructions, and convert the instructions into a standard keyboard and mouse protocol, so that the keyboard and mouse protocol parsing module of the control device can parse the keyboard and mouse instructions. Accordingly, please refer to Figure 4 , the user can click on the virtual control device in the model display interface to transmit keyboard and mouse commands to the control device and open the screen configuration application. At this time, the terminal device can display the operation interface of the screen configuration application in the model display interface. The user can enlarge the virtual control device with a gesture, trigger the operation command on the operation interface displayed in the model display interface, control the display of the screen configuration application, and complete the screen configuration.

[0064] In this way, users can complete screen configuration operations in the model display interface without actually operating on the control device, which improves the convenience of display screen configuration.

[0065] In some implementations, the aforementioned target physical device is a display screen, and the functional operation interface of the target physical device is a display screen switch operation interface of the display screen. Accordingly, the terminal device can generate a display screen switch command in response to the user's operation instruction on the display screen switch operation interface. The display screen switch command is sent to the display screen through the control device, so that the display screen is switched on and off by the control device according to the display screen switch command. Among them, the display screen switch command is used to control the switch state of the display screen.

[0066] Specifically, in order to control the display screen to turn on or off, a display screen switch operation interface can be displayed on the virtual device of the display screen. Through the user's operation on the display screen switch operation interface, the terminal device can send the display screen switch to the display screen through the control device to control the display screen to turn on or off.

[0067] In some other implementations, the aforementioned target physical device is a control device of a display screen, and the functional operation interface of the target physical device is a layer configuration interface of the control device for the display screen.

[0068] Accordingly, the terminal device can respond to the user's operation instructions on the layer configuration interface, generate a layer configuration instruction, and send the layer configuration instruction to the control device, so that the control device executes the layer configuration instruction and sends the execution result to the display screen for display. The layer configuration instruction is used to control the corresponding relationship between the layer and the input source, output interface, or the relationship between the position, size and priority of the layer.

[0069] It should be noted that, for the sake of simplicity of description, the aforementioned method embodiments are all expressed as a series of action combinations, but those skilled in the art should know that the present application is not limited to the described order of actions, because according to the present application, certain steps can be performed in other orders.

[0070] like Figure 5 The figure is a schematic diagram of the structure of a device control apparatus 500 for a display screen control scenario provided in an embodiment of the present application, wherein the device control apparatus 500 for the display screen control scenario is configured on a terminal device.

[0071] Specifically, the device control apparatus 500 for the display screen control scene may include:

[0072] A display unit 501 is used to display the three-dimensional control model of the display screen corresponding to the display screen control scene in the model display interface, wherein the three-dimensional control model of the display screen displays a three-dimensional virtual environment and virtual devices located in the three-dimensional virtual environment, each of the virtual devices is bound to one of the physical devices, and the physical devices include a display screen, a control device connected to the display screen, and / or an environment control device;

[0073] The control unit 502 is used to respond to the user's operation instructions on the target virtual device in the model display interface, and control the target physical device bound to the target virtual device.

[0074] In some embodiments of the present application, the above-mentioned display unit 501 can be specifically used to: display the functional operation interface of the target physical device in the model display interface; the above-mentioned control unit 502 can be specifically used to: control the target physical device bound to the target virtual device through the functional operation interface of the target physical device displayed in the model display interface.

[0075] In some embodiments of the present application, the above-mentioned display unit 501 can be specifically used to: display the functional operation interface displayed by the panel component of the target physical device on the target virtual device in the model display interface; and / or, in response to a user's click operation on the target virtual device, display the functional control interface of the target physical device in a pop-up window of the model display interface; and / or, on the target virtual device in the model display interface, display the functional operation interface of the application of the control terminal of the target physical device.

[0076] In some embodiments of the present application, the above-mentioned control unit 502 can be specifically used to: respond to user operation instructions triggered by the user in the functional operation interface displayed in the model display interface, generate and send control instructions to the target physical device, and the control instructions include one or more of screen configuration instructions, display screen display parameter adjustment instructions, display screen power on and off instructions, layer configuration instructions, and picture playback control instructions.

[0077] In some embodiments of the present application, the target physical device is the display screen; the functional operation interface of the target physical device is the screen configuration operation interface of the display screen; the control unit 502 can be specifically used to: respond to the user's operation instructions on the screen configuration operation interface, generate the screen configuration instructions, and the screen configuration instructions are used to control the screen of the display screen to be displayed in a corresponding order; send the screen configuration instructions to the display screen through the control device, so as to control the display screen through the control device according to the screen configuration instructions.

[0078] In some embodiments of the present application, the target physical device is the display screen; the functional operation interface of the target physical device is the display screen switch operation interface of the display screen; the control unit 502 can be specifically used to: respond to the user's operation instructions on the display screen switch operation interface, generate the display screen power on / off instruction, and the display screen power on / off instruction is used to control the power on / off state of the display screen; send the display screen power on / off instruction to the display screen through the control device, so as to control the switch of the display screen through the control device according to the display screen power on / off instruction.

[0079] In some embodiments of the present application, the target physical device is the control device; the functional operation interface of the target physical device is the layer configuration interface of the display screen; the control unit 502 can be specifically used to: respond to the user's operation instructions on the layer configuration interface, generate the layer configuration instructions, and the layer configuration instructions are used to control the correspondence between the layer and the input source and the output interface; send the layer configuration instructions to the control device so that the control device executes the layer configuration instructions, and send the execution results to the display screen for display.

[0080] In some embodiments of the present application, the device control apparatus 500 of the above-mentioned display screen control scene may further include an acquisition unit, which is used to send request information to each physical device in the display screen control scene, wherein the request information is used to instruct each physical device to feedback its own device information, and the device information includes one or more of the device status, device identification, device type, and display information of the corresponding physical device; and receive the device information fed back by each physical device according to the request information.

[0081] In some embodiments of the present application, the display unit 501 may be specifically used to: determine a target display style according to a device state of the physical device; and display a virtual device of the physical device in the model display interface according to the target display style.

[0082] It should be noted that, for the convenience and simplicity of description, the specific working process of the device control device 500 of the display screen control scene can be referred to Figures 1 to 4 The corresponding process of the method will not be repeated here.

[0083] like Figure 6 , which is a schematic diagram of a terminal device provided in an embodiment of the present application. Specifically, the terminal device 6 may include: a processor 60, a memory 61, and a computer program 62 stored in the memory 61 and executable on the processor 60, such as a device control program for a display screen control scenario. When the processor 60 executes the computer program 62, the steps in the device control method embodiment for each display screen control scenario described above are implemented, such as Figure 1 Alternatively, when the processor 60 executes the computer program 62, the functions of each module / unit in the above-mentioned device embodiments are realized, for example Figure 6 The functions of the loading display unit 301, the configuration unit 302 and the generation unit 303 are shown. Alternatively, when the processor 60 executes the computer program 62, the functions of each module / unit in the above-mentioned device embodiments are realized, for example Figure 5 The functions of the display unit 501 and the control unit 502 are shown.

[0084] The computer program may be divided into one or more modules / units, which are stored in the memory 61 and executed by the processor 60 to complete the present application. The one or more modules / units may be a series of computer program instruction segments capable of completing specific functions, which are used to describe the execution process of the computer program in the terminal device.

[0085] For example, the computer program can be divided into: a display unit and a control unit. The specific functions of each unit are as follows: a display unit, used to display the three-dimensional control model of the display screen corresponding to the display screen control scene in the model display interface, wherein the three-dimensional control model of the display screen displays a three-dimensional virtual environment and virtual devices located in the three-dimensional virtual environment, and each of the virtual devices is bound to one of the physical devices, and the physical device includes a display screen, a control device connected to the display screen, and / or an environmental control device; a control unit, used to respond to the user's operation instructions on the target virtual device in the model display interface, and control the target physical device bound to the target virtual device.

[0086] The terminal device may include, but is not limited to, a processor 60 and a memory 61. Those skilled in the art will appreciate that Figure 6 It is only an example of a terminal device and does not constitute a limitation of the terminal device. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the terminal device may also include input and output devices, network access equipment, buses, etc.

[0087] The processor 60 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), off-the-shelf programmable gate arrays or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0088] The memory 61 may be an internal storage unit of the terminal device, such as a hard disk or memory of the terminal device. The memory 61 may also be an external storage device of the terminal device, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the terminal device. Further, the memory 61 may also include both an internal storage unit of the terminal device and an external storage device. The memory 61 is used to store the computer program and other programs and data required by the terminal device. The memory 61 may also be used to temporarily store data that has been output or is to be output.

[0089] It should be noted that, for the convenience and brevity of description, the structure of the above-mentioned terminal device 6 can also refer to the specific description of the structure in the method embodiment, which will not be repeated here.

[0090] like Figure 7 As shown, the present application also provides a control system 7 of a display screen, including a display screen, a control device and a terminal device, wherein the control device is connected to the display screen and the terminal device respectively. The terminal device can be used to execute Figure 1 The steps of the device control method of the display screen control scene are shown.

[0091] It should be noted that, for the convenience and brevity of description, the structure and function of the above-mentioned terminal device can also refer to the specific description of the terminal device in the method embodiment, which will not be repeated here.

[0092] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0093] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0094] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0095] In the embodiments provided in the present application, it should be understood that the disclosed devices / terminal equipment and methods can be implemented in other ways. For example, the device / terminal equipment embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0096] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0097] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0098] If the integrated module / unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electric carrier signals and telecommunication signals.

[0099] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A device control method for a display screen control scene, characterized in that: Applied to a terminal device, the terminal device is installed with visual control software, the visual control software includes a model display interface, and the device control method of the display screen control scene includes: In the model display interface, a three-dimensional control model of a display screen corresponding to the display screen control scene is displayed, wherein the three-dimensional control model of the display screen displays a three-dimensional virtual environment and virtual devices located in the three-dimensional virtual environment, and each of the virtual devices is bound to a physical device, and the physical device includes a display screen, a control device connected to the display screen, and / or an environmental control device; In response to the user's operation instruction on the target virtual device in the model display interface, the target physical device bound to the target virtual device is controlled.

2. The device control method for display screen control scene according to claim 1, characterized in that: The display screen three-dimensional control model corresponding to the display screen control scene is displayed in the model display interface, including: In the model display interface, a functional operation interface of the target physical device is displayed; The controlling the target physical device bound to the target virtual device includes: The target physical device bound to the target virtual device is controlled through the function operation interface of the target physical device displayed in the model display interface.

3. The device control method for display screen control scene according to claim 2, characterized in that: The function operation interface of the target physical device is displayed in the model display interface, including: On the target virtual device in the model display interface, displaying a functional operation interface displayed by a panel component of the target physical device; and / or, In response to a user clicking operation on the target virtual device, displaying a function control interface of the target physical device in a pop-up window of the model display interface; and / or, On the target virtual device in the model display interface, a functional operation interface of an application program of a control terminal of the target physical device is displayed.

4. The device control method for display screen control scene according to claim 3, characterized in that: The controlling the target physical device bound to the target virtual device through the function operation interface of the target physical device displayed in the model display interface includes: In response to a user operation instruction triggered by a user in the functional operation interface displayed in the model display interface, a control instruction is generated and sent to the target physical device, wherein the control instruction includes one or more of a screen configuration instruction, a display parameter adjustment instruction, a display power on / off instruction, a layer configuration instruction, and a picture playback control instruction.

5. The device control method for display screen control scene according to claim 4, characterized in that: The target physical device is the display screen; the functional operation interface of the target physical device is the screen configuration operation interface of the display screen; The responding to the user operation instruction triggered by the user in the functional operation interface displayed in the model display interface, so as to generate and send a control instruction to the target physical device through the functional operation interface, comprises: In response to a user's operation instruction on the screen configuration operation interface, the screen configuration instruction is generated, and the screen configuration instruction is used to control the screen images of the display screen to be displayed in a corresponding order; The screen configuration instruction is sent to the display screen through the control device, so that the display screen is controlled by the control device according to the screen configuration instruction.

6. The device control method for display screen control scene according to claim 4, characterized in that: The target physical device is the display screen; the functional operation interface of the target physical device is a display screen switch operation interface of the display screen; The responding to the user operation instruction triggered by the user in the functional operation interface displayed in the model display interface, so as to generate and send a control instruction to the target physical device through the functional operation interface, comprises: In response to the user's operation instruction on the display screen switch operation interface, the display screen switch command is generated, and the display screen switch command is used to control the switch state of the display screen; The display screen power on / off command is sent to the display screen through the control device, so that the display screen is turned on and off by the control device according to the display screen power on / off command.

7. The device control method for display screen control scene according to claim 4, characterized in that: The target physical device is the control device; the functional operation interface of the target physical device is the layer configuration interface of the display screen; The responding to the user operation instruction triggered by the user in the functional operation interface displayed in the model display interface, so as to generate and send a control instruction to the target physical device through the functional operation interface, comprises: In response to the user's operation instruction on the layer configuration interface, the layer configuration instruction is generated, and the layer configuration instruction is used to control the corresponding relationship between the layer and the input source and the output interface; The layer configuration instruction is sent to the control device, so that the control device executes the layer configuration instruction and sends the execution result to the display screen for display.

8. The device control method for a display screen control scene according to any one of claims 1 to 7, characterized in that: Before displaying the three-dimensional control model of the display screen corresponding to the display screen control scene, the method includes: Sending request information to each physical device in the display screen control scene, wherein the request information is used to instruct each physical device to feedback its own device information, wherein the device information includes one or more of the device status, device identification, device type, and display information of the corresponding physical device; The device information fed back by each of the physical devices according to the request information is received.

9. The device control method for a display screen control scene according to any one of claims 1 to 7, characterized in that: The display screen three-dimensional control model corresponding to the display screen control scene is displayed, including: Determining a target display style according to a device state of the physical device; In the model display interface, the virtual device of the physical device is displayed according to the target display style.

10. A device control device for controlling a display screen scene, characterized in that: The terminal device is configured with a visual control software installed therein, the visual control software includes a model display interface, and the device control device for controlling the display screen scene includes: A display unit, configured to display a three-dimensional control model of a display screen corresponding to the display screen control scene in the model display interface, wherein the three-dimensional control model of the display screen displays a three-dimensional virtual environment and virtual devices located in the three-dimensional virtual environment, wherein each of the virtual devices is respectively bound to one of the physical devices, and the physical devices include a display screen, a control device connected to the display screen, and / or an environmental control device; The control unit is used to respond to the user's operation instructions on the target virtual device in the model display interface, and control the target physical device bound to the target virtual device. The target virtual device is any one of the virtual devices displayed in the model display interface.

11. A terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the device control method of the display screen control scene according to any one of claims 1 to 9 are implemented.

12. A control system for a display screen, comprising a display screen, a control device and a terminal device, wherein the control device is connected to the display screen and the terminal device respectively; The terminal device is used to execute the steps of the device control method of the display screen control scene as described in any one of claims 1 to 9.

13. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the device control method of the display screen control scene as claimed in any one of claims 1 to 9 are implemented.

Images