Display method based on entity association, and electronic apparatus and display system

Abstract

Disclosed in the present invention is a display method based on entity association, which method is applied to a servo end of a display system. The display method comprises: providing an association interface, wherein the association interface displays a group apparatus pool and a projector pool; receiving a first control command to select a collaboration end from the group apparatus pool, such that the association interface displays a preview window of the collaboration end, wherein the preview window corresponds to a window entity of a display of the collaboration end; receiving a second control command to select a projector from the projector pool; associating the window entity of the collaboration end with a projector entity of the projector; and on the basis of the window entity and data of the projector entity, controlling the display to prepare to display at least one slide. Further disclosed in the present invention are an electronic apparatus and a display system.

Description

Display method based on entity association, electronic device and display system TECHNICAL FIELD

[0001] The present application relates to a display technology, in particular to a display method based on entity association, an electronic device and a display system. BACKGROUND

[0002] A conventional TV wall system must be controlled by a dedicated device to play content. When the dedicated device fails, the TV wall system cannot operate normally, and even the playing data is lost. Therefore, the reliability of the TV wall system depends on the stability and life cycle of the dedicated device.

[0003] Further, the conventional TV wall system is usually bound to the current hardware design and has no flexibility. For example, in order to adjust the display range and presentation effect, the technician needs to manually adjust the number of screens of the TV wall and reset the playing content and the resolution of each screen, and cannot perform rapid adaptive adjustment. In addition, the playing content is stored in the memory of the terminal device instead of being stored centrally in the dedicated device, so when there is an update requirement, the technician must manually update the playing content of the terminal device.

[0004] In addition, the conventional TV wall system can only play multimedia resources unilaterally and does not have interactive elements. Although some related technical solutions exist, there is still room for improvement.

[0005] SUMMARY

[0006] An object of the present application is to provide a display method based on entity association, an electronic device and a display system to provide a flexible hardware and software display association architecture.

[0007] To achieve the above object, one aspect of the present application provides a display method based on entity association applied to a server of a display system, the display method comprising: providing an association interface, the association interface displaying a group device pool and a projector pool; receiving a first control command to select a collaboration end of the group device pool, so that the association interface displays a preview window of the collaboration end, the preview window corresponding to a window entity of a display of the collaboration end; receiving a second control command to select a projector of the projector pool; associating the window entity of the collaboration end with a projector entity of the projector; and controlling the display to prepare to display at least one slide according to data of the window entity and the projector entity.

[0008] To achieve the above object, one aspect of the present application provides an electronic device comprising: a processor and a memory, the memory being configured to store instructions, the processor being configured to execute the instructions, and the display method as described above being compiled as the instructions.

[0009] To achieve the above object, another aspect of the present application provides a display system, comprising: a server end and at least zero collaboration end, wherein one electronic device as described above is configured as the server end; when the display system comprises zero collaboration end, one electronic device as described above is configured as the server end and the collaboration end; when the display system comprises multiple collaboration ends, zero or one of the multiple collaboration ends is configured as one electronic device as described above.

[0010] The display method based on entity association, the electronic device and the display system of the present application can be applied to various TV wall hardware architectures, and can achieve the technical effects of reducing the time cost of TV wall system construction and improving the use efficiency. BRIEF DESCRIPTION OF DRAWINGS

[0011] Fig. 1 is a schematic diagram of a display system according to an embodiment of the present application.

[0012] Fig. 2 is a schematic diagram of an association interface according to an embodiment of the present application.

[0013] Fig. 3 is an entity association diagram according to an embodiment of the present application.

[0014] Fig. 4 is a schematic diagram of the association between a window and a projector according to an embodiment of the present application.

[0015] Fig. 5 is a flowchart of a slide editing process according to an embodiment of the present application.

[0016] Fig. 6 is a schematic diagram of a slide editor according to an embodiment of the present application.

[0017] Fig. 7 is a schematic diagram of a first implementation scheme of a display system according to an embodiment of the present application.

[0018] Fig. 8 is a schematic diagram of a second implementation scheme of a display system according to an embodiment of the present application.

[0019] Fig. 9 is a schematic diagram of a third implementation scheme of a display system according to an embodiment of the present application.

[0020] Fig. 10 is a schematic diagram of a fourth implementation scheme of a display system according to an embodiment of the present application.

[0021] Fig. 11 is a schematic diagram of a fifth implementation scheme of a display system according to an embodiment of the present application.

[0022] Fig. 12 is a schematic diagram of a sixth implementation scheme of a display system according to an embodiment of the present application.

[0023] Fig. 13 is a schematic diagram of a seventh implementation scheme of a display system according to an embodiment of the present application.

[0024] Fig. 14 is a schematic diagram of an eighth implementation scheme of a display system according to an embodiment of the present application.

[0025] Fig. 15 is a schematic diagram of a ninth implementation of the display system of the present application.

[0026] Fig. 16 is a schematic diagram of a tenth implementation of the display system of the present application.

[0027] Fig. 17 is a flowchart of a display method of the present application.

[0028] Reference numerals: 10a, 71, 81a, 81b, 81c, 91a, 91b, 91c, 91d, 91e, 91f, 101a, 101b, 101c, 111a, 111b, 111c, 111d, 111e, 111f, 121a, 121b, 123A, 123B, 123C, 123D, 131a, 131b, 133A, 133B, 133C, 133D, 141a, 141b, 143A, 143B, 143C, 143D, 151, 153A, 153B, 153C, 161, 163: electronic device 10a': standby electronic device 10b, 72, 83, 103, 124A, 124B, 124C, 124D, 134A, 134B, 134C, 134D, 144A, 144B, 144C, 144D: display 10c, 82, 92, 102, 112, 122, 132, 142, 152, 162: network communicator 101: server end 102: collaboration end 18: window arrangement 20: associated interface 21: standby device pool 22: working group menu 23: add control 24: remove control 25: preview window 251: member number module 252: window arrangement module 721, 831, 93A, 93B, 93C, 93D, 103A, 103B, 103C, 103D, 113SA1, 113SA2, 113SA3, 113SA4, 113SB, 113SC, 113SD, 124A1, 124B1, 124C1, 124D1, 134A1, 134A2, 134A3, 134A4, 134B1, 134C1, 134D1, 144A1, 144B1, 144C1, 144D1, 154A, 154B, 154C, 164A, 164B, 164C: window 26: group device pool 27: program menu 28: projector pool 29: device searcher 30, 40: associated example 31: working group entity 32: device entity 33: window entity 34: program entity 35: projector entity 36: slide entity 50: flowchart of slide editing 60: slide editing area 61: static element 62: interactive element 63: menu parameter 64: action parameter 10, 70, 80, 90, 100, 110, 120, 130, 140, 150, 160: display system 93, 113, 154, 164: multi-screen assembly system 155A, 155C, 165A, 165C: interactive element 170: display method example E1-E3, S1-S10, T1-T4: step U: entity U1: entity name U2: entity identification code U3: attribute DETAILED DESCRIPTION

[0029] In order to make the above and other objects, features, and advantages of the present application more comprehensible, preferred embodiments will be described in detail below with reference to the accompanying drawings.

[0030] In terms of hardware configuration, FIG. 1 is a schematic diagram of a display system 10 according to an embodiment of the present application. The display system 10 includes at least one electronic device 10a. The electronic device 10a can be a host computer having image processing and communication capabilities. The electronic device 10a includes a processor, a memory, a multimedia interface, a communication interface, and a user interface. The memory can store program codes to instruct the processor to perform certain procedures, such as one or more steps of the display method. Each electronic device 10a can be connected to a display 10b via the multimedia interface, such as a High Definition Multimedia Interface (HDMI) or a DisplayPort (DP), but not limited thereto. In an embodiment, the electronic device 10a and the display 10b are integrated into a single device, such as a notebook computer, a tablet computer, a smart television, etc. In an embodiment, a plurality of electronic devices 10a are connected to a network communication device (such as an Ethernet hub or a wireless router, etc.) 10c via wired or wireless networks. The communication interface can support the Transmission Control Protocol / Internet Protocol (TCP / IP) suite for communication with each other. Thus, the network communication device 10c and the plurality of electronic devices 10a can form a local area network.

[0031] In terms of software configuration, each electronic device 10a is installed with an application program to be configured as a server (or host) or a client (or slave or client). In one embodiment, the display system 10 includes only one server 101, which can have the functions of a client 102 to assume both roles; in another embodiment, the display system 10 includes one server 101 and at least one client 102, which does not have the functions of the server 101. That is, when there is already one server 101 in the display system 10, other electronic devices 10a can only be configured as clients 102, and the display system 10 can include zero or more clients 102. In operation, one server 101 and a plurality of clients 102 are connected to a network communicator (e.g., a router) 10c via TCP / IP protocol, and are assigned IP addresses by the network communicator 10c to communicate with each other. Thus, when the server 101 receives a control command from a user, the server 101 sends a communication packet to the plurality of clients 102 in response to the control command, so that the plurality of clients 102 control the plurality of displays 10b to play specified multimedia contents. As shown in FIG. 1, a window arrangement 18 (e.g., arranged in a matrix) is composed of video and audio contents of four displays 10b, which are respectively corresponding to numbers 1 to 4.

[0032] FIG. 2 is a schematic diagram of an association interface according to an embodiment of the present application. The association interface 20 can be presented on the display 10b of the server 101 for a user to input instructions and view information. The association interface 20 includes a standby device pool 21, a working group menu 22, a group device pool 26, a program menu 27, and a projector pool 28. The standby device pool 21 is used to display at least one standby electronic device 10a' and its related information, such as including a representative pattern, a machine code, and / or a network address of each standby electronic device 10a', but not limited thereto. In actual use, in the display system 10 of FIG. 1, only a single host 10a is configured to start as the server 101, and the remaining hosts 10a are configured to start as the clients 102. The client 102 can initiate registration with the server 101. In a registration operation, the client 102 sends a registration request to the server 101; and after the server 101 accepts the registration request, the server 101 sets a device entity of the client 102, wherein the device entity includes a device entity id and at least one attribute (as shown in FIG. 3). Accordingly, the registered client 102 becomes a standby electronic device 10a' and is displayed in the standby device pool 21. Then, in a window establishment operation, the server 101 sets a window entity of the display 10b of the standby electronic device 10a'; and associates the device entity id with a host identification code (host_id) attribute of the window entity, wherein the window entity includes a window entity id and at least one attribute (as shown in FIG. 3).

[0033] The workgroup menu 22, such as a drop-down menu, is provided for a user to input a control command to select a workgroup, such as "Workgroup 1". In a workgroup establishment operation, the server 101 receives a workgroup name (such as "Workgroup 1") inputted by a user; sets a workgroup entity for the workgroup, wherein the workgroup entity includes a workgroup entity id and at least one attribute (as shown in Fig. 3); and adds the workgroup name to the workgroup menu 22.

[0034] In the embodiment of Fig. 2, the group device pool 26 corresponding to the workgroup 1 includes three client devices 102 (i.e. PC001, PC005, PC007), wherein one of the three client devices 102 can simultaneously act as the server 101 to execute and display the association interface 20. Optionally, the association interface 20 further includes an add control 23 and a remove control 24. When one of the standby electronic devices 10a' in the standby device pool 21 is selected, the add control 23 is pressed by a user to add the standby electronic device 10a' to the group device pool 26; alternatively, the server 101 can receive a drag command to add the standby electronic device 10a' to the group device pool 26. On the other hand, when the server 101 receives a control command to select one of the client devices 102 in the group device pool 26, the remove control 24 is pressed by a user to remove the client device 102 from the group device pool 26; alternatively, the user can drag the client device 102 from the group device pool 26 to the standby device pool 21. In this way, the association interface 20 can provide a visual recognition effect to a user via the electronic devices (i.e. the client devices 102) located in the standby device pool 21 or the group device pool 26. In a group association operation, when a standby electronic device 10a' is selected, its device entity id is obtained; if the device entity id is not associated to any workgroup entity, a workgroup entity id is obtained; and the workgroup entity id is associated to zero or more attributes of the device entity (as shown in Fig. 3). Accordingly, the client devices 102 added to the group device pool 26 can listen to communication packets from the server 101. If the device entity id is associated to a workgroup entity, the group association operation is cancelled.

[0035] Optionally, as shown in Fig. 2, the standby device pool 21 and the group device pool 26 display device information of the electronic devices included therein, such as representative patterns, connection status (such as online or offline), machine codes and / or network addresses, so that a user can determine the origin and physical location of the electronic devices according to the above-mentioned device information. Optionally, the association interface 20 further includes a device searcher 29, in which a user can input device information to search for a desired electronic device.

[0036] For example, as shown in FIG. 2, the association interface 20 further comprises a preview window 25 for displaying a selected electronic device (e.g., the server 101 "PC001") playing a screen for a user to view. The association interface 20 further comprises a member number module 251 and a window arrangement module 252. The member number module 251 is disposed between the preview window 25 and the group device pool 26 for receiving a user input to set a maximum member number and calculating a number of devices in the group device pool 26 as a current member number. In the embodiment of FIG. 2, the maximum member number of the "workgroup 1" is four and the current member number is three. The window arrangement module 252 is disposed between the preview window 25 and the group device pool 26 for receiving a user input to set a window arrangement (e.g., the window arrangement 18 shown in FIG. 1). In an arrangement editing operation, a user input is received to select at least one device entity; at least one device entity id is read; at least one attribute of at least one window entity id associated with the at least one device entity id is read; a user input is received to adjust the at least one attribute (e.g., the scale and position of at least one window) of the at least one window entity id; and data of the adjusted at least one attribute of the at least one window entity id is written into a window arrangement attribute of the at least one device entity. In practical applications, a user can input a control command to split, merge or adjust the scale and position of a plurality of sub-windows, wherein one sub-window corresponds to one display 10b of the collaboration terminal 102.

[0037] For example, as shown in FIG. 2, the program menu 27 is, for example, a drop-down menu for a user to input a control command to select a program, e.g., "program 1". In a program establishing operation, the server 101 receives a program name (e.g., "program 1") input by a user; sets a program entity, wherein the program entity comprises a program entity id and at least one attribute (as shown in FIG. 3); and associates the workgroup entity id with the program entity id.

[0038] For example, as shown in FIG. 2, the projector pool 28 includes a plurality of media (e.g., "Projector 1", "Projector 2", "Projector 3"). In a group creation operation, a user inputs a control command to select a show entity (e.g., "Show 1"); the user inputs a projector name (e.g., "Projector 1"); the server 101 sets a projector entity; and associates the selected show entity id with zero or more attributes of the projector entity, wherein the projector entity includes a projector entity id and at least one attribute (as shown in FIG. 3). In a slide creation operation, a control command is received to select a show entity (e.g., "Show 1"); a key-in command is received to set a slide name (e.g., "Slide 1"); the server 101 sets a slide entity; and associates the selected show entity id with zero or more attributes of the slide entity, wherein the slide entity includes a slide entity id and at least one attribute (as shown in FIG. 3). In some embodiments, the key-in command is a command to fill in data (e.g., text, numbers, or symbols) by a key-in operation or a voice input operation.

[0039] FIG. 3 is an entity relationship diagram (ERD) of an embodiment of the present application. An example 30 of an association shown in FIG. 3 includes a group entity 31, a device entity 32, a window entity 33, a show entity 34, a projector entity 35, and a slide entity 36. Any one entity (e.g., U in FIG. 3, such as entities 31-36) includes an entity name (e.g., U1 in FIG. 3), an entity id (e.g., U2 in FIG. 3), and at least one attribute (e.g., U3 in FIG. 3). The entity id is a primary key (PK) of the entity, and the at least one attribute is a foreign key (FK) of the entity. For example, the group entity 31 includes an entity id and attributes such as a show id (show_id), a group name (name), a host name (name_host), and a location (locale). The group entity 31 can be created by the above-described group creation operation.

[0040] The device entity 32 includes an entity id and attributes such as a group id (group_id), a machine id (machine_id), a device name (name), a device nickname (nickname), interfaces, and a screen layout (screen_layout). The device entity 32 can be created by the above-described registration operation, so that the registered client 102 becomes the standby electronic device 10a' and is displayed in the standby device pool 21.

[0041] The screen entity 33 includes an entity identification code (id) and attributes such as a host identification code (host_id), a projector identification code (projector_id), a screen sequence number (seq), and a screen name (name). The screen entity 33 is created by the above-mentioned registration operation, and the id of the device entity 31 is associated with the host identification code (host_id) attribute of the screen entity 33. Then, the projector identification code (projector_id), the screen sequence number (seq), and the screen name (name) attributes of the screen entity 33, and the screen layout attribute of the device entity 32 are set by the above-mentioned layout editing operation.

[0042] The show entity 34 includes an entity identification code (id) and attributes such as a show name (name), a cover identification code (cover_id), a default resolution (default_resolution), and notes (notes). The show entity 34 is created by the above-mentioned show creation operation, and the workgroup entity 31 is associated with the show entity 34.

[0043] The projector entity 35 includes an entity identification code (id) and attributes such as a show identification code (show_id), a projector sequence number (seq), a projector name (name), and projector notes (notes). The projector entity 35 is created by the above-mentioned media creation operation, and the selected show entity id is associated with zero or more attributes of the projector entity 35.

[0044] The slide entity 36 includes an entity identification code (id) and attributes such as a show identification code (show_id), a slide sequence number (seq), a slide name (name), a slide resolution (resolution), a canvas, widgets (or widgets), and slide notes (notes). The slide entity 36 is created by the above-mentioned slide creation operation, and the selected show entity id is associated with zero or more attributes of the slide entity 36.

[0045] It is worth noting that the association interface 20 is designed based on the association example 30, and the association interface 20 provides intuitive and guided operation jobs, so that a user can establish the association between the electronic device 10a, the display 10b and the multimedia content through the association interface 20. In addition, the conventional TV wall system is usually bound to the current hardware design, and does not have more flexible changes. In contrast, the association interface 20 of the present application allows a user to establish the association between the electronic device 10a (i.e., the device entity 32 and the workgroup entity 31), the display 10b (i.e., the window entity 33) and the multimedia content (i.e., the program entity 34, the projector entity 35 and the slide entity 36), so as to have more flexible changes.

[0046] FIG. 4 is a schematic diagram of the association between the window and the projector according to an embodiment of the present application. FIG. 4 provides an association example 40 between the window and the projector, and the flow of the association example 40 includes: step Tl, selecting a workgroup (e.g., workgroup 1) to display all electronic devices (e.g., PC001, PC005 and PC007) in the workgroup; step T2, selecting a program (e.g., program 1) to automatically bring out all projectors (e.g., projector 1, projector 2 and projector 3) in the program; step T3, selecting a window (e.g., preview window 25) of an electronic device (e.g., PC001) from the workgroup; and step T4, associating the window with a projector (e.g., projector 2), for example, by clicking the projector ID. As shown in the embodiment of FIG. 4, assuming that the window name associated with the electronic device PC001 is "window 1", when the projector 2 is associated with the window 1, the projector 2 displays the association pattern and the association information PC001@window 1. Since the projector 1 and the projector 3 have not yet established the association with any electronic device, no association pattern and association information are displayed.

[0047] Referring again to FIG. 3, through the flow of the above-mentioned association example 40, at least one attribute of the window entity 33 can be associated with the id of a projector entity 35, and at least one attribute of the window entity 33 (e.g., the host identification code host_id is PC001, the window sequence number seq is 1, and the window name is window 1) is displayed in the association interface 20. Since the electronic devices PC005 and PC007 have not yet established the association with any projector entity, the window entity 33 of the electronic devices PC005 and PC007 is associated with zero id of the projector entity 35.

[0048] Figure 5 is a flowchart of a slide editor according to an embodiment of the present application. Figure 5 provides a flowchart example 50 of a slide editor configured by the server 101 to generate a slide, including: step El, obtaining slide parameters, such as selecting a show, obtaining a show id, obtaining a slide pool id, generating / editing a slide, and obtaining a slide id; step E2, generating a projector-adapted element, such as generating an element (e.g., a still element such as a picture, a text box, or a movie), configuring an interactive element (e.g., an action control such as a button), obtaining all projectors bound to a show id, and selecting a projector as a content medium for setting an action; step E3, generating a control command, such as selecting an action to be performed, such as including but not limited to "jump to a slide", "standby screen", or "display a web page", if the action is "jump to a slide", determining whether all slides bound to a show id are obtained, if yes, writing a slide id into the action to be performed, if no (or the action is "standby screen"), writing a standby keyword (e.g., "STANDBY") into the action to be performed, and if the action is "display a web page", writing a web address into the action to be performed; and subsequently, writing a show id, a slide id, and a corresponding action to be performed into a control instruction package, as a control command.

[0049] For example, Figure 6 is a schematic diagram of a slide editor according to an embodiment of the present application. In a slide editing area 60, a user can add at least one static element 61 for displaying a picture, text, or movie, and the user can add at least one interactive element 62, such as further setting a menu parameter 63 and an action parameter 64, for example, setting a control command to be sent after a button is triggered (e.g., clicked).

[0050] For example, in an application example, a display system according to an embodiment of the present application receives a control command, and a process in which the server assigns a task to the client to display content in at least one window (a split window or a non-split window) can play a specific screen (e.g., a standby screen or a rendering screen) according to a connection state or an assignment state, such as in a case where a connection is normal, before the client accepts an assigned task, the client causes a display to display a standby screen in an associated window, when the client receives a task assigned by the server (e.g., a slide screen), the client causes the display to render a task assignment screen in at least one window, subsequently, the client listens for a control package from the server, if no control package is received, the window maintains a previous screen (e.g., the task assignment screen), and if the client receives a task assigned by the server again, the client causes the display to render another task assignment screen in at least one window.

[0051] In addition, the display system can be configured in various configurations in actual use, such as a television wall, a three-dimensional space display system for a museum, a food advertisement for a fast food restaurant, a touch interactive wall for an aquarium, a medical image (e.g., MRI) display system, and a venue control image display system for a video performance venue, etc. For example, the display system can be configured as follows, but is not limited thereto.

[0052] FIG. 7 is a schematic diagram of a first implementation of the display system according to an embodiment of the present application, which can be used as a television wall basic application, including a single screen system and a single host system. For example, a display system 70 includes an electronic device 71 and a display 72, the electronic device 71 is electrically connected to the display 72, and the display 72 is configured with a window 721. The electronic device 71 is configured as a server and a client. In this application, the electronic device 71 is first started in a server mode to store display data, and then the electronic device 71 is assigned as a client to display content for a user to view through the window 721.

[0053] FIG. 8 is a schematic diagram of a second implementation of the display system according to an embodiment of the present application, which can be used as a television wall advanced application A, including a single screen system with a console and a single host system. For example, a display system 80 includes electronic devices 81a, 81b, 81c, a network communicator 82, and a display 83, the electronic devices 81a, 81b, 81c communicate with each other through the network communicator 82, the electronic device 81a is configured as a server, the electronic device 81b is configured as a console, which can be a mobile device with Wi-Fi function, and the electronic device 81c is configured as a client, the electronic device 81c is connected to a display 83, and the display 83 is configured with a window 831. In this application, a user can set display related parameters through the electronic device 81b, and then assign the electronic device 81c to play display content by the electronic device 81a, so as to display content for a user to view through the window 831.

[0054] Figure 9 is a schematic diagram of a third implementation of a display system of an embodiment of the present application, which can be used as a TV wall advanced application B, having a multi-screen assembly system with a central console and a multi-host system. For example, a display system 90 includes a plurality of electronic devices 91a, 91b, 91c, 91d, 91e, 91f, a network communicator 92, and a multi-screen assembly system 93 formed by a plurality of displays in close proximity. The electronic devices 91a, 91b, 91c, 91d, 91e, 91f communicate with each other via the network communicator 92, the electronic device 91a is configured as a server, the electronic device 91b is configured as a central console, which can be a mobile device with Wi-Fi function, and the electronic devices 91c, 91d, 91e, 91f are configured as collaboration terminals (e.g., A, B, C, D). The electronic devices 91c, 91d, 91e, 91f are connected to a plurality of displays of the multi-screen assembly system 93, which are configured with windows 93A, 93B, 93C, 93D. In this application, a user can set display-related parameters via the electronic device 91b, and then assign the electronic device 91a to instruct the electronic devices 91c, 91d, 91e, and / or 91f to play display content, so as to display content for the user to view via the windows 93A, 93B, 93C, and / or 93D.

[0055] Figure 10 is a schematic diagram of a fourth implementation of a display system of an embodiment of the present application, which can be used as a TV wall advanced application C, having a single-screen picture splitting system with a central console. For example, a display system 100 includes a plurality of electronic devices 101a, 101b, 101c, a network communicator 102, and a display 103. The electronic devices 101a, 101b, 101c communicate with each other via the network communicator 102, the electronic device 101a is configured as a server, the electronic device 101b is configured as a central console, which can be a mobile device with Wi-Fi function, and the electronic device 101c is configured as a collaboration terminal. The electronic device 101c is connected to the display 103, which is configured with a plurality of split windows 103A, 103B, 103C, 103D. In this application, a user can set display-related parameters via the electronic device 101b, and then assign the electronic device 101a to instruct the electronic device 101c to play display content, so as to display content for the user to view via the windows 103A, 103B, 103C, and / or 103D.

[0056] Figure 11 is a schematic diagram of a fifth implementation of a display system of an embodiment of the present application, which can be used as a TV wall to advance application D, a multi-screen assembly system with a central console and a multi-host mixed single-screen picture splitting system. For example, a display system 110 includes a plurality of electronic devices 111a, 111b, 111c, 111d, 111e, 111f, a network communicator 112, and a multi-screen assembly system 113, which is formed by a plurality of displays in close proximity, for example, four displays. The multi-screen assembly system 113 has one display configured with a plurality of split windows 113SA1, 113SA2, 113SA3, 113SA4, and the remaining three displays of the multi-screen assembly system 113 are respectively configured with a window 113SB, 113SC, 113SD. The electronic devices 111a, 111b, 111c, 111d, 111e, 111f communicate with each other via the network communicator 112. The electronic device 111a is configured as a server, the electronic device 111b is configured as a central console, which can be a mobile device with Wi-Fi function, and the electronic devices 111c, 111d, 111e, 111f are configured as collaboration terminals (for example, A, D, C, B). The electronic devices 111c, 111d, 111e, 111f are connected to the four displays of the multi-screen assembly system 113. In this application, the user can set display-related parameters via the electronic device 111b, and then assign the electronic devices 111c, 111d, 111e, and / or 111f to play display content by the electronic device 111a, so as to display the content for the user to watch via the split windows 113SA1, 113SA2, 113SA3, 113SA4 and / or the non-split windows 113SB, 113SC, 113SD. In an application example, the display system 110 can be configured as a director system, which uses a plurality of split windows to monitor a plurality of image sources, and the user can also decide to push one of the image sources to the non-split window (e.g., 113SD) as a live picture.

[0057] Figure 12 is a schematic diagram of a sixth implementation of a display system of an embodiment of the present application, which can be applied as an information billboard A, having a multi-screen decentralized system and a multi-host system of a central control station, for switching advertisement / menu / price tag screen in exhibition hall, convenience store, fast food restaurant. For example, a display system 120 includes a plurality of electronic devices 121a, 121b and a network communicator 122, the display system 120 further includes a plurality of electronic devices 123A, 123B, 123C, 123D and a plurality of displays 124A, 124B, 124C, 124D, the electronic devices 121a, 121b, 123A, 123B, 123C, 123D communicate with each other via the network communicator 122, the electronic device 121a is configured as a server, the electronic device 121b is configured as a central control station, which can be a mobile device with Wi-Fi function, the electronic devices 123A, 123B, 123C, 123D are configured as cooperative terminals (for example, numbered A, B, C, D), the electronic devices 123A, 123B, 123C, 123D are connected to the displays 124A, 124B, 124C, 124D, the displays 124A, 124B, 124C, 124D collectively form a multi-screen decentralized system, for example, the displays 124A, 124B, 124C, 124D are separated from each other (not close to each other), the displays 124A, 124B, 124C, 124D are respectively configured with a single window 124A1, 124B1, 124C1, 124D1. In this application, the user can set display related parameters through the electronic device 121b, and then assign the electronic device 121a to assign the electronic devices 123A, 123B, 123C and / or 123D to play display content, so as to display content for the user to watch through the windows 124A1, 124B1, 124C1 and / or 124D1.

[0058] Fig. 13 is a schematic diagram of a seventh implementation of a display system of an embodiment of the present application, which can be applied as an information billboard B, having a multi-screen decentralized system with a central console and a multi-host mixed single-screen picture partitioning system, for switching advertisement / menu / price tag pictures in exhibition halls, convenience stores, and fast food restaurants. For example, a display system 130 includes a plurality of electronic devices 131a, 131b and a network communicator 132, and the display system 130 further includes a plurality of electronic devices 133A, 133B, 133C, 133D and a plurality of displays 134A, 134B, 134C, 134D. The electronic devices 131a, 131b, 133A, 133B, 133C, 133D communicate with each other via the network communicator 132. The electronic device 131a is configured as a server, and the electronic device 131b is configured as a central console (which is a cooperative terminal). The central console can be a mobile device with Wi-Fi function. The electronic devices 133A, 133B, 133C, 133D are configured as cooperative terminals (e.g., A, B, C, D). The electronic devices 133A, 133B, 133C, 133D are connected to the displays 134A, 134B, 134C, 134D, respectively. The displays 134A, 134B, 134C, 134D collectively form a multi-screen decentralized system. The display 134A is configured with a plurality of partitioned windows 134A1, 134A2, 134A3, 134A4. The displays 134B, 134C, 134D are configured with a single window 134B1, 134C1, 134D1, respectively. In this application, a user can set display-related parameters via the electronic device 131b, and then assign the electronic devices 133A, 133B, 133C, and / or 133D to play display content via the electronic device 131a, so as to display content for the user to view via the partitioned windows 134A1, 134A2, 134A3, 134A4 and / or the non-partitioned windows 134B1, 134C1, 134D1.

[0059] Figure 14 is a schematic diagram of an eighth implementation of a display system of an embodiment of the present application, which can be used as a touch interactive application A, having a multi-screen decentralized system and a multi-host system with a central control terminal, for a restaurant ordering system (e.g. a kitchen pushes a time-limited dynamic of a current available dish to a table display, and a user uses a touch panel to place an order) and a teaching answering system (e.g. a teacher pushes a teaching screen with interactive buttons to students, and the students select the buttons to answer). For example, a display system 140 includes electronic devices 141a, 141b and a network communicator 142, the display system 140 further includes electronic devices 143A, 143B, 143C, 143D and displays 144A, 144B, 144C, 144D (such as touch displays or displays with touch pens), the electronic devices 141a, 141b, 143A, 143B, 143C, 143D communicate with each other via the network communicator 142, the electronic device 141a is configured as a server, the electronic device 141b is configured as a central control terminal, which can be a mobile device with Wi-Fi function, the electronic devices 143A, 143B, 143C, 143D are configured as cooperative terminals (e.g. A, B, C, D), the electronic devices 143A, 143B, 143C, 143D are connected to the displays 144A, 144B, 144C, 144D, the displays 144A, 144B, 144C, 144D collectively form a multi-screen decentralized system, and the displays 144A, 144B, 144C, 144D are respectively configured with single windows 144A1, 144B1, 144C1, 144D1. In this application, a user can set display related parameters via the electronic device 141b, and then assign the electronic device 141a to assign the electronic devices 143A, 143B, 143C and / or 143D to play display content, so as to display content for the user to watch via the windows 144A1, 144B1, 144C1 and / or 144D1, so that the user can select interactive elements according to the watched content to perform an interactive process, such as ordering or answering.

[0060] Figure 15 is a schematic diagram of a ninth implementation of a display system of an embodiment of the present application, which can be used as a touch interactive application B, a touch multi-screen assembly system without a central console and a multi-host system, for interactive exhibitions, such as interactive marine life exhibitions in science museums and interactive digital paintings exhibitions in art museums. For example, a display system 150 includes an electronic device 151 and a network communicator 152, the display system 150 further includes electronic devices 153A, 153B, 153C and a multi-screen assembly system 154 including displays (such as touch displays or combinations of displays with touch pens), the electronic devices 151, 153A, 153B, 153C communicate with each other via the network communicator 152, the electronic device 151 is configured as a server, the electronic devices 153A, 153B, 153C are configured as cooperative terminals (such as A, B, C), the electronic devices 153A, 153B, 153C are connected to the displays of the multi-screen assembly system 154, the displays of the multi-screen assembly system 154 are respectively configured with single windows 154A, 154B, 154C. In this application, a user can set display related parameters via the electronic device 151, assign the electronic devices 153A, 153B and / or 153C to play display content, so as to display content for the user to watch via the windows 154A, 154B and / or 154C, for example, the windows 154A, 154B and 154C collectively display marine life pictures, the windows 154A and 154C are respectively provided with interactive elements 155A and 155C, so that the user can select interactive elements according to the content watched to perform an interactive process, such as answering questions.

[0061] Fig. 16 is a schematic diagram of a tenth implementation of a display system according to an embodiment of the present application, which is a touch interactive application C, a touch multi-screen assembly system without a central console and a single host system, so as to be applied to interactive exhibitions, such as interactive marine life exhibitions in science museums and interactive digital painting exhibitions in art museums. For example, a display system 160 includes an electronic device 161 and a network communicator 162, and the display system 160 further includes an electronic device 163 and a multi-screen assembly system 164 including a plurality of displays (such as touch displays or combinations of displays and touch pens), the electronic devices 161 and 163 communicate with each other via the network communicator 162, the electronic device 161 is configured as a server, and the electronic device 163 is configured as a cooperative terminal, the electronic device 163 is connected to the plurality of displays of the multi-screen assembly system 164, and the plurality of displays of the multi-screen assembly system 164 are respectively configured with single windows 164A, 164B and 164C. In this application, a user can set display related parameters via the electronic device 161, and assign the electronic device 163 to play display content, so as to display content for the user to watch via the windows 164A, 164B and / or 164C, for example, the windows 164A, 164B and 164C collectively display marine life pictures, and the windows 164A and 164C are respectively provided with interactive elements 165A and 165C, so that the user can select the interactive elements according to the content watched to perform an interactive process, such as answering questions.

[0062] In an aspect, an embodiment of the present application provides a display method based on entity association, Fig. 17 is a schematic diagram of a flow of a display method according to an embodiment of the present application, a display method example 170 is applied to a display system (such as a plurality of embodiments of the display system described above), the display system includes a server, and the display method includes steps S1-S10.

[0063] As shown in Fig. 17, in step S1, the server provides an association interface; in step S2, registration is performed; in step S3, a window is established; in step S4, a group is established; in step S5, group association is performed; in step S6, layout editing is performed, and then step S10 can be performed. After step S1 is performed, step S7 can be further performed, in which a program is established; in step S8, a projector is established; in step S9, a slide is established; and in step S10, the projector and the window are associated.

[0064] In detail, as shown in FIG. 1, FIG. 2 and FIG. 17, at step S1, a correlation interface 20 is provided, wherein the correlation interface 20 displays a pool of standby devices 21, a workgroup menu 22, a pool of group devices 26, a program menu 27 and a pool of projectors 28. At step S2, a registration operation includes: receiving a registration request sent by an electronic device 10a; after accepting the registration request, setting a device entity 32 of the electronic device 10a, so that the electronic device 10a becomes a standby electronic device 10a'; wherein the device entity 32 includes a device entity identification code and at least one attribute; and adding the standby electronic device 10a' into a pool of standby devices 21 of the correlation interface 20.

[0065] As shown in FIG. 2 to FIG. 3 and FIG. 17, at step S3, a window establishment operation includes: setting a window entity 33 of a display 10b of the standby electronic device 10a'; wherein the window entity 33 includes a window entity identification code and at least one attribute; and associating the device entity identification code with a device identification code of at least one attribute of the window entity 33. At step S4, a group establishment operation includes: receiving a key-in command to set a workgroup name; setting a workgroup entity 31 of the workgroup; wherein the workgroup entity 31 includes a workgroup entity identification code and at least one attribute; and adding the workgroup name into a workgroup menu 22 of the correlation interface 20.

[0066] As shown in FIGS. 2-3 and 17, at step S5, the group association job includes receiving a control command to select the workgroup entity 31 of the workgroup selection menu 22; receiving a control command to select a pending electronic device 10a' and retrieving a device entity identification code of the pending electronic device 10a'; retrieving the workgroup entity identification code if the device entity identification code is not associated to any workgroup entity 31; associating the workgroup entity identification code to zero or more attributes of a device entity 32 of the pending electronic device 10a'; and adding the pending electronic device 10a' to the group device pool 26 of the association interface 20, making the pending electronic device 10a' a collaboration end 102. At step S5, the group association job further includes receiving a control command to retrieve the device entity identification code of the pending electronic device 10a' via an add control 23; or receiving a control command corresponding to a drag operation to retrieve the device entity identification code of the pending electronic device 10a'. At step S5, the group association job further includes receiving a control command to remove the collaboration end 102 from the group device pool 26, including receiving a control command to remove the collaboration end 102 from the group device pool 26 via a remove control 24, making the collaboration end 102 the pending electronic device 10a'; or receiving a control command corresponding to a drag operation to remove the collaboration end 102 from the group device pool 26, making the collaboration end 102 the pending electronic device 10a'. At step S5, the group association job further includes, if the device entity identification code is associated to a workgroup entity 31, canceling the group association job.

[0067] As shown in FIGS. 2-3 and 17, at step S6, the arrangement editing job includes receiving at least one control command to select at least one device entity 32 of at least one collaboration end 102 in the group device pool 26; reading at least one device entity identification code of the at least one device entity 32; reading at least one window entity identification code and at least one attribute of at least one window entity 33 associated to the at least one device entity identification code; receiving a plurality of control commands to adjust the at least one attribute of the at least one window entity 33; and writing the adjusted at least one attribute data to at least one window arrangement attribute of the at least one device entity 32. At step S7, the program creation job includes receiving a key-in command to set a program name; setting a program entity 34 of the program name, wherein the program entity 34 includes a program entity identification code and at least one attribute; and adding the program name to a program selection menu 27 of the association interface 20.

[0068] As shown in FIGS. 2-3 and 17, at step S8, the establishing a projector job includes receiving a control command to select a program entity 34 in the program menu 27, receiving a typing command to set a projector name, setting a projector entity 35 for the projector name, wherein the projector entity 35 includes a projector entity identification code and at least one attribute, associating the program entity identification code of the program entity 34 with zero or at least one attribute of the projector entity 35, and adding the projector name to the projector pool 28 of the association interface 20. At step S9, the establishing a slide job includes receiving a control command to select a program entity 34 in the program menu 27, receiving a typing command to set a slide name, setting a slide entity 36 for the slide name, wherein the slide entity 36 includes a slide entity identification code and at least one attribute, and associating the program entity identification code of the program entity 34 with zero or at least one attribute of the slide entity 36.

[0069] With the embodiment of FIG. 4, at step S10, the window and projector association job includes receiving a control command to select a collaboration end 102 in the group device pool 26, causing the association interface 20 to display a preview window 25 for the collaboration end 102, wherein the preview window 25 corresponds to a window entity 33 of a display 10b of the collaboration end 102, receiving a control command to select a projector in the projector pool 28, associating the window entity 33 of the collaboration end 102 with a projector entity 35 of the projector, and controlling the display 10b to prepare for displaying at least one slide according to data of the window entity 33 and the projector entity 35. It should be understood that when the association between the window entity 33 and the projector entity 35 is established, the electronic device 10a (i.e., the collaboration end 102) that has joined the group can monitor control packets and video packets from the server end 101 to control the display 10b to play the at least one slide. When the program entity 34 associated with the projector entity 35 is not associated with any slide entity 36, or the slide entity 36 has not established any slide, there is no slide for the display 10b to display.

[0070] It should be understood that steps S1-S5 are used to establish the association of multiple entities related to the device (e.g., to establish a workgroup, the association between the electronic device 10a and the display 10b), step S6 is used to set the display window arrangement, and steps S7-S9 are used to establish the association of multiple entities related to the content (e.g., to establish the association between a program, a projector, and a projection film). Through step S10, the binding association of the device and the content can be set to adapt to various variable television wall hardware architectures. In addition, the user can use a mouse to perform a click operation or a drag operation as a control command, and use a keyboard to enter text as an input command; in some embodiments, the user can operate the association interface 20 through voice input, but those skilled in the art can select an appropriate way to operate the association interface 20 according to actual needs.

[0071] In another aspect, an embodiment of the present application provides an electronic device, comprising a processor and a memory, the memory being configured to store instructions; when the processor is configured to execute the instructions, the display method described above is performed. For example, the electronic device is configured as a server or includes the functions of a server and a client by software.

[0072] In another aspect, an embodiment of the present application provides a display system, comprising a server and at least zero clients, and the electronic device described above is configured as the server. When the display system includes zero clients, one electronic device described above is configured as the server and the client; when the display system includes multiple clients, zero or one of the multiple clients is one electronic device described above.

[0073] The display method, the electronic device, and the display system of the embodiments of the present application can provide a flexible hardware association architecture and a flexible software association architecture, the flexible hardware association architecture can realize fast binding registration and collaboration processes and provide a perfect management interface; in addition to multi-machine collaboration, the picture splitting function is also provided, which can enable the output picture of one display to output multiple window playing contents; based on the above advantages, various variable television wall hardware architectures can be adapted, and the fast switching function can be realized. When a client is broken, the scheduled function can be quickly deployed by replacing the client, installing software, and registering. The flexible software association architecture can quickly produce playing contents and manage and distribute the playing contents, and provides a simple method for associating and interacting with hardware, which can adapt to various display requirements.

[0074] Therefore, the display method, the electronic device, and the display system of the embodiments of the present application can be adapted to various television wall hardware architectures, and can realize the requirements of fast construction, replacement of hardware and contents, and the like, and can achieve the technical effects of greatly reducing the time cost of constructing a television wall system and improving the use efficiency.

[0075] Although the present application has been disclosed in its preferred embodiments, any person skilled in the art will readily perceive variations and modifications which do not depart from the concept and scope of the present application, and therefore the scope of the present application is to be limited only by the claims.

Claims

1. A display method based on entity association, applied to a server of a display system, the display method comprising: providing an association interface, the association interface displaying a group device pool and a projector pool; receiving a first control command to select a cooperating terminal of the group device pool, causing the association interface to display a preview window of the cooperating terminal, the preview window corresponding to a window entity of a display of the cooperating terminal; receiving a second control command to select a projector in the projector pool; Associating the window entity of the collaboration terminal with a projector entity of the projector; as well as According to the data of the window entity and the projector entity, the display is controlled to prepare to display at least one slide.

2. The display method according to claim 1, further comprising performing a registration operation, comprising: receiving a registration request sent by an electronic device; After accepting the registration request, setting a device entity of the electronic device to make the electronic device a standby electronic device, wherein the device entity includes a device entity identification code and at least one attribute; and The standby electronic device is added to a standby device pool on the association interface. 3 . The display method of claim 2 , wherein the at least one attribute of the device entity comprises at least one of a group ID, a machine ID, a device name, a device nickname, a communication interface, and a window layout.

4. The display method according to claim 2, wherein after performing the registration operation, the display method further comprises performing a window creation operation, comprising: Setting a window entity of a display of the standby electronic device, wherein the window entity of the display of the standby electronic device includes a window entity identifier and at least one attribute; and The device entity identifier is associated with a server-side identifier of the at least one attribute of the window entity of the display of the standby electronic device. 5 . The display method as claimed in claim 4 , wherein the at least one attribute of the window entity comprises at least one of the server identification code, a projector identification code, a window serial number, and a window name.

6. The display method according to claim 1 , further comprising performing a group creation operation, comprising: receiving a first input command to set a workgroup name; Setting a workgroup entity of the workgroup, wherein the workgroup entity includes a workgroup entity identifier and at least one attribute; and The workgroup name is added to a workgroup menu on the association interface. 7 . The display method of claim 6 , wherein the at least one attribute of the work group entity comprises at least one of a program identifier, a group name, a server name, and a location.

8. The display method according to claim 6, wherein after the group creation operation, the display method further comprises performing a group association operation, comprising: receiving a third control command to select the workgroup entity in the workgroup menu; receiving a fourth control command to select a standby electronic device and obtain a device entity identification code of the standby electronic device; If the device entity ID is not associated with any workgroup entity, obtain the workgroup entity ID; Associating the workgroup entity identifier with zero or more attributes of a device entity of the standby electronic device; as well as The standby electronic device is added to the group device pool of the association interface, so that the standby electronic device becomes the cooperation terminal.

9. The display method according to claim 8, wherein the group association operation comprises: Receiving the fourth control command through an add control to obtain the device entity identification code of the standby electronic device; or The fourth control command corresponding to a drag operation is received to obtain the device entity identification code of the standby electronic device.

10. The display method of claim 8, wherein the group association operation comprises receiving a fifth control command to remove the collaboration terminal from the group device pool, comprising: receiving the fifth control command via a removal control to remove the collaboration terminal from the group device pool, so that the collaboration terminal becomes the standby electronic device; or The fifth control command corresponding to a drag operation is received to remove the cooperation terminal from the group device pool, so that the cooperation terminal becomes the standby electronic device.

11. The display method according to claim 8, wherein the group association operation comprises: If the device entity identifier is associated with a work group entity, the group association operation is canceled.

12. The display method according to claim 8, further comprising performing a layout editing operation after the group association operation, comprising: receiving at least one control command to select at least one device entity of at least one cooperating end in the group device pool; reading at least one device entity identification code of the at least one device entity; reading at least one window entity identifier and at least one attribute of at least one window entity associated with the at least one device entity identifier; receiving a plurality of control commands to adjust the at least one attribute of the at least one window entity; as well as The adjusted data of the at least one attribute of the at least one window entity is written into at least one window arrangement attribute of the at least one device entity.

13. The display method according to claim 1, further comprising performing a program creation operation, comprising: receiving a second input command to set a program name; Setting a program entity of the program name, wherein the program entity includes a program entity identifier and at least one attribute; and The program name is added to a program menu on the associated interface. 14 . The display method as claimed in claim 13 , wherein the at least one attribute of the program entity comprises at least one of the program name, a cover identification code, a default resolution, and a program annotation.

15. The display method according to claim 13, wherein after the program creation operation, the display method further comprises performing a projector creation operation, comprising: receiving a sixth control command to select the program entity in the program menu; receiving a third input command to set a projector name; Setting a projector entity of the projector name, wherein the projector entity includes a projector entity identification code and at least one attribute; Associating the program entity identifier of the program entity with zero attributes or the at least one attribute of the projector entity; and Add the projector name to the projector pool of the associated interface. 16 . The display method as claimed in claim 13 , wherein the at least one attribute of the projector entity comprises at least one of a program identification code, a projector serial number, a projector name, and a projector annotation.

17. The display method according to claim 15, wherein after the projector creation operation, the display method further comprises performing a slide creation operation, comprising: receiving a seventh control command to select the program entity in the program menu; receiving a fourth keystroke command to set a slide name; Setting a slide entity for the slide name, wherein the slide entity includes a slide entity identification code and at least one attribute; and The program entity identifier of the program entity is associated with zero attributes or the at least one attribute of the slide entity.

18. The display method of claim 17, wherein the at least one attribute of the slide entity comprises at least one of a program identification code, a slide serial number, the slide name, a slide resolution, a canvas, an interactive element, and a slide annotation; wherein the interactive element is configured to receive a trigger command to perform an action.

19. An electronic device comprising a processor and a memory, wherein the memory is configured to store instructions, the processor is configured to execute the instructions, and the display method according to any one of claims 1 to 18 is compiled into the instructions.

20. A display system comprising a server end and at least zero collaborative ends, wherein an electronic device as described in claim 19 is configured as the server end; when the display system comprises zero collaborative ends, an electronic device as described in claim 19 is configured as the server end and the collaborative end; when the display system comprises multiple collaborative ends, zero or one of the multiple collaborative ends is configured as an electronic device as described in claim 19.

Images