Display method based on entity association, and electronic apparatus and display system

Abstract

Disclosed in the present invention is a display method based on entity association, which method is applied to a servo end of a display system. The display method comprises: providing an association interface, wherein the association interface displays a group apparatus pool and a projector pool; receiving a first control command to select a collaboration end from the group apparatus pool, such that the association interface displays a preview window of the collaboration end, wherein the preview window corresponds to a window entity of a display of the collaboration end; receiving a second control command to select a projector from the projector pool; associating the window entity of the collaboration end with a projector entity of the projector; and on the basis of the window entity and data of the projector entity, controlling the display to prepare to display at least one slide. Further disclosed in the present invention are an electronic apparatus and a display system.

Description

Display method, electronic device and display system based on entity association Technical Field

[0001] The present invention relates to a display technology, and more particularly to a display method, electronic device, and display system based on entity association. Background Art

[0002] Traditional video wall systems require dedicated equipment to control playback content. Failure of dedicated equipment can cause the video wall system to malfunction or even result in data loss. Therefore, the reliability of a video wall system relies on the stability and lifecycle of the dedicated equipment.

[0003] Furthermore, traditional video wall systems are often tied to current hardware designs and lack flexibility. For example, to adjust the display range and presentation quality, technicians must manually adjust the number of screens in the video wall and reconfigure the content and resolution of each screen, making rapid adaptive adjustments impossible. Furthermore, content is stored in the terminal device's memory rather than in a dedicated device. Therefore, when updates are needed, technicians must manually update the content on the terminal device.

[0004] Furthermore, traditional video wall systems can only play multimedia resources unilaterally and lack interactive elements. Although there have been some related technical solutions in the past, there is still room for improvement.

[0005] Summary of the Invention

[0006] An object of the present invention is to provide a display method, electronic device, and display system based on entity association, so as to provide a flexible hardware and software display association architecture.

[0007] To achieve the above-mentioned objectives, one aspect of the present invention provides a display method based on entity association, which is applied to a server end of a display system. The display method includes: providing an association interface, which displays a group device pool and a projector pool; receiving a first control command to select a collaboration end of the group device pool, so that the association interface displays a preview window of the collaboration end, and the preview window corresponds to a window entity of a display of the collaboration end; receiving a second control command to select a projector of the projector pool; associating the window entity of the collaboration end with a projector entity of the projector; and controlling the display to prepare to display at least one slide based on data of the window entity and the projector entity.

[0008] To achieve the above objective, one aspect of the present invention provides an electronic device, comprising: a processor and a memory, wherein the memory is configured to store instructions, the processor is configured to execute instructions, and the display method described above is compiled into the instructions.

[0009] To achieve the above-mentioned purpose, another aspect of the present invention provides a display system, comprising: a server end and at least zero collaborative ends, wherein an electronic device as described above is configured as the server end; when the display system includes zero collaborative ends, an electronic device as described above is configured as the server end and the collaborative end; when the display system includes multiple collaborative ends, zero or one of the multiple collaborative ends is configured as an electronic device as described above.

[0010] The display method, electronic device, and display system based on entity association of the present invention can be applied to various TV wall hardware architectures, realize the needs of rapid construction and replacement of hardware and content, and achieve the technical effect of significantly reducing the time cost of TV wall system construction and improving usage efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] FIG1 is a schematic diagram of a display system according to an embodiment of the present invention.

[0012] FIG2 is a schematic diagram of an association interface according to an embodiment of the present invention.

[0013] FIG3 is an entity association diagram according to an embodiment of the present invention.

[0014] FIG4 is a schematic diagram showing the relationship between a window and a projector according to an embodiment of the present invention.

[0015] FIG5 is a flowchart of slide editing according to an embodiment of the present invention.

[0016] FIG6 is a schematic diagram of a slide editor according to an embodiment of the present invention.

[0017] FIG7 is a schematic diagram of a first implementation scheme of a display system according to an embodiment of the present invention.

[0018] FIG8 is a schematic diagram of a second implementation scheme of the display system according to an embodiment of the present invention.

[0019] FIG9 is a schematic diagram of a third implementation scheme of the display system according to an embodiment of the present invention.

[0020] FIG10 is a schematic diagram of a fourth implementation scheme of the display system according to an embodiment of the present invention.

[0021] FIG11 is a schematic diagram of a fifth implementation scheme of the display system according to an embodiment of the present invention.

[0022] FIG12 is a schematic diagram of a sixth implementation scheme of the display system according to an embodiment of the present invention.

[0023] FIG13 is a schematic diagram of a seventh implementation scheme of the display system according to an embodiment of the present invention.

[0024] FIG14 is a schematic diagram of an eighth implementation scheme of the display system according to an embodiment of the present invention.

[0025] FIG15 is a schematic diagram of a ninth implementation scheme of the display system according to an embodiment of the present invention.

[0026] FIG16 is a schematic diagram of a tenth implementation scheme of the display system according to an embodiment of the present invention.

[0027] FIG17 is a flow chart of a display method according to an embodiment of the present invention.

[0028] Description of reference numerals: 10a, 71, 81a, 81b, 81c, 91a, 91b, 91c, 91d, 91e, 91f, 101a, 101b, 101c, 111a, 111b, 111c, 111d, 111e, 111f, 121a, 121b, 123A, 123B, 123C, 123D, 131a, 131b, 133A, 133B, 133C, 133D, 141a, 141b, 143A, 143B, 143C, 143D, 151, 153A, 153B, 153C, 161, 163: electronic device 10a': electronic device 10b to be used, 72, 83, 103, 124A, 124B, 124C, 124D, 134A, 134B, 134C, 134D, 144A, 144B, 144C, 144D: Display 10c, 82, 92, 102, 112, 122, 132, 142, 152, 162: Network communicator 101: Server 102: Collaboration 18: Window layout 20: Association interface 21: Standby device pool 22: Workgroup menu 23: Add control 24: Remove control 25: Preview window 251: Member number module 252: Window layout module 721, 831, 93A, 93B, 93C, 93D, 103A, 103B, 103C, 103D, 113SA1, 113SA2, 113SA3, 113SA4, 113SB, 113SC, 113SD, 124A1, 124B1, 124C1, 124D1, 134A1, 134A2, 134A3, 134A4, 134B1, 134C1, 134D1, 144A1, 144B1, 144C1, 144D1, 154A, 154B, 154C, 164A, 164B, 164C: Window 26: Group device pool 27: Program menu 28: Projector pool 29: Device search engine 30, 40: Association example 31: Work group entity 32: Device entity 33: Window entity 3 4: Program Entity 35: Projector Entity 36: Slide Entity 50: Example of Slide Editing Process 60: Slide Editing Area 61: Static Component 62: Interactive Component 63: Menu Parameter 64: Action Parameter 10, 70, 80, 90, 100, 110, 120, 130, 140, 150, 160: Display System 93, 113, 154, 164: Multi-Screen Assembly System 155A, 155C, 165A, 165C: Interactive Component 170: Example of Display Method E1-E3, S1-S10, T1-T4: Step U: Entity U1: Entity Name U2: Entity Identifier U3: Attribute DETAILED DESCRIPTION

[0029] In order to make the above and other objects, features and advantages of the present invention more obvious and easy to understand, the preferred embodiments of the present invention will be specifically cited below and described in detail with reference to the accompanying drawings.

[0030] In terms of hardware configuration, Figure 1 is a schematic diagram of a display system according to an embodiment of the present invention, and the display system 10 includes at least one electronic device 10a. The electronic device 10a can be a host computer with image processing and communication capabilities. The electronic device 10a includes a processor, a memory, a multimedia interface, a communication interface, and a user interface, wherein the memory can store program code to instruct the processor to execute a specific program, such as one or more steps in the display method. Each electronic device 10a can be connected to a display 10b via a multimedia interface, such as a high-definition multimedia interface (HDMI) or a digital video interface (DisplayPort, DP), but is not limited thereto. In one embodiment, the electronic device 10a and the display 10b are integrated into a single device, such as a laptop computer, a tablet computer, a smart TV, etc. In one embodiment, multiple electronic devices 10a are connected to a network communicator (e.g., an Ethernet hub or wireless router) 10c via a wired or wireless network. The communication interface supports the Transmission Control Protocol / Internet Protocol (TCP / IP) suite for mutual communication. Thus, the network communicator 10c and the multiple electronic devices 10a form a local area network (LAN).

[0031] In terms of software configuration, each electronic device 10a is installed with an application program to be configured as a server (or host) or a collaborative terminal (or client). In one embodiment, the display system 10 includes only one server 101, and the server 101 can have the function of a collaborative terminal 102 to play two roles at the same time; in another embodiment, the display system 10 includes a server 101 and at least one collaborative terminal 102, and the collaborative terminal 102 does not have the function of a server 101. In other words, when there is already a server 101 in the display system 10, other electronic devices 10a can only be configured as collaborative terminals 102, and the display system 10 may include zero or more collaborative terminals 102. In operation, a server 101 and several collaborative terminals 102 are connected to a network communicator (such as a router, for example) 10c using the TCP / IP protocol, and communicate after the network communicator 10c assigns an IP address. Therefore, when the server 101 receives a control command from the user, it responds to the control command by sending a communication packet to the plurality of cooperating terminals 102, which in turn controls the plurality of displays 10b to play the designated multimedia content. As shown in FIG1 , a window arrangement 18 (using a matrix arrangement as an example) is composed of audio and video content displayed on four displays 10b, numbered 1 to 4.

[0032] Figure 2 is a schematic diagram of an association interface according to an embodiment of the present invention. The association interface 20 can be presented on the display 10b of the server 101 for the user to input commands and view information. The association interface 20 includes a standby device pool 21, a work group menu 22, a group device pool 26, a program menu 27, and a projector pool 28. The standby device pool 21 is used to display at least one standby electronic device 10a' and related information thereof, such as a representative pattern, a machine code and / or a network address of each standby electronic device 10a', but not limited thereto. In actual use, in the display system 10 of Figure 1, only a single host 10a is configured to start with the server 101, and the remaining hosts 10a are configured to start with the collaboration terminal 102. The collaboration terminal 102 can initiate registration with the server 101. In a registration operation, the collaboration end 102 sends a registration request to the server end 101; and after the server end 101 accepts the registration request, it sets a device entity of the collaboration end 102, wherein the device entity includes a device entity id and at least one attribute (as shown in FIG3). Accordingly, the registered collaboration end 102 becomes a standby electronic device 10a' and is displayed in the standby device pool 21. Then, in a window creation operation, the server end 101 sets a window entity of the display 10b of the standby electronic device 10a'; and associates the device entity id with a host identifier (host_id) attribute of the window entity, wherein the window entity includes a window entity id and at least one attribute (as shown in FIG3).

[0033] The workgroup menu 22 is, for example, a drop-down menu for the user to enter a control command to select a workgroup, such as "Workgroup 1." During a group creation operation, the server 101 receives a workgroup name (e.g., "Workgroup 1") entered by the user; sets a workgroup entity for the workgroup, wherein the workgroup entity includes a workgroup entity ID and at least one attribute (as shown in FIG. 3 ); and adds the workgroup name to the workgroup menu 22.

[0034] In the embodiment of FIG. 2 , the group device pool 26 corresponding to workgroup 1 includes three collaborating terminals 102 (i.e., PC001, PC005, and PC007). One of the three collaborating terminals 102 can also function as the server terminal 101 to execute and display the association interface 20. Optionally, the association interface 20 also includes an add control 23 and a remove control 24. When a standby electronic device 10a' is selected in the standby device pool 21, the add control 23 is pressed by the user to add the standby electronic device 10a' to the group device pool 26. Alternatively, the server terminal 101 can receive a drag command to add the standby electronic device 10a' to the group device pool 26. On the other hand, when the server terminal 101 receives a control command selecting a collaborating terminal 102 in the group device pool 26, the remove control 24 is pressed by the user to remove the collaborating terminal 102 from the group device pool 26. Alternatively, the user can drag the collaborating terminal 102 from the group device pool 26 to the standby device pool 21. In this way, the association interface 20 can provide a visual identification effect to the user by virtue of the electronic device (i.e., the collaboration terminal 102) being located in the standby device pool 21 or the group device pool 26. In a group association operation, when the standby electronic device 10a' is selected, its device entity id is obtained; if the device entity id is not associated with any work group entity, the work group entity id is obtained; and the work group entity id is associated with zero or more attributes of the device entity (as shown in FIG. 3 ). Accordingly, the collaboration terminal 102 added to the group device pool 26 can monitor communication packets from the server 101. If the device entity id is associated with a work group entity, the group association operation is canceled.

[0035] Optionally, as shown in FIG2 , the standby device pool 21 and the group device pool 26 display device information such as a representative image, connection status (e.g., online or offline), machine code, and / or network address of the included electronic devices, allowing the user to determine the source and physical location of the electronic devices based on this information. Optionally, the association interface 20 also includes a device search tool 29 , into which the user can enter device information to search for the desired electronic device.

[0036] For example, as shown in FIG2 , the association interface 20 further includes a preview window 25, which is used to display the screen currently being played by a selected electronic device (e.g., the server 101 "PC001") for the user to watch. The association interface 20 further includes a member number module 251 and a window layout module 252. The member number module 251 is disposed between the preview window 25 and the group device pool 26, and is used to receive user input to set the maximum number of members, and calculate the number of devices in the group device pool 26 as the current number of members. In the embodiment of FIG2 , the maximum number of members of "Work Group 1" is four, and the current number of members is three. The window layout module 252 is disposed between the preview window 25 and the group device pool 26, and is used to receive user input to set the window layout (e.g., the window layout 18 shown in FIG1 ). In a layout editing operation, user input is received to select at least one device entity; at least one device entity ID is read; at least one attribute of at least one window entity ID associated with the at least one device entity ID is read; user input is received to adjust at least one attribute of the window entity ID (e.g., the scale and position of at least one window); and the adjusted data of the at least one attribute of the at least one window entity ID is written to a window layout attribute of the at least one device entity. In actual application, the user may input control commands to split, merge, or adjust the scale and position of multiple sub-windows, where one sub-window corresponds to the display 10b of a collaboration terminal 102.

[0037] For example, as shown in FIG2 , program menu 27 is a drop-down menu for a user to enter a control command to select a program, such as "Program 1." During a program creation operation, server 101 receives a program name (e.g., "Program 1") entered by the user; sets a program entity, wherein the program entity includes a program entity ID and at least one attribute (as shown in FIG3 ); and associates the workgroup entity ID with the program entity ID.

[0038] For example, as shown in FIG2 , the projector pool 28 includes a plurality of media (e.g., “Projector 1,” “Projector 2,” and “Projector 3”). In a media creation operation, a user inputs a control command to select a program entity (e.g., “Program 1”); the user inputs a projector name (e.g., “Projector 1”); the server 101 sets a projector entity; and associates the selected program entity id with zero or more attributes of the projector entity, wherein the projector entity includes a projector entity id and at least one attribute (as shown in FIG3 ). In a slide creation operation, a control command is received to select a program entity (e.g., “Program 1”); a key-in command is received to set a slide name (e.g., “Slide 1”); the server 101 sets a slide entity; and associates the selected program entity id with zero or more attributes of the slide entity, wherein the slide entity includes a slide entity id and at least one attribute (as shown in FIG3 ). In some embodiments, the key-in command is a command for entering data (e.g., text, numbers, or symbols) through a key-in operation or a voice input operation.

[0039] Figure 3 is an entity relationship diagram (ERD) according to an embodiment of the present invention. Figure 3 shows an example relationship 30 including a workgroup entity 31, a device entity 32, a window entity 33, a program entity 34, a projector entity 35, and a slide entity 36. Each entity (e.g., entities 31 through 36, as shown in U in Figure 3) includes an entity name (e.g., U1 in Figure 3), an entity identifier (id is underlined, e.g., U2 in Figure 3), and at least one attribute (e.g., U3 in Figure 3). The entity identifier is a primary key (PK) of the entity, and at least one attribute is a foreign key (FK) of the entity. For example, workgroup entity 31 includes an entity identifier (id) and attributes such as a program id (show_id), a group name (name), a host name (name_host), and a location (locale). The workgroup entity 31 can be created through the above-described group creation operation.

[0040] The device entity 32 includes an entity identifier (id) and attributes such as a group identifier (group_id), a machine identifier (machine_id), a device name (name), a device nickname (nickname), communication interfaces (interfaces), and a screen layout (screen_layout). Through the aforementioned registration process, the device entity 32 is established, making the registered collaboration terminal 102 a standby electronic device 10a' and displayed in the standby device pool 21.

[0041] The window entity 33 includes an entity identifier (id) and attributes such as a host identifier (host_id), a projector identifier (projector_id), a window sequence number (seq), and a window name (name). Through the aforementioned registration process, the window entity 33 is created and the id of the device entity 31 is associated with the host identifier (host_id) attribute of the window entity 33. Then, through the aforementioned layout editing process, attributes such as the projector identifier (projector_id), window sequence number (seq), and window name (name) of the window entity 33 are set, as well as the window layout (screen_layout) attribute of the device entity 32.

[0042] The program entity 34 includes an entity identifier (id) and attributes such as program name, cover identifier (cover_id), default resolution (default_resolution), and notes. Through the above-mentioned program creation operation, the program entity 34 can be created and the work group entity 31 can be associated with the program entity 34.

[0043] The projector entity 35 includes an entity identifier (id) and attributes such as a program identifier (show_id), a projector sequence number (seq), a projector name (name), and projector notes (notes). By creating a mediator as described above, the projector entity 35 can be created and the selected program entity id can be associated with zero or more attributes of the projector entity 35.

[0044] The slideshow entity 36 includes an entity identifier (id) and attributes such as a show identifier (show_id), a slide sequence number (seq), a slide name (name), a slide resolution (resolution), a canvas (canvas), widgets (widgets), and slide notes (notes). Through the above-described slideshow creation operation, the slideshow entity 36 can be created and the selected show entity id can be associated with zero or more attributes of the slideshow entity 36.

[0045] It is noteworthy that the association interface 20 is designed based on the association example 30. The association interface 20 provides intuitive and guided operations, allowing users to establish associations between multiple entities through the association interface 20, thereby establishing an association between the electronic device 10a, the display 10b, and the multimedia content. In addition, traditional video wall systems are usually bound to the current hardware design and lack the flexibility to change. In contrast, the association interface 20 of the present invention allows users to establish associations between the electronic device 10a (i.e., the device entity 32 and the workgroup entity 31), the display 10b (i.e., the window entity 33), and the multimedia content (i.e., the program entity 34, the projector entity 35, and the slide entity 36), thereby providing flexibility to change.

[0046] FIG4 is a schematic diagram illustrating the association of a window with a projector according to an embodiment of the present invention. FIG4 provides an example 40 of associating a window with a projector. The process of association example 40 includes: step T1, selecting a workgroup (e.g., workgroup 1) to display all electronic devices in the workgroup (e.g., PC001, PC005, and PC007); step T2, selecting a program (e.g., program 1) to automatically display all projectors in the program (e.g., projectors 1, 2, and 3); step T3, selecting a window (e.g., preview window 25) of an electronic device (e.g., PC001) from the workgroup; and step T4, associating the window with a projector (e.g., projector 2), for example, by selecting the projector ID. In the embodiment of FIG4 , assuming the window associated with electronic device PC001 is named "Window 1," when projector 2 is associated with Window 1, projector 2 displays an association symbol and association information, PC001@Window 1. Since projectors 1 and 3 have not yet been associated with any electronic device, no association symbol or association information is displayed.

[0047] Referring again to FIG. 3 , through the process of the association example 40 described above, at least one attribute of the window entity 33 can be associated with the ID of a projector entity 35, and the at least one attribute of the window entity 33 (e.g., the host identifier host_id is PC001, the window sequence number seq is 1, and the window name is Window 1) can be displayed on the association interface 20. Since electronic devices PC005 and PC007 have not yet established an association with any projector entity, the window entities 33 of electronic devices PC005 and PC007 are associated with no projector entity 35 IDs.

[0048] Figure 5 is a flowchart of slide editing according to an embodiment of the present invention. Figure 5 provides an example slide editing process 50. This process 50 can be performed by configuring a slide editing module on the server 101. The process includes: Step E1, obtaining slide parameters, such as first selecting a program, obtaining the program ID, and then obtaining the slide pool ID. Next, generating / editing a slide, and then obtaining the slide ID. Step E2, generating projector-compatible components, such as generating components (static components such as images, text boxes, or videos), configuring interactive components (action controls such as buttons), and then obtaining all projectors bound to the program ID (show_id). A projector is selected from these components as the content for setting the action. Step E3 generates a control command. For example, the action to be executed is first selected, such as but not limited to "jump to slide," "standby screen," or "display web page." If the action is "jump to slide," a determination is made as to whether all slides bound to the program number have been obtained. If so, the slide number is written into the execution action. If not (or the action is "standby screen"), a standby keyword (such as "STANDBY") is written into the execution action. If the action is "display web page," a URL is written into the execution action. Subsequently, the program number, slide number, and corresponding action are written into a control instruction packet to serve as the control command.

[0049] For example, Figure 6 is a schematic diagram of a slide editor according to an embodiment of the present invention. Within a slide editing area 60, the user can add at least one static element 61 to display an image, text, or video. The user can also add at least one interactive element 62, for example, to further configure menu parameters 63 and action parameters 64. For example, a trigger button can be configured to send a control command upon triggering (clicking) the button.

[0050] For example, in one application example, the display system of an embodiment of the present invention receives a control command, and the server end assigns a task to the collaborative end to display content in at least one window (split or non-split window). The process can play a specific screen (such as a standby screen or a rendering screen) according to the connection status or the assignment status. For example, when the connection is normal, before the collaborative end accepts the assigned task, the collaborative end associated window first displays the standby screen. When the collaborative end receives the task assigned by the server end (such as displaying a slide screen), the collaborative end drives the display to render in at least one window to form a task-specified screen. Subsequently, the collaborative end monitors the control packet from the server end. If the control packet is not received, the window maintains the previous screen (such as the task-specified screen). If the collaborative end receives the task assigned by the server end again, the collaborative end drives the display to render in at least one window to form another task-specified screen.

[0051] Furthermore, in actual use, the display system can be configured into a variety of configurations, such as for forming a video wall, a three-dimensional space display system for a museum, food and beverage advertisements for a fast food restaurant, a touch-screen interactive wall for an aquarium, a display system for medical images (such as MRI), and a field control image display system for an audio-visual performance venue, etc. The following examples are provided, but are not limited to these.

[0052] Figure 7 is a schematic diagram of a first implementation of a display system according to an embodiment of the present invention, which can be used as a basic video wall application, including single-screen systems and single-host systems. For example, a display system 70 includes an electronic device 71 and a display 72. Electronic device 71 is electrically connected to display 72, which is configured with a window 721. Electronic device 71 is configured not only as a server but also as a collaborating client. In this application, electronic device 71 first starts as a server to store display data. It is then assigned to become a collaborating client, displaying content for the user via window 721.

[0053] FIG8 is a schematic diagram of a second implementation scheme of a display system according to an embodiment of the present invention, which can be used as an advanced video wall application A, comprising a single-screen system and a single-host system with a central console. For example, a display system 80 includes several electronic devices 81a, 81b, and 81c, a network communicator 82, and a display 83. The electronic devices 81a, 81b, and 81c communicate with each other via the network communicator 82. The electronic device 81a is configured as a server, the electronic device 81b is configured as a central console, which can be a mobile device with Wi-Fi functionality, and the electronic device 81c is configured as a collaborating terminal. The electronic device 81c is connected to a display 83, which is configured with a window 831. In this application, a user can set display-related parameters via the electronic device 81b, and then have the electronic device 81a assign the electronic device 81c to play the display content, so that the content displayed for the user to view is displayed via the window 831.

[0054] Figure 9 is a schematic diagram of a third implementation of a display system according to an embodiment of the present invention. This system can be used as an advanced video wall application B, comprising a multi-screen assembly system with a central console and a multi-host system. For example, a display system 90 includes several electronic devices 91a, 91b, 91c, 91d, 91e, and 91f, a network communicator 92, and a multi-screen assembly system 93. Multi-screen assembly system 93 is formed by multiple closely spaced displays. Electronic devices 91a, 91b, 91c, 91d, 91e, and 91f communicate with each other via a network communicator 92. Electronic device 91a is configured as a server, electronic device 91b is configured as a central console, which can be a mobile device with Wi-Fi capabilities, and electronic devices 91c, 91d, 91e, and 91f are configured as collaborative terminals (e.g., numbered A, B, C, and D). Electronic devices 91c, 91d, 91e, and 91f are connected to multiple displays of a multi-screen assembly system 93, which has windows 93A, 93B, 93C, and 93D configured on the multiple displays. In this application, a user can set display-related parameters via electronic device 91b, and then have electronic device 91a assign electronic devices 91c, 91d, 91e, and / or 91f to play and display content, so that content is displayed for the user via windows 93A, 93B, 93C, and / or 93D.

[0055] Figure 10 is a schematic diagram of a fourth implementation scheme of a display system according to an embodiment of the present invention, which can be used as a video wall advanced application C, a single-screen image splitting system with a central console. For example, a display system 100 includes a plurality of electronic devices 101a, 101b, and 101c, a network communicator 102, and a display 103. The electronic devices 101a, 101b, and 101c communicate with each other via the network communicator 102. The electronic device 101a is configured as a server, the electronic device 101b is configured as a central console, which can be a mobile device with Wi-Fi capabilities, and the electronic device 101c is configured as a collaborating terminal. The electronic device 101c is connected to the display 103, which is configured with a plurality of split windows 103A, 103B, 103C, and 103D. In this application, the user can set display-related parameters via electronic device 101b, and then let electronic device 101a assign electronic device 101c to play display content, so that content for the user to watch is displayed via windows 103A, 103B, 103C and / or 103D.

[0056] FIG11 is a schematic diagram of a fifth implementation scheme of a display system according to an embodiment of the present invention, which can be used as an advanced video wall application D, comprising a multi-screen assembly system with a central console and a multi-host hybrid single-screen image splitting system. For example, a display system 110 includes a plurality of electronic devices 111a, 111b, 111c, 111d, 111e, and 111f, a network communicator 112, and a multi-screen assembly system 113. Multi-screen assembly system 113 is formed by a plurality of closely spaced displays. For example, with four displays, one display in multi-screen assembly system 113 is configured with a plurality of split windows 113SA1, 113SA2, 113SA3, and 113SA4. The remaining three displays in multi-screen assembly system 113 are each configured with a window 113SB, 113SC, and 113SD. Electronic devices 111a, 111b, 111c, 111d, 111e, and 111f communicate with each other via a network communicator 112. Electronic device 111a is configured as a server terminal, electronic device 111b is configured as a central console, which can be a mobile device with Wi-Fi function, and electronic devices 111c, 111d, 111e, and 111f are configured as collaborative terminals (for example, numbered A, D, C, and B). Electronic devices 111c, 111d, 111e, and 111f are connected to the four displays of the multi-screen assembly system 113. In this application, a user can set display-related parameters via electronic device 111b, which then instructs electronic device 111a to assign electronic devices 111c, 111d, 111e, and / or 11f to play and display content, thereby displaying content for the user via split windows 113SA1, 113SA2, 113SA3, 113SA4, and / or non-split windows 113SB, 113SC, and 113SD. In one application example, display system 110 can be configured as a broadcast director system, using several split windows to monitor multiple video sources. The user can also decide to push one video source to a non-split window (e.g., 113SD) as a live broadcast.

[0057] FIG12 is a schematic diagram of a sixth implementation scheme of a display system according to an embodiment of the present invention, which can be used as an information signage application A, and has a multi-screen distributed system and a multi-host system with a central console, so as to be applied to advertisement / menu / price tag switching screens in exhibition halls, convenience stores, and fast food restaurants. For example, a display system 120 includes several electronic devices 121a, 121b and a network communicator 122. The display system 120 also includes several electronic devices 123A, 123B, 123C, 123D and several displays 124A, 124B, 124C, 124D. The electronic devices 121a, 121b, 123A, 123B, 123C, 123D communicate with each other via the network communicator 122. The electronic device 121a is configured as a server, and the electronic device 121b is configured as a central console. The central console can be a mobile device with Wi-Fi function. The electronic devices 123A, 123B, 123C, 123D communicate with each other via the network communicator 122. 123B, 123C, and 123D are configured as collaborative ends (for example, numbered A, B, C, and D), and the electronic devices 123A, 123B, 123C, and 123D are connected to several displays 124A, 124B, 124C, and 124D. The displays 124A, 124B, 124C, and 124D together form a multi-screen distributed system. For example, the displays 124A, 124B, 124C, and 124D are separated from each other (not close to each other), and the several displays 124A, 124B, 124C, and 124D are respectively configured with a single window 124A1, 124B1, 124C1, and 124D1. In this application, the user can set display-related parameters via electronic device 121b, and then let electronic device 121a assign electronic devices 123A, 123B, 123C and / or 123D to play and display content, so that content for the user to watch is displayed via windows 124A1, 124B1, 124C1 and / or 124D1.

[0058] FIG13 is a schematic diagram of the seventh implementation scheme of the display system of an embodiment of the present invention, which can be used as an information signboard application B, with a multi-screen distributed system with a central console and a multi-host hybrid single-screen screen splitting system, so as to be applied to the advertisement / menu / price tag switching screen in exhibition halls, convenience stores, and fast food restaurants. For example, a display system 130 includes several electronic devices 131a, 131b and a network communicator 132. The display system 130 also includes several electronic devices 133A, 133B, 133C, 133D and several displays 134A, 134B, 134C, 134D. The electronic devices 131a, 131b, 133A, 133B, 133C, 133D communicate with each other via the network communicator 132. The electronic device 131a is configured as a server end, and the electronic device 131b is configured as a central console (which is a collaborative end). The central console can be a mobile device with Wi-Fi function. Devices 133A, 133B, 133C, and 133D are configured as collaborative ends (for example, numbered A, B, C, and D). Electronic devices 133A, 133B, 133C, and 133D are connected to several displays 134A, 134B, 134C, and 134D. Displays 134A, 134B, 134C, and 134D together form a multi-screen distributed system. Display 134A is configured with several split windows 134A1, 134A2, 134A3, and 134A4, and displays 134B, 134C, and 134D are respectively configured with single windows 134B1, 134C1, and 134D1. In this application, the user can set display-related parameters through the electronic device 131b, and then let the electronic device 131a assign the electronic devices 133A, 133B, 133C and / or 133D to play and display content, so as to display content for the user to watch through the split windows 134A1, 134A2, 134A3, 134A4 and / or non-split windows 134B1, 134C1, 134D1.

[0059] FIG14 is a schematic diagram of an eighth implementation scheme of the display system of an embodiment of the present invention, which can be used as a touch interactive application A, having a multi-screen distributed system and a multi-host system with a central console, so as to be applied to a restaurant ordering system (for example, the kitchen pushes a limited-time dynamic display of the current meal to the table display, and the user uses the touch panel to place an order) and a teaching quick-answer system (for example, the teacher pushes a teaching screen with interactive buttons to the students, and allows the students to click the buttons to answer). For example, a display system 140 includes several electronic devices 141a, 141b and a network communicator 142. The display system 140 also includes several electronic devices 143A, 143B, 143C, 143D and several displays 144A, 144B, 144C, 144D (such as a touch display or a combination of a display and a stylus). The electronic devices 141a, 141b, 143A, 143B, 143C, 143D communicate with each other via the network communicator 142. The electronic device 141a is configured as a server, the electronic device 141b is configured as a central console, and the central console The platform can be a mobile device with Wi-Fi function. The electronic devices 143A, 143B, 143C, and 143D are configured as collaborative terminals (for example, numbered A, B, C, and D). The electronic devices 143A, 143B, 143C, and 143D are connected to multiple displays 144A, 144B, 144C, and 144D. The displays 144A, 144B, 144C, and 144D together form a multi-screen distributed system. The multiple displays 144A, 144B, 144C, and 144D are respectively configured with a single window 144A1, 144B1, 144C1, and 144D1. In this application, the user can set display-related parameters through the electronic device 141b, and then let the electronic device 141a assign the electronic devices 143A, 143B, 143C and / or 143D to play the display content, so that the content for the user to watch can be displayed through windows 144A1, 144B1, 144C1 and / or 144D1, so that the user can click on the interactive elements according to the watched content to conduct an interactive process, such as ordering food or answering questions.

[0060] FIG15 is a schematic diagram of a ninth implementation scheme of the display system according to an embodiment of the present invention, which can be used as a touch interactive application B, a touch-sensitive multi-screen assembly system without a central console, and a multi-host system for application in interactive exhibitions, such as interactive exhibitions of marine life at science museums and interactive exhibitions of digital pictures at art galleries. For example, a display system 150 includes an electronic device 151 and a network communicator 152. The display system 150 also includes several electronic devices 153A, 153B, 153C and a multi-screen assembly system 154. The multi-screen assembly system 154 includes several displays (such as a touch display or a combination of a display and a stylus). The electronic devices 151, 153A, 153B, 153C communicate with each other via the network communicator 152. The electronic device 151 is configured as a server end, and the electronic devices 153A, 153B, 153C are configured as collaborative ends (for example, numbered A, B, C). The electronic devices 153A, 153B, 153C are connected to the several displays of the multi-screen assembly system 154. The several displays of the multi-screen assembly system 154 are respectively configured with a single window 154A, 154B, 154C. In this application, the user can set display-related parameters through the electronic device 151, and then assign the electronic devices 153A, 153B and / or 153C to play the display content, so as to display the content for the user to watch through windows 154A, 154B and / or 154C. For example, windows 154A, 154B and 154C jointly display images of marine life, and windows 154A and 154C are respectively provided with interactive elements 155A and 155C, so that the user can click on the interactive elements according to the content being watched to conduct an interactive process, such as answering questions in a fast-paced manner.

[0061] FIG16 is a schematic diagram of a tenth implementation scheme of a display system according to an embodiment of the present invention. This system can be used as a touch interactive application C, a console-less touch-sensitive multi-screen assembly system and a single host system for interactive exhibitions, such as interactive marine life exhibitions at science museums and interactive digital art exhibitions at art galleries. For example, a display system 160 includes an electronic device 161 and a network communicator 162. The display system 160 also includes an electronic device 163 and a multi-screen assembly system 164. The multi-screen assembly system 164 includes multiple displays (such as touch displays or a combination of a display and a stylus). Electronic devices 161 and 163 communicate with each other via the network communicator 162. Electronic device 161 is configured as a server end, and electronic device 163 is configured as a collaborator end. Electronic device 163 is connected to multiple displays of the multi-screen assembly system 164. Each of the multiple displays of the multi-screen assembly system 164 is configured with a single window 164A, 164B, and 164C. In this application, the user can set display-related parameters through the electronic device 161, and then assign the electronic device 163 to play the display content so that the content for the user to watch is displayed through windows 164A, 164B and / or 164C. For example, windows 164A, 164B and 164C jointly display images of marine life, and windows 164A and 164C are respectively provided with interactive elements 165A and 165C so that the user can click on the interactive elements according to the content being watched to conduct an interactive process, such as answering a question quickly.

[0062] On the one hand, an embodiment of the present invention proposes a display method based on entity association. Figure 17 is a flow chart of the display method of an embodiment of the present invention. A display method example 170 is applied to a display system (such as multiple embodiments of the above-mentioned display system), and the display system includes a server end. The display method includes: steps S1 to S10.

[0063] As shown in Figure 17, in step S1, the server provides an association interface; in step S2, registration is performed; in step S3, a window is created; in step S4, a group is created; in step S5, group association is performed; in step S6, layout editing is performed, and then step S10 can be performed. After step S1, step S7 can be performed to create a program; in step S8, a projector is created; in step S9, a slide is created; and in step S10, the projector and window are associated.

[0064] Specifically, as shown in Figures 1, 2, and 17, in step S1, an association interface 20 is provided, wherein association interface 20 displays a standby device pool 21, a work group menu 22, a group device pool 26, a program menu 27, and a projector pool 28. In step S2, a registration operation includes: receiving a registration request from an electronic device 10a; upon accepting the registration request, configuring a device entity 32 of electronic device 10a to become a standby electronic device 10a', wherein device entity 32 includes a device entity identifier and at least one attribute; and adding the standby electronic device 10a' to a standby device pool 21 of association interface 20.

[0065] As shown in Figures 2-3 and 17, in step S3, creating a window includes: setting a window entity 33 on a display 10b of the standby electronic device 10a', wherein the window entity 33 includes a window entity identifier and at least one attribute; and associating the device entity identifier with a device identifier of at least one attribute of the window entity 33. In step S4, creating a group includes: receiving an input command to set a workgroup name; setting a workgroup entity 31 for the workgroup, wherein the workgroup entity 31 includes a workgroup entity identifier and at least one attribute; and adding the workgroup name to a workgroup menu 22 of the association interface 20.

[0066] As shown in FIG2 to FIG3 and FIG17, in step S5, the group association operation includes: receiving a control command to select a work group entity 31 in the work group menu 22; receiving a control command to select a standby electronic device 10a' and obtain a device entity identifier of the standby electronic device 10a'; if the device entity identifier is not associated with any work group entity 31, obtaining the work group entity identifier; associating the work group entity identifier with zero or more attributes of a device entity 32 of the standby electronic device 10a'; and adding the standby electronic device 10a' to the group device pool 26 of the association interface 20, making the standby electronic device 10a' a collaboration end 102. In step S5, the group association operation also includes receiving a control command to obtain the device entity identifier of the standby electronic device 10a' through an add control 23; or receiving a control command corresponding to a drag operation to obtain the device entity identifier of the standby electronic device 10a'. In step S5, the group association operation further includes receiving a control command to remove the collaboration terminal 102 from the group device pool 26. This includes: receiving a control command via a removal control 24 to remove the collaboration terminal 102 from the group device pool 26, thereby making the collaboration terminal 102 a standby electronic device 10a'; or receiving a control command corresponding to a drag operation to remove the collaboration terminal 102 from the group device pool 26, thereby making the collaboration terminal 102 a standby electronic device 10a'. In step S5, the group association operation further includes canceling the group association operation if the device entity identifier is associated with a work group entity 31.

[0067] As shown in Figures 2-3 and 17, in step S6, arranging and editing operations includes: receiving at least one control command to select at least one device entity 32 of at least one collaboration terminal 102 in the group device pool 26; reading at least one device entity identifier of the at least one device entity 32; reading at least one window entity identifier and at least one attribute of at least one window entity 33 associated with the at least one device entity identifier; receiving a plurality of control commands to adjust at least one attribute of the at least one window entity 33; and writing the adjusted at least one attribute data to at least one window layout attribute of the at least one device entity 32. In step S7, creating a program operation includes: receiving a keystroke command to set a program title; setting a program entity 34 for the program title, wherein the program entity 34 includes a program entity identifier and at least one attribute; and adding the program title to a program menu 27 of the association interface 20.

[0068] As shown in Figures 2-3 and 17, in step S8, creating a projector operation includes: receiving a control command to select a program entity 34 in the program menu 27; receiving a key command to set a projector name; setting a projector entity 35 for the projector name, wherein the projector entity 35 includes a projector entity 35 identifier and at least one attribute; associating the program entity identifier of the program entity 34 with zero or at least one attribute of the projector entity 35; and adding the projector name to the projector pool 28 of the association interface 20. In step S9, creating a slide operation includes: receiving a control command to select a program entity 34 in the program menu 27; receiving a key command to set a slide name; setting a slide entity 36 for the slide name, wherein the slide entity 36 includes a slide entity identifier and at least one attribute; and associating the program entity identifier of the program entity 34 with zero or at least one attribute of the slide entity 36.

[0069] 4 , in step S10 , the window-projector association operation includes: receiving a control command to select a collaboration terminal 102 in the group device pool 26 , causing the association interface 20 to display a preview window 25 of the collaboration terminal 102, wherein the preview window 25 corresponds to a window entity 33 of a display 10b of the collaboration terminal 102; receiving a control command to select a projector in the projector pool 28; associating the window entity 33 of the collaboration terminal 102 with a projector entity 35 of the projector; and controlling the display 10b to prepare for displaying at least one slide based on data in the window entity 33 and the projector entity 35. It should be understood that once the association between the window entity 33 and the projector entity 35 is established, the electronic device 10a (i.e., the collaboration terminal 102) that has joined the group can monitor control packets and audio / video packets from the server 101, thereby controlling the display 10b to play at least one slide. When the program entity 34 associated with the projector entity 35 has not been associated with any slide entity 36, or the slide entity 36 has not created any slide, there is no slide for the display 10b to display.

[0070] It should be understood that steps S1 to S5 are used to establish associations between multiple entities related to the device (for example, establishing an association between a workgroup, an electronic device 10a and a display 10b), step S6 is used to set the display window layout, and steps S7 to S9 are used to establish associations between multiple entities related to the content (for example, establishing an association between a program, a projector, and a slide). Through step S10, the binding association between the device and the content can be set to adapt to various and changing TV wall hardware architectures. In addition, the user can use the mouse to click or drag operations as control commands, and type text as input commands through the keyboard; in some embodiments, the user can operate the association interface 20 through voice input, but those skilled in the art can choose an appropriate method to operate the association interface 20 according to actual needs.

[0071] Another embodiment of the present invention provides an electronic device comprising a processor and a memory, wherein the memory is configured to store instructions. When the processor is configured to execute the instructions, the display method described above is performed. For example, the electronic device is configured by software to function as a server or include both server and cooperating functions.

[0072] Another embodiment of the present invention provides a display system comprising a server terminal and at least zero collaborating terminals, wherein the aforementioned electronic device is configured as the server terminal. When the display system comprises zero collaborating terminals, the aforementioned electronic device is configured as both the server terminal and the collaborating terminal; when the display system comprises multiple collaborating terminals, zero or one of the multiple collaborating terminals is the aforementioned electronic device.

[0073] The display method, electronic device, and display system of the embodiments of the present invention provide a flexible hardware-association architecture and a flexible software-association architecture. The flexible hardware-association architecture enables rapid binding, registration, and collaboration, and provides a comprehensive management interface. In addition to multi-machine collaboration, it also provides a screen splitting function, allowing a single display to output multiple windows for playback. Based on these advantages, it can adapt to various and changing TV wall hardware architectures and implement quick-change functionality. If a collaboration terminal fails, simply replacing the collaboration terminal, installing the software, and registering it allows for rapid deployment of the intended functionality. The flexible software-association architecture allows for rapid content creation, management, and distribution, providing a simple method for associating and interacting with hardware to accommodate various display needs.

[0074] Therefore, the display method, electronic device, and display system of the embodiments of the present invention can be applied to various TV wall hardware architectures, and can achieve the needs of rapid construction and replacement of hardware and content, thereby achieving the technical effect of significantly reducing the time cost of TV wall system construction and improving usage efficiency.

[0075] Although the present invention has been disclosed with reference to preferred embodiments, anyone skilled in the art may make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention shall be determined by the claims.

Claims

1. A display method based on entity association, applied to a server of a display system, the display method comprising: providing an association interface, the association interface displaying a group device pool and a projector pool; receiving a first control command to select a cooperating terminal of the group device pool, causing the association interface to display a preview window of the cooperating terminal, the preview window corresponding to a window entity of a display of the cooperating terminal; receiving a second control command to select a projector in the projector pool; Associating the window entity of the collaboration terminal with a projector entity of the projector; as well as According to the data of the window entity and the projector entity, the display is controlled to prepare to display at least one slide.

2. The display method according to claim 1, further comprising performing a registration operation, comprising: receiving a registration request sent by an electronic device; After accepting the registration request, setting a device entity of the electronic device to make the electronic device a standby electronic device, wherein the device entity includes a device entity identification code and at least one attribute; and The standby electronic device is added to a standby device pool on the association interface. 3 . The display method of claim 2 , wherein the at least one attribute of the device entity comprises at least one of a group ID, a machine ID, a device name, a device nickname, a communication interface, and a window layout.

4. The display method according to claim 2, wherein after performing the registration operation, the display method further comprises performing a window creation operation, comprising: Setting a window entity of a display of the standby electronic device, wherein the window entity of the display of the standby electronic device includes a window entity identifier and at least one attribute; and The device entity identifier is associated with a server-side identifier of the at least one attribute of the window entity of the display of the standby electronic device. 5 . The display method as claimed in claim 4 , wherein the at least one attribute of the window entity comprises at least one of the server identification code, a projector identification code, a window serial number, and a window name.

6. The display method according to claim 1 , further comprising performing a group creation operation, comprising: receiving a first input command to set a workgroup name; Setting a workgroup entity of the workgroup, wherein the workgroup entity includes a workgroup entity identifier and at least one attribute; and The workgroup name is added to a workgroup menu on the association interface. 7 . The display method of claim 6 , wherein the at least one attribute of the work group entity comprises at least one of a program identifier, a group name, a server name, and a location.

8. The display method according to claim 6, wherein after the group creation operation, the display method further comprises performing a group association operation, comprising: receiving a third control command to select the workgroup entity in the workgroup menu; receiving a fourth control command to select a standby electronic device and obtain a device entity identification code of the standby electronic device; If the device entity ID is not associated with any workgroup entity, obtain the workgroup entity ID; Associating the workgroup entity identifier with zero or more attributes of a device entity of the standby electronic device; as well as The standby electronic device is added to the group device pool of the association interface, so that the standby electronic device becomes the cooperation terminal.

9. The display method according to claim 8, wherein the group association operation comprises: Receiving the fourth control command through an add control to obtain the device entity identification code of the standby electronic device; or The fourth control command corresponding to a drag operation is received to obtain the device entity identification code of the standby electronic device.

10. The display method of claim 8, wherein the group association operation comprises receiving a fifth control command to remove the collaboration terminal from the group device pool, comprising: receiving the fifth control command via a removal control to remove the collaboration terminal from the group device pool, so that the collaboration terminal becomes the standby electronic device; or The fifth control command corresponding to a drag operation is received to remove the cooperation terminal from the group device pool, so that the cooperation terminal becomes the standby electronic device.

11. The display method according to claim 8, wherein the group association operation comprises: If the device entity identifier is associated with a work group entity, the group association operation is canceled.

12. The display method according to claim 8, further comprising performing a layout editing operation after the group association operation, comprising: receiving at least one control command to select at least one device entity of at least one cooperating end in the group device pool; reading at least one device entity identification code of the at least one device entity; reading at least one window entity identifier and at least one attribute of at least one window entity associated with the at least one device entity identifier; receiving a plurality of control commands to adjust the at least one attribute of the at least one window entity; as well as The adjusted data of the at least one attribute of the at least one window entity is written into at least one window arrangement attribute of the at least one device entity.

13. The display method according to claim 1, further comprising performing a program creation operation, comprising: receiving a second input command to set a program name; Setting a program entity of the program name, wherein the program entity includes a program entity identifier and at least one attribute; and The program name is added to a program menu on the associated interface. 14 . The display method as claimed in claim 13 , wherein the at least one attribute of the program entity comprises at least one of the program name, a cover identification code, a default resolution, and a program annotation.

15. The display method according to claim 13, wherein after the program creation operation, the display method further comprises performing a projector creation operation, comprising: receiving a sixth control command to select the program entity in the program menu; receiving a third input command to set a projector name; Setting a projector entity of the projector name, wherein the projector entity includes a projector entity identification code and at least one attribute; Associating the program entity identifier of the program entity with zero attributes or the at least one attribute of the projector entity; and Add the projector name to the projector pool of the associated interface. 16 . The display method as claimed in claim 13 , wherein the at least one attribute of the projector entity comprises at least one of a program identification code, a projector serial number, a projector name, and a projector annotation.

17. The display method according to claim 15, wherein after the projector creation operation, the display method further comprises performing a slide creation operation, comprising: receiving a seventh control command to select the program entity in the program menu; receiving a fourth keystroke command to set a slide name; Setting a slide entity for the slide name, wherein the slide entity includes a slide entity identification code and at least one attribute; and The program entity identifier of the program entity is associated with zero attributes or the at least one attribute of the slide entity.

18. The display method of claim 17, wherein the at least one attribute of the slide entity comprises at least one of a program identification code, a slide serial number, the slide name, a slide resolution, a canvas, an interactive element, and a slide annotation; wherein the interactive element is configured to receive a trigger command to perform an action.

19. An electronic device comprising a processor and a memory, wherein the memory is configured to store instructions, the processor is configured to execute the instructions, and the display method according to any one of claims 1 to 18 is compiled into the instructions.

20. A display system comprising a server end and at least zero collaborative ends, wherein an electronic device as described in claim 19 is configured as the server end; when the display system comprises zero collaborative ends, an electronic device as described in claim 19 is configured as the server end and the collaborative end; when the display system comprises multiple collaborative ends, zero or one of the multiple collaborative ends is configured as an electronic device as described in claim 19.

Images