Information interaction system and method, electronic label and display equipment

Abstract

The invention provides an information interaction system and method, an electronic label and a display device, which are used for carrying out deep fusion on the electronic label and the display device, realizing direct interaction between the electronic label and the display device and providing more portable use experience. The system comprises an electronic label and a display device, communication connection is established between the electronic label and the display device, the display device determines image data, the image data comprises a pre-configured template image, and the template image is determined according to template data input by a user on the display device; the display device sends the image data to an electronic label, the electronic label comprises a display screen group, the display screen group comprises a plurality of display screens, and at least two display screens in the plurality of display screens are used for displaying different image data; and the electronic label receives the image data and displays the image data according to a display screen corresponding to the image data.

Description

Technical Field

[0001] The present disclosure relates to the field of intelligent conference technologies, and particularly relates to an information interaction system, method, electronic sign, and display device. Background Art

[0002] An electronic sign product is an electronic display device with information receiving and transmitting functions, which can replace traditional paper labels and is commonly used in different application scenarios such as smart retail, smart office, and smart transportation. For the conference and office scenario, common electronic sign products include conference nameplates, table cards, and workstation cards, etc.

[0003] Currently, common electronic sign management systems can all realize the production and distribution of display content. In the conference scenario, participant information is usually displayed through smart table cards. Currently, the functions of smart table cards are mostly interacted through local operations, cloud management systems, mobile phone mini-programs, and centralized control software. Summary of the Invention

[0004] The present disclosure provides an information interaction system, method, electronic sign, and display device for deeply integrating the electronic sign and the display device, realizing direct interaction between the electronic sign and the display device, and providing a more portable usage experience.

[0005] In a first aspect, an information interaction system provided by an embodiment of the present disclosure includes an electronic sign and a display device, and a communication connection is established between the electronic sign and the display device, where:

[0006] The display device determines image data, where the image data includes a pre-configured template image, and the template image is determined according to template data input by a user on the display device;

[0007] The display device sends the image data to the electronic sign, and the electronic sign includes a display screen group, and the display screen group includes multiple display screens, and at least two of the multiple display screens are used to display different image data;

[0008] The electronic sign receives the image data and displays the image data according to the display screen corresponding to the image data.

[0009] As an optional implementation manner, the display device is specifically configured to determine the template image in the following manner:

[0010] Receive handwritten template data input by a user on the template function interface of the handwriting software;

[0011] Recognize the template data according to the recognition algorithm of the handwriting software, and perform typesetting on the recognition result to generate a handwritten template;

[0012] The handwritten template is screenshoted to obtain a template image.

[0013] As an optional implementation manner, the image data further includes a video stream of a display screen of a display device; the system includes:

[0014] The display device records the display screen to obtain a video stream, and sends the video stream to the electronic sign;

[0015] The electronic sign displays the video stream through a display screen corresponding to the video stream.

[0016] As an optional implementation, the electronic sign is specifically used for:

[0017] Determining the size of the signage image based on the resolution of the received image data and the resolution of the display screen corresponding to the image data;

[0018] The image data is displayed on a display screen corresponding to the image data according to the size of the signage screen.

[0019] As an optional implementation, the image data further includes a video stream obtained by recording a video window image contained in the current screen in a video conferencing scenario; the electronic signage is specifically used for:

[0020] When there is one video window image, display one video window image; or,

[0021] When there are multiple video window images, multiple video window images or a video window image specified by the user are displayed.

[0022] As an optional implementation, the image data further includes a video stream obtained by recording multiple video window images contained in the current screen in a video conferencing scenario; the system includes:

[0023] The electronic signage sends the position information of the video window image specified by the user to the display device;

[0024] The display device extracts a corresponding target video window image from the plurality of video window images according to the received position information, and sends a video stream containing the target video window image to the electronic sign;

[0025] The electronic sign receives the video stream containing the target video window image and displays it through the corresponding display screen.

[0026] As an optional implementation, the electronic sign is specifically used for:

[0027] In response to a user's selection operation on multiple video window images displayed on an electronic sign, determine the position information of the video window image corresponding to the selection operation, and send the position information to the display device.

[0028] As an alternative implementation, the video stream further includes a video stream obtained by recording a PPT image in the current screen in the PPT scenario; the system includes:

[0029] The display device captures the current PPT image, and sends the captured current PPT image and the video stream to the electronic sign, where the display level of the current PPT image is at a higher level than that of the video stream;

[0030] The electronic sign receives the annotation data of the user on the current PPT image, and sends the annotation data to the display device;

[0031] The display device displays the annotation data, and sends the video stream containing the annotation data to the electronic sign.

[0032] As an alternative implementation, the electronic sign is specifically configured to:

[0033] In response to an annotation instruction triggered by the user on the electronic sign, the electronic sign sends an annotation request to the display device, and the annotation request is used to request the display device to send the current PPT image.

[0034] As an alternative implementation, the display device is specifically configured to:

[0035] Create a transparent layer, and display the received annotation data through the transparent layer.

[0036] As an alternative implementation, the system further includes:

[0037] In response to a touch operation triggered by the user on the electronic sign, the electronic sign sends the touch data corresponding to the touch operation to the display device;

[0038] The display device generates a touch event according to the touch data, in response to the touch event, performs a corresponding operation, and sends the video stream obtained by recording the current screen to the electronic sign.

[0039] As an alternative implementation, the system further includes:

[0040] In response to a speaking instruction triggered by the user on the electronic sign, transmit the user voice data obtained by the electronic sign to the display device through a first transmission method for playing on the display device; and / or,

[0041] In response to a speech instruction triggered by a user on an electronic signboard, the user image data collected by the electronic signboard is transmitted to a display device through a second transmission method for display on the display device.

[0042] As an alternative implementation,

[0043] The electronic signboard and the display device establish at least one socket connection, and one socket connection corresponds to one socket connection channel;

[0044] When there are multiple socket connection channels, different image data is transmitted through different socket connection channels.

[0045] In a second aspect, an electronic signboard provided by an embodiment of the present disclosure includes a display screen group and a processor. The display screen group includes a plurality of display screens, and at least two of the plurality of display screens are used to display different image data; the processor is specifically configured to execute:

[0046] Determine image data, where the image data includes a pre-configured template image, and the template image is determined according to template data input by a user on a display device;

[0047] Send the image data to the electronic signboard, and a communication connection is established between the electronic signboard and the display device;

[0048] Display the image data according to the display screen corresponding to the image data.

[0049] In a third aspect, an embodiment of the present disclosure further provides a display device, including a display and a processor, where:

[0050] The display is used for displaying content;

[0051] The processor is specifically configured to execute:

[0052] Determine image data, where the image data includes a pre-configured template image, and the template image is determined according to template data input by a user on a display device;

[0053] Send the image data to the electronic signboard for instructing the electronic signboard to display the image data according to the display screen corresponding to the image data;

[0054] Where a communication connection is established between the electronic signboard and the display device, the electronic signboard includes a display screen group, the display screen group includes a plurality of display screens, and at least two of the plurality of display screens are used to display different image data.

[0055] Fourth aspect, an embodiment of the present disclosure further provides an information interaction method, which is applied to an electronic signboard. The electronic signboard includes a display screen group and a processor. The display screen group includes a plurality of display screens, and at least two of the plurality of display screens are used to display different image data. The method includes:

[0056] Receiving image data sent by a display device, where a communication connection is established between the electronic signboard and the display device;

[0057] Displaying the image data on the display screen corresponding to the image data.

[0058] Fifth aspect, an embodiment of the present disclosure further provides an information interaction method, which is applied to a display device. The method includes:

[0059] Determining image data, where the image data includes a pre-configured template image, and the template image is determined according to template data input by a user on the display device;

[0060] Sending the image data to the electronic signboard, for instructing the electronic signboard to display the image data on the display screen corresponding to the image data;

[0061] Where a communication connection is established between the electronic signboard and the display device. The electronic signboard includes a display screen group, and the display screen group includes a plurality of display screens, and at least two of the plurality of display screens are used to display different image data.

[0062] Sixth aspect, an embodiment of the present disclosure further provides a computer storage medium, on which a computer program is stored. When the program is executed by a processor, it is used to implement the steps of the method described in any one of the fourth aspect or the fifth aspect above.

[0063] Seventh aspect, the present disclosure provides a computer program product, which includes: computer program code. When the computer program code runs on a computer, it causes the computer to execute the method described in any one of the fourth aspect or the fifth aspect.

[0064] These aspects or other aspects of the present disclosure will be more clearly understood in the following description of the embodiments. Description of the Drawings

[0065] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present disclosure. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0066] Figure 1Schematic diagram of an information interaction system provided by an embodiment of the present disclosure;

[0067] Figures 2A - 2C Schematic diagram of an electronic sign display provided by an embodiment of the present disclosure;

[0068] Figure 3 Schematic diagram of the logical architecture of a dual-screen display of an electronic sign provided by an embodiment of the present disclosure;

[0069] Figure 4 Schematic diagram of an entry for a handwriting software template provided by an embodiment of the present disclosure;

[0070] Figure 5 Editing interface diagram of a template image provided by an embodiment of the present disclosure;

[0071] Figure 6 Schematic diagram of the handwriting recognition principle provided by an embodiment of the present disclosure;

[0072] Figure 7 Schematic diagram of the connection architecture between a display device and an electronic sign provided by an embodiment of the present disclosure;

[0073] Figure 8 Schematic diagram of a socket connection provided by an embodiment of the present disclosure;

[0074] Figures 9A - 9B Schematic diagram of the synchronous display of multi-video window images provided by an embodiment of the present disclosure;

[0075] Figure 10 Schematic diagram of the determination of the position of a single video window provided by an embodiment of the present disclosure;

[0076] Figure 11 Schematic diagram of the synchronous display of annotations provided by an embodiment of the present disclosure;

[0077] Figure 12 Schematic diagram of the process of reverse control of an electronic table sign provided by an embodiment of the present disclosure;

[0078] Figure 13 Schematic diagram of an electronic sign provided by an embodiment of the present disclosure;

[0079] Figure 14 Schematic diagram of a display device provided by an embodiment of the present disclosure;

[0080] Figure 15 Implementation flowchart of an information interaction method provided by an embodiment of the present disclosure;

[0081] Figure 16 Implementation flowchart of an information interaction method provided by an embodiment of the present disclosure. Detailed implementation manners

[0082] To make the objectives, technical solutions, and advantages of the present disclosure clearer, the present disclosure will be further described in detail below with reference to the accompanying drawings. Apparently, the described embodiments are only a part rather than all of the embodiments of the present disclosure. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present disclosure without creative efforts shall fall within the scope of protection of the present disclosure.

[0083] In the embodiments of the present disclosure, the term "and / or" describes the association relationship of associated objects and indicates that three relationships may exist. For example, A and / or B may represent three situations: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally indicates that the associated objects before and after are in an "or" relationship.

[0084] The application scenarios described in the embodiments of the present disclosure are used to more clearly illustrate the technical solutions of the embodiments of the present disclosure and do not constitute a limitation on the technical solutions provided by the embodiments of the present disclosure. Those of ordinary skill in the art know that with the emergence of new application scenarios, the technical solutions provided by the embodiments of the present disclosure are equally applicable to similar technical problems. Among them, in the description of the present disclosure, unless otherwise specified, the meaning of "a plurality of" is two or more.

[0085] Before introducing the information interaction system provided by the embodiments of the present disclosure, for the convenience of understanding, the technical background of the embodiments of the present disclosure will be first introduced in detail below.

[0086] An electronic signage product is an electronic display device with information receiving and transmitting functions, which can replace traditional paper labels and is commonly used in different usage scenarios such as smart retail, smart office, and smart transportation. For the meeting and office scenario, common electronic signage products include meeting room signs, table signs, and workstation signs, etc. Currently, common electronic signage management systems can all realize the production and distribution of display content. In the meeting scenario, participant information is usually displayed through smart table signs. Currently, most of the functions of smart table signs are interacted through local operations, cloud management systems, mobile phone mini-programs, and centralized control software.

[0087] The current intelligent nameplates and conference all-in-one machines are independent of each other and do not affect each other. The intelligent nameplates are controlled by an independent intelligent nameplate system. The current intelligent nameplates use double-sided screens for display and are mainly used to display images. For example, the current intelligent nameplates use double-sided 7-inch high-brightness Thin Film Transistor (TFT) screens (single-sided touch), with a display resolution of 1280×800; based on the Android operating system, with 1G of memory and 6G of FLASH memory; supporting single-machine operation and multi-machine WiFi networking modes, supporting data backup to the server; having single-machine and multi-machine batch renaming functions, capable of setting name, unit, position, page layout, with multiple solid-color backgrounds to choose from, supporting simulated layout; capable of automatically importing nameplate background pictures, names, unit names, positions and other information materials; supporting custom editing of displayed text, font, font size and font color; supporting custom editing and adjustment of the back template, picture display, information editing, modification and background customization, and capable of automatic upgrade; supporting power-off memory saving and automatic IP address search; supporting setting a fixed IP address to facilitate corresponding to the nameplate position information, and the corresponding local IP address is displayed on the nameplate interface; supporting low-battery status reminder and charging status reminder; supporting two hybrid power supply methods: rechargeable battery or power adapter charging; in the absence of a local area network, only a USB flash drive is needed to import data, and the information can be changed at any time; in the WiFi state, supporting one-key shutdown, hibernation, wake-up, screen clearing, and main screen turning off functions on the PC side; in the presence of a network, it can be extended to view the nameplate IP address by scanning the QR code on the nameplate with a mobile phone (tablet); different background pictures can be edited and sent to the electronic nameplates with one key, suitable for use when different units visit; having a function interface, displaying names of people, viewing system notifications and other quick menus, with intuitive operation; capable of viewing the local ID or IP address, supporting the call of multiple background template wallpapers, and capable of turning on and off the backlight of the secondary screen; using 2.The 4G wireless Wi-Fi communication technology features low latency, long-distance communication, and global applicability without geographical restrictions; 360° omnidirectional communication, wireless connection, convenient installation and use, facilitating the setup of different forms of meetings at any time; adopting the 128-bit Advanced Encryption Standard (AES), also known as the Rijndael encryption method, for encryption protection to prevent unauthorized access and ensure the privacy of meeting materials; built-in with a large-capacity 14,500 mAh lithium battery, low power consumption, energy-saving and environmentally friendly, with a working time of up to 12 hours; (when the screen brightness is 50%) the viewing angle is close to 170°, high-definition display of the titles of participants, arbitrary transformation of graphics and text, information service function for background push, intuitive and accurate information; supporting the display of information such as the unit logo, meeting theme, names and positions of participants; having a call service function, supporting quick calls for services such as coffee, tea, flowers, service staff, microphones, pens, paper, water, etc.; having an internal communication function, allowing customization of recipients and sending content, supporting quick group sending and sending to administrators; the system has an independent ID address, and the table card display information can be modified through the meeting software, with selectable font sizes and fonts; when not connected to the network, the unit name, personnel information, font sizes and fonts can be directly modified on the table card operation interface.

[0088] In the current intelligent table card system, there is no solution for direct interaction between the meeting all-in-one machine and the table card. The table card is controlled by a separate server and interacts through local operations, cloud management systems, mobile phone mini-programs, and PC centralized control software, without truly being deeply integrated into the meeting scenarios of the meeting all-in-one machine, such as the video conferencing scenario and the handwriting scenario of the meeting all-in-one machine. Based on this, the present disclosure provides a system for deep integration of electronic table cards and display devices, enabling direct interaction between the electronic signage and the display device, and allowing the image data of the display device to be directly sent to the electronic signage for real-time display, achieving the expansion of the table card system in the meeting scenario and the technical effect of interconnection of the table card system, and providing a more portable usage experience.

[0089] It should be noted that the display device in this embodiment refers to a large-size (generally over 50 inches) intelligent interactive display device with touch handwriting function; on this display device, writing programs such as electronic whiteboards are installed, and users can write on this display device using fingers, active pens or passive pens, etc. This display device can include display modules such as liquid crystal displays (LCD), organic light-emitting semiconductors (OLED), and electronic ink, and can display writing strokes in real time.

[0090] Such as Figure 1As shown, the information interaction system provided in this embodiment includes an electronic sign 100 and a display device 101. A communication connection is established between the electronic sign 100 and the display device 101, where:

[0091] The display device 101 determines image data, where the image data includes a pre-configured template image, and the template image is determined according to the template data input by the user on the display device;

[0092] The display device 101 sends the image data to the electronic sign 100. The electronic sign 100 includes a display screen group, and the display screen group includes multiple display screens. At least two of the multiple display screens are used to display different image data;

[0093] The electronic sign 100 receives the image data and displays the image data according to the display screen corresponding to the image data.

[0094] Optionally, the image data in this embodiment covers static images and dynamic images (in GIF or video stream format). The image data in this embodiment includes, but is not limited to, pre-configured template images, video streams; where the template image may include content such as participant information, meeting summary, etc., and the video stream includes, but is not limited to, the video stream of the current display screen of the display device; or, in a video conferencing scenario, a video stream obtained by recording the video window images included in the current screen, where a video stream may be obtained by recording one or more video window images; or, in a PPT scenario, a video stream obtained by recording the PPT images in the current screen.

[0095] Optionally, the electronic sign in this embodiment includes one or more display screen groups. One display screen group includes multiple display screens, and at least two of the multiple display screens are used to display different image data. This embodiment does not overly limit the assembly method and assembly position of the multiple display screens in the display screen group. Optionally, at least two of the multiple display screens in the display screen group have different specifications, resolutions, etc. For example, one display screen is an e-ink screen, and the other display screen is a liquid crystal display (LCD), an organic electroluminescence display (OLED), etc. This embodiment does not overly limit the display screens used in the electronic sign.

[0096] Such as Figures 2A - 2CAs shown in the figure, this embodiment provides a schematic diagram of electronic signage display. Taking an electronic signage including a display screen group with two display screens as an example, one display screen is on the side facing the user, and the other display screen is on the side facing away from the user. For the convenience of description, in this embodiment, the display screen facing the user is called the first display screen, and the display screen facing away from the user is called the second display screen. Among them, the participant information can be displayed on the second display screen, and the image data can be displayed on the first display screen. Optionally, the first display screen is an LCD or OLED touch screen, and the second display screen is an e-ink screen. Among them, the electronic ink screen is used to display static information (name, position, company, QR code, etc.), and the LCD / OLED screen is used to display dynamic information (meeting agenda, meeting temporary messages, meeting live videos, meeting PPTs, etc.). As Figure 2A shown, a video stream of multiple video window images of a video conferencing scene is displayed on the first display screen, as Figure 2B shown, a video stream of a PPT image is displayed on the first display screen, as Figure 2C shown, the participant information is displayed on the second display screen.

[0097] As Figure 3 shown, the schematic diagram of the logical architecture of the dual-screen display of the electronic signage provided in this embodiment. The first display screen is connected to a first interface, and the second display screen is connected to a second interface. The image data displayed on the first display screen is stored in a first storage area, and the image data displayed on the second display screen is stored in a second storage area. The first display screen and the second display screen are independently displayed. Optionally, the first display screen and the second display screen can display the same content or different content.

[0098] In some embodiments, the image data includes a pre-configured template image; the display device receives the template data input by the user, determines the template image according to the template data, and sends the template image to the electronic signage; the electronic signage displays the template image through the display screen corresponding to the template image.

[0099] Optionally, after receiving the template image, the electronic signage displays it through the second display screen. The template image in this embodiment can be edited and generated by the user on the display device. For example, the template image can be edited and generated through the handwriting software on the display device, or the template generation function can be developed to perform operations such as editing and generating the template image in the template generation function of the display device.

[0100] In some embodiments, the display device is specifically used for:

[0101] receiving the handwritten template data input by the user on the template function interface of the handwriting software; recognizing the template data according to the recognition algorithm of the handwriting software, typesetting the recognition result to generate a handwritten template; and taking a screenshot of the handwritten template to obtain a template image.

[0102] Optionally, since the recognition algorithms of the handwriting software are relatively rich, the recognition results can be in various font types such as standard fonts, handwriting fonts, or special fonts like brush fonts. As Figure 4 shown, a schematic diagram of the template entry of a handwriting software provided in this embodiment. Since functions such as inserting tables, sticky notes, and formulas are usually available in the handwriting software, a template function can be added to the insertion area of the handwriting software in this embodiment, and typesetting can be performed on the template function interface in the form of handwriting or standard fonts (such as Song typeface, Black typeface, etc.). As Figure 5 shown, an editing interface of the provided template image is used to create attendee information according to the meeting content and perform different typesetting, beautification, etc. operations. In this embodiment, the updated template source is stored on the display device, which is equivalent to a function of the handwriting software in the display device. When the handwriting function of the handwriting software is updated, the updated handwriting function can be used to edit the template image, for example, to create content using the updated handwriting font.

[0103] As Figure 6 shown, this embodiment also provides a schematic diagram of the handwriting recognition principle. Among them, the display device includes a display screen and an SoC (System on Chip). The display screen is provided with a touch control component that can sense and receive the touch data of the user. The SoC is used to execute the following processing flow:

[0104] Step 600: The display screen receives the touch data of the user;

[0105] In implementation, after the user's finger touches the display screen, the touch control component collects the touch data and sends it to the SoC for processing; the touch control component includes but is not limited to various types of sensors, etc.

[0106] Step 601: The display screen driver obtains the touch data and sends information such as the position information / finger count / event included in the touch data to the touch event service module;

[0107] Step 602: The touch event service module sends the touch data to the framework layer;

[0108] Step 603: The framework layer converts the touch data into an Android standard touch event;

[0109] Among them, the touch event includes coordinate points, finger count, press / lift, events (such as swipe, click, etc.).

[0110] Step 604: Send the touch event to the handwriting recognition algorithm and output different types of handwriting data for display.

[0111] Among them, different types of handwritten data include handwritten data in standard fonts and special style fonts. Optionally, the touch event can also be sent to other touch area function modules to implement corresponding functions.

[0112] As Figure 7 shown, this embodiment provides a schematic diagram of the connection architecture between a display device and an electronic sign. One display device can establish a communication connection with one or more electronic signs, that is, one display device is connected to one electronic sign, or one display device is connected to multiple electronic signs. The recognition of the handwritten text is completed through the handwriting function of the display device, and then the template image is transmitted to the electronic sign for display.

[0113] In some embodiments, the electronic sign and the display device establish at least one socket connection, and one socket connection corresponds to one socket connection channel; when there are multiple socket connection channels, different image data are transmitted through different socket connection channels.

[0114] Optionally, multiple socket connections are established according to the load condition of the server side, so as to generate multiple socket connection channels. It should be noted that one socket connection channel can be established under one socket connection, multiple socket connections correspond to multiple socket connection channels, and different types of data are transmitted through different socket connection channels to avoid data conflicts.

[0115] Among them, the socket connection is a communication mechanism in a computer network that allows two programs to communicate through the network on different computers. As Figure 8As shown in the figure, a schematic diagram of a socket connection is provided. When communicating using sockets, one program acts as the client and the other as the server, and data transmission is carried out by creating and using sockets. A socket can be understood as an interface for network communication, providing a standard communication method that enables different programs to exchange data over the network. The use of sockets is the core of Socket connection. When communicating using sockets, some parameters of the socket need to be specified, such as the IP address, port number, protocol, etc. In a Socket connection, the sockets used by the client and the server may be different. In the client, a socket needs to be created and the IP address and port number of the connection target specified, and then a connection request is sent to the server. In the server, a socket needs to be created and bound to a specified port number, and then it waits for the client's connection request. The protocol of the socket is also an important part of the Socket connection. Different protocols have different effects on the way and efficiency of data transmission. In a Socket connection, the common protocols are TCP and UDP. The TCP protocol is a reliable protocol that ensures that data will not be lost or damaged during transmission. The TCP protocol guarantees the integrity and reliability of data through steps such as connection establishment, data transmission, and connection release. The TCP protocol is suitable for occasions where data transmission reliability is required, such as file transfer, web browsing, etc. The UDP protocol is an unreliable protocol that does not guarantee the reliability of data transmission. The transmission speed of the UDP protocol is faster than that of TCP, but data may be lost or damaged during transmission. The UDP protocol is suitable for real-time communication, such as the transmission of video and audio streams. In this embodiment, no excessive limitation is imposed on the protocol used.

[0116] In the implementation, the networking method of the display device and the electronic sign is as follows:

[0117] 1) Assign IPs to the display device and the electronic sign;

[0118] 2) The display device acts as the server, and the electronic sign acts as the client, and a socket connection is established between the client and the server.

[0119] The display device obtains the IDs of all online electronic table signs. Among them, when the display device and the electronic sign establish a socket connection, the ID of the electronic table sign can be obtained according to the socket connection identifier.

[0120] After the user generates a handwritten template on the display device, the display device captures the current handwritten template through a screenshot function to obtain a template image. After the user selects the send button, an electronic sign selection menu pops up on the display interface of the display device. The electronic sign selection menu includes the IDs of all online electronic signs obtained when the display device and the electronic signs are networked. The ID of an electronic sign corresponds to the real physical location where the electronic sign is located. The user can select one or more IDs from the electronic sign selection menu to send the template image. After receiving the corresponding template image, the electronic sign updates the display screen of the corresponding display in real time.

[0121] The video conferencing function is a frequently used function of display devices (such as conference all-in-ones). In this embodiment, the video conferencing of the conference all-in-one can interact with the table sign system, which can bring a better conference experience to users.

[0122] In some embodiments, taking the image data including the video stream of the display screen of the display device as an example, the real-time interaction of the video stream between the display device and the electronic sign is realized. Optionally, the display device records the display screen to obtain a video stream and sends the video stream to the electronic sign; the electronic sign displays the video stream through the display screen corresponding to the video stream.

[0123] In practice, the display device can share the display screen of the current display device with the electronic sign. When the user operates on the display device, the video stream of the current operation can be displayed on the electronic sign in real time, so that all participating users can synchronously see the display screen of the display device on the corresponding electronic sign, effectively improving the experience of the participating users.

[0124] In some embodiments, the electronic sign in this embodiment is specifically used for:

[0125] According to the resolution of the received image data and the resolution of the display screen corresponding to the image data, determine the sign board screen size; display the image data on the display screen corresponding to the image data according to the sign board screen size.

[0126] In practice, after the image data of the display device is transmitted to the electronic sign, the size suitable for the electronic sign to display will be calculated according to the respective resolutions of the display device and the electronic sign and then displayed.

[0127] In some embodiments, the image data in this embodiment includes a video stream obtained by recording the video window image included in the current screen in a video conferencing scenario; the electronic sign is specifically used for:

[0128] When there is one video window image, display one video window image; or,

[0129] When there are multiple video window images, display multiple video window images or the video window images specified by the user.

[0130] (1) The display content of the display device and the digital signage is the same;

[0131] In this display mode, as Figures 9A - 9B shown, a schematic diagram of synchronous display of multiple video window images is provided. The display content of the digital signage is consistent with that of the display device. When the display device is a single video window, the digital signage also displays a single video window; when the display device is multiple video windows, the digital signage also displays multiple video windows; the content displayed on the digital signage is a copy of the content displayed on the display device.

[0132] First, assign IPs to the display device and the digital signage, determine the master-slave mode, that is, determine the display device as the master device (server) and the digital signage as the slave device (client). The display device and the digital signage establish a socket connection, and the display device obtains the IDs of all digital signage.

[0133] In implementation, the sending end (display device) is specifically used to perform screen recording to obtain image data. Specifically, it can obtain a virtual display through MediaProjection to achieve screen recording (i.e., the screen recording function). Among them, the principle of MediaProjection is a technology for implementing screen recording and screenshot in the Android system. The display device is also used to perform hardware encoding on the recorded image data by using MediaCodec, package the encoded image data into FLV (FLASH VIDEO, a streaming media format) data, and send the FLV data to the digital signage through RTMP (Real Time Messaging Protocol).

[0134] The receiving end (digital signage) is specifically used to receive the image data, parse the image data according to the RTMP protocol to obtain the FLV file, parse out the encoded image data according to the FLV file format, parse out the RGB data (i.e., the original image data) from the encoded image data, calculate the appropriate size according to the resolution of the digital signage and the resolution of the display device, and display the original image data.

[0135] (2) The digital signage displays the video window images specified by the user;

[0136] In some embodiments, the image data includes a video stream obtained by recording multiple video window images included in the current screen in a video conferencing scenario;

[0137] a) The digital signage sends the position information of the video window images specified by the user to the display device;

[0138] Optionally, the electronic signboard is specifically configured to: in response to a user's selection operation on multiple video window images displayed on the electronic signboard, determine the position information of the video window image corresponding to the selection operation, and send the position information to the display device.

[0139] b) The display device extracts the corresponding target video window image from the multiple video window images according to the received position information, and sends the video stream containing the target video window image to the electronic signboard;

[0140] c) The electronic signboard receives the video stream containing the target video window image and displays it through the corresponding display screen.

[0141] Under normal circumstances, the video conferencing software on the display device sometimes displays in a single window and sometimes in multiple windows. If the direct screen recording method is used, the display content of the electronic signboard is the same as that of the display device. However, there is also such a scenario where a multi-window video conference is displayed on the display device, and the participants hope that the corresponding electronic signboard only displays the windows they care about. The implementation principle is as follows:

[0142] ① Create the first video stream in the same way as the display content of the above display device and electronic signboard is the same, specifically as follows:

[0143] First, assign IPs to the display device and the electronic signboard, determine the master-slave mode, that is, determine the display device as the master device (server) and the electronic signboard as the slave device (client), establish a socket connection between the display device and the electronic signboard, and the display device obtains the IDs of all electronic signboards;

[0144] In implementation, the sending end (display device) is specifically configured to perform screen recording to obtain image data. Specifically, it can obtain a virtual display through MediaProjection to achieve screen recording (i.e., the screen recording function). Among them, the principle of MediaProjection is a technology for implementing screen recording and screenshot in the Android system. The display device is also used to perform hardware encoding on the recorded image data by using MediaCodec, package the encoded image data into FLV (FLASH VIDEO, a streaming media format) data, and send the FLV data as the finally sent image data to the electronic signboard through RTMP (Real Time Messaging Protocol).

[0145] The receiving end (electronic sign) is specifically used to receive image data, parse the image data according to the RTMP protocol to obtain an FLV file, parse the encoded image data according to the FLV file format, parse the encoded image data into RGB data (i.e., the original image data), calculate an appropriate size according to the resolution of the electronic nameplate and the resolution of the display device, and display the original image data.

[0146] ② In response to a user's selection operation on multiple video window images displayed on the electronic sign, determine the position information of the video window image corresponding to the selection operation, and send the position information to the display device.

[0147] As Figure 10 shown, a schematic diagram for determining the position of a single video window is provided. According to the resolutions of the display screen and the electronic sign, and the position of the selected video window image, calculate the position of the selected video window image on the display device. The calculation formula is as follows:

[0148] x2 = X2' × x1 / X1'; y2 = Y2' × y1 / Y1'; w2 = X2' × w1 / X1'; h2 = Y2' × h1 / Y1';

[0149] Formula (1);

[0150] Among them, (x1, y1) represents the position where the selected video window is displayed on the electronic sign, w1 and h1 represent the width and height of the selected video window displayed on the electronic sign, X1' and Y1' represent the width and height of the display area of the electronic sign; (x2, y2) represents the position where the selected video window is displayed on the display device, w2 and h2 represent the width and height of the selected video window displayed on the display device, and X2' and Y2' represent the width and height of the display area of the display device.

[0151] Optionally, the position information of the video window image corresponding to the selection operation, the resolution of the electronic sign, and the electronic sign ID can be sent to the display device.

[0152] In implementation, if a certain participant selects a video window among multiple video window images on the display screen of the electronic sign, it means that the participant hopes to focus on this video window. Then, the electronic sign of this participant will upload the following information to the display device: the resolution of this electronic sign, the position information of the selected video window, the ID of the electronic sign, etc.

[0153] ③ After receiving the resolution of the electronic sign, the position information of the selected video window, and the ID of the electronic sign, the display device disconnects the socket connection with this electronic sign; calculates the position of the selected video window in the display device according to the resolution of the display device, the resolution of the electronic sign, and the position information of the selected video window;

[0154] ④ The display device re - establishes a socket connection, establishes a connection with the electronic signboard of the application main window, and sends the video stream corresponding to the selected video window to the electronic signboard;

[0155] In implementation, the display device can use MediaProjection to obtain a virtual display to achieve screen recording. According to the position information (xx, yy, ww, hh) of the selected video window, crop the corresponding target video window image from multiple video window images, use MediaCodec for hardware encoding, package the encoded data into FLV data, and send the FLV data as the finally - sent image data to the corresponding electronic signboard through the RTMP protocol.

[0156] ⑤ The electronic signboard receives the image data, parses the image data according to the RTMP protocol to obtain an FLV file, parses the encoded image data according to the FLV file format, parses the RGB data (i.e., the original image data) from the encoded image data, calculates an appropriate size according to the resolution of the electronic table sign and the resolution of the display device, and displays the original image data.

[0157] In some embodiments, the video stream in this embodiment includes a video stream obtained by recording the PPT image in the current screen in the PPT scenario;

[0158] Ⅰ. The display device intercepts the current PPT image, and sends the intercepted current PPT image and the video stream to the electronic signboard, where the display level of the current PPT image is at a higher level than that of the video stream;

[0159] Optionally, the display device is specifically configured to create a transparent layer and display the received annotation data through the transparent layer.

[0160] Ⅱ. The electronic signboard receives the annotation data of the user on the current PPT image, and sends the annotation data to the display device;

[0161] Ⅲ. The display device displays the annotation data and sends the video stream containing the annotation data to the electronic signboard.

[0162] In implementation, in response to an annotation instruction triggered by a user on an electronic sign, the electronic sign sends an annotation request to a display device, where the annotation request is used to request the display device to send the current PPT image; the display device captures the current PPT image, creates a transparent layer, and sends the current PPT image including the transparent layer to the electronic sign, where the transparent layer is placed on the upper level of the display level where the PPT image is located, and the transparent layer is used to display annotation data; in response to a user's annotation operation on the PPT image including the transparent layer, the electronic sign sends the annotation data corresponding to the annotation operation to the display device; the display device displays the annotation data on the created transparent layer and sends the PPT image currently displaying the annotation data to the electronic sign.

[0163] It should be noted that the display principle of the PPT window is similar to that of the multi-video window. Both are that the display device records the virtual screen, then encodes, packages, and sends it; the electronic sign unpacks, decodes, and displays it. This embodiment can also implement the annotation and saving of PPT.

[0164] The PPT annotation principle is as follows:

[0165] First, an annotation channel (a separate socket connection channel for transmitting annotation data) is established between the display device and the electronic sign. Among them, multiple annotation channels can be established to transmit different data respectively to avoid data conflicts. After that, the electronic sign sends an annotation request. After receiving the annotation request, the display device captures the current PPT image and places it above the video layer. It should be noted that the user cannot directly annotate on the video stream displayed by the electronic sign. Annotation can only be performed on a static image. Therefore, the captured current PPT image is placed above the video layer where the video stream is located. And the display device can also create a transparent layer (top layer) to display the annotation path. The coordinates of each touch point drawn by the user received in the electronic sign and the resolution of the electronic sign are sent to the display device through the annotation channel. After receiving the coordinates of the touch point and the resolution of the electronic sign, the display device calculates the corresponding position of the coordinates of the touch point on the display device and displays the user's touch point at the calculated position. As Figure 11 shown, a schematic diagram of synchronous display of annotations is provided. During annotation, the content of the screen recording by the display device is the screen information with annotations added, which is convenient for all participants to see the annotation information.

[0166] In some embodiments, this embodiment also provides the function of on-site speech, which is specifically as follows:

[0167] In response to a speech instruction triggered by a user on the electronic sign, the user voice data obtained by the electronic sign is transmitted to the display device through the first transmission method for playing on the display device; and / or,

[0168] In response to a speech instruction triggered by a user on an electronic signboard, the user image data collected by the electronic signboard is transmitted to a display device through a second transmission method for display on the display device.

[0169] Optionally, the first transmission method includes Bluetooth, etc., and the second transmission method includes WIFI, etc.

[0170] In implementation, usually the conference system of the display device picks up sound through the microphone of the display device. If there are many participants, most participants may be far away from the microphone, which is not conducive to the development of the conference. In this embodiment, the microphone of the electronic signboard is connected to the display device through a dynamic Bluetooth method, and the participants pick up sound through the electronic signboard to achieve a better sound pickup effect.

[0171] First, a control channel (a separate socket connection channel for transmitting data such as voice and video) is established between the display device and the electronic signboard. When the user touches the speech button on the electronic signboard, the electronic signboard sends a Bluetooth connection request to the display device through the control channel. The display device checks the current Bluetooth connection status. If Bluetooth is already connected to another electronic signboard, the connection is automatically disconnected at this time. At the same time, it checks the current WIFI connection status. If the WIFI camera is already connected to another electronic signboard, then the connection is automatically disconnected. The display device connects to the Bluetooth microphone module that requests to speak currently and the WIFI camera module that requests to speak currently. After the connection is successful, the electronic signboard displays that the Bluetooth microphone and the WIFI camera have been connected. The WIFI camera data is injected into the virtual camera driver of the display device through WIFI. One way is to transmit the WIFI camera data to the display screen of the display device, and the other is to transmit the WIFI camera data to the video software for display by the video software. The Bluetooth microphone data is injected into the virtual microphone driver of the display device through Bluetooth, and the video conferencing software pushes the image data and audio data to the video conferencing server side.

[0172] In some embodiments, this embodiment also provides the function of reverse control of the electronic signboard, which is specifically as follows:

[0173] In response to a touch operation triggered by a user on the electronic signboard, the electronic signboard sends the touch data corresponding to the touch operation to the display device;

[0174] The display device generates a touch event according to the touch data, in response to the touch event, performs corresponding operations, and sends the video stream obtained by screen recording the current screen to the electronic signboard.

[0175] In implementation, in a video conferencing scenario, the electronic signboard acts as a receiving end. Whatever content the display device sends, the electronic signboard will display the corresponding content. However, participants may hope to provide information feedback through the electronic signboard and interact with the display device. Therefore, this embodiment provides a function for the electronic signboard to reverse-control the display device.

[0176] In implementation, the display device and the electronic signboard establish a reverse-control channel (a separate socket connection channel for transmitting touch data). The electronic signboard sends a reverse-control request, carrying the coordinates of each point touched by the user, the resolution of the electronic signboard, and touch events (long press, short press, swipe, pull up, pull down, etc.). The display device receives the reverse-control request, calculates the corresponding touch position on the display device based on the coordinates of each point and the resolution of the electronic signboard, generates a standard touch event for the display device according to the corresponding touch position, and responds to the standard touch event.

[0177] As Figure 12 shown, this embodiment also provides a schematic flowchart for reverse-control of an electronic table sign. Among them, when the user touches the display screen of the electronic signboard, after the touch component collects the touch data, it sends the touch data to the display screen driver. The display screen driver obtains the touch data and sends information such as the position information / finger count / event contained in the touch data to the touch event service module; the touch event service module sends the touch data to the framework layer; the framework layer converts the touch data into an Android standard touch event; through the reverse-control channel, the touch event, the resolution of the electronic signboard, and the coordinate array contained in the touch data are sent to the display device. After the display device obtains the touch event, the resolution of the electronic signboard, and the coordinate array, it converts the coordinate array into the corresponding coordinates of the display device, combines them into a standard touch event, and sends it to the Android system, thereby responding to the touch event.

[0178] Based on the same inventive concept, embodiments of the present disclosure also provide an electronic signboard. Since the principle of this electronic signboard for solving problems is similar to that of the system, the implementation of this electronic signboard can refer to the implementation of the system, and the repeated parts will not be elaborated.

[0179] As Figure 13 shown, the electronic signboard includes a display screen group 1300 and a processor 1301. The display screen group includes multiple display screens, and at least two of the multiple display screens are used to display different image data; the processor 1301 is specifically configured to execute:

[0180] Receive image data sent by the display device. A communication connection is established between the electronic signboard and the display device;

[0181] Display the image data according to the display screen corresponding to the image data.

[0182] As an alternative implementation, the image data further includes a video stream of the display screen of the display device; the processor 1301 is specifically configured to execute:

[0183] Receive the video stream sent by the display device and display the video stream through the display screen corresponding to the video stream.

[0184] As an alternative implementation, the processor 1301 is specifically configured to execute:

[0185] Determine the signboard screen size according to the resolution of the received image data and the resolution of the display screen corresponding to the image data;

[0186] Display the image data on the display screen corresponding to the image data according to the signboard screen size.

[0187] As an alternative implementation, the image data further includes a video stream obtained by recording the video window images included in the current screen in a video conferencing scenario; the processor 1301 is specifically configured to execute:

[0188] When there is one video window image, display one video window image; or,

[0189] When there are multiple video window images, display multiple video window images or the user-specified video window image.

[0190] As an alternative implementation, the image data further includes a video stream obtained by recording the multiple video window images included in the current screen in a video conferencing scenario; the processor 1301 is specifically configured to execute:

[0191] Send the position information of the user-specified video window image to the display device, so as to instruct the display device to intercept the corresponding target video window image from the multiple video window images according to the received position information, and send the video stream including the target video window image to the electronic signboard;

[0192] Receive the video stream including the target video window image sent by the display device and display it through the corresponding display screen.

[0193] As an alternative implementation, the processor 1301 is specifically configured to execute:

[0194] In response to the user's selection operation on the multiple video window images displayed on the electronic signboard, determine the position information of the video window image corresponding to the selection operation and send the position information to the display device.

[0195] As an alternative implementation, the video stream further includes a video stream obtained by recording a PPT image in the current screen in the PPT scenario, where the display level of the current PPT image is at a higher level than that of the video stream; the processor 1301 is specifically configured to execute:

[0196] Receive the video stream containing the PPT image sent by the display device;

[0197] Receive the annotation data of the user on the current PPT image, and send the annotation data to the display device to instruct the display device to display the annotation data and send the video stream containing the annotation data to the digital signage.

[0198] As an alternative implementation, the processor 1301 is specifically configured to execute:

[0199] In response to the annotation instruction triggered by the user on the digital signage, the digital signage sends an annotation request to the display device, and the annotation request is used to request the display device to send the current PPT image.

[0200] As an alternative implementation, the processor 1301 is further specifically configured to execute:

[0201] In response to the touch operation triggered by the user on the digital signage, send the touch data corresponding to the touch operation to the display device to instruct the display device to generate a touch event according to the touch data, execute the corresponding operation in response to the touch event, and send the video stream obtained by screen recording the current screen to the digital signage.

[0202] As an alternative implementation, the processor 1301 is further specifically configured to execute:

[0203] In response to the speaking instruction triggered by the user on the digital signage, transmit the user voice data obtained by the digital signage to the display device through the first transmission method for playing on the display device; and / or,

[0204] In response to the speaking instruction triggered by the user on the digital signage, transmit the user image data collected by the digital signage to the display device through the second transmission method for display on the display device.

[0205] As an alternative implementation,

[0206] The digital signage and the display device establish at least one socket connection, and one socket connection corresponds to one socket connection channel;

[0207] When there are multiple socket connection channels, different image data is transmitted through different socket connection channels.

[0208] Based on the same inventive concept, embodiments of the present disclosure also provide a display device. Since the principle of solving problems by this display device is similar to that of the system, the implementation of this display device can refer to the implementation of the system, and the repeated parts will not be described again.

[0209] As Figure 14 shown, the display device includes a display 1400 and a processor 1401, where:

[0210] The display 1400 is used to display content;

[0211] The processor 1401 is specifically configured to execute:

[0212] Determine image data, where the image data includes a pre-configured template image, and the template image is determined according to template data input by a user on the display device;

[0213] Send the image data to an electronic signboard, for instructing the electronic signboard to display the image data on the display screen corresponding to the image data;

[0214] Wherein a communication connection is established between the electronic signboard and the display device, the electronic signboard includes a display screen group, the display screen group includes a plurality of display screens, and at least two of the plurality of display screens are used to display different image data.

[0215] As an optional implementation manner, the processor 1401 is specifically configured to determine the template image in the following manner:

[0216] Receive the handwritten template data input by the user on the template function interface of the handwriting software;

[0217] Identify the template data according to the recognition algorithm of the handwriting software, and typeset the recognition result to generate a handwritten template;

[0218] Take a screenshot of the handwritten template to obtain a template image.

[0219] As an optional implementation manner, the image data further includes a video stream of the display screen of the display device; the processor 1401 is specifically configured to execute:

[0220] Record the display screen to obtain a video stream, and send the video stream to the electronic signboard to instruct the electronic signboard to display the video stream on the display screen corresponding to the video stream.

[0221] As an alternative implementation, the image data further includes a video stream obtained by recording multiple video window images included in the current screen in a video conferencing scenario; the processor 1401 is specifically configured to execute:

[0222] Receive the position information of the video window image specified by the user sent by the electronic signage;

[0223] According to the received position information, extract the corresponding target video window image from the multiple video window images, and send the video stream including the target video window image to the electronic signage, so as to instruct the electronic signage to receive the video stream including the target video window image and display it through the corresponding display screen.

[0224] As an alternative implementation, the video stream further includes a video stream obtained by recording the PPT image in the current screen in a PPT scenario; the processor 1401 is specifically configured to execute:

[0225] Extract the current PPT image, and send the extracted current PPT image and the video stream to the electronic signage, so as to instruct the electronic signage to receive the annotation data of the user on the current PPT image and send the annotation data to the display device; wherein the display level of the current PPT image is located at a higher level than that of the video stream;

[0226] Receive the annotation data sent by the electronic signage, display the annotation data, and send the video stream including the annotation data to the electronic signage.

[0227] As an alternative implementation, the processor 1401 is specifically configured to execute:

[0228] Create a transparent layer, and display the received annotation data through the transparent layer.

[0229] As an alternative implementation, the processor 1401 is further specifically configured to execute:

[0230] Receive the touch data sent by the electronic signage;

[0231] Generate a touch event according to the touch data, in response to the touch event, execute the corresponding operation, and send the video stream obtained by screen recording the current screen to the electronic signage.

[0232] As an alternative implementation, the processor 1401 is further specifically configured to execute:

[0233] Receive the user voice data sent by the electronic signage through the first transmission method and play the user voice data; and / or,

[0234] The second transmission method receives the user image data collected by the electronic signboard and displays the user image data.

[0235] As an alternative implementation,

[0236] The electronic signboard and the display device establish at least one socket connection, and one socket connection corresponds to one socket connection channel;

[0237] When there are multiple socket connection channels, different image data is transmitted through different socket connection channels.

[0238] Based on the same inventive concept, as Figure 15 shown, an embodiment of the present disclosure further provides an information interaction method applied to an electronic signboard. The electronic signboard includes a display screen group and a processor. The display screen group includes multiple display screens, and at least two of the multiple display screens are used to display different image data; the specific implementation process of this method is as follows:

[0239] Step 1500: Receive the image data sent by the display device. The electronic signboard and the display device have established a communication connection;

[0240] Step 1501: Display the image data according to the display screen corresponding to the image data.

[0241] Based on the same inventive concept, as Figure 16 shown, an embodiment of the present disclosure further provides an information interaction method applied to a display device. The specific implementation process of this method is as follows:

[0242] Step 1600: Determine the image data;

[0243] The image data includes a pre-configured template image, and the template image is determined according to the template data input by the user on the display device;

[0244] Step 1601: Send the image data to the electronic signboard for instructing the electronic signboard to display the image data according to the display screen corresponding to the image data;

[0245] The electronic signboard and the display device have established a communication connection. The electronic signboard includes a display screen group, and the display screen group includes multiple display screens. At least two of the multiple display screens are used to display different image data.

[0246] Based on the same inventive concept, embodiments of the present disclosure provide a computer storage medium, which includes: computer program code that, when running on a computer, causes the computer to execute any of the information interaction methods discussed above. Since the principle of the above computer storage medium for solving problems is similar to that of the information interaction method, the implementation of the above computer storage medium can refer to the implementation of the method, and the repeated parts will not be elaborated.

[0247] In a specific implementation process, the computer storage medium may include: various storage media that can store program code, such as a Universal Serial Bus Flash Drive (USB), a mobile hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disc.

[0248] Based on the same inventive concept, embodiments of the present disclosure also provide a computer program product, which includes: computer program code that, when running on a computer, causes the computer to execute any of the information interaction methods discussed above. Since the principle of the above computer program product for solving problems is similar to that of the information interaction method, the implementation of the above computer program product can refer to the implementation of the method, and the repeated parts will not be elaborated.

[0249] The computer program product can adopt any combination of one or more readable media. The readable media can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples (non-exhaustive list) of the readable storage medium include: an electrical connection with one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a Read-Only Memory (ROM), an Erasable Programmable Read-Only Memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0250] Those skilled in the art should understand that the embodiments of the present disclosure can be provided as a method, a system, or a computer program product. Therefore, the present disclosure can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present disclosure can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) that contain computer-usable program code.

[0251] This disclosure is described with reference to the flowcharts and / or block diagrams of methods, apparatuses (systems), and computer program products according to embodiments of the disclosure. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and combinations of flows and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to the processors of general-purpose computers, special-purpose computers, embedded processors, or other programmable data processing devices to generate a machine, such that the instructions executed by the processors of the computer or other programmable data processing devices produce a device for implementing the functions specified in the process Figure 1 one process or multiple processes and / or blocks Figure 1 or a device for implementing the functions specified in multiple blocks.

[0252] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, such that the instructions stored in the computer-readable memory produce a manufactured article including an instruction device that implements the functions specified in the process one process or multiple processes and / or blocks Figure 1 or a device for implementing the functions specified in multiple blocks.

[0253] These computer program instructions can also be loaded onto a computer or other programmable data processing device, such that a series of operation steps are executed on the computer or other programmable device to generate a computer-implemented process. Thus, the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in the process Figure 1 one process or multiple processes and / or blocks Figure 1 Figure 1 or a device for implementing the functions specified in multiple blocks.

[0254] Obviously, those skilled in the art can make various modifications and variations to this disclosure without departing from the spirit and scope of this disclosure. Thus, if these modifications and variations of this disclosure fall within the scope of the claims of this disclosure and their equivalent technologies, this disclosure is also intended to include these modifications and variations.

Claims

1. An information interaction system, characterized in that, The system includes an electronic signboard and a display device, and a communication connection is established between the electronic signboard and the display device, where: The display device determines image data, where the image data includes a pre-configured template image, and the template image is determined according to template data input by the user on the display device; The display device sends the image data to the electronic signboard. The electronic signboard includes a display screen group, and the display screen group includes multiple display screens. At least two of the multiple display screens are used to display different image data; The electronic signboard receives the image data and displays the image data according to the display screen corresponding to the image data.

2. The system according to claim 1, wherein The display device is specifically used to determine the template image in the following manner: Receive the handwritten template data input by the user on the template function interface of the handwriting software; Identify the template data according to the recognition algorithm of the handwriting software, and typeset the recognition result to generate a handwritten template; Take a screenshot of the handwritten template to obtain a template image.

3. The system according to claim 1, characterized in that The image data further includes a video stream of the display screen of the display device; the system includes: The display device records the display screen to obtain a video stream and sends the video stream to the electronic signboard; The electronic signboard displays the video stream through the display screen corresponding to the video stream.

4. The system according to claim 1, characterized in that, The electronic signboard is specifically used to: Determine the signboard screen size according to the resolution of the received image data and the resolution of the display screen corresponding to the image data; Display the image data on the display screen corresponding to the image data according to the signboard screen size.

5. The system according to claim 1, wherein The image data further includes a video stream obtained by recording the video window images included in the current screen in a video conferencing scenario; the electronic signboard is specifically used to: When there is one video window image, display one video window image; or, When there are multiple video window images, display multiple video window images or the video window images specified by the user.

6. The system according to claim 1, wherein The image data further includes a video stream obtained by recording multiple video window images included in the current screen in a video conferencing scenario; the system includes: The electronic signboard sends the position information of the video window image specified by the user to the display device; The display device intercepts the corresponding target video window image from the multiple video window images according to the received position information, and sends the video stream including the target video window image to the electronic signboard; The electronic signboard receives the video stream including the target video window image and displays it through the corresponding display screen.

7. The system according to claim 6, characterized in that, The electronic signboard is specifically used to: In response to a selection operation of the user on multiple video window images displayed on the electronic signboard, determine the position information of the video window image corresponding to the selection operation, and send the position information to the display device.

8. The system according to claim 1, wherein The video stream further includes a video stream obtained by recording the PPT image in the current screen in a PPT scenario; the system includes: The display device intercepts the current PPT image and sends the intercepted current PPT image and the video stream to the electronic signboard, where the display level of the current PPT image is above the video stream; The electronic signboard receives the annotation data of the user on the current PPT image and sends the annotation data to the display device; The display device displays the annotation data and sends the video stream containing the annotation data to the electronic signboard.

9. The system according to claim 8, characterized in that, The electronic signboard is specifically used for: In response to the annotation instruction triggered by the user on the electronic signboard, the electronic signboard sends an annotation request to the display device, and the annotation request is used to request the display device to send the current PPT image.

10. The system according to claim 8, wherein The display device is specifically used for: Create a transparent layer and display the received annotation data through the transparent layer.

11. The system according to claim 1, characterized in that, The system further includes: In response to the touch operation triggered by the user on the electronic signboard, the electronic signboard sends the touch data corresponding to the touch operation to the display device; The display device generates a touch event according to the touch data, in response to the touch event, performs corresponding operations, and sends the video stream obtained by recording the current screen to the electronic signboard.

12. The system according to claim 1, wherein The system further includes: In response to the speech instruction triggered by the user on the electronic signboard, transmit the user voice data obtained by the electronic signboard to the display device through the first transmission method for playing on the display device; and / or, In response to the speech instruction triggered by the user on the electronic signboard, transmit the user image data collected by the electronic signboard to the display device through the second transmission method for display on the display device.

13. The system according to claim 1, wherein The electronic signboard and the display device establish at least one socket connection, and one socket connection corresponds to one socket connection channel; When there are multiple socket connection channels, different image data are transmitted through different socket connection channels.

14. An electronic signboard, characterized in that, The electronic signboard includes a display screen group and a processor. The display screen group includes multiple display screens, and at least two of the multiple display screens are used to display different image data; the processor is specifically configured to execute: Receive the image data sent by the display device. The electronic signboard and the display device have established a communication connection; Display the image data according to the display screen corresponding to the image data.

15. A display device, characterized in that, Includes a display and a processor, wherein: The display is used for displaying content; The processor is specifically configured to execute: Determine the image data, where the image data includes a pre-configured template image, and the template image is determined according to the template data input by the user on the display device; Send the image data to the electronic signboard for instructing the electronic signboard to display the image data according to the display screen corresponding to the image data; Wherein the electronic signboard and the display device have established a communication connection, the electronic signboard includes a display screen group, and the display screen group includes multiple display screens, and at least two of the multiple display screens are used to display different image data.

16. An information interaction method, characterized in that, Applied to an electronic signboard, the electronic signboard includes a display screen group and a processor. The display screen group includes multiple display screens, and at least two of the multiple display screens are used to display different image data; the method includes: Receive the image data sent by the display device, where a communication connection is established between the electronic sign and the display device; Display the image data according to the display screen corresponding to the image data.

17. An information interaction method, characterized in that, Applied to a display device, the method includes: Determine the image data, where the image data includes a pre-configured template image, and the template image is determined according to the template data input by the user on the display device; Send the image data to the electronic sign for instructing the electronic sign to display the image data according to the display screen corresponding to the image data; Where a communication connection is established between the electronic sign and the display device, the electronic sign includes a display screen group, the display screen group includes multiple display screens, and at least two of the multiple display screens are used to display different image data.

18. A computer storage medium, on which a computer program is stored, characterized in that, When the program is executed by a processor, it implements the steps of the method according to claim 16 or 17.

Images