Multi-screen linkage sand table display method and device

Abstract

The invention relates to the technical field of multimedia, and provides a multi-screen linkage sand table display method and device. According to the invention, a multi-screen linkage sand table display device is arranged in an electronic sand table display stand area, and an operator controls a plurality of display screens of the multi-screen linkage sand table display device to display specified city planning data; acquiring face images of all visitors in the electronic sand table exhibition stand area to obtain the level labels of the visitors; pre-loading the urban planning data needing to be displayed according to the job-level label to obtain pre-loaded data; when an operator selects to display the urban planning data, the preloaded data is displayed on a corresponding display screen, so that visitors cannot feel data loading time delay when the operator displays the urban planning data, and the problems that the data volume of the content needing to be displayed by a large screen in an electronic sand table is large, the loading speed is low, and the display effect is poor are solved. And therefore, large-screen pictures are often disordered, and the visiting experience is influenced.

Description

Technical Field

[0001] The present invention relates to the field of multimedia technology, and in particular to a multi-screen linked sandbox display method and device. Background Art

[0002] As an emerging information display and decision support tool, electronic sand table is gradually widely used in various fields. In the application scenario of urban planning display, the use of electronic sand table to display urban planning data can fully display the geographical location, planning layout, supporting facilities and other key information and characteristic advantages of the designated area to visitors in a two-dimensional and three-dimensional visual form, thereby maximizing the display efficiency.

[0003] However, due to the large amount of content data required to be displayed on the large screen in the electronic sandbox and the slow loading speed, when the content required to be displayed on the large screen is not fully loaded, the large screen image often appears cluttered, resulting in a poor experience for visitors and seriously affecting the efficiency of urban planning display.

[0004] In view of this, overcoming the defects of the prior art is an urgent problem to be solved in the field of this technology. Summary of the invention

[0005] The technical problem to be solved by the present invention is to provide a multi-screen linked sand table display method and device, the purpose of which is to preload the city planning data to be displayed according to the job grade label to obtain the preloaded data; when the operator chooses to display the city planning data, the preloaded data is displayed on the corresponding display screen, so that the visitors do not feel the data loading delay when the operator is displaying, thereby solving the problem that the large screen in the electronic sand table is often cluttered due to the large amount of content data required to be displayed and the slow loading speed, which affects the visitor experience.

[0006] The present invention adopts the following technical solution:

[0007] In a first aspect, the present invention provides a multi-screen linkage sand table display method, in which a multi-screen linkage sand table display device is arranged in an electronic sand table booth area, and an operator displays specified urban planning data by controlling multiple display screens of the multi-screen linkage sand table display device;

[0008] The multi-screen linkage sandbox display method includes:

[0009] Acquire facial images of all visitors in the electronic sandbox booth area to obtain the rank labels of the visitors;

[0010] Preloading the city planning data to be displayed according to the job level label to obtain preloaded data;

[0011] When the operator chooses to display the urban planning data, the preloaded data is displayed on the corresponding display screen.

[0012] Furthermore, the city planning data to be displayed is preloaded according to the job level label, and the preloaded data includes:

[0013] When the sound source of the conversation can be captured in the electronic sand table booth area, the voice is recorded to obtain the voice information;

[0014] Determine the rank label of the visitor corresponding to the voice information;

[0015] When the voice information corresponds to multiple visitors, judging whether the speech content of the visitor in the voice information has preload validity according to the order of the rank of the rank label;

[0016] When the speech content of the visitor has pre-load validity, the pre-load priority of the visitor in the voice information is obtained according to the rank order of the rank label;

[0017] According to the preloading priority, the urban planning data involved in the voice information is preloaded to obtain preloaded data.

[0018] Furthermore, when the voice information corresponds to multiple visitors, judging whether the speech content of the visitor in the voice information has preload validity according to the rank order of the rank labels includes:

[0019] If the voice message is the first conversation during the sandbox display, when the visitor's rank label belongs to management, the visitor's speech content has preload validity;

[0020] If the voice information is not the first conversation in this sandbox display process, the speech content of the visitor whose job level label belongs to the management level has pre-loaded validity; and based on the contextual association relationship between the speech content of each visitor in the voice information, it is determined that the speech content of the visitor whose job level label does not belong to the management level has pre-loaded validity.

[0021] Furthermore, based on the contextual association between the speech contents of each visitor in the voice information, determining that there are speech contents with preloaded validity among visitors whose job level labels do not belong to the management level includes:

[0022] Converting the speech content of each visitor in the voice information from voice format to text format to obtain text content;

[0023] Based on the recording time sequence of the multiple text contents corresponding to the voice information, the semantic relationship between the multiple text contents is analyzed to obtain the contextual association relationship between the speech contents of each visitor in the voice information;

[0024] Determine whether the meaning of the speech of the visitor whose job level label is not management level is a negation of the speech of the visitor whose job level label is management level;

[0025] When the speech content of a visitor whose job grade label belongs to the management level is denied, the corresponding recording time sequence is obtained based on the context association relationship, and it is determined that the speech content in the earlier recording time sequence does not have pre-loading validity, and it is determined that the speech content in the later recording time sequence has pre-loading validity, so as to obtain the speech content with pre-loading validity among the visitors whose job grade label does not belong to the management level.

[0026] Furthermore, when the voice information corresponds to a plurality of visitors, before judging whether the speech content of the visitor in the voice information has preload validity according to the rank order of the rank labels, the method further includes:

[0027] When the voice recording starts, multiple facial images of each visitor in the electronic sandbox booth area are continuously collected to obtain a collection time range of the multiple facial images of each visitor and a recording time range of the speech content of each visitor;

[0028] When there is a collection time range that matches the recording time range, obtaining the visitor corresponding to the collection time range, and obtaining the voice line information of the speech content corresponding to the recording time range;

[0029] A voice mapping relationship is established between the visitor and the voice line information to extract the voice line information of the speech information, and the rank label of the corresponding visitor is obtained based on the extracted voice line information and the voice mapping relationship.

[0030] Furthermore, when the speech content of the visitor has pre-load validity, the pre-load priority of the visitor in the voice information is obtained according to the order of the rank of the rank label, including:

[0031] The order of the job level labels is determined from high to low as the preloading priority order of the corresponding visitors in the voice information to obtain the preloading priority.

[0032] Further, the preloading of the urban planning data involved in the voice information according to the preloading priority to obtain the preloaded data includes:

[0033] Converting the speech content from a voice format to a text format to obtain text content; extracting speech keywords from the text content;

[0034] In the city planning data corresponding to the multiple display screens, content matching is performed using speech keywords respectively to obtain a data identifier of at least one city planning data to be displayed;

[0035] A data identifier is obtained, and at least one urban planning data required to be displayed is cached into a memory to obtain preloaded data.

[0036] Furthermore, a data database is pre-established, the data database including facial information and job level labels of visitors; a camera is set up in the electronic sand table booth area;

[0037] The step of acquiring facial images of all visitors in the electronic sandbox booth area to obtain the rank labels of the visitors includes:

[0038] The facial image of the visitor is collected by the camera; the facial image is matched with the face information in the data database to obtain the corresponding rank label of the visitor.

[0039] In a second aspect, the present invention further provides a multi-screen linked sand table display device, comprising:

[0040] At least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the processor to execute the multi-screen linkage sandbox display method described in the first aspect.

[0041] In a third aspect, the present invention further provides a non-volatile computer storage medium, wherein the computer storage medium stores computer executable instructions, which are executed by one or more processors to complete the multi-screen linkage sandbox display method described in the first aspect.

[0042] In a fourth aspect, a computer program product comprising instructions is provided, which, when executed on a computer or a processor, enables the computer or the processor to execute a multi-screen linkage sandbox display method as described in the first to third aspects and any one of the aspects.

[0043] In a fifth aspect, the present invention further provides a multi-screen linkage sand table display system, comprising a multi-screen linkage sand table display device as in the second aspect, and using the multi-screen linkage sand table display method as described in the first aspect to complete the interaction of the multi-screen linkage sand table display device of the second aspect.

[0044] Different from the prior art, the present invention has at least the following beneficial effects:

[0045] The present invention obtains the rank labels of visitors through facial images of all visitors in the electronic sand table booth area, and preloads the city planning data to be displayed according to the rank labels to obtain preloaded data; when the operator chooses to display the city planning data, the preloaded data is displayed on the corresponding display screen, so that when the operator displays the data, the visitors do not feel the data loading delay, thereby ensuring the experience of the visitors and further improving the efficiency of the city planning display, and solving the problem that the large screen in the electronic sand table is often cluttered and affects the visitor experience due to the large amount of content data required to be displayed and the slow loading speed. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments of the present invention. Obviously, the drawings described below are only some embodiments of the present invention, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0047] Figure 1 is a schematic diagram of an electronic sand table booth area provided by an embodiment of the present invention;

[0048] Figure 2 It is a flowchart of a multi-screen linkage sandbox display method provided by an embodiment of the present invention;

[0049] Figure 3 is a flow chart of step 20 provided in an embodiment of the present invention;

[0050] Figure 4 It is a flowchart of another multi-screen linkage sandbox display method provided by an embodiment of the present invention;

[0051] Figure 5 is a flowchart of step 103 provided by an embodiment of the present invention;

[0052] Figure 6 is a flow chart of step 202 provided in an embodiment of the present invention;

[0053] Figure 7 is a flow chart of step 105 provided in an embodiment of the present invention;

[0054] Figure 8 This is a schematic diagram of a large screen structure of an electronic sand table according to an embodiment of the present invention;

[0055] Fig. 9 This is an overall visual effect diagram of an electronic sand table according to an embodiment of the present invention;

[0056] Fig.10 It is a data interaction flow diagram of a multi-screen linkage sandbox display device provided by an embodiment of the present invention;

[0057] Fig.11 It is a schematic diagram of the architecture of a multi-screen linked sandbox display device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0058] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0059] Unless the context requires otherwise, throughout the specification and claims, the term "including" is to be interpreted as open inclusion, that is, "including, but not limited to". In the description of the specification, the terms "one embodiment", "some embodiments", "exemplary embodiments", "examples", "specific examples" or "some examples" and the like are intended to indicate that specific features, structures, materials or characteristics associated with the embodiment or example are included in at least one embodiment or example of the present disclosure. The schematic representation of the above terms does not necessarily refer to the same embodiment or example. In addition, the specific features, structures, materials or characteristics may be included in any one or more embodiments or examples in any appropriate manner, that is, although they may be carried in the embodiments or examples of the above terms due to reasons such as the order and position of appearance, it is not limited to that they can be carried in combination by one embodiment or example.

[0060] In the description of the present invention, it is necessary to understand that the terms "center", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present disclosure and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present disclosure.

[0061] In the description of the present invention, the terms "first" and "second" are used only for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present disclosure, unless otherwise specified, the meaning of "multiple" is two or more. In addition, for example, the same type of nouns may be described as two independent individuals by adding "A" and "B" at the end. In this case, the corresponding features defined as "A" and "B" are only used to distinguish the same type of individuals for description purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features.

[0062] When describing some embodiments, the expressions "coupling", "coupling" and "connection" and their derivatives may be used. For example, when describing some embodiments, the term "connection" may be used to indicate that two or more components are in direct physical or electrical contact with each other. For another example, when describing some embodiments, the term "coupling" may be used to indicate that two or more components are in direct physical or electrical contact. However, the terms "connection" or "coupling" may also refer to two or more components that are not in direct contact with each other, but still cooperate or interact with each other, such as "optical path coupling", "wireless connection", etc. The embodiments disclosed herein are not necessarily limited to the contents of the present invention.

[0063] In the description of the present invention, the expression "A and / or B" (where A and B are used to formally represent specific characteristic contents) will be involved, and the corresponding expressions include the following three combinations: only A, only B, and a combination of A and B.

[0064] As used herein, "about," "substantially," or "approximately" includes the stated value and an average value that is within an acceptable range of deviation from the particular value as determined by one of ordinary skill in the art taking into account the measurements in question and the errors associated with the measurement of the particular quantity (i.e., the limitations of the measurement system).

[0065] Embodiment 1:

[0066] In order to solve the above problems, an embodiment of the present invention provides a multi-screen linkage sandbox display method. The applicable scenarios of the embodiment of the present invention are first introduced below:

[0067] like Figure 1As shown, a multi-screen linked sand table display device is set in the electronic sand table booth area, and the operator displays the specified urban planning data by controlling the multiple display screens of the multi-screen linked sand table display device. Visitors enter the electronic sand table booth area, stand in front of the multi-screen linked sand table display device to watch the electronic sand table to realize the urban planning display, and inform the operator of the urban planning data to be displayed in the electronic sand table; the operator selects the specified area by clicking on the control end page, thereby realizing the change of the content displayed in the electronic sand table. Among them, visitors include management leaders and ordinary staff.

[0068] like Figure 2 As shown, the multi-screen linkage sandbox display method includes:

[0069] Step 10: Acquire facial images of all visitors in the electronic sandbox booth area to obtain the rank labels of the visitors.

[0070] Among them, a data database is established in advance, and the data database includes facial information and job grade labels of visitors; a camera is set in the electronic sand table booth area; the facial image of the visitor is collected by the camera; the facial image is matched with the facial information in the data database to obtain the corresponding job grade label of the visitor.

[0071] Step 20: Preload the city planning data to be displayed according to the job level label to obtain preloaded data.

[0072] The embodiment of the present invention matches the rank labels of visitors during the city planning display in the data database based on the recorded facial information. In this scenario, the city planning data that may be displayed is preloaded in priority according to the speaking rights of the visitors determined by their rank and in descending order of speaking rights.

[0073] Step 30: When the operator chooses to display the urban planning data, the preloaded data is displayed on the corresponding display screen.

[0074] In one embodiment, the operator may be regarded as a visitor so that his / her speech may be used as a basis for preloading the urban planning data.

[0075] It should be noted that, in the embodiment of the present invention, when preloading is performed, the content currently displayed on the large screen of the electronic sandbox remains unchanged, and the preloading is only for caching the corresponding urban planning data. When the operator chooses to display the urban planning data on the large screen, the content currently displayed on the large screen will change. By preloading the urban planning data that may be displayed in advance, the delay in the visitor's perception of the large screen image can be minimized as much as possible when the operator chooses to display a certain urban planning data.

[0076] The present invention obtains the rank labels of visitors through facial images of all visitors in the electronic sand table booth area, and preloads the city planning data to be displayed according to the rank labels to obtain preloaded data; when the operator chooses to display the city planning data, the preloaded data is displayed on the corresponding display screen, so that when the operator displays the data, the visitors do not feel the data loading delay, thereby ensuring the experience of the visitors and further improving the efficiency of the city planning display, and solving the problem that the large screen in the electronic sand table is often cluttered and affects the visitor experience due to the large amount of content data required to be displayed and the slow loading speed.

[0077] The following is a detailed description of the process of preloading based on job level labels:

[0078] like Figure 3 As shown, in step 20, the city planning data to be displayed is preloaded according to the job level label, and the preloaded data includes:

[0079] Step 101: When the conversation sound source can be captured in the electronic sand table booth area, voice recording is performed to obtain voice information.

[0080] Step 102: Determine the rank label of the visitor corresponding to the voice information.

[0081] Step 103: When the voice information corresponds to multiple visitors, it is determined whether the speech content of the visitors in the voice information has preload validity according to the order of the rank of the rank labels.

[0082] Among them, the preloading validity means that the city areas involved in the speech content may need to be loaded.

[0083] Step 104: When the speech content of the visitor has pre-loading validity, the pre-loading priority of the visitor in the voice information is obtained according to the rank order of the rank label.

[0084] Among them, the order of the job level labels is determined as the preloading priority order of the corresponding visitors in the voice information in order from high to low, so as to obtain the preloading priority.

[0085] That is, the higher the job grade label, the higher the preloading priority; for example, when the job grade label of visitor 1 is a leader at the management level, and the job grade label of visitor 2 is an ordinary staff member, the preloading priority of visitor 1 is higher than that of visitor 2.

[0086] Step 105: Preload the city planning data involved in the voice information according to the preloading priority to obtain preloaded data.

[0087] Among them, each urban planning data that can be displayed in the electronic sandbox has a corresponding data identifier. When the data identifier or keyword of a certain urban planning data is mentioned in the speech content of the voice information, the voice information involves the urban planning data.

[0088] In one embodiment, the city planning data is cached into the memory to complete the preloading and obtain the preloaded data.

[0089] In order to determine whether the visitor's speech content in the voice information has pre-load validity, such as Figure 4 As shown, when the voice information corresponds to multiple visitors, before judging whether the speech content of the visitor in the voice information has preload validity according to the order of the rank of the rank label, it also includes:

[0090] Step 201: When starting voice recording, continuously collect multiple facial images of each visitor in the electronic sandbox booth area to obtain the collection time range of the multiple facial images of each visitor and the recording time range of the speech content of each visitor.

[0091] Step 202: When a collection time range matches a recording time range, obtain the visitor corresponding to the collection time range, and obtain the voice line information of the speech content corresponding to the recording time range.

[0092] The embodiment of the present invention matches the speech content with the job level label by matching the collection time range with the recording time range, thereby determining the preloading priority of the urban planning data involved in the speech content. In one embodiment, a sound recognition model can be used to extract the voice information of each visitor from the speech content.

[0093] Step 203: establishing a human voice mapping relationship between the visitor and the voice line information to extract the voice line information of the speech information, and obtaining the corresponding rank label of the visitor based on the extracted voice line information and the human voice mapping relationship.

[0094] After obtaining the visitor's job level label, you also need to determine the pre-loaded validity of the speech content according to the job level label, such as Figure 5 As shown, in step 103, when the voice information corresponds to multiple visitors, judging whether the speech content of the visitor in the voice information has preload validity according to the rank order of the rank labels includes:

[0095] Step 301: If the voice information is the first dialogue in this sandbox display process, when the visitor's rank label belongs to management, the visitor's speech content has preload validity.

[0096] Since the applicable scenario of the embodiment of the present invention is that there are both management leaders and ordinary visitors among the visitors, and in the process of urban planning display, the leaders with the rank label of management among the visitors have greater say, the embodiment of the present invention focuses on the speech content of the leaders and determines the pre-loading validity around it; for the first dialogue, by only determining the pre-loading validity of the speech content corresponding to the rank label belonging to the management, ignoring the speech content of other visitors before the speech content of the leader, the urban planning data that the leader needs to view is pre-loaded, so that when the operator receives the instruction of the leader to select the urban planning data, the large screen can display the urban planning data without delay in terms of physical perception.

[0097] In an optional embodiment, the sound information in the electronic sand table booth area can be continuously collected. When the sound source of the conversation can be captured from the sound information, the current time is recorded as the start time of this conversation; when the sound source of the conversation cannot be captured, and the sound source of the conversation cannot be captured for a certain period of time, the starting time point when the sound source of the conversation cannot be captured is determined as the end time of this conversation; based on the start time of this conversation and the end time of this conversation, the first conversation in this sand table display process is determined. Among them, the preset time is determined by those skilled in the art based on the specific usage scenario and experience; in an optional embodiment, the time interval between the end time of each sand table display process and the start time of the next sand table display process can be counted to construct a time data set, and the intelligent model is used to perform big data learning on the time data set to obtain the preset time. In addition, the start time when the camera in the electronic sand table booth area can continuously collect the same batch of facial information can be determined as the start time of this conversation; when the start time of this conversation to the time when the batch of facial information cannot be continuously collected, the start time when the batch of facial information cannot be collected is determined as the end time of this conversation.

[0098] Step 302: If the voice information is not the first conversation in this sandbox display process, the speech content of the visitor whose job level label belongs to the management level has pre-loaded validity; and based on the contextual association relationship between the speech content of each visitor in the voice information, it is determined that the speech content of the visitor whose job level label does not belong to the management level has pre-loaded validity.

[0099] In this embodiment, the speech content of the visitor whose rank label does not belong to the management level may have preloaded validity or may not have preloaded validity, which depends on the association relationship between the speech contents of each visitor.

[0100] When the voice information is not the first dialogue in the sandbox display process, the embodiment of the present invention determines the pre-load validity of the speech content of the management leader; and based on the contextual association relationship, around the speech content of the management leader, it is judged whether the speech content of the visitor whose rank label does not belong to the management level has pre-load validity. Specifically, Figure 6 As shown, in step 202, based on the contextual association between the speech contents of each visitor in the voice information, determining that there are speech contents with preloaded validity among visitors whose job level labels do not belong to the management level includes:

[0101] Step 401: converting the speech content of each visitor in the voice information from a voice format to a text format to obtain text content.

[0102] Step 402: Based on the recording time sequence of the multiple text contents corresponding to the voice information, the semantic relationship between the multiple text contents is analyzed to obtain the context association relationship between the speech contents of each visitor in the voice information.

[0103] In one embodiment, a natural language model may be used to extract semantic relationships between multiple text contents to obtain contextual association relationships.

[0104] Step 403: Determine whether the meaning of the speech content of the visitor whose job level label does not belong to the management level is a negation of the speech content of the visitor whose job level label belongs to the management level.

[0105] In one embodiment, a natural language model may be used to determine whether the meanings expressed by the speeches of two visitors are consistent, so as to improve the accuracy of the determination.

[0106] Step 404: When the speech content of the visitor whose job grade label belongs to the management level is denied, the corresponding recording time sequence is obtained based on the context association relationship, and it is determined that the speech content in the earlier recording time sequence does not have pre-loading validity, and it is determined that the speech content in the later recording time sequence has pre-loading validity, so as to obtain the speech content with pre-loading validity among the visitors whose job grade label does not belong to the management level.

[0107] The embodiments of the present invention recognize the pre-loaded validity of speech content, all of which revolve around the speech content of the management leader; for example, when the voice information is not the first dialogue in the sandbox display process, the speech content of the management leader is "enlarge the park facilities in large screen No. 3", which is in the first time sequence, and the speech content of the ordinary visitor is "there are no park facilities in large screen No. 3, only large screen No. 1 has park facilities, and the park facilities are enlarged in large screen No. 1", which is in the latter time sequence. The meaning expressed by the latter's speech content is a negation of the former's speech content; at this time, it is determined that the speech content "enlarge the park facilities in large screen No. 3" does not have pre-loaded validity, and the speech content "enlarge the park facilities in large screen No. 1" is determined to have pre-loaded validity.

[0108] It should be noted that the speech content of visitors whose job level labels do not belong to the management level may or may not have preload validity. For example, the speech content of the management level leader is "enlarge the area marked in red on the No. 1 large screen", and the speech content of the ordinary visitor is "the planning and construction of the park facilities in the red area are good". The meaning expressed by the latter's speech content does not negate the former's speech content, so it is determined that the speech content "enlarge the area marked in red on the No. 1 large screen" has preload validity, and the speech content "the planning and construction of the park facilities in the red area are good" does not have preload validity.

[0109] In order to explain the process of preloading when there is preloading validity, such as Figure 7 As shown, in step 105, the city planning data involved in the voice information is preloaded according to the preloading priority, and the preloaded data includes:

[0110] Step 501: convert the speech content from a voice format to a text format to obtain text content; and extract speech keywords from the text content.

[0111] In one embodiment, a natural language model that completes a named entity recognition task may be used to extract speech keywords from text content.

[0112] Step 502: using speech keywords to perform content matching on the city planning data corresponding to the multiple display screens, respectively, to obtain a data identifier of at least one city planning data to be displayed.

[0113] Step 503: Obtain a data identifier, and cache the at least one urban planning data required to be displayed into a memory to obtain preloaded data.

[0114] In order to ensure the normal operation of the server of the multi-screen linked sandbox display device, in an optional embodiment, a loading ratio threshold can also be set to limit the amount of preloaded urban planning data; for example, when the loading ratio threshold is 60%, due to the limited storage space of the server, after preloading the contents in the three large screens in the electronic sandbox, the memory resource occupancy rate of the preloaded data reaches 60%, then the preloading is temporarily stopped, and only the urban planning data in the three large screens are preloaded, and subsequently, after the operator selects to display the urban planning data corresponding to each preloaded data in turn, or after a preset time interval, voice recording is performed again, and new preloaded data is generated according to the re-recorded voice information; in an optional embodiment, since visitors generally do not need to frequently view areas with large location differences in a short period of time, the preset time interval can be 1 minute.

[0115] In the embodiment of the present invention, since the time taken by visitors to speak is often in the order of seconds, and even in the applicable scenarios of the embodiment of the present invention, visitors will observe the content displayed on the large screen and discuss the content in combination with multiple large screens. This process is time-consuming. Therefore, in this process, the multi-screen linkage sandbox display method of the embodiment of the present invention is used in advance to perform voice recording, convert voice information into text content, and preload according to job grade labels. When the operator selects the urban planning data to be displayed, the corresponding urban planning data is displayed immediately, so as to minimize the delay perceived by the visitor through preloading.

[0116] Embodiment 2:

[0117] like Figure 8 As shown, the electronic sand table of the embodiment of the present invention comprises a bottom screen (such as Figure 8 The large screen with the number 1 in the middle), a vertical screen (such as Figure 8 The large screen with the number 2), two side screens (such as Figure 8 The screens No. 1, 3 and 4 are two-dimensional screens, and screen No. 2 is a three-dimensional screen. The overall visual effect is as follows: Fig. 9 In the application scenario of urban planning display, specifically, the bottom screen displays global information in the form of two-dimensional data through a map; the vertical screen displays the real status of each area and related annotations through real-life three-dimensional data, such as Fig. 9 As shown in the box and text above the neutral screen, the corresponding amount of loaded data reaches 100GB; the two side screens are assisted by graphics and text, for example Fig. 9 The image is displayed on the upper left side screen and the corresponding text description is displayed on the lower side; Fig. 9The right side screen displays a two-dimensional plane map, and there are text annotations of corresponding positions on the two-dimensional plane map. The contents displayed on the four large screens are controlled by a control terminal; in an optional embodiment, the control terminal can be a mobile phone and a tablet. It should be noted that the multi-screen linkage sand table display method of the embodiment of the present invention is applicable to an electronic sand table with both a two-dimensional large screen and a three-dimensional large screen, such as Figure 8 and Fig. 9 The electronic sandbox shown is a specific example provided by an embodiment of the present invention. Figure 8 The large screen composition of the electronic sand table shown in the figure, as well as Fig. 9 The configuration of the contents displayed on each large screen shown in the figure is only used to explain the present invention and is not used to limit the present invention. Figure 8 The numbers of medium and large screens refer to the corresponding large screens.

[0118] The content displayed on the 3D and 2D screens under the same theme is often loaded first due to different data volumes. The loading time of screens 1 and 2 varies according to the different data volumes involved in different themes. Among them, the loading time of screen 2 is slow because the data volume of the 3D data loaded on screen 2 exceeds 100GB. In actual implementation, the loading interval between screens 1 and 2 is long, resulting in a poor experience for visitors.

[0119] It should be noted that the scenario targeted by the embodiment of the present invention is: the electronic sand table has been started, that is, the urban planning data is being displayed on both the three-dimensional large screen and the two-dimensional large screen, the center coordinates of the designated area displayed in real time on the two-dimensional large screen are the current two-dimensional center coordinates, and the center coordinates of the designated area displayed in real time on the three-dimensional large screen are the current three-dimensional center coordinates; the user selects the theme that needs to be displayed on the corresponding large screen next, and the designated area in the corresponding theme on the control end of the electronic sand table. At this time, for the selected large screen, its current two-dimensional center coordinates or current three-dimensional center coordinates are updated to the center coordinates of the designated area selected by the user, so as to switch the display focus of the corresponding large screen to the designated area selected by the user. Among them, when the electronic sand table is just started, the current two-dimensional center coordinates or current three-dimensional center coordinates of the corresponding large screen can be defaulted to the center coordinates of the complete area under a certain theme that can be displayed on the large screen.

[0120] In order to solve the above problems, Fig.10As shown, in this embodiment, the two-dimensional page site controls the two-dimensional large screen, and the three-dimensional page site controls the three-dimensional large screen; the current two-dimensional center coordinates are obtained from the two-dimensional page site. The server of the embodiment of the present invention stores all urban planning data, and realizes data transmission through the interaction between the server and the client. Among them, the two-dimensional page site can be understood as the client of the corresponding two-dimensional large screen, the three-dimensional page site can be understood as the client of the corresponding three-dimensional large screen, and the control-end page site can be understood as the client of the corresponding control-end screen (for example, a flat screen); a two-dimensional page site can control at least one two-dimensional large screen, a three-dimensional page site can control at least one three-dimensional large screen, and a control-end page site can realize data interaction with at least one control-end screen. The server determines the current key display areas of the two-dimensional page site and the three-dimensional page site in real time by obtaining the current two-dimensional center coordinates from the two-dimensional page site and the current three-dimensional center coordinates from the three-dimensional page site.

[0121] The applicable scenarios of the embodiments of the present invention are described below:

[0122] The user accesses the control end page through the control end application installed on the control end, selects a theme to be viewed through the control end screen, and the control end page site transmits the theme information selected by the user to the server in the form of display update instructions. After the server receives the theme information and confirms that the user has the authority to access the resources of the urban planning data in the theme, the server will broadcast the content update instructions to all sites. After each site listens to the content update instructions, it will display the content it needs to display according to the content update instructions to present the theme selected by the user; among them, the user can be a visitor or a specific operator of the electronic sand table, which is not limited here; all sites refer to: all two-dimensional page sites, three-dimensional page sites and control end page sites controlled by the server of the electronic sand table.

[0123] When the two-dimensional page site determines that the two-dimensional center coordinates to be displayed are different from the current two-dimensional center coordinates, control information is generated according to the two-dimensional center coordinates to be displayed. The two-dimensional center coordinates to be displayed are the center coordinates of the designated area to be displayed. The control information is broadcast so that the two-dimensional page site can display the designated area on the two-dimensional large screen according to the two-dimensional center coordinates to be displayed, and the three-dimensional page site can display the corresponding designated area on the three-dimensional large screen according to the control information. Under the same theme, the two-dimensional large screen displays the urban planning data of the same designated area in the form of two-dimensional data, and the three-dimensional large screen displays the urban planning data of the same designated area in the form of three-dimensional data. Fig.10As shown, after the user selects the designated area to be displayed through the control end, the 2D page site transmits the center point spatial information of the designated area (i.e., the 2D center coordinates to be displayed) to the server end, and the server end broadcasts the control information to all 2D page sites and 3D page sites. After the 2D page site receives the 2D center coordinates to be displayed containing the control information, it displays the designated area on the 2D large screen based on the 2D center coordinates to be displayed. After the 3D page site receives the 2D center coordinates to be displayed containing the control information, it displays the designated area on the 3D large screen based on the 2D center coordinates to be displayed.

[0124] The present invention controls the two-dimensional large screen through a two-dimensional page site and controls the three-dimensional large screen through a three-dimensional page site. When the two-dimensional page site determines that the two-dimensional center coordinates to be displayed are different from the current two-dimensional center coordinates of the two-dimensional large screen, the server generates control information according to the two-dimensional center coordinates to be displayed and broadcasts it, so that the three-dimensional page site displays the corresponding designated area according to the control information. After the two-dimensional center coordinates to be displayed of the two-dimensional large screen are obtained, the server transmits the control information containing the two-dimensional center coordinates to be displayed to the three-dimensional page site, and each site starts to load data at the same time through the broadcast mechanism, and reduces the interval between the loading completion time of the two-dimensional large screen and the three-dimensional large screen as much as possible, so that all sites display the corresponding pictures based on the two-dimensional center coordinates to be displayed, so as to achieve the effect that the three-dimensional large screen follows the two-dimensional large screen to adjust the picture display center, thereby realizing the control of the loading completion time and sequence of the displayed pictures, greatly improving the user experience, and solving the problem that the loading completion time and sequence of the two-dimensional large screen and the three-dimensional large screen cannot be controlled at all due to the large difference in the amount of content data displayed by the two-dimensional large screen and the three-dimensional large screen, resulting in a messy displayed picture and a poor visitor experience.

[0125] The following is an explanation of the specific process of displaying a designated area on a 2D large screen and a 3D large screen:

[0126] Under the premise that all sites have been started and the theme selected by the user already exists, when the user does not switch the theme and selects the designated area to be displayed, it is necessary to link the two-dimensional large screen and the three-dimensional large screen to display the details of the designated area respectively. At this time, there are two situations: one is that when the user views the two-dimensional large screen by dragging up and down or zooming in and out through the control end, the two-dimensional page site transmits the two-dimensional center coordinates to be displayed to the server; the server generates control information according to the two-dimensional center coordinates to be displayed and broadcasts the control information; the two-dimensional page site receives the control information and displays the designated area on the two-dimensional large screen according to the control information; the three-dimensional page site receives the control information and displays the designated area on the three-dimensional large screen according to the control information. At this time, the two-dimensional center coordinates to be displayed are transmitted to the server, and the server encapsulates the two-dimensional center coordinates to be displayed together with the relevant parameters for loading as control information and broadcasts it. After the two-dimensional page site receives it, the two-dimensional details of the designated area are displayed on the corresponding two-dimensional large screen, and after the three-dimensional page site receives it, the three-dimensional details of the designated area are displayed on the corresponding three-dimensional large screen, thereby ensuring that the three-dimensional display content is always switched with the two-dimensional large screen, improving the user experience.

[0127] In another case, the user selects the designated area to be displayed in the two-dimensional large screen through the control end page, so that the two-dimensional page site obtains the two-dimensional center coordinates to be displayed. The user selects the designated area for display by clicking on the control end screen; in one embodiment, the location information of the designated area can be highlighted on the two-dimensional large screen by highlighting the screen, so that the user can confirm whether to change his selection. The current three-dimensional center coordinates are obtained from the three-dimensional page site, and the current three-dimensional performance parameters are obtained from the three-dimensional page site. In an optional embodiment, the current three-dimensional performance parameters include the number of frames per second of the screen, the number of frames per second (Frames Per Second, abbreviated as FPS) of the current browser screen; the three-dimensional loading parameters include the view to be loaded and the animation loading time; wherein the view to be loaded is used to adjust the actual amount of data loaded in the three-dimensional scene; in an optional embodiment, the animation loading time can be tested multiple times by setting different FPS to obtain the corresponding experience value, and the corresponding experience value is selected as the animation loading time of this loading according to the number of frames per second of the screen. The two-dimensional page site determines whether the two-dimensional center coordinates to be displayed are the same as the current two-dimensional center coordinates; when the two-dimensional center coordinates to be displayed are not the same as the current two-dimensional center coordinates, the two-dimensional page site transmits the two-dimensional center coordinates to be displayed to the server. According to the current three-dimensional center coordinates and the current three-dimensional performance parameters, a three-dimensional loading parameter is obtained. The server encapsulates the two-dimensional center coordinates to be displayed and the three-dimensional loading parameter into control information, and broadcasts the control information to all two-dimensional page sites and three-dimensional page sites.

[0128] like Fig.10 As shown, the two-dimensional page site, the three-dimensional page site and the control-end page site log in to the server through the browser respectively. In an optional embodiment, the websocket protocol is used to establish a two-way connection between the control-end page site, the two-dimensional page site and the three-dimensional page site and the server respectively, so as to quickly transmit multiple messages on the same connection path.

[0129] After the broadcasting of the control information, the method further includes: after the control end page controlled by the control end page site, the two-dimensional large screen controlled by the two-dimensional page site, and the three-dimensional large screen controlled by the three-dimensional page site receive the control information from the corresponding site, they synchronously display the designated area according to the control information. Among them, a control end page site controls at least one control end page, a two-dimensional page site controls at least one two-dimensional large screen, and a three-dimensional page site controls at least one three-dimensional large screen. After the two-dimensional large screen receives the broadcasted control information from the two-dimensional page site, it synchronously displays the designated area on the two-dimensional large screen according to the control information; after the three-dimensional large screen receives the broadcasted control information from the three-dimensional page site, it synchronously displays the designated area on the three-dimensional large screen according to the control information; after the control end page receives the broadcasted control information from the control end page site, it synchronously displays the designated area on the control end page according to the control information. In one embodiment, the linkage control of the two-dimensional large screen, the three-dimensional large screen, and the control end screen can be realized by broadcasting the control information to all sites, and a set of pictures can be adaptively displayed on each large screen and the control end screen respectively, thereby improving the user experience.

[0130] The two-dimensional page site and the three-dimensional page site display the screen on the large screen in the same way according to the control information. The following takes the three-dimensional page site as an example to illustrate the process. The three-dimensional page site displays the corresponding designated area on the three-dimensional large screen according to the control information, including: setting the current three-dimensional center coordinates to the two-dimensional center coordinates to be displayed to complete the relocation processing of the current three-dimensional center coordinates of the three-dimensional large screen; according to the relocated current three-dimensional center coordinates, obtaining the city planning data required to be displayed on the three-dimensional large screen; according to the three-dimensional loading parameters, loading the city planning data so that the three-dimensional large screen displays the designated area. Since all sites in the embodiment of the present invention relocate the center coordinates according to the corresponding spatial information received (i.e., the two-dimensional center coordinates to be displayed in the control information), it can ensure that the content displayed on the three-dimensional large screen can always switch with the two-dimensional large screen, thereby improving the user experience.

[0131] In an optional embodiment, after the two-dimensional page site and the three-dimensional page site listen to the broadcast, the two-dimensional and three-dimensional scenes and the city planning introduction animation can be loaded synchronously, and the city planning introduction animation can be played first. After the playing is completed, the loaded data can be displayed on the corresponding large screen to further reduce the interval between the loading completion time of the content displayed on the two-dimensional large screen and the three-dimensional large screen, so as to avoid visitors seeing messy pictures during the data loading process, resulting in a poor viewing experience.

[0132] In addition, when it is necessary to switch the theme, the city planning data to be displayed is determined according to the information of the theme to be switched; a content update instruction is generated; wherein the content update instruction carries the city planning data to be displayed and the corresponding loading parameters. The corresponding loading parameters include: the field of view to be loaded and the animation loading duration of each two-dimensional large screen and three-dimensional large screen. The content update instruction is broadcasted, so that when the two-dimensional page site listens to the content update instruction and the three-dimensional page site listens to the content update instruction, the city planning data is synchronously loaded based on the received loading parameters and displayed on the corresponding large screen.

[0133] In one embodiment, using the two-dimensional, three-dimensional, multi-screen linked urban planning sand table display method of the embodiment of the present invention, the two-dimensional large screen and the three-dimensional large screen in the electronic sand table can be used to synchronously and completely present the images of the designated area in front of visitors, thereby controlling the time difference between loading the two-dimensional and three-dimensional complete images and switching the images within a range of 1 to 2 seconds.

[0134] Embodiment 3:

[0135] like Fig.11 , which is a schematic diagram of the architecture of a multi-screen linkage sandbox display device according to an embodiment of the present invention. The multi-screen linkage sandbox display device according to this embodiment includes one or more processors 21 and a memory 22. Fig.11 A processor 21 is taken as an example.

[0136] The processor 21 and the memory 22 may be connected via a bus or other means. Fig.11 The example of connecting through bus is taken in the following.

[0137] The memory 22 is a non-volatile computer-readable storage medium that can be used to store non-volatile software programs and non-volatile computer executable programs, such as the multi-screen linkage sandbox display method in this embodiment. The processor 21 executes the multi-screen linkage sandbox display method by running the non-volatile software programs and instructions stored in the memory 22.

[0138] The memory 22 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage devices. In some embodiments, the memory 22 may optionally include a memory remotely arranged relative to the processor 21, and these remote memories may be connected to the processor 21 via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0139] The program instructions / modules are stored in the memory 22, and when executed by the one or more processors 21, the multi-screen linkage sandbox display method in the above-mentioned embodiment is executed, for example, each step of the multi-screen linkage sandbox display method in the embodiment of the present invention described above is executed.

[0140] An embodiment of the present invention further provides a non-volatile computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are executed by one or more processors, such as Fig.11 A processor 21 can enable the above one or more processors to execute the multi-screen linkage sandbox display method in the specific implementation mode of the present invention, for example, to execute the various steps of the multi-screen linkage sandbox display method in the embodiment of the present invention described above; it can also realize Fig.11 The modules and units described above; or executing the multi-screen linkage sandbox display method in a specific embodiment of the present invention, for example, executing the various steps of the multi-screen linkage sandbox display method in the embodiment of the present invention described above; it can also be realized Fig.11 The various modules and units described.

[0141] It is worth noting that the information interaction, execution process, etc. between the modules and units within the above-mentioned devices and systems are based on the same concept as the processing method embodiment of the present invention. The specific contents can be found in the description of the method embodiment of the present invention and will not be repeated here.

[0142] A person skilled in the art may understand that all or part of the steps in the various methods of the embodiments may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the storage medium may include: a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, etc.

[0143] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A multi-screen linkage sand table display method, characterized in that: A multi-screen linked sand table display device is set in the electronic sand table booth area, and an operator displays designated urban planning data by controlling multiple display screens of the multi-screen linked sand table display device; The multi-screen linkage sandbox display method includes: Acquire facial images of all visitors in the electronic sandbox booth area to obtain the rank labels of the visitors; Preloading the city planning data to be displayed according to the job level label to obtain preloaded data; When the operator chooses to display the urban planning data, the preloaded data is displayed on the corresponding display screen.

2. The multi-screen linkage sand table display method according to claim 1 is characterized in that: The city planning data to be displayed is preloaded according to the job level label, and the preloaded data obtained includes: When the sound source of the conversation can be captured in the electronic sand table booth area, the voice is recorded to obtain the voice information; Determine the rank label of the visitor corresponding to the voice information; When the voice information corresponds to multiple visitors, judging whether the speech content of the visitor in the voice information has preload validity according to the order of the rank of the rank label; When the speech content of the visitor has pre-load validity, the pre-load priority of the visitor in the voice information is obtained according to the rank order of the rank label; According to the preloading priority, the urban planning data involved in the voice information is preloaded to obtain preloaded data.

3. The multi-screen linkage sand table display method according to claim 2 is characterized in that: When the voice information corresponds to multiple visitors, judging whether the speech content of the visitor in the voice information has preload validity according to the order of the rank of the rank tags includes: If the voice message is the first conversation during the sandbox display, when the visitor's rank label belongs to management, the visitor's speech content has preload validity; If the voice information is not the first conversation in this sandbox display process, the speech content of the visitor whose job level label belongs to the management level has pre-loaded validity; and based on the contextual association relationship between the speech content of each visitor in the voice information, it is determined that the speech content of the visitor whose job level label does not belong to the management level has pre-loaded validity.

4. The multi-screen linkage sand table display method according to claim 3 is characterized in that: The determining of the speech contents of the visitors whose job level labels do not belong to the management level and which have preloaded validity based on the contextual association relationship between the speech contents of the visitors in the voice information includes: Converting the speech content of each visitor in the voice information from voice format to text format to obtain text content; Based on the recording time sequence of the multiple text contents corresponding to the voice information, the semantic relationship between the multiple text contents is analyzed to obtain the contextual association relationship between the speech contents of each visitor in the voice information; Determine whether the meaning of the speech of the visitor whose job level label is not management level is a negation of the speech of the visitor whose job level label is management level; When the speech content of a visitor whose job grade label belongs to the management level is denied, the corresponding recording time sequence is obtained based on the context association relationship, and it is determined that the speech content in the earlier recording time sequence does not have pre-loading validity, and it is determined that the speech content in the later recording time sequence has pre-loading validity, so as to obtain the speech content with pre-loading validity among the visitors whose job grade label does not belong to the management level.

5. The multi-screen linkage sand table display method according to claim 2 is characterized in that: When the voice information corresponds to multiple visitors, before judging whether the speech content of the visitor in the voice information has preload validity according to the rank order of the rank labels, the method further includes: When the voice recording starts, multiple facial images of each visitor in the electronic sandbox booth area are continuously collected to obtain a collection time range of the multiple facial images of each visitor and a recording time range of the speech content of each visitor; When there is a collection time range that matches the recording time range, obtaining the visitor corresponding to the collection time range, and obtaining the voice line information of the speech content corresponding to the recording time range; A voice mapping relationship is established between the visitor and the voice line information to extract the voice line information of the speech information, and the rank label of the corresponding visitor is obtained based on the extracted voice line information and the voice mapping relationship.

6. The multi-screen linkage sand table display method according to claim 2 is characterized in that: When the speech content of the visitor has pre-load validity, the pre-load priority of the visitor in the voice information is obtained according to the order of the rank of the rank label, including: The order of the job level labels is determined from high to low as the preloading priority order of the corresponding visitors in the voice information to obtain the preloading priority.

7. The multi-screen linkage sand table display method according to claim 2 is characterized in that: Preloading the urban planning data involved in the voice information according to the preloading priority to obtain the preloaded data includes: Converting the speech content from a voice format to a text format to obtain text content; extracting speech keywords from the text content; In the city planning data corresponding to the multiple display screens, content matching is performed using speech keywords respectively to obtain a data identifier of at least one city planning data to be displayed; A data identifier is obtained, and at least one urban planning data required to be displayed is cached into a memory to obtain preloaded data.

8. The multi-screen linkage sandbox display method according to any one of claims 1 to 7, characterized in that: Establish a data database in advance, which includes the facial information and job level labels of visitors; set up cameras in the electronic sand table booth area; The step of acquiring facial images of all visitors in the electronic sandbox booth area to obtain the rank labels of the visitors includes: The facial image of the visitor is collected by the camera; the facial image is matched with the face information in the data database to obtain the corresponding rank label of the visitor.

9. A multi-screen linked sand table display device, characterized in that: The multi-screen linked sandbox display device comprises at least one processor and a memory, wherein the at least one processor and the memory are connected via a data bus, and the memory stores instructions executable by the at least one processor, and after being executed by the processor, the instructions are used to implement the multi-screen linked sandbox display method described in any one of claims 1 to 8.

10. A non-volatile computer storage medium, characterized in that: The computer storage medium stores computer executable instructions, and the computer executable instructions are executed by one or more processors to complete the multi-screen linkage sandbox display method described in any one of claims 1-8.

Images