Intelligent virtual cloud exhibition server, method and electronic equipment

Abstract

The invention relates to an intelligent virtual cloud exhibition server, an intelligent virtual cloud exhibition method and electronic equipment, WebGL (Web Graphics Library) 3D (Three Dimensional) modeling service is provided by adopting a WebGL technology, complicated calculation is completed by the server as much as possible based on a browser, the loading speed is high, the flow is small, the equipment requirement is low, and cross-platform and cross-terminal can be realized. Therefore, compared with a traditional virtual display technology that modeling scene files need to be downloaded in advance, rendering is carried out mainly through local equipment. According to the WebGL technology provided by the invention, 3D modeling and rendering can be carried out in combination with the virtual cloud, and occupation of a rendering thread of a local server is avoided. According to the invention, the algorithm engine is adopted to carry out audio and video and action analysis and mapping, action interaction can be carried out in the exhibition model, the artificial intelligence algorithm is adopted to enable the exhibition model to realize interaction, and the dynamic interactivity and practical applicability of the exhibition are improved.

Description

Technical Field

[0001] The present disclosure relates to the field of smart exhibition technology, and in particular to an intelligent virtual cloud exhibition server, system, application method and electronic device. Background Art

[0002] With the development and application of Internet of Things technology, the iteration and upgrading of virtual display technology, the exhibition industry has entered a new stage of development with digital transformation and intelligent upgrading. Exhibition hall projects, as important scenes for exhibitions, have also begun to put forward higher requirements for intelligent and information construction.

[0003] The exhibition hall intelligent central control management system is the core of the intelligent exhibition hall. It has the basic characteristics of platformization, digitization, and networking. The Cloud Smart Exhibition Intelligent Central Control Platform focuses on the construction and operation scenarios of intelligent exhibition halls, providing exhibition hall data management, cloud display of exhibits, equipment management, network security, remote management and other multi-functional, all-round one-stop solutions. It creates a basic platform for the construction of low-carbon, intelligent digital exhibition halls.

[0004] Traditional virtual display technologies, such as VR technology, require pre-downloading of modeling scene files and mainly rely on local devices for rendering. Therefore, it consumes a large number of running threads and running resources of the local server / GPU, resulting in slow loading speeds and huge traffic consumption, especially in three-dimensional exhibition modeling technologies such as virtual exhibitions.

[0005] In addition, in traditional virtual displays, static display technologies are generally used. These technologies are popular in static displays and interactions, but they are mainly one-to-one application scenarios and multimedia interactive data configurations for corresponding scenarios. Therefore, in dynamic interactions, such as security inspection and security scenarios, it is impossible to flexibly perform centralized interactive control with application scenarios, and it is impossible to centrally manage multimedia and multi-scene switching. Moreover, traditional virtual display technologies are mostly systematic multimedia interactive configuration data. In virtual interactions, there is no virtual interaction combined with multimedia data of actual user interactions, and there is a lack of multimedia interactivity with users. Summary of the invention

[0006] In order to solve the above problems, the present application proposes an intelligent virtual cloud exhibition server, system and application method thereof and electronic device.

[0007] On the one hand, the present application proposes an intelligent virtual cloud exhibition server, comprising:

[0008] Security layer, used to provide network security communication services;

[0009] The physical layer provides the underlying physical hardware;

[0010] Data layer, used to provide data storage services;

[0011] Network layer, used to provide network transmission services;

[0012] The platform layer is used to provide services such as exhibition hall design, rendering, and generation of dynamic models of virtual cloud exhibition halls;

[0013] The application layer is used to display the dynamic model of the exhibition hall.

[0014] As an optional implementation scheme of the present application, optionally, the physical layer includes:

[0015] Operating system, used to provide system operations;

[0016] A virtual cloud system is deployed on a cloud server and is called through a cloud gateway to provide virtual cloud services for the platform layer;

[0017] AI-box is used to provide audio and video AI processing algorithms, identify and process the audio, video and motion data of exhibitors, and extract the audio, face video images and / or motion posture information of the corresponding exhibitors;

[0018] Cameras are used to collect video motion data of exhibitors in various areas of the exhibition venue;

[0019] Audio acquisition equipment is used to collect audio data from exhibitors in various areas of the exhibition venue.

[0020] As an optional implementation scheme of the present application, optionally, the network layer is used to provide the following network communications:

[0021] Cloud API, IOT interface, 5G communication module, cloud gateway, wireless module and / or switch.

[0022] As an optional implementation scheme of the present application, optionally, the platform layer includes:

[0023] 3D engine, used to provide WebGL3D modeling services;

[0024] Algorithm engine, used to provide various data processing algorithm services;

[0025] SDN control management module, used for permission setting;

[0026] Posture recognition system, used to identify the motion and posture information of exhibitors and their control gestures;

[0027] AI voice assistant, used to obtain audio information from exhibitors and convert it into corresponding subtitle information;

[0028] The backstage management center is used for backstage management, including: identifying the facial video images of exhibitors and obtaining the personnel information of exhibitors; analyzing the audio, video and motion data of exhibitors to obtain the audio, facial video images and / or motion posture information of exhibitors in various areas of the exhibition venue, and binding the audio, facial video images and / or motion posture information to the identity ID of the corresponding exhibitors; issuing corresponding control instructions according to the control gestures of the exhibitors; generating subtitle information for the corresponding exhibitors;

[0029] The exhibition design system is used to call the three-dimensional engine and the algorithm engine on the virtual cloud system to build a virtual cloud exhibition model of the corresponding exhibition venue, and complete the model rendering on the virtual cloud system; and map the personnel information, subtitle information, face video images and / or action posture information of the exhibitors in each area to each area in the virtual cloud exhibition model to generate a dynamic model of the exhibition hall;

[0030] The task scheduling center is used to execute the scheduling tasks issued by the background management center and the exhibition design system.

[0031] As an optional implementation scheme of the present application, optionally, the exhibition design system includes:

[0032] Design interface, used to provide design pages;

[0033] Exhibition hall data management, used to save the required data for various exhibition hall designs;

[0034] Device management, used to manage the addresses of various exhibition devices in the application layer;

[0035] Scene switching, used to call and switch the corresponding exhibition hall scene according to user needs;

[0036] Data mapping, used to map the personnel information, subtitle information, face video images and / or motion posture information of the exhibitors in each area to each area in the virtual cloud exhibition model;

[0037] The exhibition hall is put on the cloud, which is used to send the dynamic model of the exhibition hall through the cloud gateway and deploy it on the cloud server.

[0038] As an optional implementation scheme of the present application, optionally, the data layer includes:

[0039] Business database, used to record exhibition business data sent back by the business end;

[0040] Algorithm database, used to store various algorithm models required by the algorithm engine;

[0041] Scene database, used to store exhibition hall scenes of different styles;

[0042] The motion database is used to store the audio, video and motion data of exhibitors.

[0043] As an optional implementation scheme of the present application, optionally, the application layer includes the following exhibition application end:

[0044] APP, PC, business terminal, virtual display equipment, projector or cockpit large screen.

[0045] On the other hand, the present application proposes an intelligent virtual cloud exhibition system, including:

[0046] Intelligent virtual cloud exhibition server;

[0047] An on-site collection system is used to collect audio, video and motion data of exhibitors in the exhibition venue and upload them to the intelligent virtual cloud exhibition server in real time;

[0048] The exhibition application terminal is used to request the exhibition hall dynamic model from the background management center, and after the background management center responds and feeds back the exhibition hall dynamic model, the exhibition hall dynamic model is displayed in real time.

[0049] On the other hand, the present application also proposes an application method of an intelligent virtual cloud exhibition system, comprising the following steps:

[0050] Collect audio, video and motion data of exhibitors in the exhibition venue and upload them to the intelligent virtual cloud exhibition server in real time;

[0051] The intelligent virtual cloud exhibition server analyzes and identifies the personnel information, subtitle information, face video images and / or motion posture information of the exhibitors in each area based on the audio, video and motion data of the exhibitors, and maps the personnel information, subtitle information, face video images and / or motion posture information of the exhibitors in each area to each area in the constructed virtual cloud exhibition model to generate a dynamic model of the exhibition hall;

[0052] The exhibition application terminal requests the exhibition hall dynamic model from the background management center, and after the background management center responds and feeds back the exhibition hall dynamic model, the exhibition hall dynamic model is displayed in real time.

[0053] In another aspect, the present application further provides an electronic device, comprising:

[0054] processor;

[0055] a memory for storing processor-executable instructions;

[0056] Wherein, the processor is configured to implement the application method when executing the executable instructions.

[0057] Technical effects of the present invention:

[0058] This application uses an intelligent virtual cloud exhibition server to design a virtual cloud exhibition, server-based virtual exhibition rendering, and WebGL technology to implement exhibition activities. It can automatically identify the voice collected by a specific sound collection device and convert it into subtitles, or realize natural language control functions; through face recognition technology, it can quickly identify faces or photos, and apply it to security inspection and security to improve security inspection efficiency. It can also be applied to a variety of interactive display scenarios; using motion and trajectory recognition, combined with multimedia control technology, it can achieve the effect of using gestures to control multimedia hardware and software, or use body movements to interact with multimedia facilities.

[0059] The WebGL technology is used to provide WebGL 3D modeling services. It only needs to be based on the browser, and the complex calculations are handed over to the server as much as possible. It has fast loading speed, low traffic, low equipment requirements, and can be cross-platform and cross-terminal. Therefore, compared with traditional virtual display technology, it is necessary to download the modeling scene file in advance and mainly rely on local devices for rendering. The WebGL technology proposed in the present invention can be combined with the virtual cloud for 3D modeling and rendering to avoid occupying the rendering thread of the local server.

[0060] The present invention adopts an algorithm engine to perform audio and video, action analysis and mapping, can perform action interaction in the exhibition model, and adopts an artificial intelligence algorithm to enable the exhibition model to achieve interaction, thereby improving the dynamic interactivity and practical applicability of the exhibition.

[0061] Further features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate exemplary embodiments, features, and aspects of the disclosure and, together with the description, serve to explain the principles of the disclosure.

[0063] Figure 1 It is a technical architecture diagram of the intelligent virtual cloud exhibition server of the present invention;

[0064] Figure 2 A schematic diagram showing the composition of a server application system utilizing a virtual cloud system according to the present invention is shown;

[0065] Figure 3 Shown is a schematic diagram of generating a dynamic model of an exhibition hall according to the present invention;

[0066] Figure 4 It is a schematic diagram showing the system composition of the intelligent virtual cloud exhibition system of the present invention;

[0067] Figure 5 It is a schematic diagram showing the application of the electronic device of the present invention. DETAILED DESCRIPTION

[0068] Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numerals in the accompanying drawings represent elements with the same or similar functions. Although various aspects of the embodiments are shown in the accompanying drawings, the drawings are not necessarily drawn to scale unless otherwise specified.

[0069] The word “exemplary” is used exclusively herein to mean “serving as an example, example, or illustration.” Any embodiment described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.

[0070] In addition, in order to better illustrate the present disclosure, numerous specific details are given in the following specific embodiments. It should be understood by those skilled in the art that the present disclosure can also be implemented without certain specific details. In some examples, means, components and circuits well known to those skilled in the art are not described in detail in order to highlight the main purpose of the present disclosure.

[0071] Example 1

[0072] like Figure 1 As shown, on one hand, the present application proposes an intelligent virtual cloud exhibition server, comprising:

[0073] Security layer, used to provide network security communication services;

[0074] The physical layer provides the underlying physical hardware;

[0075] Data layer, used to provide data storage services;

[0076] Network layer, used to provide network transmission services;

[0077] The platform layer is used to provide services such as exhibition hall design, rendering, and generation of dynamic models of virtual cloud exhibition halls;

[0078] The application layer is used to display the dynamic model of the exhibition hall.

[0079] This server (or platform) adopts B / S+C / S hybrid architecture for platform development. The business system adopts B / S architecture, Laravel development framework, Bootstrap3 responsive design, and beautiful interface, which is convenient for users to manage. The control part adopts C / S architecture, and uses SNS tools such as APP and WeChat to facilitate on-site control and sharing.

[0080] SDN technology (Software Defined Network) refers to separating the control rights on network devices and managing them by a centralized controller, without relying on underlying network devices (routers, switches, firewalls), shielding the differences from underlying network devices. The control rights are completely open, and users can customize any network routing and transmission rules and policies they want to implement, making it more flexible and intelligent.

[0081] Inspired by this technology, this platform separated audio and video streams and storage control signaling at the beginning of its design, and realized flexible conversion between protocols of various manufacturers and devices through software, which originally required a lot of hardware to complete, thus improving the performance of multimedia processing, reducing the difficulty of implementation, and improving deployment efficiency. This is called SDE (Software Defined Exhibition).

[0082] The present invention is mainly implemented using WebGL technology. Traditional virtual display technology requires pre-downloading of modeling scene files and mainly relies on local devices for rendering. WebGL technology only needs to be based on the browser, and the complex calculations are handed over to the server as much as possible. It has fast loading speed, low traffic, low device requirements, and can be cross-platform and cross-terminal.

[0083] The present invention also uses artificial intelligence algorithms to achieve exhibition interaction. It can automatically identify the voice collected by a specific sound collection device and convert it into subtitles, or realize natural language control functions; through face recognition technology, it can quickly identify faces or photos, which can be used in security inspections to improve security efficiency, and can also be used in a variety of interactive display scenarios; using motion and trajectory recognition, combined with multimedia control technology, it can achieve the effect of using gestures to control multimedia software and hardware, or using body movements to interact with multimedia facilities.

[0084] The following will describe in detail the application architecture of this server and the service functions of the server.

[0085] The security layer provides security services for the server, mainly through firewalls and encrypted communication components, to detect viruses and perform security encryption and decryption on data transmitted to the server (or from the server).

[0086] The types of firewalls mainly include packet filtering firewalls, stateful inspection firewalls, proxy firewalls, and application layer firewalls. The types of encrypted communication components include symmetric encryption, asymmetric encryption, hash functions, and digital signatures. The specific type of secure transmission configured can be configured by the administrator.

[0087] As an optional implementation scheme of the present application, optionally, the physical layer includes:

[0088] Operating system, used to provide system operations;

[0089] A virtual cloud system is deployed on a cloud server and is called through a cloud gateway to provide virtual cloud services for the platform layer;

[0090] AI-box is used to provide audio and video AI processing algorithms, identify and process the audio, video and motion data of exhibitors, and extract the audio, face video images and / or motion posture information of the corresponding exhibitors;

[0091] Cameras are used to collect video motion data of exhibitors in various areas of the exhibition venue;

[0092] Audio acquisition equipment is used to collect audio data from exhibitors in various areas of the exhibition venue.

[0093] The operating system required for the server to design exhibitions is installed by the administrator, such as

[0094] The operating system for 3D design usually refers to the computer operating system environment that runs 3D design software. 3D design software such as Autodesk 3ds Max, Autodesk Maya, Blender, etc. can run on a variety of operating systems, including but not limited to Wi ndows, macOS, and Linux. Which operating system to choose depends on the user's needs, software compatibility, and personal preferences. For example, the Wi ndows operating system is favored by many designers for its wide software support and user base. macOS is loved by professional designers for its stability and seamless integration with Apple hardware. The Linux operating system, on the other hand, attracts some users who are looking for specific workflows or have limited budgets because of its open source and customizability. When choosing an operating system, users should consider the compatibility of 3D design software, system performance, cost, and individual or team workflow requirements.

[0095] Virtual cloud exhibition hall design is an online exhibition space created using cloud computing technology, which allows users to display products, services or brand information in a virtual environment. The following are several key steps for virtual cloud exhibition hall design:

[0096] 1. Determine goals and needs: clarify the purpose of exhibition hall design, such as product launch, brand promotion or industry communication. Understand the target audience and their needs in order to design an exhibition hall that meets their expectations.

[0097] 2. Choose a suitable virtual cloud platform: Choose a stable, feature-rich and easy-to-use virtual cloud platform based on your needs. Consider the platform's scalability, degree of customization, and whether it supports multi-user interaction.

[0098] 3. Design the exhibition hall layout: Plan the overall layout of the exhibition hall, including the entrance, display area, interactive area and rest area, etc. Ensure that the layout is reasonable and convenient for visitors to navigate and experience.

[0099] 4. Make 3D models and content: Create or purchase high-quality 3D models and images to showcase products or scenes. At the same time, prepare relevant introductory text, video and audio content to enrich the display effect.

[0100] 5. Implement interactive functions: Integrate interactive tools such as chat, video conferencing, questionnaires, etc. to communicate with visitors in real time and collect feedback.

[0101] There are three main types of virtual cloud systems: public cloud, private cloud and hybrid cloud.

[0102] Public cloud is a cloud service owned and operated by a third-party provider, and users access these services through the Internet. It is suitable for scenarios that require rapid expansion of resources and applications.

[0103] A private cloud is customized for a single organization and can be deployed in the organization's internal data center or a third-party hosting facility. It provides greater security and control and is suitable for enterprises with strict requirements for data security and compliance.

[0104] A hybrid cloud is a combination of public and private clouds that allows data and applications to migrate between the two clouds to meet different business needs. This type of cloud service provides flexibility and scalability while maintaining control over critical data.

[0105] like Figure 2 The figure shows the system interaction diagram between the server and the cloud server through the switch. The specific virtual cloud system can be deployed on the cloud server and communicate with the server through the switch (or cloud gateway). The administrator can issue a call instruction to the cloud server through the server to call the virtual cloud service system on it, provide virtual cloud services for the platform layer, create the required virtual cloud exhibition model or build the exhibition hall data corresponding to the virtual cloud exhibition.

[0106] In this embodiment, when constructing the exhibition hall model of the virtual cloud exhibition, you can log in to the cloud server through the cloud gateway, enter the virtual cloud system, and combine the local three-dimensional engine and algorithm engine to jointly construct the virtual cloud exhibition model and save it synchronously on the local server.

[0107] In the process of building the virtual cloud exhibition hall model, we first need to use the 3D engine WebGL to create 3D space and objects. WebGL is a JavaScript API that allows 2D and 3D graphics to be rendered in a web browser without the need for plug-ins. With WebGL, high-quality 3D visual effects can be achieved, providing users with an immersive browsing experience.

[0108] Next, the integration of the algorithm engine is crucial. The algorithm engine can handle complex computing tasks such as physical simulation, collision detection, path planning, etc., to ensure that the interaction and dynamic effects in the virtual exhibition hall are smooth and natural. For example, the algorithm engine can be used to simulate ray tracing, enhance the realism of lighting effects, or realize dynamic interaction of virtual objects.

[0109] Steps to building a virtual cloud showroom model may include:

[0110] 1. Design the exhibition hall layout: Use 3D modeling software to design the 3D spatial layout of the exhibition hall, including walls, floors, ceilings, and display racks.

[0111] 2. Create exhibit models: Create detailed 3D models for each exhibit and ensure they are visually consistent with the actual exhibits.

[0112] 3. WebGL integration: Import the designed 3D models and layouts into the WebGL environment for scene rendering and optimization to ensure compatibility on different devices and browsers.

[0113] 4. Write interactive logic: Use the algorithm engine to write the logic for users to interact with the virtual exhibition hall, such as clicking on exhibits to view detailed information, navigation path planning, etc.

[0114] 5. Realize dynamic effects: Through the algorithm engine, dynamic effects such as weather changes and the passage of time can be realized to enhance the realism and attractiveness of the exhibition hall.

[0115] 6. Testing and optimization: Test the performance of the virtual cloud exhibition hall on a variety of devices and network environments, and make necessary optimizations based on feedback to ensure a smooth user experience.

[0116] 7. Release and maintenance: Deploy the constructed virtual cloud exhibition hall to the server, and regularly update the content and fix possible problems.

[0117] By combining the 3D engine WebGL and the algorithm engine, a virtual cloud exhibition hall model that is both beautiful and powerful can be created, providing users with an online display platform with strong interactivity and good visual effects. The final model can be saved in the database of the local server (model library).

[0118] The platform layer communicates with the cloud server through the communication network in the corresponding network layer to implement corresponding task scheduling (such as calling the algorithm engine interface to provide support operations for the algorithm model, or synchronizing the virtual cloud exhibition model built by the virtual cloud system on the cloud server to the local server, etc.). The task scheduling center performs various task scheduling.

[0119] AI-box is an intelligent processing device that integrates artificial intelligence technology. It can intelligently analyze and process audio and video content. Through deep learning and machine learning algorithms, AI-box can achieve a variety of functions, such as speech recognition, image recognition, sentiment analysis, content review, automatic subtitle generation, etc. These functions make AI-box widely used in many fields such as video surveillance, intelligent customer service, online education, media content management, etc. By analyzing audio and video data, AI-box can provide more accurate and efficient services, improve work efficiency, reduce labor costs, and provide users with a more personalized experience.

[0120] The deployment of AI-box can be done by the administrator configuring the corresponding physical hardware and connecting it to the backend management center deployed on the backend platform layer, so as to transmit the corresponding dynamic information of exhibitors (audio, facial video images and / or motion posture information) to the backend. These initial data are collected by cameras or audio acquisition devices installed at the corresponding positions of the exhibition hall and sent to the AI-box for pre-processing. After obtaining the corresponding information, it is uploaded to the platform for application.

[0121] As an optional implementation scheme of the present application, optionally, the network layer is used to provide the following network communications:

[0122] Cloud API, IOT interface, 5G communication module, cloud gateway, wireless module and / or switch.

[0123] Various communication facilities can be configured by the administrator.

[0124] As an optional implementation scheme of the present application, optionally, the platform layer includes:

[0125] 3D engine, used to provide WebGL3D modeling services; mainly uses WebGL to provide 3D modeling services, which can be understood in conjunction with the principles of WebGL;

[0126] The algorithm engine is used to provide various data processing algorithm services. It mainly calls the algorithm model from the algorithm database to perform various operations, such as face recognition algorithm, gesture recognition algorithm, etc., according to the needs of backend data processing. The algorithm engine can call the corresponding algorithm model to perform the current data calculation task according to the data calculation type issued by the backend management center.

[0127] SDN control management module is used for permission setting. Using SDN for permission control management makes the control right completely open. Users can customize any network routing and transmission rule strategies they want to achieve, making it more flexible and intelligent.

[0128] The gesture recognition system is used to identify the motion gesture information of exhibitors and their control gestures. It mainly performs gesture recognition on motion images to determine whether a preset control gesture appears. If so, the system will detect the corresponding control gesture and inform the backend management center. The backend management center recognizes the control information that the exhibition staff wants to express based on the control gesture. For example, if the gesture is a C-shaped motion trajectory, it indicates that the lighting in the exhibition hall needs to be adjusted. The backend management center can control the lighting equipment in the exhibition hall based on the control address ID of the exhibition equipment in the exhibition hall. Specific different control gestures and the corresponding control information can be pre-configured on the backend management center.

[0129] AI voice assistant, used to obtain audio information from exhibitors and convert it into corresponding subtitle information;

[0130] To convert speech to subtitles using AI voice assistant, you can follow these steps:

[0131] 1. Prepare audio files: Ensure clear audio files, which is the basis for conversion to subtitles;

[0132] 2. Choose the right AI speech recognition tool: There are many tools and services on the market that can convert speech to text, such as Google speech recognition, IBM Watson Speech to Text, Microsoft Azure Speech service, etc.

[0133] 3. Upload audio file: Upload the audio file to the selected AI speech recognition service;

[0134] 4. Adjust settings: Adjust language, accent, speed and other settings as needed to improve recognition accuracy;

[0135] 5. Start conversion: Start the speech recognition process and wait for the service to process the audio and generate subtitle text;

[0136] 6. Proofreading and Editing: AI-generated subtitles may need to be proofread and edited to correct any recognition errors or formatting issues;

[0137] 7. Export subtitle files: Once proofread, you can export subtitles to SRT, VTT or other subtitle formats for use in video editing software or display directly in a video player;

[0138] Here, the subtitles need to be configured in the corresponding area through the background, so as to show the on-site needs of the exhibition staff in the area;

[0139] The backstage management center is used for backstage management, including: identifying the facial video images of exhibitors and obtaining the personnel information of exhibitors; analyzing the audio, video and motion data of exhibitors to obtain the audio, facial video images and / or motion posture information of exhibitors in various areas of the exhibition venue, and binding the audio, facial video images and / or motion posture information to the identity ID of the corresponding exhibitor; issuing corresponding control instructions according to the control gestures of the exhibitors; generating subtitle information for the corresponding exhibitors; the backstage provides zoning services for exhibitors in various areas (exhibition area A, exhibition area B...) in the exhibition hall, collects and identifies their audio, motion information, etc., and identifies the information they need, and understands their needs in the form of subtitles, control gestures, etc.; the backstage can collect the information of each exhibitor in each exhibition area according to the information collected The video information of the personnel is used to identify the facial information of each exhibitor and bind the personnel information to them. If the audio or action information of the corresponding personnel is collected later, the information can be identified and recorded and bound to their identity ID; in the early stage of the exhibition, the identity information of the invited exhibitors will be collected and uploaded to the background by the administrator through the business end APP, etc., so later, during the exhibition, the background can perform facial recognition on the personnel in each exhibition area and display the binding information of the personnel in the exhibition area of ​​the corresponding model, so that the background can display the exhibitors in each exhibition area through the virtual cloud exhibition hall model, and understand the demand information or control gestures of the exhibitors in each exhibition area, realize the background recognition and intelligent issuance of corresponding control instructions, and realize unmanned exhibition management and interactive control;

[0140] The exhibition design system is used to call the three-dimensional engine and the algorithm engine on the virtual cloud system to build a virtual cloud exhibition model of the corresponding exhibition venue, and complete the model rendering on the virtual cloud system; and map the personnel information, subtitle information, face video images and / or action posture information of the exhibitors in each area to each area in the virtual cloud exhibition model to generate a dynamic model of the exhibition hall; the administrator can design the virtual cloud exhibition model of the exhibition hall according to the collected exhibition hall data and the preset exhibition hall framework, that is, relying on the virtual cloud system, call the algorithm engine and the three-dimensional engine to build the corresponding virtual cloud exhibition model, and at the same time, the corresponding virtual cloud simulation scene and parameters can be configured to build an exhibition model corresponding to the actual exhibition hall, and at the same time, the corresponding three-dimensional model scene of the exhibition model can be switched according to the exhibition environment to change the scene; different scene models are pre-stored in the scene database, which can be called and displayed in the three-dimensional space of the exhibition model, which can be specifically understood in combination with the scene change method of the existing VR three-dimensional model;

[0141] The task scheduling center is used to execute the scheduling tasks issued by the background management center and the exhibition design system. It mainly executes various task scheduling.

[0142] like Figure 3 As shown, when constructing a virtual cloud exhibition model, the corresponding exhibition area can be virtually constructed in the exhibition model according to the exhibition area. In the model where each exhibition area is located, the relationship between the exhibition area and the personnel corresponding to the area can be mapped later. The background can map and match the information of the exhibitors collected in the area to the exhibition area, allowing the background administrator to view the information of the exhibitors in each exhibition area through the virtual simulation of the virtual cloud exhibition model.

[0143] Combined with the above-mentioned audio and video motion data collection and processing methods, the interactive information of exhibitors in each exhibition area can be displayed. For example, in exhibition area 1, the identity faces of the exhibitors in the area can be displayed, as well as if there are subtitles with specific voices or motion trajectories, etc., and the relevant information of the person, including facial and motion information, etc., can also be displayed on the model of the exhibition area.

[0144] In this solution, the collected data of exhibitors, including faces, movements, subtitle information, etc., is mapped and configured on the corresponding exhibition area model, so that the backend administrator can understand the information of exhibitors in each exhibition area and the specific information required by these exhibitors in the exhibition area in real time, etc. The demand information or control information of the corresponding personnel can be identified through the collection and recognition technology of voice, subtitles, and motion trajectories, and the background can automatically make corresponding instructions, etc.

[0145] Mapping real-time data to the virtual model: By processing the collected dynamic data of personnel, the data must first be cleaned and organized to ensure the accuracy and completeness of the data. Then, the data is classified and encoded according to the structure and requirements of the virtual model. Next, using data mapping technology, the processed data is accurately located according to the coordinate system and attribute requirements of the virtual model (the location of each person can be determined by video, or the corresponding positioning device can be distributed to each person so that the system can capture their information and collect their location in real time. For example, different regional labels are worn by each person. When the background recognizes the avatar, if the person is found to be wearing an identification label of exhibition area 1, the person is considered to be in the area. Here, it is assumed that the person will go to the corresponding area according to the label, and the label will be removed when leaving the area) to the corresponding position in the model. Finally, the data is presented in the virtual model through visualization tools or programming interfaces to ensure the real-time update of dynamic data and the realization of interactive functions.

[0146] As an optional implementation scheme of the present application, optionally, the exhibition design system includes:

[0147] Design interface, used to provide design pages;

[0148] Exhibition hall data management, used to save the required data for various exhibition hall designs;

[0149] Device management, used to manage the addresses of various exhibition devices in the application layer;

[0150] Scene switching, used to call and switch the corresponding exhibition hall scene according to user needs;

[0151] Data mapping, used to map the personnel information, subtitle information, face video images and / or motion posture information of the exhibitors in each area to each area in the virtual cloud exhibition model;

[0152] The exhibition hall is put on the cloud, which is used to send the dynamic model of the exhibition hall through the cloud gateway and deploy it on the cloud server.

[0153] The exhibition design system allows designers to call corresponding algorithms, 3D engines, etc., to build corresponding virtual cloud models and perform physical and virtual data mapping, scene switching, exhibition hall data management, etc. The constructed virtual cloud model can also be uploaded and deployed on the cloud server through the cloud gateway (or switch). Now the exhibition application end of the application layer can request and display the constructed virtual cloud exhibition model. Some authorized users can also log in to the cloud server through APP, etc., to view and participate in the exhibition online.

[0154] The four major systems, namely the centralized management system, multimedia broadcast control system, remote console system and background management system, realize the goals of intelligent display of exhibition halls, multi-scene switching, data cloud management, remote equipment management, operation data analysis (backstage management), and network security.

[0155] The application selection of specific exhibition design systems can be divided into the following types:

[0156] 1.2D exhibition design system: mainly uses graphic design software for exhibition layout and design, suitable for preliminary design and concept display.

[0157] 2.3D exhibition design system: Using three-dimensional modeling technology, you can create a three-dimensional exhibition space model to provide a more intuitive design effect.

[0158] 3. Virtual reality (VR) exhibition design system: Through virtual reality technology, designers and customers can experience the exhibition space design in an immersive way, which is suitable for complex spaces and large-scale exhibition projects.

[0159] 4. Augmented Reality (AR) Exhibition Design System: Combines real scenes with virtual elements to enhance the interactivity and experience of exhibition design.

[0160] 5. Exhibition management system: focuses on the organization, operation and management of exhibitions, including exhibitor management, audience management, event arrangement and other functions.

[0161] 6. Comprehensive exhibition design system: It integrates 2D, 3D design, VR and AR technologies to provide comprehensive design and management solutions suitable for exhibition projects of various sizes and types.

[0162] The administrator will select the corresponding exhibition design system.

[0163] As an optional implementation scheme of the present application, optionally, the data layer includes:

[0164] Business database, used to record exhibition business data sent back by the business end;

[0165] Algorithm database, used to store various algorithm models required by the algorithm engine;

[0166] Scene database, used to store exhibition hall scenes of different styles;

[0167] The motion database is used to store the audio, video and motion data of exhibitors.

[0168] Please understand the application of each database in combination with the above-mentioned storage data. It also includes a model library for storing various algorithm models to provide support for the algorithm engine.

[0169] As an optional implementation scheme of the present application, optionally, the application layer includes the following exhibition application end:

[0170] APP, PC, business terminal, virtual display equipment, projector or cockpit large screen.

[0171] According to different user needs, you can configure the corresponding application end. The background needs to set permissions according to SDN.

[0172] Example 2

[0173] like Figure 4 As shown, based on the principle of Example 1, the present application, on the other hand, proposes an intelligent virtual cloud exhibition system, including:

[0174] The intelligent virtual cloud exhibition server described in Example 1;

[0175] An on-site collection system is used to collect audio, video and motion data of exhibitors in the exhibition venue and upload them to the intelligent virtual cloud exhibition server in real time;

[0176] The exhibition application terminal is used to request the exhibition hall dynamic model from the background management center, and after the background management center responds and feeds back the exhibition hall dynamic model, the exhibition hall dynamic model is displayed in real time.

[0177] In addition to cameras, audio acquisition equipment, etc., the on-site acquisition system can also be a 3D point cloud camera, which can be used to collect 3D point cloud data of pre-built exhibition venues and provide the platform with 3D data for building exhibition models. This can be understood specifically by combining 3D point cloud data and using 3D point clouds to reconstruct 3D models.

[0178] The exhibition application terminal refers to the various interactive application terminals deployed in the application layer. You can log in to the cloud server, view the virtual cloud exhibition model, and participate in the exhibition online.

[0179] Please refer to Example 1 for understanding of the specific server interaction.

[0180] Obviously, those skilled in the art should understand that the implementation of all or part of the processes in the above-mentioned embodiments can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the above-mentioned control embodiments. Those skilled in the art can understand that the implementation of all or part of the processes in the above-mentioned embodiments can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the above-mentioned control embodiments. Among them, the storage medium can be a disk, an optical disk, a read-only memory (ROM), a random access memory (RAM), a flash memory (Flash Memory), a hard disk (Hard Disk Drive, abbreviated as: HDD) or a solid-state drive (Solid-State Drive, SSD), etc.; the storage medium can also include a combination of the above-mentioned types of memory.

[0181] Example 3

[0182] Based on the implementation principle of Example 2, on the other hand, the present application also proposes an application method of an intelligent virtual cloud exhibition system, comprising the following steps:

[0183] Collect audio, video and motion data of exhibitors in the exhibition venue and upload them to the intelligent virtual cloud exhibition server in real time;

[0184] The intelligent virtual cloud exhibition server analyzes and identifies the personnel information, subtitle information, face video images and / or motion posture information of the exhibitors in each area based on the audio, video and motion data of the exhibitors, and maps the personnel information, subtitle information, face video images and / or motion posture information of the exhibitors in each area to each area in the constructed virtual cloud exhibition model to generate a dynamic model of the exhibition hall;

[0185] The exhibition application terminal requests the exhibition hall dynamic model from the background management center, and after the background management center responds and feeds back the exhibition hall dynamic model, the exhibition hall dynamic model is displayed in real time.

[0186] Please refer to the description of Examples 1 and 2 to understand and implement the steps of this method.

[0187] The modules or steps of the present invention described above can be implemented by a general-purpose computing system, they can be concentrated on a single computing system, or distributed on a network composed of multiple computing systems, and optionally, they can be implemented by a program code executable by a computing system, so that they can be stored in a storage system and executed by the computing system, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. Thus, the present invention is not limited to any specific combination of hardware and software.

[0188] Example 4

[0189] like Figure 5 As shown, further, in another aspect, the present application also proposes an electronic device, including:

[0190] processor;

[0191] a memory for storing processor-executable instructions;

[0192] Wherein, the processor is configured to implement the application method described in Example 3 when executing the executable instructions.

[0193] The electronic device of the embodiment of the present disclosure includes a processor and a memory for storing instructions executable by the processor, wherein the processor is configured to implement the application method described in the above embodiment 3 when executing the executable instructions.

[0194] Here, it should be noted that the number of processors can be one or more. At the same time, the electronic device of the embodiment of the present disclosure may also include an input system and an output system. Among them, the processor, memory, input system and output system may be connected through a bus or in other ways, which are not specifically limited here.

[0195] The memory, as a computer-readable storage medium, can be used to store software programs, computer executable programs and various modules, such as the program or module corresponding to the application method of Embodiment 3 of the present disclosure. The processor executes various functional applications and data processing of the electronic device by running the software programs or modules stored in the memory.

[0196] The input system can be used to receive input numbers or signals. The signal can be a key signal related to user settings and function control of the device / terminal / server. The output system can include display devices such as display screens.

[0197] The embodiments of the present disclosure have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or technical improvements in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. An intelligent virtual cloud exhibition server, It is characterized in that include: Security layer, used to provide network security communication services; The physical layer provides the underlying physical hardware; Data layer, used to provide data storage services; Network layer, used to provide network transmission services; The platform layer is used to provide services such as exhibition hall design, rendering, and generation of dynamic models of virtual cloud exhibition halls; The application layer is used to display the dynamic model of the exhibition hall.

2. The intelligent virtual cloud exhibition server according to claim 1, It is characterized in that The physical layer comprises: Operating system, used to provide system operations; A virtual cloud system is deployed on a cloud server and is called through a cloud gateway to provide virtual cloud services for the platform layer; AI-box is used to provide audio and video AI processing algorithms, identify and process the audio, video and motion data of exhibitors, and extract the audio, face video images and / or motion posture information of the corresponding exhibitors; Cameras are used to collect video motion data of exhibitors in various areas of the exhibition venue; Audio acquisition equipment is used to collect audio data from exhibitors in various areas of the exhibition venue.

3. The intelligent virtual cloud exhibition server according to claim 1, It is characterized in that The network layer is used to provide the following network communications: Cloud API, IOT interface, 5G communication module, cloud gateway, wireless module and / or switch.

4. The intelligent virtual cloud exhibition server according to claim 1, It is characterized in that The platform layer includes: 3D engine, used to provide WebGL3D modeling services; Algorithm engine, used to provide various data processing algorithm services; SDN control management module, used for permission setting; Posture recognition system, used to identify the motion and posture information of exhibitors and their control gestures; AI voice assistant, used to obtain audio information from exhibitors and convert it into corresponding subtitle information; The backstage management center is used for backstage management, including: identifying the facial video images of exhibitors and obtaining the personnel information of exhibitors; analyzing the audio, video and motion data of exhibitors to obtain the audio, facial video images and / or motion posture information of exhibitors in various areas of the exhibition venue, and binding the audio, facial video images and / or motion posture information to the identity ID of the corresponding exhibitors; issuing corresponding control instructions according to the control gestures of the exhibitors; generating subtitle information for the corresponding exhibitors; The exhibition design system is used to call the three-dimensional engine and the algorithm engine on the virtual cloud system to build a virtual cloud exhibition model of the corresponding exhibition venue, and complete the model rendering on the virtual cloud system; and map the personnel information, subtitle information, face video images and / or action posture information of the exhibitors in each area to each area in the virtual cloud exhibition model to generate a dynamic model of the exhibition hall; The task scheduling center is used to execute the scheduling tasks issued by the background management center and the exhibition design system.

5. The intelligent virtual cloud exhibition server according to claim 4, It is characterized in that The exhibition design system includes: Design interface, used to provide design pages; Exhibition hall data management, used to save the required data for various exhibition hall designs; Device management, used to manage the addresses of various exhibition devices in the application layer; Scene switching, used to call and switch the corresponding exhibition hall scene according to user needs; Data mapping, used to map the personnel information, subtitle information, face video images and / or motion posture information of the exhibitors in each area to each area in the virtual cloud exhibition model; The exhibition hall is put on the cloud, which is used to send the dynamic model of the exhibition hall through the cloud gateway and deploy it on the cloud server.

6. The intelligent virtual cloud exhibition server according to claim 1, It is characterized in that The data layer includes: Business database, used to record exhibition business data sent back by the business end; Algorithm database, used to store various algorithm models required by the algorithm engine; Scene database, used to store exhibition hall scenes of different styles; The motion database is used to store the audio, video and motion data of exhibitors.

7. The intelligent virtual cloud exhibition server according to claim 1, It is characterized in that The application layer includes the following exhibition application terminals: APP, PC, business terminal, virtual display equipment, projector or cockpit large screen.

8. An intelligent virtual cloud exhibition system, It is characterized in that include: The intelligent virtual cloud exhibition server according to any one of claims 1 to 7; An on-site collection system is used to collect audio, video and motion data of exhibitors in the exhibition venue and upload them to the intelligent virtual cloud exhibition server in real time; The exhibition application terminal is used to request the exhibition hall dynamic model from the background management center, and after the background management center responds and feeds back the exhibition hall dynamic model, the exhibition hall dynamic model is displayed in real time.

9. An application method of the intelligent virtual cloud exhibition system according to claim 8, It is characterized in that The steps include: Collect audio, video and motion data of exhibitors in the exhibition venue and upload them to the intelligent virtual cloud exhibition server in real time; The intelligent virtual cloud exhibition server analyzes and identifies the personnel information, subtitle information, face video images and / or motion posture information of the exhibitors in each area based on the audio, video and motion data of the exhibitors, and maps the personnel information, subtitle information, face video images and / or motion posture information of the exhibitors in each area to each area in the constructed virtual cloud exhibition model to generate a dynamic model of the exhibition hall; The exhibition application terminal requests the exhibition hall dynamic model from the background management center, and after the background management center responds and feeds back the exhibition hall dynamic model, the exhibition hall dynamic model is displayed in real time.

10. An electronic device, It is characterized in that include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to implement the application method described in claim 9 when executing the executable instructions.

Images