An interactive method and system based on smart community immersive space

Abstract

An interactive method and system based on an immersive space of a smart community, relating to the field of virtual reality display technology. In this method, in response to a user's target viewing request; a target map is displayed, and the target map is a structural diagram corresponding to the smart community; a first position is determined based on the user's movement operation on a target floating ball; the first position is input into a preset database for query to obtain a first data packet; the first data packet is sent to a display device so that the display device parses the first data packet to obtain a first display screen. By implementing the technical solution provided in this application, the first display screen is displayed to the user in combination with the viewing request of the immersive space of the smart community, thereby achieving a true restoration of the three-dimensional stereoscopic effect of the smart community and reducing the dependence on viewing devices, thereby improving the user experience.

Description

Technical Field

[0001] The present application relates to the field of virtual reality display technology, and specifically to an interactive method and system based on an immersive space in a smart community. Background Art

[0002] In today's society, the importance of communities as the core driving force for social harmony, stability and development is becoming increasingly prominent. Communities are not only an interconnected living collective formed by multiple social groups or organizations in a specific region, but also an important platform for people's communication, cultural maintenance, residents' lives and social management.

[0003] With the rapid development of information technology, especially the popularization and application of Internet technology, the management and service of traditional communities have undergone revolutionary changes. By introducing modern information technology, the quality of community life can be significantly improved, and a safer, more convenient, efficient and environmentally friendly living environment can be built. The construction of smart communities is a concrete manifestation of this change. It can not only effectively improve the quality of community life, but also meet the expectations of residents for a convenient, safe and warm life. In the real estate market, when choosing a house, home buyers usually need to have a deep understanding of the location, structure and community construction of the house. In this process, home buyers usually need to query information through multiple channels and go to the house sales agency for consultation. The house sales agency recommends suitable houses according to the needs of home buyers and accompanies the home buyers to visit the house on site. However, the traditional viewing method requires home buyers to arrive at the site in person to view the house structure, or can only understand it through flat pictures. However, such flat pictures often cannot truly restore the three-dimensional effect of the house, and are easily affected by the viewing equipment, resulting in a poor experience for home buyers.

[0004] Therefore, there is an urgent need for an interactive method and system based on the immersive space of a smart community that can solve the above-mentioned technical problems. Summary of the invention

[0005] The present application provides an interactive method and system based on a smart community immersive space. The method displays a first display screen to the user in combination with a viewing request of the smart community immersive space, thereby achieving a true restoration of the three-dimensional stereoscopic effect of the smart community and reducing dependence on viewing devices, thereby improving the user experience.

[0006] In a first aspect, the present application provides an interactive method based on an immersive space of a smart community, which is applied to a desktop device, and the method includes: responding to a target viewing request from a user, the target viewing request being a request to view a target map in the immersive space of the smart community; displaying a target map, the target map being a structural diagram corresponding to the smart community; determining a first position based on an operation of moving a target floating ball by the user, the first position being any position of the target floating ball on the target map; inputting the first position into a preset database for query to obtain a first data packet, the preset database including a correspondence between the first data packet and the first position, the first data packet being a three-dimensional space data packet; sending the first data packet to a display device so that the display device parses the first data packet to obtain a first display screen.

[0007] By adopting the above technical solution, in response to the user's target viewing request, the target map in the immersive space of the smart community is viewed, and the first position in the target map is determined based on the user's movement operation on the target floating ball, and the first position is input into a preset database for query to obtain a first data packet, which is a three-dimensional space data packet. By inputting the first position into the preset database, the three-dimensional space data packet corresponding to the first position can be accurately obtained, and the first data packet is sent to a display device, and the display device parses the first data packet and generates a first display screen. This display method does not depend on a specific device, and only needs to parse the first data packet and generate a first display screen, thereby reducing dependence on viewing devices and improving user experience.

[0008] Optionally, after determining the first position based on the user's movement operation on the target floating ball, the method also includes: obtaining the target dwell time, the target dwell time being the dwell time of the target floating ball at the first position; judging whether the target dwell time is less than or equal to a preset dwell threshold; when the target dwell time is less than or equal to the preset dwell threshold, confirming that the target floating ball is in a moving state.

[0009] By adopting the above technical solution, the residence time of the target floating ball in the first position, that is, the target residence time, is obtained. The target residence time is compared with the preset residence threshold to judge the user's intention. When the target residence time is less than or equal to the preset residence threshold, it is confirmed that the target floating ball is in a moving state, avoiding delays and freezes when the user quickly browses the target map, achieving a refined and intelligent user interaction experience, and further improving the user experience.

[0010] Optionally, when the target dwell time is less than or equal to a preset dwell threshold, after confirming that the target suspended ball is in a moving state, the method further includes: obtaining a moving path of the target suspended ball based on a user's moving operation on the target suspended ball; determining a second position according to the moving path, the second position being a plurality of corresponding positions in the moving path; querying a preset database for the second position to obtain a second data packet; and sending the second data packet to a display device so that the display device processes the second data packet to obtain a second display screen.

[0011] By adopting the above technical solution, the user's movement operation on the target floating ball is obtained, the movement path corresponding to the movement operation is obtained, and the second position is determined according to the movement path. The three-dimensional spatial data of multiple positions are continuously displayed according to the user's movement path, so that the user can have a more comprehensive understanding of the structure of the smart community. Since the three-dimensional spatial data of multiple positions on the user's movement path are continuously displayed, the consistency of the user experience is enhanced, unnecessary data transmission is reduced, and the data response speed is improved.

[0012] Optionally, after determining whether the target dwell time is less than or equal to a preset dwell threshold, the method further includes: when the target dwell time is greater than the preset dwell threshold, confirming that the floating ball is in a stationary state; obtaining the user's click operation on the target button, the target buttons include a zoom-in instruction button, a zoom-out instruction button, a rotation instruction button, and a comparison instruction button; identifying the click operation to obtain a control instruction so as to execute the operation corresponding to the control instruction.

[0013] By adopting the above technical solution, when the target stay time is greater than the preset stay threshold, it is confirmed that the target floating ball is in a stationary state, and it can be considered that the user needs to further understand the first position, obtain the user's click operation on the target button, and the user zooms in, shrinks, rotates and compares the first position based on his own needs, and then identifies the click operation to obtain the control instruction, executes the operation corresponding to the control instruction, and executes the corresponding control instruction according to the user's click operation. Data is loaded and processed only according to the actual needs of the user, rather than loading the data of the entire map scene at one time, thereby reducing unnecessary waste of resources, improving the operating efficiency of desktop devices, and further enhancing the user experience of the immersive space of the smart community.

[0014] Optionally, before sending the first data packet to the display device, the method also includes: dividing the first data packet to obtain multiple sub-data packets; compressing the multiple sub-data packets in sequence to obtain multiple compressed data packets, one sub-data packet corresponding to one compressed data packet; and transmitting the multiple compressed data packets to the display device using parallel transmission.

[0015] By adopting the above technical solution, the first data packet is divided into multiple sub-data packets, and each sub-data packet is compressed, thereby improving the compression efficiency. Data compression can also reduce storage space. Multiple compressed data packets are then sent to the display device using parallel transmission. Parallel transmission can speed up data processing, allowing users to see the three-dimensional space data packets faster. Due to the improvement in transmission efficiency and data processing, users can obtain the required three-dimensional space data faster, thereby improving user experience.

[0016] Optionally, the first data packet is divided into multiple sub-data packets; specifically including: obtaining multiple display areas corresponding to the display device; position encoding the multiple display areas to obtain multiple area position codes, one display area corresponds to one area position code; the first data packet is divided according to a target number to obtain multiple sub-data packets, and the target number is the total number corresponding to the multiple area position codes.

[0017] By adopting the above technical solution, multiple display areas corresponding to the display device are obtained, and then the multiple display areas are position-coded in turn to obtain multiple area position codes. The target number is determined according to the area position codes, and the first data packet is segmented based on the target number to obtain multiple sub-data packets. This segmentation ensures that each display area can obtain the corresponding sub-data packet, thereby avoiding data redundancy and insufficient problems; the segmentation method and number of the first data packet are dynamically adjusted according to the actual number of display areas of the display device, so that its segmentation can adapt to display devices of different sizes and configurations to enhance the display effect.

[0018] Optionally, after dividing the first data packet according to the target quantity to obtain multiple sub-data packets, the method also includes: obtaining a target area position code corresponding to the target display area, the target display area being any one of the multiple display areas; determining a target data position code corresponding to the target area position code according to a mapping relationship, the target data position code being a position code corresponding to the target sub-data packet, the target data position code being a position code corresponding to the display of the target sub-data packet in the target display area, and the mapping relationship being a pre-constructed mapping relationship between the target area position code and the target data position code; and sending the target sub-data packet to a display device so that the target display area of ​​the display device receives the target sub-data packet.

[0019] By adopting the above technical solution, the target area position code corresponding to the target display area is obtained, and the target data position code corresponding to the target area position code is determined by using a pre-constructed mapping relationship. The target data position code is the position code corresponding to the target sub-data package. The construction of the mapping relationship eliminates the need for personnel to manually specify sub-data packages for each display area, thereby reducing the possibility of configuration errors. The target sub-data package is sent to the display device to ensure that the target sub-data package is sent to the target display area, thereby avoiding data mistransmission and omission, and improving the accuracy of data transmission. By identifying the target display area and using the mapping relationship to achieve accurate data transmission, resource utilization is optimized and user experience is improved.

[0020] Optionally, before inputting the first position into a preset database for query and obtaining the first data packet, it is necessary to construct a preset database, which specifically includes: using a target shooting device to collect data for the smart community to obtain historical image data; dividing the historical images to obtain multiple three-dimensional image data; dividing the multiple three-dimensional image data according to preset position rules to obtain multiple positions, one position corresponding to one three-dimensional image data; processing the target three-dimensional image data to obtain a first data packet, and obtaining the first position corresponding to the target three-dimensional image data; and constructing a preset database, which includes a corresponding relationship between the first position and the first data packet.

[0021] By adopting the above technical solution, a target shooting device is used to conduct comprehensive and detailed data collection on the smart community, and a historical image is obtained. The historical image is divided to obtain a plurality of three-dimensional image data. The division process helps to split the historical image into a plurality of three-dimensional image data. One three-dimensional image data corresponds to the information of any area of ​​the smart community. The three-dimensional image data is divided according to the preset position rule, and a specific position label is assigned to each three-dimensional image data. The target three-dimensional image data is processed to obtain a first data packet, and the first position corresponding to the first data packet is obtained. A preset database is constructed, and the correspondence between the first data packet and the first position is stored in the preset database, so that the first data packet can be determined according to the first position later, thereby improving the display efficiency of the smart community.

[0022] In a second aspect of the present application, an interactive system based on an immersive space of a smart community is provided. The system is an interactive system, and the interactive system includes a desktop device and a display device. The desktop device responds to a user's target viewing request, which is a request to view a target map in the immersive space of the smart community; displays a target map, which is a structural diagram corresponding to the smart community; determines a first position based on a user's movement operation of a target floating ball, and the first position is an arbitrary position of the target floating ball on the target map; inputs the first position into a preset database for query to obtain a first data packet, and the preset database includes a correspondence between the first data packet and the first position, and the first data packet is a three-dimensional space data packet; and displays the first data packet to the display device so that the display device parses the first data packet to obtain a first display screen.

[0023] Optionally, the desktop device is used to obtain the target dwell time, which is the dwell time of the target floating ball at the first position; determine whether the target dwell time is less than or equal to a preset dwell threshold; when the target dwell time is less than or equal to the preset dwell threshold, it is confirmed that the target floating ball is in a moving state.

[0024] Optionally, the desktop device is used to obtain the moving path of the target floating ball based on the user's moving operation on the target floating ball; determine a second position according to the moving path, the second position being multiple corresponding positions in the moving path; query the second position in a preset database to obtain a second data packet; the display device is used to send the second data packet to the display device, so that the display device processes the second data packet to obtain a second display screen.

[0025] Optionally, the desktop device is used to confirm that the floating ball is in a stationary state when the target dwell time is greater than a preset dwell threshold; obtain the user's click operation on the target button, the target buttons include a zoom-in command button, a zoom-out command button, a rotation command button, and a comparison command button; identify the click operation and obtain a control command to execute the operation corresponding to the control command.

[0026] Optionally, the desktop device is used to split the first data packet to obtain multiple sub-data packets; compress the multiple sub-data packets in sequence to obtain multiple compressed data packets, one sub-data packet corresponding to one compressed data packet; and the display device is used to transmit the multiple compressed data packets to the display device using parallel transmission.

[0027] Optionally, the desktop device is used to obtain multiple display areas corresponding to the display device; position encode the multiple display areas to obtain multiple area position codes, one display area corresponds to one area position code; divide the first data packet according to a target number to obtain multiple sub-data packets, and the target number is the total number corresponding to the multiple area position codes.

[0028] Optionally, the desktop device is used to obtain a target area position code corresponding to a target display area, where the target display area is any one of multiple display areas; determine a target data position code corresponding to the target area position code based on a mapping relationship, where the target data position code is a position code corresponding to a target sub-data packet, where the target data position code is a position code corresponding to the display of the target sub-data packet in the target display area, and the mapping relationship is a pre-constructed mapping relationship between the target area position code and the target data position code; the display device is used to send the target sub-data packet to the display device so that the target display area of ​​the display device receives the target sub-data packet.

[0029] Optionally, the desktop device is used to collect data for the smart community using a target shooting device to obtain historical image data; divide the historical images to obtain multiple three-dimensional image data; divide the multiple three-dimensional image data according to preset position rules to obtain multiple positions, one position corresponding to one three-dimensional image data; process the target three-dimensional image data to obtain a first data packet, and obtain a first position corresponding to the target three-dimensional image data; build a preset database, the preset database includes a corresponding relationship between the first position and the first data packet.

[0030] In a third aspect of the present application, an electronic device is provided, which includes a processor, a memory, a user interface and a network interface, the memory is used to store instructions, the user interface and the network interface are used to communicate with other devices, and the processor is used to execute the instructions stored in the memory, so that an electronic device executes any one of the methods described above in the present application.

[0031] In a fourth aspect of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores instructions, and when the instructions are executed, any one of the above methods of the present application is executed.

[0032] In summary, one or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages:

[0033] 1. In response to the user's target viewing request, the target map in the immersive space of the smart community is viewed, and the first position in the target map is determined based on the user's movement operation on the target floating ball. The first position is input into a preset database for query to obtain a first data packet, which is a three-dimensional space data packet. By inputting the first position into the preset database, the three-dimensional space data packet corresponding to the first position can be accurately obtained, and the first data packet is sent to a display device. The display device parses the first data packet and generates a first display screen. This display method does not depend on a specific device. It only needs to parse the first data packet and generate a first display screen, which reduces dependence on viewing devices and improves user experience.

[0034] 2. Obtain the target floating ball's residence time at the first position, i.e., the target residence time, and compare the target residence time with the preset residence threshold to determine the user's intention. When the target residence time is less than or equal to the preset residence threshold, confirm that the target floating ball is in a moving state, thereby avoiding delays and freezes when the user quickly browses the target map, achieving a refined and intelligent user interaction experience, and further improving the user experience.

[0035] 3. When the target stay time is greater than the preset stay threshold, it is confirmed that the target floating ball is in a stationary state. It can be considered that the user needs to further understand the first position, obtain the user's click operation on the target button, and the user zooms in, zooms out, rotates and compares the first position based on his own needs, and then identifies the click operation to obtain the control instruction, executes the operation corresponding to the control instruction, and executes the corresponding control instruction according to the user's click operation. Data is loaded and processed only according to the actual needs of the user, rather than loading the data of the entire map scene at one time, reducing unnecessary waste of resources, while improving the operating efficiency of desktop devices and further enhancing the user experience of the immersive space of the smart community.

[0036] 4. Acquire multiple display areas corresponding to the display device, then position-code the multiple display areas in turn to obtain multiple area position codes, determine the target number according to the area position codes, and segment the first data packet based on the target number to obtain multiple sub-data packets. This segmentation ensures that each display area can obtain the corresponding sub-data packet, thereby avoiding data redundancy and insufficient problems; dynamically adjust the segmentation method and quantity of the first data packet according to the actual number of display areas of the display device, so that its segmentation can adapt to display devices of different sizes and configurations to enhance the display effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 It is a scene schematic diagram of an interactive method based on a smart community immersive space provided in an embodiment of the present application;

[0038] Figure 2 It is a flowchart of an interactive method based on a smart community immersive space provided in an embodiment of the present application;

[0039] Figure 3 It is a structural schematic diagram of an interactive method based on a smart community immersive space provided in an embodiment of the present application;

[0040] Figure 4 It is a structural diagram of an interactive system based on a smart community immersive space provided in an embodiment of the present application;

[0041] Figure 5 It is a structural schematic diagram of an electronic device disclosed in an embodiment of the present application.

[0042] Explanation of the reference numerals: 11, projection device; 12, identification table; 13, token; 14, wall; 401, desktop device; 402, display device; 500, electronic device; 501, processor; 502, communication bus; 503, user interface; 504, network interface; 505, memory. DETAILED DESCRIPTION

[0043] In order to enable technicians in this field to better understand the technical solutions in this specification, the technical solutions in the embodiments of this specification will be clearly and completely described below in conjunction with the drawings in the embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this application, not all of the embodiments.

[0044] In the description of the embodiments of the present application, words such as "for example" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "for example" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "for example" or "for example" is intended to present related concepts in a specific way.

[0045] In the description of the embodiments of the present application, the meaning of the term "multiple" refers to two or more. For example, multiple systems refer to two or more systems, and multiple screen terminals refer to two or more screen terminals. In addition, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. The terms "include", "comprise", "have" and their variations all mean "including but not limited to", unless otherwise specifically emphasized.

[0046] In today's society, as an important cornerstone of social harmony, stability and development, the value and influence of communities are becoming increasingly significant. A community is not only a highly interactive and closely connected living community formed by multiple social groups or organizations in a specific region, but also a core platform for residents' communication, cultural heritage, daily life and social governance.

[0047] With the rapid progress of information technology, especially the widespread popularization and in-depth application of Internet technology, unprecedented innovation opportunities have been brought to traditional community management and services. By introducing advanced modern information technology, the overall quality of community life can be significantly improved, and a living environment that integrates safety, convenience, efficiency and environmental protection can be built. The construction of smart communities is the concentrated embodiment of this innovation. It can not only greatly improve the quality of life of community residents, but also fully meet the residents' expectations for a comfortable, safe and warm life. In the real estate market, when choosing a property, home buyers usually need to fully understand the geographical location, building structure and construction of the community where the property is located. To this end, home buyers usually need to obtain information through multiple channels and go to the sales agency in person for consultation. The sales agency recommends suitable houses according to the specific needs of the home buyers and accompanies the home buyers for field inspections. However, the traditional field inspection method requires home buyers to arrive at the site in person to observe the structure of the house, or can only have a preliminary understanding through a two-dimensional floor plan. This flat image often cannot accurately reflect the three-dimensional effect of the house, and is easily affected by viewing equipment and conditions, resulting in a poor user experience.

[0048] Therefore, how to solve the problem that the flat image cannot accurately reflect the three-dimensional efficiency of the house, resulting in poor user experience, is an urgent problem to be solved. The embodiment of the present application provides an interactive method based on the immersive space of a smart community, which is applied to a desktop device. The desktop device of the present application refers to a platform for displaying a space map and identifying a target floating ball operation for space tour, such as Figure 1As shown, the present application provides an interactive system, which consists of a desktop device and a display device. The desktop device includes an identification table 12 and a token 13. In the present application, the token 13 refers to a target suspension ball. The identification table 12 refers to a device for displaying a spatial map and identifying the operation of the target suspension ball, which plays the role of a spatial tour. The target suspension ball controls the direction and conducts a virtual tour of the exhibition hall. The display device includes a dark field space, a projection device 11, and a target space. The target space refers to a wall 14 to build a fully immersive, advanced virtual simulation environment surrounded by a three-dimensional picture; the projection device projects the interactive content to the wall 14 in the form of a projection, and immersively displays the virtual space; the dark field space uses the projection device 11 for output display, so it needs to pass through a dark field to make the projection display clear enough. The identification table 12 uses capacitive touch screen technology to sense the user's operation on the target suspension ball on the desktop and convert the operation information into interactions and events in the virtual environment. In response to the user's request to view the smart community, the desktop device can display the map corresponding to the smart community on the desktop device so that the user can control the movement of the target suspension ball based on the target map. Based on the position corresponding to the user-controlled target floating ball, the three-dimensional data packet is determined according to the position, and then the three-dimensional data packet is sent to the display device so that the display device can show the display screen corresponding to the position to the user, thereby realizing the true restoration of the three-dimensional stereoscopic effect of the smart community and reducing the dependence on viewing devices, thereby improving the user experience.

[0049] like Figure 2 As shown, Figure 2 This is a flowchart of an interactive method based on a smart community immersive space provided by an embodiment of the present application, refer to Figure 2 The method includes the following steps S201-S205.

[0050] S201: Responding to a target viewing request of a user, where the target viewing request is a request to view a target map in an immersive space of a smart community.

[0051] In the above S201, the interactive interface of the desktop device displays multiple map options to the user. The smart community includes the overall community structure, the structure of each building in the community, the structure of a certain floor in the community, and the structure of a certain house. Different structures correspond to different maps, that is, one structure corresponds to one map. At this time, the user refers to a person who has a need to view the smart community. The user can click on any map option on the interactive interface and send a target viewing request to the desktop device based on the user's click. The target viewing request specifies that the user wants to view a target map in the immersive space of the smart community. This application uses the example of viewing the structure of the smart community. At this time, the target map is the structural diagram of the smart community. In addition to viewing the structural diagram of the smart community, you can also view the structural diagram of a building in the community, the structure of a certain floor in the building, and the structure of a certain house. The specific structure to be viewed can be viewed based on the user's needs.

[0052] S202: Display a target map, which is a structural diagram corresponding to the smart community.

[0053] In the above S202, after the desktop device receives the user's click operation to select the target map, it retrieves the corresponding target map from the pre-stored map database according to the target viewing request. At this time, the target map is the structural diagram of the smart community, and the structural diagram of the smart community includes information such as the layout of buildings, roads, green spaces, and public facilities. The target map is displayed on the desktop device, that is, the spatial bird's-eye view of the target map is displayed on the desktop device. The spatial bird's-eye view is a stereoscopic view drawn from a certain point at a high altitude based on the perspective principle, using a high viewpoint perspective method to look down on the undulations of the ground, which can effectively be converted from a plane to a three-dimensional space. The spatial bird's-eye view can facilitate users to view the overall overhead view of the smart community. This application takes the example of viewing the structure of a smart community, and can also view the buildings, floors, and house structures in the smart community, but the specific structure to view in the smart community can be selected based on the actual needs of the user, and there is no excessive limitation here.

[0054] S203: Determine a first position based on the user's movement operation on the target floating ball, where the first position is any position of the target floating ball on the target map.

[0055] In the above S203, a target floating ball can be provided on the displayed target map as an interactive medium between the user and the desktop device. The target floating ball can be presented in the form of a graphic, an icon or a cursor. The user moves the target floating ball to a certain position on the target map through an input device (the input device can be a mouse, a touch screen, a gesture, etc.), tracks the position of the target floating ball in real time, and records its position as a basis for subsequent queries. Based on the user's operation of moving the target floating ball, the first position currently staying is determined according to the operation. At this time, the first position can be understood as the position where the user currently moves the target floating ball.

[0056] In addition, to determine whether the user controls the target floating ball to move on the target map, it is necessary to judge the user's intention to move, and judge whether the user is currently in a moving state or a stationary state. The moving state means that the user is continuously in a moving state and does not stay at a certain position on the target map. The stationary state means that the user stays at a certain position on the target map during the movement, and there may be a need for further viewing. How to judge the user's intention to move includes: obtaining the target stay time, which is the stay time of the target floating ball at the first position; judging whether the target stay time is less than or equal to the preset stay threshold; when the target stay time is less than or equal to the preset stay threshold, it is confirmed that the target floating ball is in a moving state. Specifically, the user operates the target floating ball in the immersive space of the smart community to make it stay at a certain position (i.e., the first position) on the target map. The user's stay time at the first position is obtained, i.e., the target stay time. The target stay time can be understood as the time from the target floating ball to the time from stopping to moving again after reaching the first position. In order to accurately time, a high-precision timestamp or timer can also be used to record the start and end time points, and settle the difference between the two time points. A dwell threshold can be preset, which is a time length used to determine whether the user's purpose is short-term or real viewing. The target dwell time is compared with the preset dwell threshold to check whether the target dwell time is less than or equal to the preset dwell threshold. The setting of the preset dwell threshold may need to consider multiple factors, which need to be considered based on different scenarios, response speeds, and task requirements, and can also be obtained based on historical experimental data. When the target dwell time is less than or equal to the preset dwell threshold, it can be considered that the user does not really want to stay in the first position to view, but passes by briefly or touches it by mistake, then it is confirmed that the target floating ball is in a moving state, and the display screens of each position can be determined according to the target floating ball being in a moving state, and displayed to the user in turn.

[0057] For example, the target suspension ball's residence time at the first position is obtained, that is, the target residence time is 10 milliseconds, and the preset residence threshold can be set to 12 milliseconds. If the target residence time is less than the preset residence threshold, it is confirmed that the target suspension ball is in a moving state.

[0058] Further, based on the user's moving operation on the target suspended ball, the moving path corresponding to the moving operation is obtained, and the second position is determined according to the moving path, and then the second data packet is queried from the preset database to obtain the second data packet, and the second data packet is sent to the display device for processing, and a continuous display screen is displayed to the user, further improving the user experience. Specifically, it includes: based on the user's moving operation on the target suspended ball, the moving path of the target suspended ball is obtained; the second position is determined according to the moving path, and the second position is a plurality of corresponding positions in the moving path; the second position is queried in the preset database to obtain a second data packet; the second data packet is sent to the display device, so that the display device processes the second data packet to obtain a second display screen. Specifically, after determining that the target suspended ball is in a moving state, the user can touch the touch screen to display the target suspended ball, so that it moves on the target map, track the moving trajectory of the suspended ball in real time, and record the coordinate points it passes through, and these coordinate points constitute the moving path of the suspended ball. The time information of the target suspended ball arriving at each position can be obtained in sequence, and the position information can be stored in chronological order. From the moving path of the target suspended ball, multiple positions appearing in the moving path can be obtained, and the multiple positions are defined as the second position. The multiple positions include the starting point, station, turning point and specific area position of the moving path of the target suspended ball. According to the multiple positions appearing in the moving path of the target suspended ball, that is, the second position, the preset database can be input for query to obtain the second data packet, and the second position is used as a query condition to query the preset database to obtain the second data packet corresponding to the second position, that is, the three-dimensional data packet corresponding to the second position. The second data packet is sent to the display device, and the display device may be a projector device, a computer display screen and other projection devices. The sending method includes wired transmission and wireless transmission. After receiving the second data packet, the display device will parse and process the second data packet to obtain the second display screen. That is, the three-dimensional display screen corresponding to the moving path is displayed to the user so that the user can understand the three-dimensional stereoscopic images corresponding to each position passed during the movement.

[0059] Furthermore, when the target stay time is greater than the preset stay threshold, it is confirmed that the floating ball is in a stationary state; the user's click operation on the target button is obtained, and the target button includes a zoom-in instruction button, a zoom-out instruction button, a rotation instruction button, and a comparison instruction button; the click operation is identified to obtain a control instruction so as to execute the operation corresponding to the control instruction. Specifically, when the target stay time is greater than the preset stay threshold, it is confirmed that the target floating ball is in a stationary state, that is, the user intends to interact or view the first position more deeply, and the target floating ball is confirmed to be in a stationary state. The preset stay threshold is a time value set according to application requirements, which may vary from application to application. After confirming that the target floating ball is in a stationary state, some subsequent operations will be triggered, such as displaying more detailed information, enabling more interactive functions, etc. When the target floating ball is in a stationary state, a target button is displayed on the interface of the desktop device, and the target button includes multiple function buttons, including a zoom-in instruction button, a zoom-out instruction button, a rotation instruction button, and a comparison instruction button; the target button is used to control the display method of a certain location in the target map. The user clicks the target button through the touch screen, and an operation instruction is issued according to the clicked target button. Analyze the target button clicked by the user and identify the type of operation the user wants to perform. Depending on the button, the system will get different control instructions. For example, when the user clicks the zoom-in instruction button, the instruction for the zoom-in operation will be identified; when the user clicks the zoom-out instruction button, the instruction for the zoom-out operation will be identified; when the user clicks the rotation instruction button, the instruction for the rotation operation will be identified; when the user clicks the comparison instruction button, the instruction for the location comparison will be identified. If the first location corresponds to a public building, the corresponding public buildings in other communities can be viewed for the user to compare. The identification process may involve matching the ID, name, or other identifiers of the target button. After identifying the control instruction, the desktop device performs the corresponding operation. For the zoom-in instruction, the desktop device may enlarge the map area or data display where the current floating ball is located; for the zoom-out instruction, the desktop device may reduce the map or data display; for the rotation instruction, the desktop device may rotate the map or data perspective; for the comparison instruction, the desktop device may load and compare different data sets or map areas. Different operations may change the display content of the display device to meet the user's viewing and analysis needs.

[0060] S204: Input the first position into a preset database for query to obtain a first data packet, wherein the preset database includes a correspondence between the first data packet and the first position, and the first data packet is a three-dimensional space data packet.

[0061] In the above S204, when it is determined that the target suspended ball is in the first position, the first position is input into the preset database for query. Before obtaining the first data packet, a preset database needs to be constructed. The preset database is a pre-stored detailed three-dimensional model, texture, lighting and other data of each area in the smart community. The construction process specifically includes: using the target shooting device to collect data for the smart community to obtain historical image data; dividing the historical image to obtain multiple three-dimensional image data; dividing the multiple three-dimensional image data according to the preset position rule to obtain multiple positions, one position corresponds to one three-dimensional image data; processing the target three-dimensional image data to obtain the first data packet, and obtaining the first position corresponding to the target three-dimensional image data; constructing a preset database, the preset database includes the correspondence between the first position and the first data packet. Specifically, select a suitable target shooting device, such as a three-dimensional camera carried by a drone or a three-dimensional scanning device on the ground, which can capture the three-dimensional information of the smart community. Set the flight route, scanning area and shooting parameters (such as resolution, frame rate and scanning angle, etc.) of the shooting device to ensure that the three-dimensional data of the smart community can be collected comprehensively and accurately. Start the shooting device to collect data for the smart community and obtain a series of three-dimensional image data, namely historical image data. These data usually exist in the form of point clouds, grids or texture maps. Import the collected three-dimensional image data into the three-dimensional image processing software, and divide the historical images according to actual needs. Since the three-dimensional image data is usually large, the division can be based on space (such as dividing a large scene into multiple small scenes) or time (such as dividing by time period). During the division process, it is necessary to ensure that each three-dimensional image data contains complete and independent spatial information, and there is no obvious overlap or omission between the data. When defining the preset location rule, this rule can be based on the geographic coordinates of the three-dimensional image (such as longitude and latitude, altitude), or it can be a specific feature in the image content of several days (such as buildings, roads, and terrain). Apply the preset location rule to each three-dimensional image data to determine its corresponding position. This position is usually a coordinate point or area range in a three-dimensional space. After the position division, multiple positions are obtained, and each position corresponds to a three-dimensional image data. A specific three-dimensional image data is selected as the target three-dimensional image data, and the target three-dimensional image data is processed, including data compression, format conversion, coordinate system normalization, etc., so as to convert the three-dimensional image data into a format suitable for transmission and storage. After processing, a first data packet is obtained, and the first data packet contains all the information of the target three-dimensional image data, such as point cloud data, texture mapping, and material information. At the same time, the first position corresponding to the target three-dimensional image data is obtained, and this position is used for subsequent data management and query, and a corresponding relationship between the first position and the first data packet is established, and the corresponding relationship is stored in a preset database, so that users can quickly query the corresponding three-dimensional graphic data packet at the first position.As data continues to accumulate, more location and data packet information can be added to the preset database to form a complete three-dimensional image database of the smart community.

[0062] In addition, after the preset database is constructed, the first position is input into the preset database as a query condition. The preset database is searched according to the query condition to find the first data packet associated with the first position. The first data packet is a three-dimensional space data packet, and the three-dimensional scene corresponding to the first position can be displayed.

[0063] S205: Send the first data packet to the display device, so that the display device parses the first data packet to obtain a first display picture.

[0064] In the above S205, after the desktop device obtains the first data packet according to the query of the first position, before sending the first data packet to the display device, it is necessary to compress the first data packet and then send the compressed first data packet. Compressing the first data packet can improve the efficiency and reliability of data transmission, which specifically includes: dividing the first data packet to obtain multiple sub-data packets; compressing the multiple sub-data packets in turn to obtain multiple compressed data packets, one sub-data packet corresponding to one compressed data packet; transmitting the multiple compressed data packets to the display device using parallel transmission. Specifically, the first data packet is obtained, and the first data packet is divided to obtain multiple sub-data packets. According to the requirements of network transmission and performance requirements, the first data packet can be divided into multiple parts according to different requirements to obtain multiple sub-data packets. In the segmentation process, the relevant information of each sub-data packet, such as the serial number, source address, destination address, etc., needs to be recorded for subsequent processing and transmission. Then, the multiple sub-data packets are compressed in turn to obtain multiple compressed data packets. According to actual needs and data characteristics, a suitable compression method can be selected. For example, the Lempel-Ziv compression algorithm can be used. The Lempel-Ziv compression algorithm (LZ algorithm for short) is a type of lossless data compression algorithm. Its basic idea is to compress data by using strings that have been encountered to encode recurring patterns. The Lempel-Ziv compression algorithm is a dictionary-based lossless data compression algorithm with wide applicability and efficient compression performance. However, for other types of data, other suitable compression methods may need to be selected. Perform compression operations on each sub-packet and convert it into a compressed data packet. This process reduces the size of the data packet, thereby speeding up transmission and saving storage space. After the compression is completed, the compression effect can be verified by comparing the size of the original sub-packet and the compressed data packet. At the same time, the integrity and correctness of the data can also be maintained to ensure that no errors are introduced during the compression process. When using parallel transmission to transmit multiple compressed data packets to the display device, parallel transmission requires multiple physical channels, so the corresponding transmission lines and equipment are required in advance. For each compressed data packet, an independent transmission channel is required. Send multiple compressed data packets to their respective transmission channels for parallel transmission. This can fully utilize the advantages of multiple channels and improve the efficiency and speed of data transmission. During parallel transmission, it may be necessary to add control signals to synchronize the data transmission of each channel. For example, a "select" pulse can be used to notify the receiving device that all bits have been sent and it can start receiving the next data packet. After receiving the compressed data packet, the display device needs to decompress and verify the operation. First, use the same compression algorithm as the sender to decompress and restore the original sub-packet. Then, verify the integrity and correctness of the data by comparing the sequence number, checksum and other information.Through the above steps, the first data packet can be effectively segmented, compressed and sent to the display device in a parallel transmission manner, thereby improving the efficiency and reliability of data transmission.

[0065] In addition, when the first data packet is segmented to obtain multiple sub-data packets, different segmentation methods can be determined based on the number of display devices. If the number of display devices is 1, the first processing method corresponds; when the number of display devices is multiple, the second processing method corresponds. Next, the two processing methods are introduced in turn.

[0066] The first processing method is that if the number of display devices is 1, that is, the user can only view the displayed screen through one display device. Multiple display areas of the display device can be obtained, and the first data packet is divided according to the total number of multiple display areas, which is helpful to realize the efficient division and display of data on multiple display areas, specifically including: obtaining multiple display areas corresponding to the display device; position coding the multiple display areas to obtain multiple area position codes, one display area corresponds to one area position code; dividing the first data packet according to the target number to obtain multiple sub-data packets, and the target number is the total number corresponding to the multiple area position codes. Specifically, it is necessary to identify the configuration and layout of the display device and determine the multiple display areas it has. These display areas may be multiple partitions of a large screen or multiple independent display screens. The configuration information of the display device can be queried through the communication interface with the display device, or the information of the display area can be obtained through predefined configuration data. After determining the display area of ​​the display device, the system also needs to understand the size, position, resolution and other parameters of each display area for subsequent processing. Position coding is performed on multiple display areas to obtain multiple area position codes. When position coding, each display area is matched with a unique identifier to facilitate subsequent data distribution and display. The encoding method can be selected according to actual needs. It can be a simple digital number, two-dimensional coordinates, a combination of letters and values, etc. The important thing is to ensure that each code is unique and corresponds to the corresponding display area one by one. The encoding process can be completed manually or automatically generated according to the layout and configuration information of the display area. After the encoding is completed, these area position codes need to be saved for subsequent data distribution and display. Get the target number, which refers to the total number corresponding to multiple area position codes, that is, the number of all display areas on the display device. Divide the first data packet according to the target number to ensure that the size and number of each sub-data packet match the number of display areas. The segmentation process can be performed according to the content and format of the first data packet. During the segmentation process, it is also necessary to ensure that each sub-data packet contains a complete information unit and maintain the consistency and correctness of the data.

[0067] Further, how to associate the display area with the first data packet through a mapping relationship to achieve accurate distribution and display of data, specifically including: obtaining a target area position code corresponding to the target display area, the target display area is any one of the multiple display areas; determining the target data position code corresponding to the target area position code according to the mapping relationship, the target data position code is the position code corresponding to the target sub-data packet, the target data position code is the position code corresponding to the display of the target sub-data packet in the target display area, and the mapping relationship is to pre-build a mapping relationship between the target area position code and the target data position code; sending the target sub-data packet to the display device so that the target display area of ​​the display device receives the target sub-data packet. Specifically, any one display area is selected from the multiple display areas as the target display area, and the target area position code corresponding to the target display area is obtained, and the target area position code refers to the unique position code corresponding to the target display area in the display device. A preset mapping relationship table can be established, and the preset mapping relationship table records the correspondence between the area position code and the data position code. The target area position code corresponding to the target display area is input into the preset mapping relationship table for query, and the target data position code corresponding to the target area position code is obtained, and the target data position code is the position identifier corresponding to the target sub-data packet. After confirming that the target sub-data packet corresponds to the target display area, the target sub-data packet is sent to the display device to ensure that the target sub-data packet can be accurately sent to the display device where the target display area is located, so that the corresponding target display area in the display device can process the target sub-data packet. After receiving the target sub-data packet, the display device needs to determine the target sub-data packet should be displayed in the display area according to the target data position code of the target sub-data packet. After receiving the target sub-data packet, the target display area will parse the target sub-data packet and finally display the target sub-data packet on the display device. Figure 3 As shown, a display device is divided into multiple display areas. Figure 3 The rows and columns are divided to obtain the position code corresponding to each display area, 011 represents the first row and the first column, 012 represents the first row and the second column, 013 represents the first row and the third column, 021 represents the second row and the first column, 022 represents the second row and the second column, 023 represents the second row and the third column, 031 represents the third row and the first column, 032 represents the third row and the second column, 033 represents the third row and the third column.

[0068] Furthermore, in addition to using the Lempel-Ziv compression algorithm to compress multiple sub-data packets, asymmetric encryption can also be used to compress multiple sub-data packets to obtain multiple compressed data packets, specifically including: obtaining a first key corresponding to the target display area; encrypting the first key with the target sub-data packet to obtain a target compressed data packet; sending the target compressed data packet to the display device so that the target display area uses the second key to decrypt the target compressed data packet. Specifically, the first key corresponding to the target display area must be obtained first. The target display area has a pair of keys, which are divided into a public key and a private key. At this time, the first key represents the public key of the target display area. According to the identifier of the target display area, the corresponding first key is retrieved. After obtaining the first key, the first key is encrypted with the target sub-data packet to obtain the encrypted data, and then the encrypted data is compressed to reduce the size and bandwidth requirements during transmission. The compression algorithm can be selected according to the actual situation. After the encrypted and compressed data are combined into a target compressed data packet, the target display area corresponding to the target sub-data packet is queried according to the mapping relationship, and the target compressed data packet can be sent to the target display device through a network or other communication methods. During the transmission process, the integrity, security and transmission efficiency of the data may need to be considered. A secure transmission protocol such as the transport layer security protocol can be used to ensure the security of the data during transmission. After receiving the target compressed data packet, the display device must first decompress the target compressed data packet to restore the encrypted target sub-data packet. Then send the encrypted target sub-data packet to the target display area in the display device, and the target display area uses the second key to decrypt the encrypted target sub-data packet. Since the public key in the asymmetric key is used for encryption in this application, the private key (i.e., the second key) is required for decryption. The decrypted target sub-data packet will be used for display by the target display area. If the second key cannot decrypt the encrypted target sub-data packet, the encrypted target sub-data packet identifies the display content corresponding to the target display area by default, and the target sub-data packet corresponding to the target display area needs to be re-acquired, and then the target sub-data packet is encrypted and compressed according to the above steps to obtain a new target compressed data packet. Then send the new target compressed data packet to the display device so that the display device can parse it, that is, the target display area uses the second key to decrypt, and then displays the display screen corresponding to the target sub-data packet.

[0069] After the first data packet is segmented, encrypted and compressed through the above steps, the compressed first data packet is sent to the display device, which can be a projector or a display. After receiving the compressed first data packet, the display device will parse and render the compressed first data packet. The parsing includes decompression, decryption and data splicing to ensure that the first data packet can be correctly read and displayed. The rendering process generates a corresponding visual image based on the three-dimensional model, texture, lighting and other data in the first data packet. This image is the first display screen that the user expects to see. The first display screen can be a detailed three-dimensional scene, a high-resolution texture map or a realistic environmental sound effect. Finally, the display device presents the first display screen to the user, and the user can obtain detailed information about the smart community through hearing, vision and other means.

[0070] In addition to the above-mentioned segmentation processing of the first data packet, the present application also introduces a second processing method. If there are multiple display devices, that is, the user can understand the display content by viewing multiple display devices, and based on the user's current location, the screen corresponding to the current location is fully displayed to the user through multiple display devices for the user to view. Specifically including: determining the third position based on the user's first movement operation on the target floating ball, determining the target area corresponding to the third position in the first map, the first map is a structural diagram corresponding to the target apartment type, the target apartment type is composed of multiple areas, and the target apartment type is a residential household corresponding to any building in the smart community; inputting the third position into the preset first database for query to obtain a third data packet; obtaining multiple display surfaces corresponding to the target area, a target area is composed of multiple display surfaces, and multiple display devices are called based on the multiple display surfaces, and multiple display devices are position-encoded to obtain multiple display device position codes, one display device corresponds to one display device position code; obtaining the first data corresponding to multiple display devices The method comprises the steps of: dividing the third data packet according to the first quantity to obtain a plurality of first sub-data packets; obtaining a first display device from the plurality of display devices, and obtaining a first display device position code corresponding to the first display device; determining a first data position code corresponding to the first display device position code according to a first mapping relationship, wherein the first data position code is a position code corresponding to the first sub-data packet, and the first sub-data packet is any sub-data packet among the plurality of first sub-data packets; sending the first sub-data packet to the first display device, so that the first display device receives the first sub-data packet, parses the first sub-data packet, and then displays the first sub-data packet in the first display device.

[0071] Specifically, at this time, the user sends a request to view the apartment type on a certain floor in the smart community, and the first map is displayed to the user according to the viewing request. The third position is determined based on the user's first movement operation on the target floating ball. The third position is the corresponding target area in the first map. The first map represents the structural diagram corresponding to the target apartment type. The target apartment type is a residential household corresponding to any building in the smart community. The residential household is also called a residential unit, a residential suite, a residential unit suite, etc. All of the above names refer to an independent living space in a unit building, usually including basic living functional areas such as bedrooms, living rooms, kitchens, and bathrooms. In different regions and contexts, the name of a household in a unit building may be slightly different. The target apartment type consists of multiple areas, including bedroom areas, living room areas, kitchen areas, and bathroom areas. The third position is input into the preset first database for query. Before obtaining the third data packet, it is necessary to construct the preset first database, which includes the correspondence between the third position and the third data packet. The construction process of the preset first database is similar to the construction of the above-mentioned preset database, but the difference is that a shooting device is used to collect data on the target apartment to obtain first image data, and the first image data is divided based on the area of ​​the target apartment to obtain multiple area image data, and then each area image data is divided in turn to obtain a historical position. The position division at this time refers to the position division of the front, back, left, right, top and bottom based on the user's current position in the area image data, to obtain multiple orientation positions, one orientation position corresponds to three-dimensional image data in one direction; the target area image data is processed to obtain the third data packet, and the third position corresponding to the target area image data is obtained; the preset first database is constructed, and the preset first database includes the correspondence between the third position and the third data packet. For example, when the target area image data is set to the bedroom area in the target apartment, when the user is currently at a certain position A in the bedroom area, that is, the third position is A, the screen data of the user in multiple directions such as the front, back, left and right of the bedroom area are obtained based on the user's current position A, and the screen data is divided according to the directions of up north, down south, left west and right east to obtain multiple orientation positions, one orientation position corresponds to one direction of three-dimensional image data; the image data corresponding to the multiple orientation positions are combined to obtain the third data packet. That is, when the third position is at position A, the third data packet needs to be displayed to the user, and the third data packet is the three-dimensional image data corresponding to multiple orientation positions. After determining the third data packet according to the third position, it is necessary to obtain multiple display surfaces corresponding to the target area. The display surface can be understood as the wall surface corresponding to the target area, and the wall surface includes four walls of front, back, left and right, plus the wall surface corresponding to the ground and the top. The number of display devices to be called is determined according to the multiple display surfaces, and the multiple display devices are position-coded to obtain multiple display device position codes, and one display device corresponds to one display device position code.A total number corresponding to a plurality of display devices, that is, a first number, is obtained, and a third data packet is divided according to the first number to obtain a plurality of first sub-data packets, where one first sub-data packet corresponds to three-dimensional image data of one orientation position; a first display device is obtained from the plurality of display devices, a first display device position code corresponding to the first display device is obtained, a first data position code corresponding to the first display device position code is determined according to a first mapping relationship, the first data position code is a position code corresponding to the first sub-data packet, and the first sub-data packet is sent to the first display device so that the first display device receives the first sub-data packet, and the first sub-data packet is parsed, and then the first sub-data packet is displayed on the first display device.

[0072] In the above example, when the third position is A, when the target area corresponding to the third position is the bedroom area, the bedroom area corresponds to four display surfaces, and the four display surfaces include the wall corresponding to the north, the wall corresponding to the south, the wall corresponding to the west, and the wall corresponding to the east. According to the four display surfaces, four display devices are called for display, and the four display devices are position-coded, i.e., 11, 12, 13, and 14, 11 represents the first display device position code corresponding to the first display device, 12 represents the second display device position code corresponding to the second display device, 13 represents the third display device position code corresponding to the third display device, and 14 represents the fourth display device position code corresponding to the fourth display device. The total number of display devices is obtained, i.e., the first number is 4. The third data packet is divided based on the first number to obtain four first sub-data packets, wherein one of the first sub-data packets represents three-dimensional image data of a direction position, and the first data position code corresponding to the first display device position code is determined according to the first mapping relationship, and the first data position code is the position code corresponding to the first sub-data packet 1. The four first sub-data packets are numbered in sequence to obtain the first sub-data packet, the second sub-data packet, the third sub-data packet, and the fourth sub-data packet. If the first sub-data packet represents the three-dimensional image data corresponding to the north-facing position, the first sub-data packet is sent to the first display device 11 so that the first display device 11 displays the three-dimensional image data corresponding to the north-facing position, that is, the first display device 11 displays the first sub-data packet (north-facing position). According to the above steps, the first sub-data packets corresponding to the remaining three display devices are determined based on the first mapping relationship. When the second sub-data packet represents the three-dimensional image data corresponding to the south-facing position, the second sub-data packet is determined to correspond to the second display device 12 based on the first mapping relationship, that is, the second display device 12 displays the second sub-data packet; when the third sub-data packet represents the three-dimensional image data corresponding to the east-facing position, the third sub-data packet is determined to correspond to the third display device 13 based on the first mapping relationship, that is, the third display device 13 displays the third sub-data packet; when the fourth sub-data packet represents the three-dimensional image data corresponding to the west-facing position, the fourth sub-data packet is determined to correspond to the fourth display device 14 based on the first mapping relationship, that is, the fourth display device 14 displays the fourth sub-data packet. Before sending, it is necessary to compress multiple first sub-data packets, and then use parallel transmission to send multiple first compressed data packets to multiple display devices. One display device receives one first compressed data packet, and after receiving, verification is performed based on the first mapping relationship to determine that there is a corresponding relationship between the first compressed data packet received by each display device and the display device. That is, the three-dimensional image data corresponding to the four orientation positions when the user is in the third position are displayed on the four display devices respectively.

[0073] Furthermore, when there are multiple display devices for display to the user, the first residence time of the user at the third position is obtained. If the first residence time is greater than the preset first residence threshold, it is confirmed that the target floating ball is in a stationary state, that is, the user wants to know the detailed information of the third position. According to the user's click operation on the target button, the click operation is identified to obtain a control instruction. If the user clicks the comparison button, the control instruction is to obtain other house types of the same type as the third position, and then retrieve the three-dimensional image data corresponding to the other house types. According to the orientation position currently displayed by each display device, the orientation position corresponding to the other house types is displayed on each display device, so that the user can more intuitively compare the decoration styles corresponding to different house types.

[0074] In a possible implementation, in addition to the above-mentioned method of first segmenting the first data packet and then compressing the multiple sub-data packets after segmentation, the first data packet can also be compressed first to obtain a first target data packet, and then the first target data packet is segmented to obtain multiple target sub-data packets, and the third key corresponding to the display device can be obtained. In this case, the third key refers to the public key in symmetric encryption. The multiple target sub-data packets are encrypted in sequence using the third key to obtain multiple encrypted data packets, and then the multiple encrypted data packets are sent to the display device so that the display device decrypts the multiple encrypted data packets, that is, the multiple encrypted data packets are decrypted using the third key to obtain multiple target sub-data packets, and then the multiple target sub-data packets are spliced ​​according to the segmentation method to obtain a second target data packet. Finally, the second target data packet is decompressed to obtain the original first data packet. The specific method for processing the first data packet can be selected based on the actual situation, and no excessive restrictions are made here. The above method can also be used to encrypt the third data packet, thereby ensuring the security of the third data packet during the transmission process.

[0075] The present application also provides an interactive system based on the immersive space of a smart community. Figure 4 is a schematic diagram of a structure of an interactive system based on an immersive space in a smart community provided in an embodiment of the present application, with reference to Figure 4 The system is an interactive system, which includes a desktop device 401 and a display device 402.

[0076] Desktop device 401 responds to a target viewing request from a user, which is a request to view a target map in an immersive space of a smart community; displays a target map, which is a structural diagram corresponding to the smart community; determines a first position based on a user's movement operation on a target floating ball, which is an arbitrary position of the target floating ball on the target map; inputs the first position into a preset database for query to obtain a first data packet, which includes a correspondence between the first data packet and the first position, and the first data packet is a three-dimensional space data packet.

[0077] The display device 402 sends the first data packet to the display device, so that the display device parses the first data packet to obtain a first display picture.

[0078] In a possible implementation, the desktop device 401 is used to obtain the target dwell time, which is the dwell time of the target floating ball at the first position; determine whether the target dwell time is less than or equal to a preset dwell threshold; when the target dwell time is less than or equal to the preset dwell threshold, it is confirmed that the target floating ball is in a moving state.

[0079] In a possible implementation, the desktop device 401 is used to obtain a moving path of the target floating ball based on the user's moving operation on the target floating ball; determine a second position according to the moving path, where the second position is a plurality of corresponding positions in the moving path; query a preset database for the second position to obtain a second data packet; and the display device 402 is used to send the second data packet to the display device so that the display device processes the second data packet to obtain a second display screen.

[0080] In one possible implementation, the desktop device 401 is used to confirm that the floating ball is in a stationary state when the target dwell time is greater than a preset dwell threshold; obtain the user's click operation on the target button, the target button includes a zoom-in command button, a zoom-out command button, a rotation command button, and a comparison command button; identify the click operation and obtain a control command to execute the operation corresponding to the control command.

[0081] In a possible implementation, the desktop device 401 is used to split the first data packet to obtain multiple sub-data packets; compress the multiple sub-data packets in turn to obtain multiple compressed data packets, one sub-data packet corresponding to one compressed data packet; and the display device 402 is used to transmit the multiple compressed data packets to the display device using parallel transmission.

[0082] In a possible implementation, the desktop device 401 is used to obtain multiple display areas corresponding to the display device; position encode the multiple display areas to obtain multiple area position codes, one display area corresponds to one area position code; divide the first data packet according to a target number to obtain multiple sub-data packets, and the target number is the total number corresponding to the multiple area position codes.

[0083] In a possible implementation, desktop device 401 is used to obtain a target area position code corresponding to a target display area, where the target display area is any one of a plurality of display areas; a target data position code corresponding to the target area position code is determined according to a mapping relationship, where the target data position code is a position code corresponding to a target sub-data packet, where the target data position code is a position code corresponding to the display of the target sub-data packet in the target display area, and the mapping relationship is a pre-constructed mapping relationship between the target area position code and the target data position code; display device 402 is used to send the target sub-data packet to the display device so that the target display area of ​​the display device receives the target sub-data packet.

[0084] In a possible implementation, the desktop device 401 is used to collect data for the smart community using a target shooting device to obtain historical image data; divide the historical images to obtain multiple three-dimensional image data; divide the multiple three-dimensional image data into positions according to a preset position rule to obtain multiple positions, one position corresponding to one three-dimensional image data; process the target three-dimensional image data to obtain a first data packet, and obtain a first position corresponding to the target three-dimensional image data; and construct a preset database, which includes a corresponding relationship between the first position and the first data packet.

[0085] It should be noted that: when the system provided in the above embodiment realizes its functions, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the system and method embodiments provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0086] The present application also discloses an electronic device. Figure 5 , Figure 5 The electronic device 500 may include: at least one processor 501 , at least one network interface 504 , a user interface 503 , a memory 505 , and at least one communication bus 502 .

[0087] The communication bus 502 is used to realize the connection and communication between these components.

[0088] The user interface 503 may include a display screen (Display) and an object recognition table. Optionally, the user interface 503 may also include a standard wired interface and a wireless interface.

[0089] The network interface 504 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface).

[0090] Among them, the processor 501 may include one or more processing cores. The processor 501 uses various interfaces and lines to connect various parts in the entire server, and executes various functions of the server and processes data by running or executing instructions, programs, code sets or instruction sets stored in the memory 505, and calling data stored in the memory 505. Optionally, the processor 501 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 501 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application requests; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 501, and it can be implemented separately through a chip.

[0091] Among them, the memory 505 may include a random access memory (RAM) or a read-only memory (Read-Only Memory). Optionally, the memory 505 includes a non-transitory computer-readable storage medium. The memory 505 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 505 may include a program storage area and a data storage area, wherein the program storage area. Instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc. can be stored; the data storage area can store data involved in the above-mentioned various method embodiments, etc. The memory 505 can also be optionally at least one storage device located away from the aforementioned processor 501.

[0092] like Figure 5 As shown, the memory 505 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an interactive application based on the smart community immersive space.

[0093] exist Figure 5In the electronic device 500 shown, the user interface 503 is mainly used to provide an input interface for the user and obtain data input by the user; and the processor 501 can be used to call the interactive application based on the smart community immersive space stored in the memory 505. When executed by one or more processors, the electronic device executes one or more methods described in the above embodiments.

[0094] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the order of the actions described, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required for the present application.

[0095] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0096] In the several embodiments provided in the present application, it should be understood that the disclosed devices can be implemented in other ways. For example, the device embodiments described above are only schematic, such as the division of the units, which is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some service interfaces, and the indirect coupling or communication connection of devices or units can be electrical or other forms.

[0097] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0098] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0099] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a memory and includes several instructions for a computer device (which can be a personal computer, server or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned memory includes: various media that can store program codes, such as USB flash drives, mobile hard drives, magnetic disks or optical disks.

[0100] The above is only an exemplary embodiment of the present disclosure and cannot be used to limit the scope of the present disclosure. That is, any equivalent changes and modifications made according to the teachings of the present disclosure are still within the scope of the present disclosure. After considering the disclosure of the specification and the truth of practice, it will be easy for those skilled in the art to think of other embodiments of the present disclosure. This application is intended to cover any variation, use or adaptive change of the present disclosure, which follows the general principles of the present disclosure and includes common knowledge or customary technical means in the technical field that are not recorded in the present disclosure.

Claims

1. An interactive method based on smart community immersive space, characterized in that: Applied in a desktop device, the method includes: Responding to a target viewing request from a user, where the target viewing request is a request to view a target map in the smart community immersive space; Displaying the target map, where the target map is a structural diagram corresponding to the smart community; Determine a first position based on the user's movement operation on the target floating ball, the first position being any position of the target floating ball on the target map; after determining the first position based on the user's movement operation on the target floating ball, the method further includes: acquiring a target dwell time, the target dwell time being a dwell time of the target floating ball at the first position; determining whether the target dwell time is less than or equal to a preset dwell threshold; when the target dwell time is less than or equal to the preset dwell threshold, confirming that the target floating ball is in a moving state; Input the first position into a preset database for query to obtain a first data packet, the preset database includes a corresponding relationship between the first data packet and the first position, and the first data packet is a three-dimensional space data packet; before the first position is input into the preset database for query to obtain the first data packet, it is necessary to construct a preset database, which specifically includes: using a target shooting device to collect data for the smart community to obtain historical image data; dividing the historical image to obtain a plurality of three-dimensional image data; dividing the plurality of three-dimensional image data according to a preset position rule to obtain a plurality of positions, one of which corresponds to one three-dimensional image data; processing the target three-dimensional image data to obtain the first data packet, and obtaining the first position corresponding to the target three-dimensional image data; constructing the preset database, the preset database includes a corresponding relationship between the first position and the first data packet; sending the first data packet to a display device so that the display device parses the first data packet to obtain a first display screen; before sending the first data packet to the display device, the method further includes: dividing the first data packet to obtain a plurality of sub-data packets; dividing the first data packet to obtain a plurality of sub-data packets; specifically including: obtaining a plurality of sub-data packets corresponding to the display device display area; position coding the plurality of display areas to obtain a plurality of area position codings, one of the display areas corresponds to one area position coding; dividing the first data packet according to a target number to obtain a plurality of sub-data packets, the target number being the total number corresponding to the plurality of area position codings; compressing the plurality of sub-data packets in sequence to obtain a plurality of compressed data packets, one of the sub-data packets corresponding to one compressed data packet; transmitting the plurality of compressed data packets to the display device using parallel transmission; after dividing the first data packet according to the target number to obtain a plurality of sub-data packets, the method further comprises: obtaining a target area position coding corresponding to a target display area, the target display area being any one of the plurality of display areas; determining a target data position coding corresponding to the target area position coding according to a mapping relationship, the target data position coding being a position coding corresponding to a target sub-data packet, the target data position coding being a position coding corresponding to the display of the target sub-data packet in the target display area, the mapping relationship being a mapping relationship pre-constructed between the target area position coding and the target data position coding; sending the target sub-data packet to the display device so that the target display area of ​​the display device receives the target sub-data packet.

2. The method according to claim 1, characterized in that After confirming that the target suspended ball is in a moving state when the target residence time is less than or equal to the preset residence threshold, the method further includes: Based on the user's movement operation on the target floating ball, a movement path of the target floating ball is acquired; a second position is determined according to the movement path, where the second position is a plurality of corresponding positions in the movement path; The second position is queried in the preset database to obtain a second data packet; the second data packet is sent to the display device so that the display device processes the second data packet to obtain a second display screen.

3. The method according to claim 2, characterized in that After determining whether the target stay time is less than or equal to a preset stay threshold, the method further includes: When the target stay time is greater than the preset stay threshold, it is confirmed that the floating ball is in a stationary state; obtaining the user's click operation on the target button, the target button includes a zoom-in instruction button, a zoom-out instruction button, a rotation instruction button, and a comparison instruction button; The click operation is identified to obtain a control instruction so as to execute the operation corresponding to the control instruction.

4. An interactive system based on smart community immersive space, characterized in that: The system is an interactive system, comprising a desktop device (401) and a display device (402). The desktop device (401) responds to a user's target viewing request, wherein the target viewing request is a request to view a target map in the smart community immersive space; displays the target map, wherein the target map is a structural diagram corresponding to the smart community; and determines a first position based on the user's movement operation on the target floating ball, wherein the first position is any position of the target floating ball on the target map; After the first position is determined based on the user's moving operation on the target suspended ball, the method further includes: obtaining a target dwell time, the target dwell time being the dwell time of the target suspended ball at the first position; determining whether the target dwell time is less than or equal to a preset dwell threshold; when the target dwell time is less than or equal to the preset dwell threshold, confirming that the target suspended ball is in a moving state; inputting the first position into a preset database for query to obtain a first data packet, the preset database including a correspondence between the first data packet and the first position, the first data packet being a three-dimensional space data packet; before inputting the first position into the preset database for query to obtain the first data packet, a preset database needs to be constructed, specifically including: using a target shooting device to collect data for the smart community to obtain historical image data; dividing the historical image to obtain a plurality of three-dimensional image data; dividing the plurality of three-dimensional image data according to a preset position rule to obtain a plurality of positions, one position corresponding to one three-dimensional image data; processing the target three-dimensional image data to obtain the first data packet, and obtaining the first position corresponding to the target three-dimensional image data; constructing the preset database, the preset database including a correspondence between the first position and the first data packet; The display device (402) sends the first data packet to the display device so that the display device parses the first data packet to obtain a first display screen; before sending the first data packet to the display device, it also includes: dividing the first data packet to obtain multiple sub-data packets; dividing the first data packet to obtain multiple sub-data packets; specifically includes: obtaining multiple display areas corresponding to the display device; position coding the multiple display areas to obtain multiple area position codes, one display area corresponds to one area position code; dividing the first data packet according to a target number to obtain multiple sub-data packets, the target number is the total number corresponding to the multiple area position codes; compressing the multiple sub-data packets in turn to obtain multiple compressed data packets, one sub-data packet corresponds to one compressed data packet data packet; transmitting the plurality of the compressed data packets to the display device using parallel transmission; after the first data packet is divided according to the target quantity to obtain the plurality of the sub-data packets, it also includes: obtaining a target area position code corresponding to a target display area, the target display area being any one of the plurality of the display areas; determining a target data position code corresponding to the target area position code according to a mapping relationship, the target data position code being a position code corresponding to a target sub-data packet, the target data position code being a position code corresponding to the display of the target sub-data packet in the target display area, the mapping relationship being a mapping relationship pre-constructed between the target area position code and the target data position code; sending the target sub-data packet to the display device so that the target display area of ​​the display device receives the target sub-data packet.

5. An electronic device, characterized in that: The electronic device (500) comprises a processor (501), a memory (505), a user interface (503) and a network interface (504), wherein the memory (505) is used to store instructions, the user interface (503) and the network interface (504) are used to communicate with other devices, and the processor (501) is used to execute the instructions stored in the memory (505) so that the electronic device (500) executes the method according to any one of claims 1 to 3.

Images