Immersive reading interaction method and system for exhibition scene

Abstract

The invention relates to the technical field of reading exhibition, and particularly discloses an immersive reading interaction method and system for an exhibition scene. The method comprises the following steps: obtaining house type arrangement data, carrying out initialization virtual arrangement, and constructing a virtual reading exhibition scene comprising a plurality of virtual bookshelves; carrying out real-time camera shooting positioning, carrying out position mapping in the virtual reading exhibition scene, and determining a target bookshelf; performing signal positioning, acquiring a real-time hand position, and selecting a target book; and starting virtual reading of the target book, and performing book preference optimization on the plurality of virtual bookshelves. A virtual reading exhibition scene can be constructed, a target bookshelf is determined and a target book is selected through position mapping of camera positioning and book selection of signal positioning, and reading recording and book preference optimization are performed, so that home reading exhibition is realized, and all-people and popularization reading popularization is promoted; and the problems of space congestion and disorder of offline reading exhibition are solved, and the comfort and immersion experience of reading exhibition are effectively improved.

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of reading exhibition, and particularly relates to an immersive reading interaction method and system for an exhibition scene. BACKGROUND

[0002] Reading exhibition is a comprehensive cultural exhibition activity with reading as the core theme, which displays books, reading scenes, reading culture and reading experience through various forms and media. The purpose is not only to display books and reading resources, but also to stimulate the public's interest in reading, spread the concept of reading and promote the reading trend of the whole people. It not only has the functions of education and culture dissemination, but also is a cultural popularization means with high public participation and strong social influence.

[0003] In the prior art, reading exhibition mainly relies on offline physical places such as libraries, art galleries and exhibition halls, which is obviously limited by physical space. Participants must be present on site, which greatly limits the spread range and audience coverage of the exhibition, making it difficult to achieve the goal of popularizing reading to the whole people. In addition, offline exhibitions are usually open at specific time periods, which easily attracts a large number of visitors to the site at the same time, causing congestion and disorder, affecting the comfort and immersion experience of visitors. SUMMARY

[0004] The purpose of the embodiment of the present application is to provide an immersive reading interaction method and system for an exhibition scene, which aims to solve the problems raised in the background art.

[0005] To achieve the above-mentioned purpose, the embodiment of the present application provides the following technical scheme:

[0006] The immersive reading interaction method for the exhibition scene specifically comprises the following steps:

[0007] Receiving a home exhibition request of a home user, obtaining house type arrangement data, identifying a plurality of family wall spaces, performing initial virtual arrangement, and constructing a virtual reading exhibition scene containing a plurality of virtual bookshelves;

[0008] Real-time camera positioning is performed on the home user, real-time user position is obtained, position mapping is performed in the virtual reading exhibition scene, and a target bookshelf is determined from a plurality of virtual bookshelves;

[0009] Signal positioning is performed on the hand-held mobile terminal of the home user, real-time hand position is obtained, a plurality of close books are determined from the target bookshelf, real-time distance calculation and comparison are performed, and a target book is selected;

[0010] Virtual reading of the target book is started, reading record is recorded, reading record data is obtained, reading preference analysis is performed, and book preference optimization is performed on a plurality of virtual bookshelves.

[0011] As a further limitation of the technical scheme of the embodiment of the application, the receiving of the home exhibition request of the home user, the acquisition of the house type arrangement data, the identification of the plurality of home wall spaces, the initialization of the virtual arrangement, and the construction of the virtual reading exhibition scene including a plurality of virtual bookshelves specifically comprises the following steps:

[0012] Receiving a home exhibition request of a home user;

[0013] Acquiring house type arrangement data;

[0014] Wall surface recognition is performed on the house type arrangement data, a plurality of home wall spaces are determined, and corresponding wall space areas are acquired;

[0015] Acquiring exhibition book data and temporary reading permissions;

[0016] Based on the exhibition book data, book classification matching is performed on the plurality of home wall spaces according to the plurality of wall space areas, and a plurality of corresponding classification book data are acquired;

[0017] According to the plurality of classification book data, virtual bookshelves are constructed in the plurality of corresponding home wall spaces, and the plurality of virtual bookshelves form a virtual reading exhibition scene.

[0018] As a further limitation of the technical scheme of the embodiment of the application, the real-time camera positioning of the home user is performed, the real-time user position is acquired, the position mapping is performed in the virtual reading exhibition scene, and the target bookshelf is determined from the plurality of virtual bookshelves, specifically comprising the following steps:

[0019] Real-time acquisition of a plurality of home monitoring data;

[0020] Based on the preset user features, feature recognition of real-time camera positioning is performed on the plurality of home monitoring data, and a real-time user position is acquired;

[0021] Position mapping is performed in the virtual reading exhibition scene, and a scene user position is acquired;

[0022] According to the scene user position, the position distance of the home user and the plurality of virtual bookshelves is calculated;

[0023] Based on the preset standard bookshelf distance, the plurality of position distances are compared and screened to determine a qualified distance;

[0024] According to the qualified distance, a corresponding target bookshelf is determined from the plurality of virtual bookshelves.

[0025] As a further limitation of the technical scheme of the embodiment of the present application, the signal positioning of the handheld mobile terminal of the home user, the acquisition of the real-time hand position, the determination of the plurality of close books from the target bookshelf, and the real-time distance calculation and comparison, and the selection of the target book specifically include the following steps:

[0026] The signal data of the handheld mobile terminal of the home user is acquired in real time through a plurality of fixed beacons.

[0027] According to the signal data, the signal distance between the handheld mobile terminal and the plurality of fixed beacons is calculated.

[0028] According to the plurality of signal distances, the handheld mobile terminal is signal-positioned to acquire the real-time hand position.

[0029] According to the real-time hand position and the preset pickup range, the plurality of close books from the target bookshelf is determined.

[0030] The real-time book distance between the real-time hand position and the plurality of close books is calculated.

[0031] Based on the preset standard book distance, the plurality of real-time book distances is compared and filtered to determine the book pickup distance.

[0032] According to the book pickup distance, the target book is selected from the plurality of close books.

[0033] As a further limitation of the technical scheme of the embodiment of the present application, the calculation formula of the plurality of signal distances is:

[0034]

[0035] Wherein, d i represents the signal distance between the handheld mobile terminal and the i-th fixed beacon, R i is the signal strength of the handheld mobile terminal acquired by the i-th fixed beacon, A is the preset standard signal strength, and n is the preset environmental attenuation factor.

[0036] The calculation formula of the plurality of real-time book distances is:

[0037]

[0038] Wherein, L j represents the real-time book distance between the real-time hand position and the j-th close book, (x M , y M , z M ) is the spatial coordinates of the real-time hand position, and (x B,j , y B,j , z B,j ) is the spatial coordinates of the j-th close book.

[0039] As a further limitation of the technical scheme of the embodiment of the application, the starting of the virtual reading of the target book and the reading record, the acquisition of the reading record data, the reading preference analysis, and the book preference optimization of the multiple virtual bookshelves specifically include the following steps:

[0040] Generating a book taking animation effect and displaying the target book taking;

[0041] Starting the virtual reading of the target book;

[0042] Recording the reading of the home user, acquiring the reading record data, and the reading record data including the dwell time, the page turning times, and the interaction frequency of each target book;

[0043] According to the reading record data, the reading preference analysis of the home user is performed, and the interest label data is generated;

[0044] According to the interest label data, the book preference optimization of the multiple virtual bookshelves is performed.

[0045] As a further limitation of the technical scheme of the embodiment of the application, the book preference optimization of the multiple virtual bookshelves according to the interest label data specifically includes the following steps:

[0046] Reading behavior recognition is performed on the multiple home monitoring data, and reading space data is recorded;

[0047] According to the reading space data and the interest label data, the preference optimization of the bookshelf arrangement of the multiple virtual bookshelves is performed;

[0048] Acquiring the height data of the home user;

[0049] According to the height data and the interest label data, the preference optimization of the book arrangement of the multiple virtual bookshelves is performed.

[0050] An immersive reading interaction system for an exhibition scene, the system specifically includes an initialization virtual arrangement module, a target bookshelf determination module, a target book selection module, and a book preference optimization module, wherein:

[0051] The initialization virtual arrangement module is used for receiving the home exhibition request of the home user, acquiring the house layout data, identifying multiple family wall spaces, performing initialization virtual arrangement, and constructing a virtual reading exhibition scene including multiple virtual bookshelves;

[0052] The target bookshelf determination module is used for real-time camera positioning of the home user, acquiring the real-time user position, mapping the position in the virtual reading exhibition scene, and determining the target bookshelf from the multiple virtual bookshelves.

[0053] a target book selection module configured to locate a handheld mobile terminal of a home user by a signal, acquire a real-time hand position, determine a plurality of close books from the target bookshelf, and perform real-time distance calculation and comparison to select a target book;

[0054] a book preference optimization module configured to start virtual reading of the target book, perform reading record, acquire reading record data, perform reading preference analysis, and optimize book preference for a plurality of virtual bookshelves.

[0055] As a further limitation of the technical scheme of the embodiment of the present application, the initialization virtual arrangement module specifically comprises:

[0056] a request receiving unit configured to receive a home exhibition request of a home user;

[0057] a house type arrangement data acquisition unit configured to acquire house type arrangement data;

[0058] a wall surface identification unit configured to identify wall surfaces of the house type arrangement data, determine a plurality of home wall spaces, and acquire corresponding wall space areas;

[0059] a book data acquisition unit configured to acquire exhibition book data and temporary reading permission;

[0060] a book classification matching unit configured to perform book classification matching for a plurality of the home wall spaces according to a plurality of the wall space areas based on the exhibition book data, and acquire a plurality of corresponding classification book data;

[0061] a virtual bookshelf construction unit configured to construct virtual bookshelves in a plurality of corresponding home wall spaces according to a plurality of the classification book data, and a plurality of the virtual bookshelves constitute a virtual reading exhibition scene.

[0062] As a further limitation of the technical scheme of the embodiment of the present application, the target book selection module specifically comprises:

[0063] a signal data acquisition unit configured to acquire signal data of a handheld mobile terminal of a home user in real time through a plurality of fixed beacons;

[0064] a signal distance calculation unit configured to calculate signal distances between the handheld mobile terminal and a plurality of fixed beacons according to the signal data;

[0065] a signal positioning unit configured to locate the handheld mobile terminal by a signal according to a plurality of the signal distances, and acquire a real-time hand position;

[0066] a close book determination unit configured to determine a plurality of close books from the target bookshelf according to the real-time hand position and a preset pickup range.

[0067] a book distance calculation unit configured to calculate real-time book distances between the real-time hand position and the plurality of books;

[0068] a distance comparison and screening unit configured to compare and screen the plurality of real-time book distances based on a preset standard book distance to determine a book picking distance;

[0069] a target book selection unit configured to select a target book from the plurality of books based on the book picking distance.

[0070] Compared with the prior art, the present application has the following advantages:

[0071] (1) The present application can construct a virtual reading exhibition scene, determine a target bookshelf and select a target book from the virtual reading exhibition scene through position mapping by camera positioning and book selection by signal positioning, and record reading and optimize book preferences, realize home reading exhibition, promote popularization of reading promotion, and do not have the problems of space congestion and order confusion in offline reading exhibition, effectively improve the comfort and immersion experience of reading exhibition;

[0072] (2) The present application can identify walls based on house type layout data, determine a plurality of family wall spaces and corresponding wall space areas, and then match books according to the plurality of wall space areas to construct corresponding virtual bookshelves in the plurality of family wall spaces, so as to realize book classification matching according to local conditions and adapt the virtual reading exhibition scene to the home environment;

[0073] (3) The present application can obtain real-time user positions through home monitoring and shooting, map positions in the virtual reading exhibition scene, calculate position distances between the home user and the plurality of virtual bookshelves, and compare and analyze the position distances to determine a target bookshelf close to the home user;

[0074] (4) The present application can obtain signal data of a hand-held mobile terminal of the home user in real time through a plurality of fixed beacons, calculate signal distances between the hand-held mobile terminal and the plurality of fixed beacons, position the hand-held mobile terminal, obtain a real-time hand position, determine a plurality of books close to the hand position, calculate and compare real-time book distances, and determine a target book to be picked to realize automatic and high-precision interactive recognition;

[0075] (5) The present application can record reading of a home user in terms of staying time, page turning times and interactive frequency, analyze reading preferences, generate interest label data, combine reading space data and height data, optimize preferences of bookshelf arrangement and book arrangement for the plurality of virtual bookshelves, realize intelligent recommendation of reading exhibition, and construct a continuously optimized personalized exhibition experience. BRIEF DESCRIPTION OF DRAWINGS

[0076] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or prior art description will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application.

[0077] Figure 1 A flowchart of an immersive reading interaction method of an exhibition scene provided by an embodiment of the present application is shown.

[0078] Figure 2 An application architecture diagram of an immersive reading interaction system of an exhibition scene provided by an embodiment of the present application is shown. DETAILED DESCRIPTION

[0079] In order to make the objects, technical solutions and advantages of the present application more clear, the present application will be further described in detail below with reference to the drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and not to limit the present application.

[0080] It can be understood that in the prior art, reading exhibitions mainly rely on offline physical places such as libraries, art galleries, exhibition halls, etc., which are obviously limited by physical space. Participants must be present on site, which leads to a great limitation of the spread range and audience coverage of the exhibition, making it difficult to achieve the goal of popularizing reading to the public, and offline exhibitions are usually open in a specific time period, which easily attracts a large number of visitors to the site at the same time, causing space congestion and order confusion, affecting the comfort and immersion experience of visitors.

[0081] To solve the above problems, an embodiment of the present application receives a home exhibition request of a home user, obtains house type arrangement data, identifies a plurality of family wall spaces, performs initial virtual arrangement, and constructs a virtual reading exhibition scene including a plurality of virtual bookshelves. The real-time user position is obtained by real-time camera positioning of the home user, the position is mapped in the virtual reading exhibition scene, the target bookshelf is determined from the plurality of virtual bookshelves, the real-time hand position is obtained by signal positioning of the hand-held mobile terminal of the home user, the target book is determined from the target bookshelf, and real-time distance calculation and comparison are performed to select the target book. The virtual reading of the target book is started, the reading record is recorded, the reading record data is obtained, the reading preference analysis is performed, and the book preference optimization of the plurality of virtual bookshelves is performed. The virtual reading exhibition scene can be constructed, the target bookshelf is determined and the target book is selected through the position mapping of the camera positioning and the book selection of the signal positioning, the reading record and the book preference optimization are performed, the home reading exhibition is realized, the popularization of reading to the public is promoted, and the problems of space congestion and order confusion in offline reading exhibitions are avoided, effectively improving the comfort and immersion experience of the reading exhibition.

[0082] Figure 1 A flowchart of an exhibition scene immersive reading interaction method provided by an embodiment of the present application is shown.

[0083] Specifically, in one preferred embodiment provided by the present application, the exhibition scene immersive reading interaction method specifically comprises the following steps:

[0084] In step S101, a home exhibition request of a home user is received, home layout data is acquired, a plurality of home wall spaces are identified, a virtual layout is initialized, and a virtual reading exhibition scene containing a plurality of virtual bookshelves is constructed.

[0085] In the embodiment of the present application, a home exhibition request of a home user is received, and home layout data is acquired. By wall surface identification on the home layout data, a plurality of home wall spaces are determined, and wall space areas corresponding to the plurality of home wall spaces are acquired. At the same time, exhibition book data and temporary reading permissions are acquired. Based on the exhibition book data, the plurality of home wall spaces are classified and matched according to the plurality of wall space areas. The classified book data corresponding to the plurality of home wall spaces is acquired. Then, according to the correspondence between the plurality of classified book data and the plurality of home wall spaces, virtual bookshelves are constructed according to the plurality of classified book data at the plurality of home wall spaces, and the plurality of virtual bookshelves form a virtual reading exhibition scene. Thus, corresponding virtual bookshelves are generated on the identified wall surfaces, and virtual book resources are arranged by category.

[0086] It can be understood that the home layout data contains not only a home layout drawing of the home user, but also layout information of entities such as furniture and home appliances.

[0087] It can be understood that the plurality of home wall spaces are wall space areas that are not blocked by entities such as furniture and home appliances. Therefore, the wall space areas corresponding to the plurality of home wall spaces are smaller than the actual wall areas recorded in the home layout drawing.

[0088] It can be understood that because of the temporary reading permissions, the home user can temporarily read all books corresponding to the exhibition book data. However, after the exhibition ends, the home user loses the reading permissions for books that have not been purchased.

[0089] It can be understood that the book classification matching specifically includes the following steps: first, the exhibition book data is classified and divided according to the number of home wall spaces to obtain a plurality of classified book data; then, the classified book data is matched according to the size of the plurality of wall space areas and the number of books in the plurality of classified book data, so that the larger the wall space area, the more books in the matched classified book data; the smaller the wall space area, the fewer books in the matched classified book data.

[0090] It can be understood that the virtual reading exhibition scene is a VR scene, and the home user needs to wear a corresponding VR device.

[0091] Specifically, in the preferred embodiment provided by the present application, the receiving of the home exhibition request of the home user, the acquisition of the house type layout data, the identification of the plurality of home wall spaces, the initialization of the virtual layout, and the construction of the virtual reading exhibition scene containing the plurality of virtual bookshelves specifically include the following steps:

[0092] Receiving a home exhibition request of a home user;

[0093] Acquiring house type layout data;

[0094] Wall surface identification is performed on the house type layout data, a plurality of home wall spaces are determined, and corresponding wall space areas are acquired;

[0095] Exhibition book data and temporary reading permissions are acquired;

[0096] Based on the exhibition book data, book classification matching is performed on the plurality of home wall spaces according to the plurality of wall space areas, and a plurality of corresponding classification book data are acquired;

[0097] Virtual bookshelves are constructed in the plurality of corresponding home wall spaces according to the plurality of classification book data, and the plurality of virtual bookshelves form a virtual reading exhibition scene.

[0098] Further, the immersive reading interaction method of the exhibition scene further includes the following steps:

[0099] In step S102, a home user is positioned by real-time camera shooting, a real-time user position is acquired, a position mapping is performed in the virtual reading exhibition scene, and a target bookshelf is determined from the plurality of virtual bookshelves.

[0100] In the embodiment of the present application, a plurality of home monitoring data are acquired in real time, feature recognition of real-time camera shooting positioning is performed on the plurality of home monitoring data based on preset user features, home monitoring data with the presence of a home user are determined, and then a real-time user position is determined, and the real-time user position is mapped and processed in the virtual reading exhibition scene to determine a scene user position of the home user in the virtual reading exhibition scene. According to the scene user position, the position distance between the home user and the plurality of virtual bookshelves is calculated, the plurality of position distances are compared and filtered based on a preset standard bookshelf distance, it is determined whether there is a position distance less than the standard bookshelf distance in the plurality of position distances, and when it is determined that there is a position distance less than the standard bookshelf distance, it is marked as a qualified distance. The virtual bookshelf corresponding to the qualified distance is determined from the plurality of virtual bookshelves, and it is marked as a target bookshelf.

[0101] It can be understood that the target bookshelf is a virtual bookshelf close to the home user and likely to be picked up by the book.

[0102] Specifically, in the preferred embodiment provided by the present application, the real-time camera positioning of the home user is performed to obtain the real-time user position, the position mapping is performed in the virtual reading exhibition scene, and the target bookshelf is determined from the plurality of virtual bookshelves, which specifically includes the following steps:

[0103] Real-time acquisition of a plurality of home monitoring data;

[0104] Based on the preset user characteristics, the feature recognition of the real-time camera positioning of the plurality of home monitoring data is performed to obtain the real-time user position;

[0105] The position mapping is performed in the virtual reading exhibition scene to obtain the scene user position;

[0106] According to the scene user position, the position distance between the home user and the plurality of virtual bookshelves is calculated;

[0107] Based on the preset standard bookshelf distance, the plurality of position distances are compared and screened to determine the qualified distance;

[0108] According to the qualified distance, the corresponding target bookshelf is determined from the plurality of virtual bookshelves.

[0109] Further, the immersive reading interaction method of the exhibition scene further includes the following steps:

[0110] Step S103, signal positioning is performed on the hand-held mobile terminal of the home user to obtain the real-time hand position, a plurality of books close to the target bookshelf are determined from the target bookshelf, and real-time distance calculation and comparison are performed to select the target book.

[0111] In the embodiment of the present application, through a plurality of fixed beacons, signal data of a handheld mobile terminal of a home user is acquired in real time, and then according to a plurality of signal strengths in the signal data, signal distances between the handheld mobile terminal and the plurality of fixed beacons are calculated, and then the handheld mobile terminal is positioned according to the plurality of signal distances and fixed positions of the plurality of fixed beacons, to acquire a real-time hand position of the home user, and according to the real-time hand position and a preset picking range, a plurality of close books in the picking range at the real-time hand position in a target bookshelf are determined, real-time book distances between the real-time hand position and the plurality of close books are calculated, a plurality of real-time book distances are compared and selected based on a preset standard book distance, whether the plurality of real-time book distances has a real-time book distance smaller than the standard book distance is judged, and when it is judged that the real-time book distance smaller than the standard book distance exists, the real-time book distance is marked as a book picking distance, and then a close book corresponding to the book picking distance is selected from the plurality of close books, and is marked as a target book. Specifically, a calculation formula of the plurality of signal distances is:

[0112]

[0113] wherein, d i represents the signal distance between the handheld mobile terminal and the i th fixed beacon, R i is the signal strength of the handheld mobile terminal acquired by the i th fixed beacon, A is a preset standard signal strength, and n is a preset environmental attenuation factor.

[0114] A calculation formula of the plurality of real-time book distances is:

[0115]

[0116] wherein, L j represents the real-time book distance between the real-time hand position and the j th close book, (x M , y M , z M ) is a spatial coordinate of the real-time hand position, and (x B,j , y B,j , z B,j ) is a spatial coordinate of the j th close book.

[0117] Specifically, in the preferred embodiment provided by the present application, the signal positioning of the handheld mobile terminal of the home user, the acquisition of the real-time hand position, the determination of the plurality of close books in the target bookshelf, and the real-time distance calculation and comparison, and the selection of the target book specifically include the following steps:

[0118] The signal data of the handheld mobile terminal of the home user is acquired in real time through the plurality of fixed beacons.

[0119] According to the signal data, a signal distance between the handheld mobile terminal and the plurality of fixed beacons is calculated;

[0120] According to the plurality of signal distances, the handheld mobile terminal is signal positioned to obtain a real-time hand position;

[0121] According to the real-time hand position and a preset picking range, a plurality of close books in the target bookshelf are determined;

[0122] A real-time book distance between the real-time hand position and the plurality of close books is calculated;

[0123] Based on a preset standard book distance, the plurality of real-time book distances are compared and filtered to determine a book picking distance;

[0124] According to the book picking distance, a target book is selected from the plurality of close books.

[0125] Further, the immersive reading interaction method of the exhibition scene further includes the following steps:

[0126] It can be understood that the plurality of fixed beacons are smart devices in the home environment of the home user, which can communicate with the handheld mobile terminal of the home user, such as a television, a refrigerator, a computer, etc.; the handheld mobile terminal can be a smart phone, a smart watch, etc.; the communication between the handheld mobile terminal and the plurality of fixed beacons can be achieved through wireless communication modes such as Bluetooth and UWB.

[0127] It can be understood that (x B,j ,y B,j ,z B,j ) is the spatial coordinates of the jth close book, specifically the coordinates of the middle position of the spine of the jth close book.

[0128] Step S104, starting the virtual reading of the target book, and performing reading record to obtain reading record data, performing reading preference analysis, and optimizing the plurality of virtual bookshelves according to book preference.

[0129] In the embodiment of the present application, the book taking animation effect is generated, the target book is displayed for taking, then the virtual reading of the target book is started, the home user can select a temporary reading place (for example, on a sofa, on a bed, on a chair) in the home environment for exhibition, the reading record data of the home user for each target book, such as the residence time, the page turning times and the interaction frequency, is obtained by recording the reading of the home user, the reading preference analysis of the home user is performed according to the reading record data, the interest label data is generated, the reading behavior of the home monitoring data is recognized, the reading space data of the home user is recorded, and the preference optimization of the bookshelf arrangement of the multiple virtual bookshelves is performed according to the reading space data and the interest label data, and meanwhile, the height data of the home user is obtained, the preference optimization of the book arrangement of the multiple virtual bookshelves is performed according to the height data and the interest label data.

[0130] It can be understood that the reading space data records the reading time of the home user in different home rooms, and through the preference optimization of the bookshelf arrangement, the virtual bookshelves that are more in line with the interests of the home user are arranged closer to the home room where the home user spends the longest reading time, and the virtual bookshelves that are less in line with the interests of the home user are arranged closer to the home room where the home user spends the shortest reading time, so that the home user can quickly approach the virtual bookshelves of interest.

[0131] It can be understood that the preference optimization of the book arrangement of the multiple virtual bookshelves is performed according to the height data of the home user, the preference optimization of the book arrangement of each virtual bookshelf is performed, so that the books that are more in line with the interests of the home user on each virtual bookshelf are closer to the height of the home user, and the books that are less in line with the interests of the home user are farther away from the height of the home user, so that the home user can quickly pick up the books of interest on each virtual bookshelf for virtual reading.

[0132] Specifically, in the preferred embodiment provided by the present application, the starting of the virtual reading of the target book, the reading record, the obtaining of the reading record data, the reading preference analysis, and the book preference optimization of the multiple virtual bookshelves specifically include the following steps:

[0133] The book taking animation effect is generated, and the target book is displayed for taking;

[0134] The virtual reading of the target book is started;

[0135] The reading of the home user is recorded, and the reading record data is obtained, the reading record data includes the residence time, the page turning times and the interaction frequency of each target book;

[0136] The reading preference analysis of the home user is performed according to the reading record data, and the interest label data is generated;

[0137] optimize book preferences of the plurality of virtual bookshelves according to the interest label data.

[0138] Specifically, in the preferred embodiment provided by the present application, the step of optimizing book preferences of the plurality of virtual bookshelves according to the interest label data specifically includes the following steps:

[0139] reading behavior recognition is performed on the plurality of home monitoring data, and reading space data is recorded;

[0140] bookshelf arrangement preferences of the plurality of virtual bookshelves are optimized according to the reading space data and the interest label data;

[0141] height data of the home user is obtained;

[0142] book arrangement preferences of the plurality of virtual bookshelves are optimized according to the height data and the interest label data.

[0143] Further, Figure 2 An application architecture diagram of the adaptive multi-threshold image segmentation system provided by the embodiment of the present application is shown.

[0144] In another preferred embodiment provided by the present application, the immersive reading interactive system of the exhibition scene includes:

[0145] The initialization virtual arrangement module 101 is used to receive a home exhibition request of a home user, obtain house type arrangement data, identify a plurality of family wall spaces, perform initialization virtual arrangement, and construct a virtual reading exhibition scene including a plurality of virtual bookshelves.

[0146] In the embodiment of the present application, the initialization virtual arrangement module 101 receives a home exhibition request of a home user and obtains house type arrangement data. By performing wall surface identification on the house type arrangement data, a plurality of family wall spaces are determined, and wall space areas corresponding to the plurality of family wall spaces are obtained. At the same time, exhibition book data and temporary reading permissions are obtained. Based on the exhibition book data, the plurality of family wall spaces are matched with books according to the plurality of wall space areas. The classification book data corresponding to the plurality of family wall spaces is obtained. Then, according to the correspondence between the plurality of classification book data and the plurality of family wall spaces, the virtual bookshelves are constructed according to the plurality of classification book data at the plurality of family wall spaces, and the plurality of virtual bookshelves form a virtual reading exhibition scene. Thus, the corresponding virtual bookshelves are generated on the identified wall surfaces, and the virtual book resources are arranged by categories.

[0147] Specifically, in the preferred embodiment provided by the present application, the initialization virtual arrangement module 101 specifically includes:

[0148] A request receiving unit is configured to receive a home exhibition request of a home user.

[0149] A house type arrangement data obtaining unit is configured to obtain house type arrangement data.

[0150] A wall surface identifying unit is configured to identify wall surfaces based on the house type arrangement data, determine a plurality of home wall spaces, and obtain corresponding wall space areas.

[0151] A book data obtaining unit is configured to obtain exhibition book data and temporary reading permissions.

[0152] A book classification matching unit is configured to perform book classification matching on the plurality of home wall spaces based on the exhibition book data and according to the plurality of wall space areas, and obtain a plurality of corresponding classification book data.

[0153] A virtual bookshelf constructing unit is configured to construct virtual bookshelves in the plurality of corresponding home wall spaces according to the plurality of classification book data, and the plurality of virtual bookshelves form a virtual reading exhibition scene.

[0154] Further, the immersive reading interaction system of the exhibition scene further comprises:

[0155] A target bookshelf determining module 102 is configured to perform real-time camera positioning on a home user, obtain a real-time user position, perform position mapping in the virtual reading exhibition scene, and determine a target bookshelf from the plurality of virtual bookshelves.

[0156] In the embodiment, the target bookshelf determining module 102 obtains a plurality of home monitoring data in real time, performs feature recognition on the plurality of home monitoring data based on preset user features, determines home monitoring data in which the home user appears, further determines the real-time user position, performs mapping processing on the real-time user position in the virtual reading exhibition scene, determines a scene user position of the home user in the virtual reading exhibition scene, calculates a position distance between the home user and the plurality of virtual bookshelves according to the scene user position, compares and filters the plurality of position distances based on a preset standard bookshelf distance, determines whether there is a position distance smaller than the standard bookshelf distance in the plurality of position distances, marks the position distance smaller than the standard bookshelf distance as a qualified distance when it is determined that there is a position distance smaller than the standard bookshelf distance, and determines a virtual bookshelf corresponding to the qualified distance from the plurality of virtual bookshelves and marks the virtual bookshelf as the target bookshelf.

[0157] A target book selecting module 103 is configured to perform signal positioning on a hand-held mobile terminal of a home user, obtain a real-time hand position, determine a plurality of books close to the target bookshelf from the target bookshelf, and perform real-time distance calculation and comparison to select a target book.

[0158] In the embodiment of the present application, the target book selection module 103 obtains the signal data of the handheld mobile terminal of the home user in real time through a plurality of fixed beacons, calculates the signal distance between the handheld mobile terminal and the plurality of fixed beacons according to a plurality of signal strengths in the signal data, and then performs signal positioning on the handheld mobile terminal according to the plurality of signal distances and the fixed positions of the plurality of fixed beacons to obtain the real-time hand position of the home user. According to the real-time hand position and the preset pickup range, a plurality of close books in the pickup range at the real-time hand position are determined from the target bookshelf, the real-time book distance between the real-time hand position and the plurality of close books is calculated, the plurality of real-time book distances are compared and filtered based on the preset standard book distance, it is judged whether the plurality of real-time book distances have a real-time book distance less than the standard book distance, and when it is judged that the real-time book distance less than the standard book distance exists, the real-time book distance is marked as a book pickup distance. Then, the close book corresponding to the book pickup distance is selected from the plurality of close books, and is marked as a target book. Specifically, the calculation formula of the plurality of signal distances is:

[0159]

[0160] Wherein, d i represents the signal distance between the handheld mobile terminal and the i th fixed beacon, R i is the signal strength of the handheld mobile terminal obtained by the i th fixed beacon, A is a preset standard signal strength, and n is a preset environmental attenuation factor.

[0161] The calculation formula of the plurality of real-time book distances is:

[0162]

[0163] Wherein, L j represents the real-time book distance between the real-time hand position and the j th close book, (x M , y M , z M ) is the spatial coordinates of the real-time hand position, and (x B,j , y B,j , z B,j ) is the spatial coordinates of the j th close book.

[0164] Specifically, in the preferred embodiment provided by the present application, the target book selection module 103 specifically includes:

[0165] A signal data acquisition unit for obtaining signal data of a handheld mobile terminal of a home user in real time through a plurality of fixed beacons;

[0166] A signal distance calculation unit for calculating the signal distance between the handheld mobile terminal and the plurality of fixed beacons according to the signal data.

[0167] A signal positioning unit is configured to perform signal positioning on the handheld mobile terminal according to the plurality of signal distances, and obtain a real-time hand position;

[0168] A book proximity determination unit is configured to determine a plurality of books in proximity to the target bookshelf according to the real-time hand position and a preset pickup range.

[0169] A book distance calculation unit is configured to calculate real-time book distances between the real-time hand position and the plurality of books in proximity.

[0170] A distance comparison and screening unit is configured to compare and screen the plurality of real-time book distances based on a preset standard book distance, and determine a book pickup distance.

[0171] A target book selection unit is configured to select a target book from the plurality of books in proximity according to the book pickup distance.

[0172] Further, the immersive reading interaction system of the exhibition scene further comprises:

[0173] A book preference optimization module 104 is configured to start virtual reading of the target book, perform reading record, obtain reading record data, perform reading preference analysis, and optimize book preferences of the plurality of virtual bookshelves.

[0174] In the embodiment of the present application, the book preference optimization module 104 generates a book picking animation effect to display the target book, and then starts virtual reading of the target book. The home user can choose to read the exhibition temporarily at any place in the home environment (for example, on the sofa, on the bed, or on the chair). The reading record data of the home user, such as the residence time, the page turning frequency, and the interaction frequency of each target book, are obtained by recording the reading of the home user. The reading preference analysis of the home user is performed according to the reading record data, the interest label data is generated, the reading behavior of the home monitoring data is recognized, the reading space data of the home user is recorded, the bookshelf arrangement preference optimization of the plurality of virtual bookshelves is performed according to the reading space data and the interest label data, and the book arrangement preference optimization of the plurality of virtual bookshelves is performed according to the height data and the interest label data of the home user.

[0175] The technical features of the above-described embodiments can be combined in any manner. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described, however, as long as the combinations of the technical features do not contradict each other, they should be considered as within the scope of the present disclosure.

Claims

1. An immersive reading interaction method of an exhibition scene, characterized in that, The method specifically comprises the following steps: Receiving a home exhibition request of a home user, obtaining house type arrangement data, identifying multiple home wall spaces, performing initial virtual arrangement, and constructing a virtual reading exhibition scene comprising multiple virtual bookshelves; Real-time camera positioning of the home user is performed to obtain a real-time user position, and position mapping is performed in the virtual reading exhibition scene to determine a target bookshelf from the multiple virtual bookshelves; Signal positioning of a hand-held mobile terminal of the home user is performed to obtain a real-time hand position, a plurality of books close to the target bookshelf are determined from the target bookshelf, and real-time distance calculation and comparison are performed to select a target book; Virtual reading of the target book is started, reading records are recorded, reading record data is obtained, reading preference analysis is performed, and book preference optimization is performed on the multiple virtual bookshelves.

2. The immersive reading interaction method of an exhibition scene according to claim 1, characterized in that, The receiving of the home exhibition request of the home user, the obtaining of the house type arrangement data, the identification of the multiple home wall spaces, the performance of the initial virtual arrangement, and the construction of the virtual reading exhibition scene comprising the multiple virtual bookshelves specifically comprise the following steps: Receiving a home exhibition request of a home user; Obtaining house type arrangement data; Wall surface identification is performed on the house type arrangement data to determine multiple home wall spaces and obtain corresponding wall space areas; Exhibition book data and temporary reading permissions are obtained; Based on the exhibition book data, book classification matching is performed on the multiple home wall spaces according to the multiple wall space areas to obtain multiple corresponding classification book data; According to the multiple classification book data, virtual bookshelves are constructed in the multiple corresponding home wall spaces, and the multiple virtual bookshelves form a virtual reading exhibition scene.

3. The immersive reading interaction method of an exhibition scene according to claim 1, characterized in that, The real-time camera positioning of the home user to obtain a real-time user position, the position mapping in the virtual reading exhibition scene, and the determination of a target bookshelf from the multiple virtual bookshelves specifically comprise the following steps: Real-time home monitoring data is obtained; Based on preset user characteristics, feature recognition of real-time camera positioning is performed on the multiple home monitoring data to obtain a real-time user position; Position mapping is performed in the virtual reading exhibition scene to obtain a scene user position; According to the scene user position, the position distances of the home user and the multiple virtual bookshelves are calculated; According to a preset standard bookshelf distance, the multiple position distances are compared and filtered to determine a qualified distance; According to the qualified distance, a corresponding target bookshelf is determined from the multiple virtual bookshelves.

4. The immersive reading interaction method of an exhibition scene according to claim 1, characterized in that, The signal positioning of the hand-held mobile terminal of the home user to obtain a real-time hand position, the determination of multiple books close to the target bookshelf from the target bookshelf, and the real-time distance calculation and comparison to select a target book specifically comprise the following steps: Signal data of the hand-held mobile terminal of the home user is obtained in real time through multiple fixed beacons; According to the signal data, signal distances between the hand-held mobile terminal and the multiple fixed beacons are calculated; According to the multiple signal distances, signal positioning of the hand-held mobile terminal is performed to obtain a real-time hand position; According to the real-time hand position and a preset picking range, multiple books close to the target bookshelf are determined from the target bookshelf; Calculate the real-time book distance between the real-time hand position and the plurality of books; Compare and filter the plurality of real-time book distances based on a preset standard book distance to determine a book picking distance; Select a target book from the plurality of books based on the book picking distance.

5. The immersive reading interaction method of an exhibition scene according to claim 4, characterized in that, The calculation formula of the plurality of signal distances is: wherein d i represents the signal distance between the handheld mobile terminal and the i-th fixed beacon, R i represents the signal strength of the handheld mobile terminal obtained by the i-th fixed beacon, A represents a preset standard signal strength, and n represents a preset environmental attenuation factor; The calculation formula of the plurality of real-time book distances is: wherein L j represents the real-time book distance between the real-time hand position and the jth close book, (x M ,y M ,z M ) is the spatial coordinate of the real-time hand position, and (x B,j ,y B,j ,z B,j ) is the spatial coordinate of the jth close book.

6. The immersive reading interaction method of an exhibition scene according to claim 3, characterized in that, The virtual reading of the target book is started, and reading records are made to obtain reading record data, and reading preference analysis is performed to optimize the book preference of the plurality of virtual bookshelves, which specifically includes the following steps: Generate a book picking animation effect to display the target book; Start the virtual reading of the target book; Make reading records of the home user to obtain reading record data, which includes the dwell time, page turning frequency and interaction frequency of each target book; According to the reading record data, the reading preference of the home user is analyzed to generate interest tag data; According to the interest tag data, the book preference of the plurality of virtual bookshelves is optimized.

7. The immersive reading interaction method of an exhibition scene according to claim 6, characterized in that, The book preference optimization of the plurality of virtual bookshelves according to the interest tag data specifically includes the following steps: Make reading behavior recognition of the plurality of home monitoring data to record reading space data; According to the reading space data and the interest tag data, the preference optimization of the bookshelf arrangement of the plurality of virtual bookshelves is performed; Obtain the height data of the home user; According to the height data and the interest tag data, the preference optimization of the book arrangement of the plurality of virtual bookshelves is performed.

8. Immersive reading interaction system for an exhibition scene, characterized in that, The system specifically includes an initialization virtual arrangement module, a target bookshelf determination module, a target book selection module and a book preference optimization module, wherein: The initialization virtual arrangement module is used to receive the home exhibition request of the home user, obtain the house layout data, identify a plurality of family wall spaces, perform initialization virtual arrangement, and construct a virtual reading exhibition scene including a plurality of virtual bookshelves; The target bookshelf determination module is used to position the home user in real time, obtain the real-time user position, map the position in the virtual reading exhibition scene, and determine the target bookshelf from the plurality of virtual bookshelves; The target book selection module is used to position the hand-held mobile terminal of the home user, obtain the real-time hand position, determine a plurality of books from the target bookshelf, and perform real-time distance calculation and comparison to select the target book; The book preference optimization module is used to start the virtual reading of the target book, make reading records, obtain reading record data, perform reading preference analysis, and optimize the book preference of the plurality of virtual bookshelves.

9. The immersive reading interactive system of an exhibition scene according to claim 8, characterized in that, The initialization virtual arrangement module specifically includes: The request receiving unit is used to receive the home exhibition request of the home user; The house layout data obtaining unit is used to obtain the house layout data; The wall surface identification unit is used to identify the wall surface of the house layout data, determine a plurality of family wall spaces, and obtain the corresponding wall space area; The book data obtaining unit is used to obtain exhibition book data and temporary reading permission; The book classification matching unit is configured to perform book classification matching on the plurality of home wall spaces according to the plurality of wall space areas based on the exhibition book data, and obtain a plurality of corresponding classified book data. The virtual bookshelf construction unit is configured to construct virtual bookshelves in the corresponding home wall spaces according to the classified book data, and the virtual bookshelves constitute a virtual reading exhibition scene.

10. The immersive reading interactive system of an exhibition scene according to claim 8, characterized in that, The target book selection module specifically comprises: The signal data acquisition unit is configured to acquire signal data of a handheld mobile terminal of a home user in real time through a plurality of fixed beacons. The signal distance calculation unit is configured to calculate signal distances between the handheld mobile terminal and the plurality of fixed beacons according to the signal data. The signal positioning unit is configured to perform signal positioning on the handheld mobile terminal according to the plurality of signal distances, and obtain a real-time hand position. The close book determination unit is configured to determine a plurality of close books from the target bookshelf according to the real-time hand position and a preset picking range. The book distance calculation unit is configured to calculate real-time book distances between the real-time hand position and the plurality of close books. The distance comparison and screening unit is configured to compare and screen the plurality of real-time book distances based on a preset standard book distance, and determine a book picking distance. The target book selection unit is configured to select a target book from the plurality of close books according to the book picking distance.

Images