A display system, a display device, and a display control method

Abstract

The present invention discloses a display system, a display device and a display control method. The display system includes: a server and a display device; wherein: the server is configured to receive user data input by a target user to a user terminal; determine the user type to which the target user belongs in at least one display type according to the user data; and feedback a display instruction matching the user type to the user terminal; the display device is configured to obtain the display instruction in the user terminal after detecting the user terminal; and determine the display content of the object to be displayed corresponding to the user type according to the display instruction, and display the display content to the target user.

Description

Technical Field

[0001] The present invention relates to the field of display technologies, and in particular, to a display system, a display device, and a display control method. Background Art

[0002] With the development of network technologies and Internet of Things technologies, in application scenarios such as teaching, exhibitions, science popularization, and scenic spots, when users receive relevant content introductions or science popularization displays, they increasingly focus on personalized and immersive experiences. However, currently in science and technology museums and museums, when presenting relevant content to visiting audiences, it is only through simple video playback or centralized explanations by tour guides. However, the types of audiences are different, and their understanding abilities of things also vary. Therefore, the existing display methods are not conducive to the dissemination of display content and providing users with immersive experiences.

[0003] It can be seen that the current content display methods are too single, not conducive to the understanding and dissemination of display content, and unable to provide users with immersive experiences. Summary of the Invention

[0004] In view of the above problems, the present invention provides a display system, a display device, and a display control method, which can match display content that suits the characteristics of users for users, enhance the immersive experience of users, and be more conducive to users' understanding of the objects to be displayed.

[0005] In a first aspect, the present application provides the following technical solution through an embodiment:

[0006] A display system, comprising: a server and a display device; wherein:

[0007] The server is configured to receive user data input by a target user to a user terminal; determine the user type to which the target user belongs in at least one display type according to the user data; and feedback a display instruction matching the user type to the user terminal; the display device is configured to, after detecting the user terminal, obtain the display instruction in the user terminal; and determine the display content of the object to be displayed corresponding to the user type according to the display instruction, and display the display content to the target user.

[0008] Optionally, the server includes an application server and a database server; the database server stores: at least one display type and display instructions corresponding to user types under each display type;

[0009] The application server is configured to determine the user type to which the target user belongs in each display type according to the user data; and determine the corresponding display instruction from the database server according to the user type.

[0010] Optionally, the server is further specifically configured to:

[0011] According to the user data and the classification model corresponding to each display type, the user type to which the target user belongs in each display type is determined; wherein, for each of the display types, the classification model is obtained by training an original model corresponding to the display type based on the historical user data received by the server.

[0012] Optionally, the server is further specifically used for:

[0013] Every time the amount of received user data increases by a first preset amount, the following update step is performed on each of the classification models: the original model is trained based on the historical user data and the added user data to obtain a corresponding first updated model; wherein the first updated model is used as the updated classification model.

[0014] Optionally, the server is further specifically used for:

[0015] Receive the rating data fed back by the user terminal; the rating data represents the user's satisfaction with the content displayed by the display device; when the amount of received rating data increases by a second preset amount, perform the following update steps on each of the classification models: train the original model according to the historical user data and the rating data to obtain a corresponding second updated model; wherein the second updated model is used as the updated classification model.

[0016] Optionally, each of the display instructions is matched with a corresponding user type; and the server is further specifically configured to:

[0017] Receive the rating data fed back by the user terminal; the rating data represents the user's satisfaction with the content displayed by the display device; for any display instruction, if the negative rating data is greater than a preset quantity threshold, cancel the matching between the display instruction and the corresponding user type; wherein the negative rating data is the rating data with a score less than a preset rating threshold.

[0018] Optionally, the display device includes any one or more of the following display units: a visual display unit, an auditory display unit, an olfactory display unit, and a tactile display unit; the display instruction includes any one or more of the following: a visual display instruction, an auditory display instruction, an olfactory display instruction, and a tactile display instruction;

[0019] The visual display unit is used to play the picture display content corresponding to the visual display instruction; the auditory display unit is used to play the sound display content corresponding to the auditory display instruction; the olfactory display unit is used to generate the smell display content corresponding to the olfactory display instruction; the tactile display unit is used to provide the interactive display content corresponding to the tactile display instruction.

[0020] Optionally, the display device includes an identification unit and a control unit.

[0021] The identification unit is configured to determine that the user terminal is detected when the terminal identifier of the user terminal is identified and / or the user identifier of the target user is identified; obtain a display instruction in the user terminal, and send the display instruction to the control unit; the control unit is configured to determine the display content of the object to be displayed corresponding to the user type according to the display instruction, and control the display device to display the display content to the target user.

[0022] Optionally, the user data includes demographic data and interest data; the interest data represents the display content that the user is interested in.

[0023] In a second aspect, based on the same inventive concept, the present application provides the following technical solution through an embodiment:

[0024] A display device includes an identification unit and a control unit; wherein:

[0025] The identification unit is configured to determine that the user terminal is detected when the terminal identifier of the user terminal is identified and / or the user identifier of the target user is identified; and obtain a display instruction from the user terminal after detecting the user terminal; send the display instruction to the control unit; wherein, the obtaining method of the display instruction is: receiving user data input by the target user; determining the user type to which the target user belongs in at least one display type according to the user data; obtaining a display instruction matching the user type; the control unit is configured to determine the display content of the object to be displayed corresponding to the user type according to the display instruction, and display the display content to the target user.

[0026] Optionally, it further includes any one or more of the following display units: a visual display unit, an auditory display unit, an olfactory display unit, and a tactile display unit; the display instruction includes any one or more of the following: a visual display instruction, an auditory display instruction, an olfactory display instruction, and a tactile display instruction;

[0027] The visual display unit is configured to play the picture display content corresponding to the visual display instruction; the auditory display unit is configured to play the sound display content corresponding to the auditory display instruction; the olfactory display unit is configured to generate the odor display content corresponding to the olfactory display instruction; the tactile display unit is configured to provide the interactive display content corresponding to the tactile display instruction.

[0028] In a third aspect, based on the same inventive concept, the present application provides the following technical solution through an embodiment:

[0029] A display control method includes:

[0030] Receiving user data input by a target user to a user terminal; determining, according to the user data, the user type to which the target user belongs in each display type; and feeding back a display instruction matching the user type to the user terminal, so that after detecting the user terminal, a preset display device obtains the display instruction in the user terminal and displays content to the target user according to the display instruction; there is more than one display type, and the display instruction is used to control the display device to display content.

[0031] In a fourth aspect, based on the same inventive concept, the present application provides the following technical solution through an embodiment:

[0032] A readable storage medium stores a computer program thereon, and when the program is executed by a processor, the steps of the method described in the foregoing third aspect are implemented.

[0033] A display system, a display device and a display control method provided by an embodiment of the present invention, wherein the display system includes: a server and a display device; and the server receives user data input by a target user to a user terminal; determines the user type to which the target user belongs in at least one display type according to the user data; and feeds back a display instruction matching the user type to the user terminal. After detecting the user terminal, the display device obtains the display instruction in the user terminal; and determines the display content of the object to be displayed corresponding to the user type according to the display instruction, and displays the display content to the target user. During the process of the display device displaying the display content, only the corresponding display instruction needs to be obtained, and the display instruction is determined by the user data of the target user, which can well fit the characteristics of the target user; at the same time, the display instruction can be a display instruction corresponding to multiple display types to achieve multimodal display; when displaying the display content to the target user, a better immersive experience can be given to the target user; for the same exhibit, when displaying to different users, different display contents can be used for display based on different user types, which is more conducive to the explanation of the exhibit and makes it easier for the target user to understand the exhibit.

[0034] The above description is only an overview of the technical solution of the present invention. In order to be able to understand the technical means of the present invention more clearly, it can be implemented according to the content of the specification. And in order to make the above and other purposes, features and advantages of the present invention more obvious and understandable, the specific embodiments of the present invention are hereinafter specifically exemplified. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] To more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the drawings in the following description are some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings. In the drawings:

[0036] Figure 1 Shows a schematic structural diagram of a display system provided by an embodiment of the present invention;

[0037] Figure 2 Shows a schematic structural diagram of another display system provided by an embodiment of the present invention;

[0038] Figure 3 Shows a schematic structural relationship diagram of display types, display instructions, and user types in an embodiment of the present invention;

[0039] Figure 4 Shows a schematic diagram of a recommendation engine architecture in an embodiment of the present invention;

[0040] Figure 5 Shows a schematic structural diagram of an olfactory module in an embodiment of the present invention;

[0041] Figure 6 Shows a schematic overall structural diagram after the olfactory module is connected to a mobile phone in an embodiment of the present invention;

[0042] Figures 7 - 9 Shows schematic diagrams of three different interactive interfaces in a visual display unit in an embodiment of the present invention;

[0043] Figure 10 Shows a schematic structural diagram of a display device in an embodiment of the present invention;

[0044] Figure 11 Shows a flowchart of a display control method in an embodiment of the present invention. Detailed implementation manners

[0045] The following will describe the exemplary embodiments of the present disclosure in more detail with reference to the drawings. Although the exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided so that the present disclosure can be more thoroughly understood and the scope of the present disclosure can be fully conveyed to those skilled in the art.

[0046] A display system provided in an embodiment of the present invention can provide personalized display content for users when displaying to users, so as to adapt to different user groups, enhance the immersive experience of users, and is conducive to the understanding and dissemination of content. In particular, for the same object to be displayed, different display contents and display types can be respectively adopted to display to users based on different user types, which well adapts to the characteristics of users and improves the display effect and the immersive experience of users. The display system of the present invention will be described in detail below through specific examples.

[0047] Please refer to Figure 1 and Figure 2 As shown, in an embodiment of the present invention, a display system 100 is provided. The display system 100 includes: a server 10 and a display device 20. The server 10 and the display device 20 can be communicatively connected or not, without limitation.

[0048] The server 10 is configured to receive user data input by a target user to a user terminal 30; determine the user type to which the target user belongs in at least one display type according to the user data; and feedback a display instruction matching the user type to the user terminal 30. The server is a cloud server.

[0049] It can be understood that the target user can be any one in the user group. The user terminal 30 can be carried by the target user. For example, the user terminal 30 can be a mobile phone, a tablet computer, a laptop computer, a smart watch, a smart earphone, etc., but not limited thereto; for example, it can also be other types of handheld terminals. The user terminal 30 can have a unique terminal identifier. The display device 20 identifies the user terminal 30 by recognizing the terminal identifier, so as to determine the target user. In addition, corresponding client software can be installed on the user terminal 30, and an account belonging to the target user can be created through account registration, and a unique user identifier can be assigned to the target user; the display device 20 can also identify the target user by recognizing the user identifier.

[0050] In addition, the user identifier and the terminal identifier can be bound. When the display device 20 recognizes both the terminal identifier and the user identifier at the same time, it is determined that the target user is recognized. By this method, the security of the display content can be guaranteed, which is conducive to applications in some scenarios with high confidentiality requirements, such as internal technical secret sharing displays, confidential meeting displays, and so on.

[0051] The user terminal 30 can communicate with the server 10, and the communication method can be a wireless network, such as 2G network, 3G network, 4G network, 5G network, WIFI network, etc.

[0052] User data may include the user's demographic data and interest data. For example, demographic data includes date of birth, name, age, native place, occupation, city of residence, educational background, etc.; interest data includes: sports preferences, dietary preferences, movie-watching preferences, news preferences, etc. Interest data can characterize the display content that the user is interested in. In addition, it may also include information such as the user's physical defects, such as whether there are visual impairments, hearing impairments, olfactory impairments, etc.

[0053] In some implementation manners, a preset questionnaire may be pushed to the user terminal 30, and the user's demographic data and interest data are collected through the user's filling or collection. After the collection is completed, the user terminal 30 sends the questionnaire filled by the user or the user data in the questionnaire to the server 10, and the server 10 may store these user data or classify the user based on the user data.

[0054] Furthermore, the server 10 may include an application server 12 and a database server 11.

[0055] The application server 12 can be used to classify the user data of the target user to obtain the user type of the target user; at the same time, it can also store the user data of the target user in the database server 11.

[0056] Stored in the database server 11 are: at least one display type and the display instructions corresponding to the user type under each display type. The display type is the type of content used to display to the user. For example, the display type may include: visual content, auditory content, tactile content, and olfactory content. Specifically, visual content, such as pictures, videos, etc.; auditory content, such as music, background narration, animal calls, etc.; tactile content, such as interactive content that can be clicked, tactile content that gives the user a vibration experience, a temperature change experience, a blowing experience, etc.; olfactory content, such as various odors or fragrances.

[0057] Under each display type, there are multiple display instructions. Each display instruction can be used to display its corresponding display content; at the same time, each display instruction also corresponds to a user type. The display instruction can be used to determine the corresponding display content and control the display device 20 to display the display content; for example, the display instruction can be a code that the display device 20 can recognize. By classifying the target user and simultaneously finding the display instructions corresponding to the user type of the target user under each display type, the best match is achieved. Ensure that the content finally displayed to the target user is all content that the target user is interested in, which is beneficial to the immersive experience of the target user. In addition, the content fed back by the server 10 to the user terminal 30 in this implementation is the display instruction, which can avoid the transmission of a large amount of data and improve the response speed.

[0058] Further, the display type, display instruction, and user type can be stored according to the following storage structure: display type - display instruction - user type; for example, visual content - display instruction A1 - user type A1; visual content - display instruction A2 - user type A2; visual content - display instruction A3 - user type A3; auditory content - display instruction B1 - user type B1; and so on, as Figure 3 shown. By adopting this storage structure, it is convenient to adjust the display instructions adapted to the user type. For example, according to the change of social habits or cultural atmosphere, different user types can be reclassified subsequently, so as to rematch the corresponding user types for different display instructions; conversely, that is to rematch the corresponding display instructions for the newly classified user types.

[0059] The application server 12 is also specifically configured to: after retrieving the user data of the target user, input it into a preset classification model to classify the target user, and the user type to which the user belongs in each display type can be obtained; then, according to the user type, determine the corresponding display instruction from the database server 11, and feedback the display instruction to the corresponding user terminal 30. The application server 12 can directly receive the user data of the target user, or retrieve the user data of the target user from the database server 11.

[0060] The application server 12 can also be used to perform model training using all the user data stored in the database server 11 to obtain a classification model for user type classification. The historical user data is data for all users, and these historical user data can be stored in the database server 11.

[0061] In some implementation manners, each display type can correspond to the same classification model, that is, when classifying the target user, only one classification is required.

[0062] However, in some other implementation manners, each display type can correspond to an independently used classification model. Thus, the classification models for different display types can be trained separately, which can better fit the display methods that users are interested in. That is to say, the server 10 is also specifically configured to: according to the user data and the classification model corresponding to each display type, determine the user type to which the target user belongs in each display type; wherein, for each display type, the classification model is obtained by training the original model corresponding to this display type based on the historical user data received by the server 10.

[0063] In this embodiment, the classification model that can be adopted can include classification models of machine learning, such as: logistic regression, support vector machine, etc. Thus, a classification model can be obtained with relatively low computing resources and costs. In addition, without considering computing resources, relevant models of neural network and deep learning can also be adopted.

[0064] In some implementation manners, when training the original model, the data of each user in the historical user data can be preliminarily processed in a targeted manner. For example, the corresponding effective feature data can be selected for different display types, and redundant feature data can be removed. Specifically, a feature selection algorithm based on correlation, a minimum redundancy maximum correlation algorithm, etc. can be used, without limitation. For example, in the process of removing redundant feature data, the name in the historical user data can be removed. In addition, for the original models of different display types, the feature data irrelevant to the display type can also be removed in a targeted manner; for example, when training the display model corresponding to visual content, the data related to olfactory disorders and hearing disorders in the historical user data can be removed to improve the training efficiency and accuracy of the classification model.

[0065] It should be noted that when using the classification model to classify the target user, feature extraction and redundant feature removal can also be performed on the user data of the target user, which will not be elaborated here.

[0066] Furthermore, for the classification models of the same display type, multiple original models can be used for training to determine the finally used classification model. For example, when obtaining the classification model corresponding to visual content, a logistic regression model and a support vector machine prediction model can be used for training simultaneously; after the training is completed, the first candidate model corresponding to the logistic regression model and the second candidate model corresponding to the support vector machine prediction model are obtained. Finally, the candidate model with the best effect can be determined from these two types of candidate models as the classification model corresponding to the visual content. One way to determine the model with the best effect from the candidate models is as follows:

[0067] First, obtain one or more test data. The test data is the user data for testing and has the same structure as the user data input by the target user or the historical user data. Then obtain the calibration results of the administrator user for these test data to determine the calibration type; the calibration type belongs to the user types corresponding to the first candidate model and the second candidate model. Next, input the test data into the first candidate model for classification respectively to obtain the first classification results; input the test data into the second candidate model for classification to obtain the second classification results. Finally, for the first candidate model, count the first quantity or the first proportion that the first classification result corresponding to each test data is the same as the corresponding calibration type; for the second candidate model, count the second quantity or the second proportion that the first classification result corresponding to each test data is the same as the corresponding calibration type. If the first quantity is greater than the second quantity, or the first proportion is greater than the second proportion, then the first candidate model is determined as the finally used classification model; otherwise, the second candidate model is determined as the finally used classification model. Determining the classification model through the above method has the characteristics of simplicity and reliability, and only requires less computing resources.

[0068] In addition, in some ways, the convergence effect of the candidate model can be judged through a loss function, and the candidate model with good convergence effect is determined as the classification model.

[0069] The display device 20 is used to obtain the display instruction in the user terminal 30 after detecting the user terminal 30; and determine the display content of the object to be displayed corresponding to the user type according to the display instruction, and display the display content to the target user.

[0070] In some implementation manners, the display device 20 may be a display device 20 for displaying a single display content, or may be a display device 20 for displaying multiple display contents. The display device 20 may include any one or more of the following display units: a visual display unit 24, an auditory display unit 25, an olfactory display unit 26, and a tactile display unit 27, etc. The display device 20 may be correspondingly bound to an object to be displayed, and the object to be displayed may be a cultural relic, a commodity, a cultural concept, an era history, etc.; for example, the object to be displayed may be a famous painting, an antique, a technical concept, a new product, a historical culture, etc. The display instruction includes any one or more of the following: a visual display instruction, an auditory display instruction, an olfactory display instruction, and a tactile display instruction.

[0071] Specifically, the visual display unit 24 is used to play the picture display content corresponding to the visual display instruction; for example, the visual display unit 24 may be a large screen, a projector, a head-mounted display device, etc. The auditory display unit 25 is used to play the sound display content corresponding to the auditory display instruction; for example, the auditory display unit 25 may be a sound device such as a speaker or a headphone. The olfactory display unit 26 is used to generate the odor display content corresponding to the olfactory display instruction; for example, the olfactory display unit 26 may be an electronic fragrance spray, a head-mounted olfactory device and other odor-emitting devices. The tactile display unit 27 is used to provide the interactive display content corresponding to the tactile display instruction; for example, the tactile display unit 27 may be a handle, a glove, a touch screen, etc. A control unit 22 for processing the display instruction and an identification unit 21 for identifying the terminal device may be provided in each display unit, so that in some application scenarios, the content can be displayed to the target user only through some display forms.

[0072] Furthermore, in some implementation manners, a control unit 22 for uniformly controlling each display unit and an identification unit 21 for identifying the terminal device may also be provided. Since the target user has been classified at the server 10 end, it is ensured that the display instructions sent to the user terminal 30 are all of interest to the target user. Therefore, when the control unit 22 receives the display instruction, it can be executed without additional calculation processing. In this way, when displaying the corresponding display content to the target user, it can be completely synchronized to achieve a better immersive effect.

[0073] For example, when the target user is at a red tourism scenic spot and the object to be displayed is a person's deeds, the server 10 classifies and obtains that the user type represents the target user as an adult, with hobbies in military and history. At this time, after the display device 20 obtains the display instruction corresponding to the target user, it can retrieve the corresponding visual content, auditory content, olfactory content, and tactile content; for example, play the front-line combat or command pictures of the person on a large display screen or a projection device, play the sound of an attack bugle on a surround sound device, heat a preset fragrance device to make the fragrance device emit a smell similar to gunpowder, and turn on a hot air fan to make the target user feel the environmental conditions at the front line. After the display device 20 obtains the display instruction corresponding to the target user, it can control multiple display units to simultaneously display multi-modal display content for the target user, giving the user an immersive experience.

[0074] If the server 10 classifies and obtains that the user type represents the target user as a middle school student, with hobbies in learning and thinking. At this time, after the display device 20 obtains the display instruction corresponding to the target user, it can retrieve the corresponding visual content, auditory content, olfactory content, and tactile content; for example, play the person's academic deeds and school pictures in middle school and university on a large display screen or a projection device, explain the hardships, setbacks, and successes of the person's academic path on a surround sound device, etc.; heat a preset fragrance device to make the fragrance device emit the smell of printed paper, and turn on a fan to gently blow the target user. After the display device 20 obtains the display instruction corresponding to the target user, it can control multiple display units to simultaneously display multi-modal display content for the target user, giving the user an immersive experience.

[0075] For the same display object, different user types can obtain different display contents, realizing targeted personalized display, making the object to be displayed more easily accepted and understood by users, and improving the publicity effect and the user's immersive experience.

[0076] In addition, the display content displayed by the display device 20 can be stored in the local hard disk; when the control unit 22 receives the display instruction, it can call the corresponding display content from the storage device for playback or execution based on the display instruction, achieving a quick response.

[0077] Specifically, the recognition unit 21 is configured to determine that the user terminal 30 corresponding to the target user is detected when the terminal identifier of the user terminal 30 is recognized and / or the user identifier of the target user is recognized. Further, it can also determine that the user terminal 30 corresponding to the target user is detected when the terminal identifier of the user terminal 30 is recognized and / or the user identifier of the target user is recognized and the distance is less than a preset distance (or the signal strength is greater than a preset strength). Then, the recognition unit 21 obtains the display instruction in the user terminal 30 and sends the display instruction to the control unit 22. The recognition unit 21 can be a radio frequency module, a Bluetooth module, a wifi module, etc. In some implementation manners, the radio frequency module can be used to implement the recognition and communication between the recognition unit 21 and the user terminal 30. The short-range wireless communication of the radio frequency module can be used to achieve fast recognition and communication in the display scenario of this solution, and the cost is low. The control unit 22 is configured to determine the display content of the object to be displayed corresponding to the user type according to the display instruction, and control the display device 20 to display the display content to the target user.

[0078] Generally, in a real display scenario, users continuously use the display device 20. Therefore, the server 10 will accumulate a large amount of user data. As the data accumulates, the server 10 can also update the currently used classification model through the newly added user data and the original historical user data to ensure the accuracy of the personalized recommendation of the entire display system 100 to the target user. That is, the server 10 is also specifically configured to: when the amount of received user data increases by a first preset amount each time, perform the following update steps on each classification model:

[0079] Train the original model according to the historical user data and the added user data to obtain a corresponding first updated model; where the first updated model is used as the updated classification model. When determining the first preset amount, it can be determined according to the size of the user traffic. For example, in the case of large user traffic, the first preset amount can be set to a larger value, and vice versa to a smaller value, to reduce the load pressure on the server 10 during large passenger flows.

[0080] In some embodiments, the server 10 is further specifically configured to: receive the scoring data fed back by the user terminal 30. The scoring data may be the score given by the user to the displayed content after experiencing the displayed content. For example, if the score range is 1-10, the user can fill in a value between 1-10 for scoring. In implementation, after the display device 20 finishes displaying, the display device 20 sends a prompt message indicating the end of display to the user terminal 30, so as to generate an evaluation questionnaire on the user terminal 30. Thus, the server 10 can receive the completed evaluation questionnaire or the scoring data in the evaluation questionnaire filled in by the target user. Additionally, it can also be implemented as follows: after the display device 20 finishes displaying, the display device 20 or the server 10 pushes an evaluation page to the user terminal 30 through means such as a web page, a mini program, a client, etc., to prompt the target user to fill in evaluation information, so as to collect the scoring data of the target user.

[0081] The scoring data represents the satisfaction degree of the user with the content displayed by the display device 20. For example, when the scoring data is lower than 6 points, it can be considered as negative scoring data, and when the scoring data is higher than 6 points, it can be considered as positive scoring data; when the amount of received scoring data increases by a second preset quantity each time, the following update steps are performed on each classification model: training the original model according to the historical user data and the scoring data to obtain a corresponding second updated model; where the second updated model serves as the updated classification model. Similarly, when determining the second preset quantity, it can be determined according to the size of the user traffic. For example, in the case of a large user traffic, the second preset quantity can be set to a larger value, and vice versa to a smaller value, so as to reduce the load pressure on the server 10 during peak passenger flow. Through the scoring data fed back by the user, the accuracy of model training can be further improved.

[0082] It should be noted that during the process of the server 10 updating the classification model, for each display type, multiple original models can also be used for training to obtain multiple candidate models; the model with the best effect is determined from the candidate models as the updated model, and the specific implementation process has been described in the foregoing examples and will not be elaborated here.

[0083] In some implementations, since each display instruction is matched with a corresponding user type, the server 10 is further specifically configured to: receive the rating data fed back by the user terminal 30; the rating data represents the satisfaction degree of the user with the content displayed by the display device 20; for any display instruction, if the score of the rating data is less than a preset rating threshold, the matching between the display instruction and the corresponding user type is released. For example, the rating threshold is 6 points. When the score of the rating data is less than 6 points, it can be determined as negative rating data. The rating threshold can also be set to other values, such as 7, 8, etc. Based on different total scores, adaptive adjustment can be made. When the number of negative rating data statistically obtained is greater than the quantity threshold, it indicates that the current displayed content does not match the target users, that is, there is an error in the matching relationship between the currently executed display instruction and the user type. Therefore, the matching between the display instruction and the user type can be released. This can avoid the server 10 from repeatedly feeding back inappropriate display instructions to the display device 20 before the model is updated, and improve the subsequent user experience. In addition, the server 10 can also be used to update the current classification model for any display type if the number of negative rating data in the rating data is greater than a preset quantity threshold. The update process can refer to the process of obtaining the second updated model, so as to avoid the currently used classification model from affecting the subsequent user experience.

[0084] Please refer to Figure 4, in some implementation manners of this embodiment, in order to implement the functions of the server 10, a recommendation engine is also designed as the architecture of the server 10. Specifically, the functional modules included in the recommendation engine are as follows: a database module 101, a classifier module 102, a recommendation module 103, and a training module 104. The database module 101 includes a user information database unit for storing user data and a display type and content preference database unit for storing user feedback rating data. In addition, the database module 101 can also perform feature extraction, redundant information removal, and effective feature selection on the user data and rating data in the user information database unit and the display type and content preference database unit for use by the training module 104 to implement the training of the original model and determine the optimal classification model from the candidate models obtained by training. At the same time, since the rating data is generally user-directed evaluation and has fewer redundant features, in order to avoid removing useful information, the training module 104 can directly use the rating data in the display type and content preference database unit. The classifier module 102 is used to classify based on the user data and the best-performing classification model selected, so as to determine the user type under each display type and the display instruction corresponding to the user type. The recommendation module 103 is used to recommend the display instruction to the user terminal 30 corresponding to the target user, so as to perform display when the display device 20 detects the user terminal 30. At the same time, the recommendation module 103 can also receive and push a corresponding evaluation page to the user terminal 30 corresponding to the target user, so as to receive the rating data feedback by the user, and the rating data can be stored in the display type and content preference database unit.

[0085] Through the above architecture, the server 10 of this embodiment can realize the cyclic processing of user data and ensure the accurate and reliable self-update of the classification model. Furthermore, the display content recommended to the target user based on the display instruction is more in line with the interest characteristics of the target user, which is conducive to the dissemination and understanding of the display content and better provides the user with an immersive experience.

[0086] The working principle of the display system 100 of the present invention will be described below through a specific application scenario:

[0087] The user terminal 30 can be a smart phone externally connected to the olfactory module 26a, such as Figure 5 and Figure 6 shown. Therefore, multi-modal display types such as visual content, auditory content, olfactory content, and tactile content can all be completed by the smart phone and the externally connected olfactory module 26a. Specifically, the mobile phone has a speaker, a vibration motor, and a display screen. Therefore, in addition to serving as the user terminal 30, the mobile phone can also serve as the visual display unit 24, the auditory display unit 25, and the tactile display unit 27, while the olfactory module 26a serves as the olfactory display unit 26; at the same time, the mobile phone processor can integrate the functions of the control unit 22, and the recognition unit 21 can be set in the exhibit.

[0088] Please refer to Figure 5 , the solution implementation of the olfactory module 26a may include: a housing 261, a solid fragrance 264, a heating plate 265, a driving circuit 266, and an OTG (On-The-Go) connector 267. The heating plate 265 can be implemented using ITO (indium tin oxide) for heating. The smell of the solid fragrance 264 is emitted from the olfactory module 26a through the air duct 262 and the orifice 263. The overall shape of the olfactory module 26a can be made in the form of a mobile phone housing, which can be sleeved outside the mobile phone and inserted into the mobile phone interface through the OTG connector 267, such as Figure 6 shown. When the mobile phone receives the display instruction fed back by the server 10, the mobile phone can determine the corresponding display content based on the display instruction and display the display content; among them, the smell display content can control the driving circuit 266 of the olfactory module 26a through the OTG connector 267, and the driving circuit 266 controls the heating plate 265 of a specific solid fragrance 264 area to heat, so as to help the fragrance of the solid fragrance 264 diffuse, and the user can smell a specific smell, thus completing the olfactory display part.

[0089] When the target user interacts with the display system 100 in the museum, first, the target user creates an account on the mobile phone. When creating the account, personal information needs to be entered and a questionnaire needs to be filled out, so as to generate user data. After the user data is obtained by the server 10, the target user is classified based on the user data. When the target user holds the user terminal 30 and enters the exhibition scene and approaches the exhibit when visiting the target exhibit, after the recognition unit 21 in the exhibit detects that the mobile phone is approaching, it can trigger the control unit 22 in the mobile phone to obtain the display instruction, and make the mobile phone and the olfactory module 26a present the display content to the user based on the display instruction. After the display of the display content is completed, an evaluation page can be generated on the mobile phone (or the server 10 pushes the evaluation page) for the target user to evaluate the feelings after the display is completed, and score data is generated.

[0090] Furthermore, a corresponding interactive interface can be displayed on the screen of the mobile phone in a timely manner to form haptic display content. For example, still taking the mobile phone as the user terminal 30 and connecting it to the olfactory module 26a as an example, since all displays are completely realized through the user's handheld terminal, considering that in the exhibition scenario, most of the target users are exposed to the terminal for the first time, and there may be child and elderly users. To minimize the learning cost to the greatest extent, the interactive interface can be displayed on the mobile phone screen. When designing the interactive interface, the operation buttons can be minimized as much as possible; the visibility of the buttons can be increased, for example, by using larger button designs and eye-catching colors; the interface content can be simplified as much as possible. For example, the areas set in the interactive interface can include: a visual content display area, a display start button, a return button, and a map display area. The combination of these designs and display automation helps to minimize the user's learning cost and enhance the user's experience during the visit.

[0091] After the target user approaches the exhibit with the mobile phone in hand, the recognition unit 21 set in the exhibit recognizes the target user, and the mobile phone vibrates slightly to indicate that the display is about to start. Then the display will begin, and the display content includes voice explanations, fragrance release, video footage, etc. If the current display includes interactions, then there will be an operation demonstration combining vision and voice. After the target user clicks the display start button, the target user can interact through the mobile phone. Additionally, the user can also choose to skip the interaction button to skip the interaction session, as Figure 7 shown. After all the display content has been shown, there will be a voice prompt indicating the end of the display of this exhibit, achieving an immersive display of the exhibit.

[0092] During the display process, the exhibit can be presented in the visual content display area of the mobile phone screen, as Figure 8 shown. The mobile phone speaker can play the background introduction of the exhibit, and when introducing the special features of the exhibit, it can control the olfactory module 26a to release fragrance or control the mobile phone vibrator to vibrate. The map display area is set below the visual content display area. After clicking on the map display area, the map can be enlarged to cover the entire mobile phone screen, enabling the target user to conveniently check the locations of other exhibits or service facilities near the venue. Clicking the return button can return to the previous interface, as Figure 9 shown. The end button can be continuously displayed in the lower right corner of the interface. Clicking the end button can directly end the display of this exhibit.

[0093] In summary, a display system in an embodiment of the present invention includes: a server and a display device; the server receives user data input by a target user to a user terminal; according to the user data, determines the user type to which the target user belongs in at least one display type; and feeds back a display instruction matching the user type to the user terminal. The display device, after detecting the user terminal, obtains the display instruction in the user terminal; and determines the display content of the object to be displayed corresponding to the user type according to the display instruction, and displays the display content to the target user. During the process of the display device displaying the display content, only the corresponding display instruction needs to be obtained, and the display instruction is determined by the user data of the target user, which can well match the characteristics of the target user; at the same time, the display instruction can be a display instruction corresponding to multiple display types, realizing multimodal display; when displaying the display content to the target user, a better immersive experience can be given to the target user; for the same exhibit, when displaying to different users, different display contents can also be used for display based on the different user types, which is more conducive to the explanation of the exhibit and makes it easier for the target user to understand the exhibit..

[0094] Please refer to Figure 10 , based on the same inventive concept, an embodiment of the present invention further provides a display device, which includes an identification unit 210 and a control unit 220; wherein: the identification unit 210 is configured to detect a user terminal, and after detecting the user terminal, obtain the display instruction in the user terminal; and send the display instruction to the control unit 220; the way to obtain the display instruction is: receive user data input by a target user; according to the user data, determine the user type to which the target user belongs in at least one display type; obtain a display instruction matching the user type; the control unit 220 is configured to determine the display content of the object to be displayed corresponding to the user type according to the display instruction, and display the display content to the target user.

[0095] As an optional implementation manner, the display device further includes any one or more of the following display units: a visual display unit 240, an auditory display unit 250, an olfactory display unit 260, and a tactile display unit 270; the display instruction includes any one or more of the following: a visual display instruction, an auditory display instruction, an olfactory display instruction, and a tactile display instruction; the visual display unit 240 is configured to play the picture display content corresponding to the visual display instruction; the auditory display unit 250 is configured to play the sound display content corresponding to the auditory display instruction; the olfactory display unit 260 is configured to generate the odor display content corresponding to the olfactory display instruction; the tactile display unit 270 is configured to provide the interactive display content corresponding to the tactile display instruction.

[0096] As an alternative implementation, the recognition unit 210 is further configured to determine that the user terminal is detected when the terminal identifier of the user terminal is recognized and / or the user identifier of the target user is recognized; obtain a display instruction in the user terminal, and send the display instruction to the control unit 220.

[0097] It should be noted that the display device 200 provided in the embodiments of the present invention has the same specific implementation and the resulting technical effects as the display device in the foregoing display system. For the sake of brief description, for the parts not mentioned in this embodiment, reference may be made to the corresponding content in the foregoing display system embodiment.

[0098] Please refer to Figure 11 , based on the same inventive concept, in another embodiment of the present invention, a display control method is further provided. The method includes:

[0099] Step S10: Receive user data input by the target user to the user terminal;

[0100] Step S20: Determine the user type to which the target user belongs in each display type according to the user data;

[0101] Step S30: Feed back the display instruction matching the user type to the user terminal, so that after the preset display device detects the user terminal, obtain the display instruction in the user terminal, and perform content display for the target user according to the display instruction; there is more than one display type, and the display instruction is used to control the display device to display content.

[0102] It should be noted that the display control method provided in the embodiments of the present invention has the same specific implementation and the resulting technical effects as the steps executed by the server in the foregoing display system. For the sake of brief description, for the parts not mentioned in this embodiment, reference may be made to the corresponding content in the foregoing display system embodiment.

[0103] Based on the same inventive concept, in another embodiment of the present invention, a readable storage medium is further provided, on which a computer program is stored. The program is characterized in that when the program is executed by a processor, the steps of the method described in the foregoing method embodiment are implemented. It should be noted that for the readable storage medium provided in the embodiments of the present invention, when the program is executed by the processor, the specific implementation of each step and the resulting technical effects are the same as those of the server in the foregoing method embodiment and display system embodiment. For the sake of brief description, for the parts not mentioned in this embodiment, reference may be made to the corresponding content in the foregoing method embodiment.

[0104] As used herein, the term "and / or" is merely a description of the relationship between associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. Additionally, in this text, the character " / " generally indicates that the associated objects before and after are in an "or" relationship; the word "comprising" does not exclude the existence of elements or steps not listed in the claims. The word "a" or "an" preceding an element does not exclude the existence of multiple such elements. The present invention can be implemented by means of hardware including several different elements and by means of a suitably programmed computer. In the unit claims listing several devices, several of these devices can be embodied by the same hardware item. The use of the words first, second, and third, etc. does not denote any order. These words can be interpreted as names.

[0105] Those skilled in the art will appreciate that the embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present invention can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0106] The present invention is described with reference to the flowcharts and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present invention. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and combinations of flows and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing device to produce a machine, such that the instructions executed by the processor of the computer or other programmable data processing device generate means for implementing the functions specified in Figure 1 one flow or multiple flows and / or blocks Figure 1 one block or multiple blocks.

[0107] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, such that the instructions stored in the computer-readable memory produce a manufacture including instruction means that implement the functions specified in Figure 1 one flow or multiple flows and / or blocks Figure 1 one block or multiple blocks.

[0108] These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus, causing a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, such that the instructions executed on the computer or other programmable apparatus provide steps for implementing the functions specified in one flow Figure 1 one flow or more flows and / or blocks Figure 1 or steps for implementing the functions specified in one block or more blocks.

[0109] Although the preferred embodiments of the present invention have been described, additional changes and modifications can be made by those skilled in the art once they learn of the basic inventive concept. Therefore, the appended claims are intended to be construed to cover the preferred embodiments as well as all changes and modifications falling within the scope of the present invention.

[0110] It is obvious that those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention is also intended to include these modifications and variations.

Claims

1. A display system, characterized in that, include: Servers and display devices; including: The server is used to receive user data input by a target user to a user terminal, wherein the user data is demographic data and interest data of the user and physiological defect data of the user; determine the user type to which the target user belongs in at least one display type according to the user data; and feed back a display instruction matching the user type to the user terminal; The display device is used to obtain a display instruction in the user terminal after detecting the user terminal; and determine the display content of the object to be displayed corresponding to the user type according to the display instruction, and display the display content to the target user.

2. The display system according to claim 1, characterized in that The server includes an application server and a database server; the database server stores: at least one display type and display instructions corresponding to user types under each display type; The application server is used to determine the user type to which the target user belongs in each display type according to the user data; and determine the corresponding display instruction from the database server according to the user type.

3. The display system according to claim 1, wherein The server is also specifically used for: Determining the user type to which the target user belongs in each display type according to the user data and the classification model corresponding to each display type; For each of the display types, the classification model is obtained by training an original model corresponding to the display type according to the historical user data received by the server.

4. The display system according to claim 1, wherein Each of the display instructions is matched with the corresponding user type; the server is further specifically configured to: Receiving rating data fed back by the user terminal; the rating data represents the user's satisfaction with the content displayed by the display device; For any display instruction, if the negative rating data is greater than a preset quantity threshold, the display instruction is matched with the corresponding user type; wherein the negative rating data is rating data with a score less than a preset rating threshold.

5. The display system according to claim 1, wherein The display device includes any one or more of the following display units: a visual display unit, an auditory display unit, an olfactory display unit, and a tactile display unit; the display instructions include any one or more of the following: a visual display instruction, an auditory display instruction, an olfactory display instruction, and a tactile display instruction; The visual display unit is used to play the screen display content corresponding to the visual display instruction; The auditory display unit is used to play the sound display content corresponding to the auditory display instruction; The olfactory display unit is used to generate odor display content corresponding to the olfactory display instruction; The tactile display unit is used to provide interactive display content corresponding to the tactile display instruction.

6. The display system according to claim 1, wherein The display device comprises an identification unit and a control unit. The identification unit is configured to determine that the user terminal is detected when a terminal identifier of the user terminal and / or a user identifier of the target user is identified; Acquire a display instruction in the user terminal, and send the display instruction to the control unit; The control unit is configured to determine the display content of the object to be displayed corresponding to the user type according to the display instruction, and control the display device to display the display content to the target user.

7. A display device, characterized in that, It includes an identification unit and a control unit; wherein: The identification unit is configured to determine that the user terminal is detected when the terminal identifier of the user terminal is recognized and / or the user identifier of the target user is recognized; and after detecting the user terminal, obtain a display instruction from the user terminal; and send the display instruction to the control unit; Wherein, the display instruction is obtained in the following manner: receiving user data input by the target user, where the user data is the demographic data, interest data and physiological defect data of the user; determining the user type to which the target user belongs in at least one display type according to the user data; and obtaining a display instruction matching the user type; The control unit is configured to determine the display content of the object to be displayed corresponding to the user type according to the display instruction, and display the display content to the target user.

8. The display device according to claim 7, wherein It further includes any one or more of the following display units: a visual display unit, an auditory display unit, an olfactory display unit and a tactile display unit; the display instruction includes any one or more of the following: a visual display instruction, an auditory display instruction, an olfactory display instruction and a tactile display instruction; The visual display unit is configured to play the picture display content corresponding to the visual display instruction; The auditory display unit is configured to play the sound display content corresponding to the auditory display instruction; The olfactory display unit is configured to generate the odor display content corresponding to the olfactory display instruction; The tactile display unit is configured to provide the interactive display content corresponding to the tactile display instruction.

9. A display control method, characterized in that, It includes: Receiving user data input by the target user to the user terminal; The user data is the demographic data, interest data and physiological defect data of the user; Determining the user type to which the target user belongs in each display type according to the user data; Feeding back the display instruction matching the user type to the user terminal, so that after the preset display device detects the user terminal, it obtains the display instruction in the user terminal and displays the content to the target user according to the display instruction; there is more than one display type, and the display instruction is used to control the display device to display content.

10. A readable storage medium, on which a computer program is stored, characterized in that, When the program is executed by a processor, it implements the steps of the method described in claim 9.

Images