Interactive display methods, systems, electronic devices and storage media

Abstract

This invention discloses an interactive display method, system, electronic device, and storage medium. The interactive display method includes: acquiring preset position information corresponding to preset touch points of a target recognizer; determining a preset interaction model based on the preset position information; acquiring target position information corresponding to the preset touch points of the target recognizer based on the interaction operation of the preset interaction model; calculating relative position information based on the preset position information and the target position information; and controlling the switching of the display content of the screen based on the relative position information. Through the above interactive display method, position change parameters during the interaction process can be stably identified, and interactive operations can be accurately implemented based on these position change parameters.

Description

Technical Field

[0001] This invention relates to the field of human-computer interaction technology, and in particular to an interactive display method, system, electronic device, and storage medium. Background Technology

[0002] AR (Augmented Reality) technology is a novel human-computer interaction technology. The emergence of AR products marks the first time the virtual and real worlds have been seamlessly integrated, achieving a "leap" across screens and propelling human-computer interaction design from a two-dimensional plane to a three-dimensional world. However, due to market and technological factors, the human-computer interface of AR products is still in its early stages, with various concepts and methods still in the initial formation and testing phase. In the short term, the AR market is primarily divided into mobile AR based on mobile devices such as smartphones and AR glasses based on head-mounted displays, but it also includes in-vehicle HUDs, interactive large-screen displays in shopping malls, and more.

[0003] Currently, some AR products suffer from hardware defects that prevent them from smoothly executing user-inputted interactive commands, severely impacting the user experience. Summary of the Invention

[0004] This invention aims to at least solve one of the technical problems existing in the prior art. To this end, this invention proposes an interactive display method that can stably identify position change parameters during the interaction process and accurately realize interactive operations based on these position change parameters.

[0005] The present invention also proposes an interactive display system.

[0006] This invention also proposes an AR platform.

[0007] The present invention also proposes an interactive display electronic device.

[0008] The present invention also proposes an interactive display computer storage medium.

[0009] An interactive display method according to a first aspect of the present invention includes:

[0010] Obtain the preset position information corresponding to the preset contact point of the target recognizer;

[0011] A preset interaction model is determined based on the preset location information, and the target location information corresponding to the preset touch point of the target recognizer is obtained based on the interaction operation of the preset interaction model.

[0012] Relative position information is calculated based on the preset position information and the target position information;

[0013] The display content of the screen is switched according to the relative position information.

[0014] The interactive display method according to embodiments of the present invention has at least the following beneficial effects: by using the preset position information corresponding to the preset touch point of the target recognizer, a preset interaction model corresponding to the target recognizer can be determined, and the target position information generated when the user performs an interactive operation can be obtained according to the preset interaction model. The relative position information can be calculated according to the preset position information and the target position information. Finally, the display content of the display screen can be switched according to the relative position information. The position change parameters during the interaction process can be stably identified, and the interactive operation can be accurately realized according to the position change parameters.

[0015] According to some embodiments of the present invention, obtaining the preset position information corresponding to the preset touch point of the target identifier includes: obtaining point coordinate information corresponding to a plurality of preset touch points respectively; obtaining the relative positional relationship between the plurality of preset touch points according to the point coordinate information; and determining the preset position information corresponding to the preset touch point according to the relative positional relationship.

[0016] According to some embodiments of the present invention, the target position information includes: target displacement information; obtaining the target position information corresponding to the preset touch point of the target recognizer according to the interactive operation of the preset interactive model includes: obtaining multiple target displacement states corresponding to the target recognizer during movement under the preset interactive model; determining the displacement of the target recognizer according to the multiple target displacement states; and calculating the target displacement information according to the displacement conditions.

[0017] According to some embodiments of the present invention, the target position information includes: target angle information; obtaining the target position information corresponding to the preset touch point of the target recognizer according to the interactive operation of the preset interactive model includes: obtaining multiple target angle parameters corresponding to the target recognizer during movement under the preset interactive model; determining the rotation of the target recognizer according to the multiple target angle parameters; and calculating the target angle information according to the rotation.

[0018] According to some embodiments of the present invention, controlling the display content of the display screen according to the relative position information includes: obtaining a preset resolution corresponding to the display screen, obtaining an actual resolution corresponding to the display screen; calculating a display deviation based on the preset resolution and the actual resolution; adjusting the display content of the display screen according to the display deviation, and controlling the output of the display content.

[0019] An interactive display system according to a second aspect embodiment of the present invention includes:

[0020] The identification module is used to obtain the preset position information corresponding to the preset contact point of the target identifier;

[0021] An interaction module is used to determine a preset interaction model based on the preset location information, and to obtain target location information corresponding to a preset touch point of the target recognizer based on the interaction operation of the preset interaction model.

[0022] The calculation module is used to calculate the relative position information based on the preset position information and the target position information;

[0023] The display module is used to control the switching of the display content on the screen according to the relative position information.

[0024] The interactive display system according to embodiments of the present invention has at least the following beneficial effects: by using the preset position information corresponding to the preset touch point of the target recognizer, the preset interaction model corresponding to the target recognizer can be determined; the target position information generated when the user performs an interactive operation can be obtained according to the preset interaction model; the relative position information can be calculated according to the preset position information and the target position information; finally, the display content of the display screen can be switched according to the relative position information; the position change parameters during the interaction process can be stably identified; and the interactive operation can be accurately realized according to the position change parameters.

[0025] According to some embodiments of the present invention, the target identifier is disposed on the interaction module.

[0026] According to some embodiments of the present invention, the target identifier includes a plurality of preset contacts; the plurality of preset contacts are connected to each other by a conductor.

[0027] According to some embodiments of the present invention, the display module includes a plurality of displays.

[0028] According to some embodiments of the present invention, the interaction module further includes: a touch screen; the touch screen is used to acquire the interaction operation of the preset interaction model.

[0029] According to some embodiments of the present invention, the display module further includes: a delay device; the delay device is used to control the delayed display of the display content.

[0030] According to some embodiments of the present invention, the display module further includes: a projection device; the projection device is used to control the projection display of the display content.

[0031] The AR platform according to a third aspect of the present invention includes the interactive display system proposed in the second aspect of the present invention.

[0032] The AR platform according to the third aspect of the present invention has at least the following beneficial effects: by utilizing the interactive display system proposed in the second aspect of the present invention, the preset interactive model corresponding to the target recognizer can be determined through the preset position information corresponding to the preset touch point of the target recognizer, and the target position information generated when the user performs interactive operation can be obtained according to the preset interactive model. The relative position information can be calculated according to the preset position information and the target position information. Finally, the display content of the display screen can be switched according to the relative position information. The position change parameters during the interaction process can be stably identified, and the interactive operation can be accurately realized according to the position change parameters.

[0033] An interactive display electronic device according to a fourth aspect of the present invention includes: at least one processor, and a memory communicatively connected to the at least one processor; wherein the memory stores instructions which are executed by the at least one processor to cause the at least one processor to implement the interactive display method described in the first aspect when executing the instructions.

[0034] The interactive display electronic device according to the embodiments of the present invention has at least the following beneficial effects: by using the preset position information corresponding to the preset touch point of the target recognizer, the preset interaction model corresponding to the target recognizer can be determined, and the target position information generated when the user performs an interactive operation can be obtained according to the preset interaction model. The relative position information can be calculated according to the preset position information and the target position information. Finally, the display content of the display screen can be switched according to the relative position information. The position change parameters during the interaction process can be stably identified, and the interactive operation can be accurately realized according to the position change parameters.

[0035] According to a fifth aspect of the present invention, an interactive display storage medium stores computer-executable instructions for causing a computer to perform the interactive display method described in the first aspect.

[0036] According to the fifth aspect of the present invention, the interactive display storage medium has at least the following beneficial effects: by using the preset position information corresponding to the preset touch point of the target recognizer, the preset interaction model corresponding to the target recognizer can be determined, and the target position information generated when the user performs an interactive operation can be obtained according to the preset interaction model. The relative position information can be calculated according to the preset position information and the target position information. Finally, the display content of the display screen can be switched according to the relative position information. The position change parameters during the interaction process can be stably identified, and the interactive operation can be accurately realized according to the position change parameters. Attached Figure Description

[0037] The above and / or additional aspects and advantages of the present invention will become apparent and readily understood from the description of the embodiments taken in conjunction with the following drawings, in which:

[0038] Figure 1 This is a flowchart of the interactive display method according to an embodiment of the present invention;

[0039] Figure 2 This is a flowchart illustrating the process of obtaining preset location information according to an embodiment of the present invention;

[0040] Figure 3 This is a schematic diagram of the structure of the interactive display system according to an embodiment of the present invention;

[0041] Figure 4 This is a schematic diagram of the target identifier according to an embodiment of the present invention;

[0042] Figure 5 This is a functional block diagram of an electronic device according to an embodiment of the present invention.

[0043] Figure label:

[0044] The system includes an identification module 3000, a target identifier 3010, a first preset contact 3011, a second preset contact 3012, a third preset contact 3013, a fourth preset contact 3014, an interaction module 3100, a calculation module 3200, a display module 3300, a processor 500, a memory 510, a data transmission module 520, a camera 530, and a display screen 540. Detailed Implementation

[0045] Embodiments of the present invention are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present invention, and should not be construed as limiting the present invention.

[0046] In the description of this invention, unless otherwise explicitly defined, terms such as "setting," "installing," and "connecting" should be interpreted broadly, and those skilled in the art can reasonably determine the specific meaning of the above terms in this invention in conjunction with the specific content of the technical solution.

[0047] Reference Figure 1 According to an embodiment of the first aspect of the present invention, the interactive display method includes:

[0048] Step S100: Obtain the preset position information corresponding to the preset contact point of the target recognizer.

[0049] The target identifier can be a device used to identify the location; the preset contacts can be several conductor contacts pre-set on the target identifier, and multiple preset contacts can be set as needed; the preset position information can be the point coordinate information or angle information corresponding to multiple preset contacts. Optionally, assuming that a target identifier has 4 preset contacts, and assuming that the preset position information corresponding to the 4 preset contacts is p1, then the preset position information is p1.

[0050] Step S110: Determine a preset interaction model based on preset location information, and obtain the target location information corresponding to the preset touch point of the target recognizer based on the interaction operation of the preset interaction model.

[0051] The preset interaction model can be a pre-set model for interaction, which can be set according to requirements. The interaction operation of the preset interaction model can be an operation that uses the preset interaction model to control the target recognizer to achieve human-computer interaction; different preset interaction models correspond to different interaction operations. The target position information can be the point coordinate information corresponding to the preset touch point of the target recognizer obtained after the interaction operation. Optionally, the preset interaction model can be determined based on the preset position information. For example, assuming the preset position information is p1, the preset interaction model can be determined as Q1 (assuming Q1 is a sofa model), and the sofa model Q1 is loaded onto the display screen. Assuming the preset position information is p2, the preset interaction model can be determined as Q2 (assuming Q2 is a bed model), and the bed model Q2 is loaded onto the display screen. Then, based on the interaction operation of Q1, such as using the sofa model to control the target recognizer to perform a translation operation, the target position information corresponding to the preset touch point of the target recognizer after translation is obtained as p2.

[0052] Step S120: Calculate the relative position information based on the preset position information and the target position information.

[0053] The relative position information can be the relative displacement change information of the target recognizer. Optionally, the relative position information can be calculated based on preset position information and target position information. For example, assuming the preset position information is p1 and the target position information obtained after the interactive operation is p2, the relative position change of the target recognizer can be calculated based on p1 and p2 to obtain the relative position information p3.

[0054] Step S130: Control the switching of the display content on the screen according to the relative position information.

[0055] The displayed content can be various interactive scene content projected onto the screen. When the target recognizer's position is moved or changed, the preset interactive model on the display screen can be controlled to change its parameters accordingly, achieving interactive display. Therefore, the displayed content can be switched based on relative position information. Optionally, assuming the relative position information is p3, the scene content on the display screen can be switched based on p3, thus realizing the display of human-computer interaction scene content. For example, the displayed content of the sofa model on the display screen can be switched based on p3. Assuming p3 is displacement information, the displayed content of the sofa model on the display screen can be translated according to p3; assuming p3 is angle information, the displayed content of the sofa model on the display screen can be rotated according to p3; assuming p3 is both displacement and angle information, the displayed content of the sofa model on the display screen can be translated and rotated according to p3.

[0056] The above-described interactive display method can determine the preset interaction model corresponding to the target recognizer by using the preset position information corresponding to the preset touch point of the target recognizer. It can obtain the target position information generated when the user performs an interactive operation based on the preset interaction model, and calculate the relative position information based on the preset position information and the target position information. Finally, it can control the switching of the display content of the screen based on the relative position information. It can stably recognize the position change parameters during the interaction process and accurately realize the interactive operation based on the position change parameters.

[0057] The above-mentioned interactive display method can be applied to the field of AR technology (Augmented Reality for mobile applications, or AR for short) to realize the overlay of the virtual world onto the real world on the display screen and enable human-computer interaction. Through the above-mentioned interactive display method, the position change parameters of the human-computer interaction process can be stably identified, and the human-computer interaction operation can be accurately displayed.

[0058] Reference Figure 2 , Figure 2 A flowchart illustrating the process of obtaining preset position information corresponding to preset touch points of a target identifier includes:

[0059] Step S200: Obtain the point coordinate information corresponding to multiple preset contact points.

[0060] In this context, the point coordinate information can be the coordinate information corresponding to a certain preset touch point. Optionally, the target recognizer can correspond to several preset touch points. Assuming that the target recognizer corresponds to three preset touch points, the point coordinate information corresponding to these three preset touch points can be obtained respectively. We can get: the point coordinate information corresponding to the first preset touch point is a(x1, y1), the point coordinate information corresponding to the second preset touch point is b(x2, y2), and the point coordinate information corresponding to the third preset touch point is c(x3, y3). Thus, the point coordinate information corresponding to the three preset touch points can be obtained as a(x1, y1), b(x2, y2), and c(x3, y3).

[0061] Step S210: Obtain the relative positional relationship between multiple preset contact points based on the point coordinate information, and determine the preset position information corresponding to the preset contact points based on the relative positional relationship.

[0062] The relative positional relationship can be the point coordinate positional relationship between multiple preset touch points. Optionally, assuming the target recognizer includes three preset touch points, and the point coordinate information corresponding to the three preset touch points are a(x1, y1), b(x2, y2), and c(x3, y3), the point coordinate positional relationship between the three preset touch points can be determined based on the above point coordinate information. For example, the coordinates of a(x1, y1), b(x2, y2), and c(x3, y3) can be normalized, and the origin of the coordinates can be normalized to the centroid of the three preset touch points, so that the point coordinate positional relationship between the three preset touch points is p1, p1 = {a(x1, y1), b(x2, y2), c(x3, y3)}, and then the preset position information corresponding to the preset touch points of the target recognizer is p1. By acquiring the point coordinate information corresponding to each preset touch point in the target recognizer, and then determining the relative positional relationship between multiple preset touch points based on these point coordinate information, the accurate preset position information corresponding to the preset touch points can be obtained based on the relative positional relationship, and the position information of the target recognizer before interaction can be stably identified.

[0063] In some embodiments of the present invention, the target position information includes target displacement information. The target displacement information may be the position movement information corresponding to a preset touch point obtained after controlling the target recognizer to perform a translational interactive operation. Optionally, it may be the target displacement information obtained by controlling the target recognizer to translate in various directions. For example, assuming the preset position information is p1, p1 = {a(x1, y1), b(x2, y2), c(x3, y3)}, after controlling the target recognizer to move a distance d1 along the positive horizontal direction, the target position information obtained is target displacement information p2, assuming p2 = {a(x1+d1, y1), b(x2+d2, y2), c(x3+d3, y3)}, thus the target displacement information p2 can be obtained.

[0064] Based on the interactive operations of the preset interactive model, the target location information corresponding to the preset touch point of the target recognizer is obtained, including:

[0065] Under the preset interaction model, multiple target displacement states corresponding to the target recognizer during its movement are obtained. These target displacement states can be the movement state of the target recognizer during translation within a unit of time, such as whether the target recognizer has lost points during its movement. Multiple target displacement states can be obtained through sampling. Optionally, it is assumed that within a unit of time T1, multiple target displacement states are sampled as: (x1,y1,t1), (x2,y2,t2), (x3,y3,t3), and (x4,y4,t4).

[0066] The displacement of the target identifier is determined based on multiple target displacement states, and the target displacement information is calculated based on these displacement states. The displacement state of the target identifier can include whether the target identifier loses points during movement. Because changes in capacitance or user removal of the target identifier during its translation can lead to point loss during identification, this can be addressed by acquiring multiple target displacement states during movement to determine the target identifier's displacement state and thus identify whether point loss exists. Optionally, when the acquired target displacement states are continuous, indicating no point loss, the target displacement information can be directly calculated based on these states. For example, assuming multiple target displacement states are sampled within a unit time T1 as (x1,y1,t1), (x2,y2,t2), (x3,y3,t3), and (x4,y4,t4), the target displacement information can be calculated as (x1,y1), (x2,y2), (x3,y3), and (x4,y4).

[0067] Optionally, when the collected target displacement states are discontinuous and there is a problem of missing points, the target recognition device's movement trajectory can be corrected based on the displacement of the missing points, thereby obtaining the target displacement information. For example, assuming that multiple target displacement states are sampled at four times (t1, t2, t3, and t4) within a unit time T as (x1, y1, t1), (x2, y2, t2), and (x4, y4, t4), it can be determined that the target identifier does not exist at the coordinate point corresponding to time t3. Based on the target displacement states at times t1 and t2, i.e., based on (x1, y1, t1) and (x2, y2, t2), the average moving speed v1 during the time interval from t1 to t2 can be calculated. Then, based on (x1, y1, t1), (x2, y2, t2) and the average moving speed v1, (x3, y3, t3) can be calculated. Thus, the target displacement information can be obtained as (x1, y1), (x2, y2), (x3, y3), and (x4, y4). The target displacement state at time t4 (x4, y4, t4) can also be calculated based on the three target displacement states (x1, y1, t1), (x2, y2, t2), and (x3, y3, t3). This yields the target displacement information as (x1, y1), (x2, y2), (x3, y3), and (x4, y4). By acquiring multiple target displacement states during the translation process and determining whether the target recognizer has missed any points, and promptly correcting any erroneous movement trajectories, the displacement changes of the target recognizer during interaction can be stably identified.

[0068] In some embodiments of the present invention, the target position information includes target angle information. The target angle information may be the position rotation information corresponding to a preset touch point obtained after an interactive operation that controls the target recognizer to rotate. Optionally, it may be the target angle information obtained by controlling the target recognizer to rotate. For example, assuming the preset position information is p1, and the angle corresponding to p1 is 0°, after controlling the target recognizer to rotate 90° clockwise, the target position information obtained is target angle information p3. Assuming the angle corresponding to p3 is 90°, then the target angle information p3 = 90° can be obtained.

[0069] Based on the interactive operations of the preset interactive model, the target location information corresponding to the preset touch point of the target recognizer is obtained, including:

[0070] Under the preset interaction model, multiple target angle parameters corresponding to the target recognizer during its movement are obtained. These target angle parameters can be rotation angle information controlling the target recognizer's rotation process, such as the rotation angle value and / or the angular velocity value of the target recognizer. Multiple target angle parameters can be obtained through sampling. Optionally, assuming the target angle parameter is rotation angle information, the rotation angle values ​​of the target recognizer at multiple moments during the rotation process can be obtained. For example, the rotation angle value of the target recognizer at moment t1 is 30°, the rotation angle value of the target recognizer at moment t2 is -15°, and the rotation angle value of the target recognizer at moment t3 is 45°. Optionally, assuming the target angle parameter is angular velocity value, the angular velocity values ​​of the target recognizer at multiple moments during the rotation process can be obtained. For example, the angular velocity value at moment t1 is ω1, the angular velocity value at moment t2 is ω2, and the angular velocity value at moment t3 is ω3. Optionally, assuming the target angle parameter is both rotation angle value and angular velocity value, the rotation angle value and angular velocity value of the target recognizer at multiple moments during the rotation process can be obtained. For example, the rotation angle value of the target recognizer at moment t1 is 10° and the angular velocity value is ω1, the rotation angle value of the target recognizer at moment t2 is 110° and the angular velocity value is ω2, and the rotation angle value of the target recognizer at moment t3 is -20° and the angular velocity value is ω3.

[0071] The rotation of the target recognizer is determined based on multiple target angle parameters, and the target angle information is calculated based on this rotation. The rotation of the target recognizer can be information about whether the angle change is stable during rotation. Because the physical distances between the multiple preset contact points of the target recognizer may be quite close, or due to unstable calculation direction, the multiple target angle parameters obtained by the target recognizer may be unstable, increasing the possibility of recognition point error and thus leading to unstable angle changes in the target recognizer; for example, the obtained angle value may jump. To solve the problem of unstable angle changes, the rotation of the target recognizer can be determined by obtaining the corresponding multiple target angle parameters during rotation, thereby determining whether an unstable angle change problem exists. Optionally, when multiple target angle parameters do not jump between states, it can be determined that there is no unstable state of angle change. Therefore, the target angle information can be obtained directly from the multiple target angle parameters. For example, if the multiple target angle parameters are the rotation angle value of the target recognizer at time t1 as 30°, the rotation angle value of the target recognizer at time t2 as -15°, and the rotation angle value of the target recognizer at time t3 as 45°, then the target angle information can be directly obtained as 30°, -15°, and 45°.

[0072] Optionally, when multiple target angle parameters exhibit jumps, it indicates an unstable angle state. Calculations can be performed based on this instability to correct the target identifier's trajectory and obtain the target angle information. For example, assuming that the target angle parameters acquired at three moments within a unit time T are angular velocities ω1 at time t1, ω2 at time t2, and ω3 at time t3, where ω2 >> ω1 > ω3, then an unstable angle state can be identified. The system can correct for unstable angle changes. For example, a pre-set rotation error range ω0 for the target recognizer can be used. When ω1 < ω0, ω3 < ω0, and ω2 > ω0, ω2 can be corrected to ω1, meaning the original angle ω1 is retained as the target angle information. Therefore, the obtained target angle information is ω1 and ω3. When ω1 < ω0, ω2 < ω0, and ω3 > ω0, ω3 can be omitted. Instead, a new ω3 is calculated based on ω1 and ω2, denoted as ω31. Therefore, the obtained target angle information is ω1, ω2, and ω31. By acquiring multiple target angle parameters and determining whether there are rotation angle jumps in the target recognizer, the rotation angle error can be corrected promptly when such rotation occurs, thus stabilizing the recognition of angle changes during interaction.

[0073] In some embodiments of the present invention, controlling the display content of the display screen according to relative position information includes:

[0074] Obtain the preset resolution corresponding to the display screen, and obtain the actual resolution corresponding to the display screen. The preset resolution can be a pre-set display resolution; the actual resolution can be the display resolution of the actual display screen used in the application. Optionally, assuming the preset resolution is 1980*1080 and the actual resolution is 1280*720, the preset resolution and actual resolution can be obtained separately.

[0075] The display deviation is calculated based on the preset resolution and the actual resolution. The display deviation can be the display error value between the preset resolution and the actual resolution. Since the preset resolution and the actual resolution may not be consistent, to avoid abnormal display of content on the screen when they are inconsistent, the display deviation can be calculated, and the display content can be adjusted according to this deviation. Optionally, assuming the preset resolution is 1980*1080 and the actual resolution is 1280*720, the display deviation f1 = 0.43 is calculated based on these two values.

[0076] The display content of the screen is adjusted according to the display deviation, and the output of the display content is controlled. Optionally, assuming the display deviation is f1, the display content of the screen can be adjusted according to f1. For example, the display content at a preset resolution can be cropped according to the display deviation, ignoring the coordinates of the part exceeding the actual resolution, and only the display content within the actual resolution is controlled to be projected onto the actual application screen, while the coordinates of the part exceeding the actual resolution are projected onto the boundary of the actual application screen, thereby controlling the proportional output of the display content; or, the display content at a preset resolution can be scaled according to the display deviation, so that the actual application screen can display all the display content, thus ensuring the integrity of the display content. The display deviation can be calculated by using the preset resolution and the actual resolution of the screen, and the display content can be adjusted according to the display deviation and the output of the adjusted display content can be controlled to solve the problem of abnormal display content on the screen.

[0077] Reference Figure 3 According to the second aspect of the present invention, an interactive display system comprises:

[0078] The recognition module 3000 is used to obtain the preset position information corresponding to the preset contact point of the target recognizer.

[0079] Optionally, the recognition module 3000 includes a target recognizer 3010. The recognition module 3010 can obtain preset position information by recognizing the positional relationship of preset contact points on the target recognizer. This preset position information may include displacement information and / or angle information. Multiple preset contact points can be set as needed. Optionally, assuming that the position coordinates corresponding to the three preset contact points on the target recognizer are (x1, y1), (x2, y2), and (x3, y3), the preset position information can be obtained as p1 = {(x1, y1), (x2, y2), (x3, y3)}.

[0080] The interaction module 3100 is used to determine a preset interaction model based on preset location information, and to obtain target location information corresponding to the preset touch point of the target recognizer based on the interaction operation of the preset interaction model.

[0081] Optionally, the interaction module 3100 can determine the preset interaction model as sofa model Q1 based on the preset position information p1 = {(x1,y1),(x2,y2),(x3,y3)}, and load the sofa model Q1 onto the display screen; it can also determine the preset interaction model as bed model Q2 based on the preset position information p2 = {(x3,y3),(x4,y4),(x5,y5)}, and load the bed model Q2 onto the display screen. Once the preset interaction model is determined, the target position information corresponding to the preset touch points of the target recognizer after the interaction operation can be obtained by controlling the target recognizer according to the preset interaction model. For example, assuming the obtained target position information is p3 = {(x6,y6),(x7,y7),(x8,y8)}, the above target position information can be obtained.

[0082] The calculation module 3200 is used to calculate the relative position information based on the preset position information and the target position information.

[0083] Optionally, assuming the preset position information is p2 = {(x3,y3),(x4,y4),(x5,y5)}, and the target position information is p3 = {(x6,y6),(x7,y7),(x8,y8)}, then the calculation module 3200 can calculate the relative position information as p4 = {(x6-x3,y6-y3),(x7-x4,y7-y4),(x8-x5,y8-x5)} based on p2 and p3. Optionally, assuming the preset position information is p5 = 0°, and the target position information is p6 = -35°, then the relative position information can be calculated as p7 = -35°.

[0084] Display module 3300 is used to control the switching of the display content of the display screen according to the relative position information.

[0085] Optionally, when the target recognizer 3010 is moved or its placement position is changed, the preset interactive model on the display screen can be controlled to change its parameters accordingly. For example, assuming the relative position information is p7 = -35°, the display module 3300 can control the display content on the screen to switch according to p7. For example, assuming the preset interactive model is a chair model, the display content of the chair model on the screen can be controlled to rotate counterclockwise by 35° to achieve interactive display.

[0086] The aforementioned interactive display system can determine the preset interaction model corresponding to the target recognizer by using the preset position information corresponding to the preset touch point of the target recognizer. It can obtain the target position information generated when the user performs an interactive operation based on the preset interaction model, and calculate the relative position information based on the preset position information and the target position information. Finally, it can control the switching of the display content of the screen based on the relative position information. It can stably recognize the position change parameters during the interaction process and accurately realize the interactive operation based on the position change parameters.

[0087] Please continue to refer to Figure 3 In some embodiments of the present invention, the target recognizer 3010 is disposed on the interaction module 3100. Optionally, disposing of the target recognizer 3010 on the interaction module 3100 allows the interaction module 3100 to acquire preset position information corresponding to preset touch points of the target recognizer 3010, and to determine a preset interaction model based on the preset position information. Disposing of the target recognizer on the interaction module allows for the direct acquisition of accurate preset position information.

[0088] Please refer to the above as well. Figure 3 and Figure 4 In some embodiments of the present invention, the target identifier 3010 includes a plurality of preset contacts. For example... Figure 4 As shown, the target identifier 3010 is assumed to include four preset contacts, namely the first preset contact 3011, the second preset contact 3012, the third preset contact 3013 and the fourth preset contact 3014.

[0089] Multiple preset contacts are connected by a conductor. For example... Figure 4 As shown, the first preset contact 3011, the second preset contact 3012, the third preset contact 3013, and the fourth preset contact 3014 can be connected by a conductor, assuming that the conductor is conductive adhesive or graphene. Optionally, the portion of the target identifier 3010 other than the first preset contact 3011, the second preset contact 3012, the third preset contact 3013, and the fourth preset contact 3014 can be encapsulated in an insulating material (e.g., insulating adhesive) into a cylinder for easy handling by the user. Through the multiple connected preset contacts on the target identifier, preset position information can be reliably identified.

[0090] In some embodiments of the present invention, the display module 3300 includes multiple displays. Optionally, the display module 3300 may include four displays, which may be connected together or externally connected. By using multiple displays in the display module 3300, the content displayed on the displays can be more complete.

[0091] In some embodiments of the present invention, the interaction module 3100 further includes a touch screen. The touch screen is used to acquire the interaction operations of a preset interaction model. Optionally, the touch screen can be a capacitive screen, and a plurality of target recognizers 3010 can be placed on the touch screen. The touch screen can recognize 80 preset touch points. For example, assuming there are three target recognizers 3010, and assuming the interaction operations of the preset interaction model are controlling the first target recognizer to translate a distance d1 in the positive vertical direction, controlling the second target recognizer to translate a distance d2 in the negative horizontal direction, and controlling the third target recognizer to rotate 180°, then the above three interaction operations can be acquired through the touch screen. By acquiring the interaction operations of the preset interaction model through the touch screen, the accurate parameter changes of the preset interaction model can be obtained.

[0092] In some embodiments of the present invention, the display module 3300 further includes a delay device. The delay device is used to control the delayed display of the display content. Since the display module 3300 may experience unsmooth display due to transmission delay when controlling the switching of display content based on relative position information, the delay device can be set to control the delayed display of the display content, so that the display content can be displayed continuously and smoothly.

[0093] In some embodiments of the present invention, the display module 3300 further includes a projection device. The projection device is used to control the projection display of the display content. Optionally, the projection device can load a preset interactive model onto the display screen. For example, when the preset interactive model is a sofa model, the sofa model can be loaded and projected onto the display screen. The projection device can also project display content that has been switched according to its relative position onto the display screen for display. For example, after controlling the sofa model to rotate 90°, the rotated sofa model can be loaded and projected onto the display screen for display. By setting the projection device to project the display content, users can obtain a better visual experience.

[0094] The AR platform proposed according to a third aspect embodiment of the present invention includes the interactive display system as described in the second aspect embodiment of the present invention. Through the AR platform of the third aspect embodiment of the present invention, position change parameters during the interaction process can be stably identified, and interactive operations can be accurately implemented based on these position change parameters.

[0095] Reference Figure 5 The fourth aspect of the present invention also provides an internal structure diagram of an interactive display electronic device, including: at least one processor 500, and a memory 510 communicatively connected to the at least one processor 500; it may also include a data transmission module 520, a camera 530, and a display screen 540.

[0096] The processor 500 executes the interactive display method in the first aspect embodiment by calling a computer program stored in the memory 510.

[0097] Memory, as a non-transitory storage medium, can be used to store non-transitory software programs and non-transitory computer-executable programs, such as the interactive display method in the first aspect embodiment of the present invention. The processor implements the interactive display method in the first aspect embodiment by running the non-transitory software program and instructions stored in the memory.

[0098] The memory may include a program storage area and a data storage area, wherein the program storage area may store the operating system and applications required for at least one function; the data storage area may store the interactive display method for executing the first aspect embodiment described above. Furthermore, the memory may include high-speed random access memory and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid-state storage device. In some embodiments, the memory may optionally include memory remotely located relative to the processor, and these remote memories may be connected to the terminal via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0099] The non-transitory software program and instructions required to implement the interactive display method in the first aspect embodiment are stored in memory. When executed by one or more processors, the interactive display method in the first aspect embodiment is executed.

[0100] Fifthly, embodiments of the present invention also provide an interactive display storage medium storing computer-executable instructions, which are used to: execute the interactive display method in the first aspect embodiment.

[0101] In some embodiments, the storage medium stores computer-executable instructions that are executed by one or more control processors, such as a processor in an electronic device according to a second aspect embodiment, causing the one or more processors to perform the interactive display method described in the first aspect embodiment.

[0102] The electronic device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.

[0103] It will be understood by those skilled in the art that all or some of the steps and systems in the methods disclosed above can be implemented as software, firmware, hardware, and suitable combinations thereof. Some or all of the physical components can be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit. Such software can be distributed on a computer-readable medium, which can include storage media (or non-transitory media) and communication media (or transient media). As is known to those skilled in the art, the term storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and is accessible to a computer. Furthermore, as is known to those skilled in the art, communication media typically contain computer-readable instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.

[0104] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "illustrative embodiment," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of the invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0105] Although embodiments of the invention have been shown and described, those skilled in the art will understand that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the claims and their equivalents.

Claims

1. An interactive display method, characterized in that, include: Obtain the preset position information corresponding to the preset contact point of the target recognizer; A preset interaction model is determined based on the preset location information, the display content corresponding to the preset interaction model is loaded on the display screen, and the target location information corresponding to the preset touch point of the target recognizer is obtained based on the interaction operation of the preset interaction model; wherein, different preset interaction models correspond to different interaction operations. Relative position information is calculated based on the preset position information and the target position information; The display content corresponding to the preset interactive model on the display screen is switched according to the relative position information. The target location information includes target displacement information. The step of obtaining the target location information corresponding to the preset touchpoint of the target recognizer based on the interaction operation of the preset interaction model includes: Under the preset interaction model, multiple target displacement states corresponding to the target recognizer during the movement process are obtained; The displacement of the target identifier is determined based on the multiple target displacement states; When the displacement condition is that there is a missing point, the target displacement state of the missing point is determined according to multiple target displacement states; The target displacement information is calculated based on the target displacement state of the lost point and multiple target displacement states; The target location information includes target angle information. Obtaining the target location information corresponding to the preset touchpoint of the target recognizer based on the interaction operation of the preset interaction model includes: Under the preset interaction model, multiple target angle parameters corresponding to the target recognizer during the movement process are obtained; The rotation of the target identifier is determined based on the multiple target angle parameters; When the rotation is unstable due to angle changes, the target angle parameters are corrected according to the preset rotation error range of the target recognizer to obtain the target angle information; The step of controlling the switching of the display content corresponding to the preset interaction model on the display screen according to the relative position information includes: Obtain the preset resolution and actual resolution corresponding to the display screen; The display deviation is calculated based on the preset resolution and the actual resolution, and the display deviation is used to indicate the display error value between the preset resolution and the actual resolution; Adjust the display content of the display screen according to the display error value, and control the output of the display content.

2. The method according to claim 1, characterized in that, The acquisition of preset position information corresponding to preset touch points of the target recognizer includes: Obtain the point coordinate information corresponding to each of the multiple preset contact points; The relative positional relationship between the multiple preset contact points is obtained based on the point coordinate information, and the preset position information corresponding to the preset contact points is determined based on the relative positional relationship.

3. An interactive display system, characterized in that, include: The identification module is used to obtain the preset position information corresponding to the preset contact point of the target identifier; An interaction module is used to determine a preset interaction model based on the preset location information, load the display content corresponding to the preset interaction model on the display screen, and obtain the target location information corresponding to the preset touch point of the target recognizer based on the interaction operation of the preset interaction model; wherein, different preset interaction models correspond to different interaction operations. The target location information includes target displacement information. The step of obtaining the target location information corresponding to the preset touchpoint of the target recognizer based on the interaction operation of the preset interaction model includes: Under the preset interaction model, multiple target displacement states corresponding to the target recognizer during the movement process are obtained; The displacement of the target identifier is determined based on the multiple target displacement states; When the displacement condition is that there is a missing point, the target displacement state of the missing point is determined according to multiple target displacement states; The target displacement information is calculated based on the target displacement state of the lost point and multiple target displacement states; The target location information includes target angle information. Obtaining the target location information corresponding to the preset touchpoint of the target recognizer based on the interaction operation of the preset interaction model includes: Under the preset interaction model, multiple target angle parameters corresponding to the target recognizer during the movement process are obtained; The rotation of the target identifier is determined based on the multiple target angle parameters; When the rotation is unstable due to angle changes, the target angle parameters are corrected according to the preset rotation error range of the target recognizer to obtain the target angle information; The calculation module is used to calculate the relative position information based on the preset position information and the target position information; The display module is used to control the switching of the display content corresponding to the preset interactive model on the display screen according to the relative position information; The step of controlling the switching of the display content corresponding to the preset interaction model on the display screen according to the relative position information includes: Obtain the preset resolution and actual resolution corresponding to the display screen; The display deviation is calculated based on the preset resolution and the actual resolution, and the display deviation is used to indicate the display error value between the preset resolution and the actual resolution; Adjust the display content of the display screen according to the display error value, and control the output of the display content.

4. The system according to claim 3, characterized in that, The identification module includes a target identifier, which is disposed on the interaction module.

5. The system according to claim 4, characterized in that, The target identifier includes multiple preset contact points; The plurality of preset contacts are connected by a conductor.

6. An interactive display electronic device, characterized in that, include: At least one processor, and, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that are executed by the at least one processor to implement the interactive display method as described in any one of claims 1 to 2 when the at least one processor executes the instructions.

7. An interactive display storage medium, characterized in that, The storage medium stores computer-executable instructions for causing a computer to perform the interactive display method as described in any one of claims 1 to 2.

Images