Information display method and system based on mobile screen

Abstract

The invention relates to an information display method and system based on a mobile screen, and relates to the field of science and education display technology, and the method comprises the steps: responding to a trigger signal arranged on the mobile screen, and collecting a current image shot by the mobile screen; identifying the current image based on an exhibit three-dimensional model stored in a preset exhibit database to obtain a current exhibit; searching corresponding exhibit information classification and classification information from a preset information database based on the current exhibit; displaying the exhibit information classification on a mobile screen, receiving a selected classification, and defining the classification information corresponding to the selected classification as selected information; and displaying the selected information on a mobile screen. The method has the advantages that image recognition is carried out through the mobile screen, then each person looks up required information on the mobile screen of the person, the person does not need to queue up and check on a public screen, and the exhibit display efficiency is improved.

Description

Technical Field

[0001] The present invention relates to the field of science education display technology, and in particular, to an information display method and system based on a mobile screen. Background Art

[0002] An exhibition hall is generally called a convention and exhibition venue, which is a place for displaying products, conference exchanges, information dissemination, economic trade, etc. Among them, a science education exhibition hall is a type of exhibition hall. In a science education exhibition hall, knowledge of science and education is usually displayed to visitors through a combination of text, images, and videos on a display screen.

[0003] During the display process, for some esoteric science education knowledge, when popularizing it, it is necessary to introduce in detail the professional knowledge in various dimensions of this field. If the text is displayed on a display board, often due to the limited space of the display board, some science education knowledge is difficult to display and convey, or when the display board needs to convey this part of knowledge completely because of a large amount of knowledge involved, the text used is small and the layout is relatively dense, affecting the viewing experience of visitors. In order to improve the problem that a conventional display board is difficult to elaborate on the overall system architecture knowledge in detail, current science education venues often use a touch display screen to further display the content in the conventional display board, that is, when touching the text display screen, an interpretation of it will automatically pop up.

[0004] In view of the above related technologies, although the touch display screen solves the above problems, if there are many people who want to know about the same exhibit, but the display board can only display one content, then most people need to queue up or give up, which also affects the viewing experience of visitors. Summary of the Invention

[0005] In order to improve the problem that when the display board can only display one content, most people need to queue up or give up, which also affects the viewing experience of visitors, the present invention provides an information display method and system based on a mobile screen.

[0006] In a first aspect, the present invention provides an information display method based on a mobile screen, adopting the following technical solution: An information display method based on a mobile screen includes: Responding to a trigger signal set on the mobile screen, collecting a current image captured by the mobile screen; Identifying the current image based on the three-dimensional model of the exhibit stored in a preset exhibit database to obtain the current exhibit; Finding the corresponding exhibit information classification and classification information from a preset information database based on the current exhibit; Displaying the exhibit information classification on the mobile screen, receiving the selected classification, and defining the classification information corresponding to the selected classification as the selected information; The selected information is displayed on the mobile screen.

[0007] By adopting the above technical solution, image recognition is performed through the mobile screen, and then everyone can find the information they need on their own mobile screen, without having to queue up to view it on a public screen, thereby improving the efficiency of exhibit display.

[0008] Optionally, the method of identifying the current image to obtain the current exhibit includes: Determine the angle image based on the three-dimensional model of the exhibit stored in the exhibit database; Match the angle images with the current image one by one to obtain successfully matched exhibits; When the number of matching exhibits is 1, the matching exhibit is output as the current exhibit; When the number of matching exhibits is greater than or equal to 2, the mobile screen coordinates are received; Find the corresponding placement coordinates from the preset placement database based on the matching exhibits; Calculate the distance of exhibits based on the mobile screen coordinates and placement coordinates; Screening the smallest exhibit distance and defining the corresponding matching exhibit as the target matching exhibit; Output the target matching exhibit as the current exhibit.

[0009] By adopting the above technical solution, if two or more exhibits are recognized on a screen, the selected one is determined based on the positions of the exhibits and the positions of the person, without the need for human judgment, making the recognition process more intelligent.

[0010] Optionally, the method for calculating the distance of the exhibits based on the mobile screen coordinates and the placement coordinates includes: Receive the coordinates of the mobile screen and receive the direction of the mobile screen at the same time; The placement coordinates are screened based on the mobile screen orientation, the mobile screen coordinates and a preset mobile screen shooting angle range to obtain the orientation placement coordinates; The exhibit distance is calculated based on the mobile screen coordinates and orientation placement coordinates.

[0011] By adopting the above technical solution, the placement coordinates are screened by the direction of the camera of the mobile screen and the wide angle of shooting, which reduces the calculation and comparison amount of impossible placement coordinates and improves the calculation efficiency of the placement coordinates.

[0012] Optionally, a method for determining whether to screen the minimum exhibit distance and define the corresponding matching exhibit as a target matching exhibit is also included, and the method includes: The orientation placement coordinates with the shortest exhibit distance are defined as the minimum placement coordinates, and the other orientation placement coordinates are defined as other placement coordinates; Find the corresponding minimum shooting area from a preset shooting database based on the minimum placement coordinates; Find the corresponding other shooting areas from the shooting database based on other placement coordinates; When the minimum shooting area coincides with the other shooting areas, define the other placement coordinates as the first optional placement coordinates and the corresponding matching exhibits as the first optional matching exhibits; Form a first selection option based on the target matching exhibit and the first optional matching exhibits; Output the first selection option instead of directly outputting the target matching exhibit as the current exhibit; When the minimum shooting area does not coincide with the other shooting areas, screen the placement coordinates with the smallest distance to the exhibit and output the target matching exhibit as the current exhibit.

[0013] By adopting the above technical solution, if two exhibits are in one booth and there is no aisle in between, then it is also possible that it is another exhibit at this time, thus generating options for the user to choose. If the two are not in the same booth and the other exhibit has its own shooting area, then only the information of the nearest exhibit is generated, improving the accuracy of exhibit selection.

[0014] Optionally, when the minimum shooting area does not coincide with the other shooting areas, the method of screening the placement coordinates with the smallest distance to the exhibit and outputting the target matching exhibit as the current exhibit includes: Receive other mobile screen coordinates; Determine other occupied ranges based on the other mobile screen coordinates and a preset human body range; Integrate based on the other occupied ranges to obtain the total occupied range; When the other shooting areas are covered by the total occupied range, define the corresponding other placement coordinates as the second optional placement coordinates and the corresponding matching exhibits as the second optional matching exhibits; Form a second selection option based on the target matching exhibit and the second optional matching exhibits; Output the second selection option instead of directly outputting the target matching exhibit as the current exhibit; When there are partial areas of the other shooting areas that do not fall into the total occupied range, screen the placement coordinates with the smallest distance to the exhibit and output the target matching exhibit as the current exhibit.

[0015] By adopting the above technical solution, if the best shooting area of the second booth is occupied, resulting in the current photographer having to shoot within the area where the first exhibit is located, then at this time the second exhibit may also be the corresponding required exhibit, so it should also be regarded as a corresponding option for selection, improving the accuracy of exhibit selection.

[0016] Optionally, it further includes a method for determining whether to define the corresponding matching exhibit as the second optional matching exhibit when other shooting areas are covered by the total occupied range. The method includes: Defining the corresponding other placement coordinates as the expected optional placement coordinates; Determining the intermediate placement coordinates based on the expected optional placement coordinates, the placement coordinates, the moving screen orientation, the moving screen coordinates, and the moving screen shooting angle range; Defining the matching exhibit corresponding to the expected optional placement coordinates as the second optional matching exhibit when the intermediate placement coordinates do not exist or the other shooting area corresponding to the intermediate placement coordinates is covered by the total occupied range; Not defining the matching exhibit corresponding to the expected optional placement coordinates as the second optional matching exhibit when the other shooting area corresponding to the intermediate placement coordinates is not completely covered by the total occupied range.

[0017] By adopting the above technical solution, it is also possible that there is a third exhibit between the second exhibit and the first exhibit. Then, it is entirely possible to shoot the second exhibit within the area of the third exhibit. Therefore, in this case, the second exhibit cannot be the target exhibit of the customer, and then it can be abandoned.

[0018] Optionally, it further includes an information display method when there is no current exhibit when identifying the current image to obtain the current exhibit. The method includes: Receiving the no-exhibit moving screen coordinates and the no-exhibit moving screen orientation when there is no current exhibit; Searching all possible placement coordinates from the placement database; Filtering the possible placement coordinates based on the no-exhibit moving screen orientation, the no-exhibit moving screen coordinates, and the moving screen shooting angle range to obtain the no-exhibit orientation placement coordinates closest to the no-exhibit moving screen coordinates; Searching the corresponding no-exhibit shooting area from the shooting database based on the no-exhibit orientation placement coordinates; Determining the overlapping area based on the no-exhibit shooting area, the no-exhibit moving screen orientation, the no-exhibit moving screen coordinates, and the moving screen shooting angle range; Outputting the matching exhibit corresponding to the no-exhibit orientation placement coordinates as the current exhibit when the overlapping area is completely covered by the total occupied range; Outputting a preset no-exhibit signal when the overlapping area is not completely covered by the total occupied range.

[0019] By adopting the above technical solution, when there is no corresponding exhibit displayed on the screen, it is determined whether it is blocked by a person. If it is blocked by a person in the front, the corresponding exhibit is directly output using the coordinates, improving the intelligence of exhibit display.

[0020] Optionally, the method for determining the overlapping area based on the pinless shooting area, the pinless moving screen orientation, the pinless moving screen coordinates, and the moving screen shooting angle range includes: Determine the area that falls within based on the pinless shooting area, the pinless moving screen coordinates, and the moving screen shooting angle range; Filter the area that falls within based on the pinless moving screen coordinates and the pinless orientation placement coordinates to obtain a partial area that falls within between the pinless moving screen coordinates and the pinless orientation placement coordinates, and output the partial area that falls within as the overlapping area.

[0021] By adopting the above technical solution, even if there are people in the subsequent area, they cannot block the exhibits in the front, so only the display area of the exhibits in the front needs to be judged, improving the judgment efficiency.

[0022] Optionally, it further includes a method for finding and outputting the current exhibit when there is no pinless orientation placement coordinate, and this method includes: When there is no pinless orientation placement coordinate, determine the semi-orientation range based on the pinless moving screen coordinates and the pinless moving screen orientation; Filter the possible placement coordinates based on the pinless moving screen coordinates and the semi-orientation range to obtain the deviation placement coordinate closest to the pinless moving screen coordinates; Find the corresponding deviation shooting area from the shooting database based on the deviation placement coordinate; Determine the deviation overlapping area based on the deviation shooting area, the pinless moving screen coordinates, the semi-orientation range, and the deviation placement coordinate; When the deviation overlapping area is completely covered by the total occupied range, output the matching exhibit corresponding to the deviation placement coordinate as the current exhibit; When the deviation overlapping area is not completely covered by the total occupied range, output a no-exhibit signal.

[0023] By adopting the above technical solution, when the front is blocked by people, there may also be a situation where the exhibit is not aligned, so at this time, it is necessary to consider whether the line of sight of the nearest exhibit is blocked.

[0024] In a second aspect, the present invention provides an information display system based on a mobile screen, adopting the following technical solution: An information display system based on a mobile screen, including: An acquisition module for acquiring the current image, the mobile screen coordinates, and the mobile screen orientation; A memory for storing the program of the control method of the information display method based on the mobile screen as described above; A processor for loading and executing the program in the memory.

[0025] By adopting the above technical solution, image recognition is performed through a mobile screen, and then each person can search for the information they need on their own mobile screen, without having to queue up to view on a public screen, thus improving the efficiency of exhibit display.

[0026] In summary, the present invention includes at least one of the following beneficial technical effects: 1. Image recognition is performed through a mobile screen, and then each person can search for the information they need on their own mobile screen, without having to queue up to view on a public screen, thus improving the efficiency of exhibit display; 2. If two or more exhibits are recognized on a screen, then it is determined which one is selected based on the positions of the exhibits and the person, without the need for manual judgment, making the recognition process more intelligent; 3. When the corresponding exhibit is not displayed on the screen, it is determined whether it is blocked by a person. If it is blocked by a person in front, the corresponding exhibit is directly output using coordinates, improving the intelligence of exhibit display. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 is a flowchart of a method for information display based on a mobile screen in an embodiment of the present application.

[0028] Figure 2 is a flowchart of a method for recognizing a current image to obtain a current exhibit in an embodiment of the present application.

[0029] Figure 3 is a flowchart of a method for calculating the distance between an exhibit based on the coordinates of a mobile screen and the placement coordinates in an embodiment of the present application.

[0030] Figure 4 is a simple schematic diagram of a mobile screen aligning with an exhibit in an embodiment of the present application.

[0031] Figure 5 is a flowchart of a method for determining whether to screen the minimum distance between exhibits and define the corresponding matching exhibit as the target matching exhibit in an embodiment of the present application.

[0032] Figure 6 is a flowchart of a method for screening the placement coordinates with the minimum distance between exhibits and outputting the target matching exhibit as the current exhibit when the minimum shooting area does not overlap with other shooting areas in an embodiment of the present application.

[0033] Figure 7 is a flowchart of a method for determining whether to define the corresponding matching exhibit as the second optional matching exhibit when other shooting areas are covered by the total occupied range in an embodiment of the present application.

[0034] Figure 8It is a flowchart of the information display method when identifying the current image to obtain the current exhibit in the embodiment of the present application and there is no current exhibit.

[0035] Figure 9 It is a flowchart of determining the overlapping area based on the unpinned shooting area, unpinned moving screen orientation, unpinned moving screen coordinates, and moving screen shooting angle range in the embodiment of the present application.

[0036] Figure 10 It is a flowchart of the method for finding and outputting the current exhibit when there is no unpinned orientation placement coordinate in the embodiment of the present application. Detailed implementation manners

[0037] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments.

[0038] An embodiment of the present invention discloses an information display method based on a mobile screen. Refer to Figure 1 , an information display method based on a mobile screen includes: Step 100: In response to a trigger signal set on the mobile screen, collect the current image captured by the mobile screen.

[0039] The trigger signal is a signal for triggering the mobile screen to start executing the information display method. The triggered action can be that the user presses the corresponding button on the mobile screen. Here, the mobile screen can be a smart tablet, for example: IPAD.

[0040] The current image is the image captured by the camera on the mobile screen. Here, a high-definition camera is set on the mobile screen. The collection method is for the camera to take pictures.

[0041] When the user presses the button, the system responds to the trigger signal corresponding to the button, turns on the camera to take pictures, and obtains the current image.

[0042] Step 101: Identify the current image based on the three-dimensional model of the exhibit stored in the preset exhibit database to obtain the current exhibit.

[0043] The current exhibit is the exhibit identified in the captured current image. The three-dimensional model of each exhibit in the exhibition hall is stored in the exhibit database. It is obtained by the staff's three-dimensional drawing of each exhibit before the exhibition. The drawing method can be any three-dimensional model software, for example: SolidWorks. The identification method will be described in subsequent steps and will not be elaborated here.

[0044] Step 102: Based on the current exhibit, find the corresponding exhibit information classification and classification information from the preset information database.

[0045] The exhibit information classification is a category of information about the current exhibit. For example, if the current exhibit is a mobile phone, the exhibit information classification can be: mobile phone size, mobile phone model, internal processor, camera resolution, etc. The classification information is the information corresponding to the exhibit information classification. The mapping relationship of the current exhibit, the exhibit information classification, and the classification information is stored in the database. It is obtained by the staff classifying each piece of information of the exhibit during the process of displaying the exhibit and then recording and storing it. When the system receives the corresponding current exhibit, it automatically searches the database for the corresponding exhibit information classification and classification information and outputs them.

[0046] Step 103: Display the exhibit information classification on the mobile screen, receive the selected classification, and define the classification information corresponding to the selected classification as the selected information.

[0047] The selected classification is one of the classifications selected by the user from the exhibit information classification on the mobile screen. The receiving method is that the corresponding text of the exhibit information classification will be displayed on the mobile screen, and then the user can click it. It should be noted here that the mobile screen is a touch screen.

[0048] Step 104: Display the selected information on the mobile screen.

[0049] Refer to Figure 2 , the method for identifying the current exhibit from the current image includes: Step 200: Determine the angular image based on the three-dimensional model of the exhibit stored in the exhibit database.

[0050] The angular image is an image obtained by taking a picture of the three-dimensional model of the exhibit at a certain angle. Here, it can be obtained by screenshot software, that is, when the three-dimensional model of the exhibit rotates, the three-dimensional model is captured by the screenshot software.

[0051] Step 201: Match the angular images one by one with the current image to obtain the matching exhibits that match successfully.

[0052] The matching exhibit is the exhibit corresponding to the angular image that matches the current image successfully. Here, first the angular image and the current image are matched, and then when the match is successful, the corresponding three-dimensional model of the exhibit is automatically searched, and then the exhibit corresponding to the three-dimensional model of the exhibit is found.

[0053] Step 202: When the number of matching exhibits is 1, output the matching exhibit as the current exhibit.

[0054] If the number of matching exhibits is 1, it means that there is no interference from any other exhibits, so the matching exhibit can be directly output as the current exhibit.

[0055] Step 203: When the number of matching exhibits is greater than or equal to 2, receive the mobile screen coordinates.

[0056] The moving screen coordinates are the location where the moving screen is located, which can be obtained by installing a positioning device on the moving screen, such as a GPS positioning device.

[0057] When the number of matching exhibits is greater than or equal to 2, it indicates that it may be one of the two exhibits at this time.

[0058] Step 204: Based on the matching exhibits, find the corresponding placement coordinates from the preset placement database.

[0059] The placement coordinates are the locations where the matching exhibits are located. The database stores the mapping relationship between the matching exhibits and the placement coordinates. After the staff arranges all the exhibits, the corresponding locations are recorded. When the system receives the matching exhibits, it automatically searches the database for the corresponding placement coordinates and outputs them.

[0060] Step 205: Calculate the exhibit distance based on the moving screen coordinates and the placement coordinates.

[0061] The exhibit distance is the distance between the moving screen and the exhibit. The calculation method is based on the coordinate values of the two coordinates.

[0062] Step 206: Screen the minimum exhibit distance and define the corresponding matching exhibit as the target matching exhibit.

[0063] Step 207: Output the target matching exhibit as the current exhibit.

[0064] Under normal circumstances, people will stand in front of the corresponding exhibit to take pictures, so generally the distance of the required exhibit is the closest.

[0065] Refer to Figure 3 , the method for calculating the exhibit distance based on the moving screen coordinates and the placement coordinates includes: Step 300: Receive the moving screen coordinates and the moving screen orientation at the same time.

[0066] As Figure 4 shown, the rectangular one is the moving screen, and the location where its camera is located is the moving screen coordinates. The circle is the corresponding exhibit, and the coordinates of the center point of the circle are the placement coordinates. Receiving the screen orientation means receiving the orientation of the screen, which here refers to the orientation of the camera. As Figure 4 shown, the middle dotted line is the moving screen orientation. Here, it can be obtained by converting the orientation of the compass installed in the moving screen, that is, the angle between the compass and the vertical direction of the moving screen is how many degrees, then the moving screen orientation is the deviation from the due north direction by how many degrees.

[0067] Step 301: Screen the placement coordinates based on the moving screen orientation, the moving screen coordinates, and the preset moving screen shooting angle range to obtain the orientation placement coordinates.

[0068] The shooting angle range of the mobile screen is the range of the angles captured by the camera on the mobile screen. Here, the angle is restricted due to the mechanical structure. For example Figure 4 As shown, the two dotted lines on the left and right are the shooting angle ranges. The orientation placement coordinates are the placement coordinates that may fall within the image captured by the mobile screen camera. The screening method is as follows Figure 4 As shown, after the mobile screen coordinates are determined, the shooting range in the actual scene is drawn according to the orientation of the mobile screen and the shooting angle range of the mobile screen, and then the placement coordinates falling within the shooting range are screened.

[0069] Step 302: Calculate the distance between the exhibit and the mobile screen based on the mobile screen coordinates and the orientation placement coordinates.

[0070] The calculation method here is similar to that in step 205 and will not be elaborated here.

[0071] Refer to Figure 5 , and it also includes a judgment method for whether to screen the minimum distance between the exhibit and the mobile screen and define the corresponding matching exhibit as the target matching exhibit. The method includes: Step 400: Define the orientation placement coordinate with the minimum distance between the exhibit and the mobile screen as the minimum placement coordinate, and define the other orientation placement coordinates as other placement coordinates.

[0072] Step 401: Based on the minimum placement coordinate, find the corresponding minimum shooting area from the preset shooting database.

[0073] The minimum shooting area is a suitable area for shooting the exhibit corresponding to the minimum placement coordinate. For example Figure 4 As shown, the area between the two rectangles drawn in dotted lines with the minimum placement coordinate as the center point is the minimum shooting area. The mapping relationship between the minimum placement coordinate and the minimum shooting area is stored in the database. It is set by the staff according to the reasonable shooting area when shooting the exhibit, and the corresponding placement coordinate and shooting area are recorded to form a mapping relationship. When the system receives the minimum placement coordinate, it automatically finds the corresponding minimum shooting area from the database for output.

[0074] It should be noted that the width of the shooting area is only the width of one person, that is, there will be no second person on the straight line formed by the exhibit and any one person.

[0075] Step 402: Based on the other placement coordinates, find the corresponding other shooting areas from the shooting database.

[0076] The other shooting areas are suitable areas for shooting the exhibits corresponding to the other placement coordinates. The establishment of the database was introduced in step 401 and will not be elaborated here. When the system receives the other placement coordinates, it automatically finds the other shooting areas from the database for output.

[0077] Step 403: When the minimum shooting area coincides with other shooting areas, define the other placement coordinates as the first optional placement coordinates, and define the corresponding matching exhibits as the first optional matching exhibits.

[0078] When the minimum shooting area coincides with other shooting areas, it means that standing at this position, one can shoot both the exhibits at the minimum placement coordinates and the exhibits corresponding to other placement coordinates. Therefore, it is impossible to determine which is the user's target exhibit.

[0079] Step 404: Form a first selection option based on the target matching exhibit and the first optional matching exhibits.

[0080] The first selection option is an option that can be selected by the user due to the unclear target exhibit. The formation method is to form a table with the target matching exhibit and the first optional matching exhibits in text form and then display it on the screen of the mobile screen.

[0081] Step 405: Output the first selection option instead of directly outputting the target matching exhibit as the current exhibit.

[0082] Since it is not clear which exhibit is the one the end user needs, the first selection option is output instead of only outputting the target matching exhibit.

[0083] Step 406: When the minimum shooting area does not coincide with other shooting areas, filter out the placement coordinates with the smallest distance to the exhibit and output the target matching exhibit as the current exhibit.

[0084] When the minimum shooting area does not coincide with other shooting areas, it means that the images of other exhibits are not taken at reasonable shooting positions but are accidentally taken during the shooting process. Therefore, the target is clear, and the information the user wants is the information of the target matching exhibit. Thus, the target matching exhibit can be output as the current exhibit.

[0085] Refer to Figure 6 When the minimum shooting area does not coincide with other shooting areas, the method of filtering out the placement coordinates with the smallest distance to the exhibit and outputting the target matching exhibit as the current exhibit includes: Step 500: Receive other mobile screen coordinates.

[0086] The other mobile screen coordinates are the coordinates of other mobile screens in the venue except for the mobile screen coordinates. The receiving method is similar to Step 203 and will not be elaborated here.

[0087] Step 501: Determine other occupied ranges based on the other mobile screen coordinates and the preset human body range.

[0088] The human body range is the range occupied by the human body on the horizontal plane. Here, for example, the human body is regarded as a cylinder with a diameter of 50 cm. The other occupied range is the range blocked by the person holding the mobile screen corresponding to the other mobile screen coordinates. The determination method is to draw the human body range with the other mobile screen coordinates as the center point of the human body range.

[0089] Step 502: Integrate based on the other occupied ranges to obtain the total occupied range.

[0090] The total occupied range is the integration of the other occupied ranges.

[0091] Step 503: When the other shooting area is covered by the total occupied range, define the corresponding other placement coordinates as the second optional placement coordinates, and define the corresponding matching exhibit as the second optional matching exhibit.

[0092] When the other shooting area is covered by the total occupied range, it means that the other shooting area is already full of people, and the user of the current mobile screen cannot move there to shoot. Therefore, it is possible that the user can only shoot the matching exhibit corresponding to the other placement coordinates at the current position, so the second optional matching exhibit is formed.

[0093] Step 504: Form the second selection option based on the target matching exhibit and the second optional matching exhibit.

[0094] The second selection option is an option that can be selected by the user due to the unclear target exhibit. The formation method is similar to step 404 and will not be elaborated here.

[0095] Step 505: Output the second selection option instead of directly outputting the target matching exhibit as the current exhibit.

[0096] Step 506: When there are partial areas in the other shooting areas that do not fall into the total occupied range, screen the placement coordinates with the smallest distance to the exhibit and output the target matching exhibit as the current exhibit.

[0097] When there are partial areas in the other shooting areas that do not fall into the total occupied range, it means that there are still areas in the other shooting areas where the exhibits corresponding to the other placement coordinates can be photographed. If you want to photograph the exhibits corresponding to the other placement coordinates, you can completely move to that area to shoot. Therefore, the exhibits corresponding to the other placement coordinates are not the exhibits that the user wants to shoot. Then screen the placement coordinates with the smallest distance to the exhibit and output the target matching exhibit as the current exhibit.

[0098] Refer to Figure 7 , and also includes a method for determining whether to define the corresponding matching exhibit as the second optional matching exhibit when the other shooting area is covered by the total occupied range. The method includes: Step 600: Define the corresponding other placement coordinates as the expected optional placement coordinates.

[0099] The corresponding other placement coordinates here are the areas of other shooting regions covered by the total occupied range.

[0100] Step 601: Determine the intermediate placement coordinates based on the expected optional placement coordinates, the placement coordinates, the moving screen orientation, the moving screen coordinates, and the moving screen shooting angle range.

[0101] The intermediate placement coordinates are the placement coordinates between the expected optional placement coordinates and the placement coordinates. The determination method is as follows Figure 4 As shown, first determine the orientation placement coordinates according to Step 301, and then form two circles with the distances between the moving screen coordinates and the placement coordinates, and between the moving screen coordinates and the expected optional placement coordinates as the diameters of the circles. The orientation placement coordinates that fall between the two circles are the intermediate placement coordinates.

[0102] Step 602: Define the matching exhibit corresponding to the expected optional placement coordinates as the second optional matching exhibit when the intermediate placement coordinates do not exist or the other shooting region corresponding to the intermediate placement coordinates is covered by the total occupied range.

[0103] If the intermediate placement coordinates do not exist, it means that the other shooting region corresponding to the expected optional placement coordinates is covered by the total occupied range, and the placement coordinates are the positions of the nearest exhibits. Therefore, it is reasonable to shoot within the range corresponding to the placement coordinates, and the matching exhibit corresponding to the expected optional placement coordinates is defined as the second optional matching exhibit.

[0104] When the other shooting region corresponding to the intermediate placement coordinates is covered by the total occupied range, it means that the shooting region corresponding to the intermediate placement coordinates is also occupied by people. Therefore, the matching exhibit corresponding to the expected optional placement coordinates is defined as the second optional matching exhibit.

[0105] Step 603: Do not define the matching exhibit corresponding to the expected optional placement coordinates as the second optional matching exhibit when the other shooting region corresponding to the intermediate placement coordinates is not completely covered by the total occupied range.

[0106] When the other shooting region corresponding to the intermediate placement coordinates is not completely covered by the total occupied range, it means that it is completely possible to shoot the exhibit corresponding to the expected optional placement coordinates within the other shooting region corresponding to the intermediate placement coordinates, which is closer to the matching exhibit corresponding to the expected optional placement coordinates. Therefore, the matching exhibit corresponding to the expected optional placement coordinates is not the user's target exhibit, and the matching exhibit corresponding to the expected optional placement coordinates is not defined as the second optional matching exhibit.

[0107] Refer to Figure 8, also includes an information display method when identifying the current image to obtain the current exhibit and there is no current exhibit. The method includes: Step 700: Receive the coordinate and orientation of the screen without an exhibit when there is no current exhibit.

[0108] The coordinate of the screen without an exhibit is the coordinate of the moving screen that has obtained the current image but cannot identify the current exhibit. The orientation of the screen without an exhibit is the orientation of the moving screen corresponding to the coordinate of the screen without an exhibit.

[0109] Step 701: Find all possible placement coordinates from the placement database.

[0110] The possible placement coordinates are the coordinates of all exhibits entered in the placement database.

[0111] Step 702: Screen the possible placement coordinates based on the orientation of the screen without an exhibit, the coordinate of the screen without an exhibit, and the shooting angle range of the moving screen to obtain the placement coordinates without an exhibit orientation that is closest to the coordinate of the screen without an exhibit.

[0112] The placement coordinates without an exhibit orientation are the possible placement coordinates that are closest to the coordinate of the screen without an exhibit. The determination method is to first determine the shooting range according to Step 301, then screen the possible placement coordinates that fall within the range, and then calculate the distances between the coordinate of the screen without an exhibit and the possible placement coordinates that fall within the range respectively. The one with the smallest distance is the placement coordinates without an exhibit orientation.

[0113] Step 703: Find the corresponding shooting area without an exhibit from the shooting database based on the placement coordinates without an exhibit orientation.

[0114] The shooting area without an exhibit is the appropriate shooting area for the exhibit corresponding to the placement coordinates without an exhibit orientation. The establishment of the database was introduced in Step 401 and will not be elaborated here. When the system receives the placement coordinates without an exhibit orientation, it automatically finds and outputs the shooting area without an exhibit from the database.

[0115] Step 704: Determine the overlapping area based on the shooting area without an exhibit, the orientation of the screen without an exhibit, the coordinate of the screen without an exhibit, and the shooting angle range of the moving screen.

[0116] The overlapping area is the area where the shooting area without an exhibit and the shooting range of the moving screen overlap. Here, first determine the shooting range of the moving screen according to the coordinate of the screen without an exhibit, the orientation of the screen without an exhibit, and the shooting angle range of the moving screen, and then place the two in the same coordinate system. The area where the coordinates overlap is the overlapping area.

[0117] Step 705: When the overlapping area is completely covered by the total occupied range, output the matching exhibit corresponding to the placement coordinates without an exhibit orientation as the current exhibit.

[0118] When the overlapping area is completely covered by the total occupied range, it indicates that although the button for the trigger signal is pressed, the exhibit is completely blocked in the direction of the camera shooting, so the determination of the exhibit cannot be carried out. In order for the user to still be able to read the information of the exhibit when it is blocked, the matching exhibit corresponding to the coordinate of the exhibit orientation without exhibit is directly output as the current exhibit.

[0119] Step 706: When the overlapping area is not completely covered by the total occupied range, output a preset signal indicating no exhibit.

[0120] The signal indicating no exhibit is a signal that the exhibit cannot be recognized or there is no exhibit. The output method can be a text output method.

[0121] When the overlapping area is not completely covered by the total occupied range, it means that the user can completely capture the corresponding exhibit, even without entering the area for shooting without exhibit corresponding to the coordinate of the exhibit orientation without exhibit. Therefore, a signal indicating no exhibit is output.

[0122] Refer to Figure 9 , the method for determining the overlapping area based on the area for shooting without exhibit, the orientation of the screen without exhibit, the coordinate of the screen without exhibit, and the range of the shooting angle of the screen includes: Step 800: Determine the falling area based on the area for shooting without exhibit, the coordinate of the screen without exhibit, and the range of the shooting angle of the screen.

[0123] The falling area is the area captured by the camera corresponding to the coordinate of the screen without exhibit. The determination method was introduced in step 401 and will not be elaborated here.

[0124] Step 801: Screen the falling area based on the coordinate of the screen without exhibit and the coordinate of the exhibit orientation without exhibit to obtain a partial falling area located between the coordinate of the screen without exhibit and the coordinate of the exhibit orientation without exhibit, and output the partial falling area as the overlapping area.

[0125] The partial falling area is the area located between the coordinate of the screen without exhibit and the coordinate of the exhibit orientation without exhibit. Here, a circle is formed with the distance between the coordinate of the screen without exhibit and the coordinate of the exhibit orientation without exhibit as the diameter of the circle, and then the area falling within the circle is the partial falling area.

[0126] Even if there are people in the area behind the coordinate of the exhibit orientation without exhibit, they cannot block the exhibit in the front. Therefore, only the display area of the exhibit in the front needs to be judged, which improves the judgment efficiency.

[0127] Refer to Figure 10 , it also includes a method for finding and outputting the current exhibit when there is no coordinate of the exhibit orientation without exhibit. This method includes: Step 900: When there is no coordinate of the exhibit orientation without exhibit, determine the semi-orientation range based on the coordinate of the screen without exhibit and the orientation of the screen without exhibit.

[0128] The semi-orientation range is the range of the semi-circular angle corresponding to the orientation of the fretless moving screen. Here, based on the coordinates of the fretless moving screen, the ray corresponding to the orientation of the fretless moving screen is determined, and then the angles of 90° clockwise and counterclockwise are integrated to obtain the semi-orientation range.

[0129] When there is no fretless orientation placement coordinate, it indicates that the exhibit is not aligned at this time. However, it is also possible that it is not aligned because someone is blocking in front, so further analysis is required.

[0130] Step 901: Screen the possible placement coordinates based on the coordinates of the fretless moving screen and the semi-orientation range to obtain the deviation placement coordinates that are closest to the coordinates of the fretless moving screen.

[0131] The deviation placement coordinates are the possible placement coordinates that are closest to the coordinates of the fretless moving screen. The screening method is similar to that of step 702, except that the orientation range is different.

[0132] Step 902: Find the corresponding deviation shooting area from the shooting database based on the deviation placement coordinates.

[0133] The deviation shooting area is the appropriate shooting area of the exhibit corresponding to the deviation placement coordinates.

[0134] Step 903: Determine the deviation coincidence area based on the deviation shooting area, the coordinates of the fretless moving screen, the semi-orientation range, and the deviation placement coordinates.

[0135] The deviation coincidence area is the area where the deviation shooting area and the shooting range of the moving screen overlap. The determination method is similar to that of step 704 and will not be elaborated here.

[0136] Step 904: When the deviation coincidence area is completely covered by the total occupied range, output the matching exhibit corresponding to the deviation placement coordinates as the current exhibit.

[0137] When the deviation coincidence area is completely covered by the total occupied range, it is very likely that it is blocked by others and not aligned. Then, output the matching exhibit corresponding to the deviation placement coordinates as the current exhibit.

[0138] In addition, when there are fretless orientation placement coordinates, the method of steps 900 - 904 can also be used to determine whether the matching exhibit corresponding to the deviation placement coordinates may also be the target exhibit, so as to generate options for the user to select.

[0139] Step 905: When the deviation coincidence area is not completely covered by the total occupied range, output a no-exhibit signal.

[0140] When the deviation coincidence area is not completely covered by the total occupied range, it indicates that the user can definitely see the matching exhibit corresponding to the deviation placement coordinate. Then, the matching exhibit corresponding to the deviation placement coordinate is excluded, so a no-exhibit signal is output.

[0141] Based on the same inventive concept, an embodiment of the present invention provides an information display system based on a mobile screen.

[0142] An information display system based on a mobile screen includes: An acquisition module for acquiring a current image, a mobile screen coordinate, and a mobile screen orientation; A memory for storing a program of a control method for an information display method based on a mobile screen; A processor for loading and executing the program in the memory.

[0143] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the above division of each functional module is used as an example. In actual applications, the above functions can be allocated to different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working processes of the above-described system, device, and unit can refer to the corresponding processes in the foregoing method embodiments and will not be elaborated here.

[0144] The above is only a preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above embodiments. All technical solutions falling within the idea of the present invention belong to the protection scope of the present invention. It should be noted that for those of ordinary skill in the art, several improvements and refinements made without departing from the principle of the present invention should also be regarded as the protection scope of the present invention.

Claims

1. An information display method based on a mobile screen, characterized in that, Including: In response to a trigger signal set on the mobile screen, acquiring a current image captured by the mobile screen; Identifying the current image based on the three-dimensional model of the exhibit stored in the preset exhibit database to obtain the current exhibit; Finding the corresponding exhibit information classification and classification information from the preset information database based on the current exhibit; Displaying the exhibit information classification on the mobile screen, receiving the selected classification, and defining the classification information corresponding to the selected classification as the selected information; Displaying the selected information on the mobile screen; Among them, the method for identifying the current image to obtain the current exhibit includes: Determining an angular image based on the three-dimensional model of the exhibit stored in the exhibit database; Matching the angular images with the current image one by one to obtain a matching exhibit with successful matching; When the number of the matching exhibits is 1, outputting the matching exhibit as the current exhibit; When the number of the matching exhibits is greater than or equal to 2, receiving the mobile screen coordinates; Finding the corresponding placement coordinates from the preset placement database based on the matching exhibits; Calculating the exhibit distance based on the mobile screen coordinates and the placement coordinates; Selecting the smallest exhibit distance and defining the corresponding matching exhibit as the target matching exhibit; Outputting the target matching exhibit as the current exhibit; Among them, the method for calculating the exhibit distance based on the mobile screen coordinates and the placement coordinates includes: Receiving the mobile screen orientation while receiving the mobile screen coordinates; Screening the placement coordinates based on the mobile screen orientation, the mobile screen coordinates, and the preset mobile screen shooting angle range to obtain the orientation placement coordinates; Calculating the exhibit distance based on the mobile screen coordinates and the orientation placement coordinates.

2. The information display method based on a mobile screen according to claim 1, wherein It also includes a judgment method for whether to select the smallest exhibit distance and define the corresponding matching exhibit as the target matching exhibit. This method includes: Defining the orientation placement coordinate with the smallest exhibit distance as the minimum placement coordinate, and defining the other orientation placement coordinates as other placement coordinates; Finding the corresponding minimum shooting area from the preset shooting database based on the minimum placement coordinate; Finding the corresponding other shooting areas from the shooting database based on the other placement coordinates; When the minimum shooting area and the other shooting areas overlap, defining the other placement coordinates as the first optional placement coordinates, and defining the corresponding matching exhibits as the first optional matching exhibits; Forming a first selection option based on the target matching exhibit and the first optional matching exhibit; Outputting the first selection option without directly outputting the target matching exhibit as the current exhibit; When the minimum shooting area and the other shooting areas do not overlap, screening the placement coordinate with the smallest exhibit distance and outputting the target matching exhibit as the current exhibit.

3. The information display method based on a mobile screen according to claim 2, wherein When the minimum shooting area and the other shooting areas do not overlap, the method for screening the placement coordinate with the smallest exhibit distance and outputting the target matching exhibit as the current exhibit includes: Receiving other mobile screen coordinates; Determine other occupied ranges based on the other mobile screen coordinates and a preset human body range; Integrate based on the other occupied ranges to obtain a total occupied range; When the other shooting area is covered by the total occupied range, define the corresponding other placement coordinates as second optional placement coordinates, and define the corresponding matching exhibit as a second optional matching exhibit; Form a second selection option based on the target matching exhibit and the second optional matching exhibit; Output the second selection option, rather than directly outputting the target matching exhibit as the current exhibit; When there are partial areas in the other shooting areas that do not fall within the total occupied range, screen the placement coordinates with the smallest distance to the exhibit and output the target matching exhibit as the current exhibit.

4. The information display method based on a mobile screen according to claim 3, wherein It also includes a method for determining whether to define the corresponding matching exhibit as a second optional matching exhibit when the other shooting area is covered by the total occupied range. The method includes: Define the corresponding other placement coordinates as expected optional placement coordinates; Determine intermediate placement coordinates based on the expected optional placement coordinates, the placement coordinates, the mobile screen orientation, the mobile screen coordinates, and the mobile screen shooting angle range; When the intermediate placement coordinates do not exist or the other shooting area corresponding to the intermediate placement coordinates is covered by the total occupied range, define the matching exhibit corresponding to the expected optional placement coordinates as a second optional matching exhibit; When the other shooting area corresponding to the intermediate placement coordinates is not completely covered by the total occupied range, do not define the matching exhibit corresponding to the expected optional placement coordinates as a second optional matching exhibit.

5. The information display method based on a mobile screen according to claim 3, wherein It also includes an information display method when there is no current exhibit when identifying the current image to obtain the current exhibit. The method includes: Receive no-exhibit mobile screen coordinates and no-exhibit mobile screen orientation when there is no current exhibit; Find all possible placement coordinates from the placement database; Screen the possible placement coordinates based on the no-exhibit mobile screen orientation, the no-exhibit mobile screen coordinates, and the mobile screen shooting angle range to obtain no-exhibit orientation placement coordinates closest to the no-exhibit mobile screen coordinates; Find the corresponding no-exhibit shooting area from the shooting database based on the no-exhibit orientation placement coordinates; Determine the overlapping area based on the no-exhibit shooting area, the no-exhibit mobile screen coordinates, and the mobile screen shooting angle range; When the overlapping area is completely covered by the total occupied range, output the matching exhibit corresponding to the no-exhibit orientation placement coordinates as the current exhibit; When the overlapping area is not completely covered by the total occupied range, output a preset no-exhibit signal.

6. The information display method based on a mobile screen according to claim 5, wherein, The method for determining the overlapping area based on the no-exhibit shooting area, the no-exhibit mobile screen coordinates, and the mobile screen shooting angle range includes: Determine the falling area based on the no-exhibit shooting area, the no-exhibit mobile screen coordinates, and the mobile screen shooting angle range; Based on the fretless moving screen coordinates and the fretless orientation placement coordinates, screen the falling area to obtain a partial falling area located between the fretless moving screen coordinates and the fretless orientation placement coordinates, and output the partial falling area as the overlapping area.

7. A method for information display based on a mobile screen according to claim 6, characterized in that, It further includes a method for finding and outputting the current exhibit when there is no fretless orientation placement coordinate. The method includes: When there is no fretless orientation placement coordinate, determine a semi-orientation range based on the fretless moving screen coordinates and the fretless moving screen orientation; Based on the fretless moving screen coordinates and the semi-orientation range, screen the possible placement coordinates to obtain a deviation placement coordinate closest to the fretless moving screen coordinates; Based on the deviation placement coordinate, find a corresponding deviation shooting area from the shooting database; Based on the deviation shooting area, the fretless moving screen coordinates, the semi-orientation range, and the deviation placement coordinate, determine a deviation overlapping area; When the deviation overlapping area is completely covered by the total occupied range, output the matching exhibit corresponding to the deviation placement coordinate as the current exhibit; When the deviation overlapping area is not completely covered by the total occupied range, output the no-exhibit signal.

8. An information display system based on a mobile screen, characterized in that, It includes: A receiving module for receiving a current image, moving screen coordinates, and moving screen orientation; A memory for storing a program of the control method of the information display method based on the moving screen according to any one of claims 1 to 7; A processor for loading and executing the program in the memory.

Images