A schedule display method, a schedule display device, and a storage medium
By constructing and displaying a three-dimensional model based on agenda information, the problem of intuition in the current technology of schedule viewing is solved, personalized and intuitive schedule information display is realized, and user experience is improved.
Patent Information
- Application Number
- CN202310462253.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-04-21
- Publication Date
- 2025-05-27
- Estimated Expiration
- 2043-04-21
AI Technical Summary
The agenda viewing method in the existing technology is not intuitive enough, and it requires text extraction and analysis to achieve clear interpretation, which is difficult to meet the experience needs of different users.
By obtaining schedule information, building a three-dimensional model, and determining the display position of the three-dimensional model based on the schedule position and the current position, the three-dimensional model that meets the display conditions is displayed in the three-dimensional space.
It realizes personalized display of schedule information, allowing users to intuitively view schedule information, and improves the fun and convenience of schedule information display.
Smart Images

Figure CN116600045B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer vision technology, and in particular to a schedule display method, a schedule display device, and a storage medium. Background Art
[0002] Augmented Reality (AR) is a technology that cleverly integrates virtual information with the real world. It widely uses a variety of technical means such as multimedia, 3D modeling, real-time tracking and registration, intelligent interaction, and sensing. AR simulates computer-generated text, images, 3D models, music, and videos, and applies them to the real world, so that the two types of information complement each other, thereby achieving "enhancement" of the real world.
[0003] Augmented reality technology has been developed for many years. We hope that one day we can use this technology in daily life and work to provide convenience in life and improve work efficiency. At present, many work scenarios have emerged. With the advancement of technology, there are also global positioning methods based on multi-sensor fusion such as visual high-precision maps and signal positioning. Various science fiction concepts such as digital twins and parallel worlds are gradually becoming possible.
[0004] However, most of the existing methods for viewing schedules remain at the ordinary display mode, resulting in the existing schedule viewing method being not intuitive enough and requiring text extraction, analysis, etc. to achieve a clear interpretation state, which is difficult to meet the experience needs of different users. Summary of the invention
[0005] In order to solve the above technical problems existing in the prior art, the present application provides a schedule display method, a schedule display device and a storage medium.
[0006] To solve the above problems, the present application provides a schedule display method, which includes: obtaining schedule information, wherein the schedule information includes character information and / or event information; constructing a three-dimensional model based on the character information and / or event information; determining the display position of the three-dimensional model corresponding to the schedule information in the three-dimensional space based on the schedule position and current position of the schedule information; and displaying the three-dimensional model whose display position meets the display conditions in the three-dimensional space.
[0007] In one embodiment, determining the display position of the three-dimensional model corresponding to the schedule information in the three-dimensional space based on the schedule position and the current position of the schedule information includes: mapping the current position and the schedule position into a geographic coordinate system respectively to obtain the first coordinate of the schedule position in the geographic coordinate system and the second coordinate of the current position in the geographic coordinate system; determining the relative position relationship between the current position and the schedule position based on the relative position between the first coordinate and the second coordinate in the geographic coordinate system; and determining the display position of the three-dimensional model corresponding to the schedule information in the three-dimensional space based on the relative position relationship.
[0008] In one embodiment, displaying the three-dimensional model whose display position meets the display conditions in the three-dimensional space includes: determining a current display space in the three-dimensional space based on the current position and the current display direction; mapping the direction area indicated by the current display space into the geographic coordinate system to obtain the coordinate area of the direction area in the geographic coordinate system; and displaying the three-dimensional model whose first coordinate is within the coordinate area in the current display space.
[0009] In one embodiment, after displaying the three-dimensional model whose first coordinate is within the coordinate area in the current display space, the method includes: obtaining a next display direction, where the next display direction is different from the current display direction; updating the display conditions of the three-dimensional space based on the next display direction and the current position; and displaying the three-dimensional model whose display position meets the updated display conditions in the three-dimensional space.
[0010] In one embodiment, after displaying the three-dimensional model whose first coordinate is within the coordinate area in the current display space, the method includes: calculating the relative distance value between the schedule position corresponding to each three-dimensional model displayed in the current display space and the current position respectively based on the first coordinate of each schedule position and the second coordinate; and arranging and displaying each three-dimensional model displayed in the current display space in ascending or descending order of the values of the relative distance values.
[0011] In one embodiment, displaying the three-dimensional model whose first coordinate is within the coordinate area in the current display space includes: determining a target three-dimensional model, where the first coordinate of the target three-dimensional model is outside the coordinate area; determining a target display direction based on the current position and the first coordinate of the target three-dimensional model; and determining prompt information for guiding a target object to change from the current display direction to the target display direction based on the target display direction and the current display direction.
[0012] In one embodiment, constructing a three-dimensional model based on the person information and / or event information includes: determining the age of the person in the person information who is scheduled; selecting a corresponding preset three-dimensional model based on the age of the scheduled person, where different preset three-dimensional models correspond to different age ranges.
[0013] In one embodiment, constructing a three-dimensional model based on the person information and / or event information includes: determining the scheduled time in the event information; adjusting a status display flag of the three-dimensional model in the three-dimensional space based on the current time and the scheduled time, where the status display flag is used to indicate a display status of the three-dimensional model in the three-dimensional space.
[0014] In one embodiment, adjusting the status display flag of the three-dimensional model in the three-dimensional space based on the current time and the scheduled time includes: calculating a time difference between the current time and the scheduled time; comparing the time difference with a preset difference threshold to obtain a difference comparison result; adjusting the status display flag of the three-dimensional model in the three-dimensional space based on the difference comparison result.
[0015] To solve the technical problems existing in the prior art, the present application provides a schedule display device, which includes: a processor and a memory, where a computer program is stored in the memory, and the processor is configured to execute the computer program to implement the above method.
[0016] To solve the technical problems existing in the prior art, the present application provides a computer-readable storage medium, which stores program instructions, and when the program instructions are executed by a processor, the above method is implemented.
[0017] Compared with the prior art, the schedule display method of the present application includes: obtaining schedule information, where the schedule information includes person information and / or event information; constructing a three-dimensional model based on the person information and / or event information; determining a display position of the three-dimensional model corresponding to the schedule information in the three-dimensional space based on the schedule position of the schedule information and the current position; and displaying the three-dimensional models whose display positions meet the display conditions in the three-dimensional space. Through the above implementation manner, constructing a three-dimensional model based on the person information and / or event information in the schedule information can make the display of the schedule information more personalized; at the same time, positioning the three-dimensional model at a specific position in the three-dimensional space according to the schedule position and the current position in the schedule information, and only displaying the three-dimensional models that meet the display conditions, so that the schedule information can be intuitively viewed, and the interest of the schedule information display is improved.
[0018] It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and do not limit the present application. Brief Description of the Drawings
[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required to be used in the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.
[0020] Figure 1 is a schematic flowchart of an embodiment of the schedule display method provided by the present application;
[0021] Figure 2 is Figure 1 a schematic flowchart of an embodiment of step S103 in
[0022] Figure 3 is Figure 1 a schematic flowchart of an embodiment of step S104 in
[0023] Figure 4 is Figure 3 a schematic flowchart of an embodiment of step S303 shown in
[0024] Figure 5 is a schematic structural diagram of an embodiment of the schedule display device provided by the present application;
[0025] Figure 6 is a schematic structural diagram of an embodiment of the schedule display device of the present application;
[0026] Figure 7 Schematic structural diagram of an embodiment of the computer storage medium of the present application. Detailed Embodiments
[0027] The following will further describe the present application in detail in conjunction with the drawings and embodiments. It should be specifically noted that the following embodiments are only used to illustrate the present application, but do not limit the scope of the present application. Similarly, the following embodiments are only some embodiments of the present application rather than all embodiments. All other embodiments obtained by those of ordinary skill in the art without creative efforts belong to the scope protected by the present application.
[0028] References to "embodiments" in this specification mean that specific features, structures, or characteristics described in connection with the embodiments can be included in at least one embodiment of the present application. The phrase appears in various places in the specification and does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art will explicitly and implicitly understand that the embodiments described herein can be combined with other embodiments.
[0029] In the description of the present application, it should be noted that, unless otherwise clearly specified and limited, the terms "mounted", "arranged", "connected", and "coupled" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be directly connected or indirectly connected through an intermediate medium. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood according to specific circumstances.
[0030] The present disclosure relates to the field of augmented reality. By acquiring the image information of a target object in a real environment, and then using various vision-related algorithms to detect or recognize the relevant features, states, and attributes of the target object, an AR effect combining virtual and real that matches a specific application can be obtained. Exemplarily, the target object can involve the face, limbs, gestures, actions, etc. related to the human body, or identification markers, landmarks related to objects, or sand tables, display areas, or display items related to venues or places. The vision-related algorithms can involve visual positioning, SLAM, three-dimensional reconstruction, image registration, background segmentation, key point extraction and tracking of objects, pose or depth detection of objects, etc. The specific applications can not only involve interaction scenarios such as guiding, navigation, explanation, reconstruction, virtual effect overlay display, etc. related to real scenes or items, but also involve special effect processing related to people, such as makeup beautification, limb beautification, special effect display, virtual model display, etc.
[0031] The detection or recognition processing of the relevant features, states, and attributes of the target object can be achieved through a convolutional neural network. The above convolutional neural network is a network model obtained by training a model based on a deep learning framework.
[0032] Based on the above technical foundation, the present application provides a schedule display method. Refer to Figure 1 , Figure 1 which is a schematic flowchart of an embodiment of the schedule display method provided by the present application. Specifically, it can include the following steps S101 to step S104.
[0033] Step S101: Obtain schedule information, where the schedule information includes person information and / or event information.
[0034] Schedule information can be used to remind users to arrange things they plan to do. When the relevant information in the schedule information meets the preset conditions, the user can be prompted to perform relevant work by pushing messages. Exemplarily, taking a mobile terminal with a schedule function as an example, when the mobile terminal detects that the user clicks the icon of the calendar application, an interface for creating schedule information can be displayed. In the interface for creating schedule information, the user can create schedule information. For example, the user can enter the title of the schedule event, set the start time and end time of the schedule, set the time for schedule notification, set whether to enable all-day events, whether to enable alarm reminders, and set whether the schedule repeats, etc. Exemplarily, the title of the schedule created by the user can be "Party", the start time of this schedule can be 8:50 am, the end time can be 9:50 am, this schedule can be a one-time event, the time for schedule notification can be set to 10 minutes before the start time, the schedule is not set as an all-day event, and no alarm reminder is set. Among them, the notification time of the schedule is the time point when the mobile terminal notifies the schedule. Exemplarily, when the mobile terminal detects that the preset time point (notification time) of 8:40 for this "Party" schedule arrives, a notification message for this schedule is pushed on the mobile terminal interface. Among them, the notification messages of the schedule and the notification messages of applications such as text messages, WeChat, and Weibo are in a similar manner and will not be elaborated here.
[0035] The schedule information includes person information, and the person information may include identity data of the users participating in the schedule. For example, the identity data includes data such as the user's name, ethnicity, gender, age, address, occupation, etc. One or more person information may be included in the same schedule information. Exemplarily, when the theme of the schedule information is a meeting, the person information in the schedule information may include multiple speakers of the meeting, and each person information has its own identity data.
[0036] The schedule information includes event information, and the event information may include the time set for the schedule, the theme of the schedule, etc. Exemplarily, the theme of the schedule information is "Shopping", the start time of this schedule is 10:50 am, and the time for schedule notification can be set to 10 minutes before the start time.
[0037] Step S102: Construct a three-dimensional model based on the person information and / or event information.
[0038] After determining the person information and / or event information in the schedule information, a three-dimensional model corresponding to each schedule information can be constructed based on the person information and / or event information, thereby enabling personalized display of the schedule information.
[0039] In one embodiment, the step of constructing a three-dimensional model based on person information and / or event information (step S102) includes: determining the age of the person in the person information who is scheduled; based on the age of the person who is scheduled, selecting a corresponding preset three-dimensional model, where different preset three-dimensional models correspond to different age ranges.
[0040] The person information may include the age of the person who is scheduled. Exemplarily, the schedule information includes the user's identity data. For example, the identity data includes the user's name, ethnicity, gender, age, address, occupation, and other data. In some embodiments, the schedule information includes other identity data such as the name of the person participating in the schedule, and the age of the person who is scheduled corresponding to it can be found from the database through the existing identity data; in some embodiments, the age of the person who is scheduled input by the user can be obtained during the process of creating the schedule information.
[0041] After determining the age of the person who is scheduled, a preset three-dimensional model corresponding to the age of the person can be selected based on the age of the person, so as to achieve the purpose of creating three-dimensional models corresponding to different schedule information according to different ages of the user. Among them, different preset three-dimensional models correspond to different age ranges. Exemplarily, the age of the person can be divided into six age ranges: 0 - 6 years old is the infant and toddler age range, 7 - 12 years old is the children's age range, 13 - 17 years old is the adolescent age range, 18 - 45 years old is the young age range, 46 - 69 years old is the middle-aged age range, and 69 years old and above is the elderly age range. Each age range is configured with a different preset three-dimensional model. When it is recognized that the age of the person who is scheduled is 16 years old, the preset three-dimensional model corresponding to the adolescent age range is selected as the three-dimensional model of the schedule information.
[0042] In another embodiment, the step of constructing a three-dimensional model based on person information and / or event information (step S102) includes: determining the schedule time in the event information; based on the current time and the schedule time, adjusting the status display flag of the three-dimensional model in the three-dimensional space, where the status display flag is used to indicate the display status of the three-dimensional model in the three-dimensional space.
[0043] The event information may include the schedule time, where the schedule time can be the start time of the schedule or the notification time of the schedule. Exemplarily, the start time of the schedule created by the user can be 8:50 am, and the end time can be 9:50 am. The notification time of this schedule can be set to 10 minutes before the start time. At this time, the schedule time determined based on the event information can include the start time of the schedule (8:50 am) or the notification time of the schedule (8:40 am).
[0044] The current time is the time when the user views the schedule information. For example, if the current time and the schedule time are both Beijing time, after obtaining the schedule time and the current time, the status display mark of the 3D model in the 3D space can be adjusted based on the current time and the schedule time. The status display mark may include the color of the 3D model, the size of the 3D model, the shape of the 3D model, etc.
[0045] Specifically, based on the current time and the schedule time, the steps of adjusting the display status of the three-dimensional model in the three-dimensional space include: calculating the time difference between the current time and the schedule time; comparing the time difference with a preset difference threshold to obtain a difference comparison result; and adjusting the status display mark of the three-dimensional model in the three-dimensional space based on the difference comparison result.
[0046] Schedule information is mainly used to remind users to arrange what they plan to do. If the current time is close to the schedule time in the schedule information, it means that the things planned in the schedule information are more urgent. At this time, the status display mark of the three-dimensional model can be adjusted to display the urgency of the schedule information through different status display marks. Specifically, the urgency of the schedule information can be obtained by calculating the time difference between the current time and the schedule time, so as to adjust the status display mark of the three-dimensional model according to the time difference. Among them, the preset difference threshold may include multiple difference segments, each difference segment corresponds to a different display size and / or display color. After the time difference is obtained, the status display mark of the three-dimensional model can be adjusted according to the display size and / or display color corresponding to a certain difference segment based on the time difference being in a certain difference segment of the multiple difference segments. Exemplarily, the preset difference threshold includes four difference segments, the first difference segment is 0-15 minutes, the second difference segment is 15-30 minutes, the third difference segment is 30-60 minutes, and the fourth difference segment is more than 60 minutes, and when the status display mark includes a display color, the color corresponding to the first difference segment can be red, the color corresponding to the second difference segment can be orange, the color corresponding to the third difference segment can be yellow, and the color corresponding to the fourth difference segment can be white; and when the status display mark includes a display size, the size corresponding to the first difference segment to the size corresponding to the fourth difference segment gradually decreases. As a result, when viewing the schedule information, it is convenient for the user to more intuitively judge the urgency of the schedule information according to the different status display marks of the schedule information, so as to improve the convenience of consulting the schedule information.
[0047] Step S103: Based on the schedule position of the schedule information and the current position, determine the display position of the three-dimensional model corresponding to the schedule information in the three-dimensional space.
[0048] The three-dimensional space can be constructed based on pictures taken of the actual environment. Among them, the number of pictures taken is greater than 1. For example, it can be 10, 20, 50, etc. The more pictures there are, the more accurate the constructed three-dimensional space will be. However, relatively speaking, the time required to construct the three-dimensional space will be more. The schedule information can include the schedule location, and the schedule location can include actual place names or geographical coordinates, etc. For example, the schedule location includes Beijing, Shanghai, Guangzhou, etc.; or the schedule location is represented by geographical coordinates similar to 40 degrees north latitude and 116 degrees east longitude.
[0049] The current location can be the location information of the point where the user is currently located. The user can hold a display device and obtain the user's current location by obtaining the current location information of the display device. The display device can be any electronic device that supports the AR function, including but not limited to AR glasses, tablets, smartphones, etc. Exemplarily, presenting an AR effect on the display device can be understood as showing virtual objects integrated into the real scene on the display device. It can be directly rendering the presentation content of the virtual object and integrating it with the real scene, or after integrating the presentation content of the virtual object with the real scene picture, showing the integrated display picture. In this embodiment, the display device can be a display device such as a mobile terminal.
[0050] The current location acquisition method can receive the current location transmitted by a positioning device. Exemplarily, the positioning device can be a satellite positioning device, an inertial positioning device, or a combination of both; the satellite positioning device can be a device based on the Global Positioning System, the Galileo satellite positioning system, the GLONASS satellite positioning system, or the Beidou positioning system.
[0051] The three-dimensional space can be a virtual space centered on the user. After determining the schedule location and the current location, the relative position relationship between the schedule location and the current location can be obtained, and then the display position of the three-dimensional model corresponding to the schedule information in the three-dimensional space is based on the relative position relationship between the schedule location and the current location. Exemplarily, when the schedule location is due north of the current location, the three-dimensional model corresponding to the schedule information can be placed at the display position due north in the three-dimensional space.
[0052] Step S104: Display the three-dimensional models whose display positions meet the display conditions in the three-dimensional space.
[0053] The display conditions can include a part of the three-dimensional space that the display device can display. After the display device displays a part of the three-dimensional space, the three-dimensional models within the displayed part of the three-dimensional space are displayed.
[0054] Exemplarily, the current display direction can be determined first in the three-dimensional space, and then the display conditions of the three-dimensional space can be determined according to the current position information and the current display direction. Then, the three-dimensional models whose display positions meet the display conditions are displayed in the three-dimensional space. Specifically, the current display direction can be the direction towards which the display device faces, or the current display direction is the direction towards which the user's face faces. The three-dimensional space can be a virtual space centered on the user. That is, the user is in the three-dimensional space, and the direction towards which the user faces can determine the corresponding current display direction in the three-dimensional space. After determining the current position and the current display direction, the virtual space currently displayed in the three-dimensional space can be determined. The display conditions can be the relative distance between the schedule position and the current position, whether the orientation of the schedule position relative to the current position is in the current display direction, and so on.
[0055] Through the above embodiments, constructing a three-dimensional model based on the person information and / or event information in the schedule information can make the display of the schedule information more personalized. At the same time, positioning the three-dimensional model at a specific position in the three-dimensional space according to the schedule position and the current position in the schedule information, and only displaying the three-dimensional models that meet the display conditions, so that the schedule information can be intuitively viewed, and the interestingness of the display of the schedule information is improved.
[0056] See Figure 2 , Figure 2 is Figure 1 A schematic flowchart of an embodiment of step S103 in
[0057] Step S201: Map the current position and the schedule position to the geographic coordinate system respectively, to obtain the first coordinate of the schedule position in the geographic coordinate system and the second coordinate of the current position in the geographic coordinate system.
[0058] After determining the current position and the schedule position, map the current position and the schedule position to the same coordinate system at the same time, to obtain the coordinates of the current position and the schedule position in the same coordinate system respectively, so as to determine the relative position relationship between the current position and the schedule position based on the coordinates of the two positions. In this embodiment, by mapping the current position and the schedule position to the geographic coordinate system respectively, the first coordinate of the schedule position in the geographic coordinate system and the second coordinate of the current position in the geographic coordinate system are obtained respectively, and the first coordinate and the second coordinate can be reflected by longitude and latitude.
[0059] Step S202: Determine the relative position relationship between the current position and the schedule position based on the relative position of the first coordinate and the second coordinate in the geographic coordinate system.
[0060] After mapping both the current position and the schedule position to the geographic coordinate system, the relative position relationship between the current position and the schedule position can be determined based on the first coordinate of the schedule position and the second coordinate of the current position. For example, the schedule position is in the northwest direction of the current position, or the schedule position is in the 11 o'clock direction of the current position, etc.
[0061] Step S203: Based on the relative position relationship, determine the display position of the 3D model corresponding to the schedule information in the three-dimensional space.
[0062] After determining the relative position relationship between the current position and the schedule position, the display position of the 3D model corresponding to the schedule information in the three-dimensional space can be determined. For example, in the three-dimensional space, taking the user as the center, based on the relative position relationship, the display position of the 3D model corresponding to the schedule information can be determined in the three-dimensional space. Specifically, in some embodiments, the second coordinate where the user is located can be set as the origin of the three-dimensional space, that is, taking the user as the center, and based on the relative position relationship, the display position of the 3D model corresponding to the schedule information can be determined in the three-dimensional space. In some other embodiments, the coordinates of other reference objects can also be set as the origin of the three-dimensional space. Through the above implementation methods, the relative position relationship between the current position and the schedule position in the display space can be combined to accurately determine the display position of the 3D model corresponding to the schedule information in the three-dimensional space, so as to improve the convenience of viewing the schedule information.
[0063] See Figure 3 , Figure 3 is Figure 1 A schematic flowchart of an embodiment of step S104 in
[0064] Step S301: Based on the current position and the current display direction, determine the current display space in the three-dimensional space.
[0065] The current display direction can be the direction towards which the display device faces, or the current display direction is the direction towards which the user's face faces. The three-dimensional space can be a virtual space centered on the user, that is, the user is in the three-dimensional space, and the direction towards which the user faces can determine the corresponding current display direction in the three-dimensional space. When the current position and the current display direction are determined, the virtual space currently displayed in the three-dimensional space can be determined. The current display space can be displayed on the display terminal for the user to view. Exemplarily, taking the display terminal as a mobile terminal, the user holds the mobile terminal, and the orientation of the rear camera of the mobile terminal can be defined as the current display direction. The three-dimensional space obtained based on the rear camera of the mobile terminal is the current display space displayed on the mobile terminal. When the user holds the mobile terminal and rotates it by a specific angle, the orientation of the mobile terminal changes, thereby changing the current display direction and further changing the current display space.
[0066] Step S302: Map the direction area indicated by the current display space to the geographic coordinate system to obtain the coordinate area of the direction area in the geographic coordinate system.
[0067] The current display space is a range area. Exemplarily, the three-dimensional space is centered on the user himself, that is, it can be considered that the three-dimensional space is a three-dimensional virtual space centered on the user and existing in all 360° directions of the user. When the display terminal is a mobile terminal, the user holds the mobile terminal, and the current display space displayed in the mobile terminal includes a partial regional space of the three-dimensional space starting from the position where the user is located. For the sake of easy understanding, the three-dimensional space can be simply regarded as a three-dimensional virtual space centered on the user, and the current display space is a conical three-dimensional space with the user as the vertex.
[0068] The direction area indicated by the current display space includes the area range formed by extending outward along the boundary line of the current display space. Mapping this area range in the geographic coordinate system can determine the coordinate value area of the indicated direction area in the geographic coordinate system.
[0069] Step S303: Display the 3D model whose first coordinate is within the coordinate area in the current display space.
[0070] After determining the coordinate value area of the direction area indicated by the current display space in the geographic coordinate system, it is possible to determine whether the first coordinate of the schedule position is within the coordinate value area, and display the 3D model whose first coordinate is within the coordinate area in the current display space. Exemplarily, when there are multiple schedule information, the first coordinates corresponding to some schedule information are within the coordinate value area, and the first coordinates corresponding to other schedule information are outside the coordinate value area, then only the 3D models whose first coordinates are within the coordinate area are displayed in the three-dimensional space. Exemplarily, the first coordinate of the schedule position of the first schedule information is 40° north latitude and 116° east longitude, the first coordinate of the schedule position of the second schedule information is 39° north latitude and 115° east longitude, the first coordinate of the schedule position of the third schedule information is 40° north latitude and 117° east longitude, etc. When the coordinate value area includes the range of 30° north latitude to 45° north latitude and 110° east longitude to 120° east longitude, it can be determined that the first coordinates of the first schedule information, the second schedule information, and the third schedule information are all within the coordinate value area, and the first schedule information, the second schedule information, and the third schedule information are all displayed in the current display space.
[0071] In some other embodiments, to facilitate the user in viewing a three-dimensional model of greater concern, when the display position of the three-dimensional model does not meet the display conditions, a prompt message may be generated for the user to view the three-dimensional model. Specifically, displaying the three-dimensional model with the first coordinate within the coordinate region in the current display space (step S303) includes: determining a target three-dimensional model, where the first coordinate of the target three-dimensional model is outside the coordinate region; determining a target display direction based on the current position and the first coordinate of the target three-dimensional model; and determining a prompt message for guiding the target object to change from the current display direction to the target display direction based on the target display direction and the current display direction. The target three-dimensional model may be one or more of a plurality of three-dimensional models. The method for determining the target three-dimensional model may include obtaining an operation instruction input by the user and then determining the target three-dimensional model according to the operation instruction. Among them, the first coordinate of the target three-dimensional model is outside the coordinate region of the direction region indicated by the current display space, that is, the display position of the target three-dimensional model does not meet the current display conditions, and the target three-dimensional model is not displayed in the current display space in the three-dimensional space. At this time, in order to guide the user to find the target three-dimensional model, a prompt message may be generated through the target display direction and the current display direction. The user may change the display conditions of the three-dimensional space according to the guidance of the prompt message so that the target three-dimensional model is displayed in the three-dimensional space. Among them, the prompt message may include prompting the user to rotate a specific angle along a predetermined direction, etc., so that the first coordinate corresponding to the target three-dimensional model is within the coordinate region of the changed display space.
[0072] In one embodiment, after the step of displaying the three-dimensional model with the first coordinate within the coordinate region in the current display space (step S303), the method may further include: obtaining a next display direction, where the next display direction is different from the current display direction; updating the display conditions of the three-dimensional space based on the next display direction and the current position; and displaying the three-dimensional model whose display position meets the updated display conditions in the three-dimensional space.
[0073] When the three-dimensional space is a virtual space centered on the user, that is, when the user is in the three-dimensional space, a current display direction can be determined and corresponding to the direction the user is facing in the three-dimensional space. When the user holds the display device and rotates a specific angle, the next display direction can be determined according to the rotated orientation. After the next display direction is determined, the display conditions of the three-dimensional space are updated based on the next display direction and the current position, and the three-dimensional model that meets the updated display conditions is displayed in the three-dimensional space. In this way, the display conditions can be updated according to the switching of the display direction, so as to achieve the purpose of updating the three-dimensional model displayed in the three-dimensional space, thereby improving the interactivity and interest of the schedule information display.
[0074] See Figure 4 , Figure 4 is Figure 3Schematic flowchart of an embodiment of step S303 shown. Specifically, it may include the following steps S401 to step S402.
[0075] Step S401: Based on the first coordinate and the second coordinate of each schedule position, calculate the relative distance value between the schedule position corresponding to each three-dimensional model displayed in the current display space and the current position respectively.
[0076] In this embodiment, multiple schedule information is included at the same time, and each schedule information has a corresponding schedule position. After determining the schedule information displayed in the current display space, if the schedule information that meets the display conditions is directly displayed in the current display space irregularly, the final presented content may not be suitable for the user to view, especially when there is a large amount of schedule information that meets the display conditions. To facilitate the user to view the relevant schedule information in the current display space, all the schedule information that meets the display conditions can be displayed in the current display space according to a certain rule. Specifically, the relative distance value between the schedule position corresponding to each displayed schedule information and the current position can be calculated respectively, so as to display the schedule information in the current display space according to the relative distance value.
[0077] Step S402: Arrange and display each three-dimensional model displayed in the current display space in ascending or descending order of the numerical values between the relative distance values.
[0078] The schedule information displayed in the current display space can be displayed in the current display space in descending order of the relative distance value; or the schedule information displayed in the current display space can be displayed in the current display space in ascending order of the relative distance value; or the schedule information displayed in the current display space can be displayed in ascending order of the relative distance value and in a specific shape in the three-dimensional space. Exemplarily, the schedule information with the smallest relative distance value is placed in the middle position of the current display space, and then the schedule information with gradually increasing relative distance values is respectively arranged around the schedule information with the smallest distance value to form the first fan-shaped ring, and then continue to arrange the schedule information with gradually increasing relative distance values around the schedule information of the first fan-shaped ring to form the second fan-shaped ring, and repeat this layout method until all the schedule information in the current display space is displayed in the three-dimensional space. Thus, by arranging and displaying the schedule information in the current display space according to the relative distance value, it is convenient for the user to view the schedule information in the current display space.
[0079] To implement the schedule display method of the above embodiment, the present application provides a schedule display device. Refer to Figure 5 , Figure 5 is a schematic structural diagram of an embodiment of the schedule display device provided by the present application.
[0080] Specifically, the schedule display device 50 may include: an acquisition module 51, a construction module 52, a determination module 53, and a display module 54.
[0081] The acquisition module 51 is configured to acquire schedule information, where the schedule information includes person information and / or event information.
[0082] The construction module 52 is configured to construct a three-dimensional model based on the person information and / or event information.
[0083] The determination module 53 is configured to determine the display position of the three-dimensional model corresponding to the schedule information in the three-dimensional space based on the schedule position of the schedule information and the current position.
[0084] The display module 54 is configured to display the three-dimensional model whose display position meets the display condition in the three-dimensional space.
[0085] Wherein, in an embodiment of the present application, Figure 5 Each module in the schedule display device 50 shown can be separately or all combined into one or several units to form, or a certain one (or some) of the units can be further split into multiple smaller sub-units in terms of function, and the same operations can be achieved without affecting the realization of the technical effects of the embodiments of the present application. The above modules are divided based on logical functions. In practical applications, the function of one module can also be realized by multiple units, or the functions of multiple modules can be realized by one unit. In other embodiments of the present application, the schedule display device 50 may also include other units. In practical applications, these functions can also be assisted by other units and can be realized by the cooperation of multiple units.
[0086] The schedule display device 50 of the present application can be a server, a mobile device, or a system in which the server and the mobile device cooperate with each other. Correspondingly, each part included in the mobile device, such as each unit, sub-unit, module, and sub-module, can be all arranged in the server, all arranged in the mobile device, or separately arranged in the server and the mobile device.
[0087] Furthermore, the above server can be hardware or software. When the server is hardware, it can be implemented as a distributed server cluster composed of multiple servers or as a single server. When the server is software, it can be implemented as multiple software or software modules, such as software or software modules used to provide a distributed server, or as a single software or software module, which is not specifically limited herein.
[0088] The above method is applied to a schedule display device. For details, please refer to Figure 6 , Figure 6It is a schematic structural diagram of an embodiment of the schedule display device of the present application. In this embodiment, the schedule display device 60 includes a processor 61 and a memory 62. Among them, a computer program is stored in the memory 62, and the processor 61 is used to execute the computer program to implement the above schedule display method.
[0089] Among them, the processor 61 can be an integrated circuit chip with signal processing capabilities. The processor 61 can also be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc.
[0090] For the schedule display method of the above embodiment, it can be presented in the form of a computer program. The present application proposes a computer storage medium carrying the computer program. Please refer to Figure 7 , Figure 7 It is a schematic structural diagram of an embodiment of the computer storage medium of the present application. In this embodiment, the computer storage medium 70 includes a computer program 71, which can be executed to implement the above schedule display method.
[0091] The computer storage medium 70 of this embodiment can be a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disc, etc., which can store program instructions. Or it can also be a server storing the program instructions. The server can send the stored program instructions to other devices for running, or it can also run the stored program instructions by itself.
[0092] If the technical solution of the present application involves personal information, before the product applying the technical solution of the present application processes personal information, it has clearly informed the personal information processing rules and obtained the individual's independent consent. If the technical solution of the present application involves sensitive personal information, before the product applying the technical solution of the present application processes sensitive personal information, it has obtained the individual's separate consent and at the same time meets the requirement of "express consent". For example, at a personal information collection device such as a camera, a clear and prominent sign is set to inform that the personal information collection range has been entered and personal information will be collected. If an individual voluntarily enters the collection range, it is regarded as consenting to the collection of their personal information; or on the personal information processing device, when the personal information processing rules are informed by obvious signs / information, personal authorization is obtained through pop-up information or asking the individual to upload their personal information by themselves, etc.; among them, the personal information processing rules may include information such as the personal information processor, the purpose of personal information processing, the processing method, and the types of personal information processed.
[0093] In addition, when the above functions are implemented in the form of software functions and sold or used as independent products, they can be stored in a storage medium readable by a mobile terminal. That is, the present application also provides a storage device storing program data, and the program data can be executed to implement the methods of the above embodiments. The storage device can be a USB flash drive, an optical disc, a server, etc. That is to say, the present application can be embodied in the form of a software product, which includes several instructions for causing an intelligent terminal to execute all or part of the steps of the methods described in the various embodiments.
[0094] In the description of the present application, the descriptions referring to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples", etc. mean that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described can be combined in a suitable manner in any one or more embodiments or examples. In addition, without conflict, those skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples.
[0095] In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present application, the meaning of "a plurality" is at least two, such as two, three, etc., unless otherwise specifically defined.
[0096] Any process or method description in the flowchart or described in other ways herein can be understood as representing a module, segment, or part of code including one or more executable instructions for implementing a specific logical function or process. The scope of the preferred embodiments of the present application includes additional implementations, where the functions can be executed in a substantially simultaneous manner or in the reverse order according to the functions involved, rather than in the order shown or discussed, which should be understood by those skilled in the art of the embodiments of the present application.
[0097] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a definitional sequence of executable instructions for implementing a logical function, and can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device (which can be a personal computer, server, network device, or other system that can fetch instructions from the instruction execution system, apparatus, or device and execute the instructions). For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium include the following: an electrical connection portion having one or more wirings (electronic device), a portable computer diskette (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium can even be paper or other suitable medium on which the program can be printed, as the program can be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, interpretation, or otherwise processing as appropriate, and then storing it in a computer memory.
[0098] The above are only the embodiments of the present application, and do not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made by using the content of the specification and drawings of the present application, or directly or indirectly applied in other related technical fields, shall be equally included in the patent protection scope of the present application.
Claims
1. A schedule display method, characterized in that, the schedule display method includes: obtaining schedule information, where the schedule information includes person information and / or event information; constructing a three-dimensional model based on the person information and / or event information; determining a display position of the three-dimensional model corresponding to the schedule information in a three-dimensional space based on a schedule position of the schedule information and a current position; displaying the three-dimensional model whose display position meets the display condition in the three-dimensional space; wherein, determining the display position of the three-dimensional model corresponding to the schedule information in the three-dimensional space based on the schedule position of the schedule information and the current position includes: mapping the current position and the schedule position to a geographic coordinate system respectively to obtain a first coordinate of the schedule position in the geographic coordinate system and a second coordinate of the current position in the geographic coordinate system; determining a relative position relationship between the current position and the schedule position based on a relative position of the first coordinate and the second coordinate in the geographic coordinate system; determining the display position of the three-dimensional model corresponding to the schedule information in the three-dimensional space based on the relative position relationship; wherein, displaying the three-dimensional model whose display position meets the display condition in the three-dimensional space includes: determining a current display space in the three-dimensional space based on the current position and a current display direction; mapping a direction area indicated by the current display space to the geographic coordinate system to obtain a coordinate area of the direction area in the geographic coordinate system; displaying the three-dimensional model whose first coordinate is within the coordinate area in the current display space; respectively calculating a relative distance value between a schedule position corresponding to each three-dimensional model displayed in the current display space and the current position based on the first coordinate and the second coordinate of each schedule position; arranging and displaying each three-dimensional model displayed in the current display space in an ascending or descending order of the values of the relative distance values, wherein the arranging and displaying manner of the three-dimensional models includes: limiting the three-dimensional model corresponding to the smallest relative distance value to a middle position in the current display space, and at least part of the remaining three-dimensional models form a fan shape around the three-dimensional model corresponding to the smallest relative distance value.
2. The method according to claim 1, characterized in that, after displaying the three-dimensional model whose first coordinate is within the coordinate area in the current display space, the method includes: obtaining a next display direction, where the next display direction is different from the current display direction; updating a display condition of the three-dimensional space based on the next display direction and the current position; displaying the three-dimensional model whose display position meets the updated display condition in the three-dimensional space.
3. The method according to claim 1, characterized in that, displaying the three-dimensional model whose first coordinate is within the coordinate area in the current display space includes: Determine a target 3D model, wherein the first coordinate of the target 3D model is outside the coordinate region; Determine a target display direction based on the current position and the first coordinate of the target 3D model; Based on the target display direction and the current display direction, determine a prompt message for guiding the target object to change from the current display direction to the target display direction.
4. The method according to claim 1, wherein, the constructing of the 3D model based on the person information and / or event information includes: Determine the person age of the scheduled person in the person information; Based on the person age of the scheduled person, select a corresponding preset 3D model, wherein different preset 3D models correspond to different age ranges.
5. The method according to claim 1, wherein, the constructing of the 3D model based on the person information and / or event information includes: Determine the scheduled time in the event information; Based on the current time and the scheduled time, adjust the status display flag of the 3D model in the 3D space, wherein the status display flag is used to indicate the display status of the 3D model in the 3D space.
6. The method according to claim 5, wherein, the adjusting of the status display flag of the 3D model in the 3D space based on the current time and the scheduled time includes: Calculate the time difference between the current time and the scheduled time; Compare the time difference with a preset difference threshold to obtain a difference comparison result; Based on the difference comparison result, adjust the status display flag of the 3D model in the 3D space.
7. A schedule display device, wherein, it includes: A processor and a memory, wherein a computer program is stored in the memory, and the processor is used to execute the computer program to implement the method according to any one of claims 1 to 6.
8. A computer-readable storage medium, on which program instructions are stored, wherein, when the program instructions are executed by a processor, the method according to any one of claims 1 to 6 is implemented.
Citation Information
Patent Citations
Schedule generation method and device, electronic device and computer readable storage medium
CN109670786A
Virtual display method and device, equipment and storage medium
CN114967914A
Image display method based on augmented reality, display equipment and storage medium
CN115393509A