Fortune slips, methods for selling fortune slips, AR display programs

Abstract

This approach retains the traditional experience of fortune-telling while adding an additional digital experience. [Solution] A fortune-telling slip that includes an AR trigger unit in the concealed part and a connection guidance unit (such as a two-dimensional code) in the exposed part, so that tracking AR can be performed by an AR-capable terminal. A method for selling fortune-telling slips that includes a step of concealing the AR trigger unit. An AR display program that processes and outputs the output result based on surrounding information. An AR display program that uses each stage of opening the fortune-telling slip as an AR trigger.

Description

Technical Field

[0001] The present invention relates to fortune-telling slips, a method for selling fortune-telling slips, and an AR display program.

Background Art

[0002] Conventionally, various devices have been proposed to utilize digital technology for fortune-telling slips and display additional information. For example, according to Non-Patent Document 1, "Is the Shrine Going Digital? The 'QR Code (Registered Trademark)' Fortune-Telling Slip at Kibune Shrine," which will be described later, a two-dimensional code is posted on the fortune-telling slip so that foreign languages that cannot be fully expressed on paper slips can be obtained using a smartphone or the like.

[0003] In addition, similar to Patent Document 1 and Non-Patent Document 2, various devices have been proposed to enhance the enjoyment of digital experiences without using paper itself while expressing fortune-telling slips. In particular, in Non-Patent Document 2, in response to the background of the spread of diseases, such as using an IC chip to avoid physical contact, an attempt is made to solve problems using modern technology. Contrary to the image of fortune-telling slips that are mainly installed in shrines and temples and tend to have an old-fashioned image, a proactive attitude towards technological development that actively incorporates advanced technologies can be seen.

[0004] On the other hand, in recent years, there has been active industrial movement to interweave reality and digital experiences, such as AR, VR, XR, and MR, to enhance further experientiality. In line with such industrial and technological trends, an improvement in the experientiality of fortune-telling slips is also demanded.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Non-Patent Documents

[0006]

Non-Patent Document 1

[0007] However, as mentioned above, despite proactive technological development that took into account the historical context, traditional fortune-telling slips had the following problems.

[0008] First and foremost, the biggest challenge was the inability to maintain the experiential value of traditional fortune-telling slips. As mentioned earlier, in the process of using digital technology to enhance the experiential value of fortune-telling slips, the enjoyment of the act of unwrapping the sealed slips and the enjoyment of deciphering the various items that were present in the original slips were lost. In the original, non-digital fortune-telling slips, the appeal lay not only in enjoying the result written on the slip, but also in the process of unwrapping the scattered slips or shaking the container to draw out the stick. However, the challenge with digitalization using conventional technology was that much of the enjoyment of traditional fortune-telling slips, such as the paper slips and shaking the container to draw out the stick, was lost. [Means for solving the problem]

[0009] To solve the above problems, one aspect of the present invention is a fortune-telling device that includes an AR trigger unit in the concealed portion and a connection guidance unit in the exposed portion.

[0010] Furthermore, one aspect of the present invention is a fortune-telling device that includes an AR trigger unit in the concealed portion.

[0011] Furthermore, one aspect of the present invention is a fortune-telling slip as described above, which includes a connection guide part.

[0012] Furthermore, one aspect of the present invention is a method for selling fortune slips that includes the step of concealing the AR trigger portion.

[0013] Furthermore, one aspect of the present invention is a method for selling fortune slips as described in the preceding paragraph, which includes the step of displaying a connection guidance section.

[0014] Furthermore, one aspect of the present invention is a method for selling fortune slips that includes the step of concealing the AR trigger unit and the connection guidance unit.

[0015] Furthermore, one aspect of the present invention is an AR display program that processes and outputs output results based on surrounding information.

[0016] Furthermore, one aspect of the present invention is an AR display program that uses each stage of opening a fortune slip as an AR trigger. [Effects of the Invention]

[0017] This invention solves the problems of traditional fortune-telling by using digital technology, particularly augmented reality (AR) technology, to enhance the experience. To define AR (augmented reality), it is a technology that overlays non-existent images onto real images obtained through the camera of a smartphone or tablet, or real images directly viewed, such as those seen through smart glasses with an optical see-through display. More specifically, this invention can be expected to have the following effects by using AR in fortune-telling.

[0018] First and foremost, the greatest benefit is that it enhances the traditional experience of fortune-telling while preserving its original appeal. According to this invention, although digital technology is used, the foundation remains the real fortune-telling slip, and the AR adds an additional experience. Therefore, it does not diminish the enjoyment and fun of experiences such as "the pleasure of opening the glued seal" or "the pleasure of deciphering the various items." As a result, users can enjoy both the additional effects of digital technology and the enjoyment of the analog experience.

[0019] The second benefit is the improved entertainment value of the unboxing process. According to the present invention, by pre-registering multiple trigger elements for displaying AR for each stage of the pattern change that occurs when opening the fortune slip, different AR content can be displayed at each stage of unboxing, making the experience of gradually unboxing the glued and folded fortune slip even more enjoyable compared to conventional technology.

[0020] The third benefit is the ability to integrate with AR (Augmented Reality) and MR (Mixed Reality) experiences. According to this invention, the information and experiences available to users can be expanded by utilizing AR and MR technologies. This goes beyond simply providing additional information through a QR code, as in conventional technologies, and allows for more immersive visual experiences, such as displaying 3DCG three-dimensionally within a landscape for guidance, enhancing visual effects like making fortune slips glow divinely, and playing videos that blend seamlessly into the scenery. Furthermore, these effects increase user interest and, consequently, promote purchasing behavior compared to conventional technologies.

[0021] Subsequently, as the fourth effect, it can be mentioned that the surrounding environment and individual information can be utilized in the output result. According to the present invention, individual information such as the user's heart rate, position information, and furthermore, schedules registered in the calendar application can be utilized to dynamically change the output result. Specifically, for example, regarding results such as "Waiting for someone: not coming", "Illness: getting better", "Direction: northwest" written in the fortune-telling result, after obtaining the current position information and searching for information on hospitals or massage shops located in the northwest and displaying it on the user terminal screen, it can indicate the possibility of the illness being cured by hospitals or massage shops in the northwest, or present the possibility of not being able to meet the schedule with the person registered in the calendar application. Based on the fortune-telling result, it is possible to provide information optimized for each user's needs and offer a more satisfactory individual experience compared to the prior art.

[0022] Subsequently, as the fifth effect, it can be mentioned that Web access means such as two-dimensional codes can be posted on the outer surface of the fortune-telling to enable the appeal for purchases. According to the present invention, as a trigger element for displaying AR, by using visual elements such as pictures and texts that are usually used as fortune-telling, the two-dimensional code can be posted on the outside of the fortune-telling without the need to post it inside. Before purchase, the user can sense that there is additional information by the two-dimensional code. As a result, there is no need for additional promotion to suggest additional information by the two-dimensional code separately to appeal for purchases, and compared to the prior art, the promotion cost can be reduced. Also, compared to the prior art, the paper surface of the fortune-telling can be utilized more effectively. In addition, the user can clearly grasp the potential value of the fortune-telling.

Brief Explanation of Drawings

[0023] [Figure 1] It is a schematic diagram showing the overall image of the information processing system showing this embodiment. [Figure 2] It is a block diagram showing the configuration of the server 70. [Figure 3] It is a block diagram showing the configuration of the user terminal 90. [Figure 4] This is a block diagram showing the structure of 100 fortune slips. [Figure 5] This is a plan view showing the fortune slip 100 of this embodiment. [Figure 6] This is a block diagram showing the configuration of the memory unit 111. [Figure 7] This is a block diagram showing the configuration of the memory unit 121. [Figure 8] This is a perspective view showing how the fortune slip of this embodiment is folded. [Figure 9] This is a cross-sectional view of the fortune slip of this embodiment when it is folded. [Figure 10] This is a flowchart showing the information processing procedure of this embodiment. [Figure 11] This flowchart shows the procedure for the sales method of this embodiment. [Figure 12] This is a reference diagram showing variations of folded fortune slips. [Figure 13] This is a perspective view showing a modified version where fortune slips are displayed in a drawer. [Figure 14] This is a perspective view showing a modified version of the omikuji (fortune slips) being displayed on a shelf. [Figure 15] This is a flowchart showing the information processing procedure for modified examples. [Figure 16] This is a reference diagram showing a modified version of the process, illustrating how the fortune slip is copied onto the user's terminal. [Figure 17] This is a plan view showing the stepwise multiple AR triggers used in the modified example. [Modes for carrying out the invention]

[0024] The following describes one embodiment of the present invention. First, as a premise, this embodiment is intended to add a new element of fun to conventional folded paper fortune slips using AR technology without significantly diminishing their appeal. Among AR technologies, this invention particularly focuses on marker tracking and image tracking (hereinafter collectively referred to as "tracking AR"). This technology typically detects a specific trigger element from image or video information of the surrounding environment obtained in real time through a camera or the like, and overlays and displays the information based on the detected position. However, it should be noted that, according to the common technical knowledge at the time of filing, there are many cases where AR is performed based on a comprehensive determination of the position of the terminal running the application using a gyro sensor or GPS, without using a trigger.

[0025] [Overall structure] First, the overall system configuration will be explained using Figure 1. Figure 1 is a schematic diagram showing the overall structure of the information processing system according to this embodiment. This embodiment includes a server 70, a user terminal 90, and a fortune-telling device 100. The server 70 and the user terminal 90 are configured to communicate via the Internet 80. As an example of information processing performed using the above configuration, this embodiment will explain the process of holding a smartphone, which is an example of a user terminal 90, over a physically existing fortune-telling device 100 and performing tracking AR.

[0026] [Server Hardware Configuration] Next, the configuration of the server 70 will be explained using Figure 2. The server 70 comprises at least a processing unit 110, a storage unit 111, and a communication unit 112. The processing unit 110 executes various programs for controlling the server 70. The storage unit 111 stores various programs executed by the processing unit 110 and various data used. The communication unit 112 connects to the internet 80 by wired or wireless connection and sends and receives predetermined data with the user terminal 90 or other servers (not shown).

[0027] [User terminal hardware configuration] Next, the configuration of the user terminal 90 will be explained using Figure 3. The user terminal 90 comprises at least a processing unit 120, a storage unit 121, a communication unit 122, an input unit 123, and a display unit 124. More specifically, the user terminal 90 here is assumed to be a handheld device such as a smartphone, but it also generally includes any device capable of performing AR, such as a PC with a camera, video see-through smart glasses that acquire real-world surrounding information as visual information from the camera and display it on the display unit, optical see-through smart glasses that display additional information when the user directly views real-world surrounding information, or a device that sends signals directly to the brain to allow the user to recognize visual information.

[0028] The processing unit 120 controls the operation of the user terminal 90 by executing a browser or AR display application (described later) and a system program (not shown) for controlling the overall operation of the user terminal 90. The processing unit 120 may consist of a single processor or multiple processors. The storage unit 121 stores various programs executed by the processing unit 120 and various data used by those programs. The storage unit 121 is, for example, a flash EEPROM or a hard disk drive. The display unit 124 is typically a liquid crystal display device. The communication unit 122 connects to the internet 80 by wired or wireless connection and sends and receives predetermined data with the server 70, etc.

[0029] The input unit 123 is an input device for receiving user operations and information from external sources. In this embodiment, a camera or touch panel is particularly envisioned, but it also includes various pointing devices such as a mouse or keyboard, various push-buttons, analog sticks, and other input devices, as well as location information acquisition devices such as GPS, gyro sensors, light intensity meters, and biometric data acquisition devices such as body temperature and iris scans.

[0030] Furthermore, the aforementioned input may be achieved through the interaction of multiple devices. For example, this includes acquiring surrounding data by measuring body temperature with a smartwatch and sending the data to a smartphone via Bluetooth®. In addition, the aforementioned configuration can also be achieved by connecting a webcam to a PC that does not have a camera.

[0031] [Functional and physical configuration of fortune slips] Next, the fortune-telling slip 100 will be explained using Figures 4 and 5. First, referring to Figure 4, a functional block diagram, the fortune-telling slip 100 includes a connection guide part 201 and a trigger part 202 as its functions. Referring to Figure 5, a plan view of the object, the fortune-telling slip 100 has surfaces 101, 102, 103, 104, 105, and 106. The fortune-telling slip 100 is made of a foldable sheet material such as paper, aluminum foil, or rubber. Dotted lines 301, 302, 303, 304, and 305 indicate the positions of the folds. Although surfaces 101 to 106 are on the same plane, they are treated as separate surfaces for the sake of explanation when folded at the positions of dotted lines 301 to 305.

[0032] The connection guidance unit 201 is embodied as a two-dimensional code on surface 102. The trigger unit 202 is embodied as a pattern spanning surfaces 103, 104, and 105. In this embodiment, the connection guidance unit is assumed to be printed as a two-dimensional code, but is not limited to this. Other forms of the trigger unit, such as displaying a URL as a string or attaching an IC chip that allows information to be read by touch, have equivalent functionality and are equally valid. The trigger unit 202 can be any form of pattern, as long as it is registered as a trigger in advance. A well-known technique is to use an AR marker.

[0033] [application] Next, Figure 6 will be used to explain the storage unit 111 provided in the server 70. The storage unit 111 includes an AR display program 116, content data 117, and trigger interpretation data 118. These data are downloaded to the user terminal 90 to take effect, and will be explained in detail below.

[0034] Next, Figure 7 will be used to describe the memory unit 121 provided in the user terminal 90. The memory unit 121 is equipped with a browser 125. This is a general web browsing application. However, the scope of web browsing is broad, and it is known that various functions can be realized by executing scripting languages ​​such as JavaScript using a browser. Applications such as video playback, games, and 3D graphics display can also be deployed on the browser. In this embodiment, AR is displayed as one of these broadly deployable applications.

[0035] Next, the AR display program 126, content data 127, and trigger interpretation data 128 will be described below. For the sake of explanation, these are described as if they were originally included in the browser 125, but this is not the only way to describe them. In most cases, when necessary, they are downloaded from the server 70 via the communication unit 122 by the user terminal 90, which receives user input from the input unit 123. The AR display program 116 in the storage unit 111 of the server 70 corresponds to the AR display program 126, the content data 117 corresponds to the content data 127, and the trigger interpretation data 118 corresponds to the trigger interpretation data 128, and they are all considered to be the same.

[0036] Next, the AR display program 126 will be explained in detail. The AR display program 126 is based on common browser display technologies such as HTML, CSS, and JavaScript, in order to enable the browser 125 to function as an AR display application. Furthermore, it includes a 3DCG display library and a library containing a program for recognizing AR markers, which are necessary for displaying AR. By running the AR display program 126 configured in this way on the browser 125, the browser 125 will function as an AR display application.

[0037] As is evident from the above explanation, the primary purpose of the browser 125 in this embodiment is to operate the AR display program 126 as an AR display application by executing it through the browser 125. Therefore, it should be noted that the browser 125 and the AR display program 126 can be considered substantially equivalent to a single AR display application. In other words, the configuration of this embodiment should be treated as equivalent to a case where the AR display application is stored in the storage unit 111 and downloaded to the user terminal 90 for use.

[0038] However, as is common practice in current technology, due to security concerns, implementing AR display via a web browser may have limitations on the surrounding information that can be accessed (such as location information and camera information) compared to implementing it via a dedicated app created for AR display, and in some cases, the two may not be considered entirely equivalent. However, in this invention, such specification constraints inherent in individual terminals and operating systems are not important issues in terms of the technical concept, so we will omit further explanation.

[0039] Next, the content data 127 includes 3DCG model data, image data, text data, video data, audio data, and programs that link or interact with these, and define and control the behavior when tapped or clicked, all of which have been planned and prepared in advance by the developer or dynamically generated, in order to be displayed overlaid on real-world visual information when the AR display program 126 is executed by the browser 125 and the app functions as an AR application.

[0040] Next, in this embodiment, the trigger interpretation data 128 is feature point extraction data of the trigger unit 202 that has been processed in advance by AI or the like. The trigger interpretation data 128 is data that serves as a criterion for determining whether or not there are elements in the acquired peripheral information, such as the camera, gyro sensor, and GPS, that can be identified as the trigger unit 202, which is the criterion for displaying AR, when the AR display program 126 is executed by the browser 125 and the application functions as an AR display application.

[0041] Next, the two-dimensional code interpretation app 129 is an application that includes a function for interpreting two-dimensional codes, and at the time of filing, this is often a standard feature included in the camera app that comes standard on smartphones. The two-dimensional code interpretation app 129 includes a function that verifies whether an image or video obtained through the camera, among other inputs, contains a two-dimensional code, and if detected, launches the browser 125 and prompts the user to visit a web page by following the URL interpreted from the two-dimensional code.

[0042] [Steps to Sales] Here, we will explain in more detail the procedure for selling the fortune slips 100 using Figures 5, 8, 9, and 11. In this embodiment, as mentioned above, the fortune slips 100 are assumed to be sold in a state where a sheet of paper or the like, configured as shown in Figure 5, is folded before display as shown in Figure 9 and glued together.

[0043] Figure 11 is a flowchart showing the steps leading up to the sale. Referring to Figure 11, the steps leading up to the sale include steps S510 and S520. A detailed explanation of these steps is given below.

[0044] First, step S510 will be explained in detail with reference to Figures 8 and 9. As shown in Figure 8, the surface 106 is folded in the direction of the arrow, using the dotted line 305 as a reference. If the sections are folded in the order of dotted line 304, dotted line 303, dotted line 302, and dotted line 301, as a result, as shown in Figure 9, only surfaces 101 and 102 will be exposed on the outside, while the other surfaces 103, 104, 105, and 106 will be folded inward so that they are not visible from the outside. According to the common technical knowledge at the time of filing, at this time the parts are glued and bonded at the shaded area 310 to fix the overall folded shape. In the process of constructing as described above, the trigger part 202 of the fortune slip 100 is folded inward and is not visible from the outside, in other words, it is covered and concealed. As mentioned above, forming the state in which the trigger part 202 is concealed corresponds to step S510.

[0045] Similarly, the procedure of "displaying the connection guide portion" shown in step S520 is also achieved when the fortune slip 100 is folded, as shown in Figure 9. Specifically, the connection guide portion 201 that has been embossed on surface 102 can be considered to have been displayed by folding the fortune slip 100 so that surface 102 is exposed as a surface visible from the outside.

[0046] [Additional effects of this embodiment] This configuration allows for additional effects. At the time of sale, the concealed surface is covered and glued, so the user can only see the visible surface. The user can see the connection guidance part, such as the QR code on the visible surface from the outside, and sense that there is additional information there. Through the QR code, they can find the location of the additional information even before purchase (when the product is given after paying the offering fee). However, because the trigger part is folded inside, it is not possible to perform tracking AR itself.

[0047] Thus, while AR cannot be used without a purchase, displaying a QR code or similar on the surface can suggest the availability of additional information, thus encouraging purchases. This was not possible with traditional fortune-telling slips because the QR code was directly linked to the fortune-telling result information. In tracking AR, by linking two key elements—a connection guidance part for the QR code, etc., and a trigger part—pre-purchase information and post-purchase information can coexist on a single web page, and their display can be switched on or off depending on whether the user has made a purchase. This contributes to increasing the relevance of physical fortune-telling slips.

[0048] [Figure 11: A modified example of the sales procedure] As mentioned above, the steps S510 and S520 shown in Figure 11 are mostly achieved by folding a sheet of paper or other material, such as the fortune slip 100, as shown in Figure 9, but are not limited to this. As other examples, as shown in Figures 13 and 14, step S510 involves displaying fortune slips having a trigger part 202 in a shelf for storing them, while concealing the trigger part 202 so that it is not immediately visible. Step S520 can be considered to involve posting the connection guidance part 201 as a poster or notice, or setting up a stand displaying the connection guidance part 201, in a location visible from outside the shelf or in other surrounding areas related to the sale of fortune slips.

[0049] Regarding the drawings, Figure 9 is drawn with exaggerated thickness to clearly show the structure. For illustrative purposes, surface 103 is not depicted as being completely covered by surface 101, but the connecting guide portion 201 is to be assumed to be covered and invisible by surface 101. Furthermore, in this embodiment, it is described as being glued at the dotted line portion 310, but it is not limited to this, and it is equally conceivable that the folded state of the fortune slip 100 as shown in Figure 9 can be maintained by fixing it with auxiliary tools such as clips or staples, or by forming a fixing structure on the fortune slip 100 such as HarinaX (registered trademark), or by wrapping it in an envelope or the like.

[0050] [Variations of the folding method shown in Figure 12] A key feature of this embodiment is that, as shown in Figure 9, the connection guide portion 201 is exposed on the outside of the fortune slip 100, while the trigger portion 202 is hidden so that it is not visible from the outside. As long as the above configuration is in place, it should be understood that the method of folding and the number of surfaces formed by folding the fortune slip are all equivalent. More specifically, as shown in Figure 12, fortune slips sold in crane or heart shapes have been confirmed at the time of filing. Even with these folding methods, an exposed surface and a concealed surface are formed, so this embodiment can be implemented by integrating the connection guide portion on the exposed surface and the trigger portion on the concealed surface. However, it is not limited to these, and any configuration in which a connection guide portion such as a two-dimensional code is displayed on the exposed surface and the trigger portion is concealed on the concealed surface can be considered equivalent to this embodiment.

[0051] [Operation] Next, the operation and procedure will be explained. First, this embodiment is based on the physical properties of fortune slips and the culture of fortune slips in Japan at the time of filing, and the effects of the invention are realized when information processing technology is linked to these. Specifically, in this embodiment, as mentioned above, it is assumed that the fortune slip 100 is held by the user in a folded state as shown in Figure 9. The user who has the fortune slip 100 in their hand will release the folded structure in Figure 9 by peeling off the adhesive at the dotted line portion 310, and will try to see the overall appearance of the fortune slip 100 as shown in Figure 5. Then the user will activate their user terminal 90. Assuming that the above is simply something the user would do as a matter of common sense and culture, the information processing procedure will be explained below with reference to Figure 10.

[0052] First, in step S410, the user terminal 90 receives an operation from the user through the input unit 123 and launches the QR code interpretation application 129. The QR code interpretation application 129 receives external information as images or videos, particularly through the camera of the input unit 123, and verifies whether or not a QR code is present within it. When the user successfully inputs information, for example by pointing the fortune slip 100 at one of the input units 123 which has been transformed into a camera, or by pointing the connection guidance unit 201 which has been transformed into a QR code at one of the input units 123 which has been transformed into a camera, the QR code interpretation application 129 interprets the URL represented by the connection guidance unit 201, launches the browser 125, and attempts to make a request to the server 70 via the internet 80 to connect to the interpreted URL. Assuming that the request is successful, the process proceeds to the next step.

[0053] Next, in step S420, as a response to the request, the server 70 returns the AR display program 116, content data 117, and trigger interpretation data 118 to the user terminal 90. The returned data is stored in the storage unit 121 as the AR display program 126, content data 127, and trigger interpretation data 128. When the browser 125 executes the AR display program 126, the browser 125 subsequently behaves as an AR display application. Therefore, in this embodiment, for the sake of convenience, the browser 125 behaving as an AR display application will be referred to as "AR application 125" from now on.

[0054] Next, in step S430, the AR application 125 continuously receives surrounding information as images and videos through one of the input units 123 that have been transformed into cameras. Then, it verifies, based on the trigger interpretation data 128, whether or not there is anything in the received surrounding information that can be recognized as a trigger unit 202.

[0055] Next, in step S440, it is determined whether the trigger unit 202 has been detected. If it has not been detected, the process returns to step S430. If it has been detected, the process proceeds to step S450.

[0056] Next, in step S450, the content data 127 is displayed. What to display and where to display it is at the discretion of the implementer and is not a requirement of the invention, but to make it easier to visualize, using the trigger unit 202 in Figure 5 as an example, in an AR application 125 for the purpose of text translation, a clear example would be to overlay the translated text "The person waiting: comes" near the detected position of the string "Waiting person coming," which is set as the trigger element.

[0057] Next, in step S460, the AR app 125 determines whether it has received a termination command from the user. If it has, the execution of the AR app 125 is terminated; otherwise, the process returns to step S430, and the loop repeats.

[0058] The above describes the information processing procedure of this embodiment.

[0059] [Modified examples shown in Figures 15 and 16] Next, a modified version of this embodiment will be described with reference to Figures 15 and 16. First, Figure 16 is an image showing how this modified version is implemented. It shows how additional information appears when a smartphone, which is the user terminal 90, is held over the fortune-telling device 500, such as "We recommend Kitanishi Hospital for you."

[0060] At the time of application, typical fortune slips contain various items such as "Waiting Person," "Illness," "Direction," and "Marriage Proposal," but the text is short and can be difficult to interpret. For example, even if it says "Direction: Northwest," it is not easy to determine what is located in the northwest direction from the user's current location, or which of the many items is most important to the user. Therefore, in order to convey such difficult-to-interpret information in an easy-to-understand and more concrete way, biometric and location information obtained through the user terminal 90 is used to process the information so that it is most appropriate for the individual user. More specifically, processing means, for example, if the fortune slip results in "Direction: Northwest" and "Illness: Will be cured," searching for a hospital located in the northwest direction from the user's location and displaying that information.

[0061] Next, the procedure for this modified example will be explained with reference to Figure 15. Figure 15 is a modified version of Figure 10 with additional processing. The only difference between Figure 10 and Figure 15 is the addition of step S445 between step S440 and step S450.

[0062] In step S445, the AR application 125 acquires information such as data already contained in the memory unit 121 (not shown), such as contacts and schedules, data from the Web obtained through the communication unit 122, location information, light intensity information, infrared information, heart rate information, fingerprint information, iris information, surrounding image information obtained from the input unit 123, or user facial expression information and gaze information obtained by analyzing these using artificial intelligence. While comparing this information with the meaning written on the fortune slip 500, the AR application 125 generates secondary information and adds it to the content data 127, or processes the content data 127 itself.

[0063] In the subsequent step S450, the content data 127 processed in the previous step, along with the generated secondary information, is displayed.

[0064] By implementing this method, it helps users interpret the meaning of the fortune slips, and the effect is achieved in making difficult-to-interpret information easier to understand.

[0065] [Modified example shown in Figure 17] Next, we will explain Modification 2 with reference to Figures 5 and 17. A characteristic of folded fortune slips is that the visible area expands as they are opened in stages. More specifically, when opening a fortune slip, the entire image of trigger element 202 is not immediately visible as a whole picture. Rather, as the fortune slip is opened, the visible area gradually expands with each step, showing trigger element 211, trigger element 212, and so on, until the final stage, the entire image of trigger element 202 and fortune slip 100 is visible. This is a physical characteristic that fortune slips generally possess. This modification utilizes the aforementioned physical characteristics of fortune slips to further enhance the enjoyment when using AR.

[0066] As is common technical knowledge at the time of filing, the elements such as images that serve as trigger elements for tracking AR are not limited to a single element, but can be set as multiple elements simultaneously and in parallel, displaying different content data corresponding to each trigger element. Applying this, as an example, trigger elements 211, 213, and 214 are pre-set as different trigger elements. Furthermore, as content data corresponding to the trigger elements, a star-lighting effect (not shown) is set for trigger element 211, a circle-scaling effect (not shown) is set for trigger element 213, and an animation effect (not shown) of a hand going from a fist to a thumbs-up is set for trigger element 214. In addition, a drum roll sound is set as the corresponding content data for trigger element 211, and a cymbal crash sound is set for trigger element 214. With the trigger elements and content data associated in this way, when the input unit 123, which has been transformed into a camera through the AR app 125, receives surrounding information, as the user gradually unfolds the fortune slip from its folded state as shown in Figure 9 to its fully unfolded state as shown in Figure 5, visually, effects such as the aforementioned glowing stars and expanding and contracting circles are gradually added, and a drum roll sound gradually builds up the mood, culminating in a cymbal crash to display the result. In this way, the user can enjoy effects such as sound being played in stages and visual effects being applied in accordance with the timing of their unfolding.

[0067] This type of presentation, which allows users to enjoy the unboxing process over time, particularly takes advantage of the unique characteristics of fortune slips sold in a folded form, as shown in Figure 9. This modified version enhances the enjoyment of the significance of real fortune slips and the unboxing process through the use of tracking AR.

[0068] The embodiments and modified examples of the present invention have been described above. Herein, the present invention is not limited to the example of the embodiment described above, but includes various modified examples. For example, the example of the embodiment described above was described in detail to make the present invention easier to understand, and the present invention is not limited to having all the configurations described herein. Furthermore, some of the configurations of one example of an embodiment can be replaced with the configurations of another example. Furthermore, some of the configurations of one example of an embodiment can be added to the configuration of another example. Furthermore, some of the configurations of the example of each embodiment can be added, deleted, or replaced with other configurations. [Explanation of symbols]

[0069] 70 servers 90 User Terminals 100 fortune slips 101 Fortune slip side, 102 Fortune slip side, 103 Fortune slip side, 104 Fortune slip side, 105 Fortune slip side, 106 Fortune slip side 110 Processing Unit 111 Storage section 112 Communications Department 116 AR display program 117 Content Data 118 Trigger Interpretation Data 120 Processing Unit 121 Storage section 122 Communications Department 123 Input section 124 Display section 125 Browsers 126 AR display program 127 Content Data 128 Trigger Interpretation Data 129 QR Code Interpretation App 201 Connection guidance section (two-dimensional code as an example) 202 Trigger section (for example, a square frame enclosing the waiting person, business, and academic results) 211 An example of the trigger section (part of 202)

Claims

1. A fortune-telling device that includes an AR trigger unit in the concealed section and a connection guidance unit in the exposed section.

2. The concealed part contains the AR trigger part, and the fortune slip

3. In addition to the above, the fortune slips include the connection guide section.

4. A method of selling fortune slips that includes a step to conceal the AR trigger part.

5. In addition to the above, a method of selling fortune slips that includes the step of displaying a connection guidance section.

6. A method for selling fortune slips that includes a step of concealing the AR trigger part and the connection guidance part.

7. An AR display program that processes and outputs results based on surrounding information.

8. An AR display program that uses each stage of opening a fortune slip as an AR trigger.

Images