Method and apparatus for storing or utilizing additional location information

Abstract

Disclosed are a method and apparatus by which a terminal for storing and utilizing a photograph file stores or utilizes additional location information. The method by which the terminal stores and utilizes additional location information, comprising the steps of: obtaining additional location information about the current location of the terminal by using wireless communication; and storing the obtained additional location information together with a file storing a photograph taken at the location may be provided as an operating method of the terminal for ahceiving said purpose. The terminal can perform various operations by using the stored additional location information, such as making a call to a stored phone number, accessing a stored Internet address, arranging photographs by using a name or ID of a stored location, and displaying the location of a stored address on a map of a predetermined map application.

Description

Method and device for storing or utilizing location information

[0001] The present invention relates to a method and device for storing location information in a file together with a photo when taking a photo, or for utilizing location information stored in a photo file.

[0002] Currently, various technologies are being used to implement indoor navigation. Methods utilizing beacons, location markers, and magnetic fields are being utilized, and recently, research is also underway into installing similar Global Positioning System (GPS) devices inside buildings. These advancements in various indoor navigation technologies are gradually leading to the commercialization of indoor navigation.

[0003] Meanwhile, when a photo is taken and saved, various additional information is usually saved in the file along with the photo. The most widely used is EXIF ​​(Exchangeable Image File Format), and many image file formats support this format. EXIF ​​is an image file metadata format used in digital cameras, etc., and was developed to store various information, such as the time, in photo files or recording files taken by the camera. In other words, information about images or sounds can be additionally recorded in JPEG (Joint Photographic Experts Group), TIFF (Tagged Image File Format) 6.0, RIFF (Raster Image File Format), and WAV (Waveform Audio Format) formats. EXIF ​​data is saved as part of the image file, and the data is preserved even if the image is changed when using software that supports EXIF ​​data.

[0004] EXIF metadata contains various information, such as the date and time the photo was taken, the camera manufacturer, the camera shutter speed, aperture value, and latitude and longitude location information. Information such as the date and latitude can be useful to the general public. However, most EXIF ​​metadata, while useful to photography professionals and related businesses, may not be useful to the general public.

[0005] When people search for photos on their smartphones or personal computers (PCs), they typically sort them by date and then find the one they want. Photos can also be sorted by folder, name, or file size. However, photos aren't organized by location. While photos taken outdoors can store latitude and longitude information acquired using GPS signals, detailed information about the location cannot be obtained using this information.

[0006] In particular, GPS reception is not possible indoors, so even latitude and longitude cannot be stored. This means that photos taken indoors cannot store location information such as latitude and longitude. Even if latitude, longitude, and altitude information were displayed in indoor photos, this information would not be used to determine which floor of the building or which store the photo was taken from.

[0007] When looking at photos taken indoors or outdoors, people can identify when the photo was taken, but they cannot obtain additional information about the location. For example, a woman might take a photo of a beautiful pair of shoes a few days ago, but not be able to buy them because she doesn't know the name of the store where the photo was taken. A foreign tourist might take a photo of chocolate in front of a chocolate shop in Paris, France, but not be able to use the photo to purchase the chocolate after returning to her home country. Another woman might look at a photo of food taken at a fancy restaurant years ago and wonder what the food was called and how much it cost, but she cannot.

[0008] People may feel uncomfortable because photos taken this way do not store various additional information related to the location where the photo was taken.

[0009] The purpose of the present invention to solve the above problems is to provide a method and device for saving additional location information together with a photo file when taking a photo or for utilizing the saved additional location information so that a user can conveniently utilize the saved photo.

[0010] The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description below.

[0011] In order to achieve the above object, a method of operating a terminal for storing and utilizing a photo file according to one embodiment of the present invention comprises the steps of: obtaining additional location information about the current location of the terminal using wireless communication; and storing the obtained additional location information together with a file storing a photo taken at the location.

[0012] In one embodiment of the present invention, the location additional information may include at least one of a location name, a predetermined location ID (identifier), a country name, a city name, a building name, a predetermined building ID, an address of a building, a phone number of a building manager, the floor on which a terminal is located within a building, an Internet address providing building information, a predetermined indoor map app ID, coordinates of the terminal location on an indoor map used by a predetermined indoor map app, a store name, a predetermined store ID, store business hours, a phone number of the store, an Internet address for purchasing items from the store, an Internet address of a store operator, a name of an event or performance, a name of an event venue or performance hall, performers of an event or performance, the order of an event or performance, a synopsis of a performance, information on the time at which an event or performance is held, an Internet address providing information on an event or performance, a phone number providing information on an event or performance, a predetermined application ID, and data pre-assigned to the location by a predetermined application.

[0013] In one embodiment of the present invention, in the step of obtaining the location additional information using wireless communication, the location additional information may be directly wirelessly received from a wireless communication device installed at the location, or the indoor location additional information may be received from a server having the location additional information by connecting to the connected server.

[0014] In one embodiment of the present invention, the terminal may further include a step of utilizing location additional information stored in the photo file.

[0015] Here, in the step of utilizing the location additional information stored in the photo file, the terminal may perform one or more of the following: making a call to the stored phone number, accessing the stored Internet address, sorting photos using the name or ID (identifier) ​​of the stored location, or displaying the location of the stored address on a map of a pre-designated map app.

[0016] Here, when accessing the above-mentioned saved Internet address, the image of the photo can be transmitted to the server of the above-mentioned Internet address so that the image of the photo can be retrieved from the server of the above-mentioned Internet address.

[0017] Here, in the step where the terminal utilizes the location additional information stored in the photo file, if there is store information in the additional information stored in the photo file, the electronic receipts paid for at the store are searched using the store information, and among the searched receipts, the electronic receipt having the stored shooting time and receipt issuance time closest to each other is selected, and the selected electronic receipt or information extracted from the selected electronic receipt can be displayed on the screen or stored as additional information in the photo file.

[0018] Here, the information extracted from the selected electronic receipt may include one or more of a product list, a food order list, a receipt issuance time, a product price, a food price, and payment method information.

[0019] Here, in the step where the terminal utilizes the location additional information stored in the photo file, if the additional information stored in the photo file includes a predetermined application ID (identifier) ​​and data assigned to the location by the predetermined application, one or more of the following actions can be performed: executing the predetermined application using the data assigned to the location; displaying on the screen where the photo appears that the predetermined application is executable; and sorting photos having the predetermined application ID.

[0020] Here, the above-described application is an application that describes an exhibit, and the data assigned to the location in the above-described application may include at least one of the ID of the exhibit and the method of describing the exhibit.

[0021] In one embodiment of the present invention, the terminal may further include a step of displaying location additional information stored in the photo file on the screen by overlaying it on the photo image.

[0022] Here, in the step of displaying the location additional information stored in the photo file on the screen by overlaying it with the photo image, an icon or character mapped to the location additional information predetermined for the photo image may be displayed on the screen by overlaying it with the photo image, and when the icon or character overlaid on the screen is touched, the touched character or icon and the mapped location additional information may be selected from the photo file, and the selected location additional information may be displayed on the screen by overlaying it with the photo image.

[0023] In one embodiment of the present invention, the terminal may further include a step of displaying, on a screen, overlapping operations that can be performed using location additional information stored in the photo file, on the photo image.

[0024] Here, the actions that can be executed using the location additional information stored in the photo file may include one or more of accessing an Internet address, making a phone call, viewing performance information, viewing event information, viewing an indoor map, viewing an exhibit description, and listening to an exhibit description.

[0025] Here, in the step of displaying on the screen the actions that can be executed using the location additional information stored in the photo file by overlaying them on the photo image, characters or icons mapped to the predetermined execution actions can be displayed on the screen by overlaying them on the photo image.

[0026] Here, when the terminal receives a touch input through the character or icon displayed on the screen overlapping the photograph image, the terminal can perform a predetermined execution action mapped to the character or icon.

[0027] According to the present invention, when taking a photo, location additional information acquired through wireless communication is stored together with the photo file, and by utilizing the stored location additional information, a user can receive various services, such as calling the store where the photo was taken using the stored photo, accessing an Internet website selling the product in the photo, or arranging the stored photos based on the same location additional information.

[0028] The effects that can be obtained from the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by a person having ordinary skill in the art to which the present invention belongs from the description below.

[0029] Figure 1 is an exemplary diagram showing a terminal, a screen, and a user used in one embodiment of the present invention.

[0030] Figure 2 is an example of a screen for executing a commercial app that displays latitude and longitude information stored in a photo file on a map.

[0031] FIG. 3 is a flowchart showing how to store location information together with a photo file according to one embodiment of the present invention.

[0032] FIG. 4 is an exemplary diagram of directly receiving location information of a location where a terminal is located from a wireless communication device where the terminal is located according to one embodiment of the present invention.

[0033] FIG. 5 is an exemplary diagram showing a message format of information broadcast by a Bluetooth beacon device according to one embodiment of the present invention.

[0034] Figure 6 is a procedure diagram for a terminal to utilize stored photo files and location additional information according to one embodiment of the present invention.

[0035] FIG. 7 is an example diagram of a terminal screen in which a photo and location additional information are displayed together according to one embodiment of the present invention.

[0036] FIG. 8 is an example diagram showing a description of an exhibit displayed on a screen along with a photograph of the exhibit according to one embodiment of the present invention.

[0037] FIG. 9 is an example diagram showing a phone number icon and an Internet address icon overlapping each other in a photo file according to one embodiment of the present invention.

[0038] FIG. 10 is an example diagram showing a phone number displayed together with a photo when a user touches a phone number icon on a screen according to one embodiment of the present invention.

[0039] FIG. 11 is an exemplary diagram showing icons of various actions according to one embodiment of the present invention located at the upper left of the photo.

[0040] FIG. 12 is an exemplary diagram showing an exhibit description being displayed overlaid on a photo when a user touches an exhibit description view icon according to one embodiment of the present invention.

[0041] Figure 13 is a block diagram illustrating one embodiment of a terminal used in the present invention.

[0042] This disclosure may be subject to various modifications and various embodiments. Specific embodiments are illustrated and described in detail in the drawings. However, this is not intended to limit the disclosure to specific embodiments, but rather to encompass all modifications, equivalents, and alternatives falling within the spirit and technical scope of the disclosure.

[0043] In embodiments of the present disclosure, “at least one of A and B” may mean “at least one of A or B” or “at least one of combinations of one or more of A and B.” Furthermore, in embodiments of the present disclosure, “at least one of A and B” may mean “at least one of A or B” or “at least one of combinations of one or more of A and B.”

[0044] When a component is referred to as being "connected" or "connected" to another component, it should be understood that it may be directly connected or connected to that other component, but that there may be other components intervening. Conversely, when a component is referred to as being "directly connected" or "connected" to another component, it should be understood that there are no other components intervening.

[0045] The terminology used in this disclosure is only used to describe specific embodiments and is not intended to limit the present disclosure. The singular expression includes the plural expression unless the context clearly indicates otherwise. In this disclosure, it should be understood that the terms "comprises" or "has" indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but do not preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0046] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art to which this disclosure pertains. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and shall not be interpreted in an idealized or overly formal sense unless explicitly defined herein.

[0047] Throughout the specification, a terminal includes software (applications / programs) stored on a computer-readable storage medium, and hardware such as a processor, memory, a screen, and a communication module. The processor, in cooperation with the hardware, runs one or more applications. The screen can display a user interface provided by the application. Depending on the terminal type, the screen can receive user input, such as touch input. The communication module can communicate with a server via a communication network or with other terminals or devices via device-to-device communication (D2D communication). The terminal can be implemented in various forms, and can refer to various devices that a user can carry and use while moving, such as a communication-capable tablet PC, wireless phone, mobile phone, smart phone, smart watch, smart glass, e-book reader, PMP (portable multimedia player), portable game console, navigation device, digital camera, DMB (digital multimedia broadcasting) player, digital audio recorder, digital audio player, digital picture recorder, digital picture player, digital video player, etc. Here, the user refers to a person who uses the terminal.

[0048] An application is software stored on a computer-readable storage medium, containing instructions and data for executing the operations of the present disclosure. The application is installed on a terminal and executed there. Furthermore, the application can communicate with a designated server via a communication network. Hereinafter, the application may be simply referred to as an app.

[0049] A server may include one or more processors, a memory that loads a computer program to be executed by the processors, a storage device that stores the computer program and various data, and a communication interface.

[0050] In this disclosure, 'touch' or 'tap' means that the user lightly taps a certain part of the screen in order to perform some action on the terminal, and this can be viewed as an action similar to clicking a certain part of the screen with a mouse on a PC, etc.

[0051] In the present invention, location information refers to latitude, longitude, and altitude information, and location additional information refers to additional information related to the location. For example, it may be the name of a store or building at the location, but is not limited to the examples described above.

[0052] Hereinafter, preferred embodiments of the present disclosure will be described in more detail with reference to the attached drawings. In order to facilitate an overall understanding in describing the present disclosure, identical reference numerals will be used for identical components in the drawings, and redundant descriptions of identical components will be omitted.

[0053] Figure 1 is an exemplary diagram showing a screen (210), a terminal (200), and a user (100) used in one embodiment of the present invention. The user (100) is a person who uses the terminal (200), and the screen (210) is one of the devices constituting the terminal (200), which displays a user interface and can receive touch inputs, etc. from the user (100).

[0054] First, to facilitate understanding of the present invention, we briefly introduce EXIF ​​(Exchangeable Image File Format), a format for additional information stored in photo files. EXIF ​​is an image file metadata format used in digital cameras, and EXIF ​​data is stored as part of the image file. EXIF ​​metadata contains various pieces of information, and detailed information can be found on the related Internet site (https: / exiftool.org).

[0055] However, the additional information stored in EXIF ​​may not be very useful to the general public. Information that is useful to people may include the shooting date or location information such as latitude, longitude, and altitude obtained from GPS signals. Among the additional information, the shooting date is very useful for sorting photos by date, but the latitude and longitude location information is not meaningful to the user (100) on its own and requires an additional app that displays the latitude and longitude information on a map. FIG. 2 shows an example screen for executing a commercial app that displays the latitude and longitude information stored in a photo file on a map. In FIG. 2, the part where the actual photo appears is indicated as the "screen where the photo is displayed." For example, a user can tap "..." on the screen of FIG. 2 and then tap "View Map Location" to launch the map app. When the map app is launched, the map app can display the location where the photo was taken on the map using the latitude and longitude information stored in the photo. As described above, various additional information stored in the existing EXIF ​​format may not provide much convenience to the user (100).

[0056] In order to solve the above-mentioned problem, the present invention proposes a method of acquiring location additional information that may be useful to people by means of wireless communication and storing it together with a photo file. Fig. 3 shows a process diagram according to an embodiment of the present invention to achieve the above-mentioned purpose. The operating method of a terminal (200) according to an embodiment of the present invention includes a step (S100) of acquiring location additional information using wireless communication at the current location of the terminal (200); and a step (S200) of storing the acquired location additional information together with a file of a photo taken at the location.

[0057] Obtaining additional location information from the current location of the terminal (200) (S100) can be accomplished via wireless communication. The present disclosure proposes two methods for obtaining additional information via wireless communication. The first method involves the terminal (200) directly obtaining additional location information from a wireless communication device, while the second method involves the terminal accessing a server providing additional location information and receiving the additional location information.

[0058] FIG. 4 illustrates an example of directly receiving location information about a location where a terminal (200) is located from a wireless communication device (300) located at the location where the terminal (200) is located. In FIG. 4, the communication range of the wireless communication device is indicated by a dotted line, and the terminal is within the communication range within which the signal transmitted by the wireless communication device can be received. In the above case, the terminal can determine the location of the wireless communication device as its own location. The wireless communication device providing the location information may be a device-to-device communication (D2D) device. For example, the wireless communication device in FIG. 4 may be one of the device-to-device communication devices such as Bluetooth, WiFi direct, Near Field Communication (NFC), and Ultra Wideband (UWB). A smartphone terminal has the four device-to-device communication means built-in. However, in addition to the above device-to-device communication devices, various device-to-device communication devices exist, and the present invention is not limited to the above-described device-to-device communication devices.

[0059] For example, the terminal-to-terminal communication device of FIG. 4 may be a beacon device. A Bluetooth beacon device such as BLE (Bluetooth Low Energy) may periodically broadcast various information. The broadcasted information may be composed of a 'Tag ID' and a 'value' similar to the EXIF ​​format. For example, in EXIF, the pair of 'Tag ID' and 'value' may be '0xfde9' and '7E93-750E-TCY0-0045', where '0xfde9' represents a serial number and '7E93-750E-TCY0-0045' may represent a serial number. Here, '0x' represents hexadecimal notation. Although an example of the EXIF ​​format was given above, the method of broadcasting the location additional information is not limited to the example of the EXIF ​​described above. FIG. 5 shows an example of a message format in which a Bluetooth beacon device broadcasts information. Data fields such as the Bluetooth beacon device's ID (identifier), TagID1, Value1, TagID2, and Value2 are displayed. For example, the value of TagID1 may be '0x0003', which represents the building name, and the value of value1 may be 'Hyundai Outlet Daejeon Branch'.

[0060] The above broadcasted information may include one or more of the ID (identifier) ​​of the beacon device, a predetermined location ID, the name of the building where the beacon device is located, a predetermined building ID, the floor number within the building where the beacon is installed, the name of the country where the beacon device is located or a predetermined country ID, the name of the city where the beacon device is located or a predetermined city ID, the address of the location where the beacon device is located, the phone number of the building where the beacon device is located, the name of the store where the beacon device is located or the store address or the store phone number, the Internet address where the store's items can be purchased or the Internet address of the store operator or a predetermined store ID, the name of an event or performance held at the location where the beacon device is located, the name of the event or performance venue or the performance venue, the performers of the event or performance, the order of the event or performance, the performance synopsis, the time information of the event or performance, the Internet address providing information on the event or performance, the phone number providing information on the event or performance, the predetermined application ID, and data pre-assigned to the location by the predetermined application. Here, as described above, the location where the beacon device is located can be determined as the location of the terminal (200).

[0061] The information broadcasted above is explained in more detail as follows. The ID of the beacon device refers to a value assigned in advance to each beacon device to distinguish each beacon device. The name of the building where the beacon device is located may be 'Hyundai Outlet Daejeon Branch' as ​​in the example described above. The predetermined building ID may be, for example, '0820420955'. The floor number within the building where the beacon is installed may be '3' if the beacon is installed on the 3rd floor. The beacon device may broadcast the name of the country or a predetermined country ID, for example, 'Republic of Korea' or '082'. Similarly, the beacon device may broadcast the name of the city or a predetermined city ID, for example, 'Daejeon' or '042'. The address of the location where the beacon device is located may be, for example, '123 Technojungang-ro, Yuseong-gu, Daejeon, Republic of Korea'. The phone number of a building with a beacon device can be, for example, '042-332-2233', and the Internet address (Uniform Resource Locator, URL) can be 'http: / / www.ehyundai.com'. The beacon device can be installed in a store, for example, in 'ABC Mart' on the 3rd floor of the 'Hyundai Outlet Daejeon Branch' building. Therefore, in this case, the beacon device can broadcast 'ABC Mart', or broadcast ABC Mart's phone number '042-332-2550', or ABC Mart's Internet address 'https: / / abcmart.a-rt.com / '. For indoor navigation, the beacon device installed indoors can broadcast a pre-determined location ID. The beacon device can broadcast the address of the store, for example, in the case of ABC Mart, it can broadcast '3rd floor, Hyundai Outlet Daejeon Branch, 123 Technojungang-ro, Yuseong-gu, Daejeon, Republic of Korea'.If a beacon device is installed at an event venue, the beacon device can broadcast information about the event venue, such as the event name, event period, event time, event introduction Internet address, event venue address, and event hosting organization phone number. If a beacon device is installed at a performance venue, the beacon device can broadcast information about the performance venue, such as the performance name, performance period, performance time, performance synopsis, performance introduction Internet address, performance venue address, and event hosting organization phone number. The beacon device can broadcast a pre-determined application ID or data pre-assigned to the location by the pre-determined application. For example, a beacon device installed in front of the first exhibit in a museum can broadcast the exhibit description application ID and the exhibit ID.

[0062] A second method of obtaining location information via wireless communication is for the terminal (200) to access an Internet server that provides location information and receive the location information. In order for the terminal (200) to access the server that provides location information, the terminal (200) must know its current location and the Internet address of the server that provides the location information. This operation can be performed in an indoor navigation app. For example, if the terminal (200) is indoors, the indoor navigation app of the terminal (200) can receive beacon signals from nearby Bluetooth beacon devices to determine its location and receive information about the location from an indoor navigation app server at a predetermined Internet address. Typically, multiple apps can be installed on the terminal (200) and the multiple apps can share information with each other. Therefore, the present invention will omit a description of how a photo app and an indoor navigation app share information.

[0063] Examples of additional location information that can be obtained by connecting to a server are the same as examples of additional location information obtained directly from the beacon device described above.

[0064] Saving the acquired location additional information together with the file of the photo taken at the location (S200) is to record the acquired location additional information in the photo file. For example, step S200 can be performed by predefining the format of the Tag ID and the stored value related to each location additional information, such as EXIF, and storing the value related to the defined Tag ID together in the photo file. This can be implemented by adding the 'Tag ID' and 'value' related to the location additional information to the existing EXIF ​​format. However, it is not limited to the above-described implementation method.

[0065] Figure 6 illustrates a procedure for a terminal (200) to utilize a stored photo file and additional location information. The terminal (200) can utilize the stored photo file and additional location information in various ways (S300). The following describes methods for the terminal (200) to utilize additional location information stored in a photo file.

[0066] First, all saved location information can be checked on the terminal screen (210). Fig. 7 shows an example of a terminal screen (210) in which a photo and location information are displayed together.

[0067] If the saved location information includes a building name or building ID, the terminal (200) can search for all photos containing a specific building name or building ID and display them to the user (100) via the screen (210). Furthermore, if the saved location information includes a country name or country ID, the photos taken can be sorted by country. Furthermore, if the saved location information includes a city name or city ID, the photos taken can be sorted by city.

[0068] If the saved location additional information includes an address, the user (100) can check the location of the address on the screen (210) by touching the address or the map view icon. That is, if the map view icon is touched, the map app is launched, and the map app displays the location of the address on a two-dimensional map using the address. Similarly, the EXIF ​​format can record location information, and if there is location information, the terminal can pass the location information (i.e., latitude and longitude information) to the map app, and the map app can display the location on the map. However, in general, the latitude and longitude information calculated by the terminal by receiving a GPS signal may have an error of several tens of meters, and thus may not represent the exact location where the photo was taken on the two-dimensional map. On the other hand, if the stored address information is used, the map app can display the exact location on the map.

[0069] If the stored location information includes a building's phone number, the user (100) can call the building. For example, in FIG. 7, the user (100) can call the phone number displayed on the terminal screen (210) by touching the phone number or a call icon next to the phone number. Also, FIG. 7 includes an Internet address as one of the location information, and the user (100) can access the website (or server) of the Internet address by touching the Internet address or the Internet access icon next to the Internet address. Since the above-described method of making a phone call or accessing an Internet address is already widely used on smartphones, etc., the detailed process thereof will be omitted.

[0070] Even if the stored location information includes a store's phone number or Internet address, the same operation as a building phone number or Internet address can be performed. In particular, in the case of a store's Internet address, when accessing the Internet address, the image of the photo can be transmitted to the website (or server) of the Internet address so that the website (or server) of the Internet address can search for the image. For example, a user (100) may take a picture of a shoe he or she likes at a certain shoe store and later want to purchase the shoe while viewing the picture. At this time, the user (100) can click the Internet address stored in the picture file, and the terminal (200) can transmit the shoe picture to the store's website (or server) while accessing the store's website (or server). Then, the website can search for products matching the received shoe picture or similar products and transmit them to the terminal (200), and the terminal (200) can display them on the screen (210).

[0071] A file of a photo taken at a store inside a building, for example, the ABC Mart mentioned above, can store '3rd floor, Hyundai Outlet Daejeon Branch, 123 Technojungang-ro, Yuseong-gu, Daejeon, Republic of Korea' as additional location information, and the user (100) can press the address or touch the indoor map icon on the right side of the address to display an indoor map of the 3rd floor of the 'Hyundai Outlet Daejeon Branch' on the terminal screen (210). That is, just as touching the above-mentioned phone call icon connects to a phone call app on a smartphone terminal, touching the indoor map icon connects to an indoor map app to display an indoor map of the above floor of the building.

[0072] Even if the saved location information includes the address, phone number, or Internet address of the venue or performance hall, the location information can be used in the same manner as the building address, phone number, or Internet address described above.

[0073] If the saved location additional information includes a predetermined application ID (identifier) ​​or data pre-assigned to the location by the predetermined application, the ID and data can be utilized in a variety of ways. For example, it can be utilized in an exhibit description app. For example, the ID of the exhibit description app can be '0x1000', and the data pre-assigned to a certain exhibit in the exhibit description app can be '129, 0'. Here, '129' is the ID assigned to the exhibit by the app, and '0' can mean that the description of the exhibit is made in text rather than voice ('1'). Fig. 8 is an example diagram showing a description of an exhibit displayed on the screen along with a photo of the exhibit. The exhibit description app can operate in conjunction with a photo app, and when a user (100) clicks on the exhibit ID displayed along with the photo of the exhibit, he can view the description of the exhibit, as shown in Fig. 8. Additionally, the terminal (200) can search for photos containing the application ID '0x1000' and arrange them on the screen (210), and the user (100) can view the arranged photos along with a description.

[0074] When a photo is taken at a store, various store information can be stored together in the photo file as location information, as described above. Furthermore, if the terminal (200) has electronic receipts, the stored location information can be used to search for electronic receipts purchased at the store. Specifically, a search can be performed if the store name stored in the photo file is identical to the store name in the electronic receipt, or if the store ID stored in the photo file is identical to the store ID in the electronic receipt.

[0075] Since most photo files store shooting time information, the terminal (200) can find an electronic receipt among the retrieved receipts whose shooting time and receipt issuance time are closest to those stored in the photo file, and display the found electronic receipt information on the terminal screen (210).

[0076] For example, a woman can look at a photo of food taken at a restaurant two years ago and simultaneously see a receipt from that restaurant, which will tell her the names and prices of the food in the photo.

[0077] Here, the woman may not want to see the receipt itself, but may only be curious about the names and prices of the food in the photo. Therefore, the terminal (200) can extract only the list of food (items) and price information from the found electronic receipt and display them on the screen (210). Currently, various electronic receipt apps exist. The electronic receipt of each electronic receipt app stores the number of items purchased and the names and prices of each item, but the storage format of this data may vary for each app. Extracting the list and prices of items included in the electronic receipt may be implemented differently for each electronic receipt app, and the present invention does not describe a detailed implementation method for extracting only the list and price information of items from the electronic receipt.

[0078] Information that can usually be extracted from an electronic receipt includes a list of purchased products and their prices, a list of food ordered and their prices, receipt issuance time, or payment method information.

[0079] The terminal (200) can store the information extracted from the electronic receipt as additional information in the photo file. The terminal (200) can perform the storage at the request of the user (100) or automatically when the information is extracted from the electronic receipt.

[0080] Another way for the terminal (200) to utilize the location additional information stored in the photo file is to display the location additional information stored in the photo file on the screen (210) by overlapping the photo image. For example, the terminal (200) may display a touchable icon or character on the photo screen (210), and when the icon or character is touched, the location additional information stored in the photo file may be displayed on the screen (210) by overlapping the photo image. FIG. 9 is an example diagram showing a phone number icon and an Internet address icon overlapping and displayed on a photo file, and FIG. 10 is an example diagram showing a phone number displayed together with the photo when the user (100) touches the phone number icon.

[0081] Likewise, other location information, such as the example of the phone number above, may be displayed on the screen (210) along with the photo.

[0082] After step S200, the terminal (200) can display on the screen (210) actions (functions) that can be executed using the location additional information stored in the photo file by overlaying the photo image.

[0083] Here, actions that can be executed using the location information stored in the photo file may include connecting to an Internet address, making a phone call, viewing performance information, viewing event information, viewing an indoor map, and viewing an exhibit description.

[0084] The method of displaying the above actions on the screen (210) by overlaying them on a photographic image may be to display characters or icons representing the execution actions on the screen (210) by overlaying them on the photographic image. When the terminal receives a touch input from characters or icons representing the execution actions displayed on the screen (210) by overlaying them on the photographic image, the terminal can perform the execution actions.

[0085] Figure 11 shows icons for accessing an Internet address, making a phone call, viewing performance information, viewing event information, viewing an indoor map, and viewing an exhibit description, located in the upper left corner of the photo. Figure 12 shows that when a user touches the View Exhibit Description icon, the exhibit description is superimposed on the photo.

[0086] In Fig. 11, six icons are displayed, but the user (100) may not like to see six icons displayed in the photo. Therefore, the terminal (200) may display the corresponding execution action icon only when the location additional information contains information that enables an execution action. Alternatively, the terminal (200) may display only the location additional information of the option that the user (100) has pre-selected to display by overlaying it on the photo.

[0087] After step S200, the terminal (200) can delete the location additional information stored in the photo file. The user (100) can preset deletion for each location additional information in the terminal (200), and the terminal (200) can select and delete the location additional information to be deleted according to the deletion option set above. Alternatively, the location additional information set to be deleted may not be stored in step S200. In addition, the deletion of the location additional information stored in the photo file can be set to occur only when the terminal (200) transmits the photo to an external device other than the terminal, such as a server, a PC, or another user terminal, and the terminal (200) can perform the deletion operation according to the above setting when transmitting the photo.

[0088] Fig. 13 is a block diagram illustrating an embodiment of a terminal (200) configuration. In Fig. 13, a different symbol 600 is assigned to the terminal (200), but both 200 and 600 refer to the same terminal.

[0089] Referring to FIG. 13, the terminal (600) may include at least one processor (610), a memory (620), a transceiver (630) connected to a network to perform communication, and a wireless communication device (640) having a transmitter for transmitting a wireless signal and a receiver for receiving a wireless signal. In addition, the terminal (600) may further include an input interface device (650), an output interface device (660), a storage device (670), etc. Each component included in the terminal (600) may be connected to each other by a bus (680) and may communicate with each other. However, each component included in the terminal (600) may be connected through an individual interface or individual bus centered on the processor (610), rather than a common bus (680). For example, the processor (610) may be connected to at least one of a memory (620), a transceiver (630), a wireless communication device (640), an input interface device (650), an output interface device (660), and a storage device (670) via a dedicated interface.

[0090] The processor (610) can execute program commands stored in at least one of the memory (620) and the storage device (670). The processor (610) may refer to a central processing unit (CPU), a graphics processing unit (GPU), or a dedicated processor in which methods according to embodiments of the present invention are performed. Each of the memory (620) and the storage device (670) may be configured with at least one of a volatile storage medium and a non-volatile storage medium. For example, the memory (620) may be configured with at least one of a read-only memory (ROM) and a random access memory (RAM).

[0091] The operations of the method according to the embodiments of the present disclosure can be implemented as a computer-readable program or code on a computer-readable recording medium. A computer-readable recording medium includes any type of recording device that stores information readable by a computer system. Furthermore, a computer-readable recording medium can be distributed across network-connected computer systems, allowing the computer-readable program or code to be stored and executed in a distributed manner.

[0092] Additionally, the computer-readable recording medium may include hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, etc. The program instructions may include not only machine language codes produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc.

[0093] While some aspects of the present disclosure have been described in the context of a device, they may also represent a description of a corresponding method, wherein a block or device corresponds to a method step or a feature of a method step. Similarly, aspects described in the context of a method may also be described as a corresponding block or item or a feature of a corresponding device. Some or all of the method steps may be performed by (or using) a hardware device, such as, for example, a microprocessor, a programmable computer, or an electronic circuit. In some embodiments, at least one or more of the most important method steps may be performed by such a device.

[0094] In embodiments, a programmable logic device (e.g., a field-programmable gate array) may be used to perform some or all of the functions of the methods described herein. In embodiments, the field-programmable gate array may operate in conjunction with a microprocessor to perform one of the methods described herein.

[0095] Although the present disclosure has been described with reference to preferred embodiments thereof, it will be understood by those skilled in the art that various modifications and changes may be made to the present disclosure without departing from the spirit and scope of the present disclosure as set forth in the claims below.

[0096] There is.

Claims

1. A method of operating a terminal that stores and utilizes photo files, A step of obtaining additional location information about the current location of the terminal using wireless communication; and A step of storing the acquired location information together with a file storing a photo taken at the location, How to store and use location information 2. In paragraph 1, The above location additional information is: Location name, pre-defined location ID (identifier), country name, city name, building name, pre-defined building ID, building address, building manager's phone number, floor number of the terminal within the building, building information providing internet address, pre-defined indoor map app ID, terminal location coordinates on the indoor map used by the pre-defined indoor map app, store name, pre-defined store ID, store business hours, store phone number, internet address where the store's items can be purchased, store operator's internet address, event or performance name, event or performance venue name, event or performance performer, event or performance order, performance synopsis, event or performance opening time information, internet address providing event or performance information, phone number guiding the event or performance, pre-defined application ID, data pre-assigned to the above location by the pre-defined application, including one or more of the following: How to store and use location information 3. In paragraph 1, In the step of obtaining the above location additional information using wireless communication, Directly wirelessly receiving the location additional information from a wireless communication device installed at the location, or connecting to a server having the location additional information and receiving the location additional information from the connected server. How to store and use location information 4. In paragraph 1, The terminal further includes a step of utilizing location additional information stored in the photo file. How to store and use location information 5. In paragraph 4, In the step where the terminal utilizes the location additional information stored in the photo file, Performing one or more of the following: making a call to the above-mentioned saved phone number, accessing the above-mentioned saved Internet address, sorting photos using the name or ID of the above-mentioned saved location, or displaying the location of the above-mentioned saved address on a map of a pre-designated map app. How to store and use location information 6. In paragraph 5, When accessing the above saved Internet address, To transmit the image of the photo to the server of the above Internet address so that the image of the photo can be retrieved from the server of the above Internet address, How to store and use location information 7. In paragraph 4, In the step where the terminal utilizes the location additional information stored in the photo file, If there is store information in the additional information stored in the photo file, electronic receipts paid at the store are searched using the store information, and among the searched receipts, the electronic receipt with the closest stored shooting time and receipt issuance time is selected, and the selected electronic receipt or information extracted from the selected electronic receipt is displayed on the screen or stored as additional information in the photo file. How to store and use location information 8. In paragraph 7, The information extracted from the above-selected electronic receipt includes one or more of the following: a product list, a food order list, a receipt issuance time, a product price, a food price, and payment method information. How to store and use location information 9. In paragraph 4, In the step where the terminal utilizes the location additional information stored in the photo file, If the additional information stored in the above photo file contains a predetermined application ID (identifier) ​​and data assigned to the above location by the above predetermined application, Performing one or more of the following actions: executing the predetermined application using the data assigned to the above location, displaying on the screen where the photo appears that the predetermined application can be executed, and sorting the photos with the predetermined application ID. How to store and use location information 10. In paragraph 9, The above-described application is an application that describes an exhibit, and the data assigned to the location in the above-described application includes at least one of an identifier (ID) of the exhibit and a method of describing the exhibit. How to store and use location information 11. In paragraph 1, The terminal further includes a step of displaying location additional information stored in the photo file on the screen by overlaying it on the photo image. How to store and use location information 12. In paragraph 11, In the step where the terminal displays the location additional information stored in the photo file on the screen by overlaying it on the photo image, An icon or character mapped to a predetermined location additional information in the above photograph image is displayed on the screen by overlapping the above photograph image, and when the icon or character overlaid on the screen is touched, the touched character or icon and the mapped location additional information are selected from the above photograph file, and the selected location additional information is displayed on the screen by overlapping the above photograph image. How to store and use location information 13. In paragraph 1, The terminal further includes a step of displaying on the screen overlaid the photo image the actions that can be executed using the location additional information stored in the photo file. How to store and use location information 14. In paragraph 13, Actions that can be performed using the location information stored in the above photo file include one or more of accessing an Internet address, making a phone call, viewing performance information, viewing event information, viewing an indoor map, viewing an exhibit description, and listening to an exhibit description. How to store and use location information 15. In paragraph 13, In the step of displaying actions that can be executed by using the location information stored in the above photo file on the screen by overlaying the photo image, The above-mentioned actions that can be performed are superimposed on the above-mentioned photographic image and displayed on the screen as characters or icons mapped to them. How to store and use location information 16. In paragraph 15, When a touch input is received through the above character or icon that appears on the screen overlapping the above photographic image, a predetermined execution action mapped to the character or icon is performed. How to store and use location information 17. In a terminal that stores and utilizes photo files, A wireless communication device that transmits and receives wireless signals and Including a processor connected to the above wireless communication device, The above processor, Acquire additional location information about the current location of the terminal using wireless communication, The location information obtained above is stored together with the photo file that stores the photo taken at the above location. Terminals that store and utilize additional location information

Images