Information processing device, control method for information processing device, program, and storage medium

The information processing device ensures accurate display or notification of place names, addressing the issue of incomplete network environments and database insufficiencies to maintain image quality and user clarity.

JP2026182098APending Publication Date: 2026-11-19CANON KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2025078029
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2025-05-08
Publication Date
2026-11-19

AI Technical Summary

Technical Problem

Existing technologies fail to address the issue of acquiring place name information when network environments are unreliable, or when the image lacks position information or the database is incomplete, leading to potential user misidentification and degraded image quality.

Method used

An information processing device that requests and displays place name information in a non-overlapping area if available, or provides notification if unavailable, using a hierarchical place name database and network connectivity to manage place name acquisition.

Benefits of technology

Prevents user misidentification and maintains image quality by ensuring place name information is accurately displayed or indicated when available, or providing clear notifications when it is not.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026182098000001_ABST
    Figure 2026182098000001_ABST
Patent Text Reader

Abstract

This system helps prevent user misidentification and a decline in image quality when name information related to the location indicated by location data cannot be obtained. [Solution] A means for acquiring location information, A request means for requesting name information, which is information indicating the name of the place indicated by the location information acquired by the acquisition means, If name information is obtained in response to the above request, the system controls the display of the name to be superimposed based on the obtained name information in a first area that is not superimposed on the image, and to display the name to be superimposed in a second area that is superimposed on the image. If name information cannot be obtained in response to the aforementioned request, a control means controls the display of notification information that is not subject to being superimposed on the image in an area that is not superimposed on the image, and prevents the display of a name related to a location in the second area. It is characterized by having the following features.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, a control method for an information processing apparatus, a program, and a storage medium, and particularly to a technique for outputting a place name using position information.

Background Art

[0002] A technique is known for printing an image with date information and a place name at the time of shooting superimposed thereon.

[0003] Patent Document 1 proposes referring to a location information database from position information based on GPS signals added to photograph data, acquiring location information, and superimposing and printing the location information on a photographic image. The location information database is a database that associates position information consisting of longitude and latitude with the name of a building at the location indicated by the position information and the place name of the location.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] Even when it is desired to acquire name information related to the location indicated by position information, place name information may not be acquired due to factors such as the network environment, the presence or absence of position information in an image, and the presence or absence of place name information in a database. If the place name information cannot be acquired and no place name is output, the user may mistakenly recognize that some kind of malfunction (freeze, breakdown, etc.) has occurred in the apparatus. On the other hand, when it is desired to output an image with a place name superimposed thereon, if something different from the place name is superimposed on the image just because the place name cannot be acquired, the quality of the image may deteriorate. Patent Document 1 does not consider cases where the place name information of an image cannot be acquired. [Means for solving the problem]

[0006] In view of the above problems, the present invention aims to provide a mechanism that prevents user misidentification and a decline in image quality when name information related to a location indicated by location information cannot be obtained.

[0007] The information processing device of the present invention is A means of acquiring location information, A request means for requesting name information, which is information indicating the name of the place indicated by the location information acquired by the acquisition means, If name information is obtained in response to the above request, the system controls the display of the name to be superimposed based on the obtained name information in a first area that is not superimposed on the image, and to display the name to be superimposed in a second area that is superimposed on the image. If name information cannot be obtained in response to the aforementioned request, a control means controls the display of notification information that is not subject to being superimposed on the image in an area that is not superimposed on the image, and prevents the display of a name related to a location in the second area. It is characterized by having the following features. [Effects of the Invention]

[0008] According to the present invention, when name information related to location information cannot be obtained, it is possible to prevent user misidentification and a decrease in image quality. [Brief explanation of the drawing]

[0009] [Figure 1] This block diagram shows the configuration of the data processing system according to this embodiment. [Figure 2] This is a block diagram showing the hardware configuration of an image processing device. [Figure 3] This is an example of the print settings screen. [Figure 4] This is an example of the detailed settings screen. [Figure 5] This is an example of the location setting screen. [Figure 6]This is a diagram showing an example of position information and place name information. [Figure 7] This is a flowchart of print setting processing. [Figure 8] This is a diagram showing the data structure of place name management information. [Figure 9] This is a flowchart of update processing for place name management information. [Figure 10] This is a display example of notification information indicating that place name information cannot be acquired. [Figure 11] This is a flowchart of update processing for a place name character string. [Figure 12] This is a flowchart of detailed setting processing. [Figure 13] This is a flowchart of shooting location setting processing. [Figure 14] This is a flowchart of update processing for a shooting location setting screen. [Figure 15] This is a diagram showing an arrangement example of a place name character string and a date character string. [Figure 16] This is a display example of a place name batch application check box. [Figure 17] This is an example of an image in which place name character strings of a plurality of pieces of place name information are superimposed. [Mode for Carrying Out the Invention]

[0010] In the location information database (place name information database), a plurality of place names with different levels of detail (hierarchies), such as detailed place names at the municipal level and general place names at the prefectural level, are managed as place names corresponding to position information. Having the user perform an operation to specify each time which of the plurality of place names with different levels of detail (hierarchies) to use leads to an increase in the number of operation steps and is cumbersome. On the other hand, depending on the position information, the place names managed in the place name information database may be insufficient, and detailed place names may not be acquired. When a detailed place name cannot be acquired but a general place name can be acquired, not outputting a place name just because the detailed place name cannot be acquired leads to a reduction in usability. Patent Document 1 does not consider a situation where a plurality of place names with different levels of detail (hierarchies) are managed.

[0011] Furthermore, even when it is desired to acquire name information related to the location indicated by position information, the place name information may not be acquired depending on factors such as the network environment, the presence or absence of position information in the image, and the presence or absence of place name information in the database. If the place name information cannot be acquired and no place name is output, the user may mistakenly recognize that some kind of malfunction (freezing, failure, etc.) has occurred in the apparatus. On the other hand, when it is desired to output a place name superimposed on an image, if something different from the place name is superimposed on the image just because the place name cannot be acquired, the quality of the image may be degraded. Patent Document 1 did not consider the case where the place name information of an image cannot be acquired.

[0012] Furthermore, when superimposing visible additional information on an image, it is preferable to arrange the additional information at a position on the image where it does not overlap an important subject. On the other hand, however, when a plurality of types of additional information such as a place name and a date are superimposed on an image, there remains a problem regarding what kind of arrangement is preferable. Patent Document 1 did not consider the arrangement when superimposing a plurality of types of additional information.

[0013] Hereinafter, the best mode for carrying out the present invention will be described with reference to the drawings.

[0014] Figure 1 is a block diagram illustrating the configuration of a data processing system 100 according to the present embodiment. The data processing system 100 includes an access point 101, an image processing apparatus 200, and a printing apparatus 102, and the image processing apparatus 200 and the printing apparatus 102 are connected via a network constructed by the access point 101. Note that a plurality of image processing apparatuses 200 and a plurality of printing apparatuses 102 may be connected.

[0015] The access point 101 is a master unit of a wireless LAN having a general network router function, and provides a wireless LAN via Wi-Fi (trademark) in a home, office, or the like. The access point 101 is an access point (AP) in wireless LAN communication in an infrastructure mode. LAN stands for Local Area Network.

[0016] The image processing device 200 is a mobile terminal such as a smartphone, and runs an operating system for small terminals and programs that control calls and data communication. Alternatively, the image processing device 200 may be a personal computer without voice control, location detection control, or mobile phone data communication. The image processing device 200 can also store programs such as the printing application software (hereinafter referred to as the printing app) described later. Print data created using the printing app can be transmitted to the printing device 102 via the network established by the access point 101. The image processing device 200 can connect to the internet via the access point 101, and the printing app can be downloaded and installed via the internet. The image processing device 200 can also install the printing app from a recording medium attached to the image processing device 200. Furthermore, the image processing device 200 can connect to the image management server 103 and the geographical information management server 104 via the network established by the access point 101 and the internet.

[0017] The printing device 102 (image processing device, image forming device) is a digital multifunction device equipped with various job execution functions such as printer, copy, scanner, and fax transmission functions, and is a printer. The user can instruct the printing device 102 to execute jobs such as printing, scanning, and faxing by operating the image processing device 200.

[0018] The image management server 103 is a server capable of storing image data captured by users with imaging devices such as cameras, and can be connected to the image processing device 200 via the network and the internet established by the access point 101.

[0019] The geographical name information management server 104 is a system that uses positioning sensors such as GPS (Global Positioning System). It is a server system that manages geographical name information corresponding to location information and can connect to the image processing device 200 via the network and the internet established by the access point 101. The geographical name information management server 104 functions as a database of geographical name information (location information), which is the name of a place corresponding to location information.

[0020] Figure 2 is a block diagram showing the hardware configuration of the image processing device 200. The image processing device 200 includes a line connection unit 201, a wireless LAN unit 202, a camera 203, a touch panel display 204, and a GPS unit 205. The image processing device 200 may also include a unit for performing other communication methods such as BLE (Bluetooth Low Energy) (Bluetooth is a trademark).

[0021] Furthermore, the image processing device 200 connects various memories and circuits via an internal bus 211. Specifically, these include a CPU 212, program memory 213, data memory 214, non-volatile memory 215, line control circuit 216, wireless LAN control circuit 217, camera control circuit 218, operation unit control circuit 219, and GPS control circuit 220. The CPU 212 (Central Processing Unit) includes at least one (one or more) processors and controls the entire system of the image processing device 200. The program memory 213 is in the form of ROM (Read Only Memory) and can store the embedded operating system (OS) of the image processing device 200 and programs such as the printing application of this embodiment. The data memory 214 is in the form of RAM (Random Access Memory) and is a memory for the CPU 212 to execute various programs and is a work memory area where applications execute programs. The non-volatile memory 215 is composed of memory such as flash memory and stores data that needs to be saved even after the image processing device 200 is restarted (for example, image data to be saved and application program management information managed by the printing application). In this embodiment, each application program stored in the program memory 213 is controlled for software execution under the management of the OS. Specifically, this is achieved by the CPU 212 loading the application programs stored in the program memory 213 into the data memory 214.

[0022] The line control circuit 216 is connected to the line connection unit 201 and can connect to the mobile phone network to make calls and send / receive data. The wireless LAN control circuit 217 is connected to the wireless LAN unit 202 and can communicate with other devices via wireless LAN. The wireless LAN unit 202 can communicate data (packet) using a communication method compliant with, for example, the IEEE 802.11 series (IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, etc.). The camera control circuit 218 controls image capture via the camera 203. The CPU 212 can store images captured by the camera control circuit 218 via the camera 203 in the data memory 214 or non-volatile memory 215. The operation control circuit 219 controls the output of image data displayed on the touch panel display 204 and controls input of operations from the user via the touch panel display 204. The GPS control circuit 220 determines the current location based on information from GPS via the GPS unit 205. Furthermore, the CPU 212 can record the shooting location for each image file by embedding the identified location information into the image file captured by the camera control circuit 218 via the camera 203. In addition to images captured by the camera control circuit 218 via the camera 203, the CPU 212 can also store images acquired from external sources in the data memory 214 or non-volatile memory 215, or conversely, transmit them to external sources. Specifically, these include images acquired through the mobile phone network connected via the line control circuit 216 and line connection unit 201, and images acquired through the internet connected via the wireless LAN control circuit 217 and wireless LAN unit 202.

[0023] This section explains how to overlay place names onto an image to be printed using a printing application.

[0024] Figure 3 shows an example of the display of the print settings screen 300 provided by the print application on the touch panel display 204. When the print application is launched on the image processing device 200 (the print application is opened) and the image to be printed is selected via the top screen and the image selection screen, the print settings screen 300 is displayed. The top screen accepts the user's selection of what kind of printing to perform, and selectable items such as photo printing, photo layout, calendar, card, disc label, and collage are displayed. If photo printing is selected, a screen is displayed to select either photos on the device (image files stored on a recording medium managed by the image processing device 200) or web services (image files stored on a server on the internet). If photos on the device are selected, a list of thumbnails of image files stored on a recording medium managed by the image processing device 200 is displayed as a list of image options (photo selection screen). If web services are selected, a list of thumbnails of image files stored on a server on the internet corresponding to the user account is displayed as a list of image options (photo selection screen). When the photo selection screen accepts the user's selection of one or more images, the print settings screen 300 shown in Figure 3 is displayed to accept print settings for the selected images.

[0025] Area 301 is the back button. When Area 301 is touched, the screen returns to the screen that was displayed before the print settings screen 300 was displayed. Area 302 is the area that displays the print preview image of the image selected by the user on the photo selection screen. If the shooting location setting described later is turned on, the location name 303 will be superimposed on the preview image displayed in Area 302, and if the date setting described later is turned on, the date 304 indicating the date and time the image was taken will be superimposed. Area 305 is the display image switching button used to switch the displayed image in Area 302 when printing multiple images at once. Area 306 is the printer management item, and displays the identification information of the printer that is currently registered and the target of the print command. Also, when Area 306 is touched, the printer management process, which is the process of changing the target printer of the print command, is executed. Area 307 is the setting change item, and indicates that the user will return to the detailed settings screen. When Area 307 is touched, the user returns to the detailed settings screen. The detailed settings screen will be described later in Figure 4. Area 308 is the print button. When area 308 is touched, the print command to the printer displayed in area 306 is executed. In other words, a print job is sent to the printer.

[0026] Figure 4 shows an example of the display of the detailed settings screen 400 provided by the printing application on the touch panel display 204. Area 401 is the back button. When area 401 is touched, the screen transitions to the print settings screen 300, which was displayed before the detailed settings screen 400 was displayed. Areas 402 to 407 are options for various setting items. When any of areas 402 to 405 is touched and selected, the process corresponding to the touched option is executed from the paper size setting process, paper type setting process, paper feed method setting process, and border setting process. Area 406 is the setting item for date setting. When area 406 is touched and selected, the date setting process is executed. Area 407 is the setting item for shooting location setting. When area 407 is touched and selected, the screen transitions to the shooting location setting screen. Details of the shooting location setting screen will be described later in Figure 5.

[0027] Figures 5(a) and 5(b) show examples of the display of the shooting location setting screen 500 provided by the printing application on the touch panel display 204. Area 501 is the back button. When area 501 is touched, the user transitions to the detailed settings screen 400, which was displayed before the shooting location setting screen 500 was displayed. Area 502 displays whether the shooting location setting is on or off. If "On" is selected, a mark indicating that it is enabled is added next to the "On" indicator, and if "Off" is selected, a mark indicating that it is enabled is added next to the "Off" indicator. The illustrated example is an example of the display when it is on. Area 503 is the preview display area, where an image based on SVG (Scalable Vector Graphics) data, which reflects the result of overlaying the date setting and shooting location setting results onto the image searched on the photo selection screen, is displayed as a preview image. If the location setting described later is turned on, the preview image displayed in area 503 will have the place name 504 superimposed on the area superimposed on the image, and if the date setting described later is turned on, the date 505 will be superimposed. Area 506 is a display image switching button for switching the preview image displayed in area 503 when multiple images are selected.

[0028] Area 507 is a text box for displaying the string of a place name to be superimposed on the image, in an area that is not superimposed on the image. If place name information can be obtained from the place name information management server 104, the string of the obtained place name (in the illustrated example, "Ota Ward") will be displayed in Area 507, as shown in Figure 5(a). If place name information cannot be obtained, the string "(Unknown)" will be displayed as an indication that place name information could not be obtained, as shown in Figure 5(b). In addition, if the user performs a character input operation, the string entered by the user will be displayed in Area 507, regardless of whether place name information has been obtained or not. The string displayed in Area 507 is basically superimposed as a place name 504 on the preview image in Area 503, as shown in Figure 5(a). On the other hand, as shown in Figure 5(b), if place name information cannot be obtained, the string "(Unknown)" will be displayed in Area 507, but no display items caused by the request for place name information, such as the string "(Unknown)", will be superimposed on the preview image in Area 503. In other words, place names and error information are not displayed at the location indicated by code 504. If "(Unknown)" is displayed in area 507, the CPU 212 may display details of the reason why place name information could not be obtained, and the solutions that the user should take to obtain place name information, as notification information on the shooting location setting screen 500. For example, notification information such as "Image data does not contain in-image location information" or "Information corresponding to in-image location information is not registered in the place name information management server" may be displayed.

[0029] Area 508 displays the total number of selected images and the index of the selected images, and displays a string indicating which of the total number of selected images the preview image displayed in Area 503 is. Area 509 displays the size of the place name 504 superimposed on the preview image in Area 503. When Area 509 is touched, a text size setting process is executed to change the size of the superimposed place name string. Area 510 displays the color of the place name 504 superimposed on the preview image in Area 503. When Area 510 is touched, a text color setting process is executed to change the color of the superimposed place name string. Area 511 displays the border color of the place name 504 superimposed on the preview image in Area 503. When Area 511 is touched, a border setting process is executed to change the border color of the superimposed string.

[0030] If the image processing device 200 is connected to the internet, the CPU 212 uses the geographic name information acquisition API to obtain geographic name information corresponding to the location information recorded in the image attribute information from the geographic name information management server 104. API stands for Application Programming Interface. Figure 6(a) shows an example of location information contained in an image file. Figure 6(b) shows an example of geographic name information corresponding to location information obtained using the geographic name information acquisition API (an example of geographic name information managed by the geographic name information management server 104).

[0031] Figure 6(a) is a table showing examples of latitude and longitude indicated by three different location data points. Columns 601 to 603 show location data acquired by GPS at different locations. The latitude and longitude in column 601 are location data acquired at a point in Todoroki Green Space (Location A). The latitude and longitude in column 602 are location data acquired at a point in Seoul (Location B). The latitude and longitude in column 603 are location data acquired at a point in Antarctica (Location C). The image file of an image taken at Location A (an image taken at Location A) contains the location data shown in column 601, acquired by GPS. The image file of an image taken at Location B (an image taken at Location B) contains the location data shown in column 602, acquired by GPS. The image file of an image taken at Location C (an image taken at Location C) contains the location data shown in column 603, acquired by GPS.

[0032] Figure 6(b) shows an example of place names obtained by querying the place name information management server 104 for place names corresponding to the location information of points A to C explained in Figure 6(a). The place name information in columns 611 to 613 is obtained as place name information corresponding to the location information in columns 601 to 603, respectively. For each location information, up to four pieces of place name information can be obtained: landmark information, the first-level place name information which is its parent hierarchy, the second-level place name information, and the third-level place name information. The third-level place name information is contained within the place name indicated by the second-level place name information, and the second-level place name information is contained within the place name indicated by the first-level place name information. In other words, the third-level place name information is a lower-level place name information than the second-level place name information, and the second-level place name information is a lower-level place name information than the first-level place name information. For example, "Nakahara Ward," the third-level place name information in column 611, is geographically located within the area of ​​"Kawasaki City," the second-level place name information in column 611. Similarly, "Kawasaki City," the second-level place name information in column 611, is geographically located within the area of ​​"Kanagawa Prefecture," the first-level place name information in column 611. Conversely, "Kawasaki City" is the name of a part of the area included in "Kanagawa Prefecture," and "Nakahara Ward" is the name of a part of the area included in "Kawasaki City." Other examples of first-level and second-level place name information include "New York State" as the first-level place name information and "Manhattan" as the second-level place name information. The first to third levels of column 611 also correspond to the hierarchical structure of administrative areas (prefecture > city > ward). That is, the first-level, second-level, and third-level place name information are place names at the prefecture level, the municipal level, and more detailed place name information than the second level, respectively. Landmark information refers to geographically significant features that serve as landmarks in relation to their location, regardless of the hierarchical structure of place names, and its inclusion relationship with first- to third-level place name information is arbitrary. For example, the landmark information in column 611, "Todoroki Green Space," is a part of "Nakahara Ward" and is geographically contained within "Nakahara Ward." On the other hand, the landmark information could be "Mount Fuji," but "Mount Fuji" is the name of a mountain in Japan that straddles parts of "Yamanashi Prefecture" and "Shizuoka Prefecture," and there is no inclusion relationship (hierarchical relationship) with "Toyama Prefecture" and "Yamanashi Prefecture," which could be first-level place name information.

[0033] Furthermore, even when querying the place name management server 104 for a place name corresponding to the location information, it may not be possible to obtain one or more of the place name information landmark information, first-level place name information, second-level place name information, or third-level place name information. This occurs because the place name information management server 104 does not have the information. The information indicated as "unavailable" in columns 612 and 613 indicates that the CPU 212 was unable to obtain the place name information even when using the place name information acquisition API because the place name information management server 104 does not have the place name information. For example, in column 613, the first-level place name information, second-level place name information, and third-level place name information were not obtained. Since point C is in Antarctica, there is no administrative area, and therefore, there is no place name that corresponds to the first-level place name information, second-level place name information, or third-level place name information. Furthermore, even if the location information is for a place that actually has landmarks or administrative districts, it cannot be obtained if the landmark information, first-level place name information, second-level place name information, or third-level place name information is not registered in the place name information management server 104.

[0034] Figure 7 shows a flowchart of the print settings process. When the image processing device 200 is instructed to start the print application (the print application is opened), and the image to be printed is selected via the top screen and the photo selection screen, the process shown in Figure 7 begins. This process is achieved when the program of the print application, recorded in the program memory 213, is loaded into the data memory 214 and executed by the CPU 212.

[0035] In S701, CPU212 determines whether the shooting location setting is turned on or off. If the shooting location setting is on, proceed to S702; otherwise, proceed to S703.

[0036] In step S702, CPU212 performs the process of updating the place name management information. The process of updating the place name management information will be described later using Figure 9. Note that the process of updating the place name management information is not performed in processes prior to S702 (i.e., when the top screen or photo selection screen is displayed).

[0037] In S703, CPU212 displays the print settings screen 300 as described in Figure 3. At this time, it performs the same processing as in S1403 to S1410 in Figure 14 (described later) to create SVG data for the image to be printed, and displays a reduced image of the created SVG data as a preview image in area 302. After the image to be printed is selected and the processing in Figure 7 begins, if the shooting location setting is turned on in S701, the print settings screen 300 as described in Figure 3 will be displayed without any user operation (for example, inputting, selecting, or placing a place name). Also, after requesting the acquisition of place name information in the processing of S702, if the place name information is acquired, a reduced image of the SVG data with the place name superimposed will be displayed in area 302 without any user operation.

[0038] In S705, CPU212 determines whether the printer management item (area 306) has been touched. If area 306 is touched, the process proceeds to S706; otherwise, it proceeds to S707.

[0039] In S706, CPU212 executes printer management processing, which is the process of changing the printer to which a print command is sent.

[0040] In S707, CPU212 determines whether the setting change item (area 307) has been touched. If area 307 is touched, the process proceeds to S708; otherwise, it proceeds to S709.

[0041] In S708, CPU212 executes the detailed configuration process. The detailed configuration process will be described later using Figure 12.

[0042] In S709, the CPU 212 determines whether the print button (area 308) has been touched. If area 308 is touched, the process proceeds to S710; otherwise, it proceeds to S711. The CPU 212 also saves the settings configured in S1204 to S1207 of Figure 12 (described later) to the non-volatile memory 215 when area 308 is touched. Therefore, when the user closes the print application and then restarts it, in S703, the SVG data reflecting the settings stored in the non-volatile memory 215 is displayed in area 302. In other words, if the location setting was turned on when the print application was last launched, the application can print an image with the location name superimposed on the image to be printed without the user having to perform the setting operation on the location setting screen explained in Figure 5. Thus, the effort required from the user can be reduced.

[0043] In S710, the CPU 212 processes a print command by sending a print job containing the image to be printed and the print request to the image processing device 200. If the location setting is enabled and place name information is available, the image to be printed is an image with the place name superimposed on it.

[0044] In S711, CPU212 determines whether the back button (area 301) has been touched. If area 301 is touched, proceed to S712; otherwise, proceed to S704.

[0045] In S712, CPU212 displays a notification on the print settings screen 300 asking whether or not to discard the place name management information obtained during the place name management information update process in S702.

[0046] In S713, CPU212 determines whether it has been selected to discard the place name management information obtained in S702. If it has been selected to discard the place name management information, the process proceeds to S714; otherwise, it proceeds to S704.

[0047] In S714, CPU212 discards (erases, clears) the place name management information acquired in S702 from the non-volatile memory 215.

[0048] Figure 8 illustrates the place name management information managed by the printing application. Figure 8 shows the data structure when place name management information 800 is stored in non-volatile memory 215. The CPU 212 records place name information corresponding to the location information attached to the image, obtained using the place name information acquisition API, as place name management information 800 for each image (i.e., associated with the image) in non-volatile memory 215. Place name management information 800 includes a place name acquisition flag 801, a place name string 802, a customization flag 803, and acquisition failure reason information 804. The place name acquisition flag 801 indicates whether or not the place name information corresponding to the image's location information has been acquired using the place name information acquisition API. The place name string 802 is the string that should be superimposed on the image when the shooting location setting is turned on. If the place name information acquired using the place name information acquisition API is superimposed as is, information indicating strings such as "Kawasaki City" or "Seoul Special City" will be recorded. If the user has edited the place name information to be overlaid by performing a text input operation, information indicating the edited (customized) string reflecting the results of the text input by the user is recorded. The customization flag 803 indicates whether or not the user has edited (customized) the place name information to be overlaid by performing a text input operation. The acquisition failure reason information 804 indicates the reason why the place name information could not be acquired when it could not be acquired. For example, information indicating that the location information could not be acquired because the location information was not recorded in the image file (referred to as reason 1) is recorded. Alternatively, let's consider the case where the image file has location information. Information indicating that the corresponding place name information was queried using the place name information acquisition API regarding that location information, but could not be acquired because the corresponding place name was not registered in the place name information management server 104 (referred to as reason 2) is recorded. If there are multiple images for which location information is to be acquired (i.e., images selected on the photo selection screen), multiple place name management information 800 are generated, each corresponding to a different image.

[0049] Figure 9 shows a flowchart of the process for updating place name management information. This process is a detailed explanation of the process S702 in Figure 7. This process is achieved when the program for the printing application, recorded in program memory 213, is loaded into data memory 214 and executed by the CPU 212.

[0050] In S901, the CPU 212 determines whether or not place name management information 800 corresponding to the image to be printed (the image selected on the photo selection screen) is stored in the non-volatile memory 215. If place name management information 800 is not stored for all of the images to be printed, the process proceeds to S902. If place name management information 800 is stored for all of the images to be printed, the process proceeds to S903.

[0051] In S902, CPU212 creates (generates) corresponding place name management information 800 for all images to be printed. The place name management information 800 created in S902 is initially set to False for the place name acquisition flag 801, Null for the place name string 802, False for the customization flag 803, and Null for the acquisition failure reason information 804.

[0052] In S903, the CPU 212 determines whether the image processing unit 200 can connect to the internet. If it determines that it cannot connect to the internet, it proceeds to S904; if it determines that it can connect to the internet, it proceeds to S905.

[0053] At S904, the CPU 212 displays a notification to the user on the print settings screen 300 or the shooting location settings screen 500, indicating that the image processing device 200 cannot connect to the internet and therefore cannot obtain place name information, and then terminates the process of updating the place name management information. Figure 10 shows an example of the notification displayed at S904, indicating to the user that place name information cannot be obtained because there is no internet connection. As shown in the figure, it displays that the shooting location (place name, name of place) could not be obtained, and that the solution to obtain it is to connect to the internet. This notification also indicates that the reason why the place name information could not be obtained is that there is no internet connection.

[0054] In S905, CPU212 sets one of the one or more place name management information 800 corresponding to the image to be printed as the processing target. For example, if there are three images to be printed, it sets the place name management information 800 corresponding to the first image as the processing target.

[0055] In S906, the CPU 212 determines whether the place name acquisition flag 801 of the place name management information 800 to be processed is True. If it is True, the process proceeds to S913 (i.e., the process of acquiring the place name is skipped); otherwise, the process proceeds to S907 and the process of acquiring the place name from S907 onwards is performed.

[0056] In S907, CPU212 obtains location information from the attribute information of the image to be printed. For example, it obtains location information from the Exif (Exchangeable image file format) information of the image file. If the imaging device is set to add location information to images when an image is taken, location information indicating the position of the imaging device, which was acquired using the GPS unit at the time of shooting, is added as attribute information to the captured image. In S907, if location information is added in this way, it is acquired. If the imaging device is not set to add location information to images when an image is taken, or if it does not have a GPS unit and therefore does not have a function to acquire location information, location information is not added to the attribute information of the captured image. If such an image is to be printed, S907 cannot acquire the location information.

[0057] In S908, CPU212 determines whether or not the image's location information was obtained in S907. If it was obtained, the process proceeds to S909; otherwise, it proceeds to S912.

[0058] In S909, CPU212 performs a process to update the place name string using the place name information acquisition API. The process of updating the place name string will be described later using Figure 11.

[0059] In S910, CPU212 determines whether the update of the place name string in S909 was successful. If it is determined to be successful, it proceeds to S911; otherwise (if it is determined to be unsuccessful), it proceeds to S912.

[0060] In S911, CPU212 sets (records) the "place name acquired" flag 801 of the place name management information 800 to True.

[0061] In S912, the CPU 212 sets a string indicating the reason why the place name management information could not be obtained in the place name management information reason information 804, which was expanded in the data memory 214 in S905. The reason why the place name management information could not be obtained, set in S912, is a different string depending on the reason why the place name management information could not be obtained. For example, if it is determined in S908 that the location information in the image could not be obtained, a string indicating that the location information could not be obtained is set. If it is determined in S910 that it is a failure, a string indicating that it is a failure is set. In addition, if the location information could not be obtained because the image does not have location information attached, notification information to inform the user of this may be displayed on the print settings screen 300 or the shooting location setting screen 500.

[0062] In S913, the CPU 212 determines whether the processing from S905 to S912 has been completed for all of the image data to be printed. If it determines that the processing from S905 to S912 has been completed for all of the image data to be printed, the process of updating the place name management information is terminated. If it determines that the processing has not been completed, the process proceeds to S905, and the above processing is performed for the next image. For example, if there are three images to be printed, and the processing for the place name management information 800 corresponding to the first image has been completed, but the processing for the second and third images is not yet complete, the process proceeds to S905. Then, in S905, the processing is repeated with the place name management information 800 corresponding to the second image as the target.

[0063] Figure 11 shows a flowchart of the process for updating place name strings. This process is a detailed explanation of the process S909 in Figure 9. This process is achieved when the program for the printing application, recorded in program memory 213, is loaded into data memory 214 and executed by the CPU 212.

[0064] In S1101, the CPU 212 obtains place name information using the place name information acquisition API from the location information acquired in S907, and stores the acquired place name information in the data memory 214. More specifically, the CPU uses the place name information acquisition API to request the acquisition of two pieces of information, first-level place name information and second-level place name information, from the place name information management server 104 via the internet, using the location information (for example, the location information shown in column 601) as a query. In this embodiment, the acquisition of two pieces of information, first-level place name information and second-level place name information, is described as being requested, but it is also possible to request the acquisition of four pieces of information, including landmark information and third-level place name information.

[0065] In S1102, the CPU 212 determines whether it was able to obtain the second-level place name information from the place name information stored in the data memory 214. If it was able to obtain the second-level place name information, it proceeds to S1103; otherwise, it proceeds to S1104.

[0066] In S1103, CPU212 sets the second-level place name information obtained in S1101 into the place name string 802 of the place name management information 800.

[0067] In S1104, the CPU 212 determines whether it was able to obtain the first-level place name information from the place name information stored in the data memory 214. If it was able to obtain the first-level place name information, it proceeds to S1105; otherwise, it proceeds to S1107.

[0068] In S1105, CPU212 sets the first-level place name information obtained in S1101 into the place name string 802 of the place name management information 800.

[0069] In S1106, the CPU 212 records information in the data memory 214 indicating that the update of the place name string was successful, and terminates the place name string update process. In this case, the result in S910, as mentioned above, is determined to be Yes.

[0070] In S1107, the CPU 212 records information in the data memory 214 indicating that the update of the place name string failed, and terminates the place name string update process. In this case, the result in S910, as described above, is determined to be No.

[0071] As explained above, if the second-level place name information is obtained in S1001, the second-level place name information is set to place name string 802 in S1003. Also, even if the second-level place name information is not obtained in S1001, if the first-level place name information is obtained, the first-level place name information is set to place name string 802. In other words, the CPU 212 can display a preview image with superimposed place name information in S703 or S1410 without requiring the user to select whether to set the second-level or first-level place name information to place name string 802. Thus, it is possible to superimpose a more suitable place name while reducing the effort required from the user. That is, it is possible to use the most suitable place name from among multiple place names at different levels with ease of operation.

[0072] Figure 12 shows a flowchart of the detailed settings process. This process is a detailed version of the S708 process in Figure 7. This process is achieved when the program for the print application, recorded in the program memory 213, is loaded into the data memory 214 and executed by the CPU 212.

[0073] In S1201, CPU212 displays the detailed settings screen 400, as explained in Figure 4.

[0074] In S1203, CPU212 determines whether the shooting location setting item (area 407) has been touched. If area 407 has been touched, proceed to S1204; otherwise, proceed to S1205.

[0075] In S1204, CPU212 executes the shooting location setting process. The shooting location setting process will be described later using Figure 13.

[0076] In S1205, CPU212 determines whether the date setting item (area 406) has been touched. If area 406 has been touched, proceed to S1206; otherwise, proceed to S1207.

[0077] In S1206, CPU212 executes a date setting process, which changes the date setting for printing on the image to be printed. Specifically, it switches the date setting off if it was on, and on if it was off. In other words, each time the date setting item is touched, the date setting is toggled on and off. The set content is recorded in non-volatile memory215.

[0078] In S1207, CPU212 determines whether any of the other setting area, i.e., area 402-405, has been touched. If any of area 402-405 has been touched, the process proceeds to S1208; otherwise, it proceeds to S1209.

[0079] In S1208, CPU212 performs setting processing for the setting item that was determined to have been touched in S1207. Specifically, if the paper size setting item (area 402) is touched, it processes to change the paper size setting of the image to be printed, and changes the paper size setting according to the user's operation. If the paper type setting item (area 403) is touched, it processes to change the paper type setting of the image to be printed, and changes the paper type setting according to the user's operation. Similarly, the paper feed method and border setting (borderless printing setting) settings can also be changed according to the user's operation.

[0080] In S1209, CPU212 determines whether the back button (area 401) has been touched. If area 401 is touched, the detailed settings process ends, the print settings screen is displayed, and the process proceeds to S705. If area 401 is not touched, the process proceeds to S1202.

[0081] Figure 13 shows a flowchart of the shooting location setting process. This process is a detailed explanation of the process at S1204 in Figure 12. This process is achieved when the program for the printing application, recorded in program memory 213, is loaded into data memory 214 and executed by the CPU 212.

[0082] In S1301, CPU212 displays the shooting location setting screen 500, as explained in Figure 5.

[0083] In step S1302, CPU212 performs the update process for the shooting location setting screen. The process for updating the shooting location setting screen will be described later using Figure 14.

[0084] In S1303, CPU212 determines whether or not an operation to toggle the shooting location setting on / off (touch operation on area 502) has occurred. If an operation to toggle the shooting location setting on / off has occurred, the process proceeds to S1304; otherwise, it proceeds to S1305.

[0085] In S1304, CPU212 switches the shooting location setting on / off. More specifically, if the shooting location setting was off, and an operation to switch the shooting location setting on / off was performed, the shooting location setting is switched on, and the process proceeds to S1302. Also, in response to the switch to on, the shooting location setting screen update process described later activates and displays areas 503-511, and if place name information has not yet been acquired for the image being set, the place name information is acquired and overlaid on the preview image. Also, if the shooting location setting was on, and an operation to switch the shooting location setting on / off was performed, the shooting location setting is switched off, and the process proceeds to S1302. Also, in response to the switch to off, the shooting location setting screen update process described later deactivates (grays out) areas 503-511 (excluding areas 501 and 502). Therefore, S1305, S1307, and S1309, described later, will be judged as No regardless of the actual operating status as long as the shooting location setting is turned off.

[0086] In S1305, CPU212 determines whether or not an editing operation has been performed on the string displayed in the text box (area 507). Specifically, it determines whether or not area 507 has been touched and whether or not a text input operation has been performed to edit the displayed place name. When area 507 is touched, a soft keyboard is displayed, and the string displayed in area 507 can be edited according to the operation on the soft keyboard. If it is determined that an editing operation has been performed on the string representing the place name displayed in area 507, the process proceeds to S1306; otherwise, the process proceeds to S1307.

[0087] In S1306, CPU212 updates the place name string 802 of the place name management information 800 of the preview image to the string edited by the user in S1305. It also sets the customization flag 803 to True. Then, proceeding to S1302, the preview image reflecting the changed place name string 802 in place name 504 is displayed in area 503.

[0088] In S1307, CPU212 determines whether an operation has been performed to edit the appearance of the place name string superimposed on the image. Specifically, it determines whether an operation has been performed on any of the regions 509 to 511. If an operation has been performed on any of the regions 509 to 511, the process proceeds to S1308; otherwise, it proceeds to S1309.

[0089] In S1308, CPU212 performs a setting process to change the font size, color, and border of the place names superimposed on the image, in response to operations on areas 509-511. Then, it proceeds to S1302 to apply the changed appearance.

[0090] In S1309, the CPU 212 determines whether the display image switching button (area 506) has been touched. If it is determined that area 506 has been touched, the CPU 212 switches the image to be displayed from among the multiple images selected as the print target (overlay target image), performs the process in S1302, and displays the shooting location setting screen with the switched image. If area 506 is not touched, the process proceeds to S1310.

[0091] In S1310, CPU212 determines whether the back button (area 501) has been touched. If area 501 has been touched, the shooting location setting process ends and the detailed settings screen is displayed, proceeding to S1203. If area 501 is not touched, proceeding to S1303.

[0092] Figure 14 shows a flowchart of the update process for the shooting location setting screen. This process is a detailed explanation of the process S1302 in Figure 13. This process is achieved when the program for the printing application, recorded in the program memory 213, is loaded into the data memory 214 and executed by the CPU 212.

[0093] In S1401, the CPU 212 refers to the setting information stored in the non-volatile memory 215 and determines whether the location printing setting is turned on. If it determines that the location printing setting is turned on, the process proceeds to S1402; otherwise (if it is set to off), the process proceeds to S1411.

[0094] In S1402, CPU212 performs the process of updating the place name management information. The process of updating the place name management information is described above using Figure 9.

[0095] In S1403, the CPU 212 loads (acquires) the place name management information 800 corresponding to the image displayed in area 503 into the data memory 214.

[0096] In S1404, the CPU 212 determines whether at least one (either one or both) of the place name acquisition flag 801 and the customization flag 803 of the place name management information 800 is True. If at least one (either one or both) of the place name acquisition flag 801 and the customization flag 803 is True, the process proceeds to S1405; if both are false, the process proceeds to S1406.

[0097] In S1405, CPU212 displays the string set in the place name string 802 of the place name management information 800 in area 507. For example, as shown in Figure 5(a), "Ota-ku" is displayed in area 507.

[0098] At S1406, CPU212 displays the string "(Unknown)" in area 507. For example, as shown in Figure 5(b), "(Unknown)" is displayed in area 508. As mentioned above, this string "(Unknown)" is not superimposed on the preview image displayed in area 503. Thus, in this embodiment, when place name information cannot be obtained, the string "(Unknown)" is displayed in area 507, but the string "(Unknown)" is not superimposed on the image data to be printed. This indicates to the user that the print application's function for superimposing place names is working normally without any problems, and the user can correctly recognize that place name information could not be obtained. Furthermore, it is possible to suppress the situation in which the image quality is degraded by the superimposition of strings such as "(Unknown)" on the image to be printed. In other words, when name information related to the place indicated by location information cannot be obtained, it is possible to suppress both user misunderstanding and a decrease in image quality. Note that the string "(Unknown)" may be replaced with another string indicating that place name information could not be obtained, such as "(Place name information unavailable)", "No place name information", "(Null)", or "(XXXX)".

[0099] In S1407, the CPU 212 refers to the configuration information stored in the non-volatile memory 215 and determines whether the date setting is on or off. If it determines that the date setting is not on (i.e., the date setting is off), it proceeds to S1408; if it determines that it is on, it proceeds to S1409.

[0100] In S1408, CPU212 decides to superimpose the string set in place name string 802 (i.e., the same string as the string displayed in area 507) onto the first area of ​​the image to be printed. An example of an image with place name string 802 superimposed as determined in this way is shown in Figure 15(b). Further details will be described later.

[0101] In S1409, CPU 212 decides to superimpose the string indicating the date information onto the first region of the image to be printed. CPU 212 also decides to superimpose the string set in place name string 802 (i.e., the same string displayed in region 507) onto the second region of the image to be printed, rather than the first region. Figure 15(c) shows an example of an image where both the date string indicating the date information (the first type of additional information) and the place name string 802 (the second type of additional information) are superimposed in a visible manner. Further details will be described later.

[0102] In S1410, CPU212 generates image data (SVG data) with the place name string and / or date string superimposed on the position (area) determined in S1408 or S1409, and displays a scaled-down preview image of the generated SVG data in area 503. In other words, this process generates an image with the place name information superimposed on it, making it visible. The place name string and date string superimposed (added) to the image are visible to the user. Note that the generation of the image with the place name information superimposed in S1410 is performed even without user operation such as inputting or selecting a place name, as long as the place name information has been acquired and before the place name editing operation (customization) in S1303 and S1304 is performed. Also, the generation of the image with the place name information superimposed in S1410 is performed even without user operation to adjust the position of the place name string and date string.

[0103] In S1411, CPU212 activates areas 503-511 of the shooting location setting screen 500, making them ready to accept user input.

[0104] In S1412, CPU212 deactivates and grays out areas 503-511 of the shooting location setting screen 500, rendering them unresponsive to user input.

[0105] Figures 15(a) to 15(c) show examples of images of SVG data generated by S703 or S1410 in Figure 7.

[0106] Figure 15(a) shows an example of SVG data generated when the date setting is turned on and the shooting location setting is turned off. The date string is superimposed on the first region of the image (region 1501 in the figure). The first region is located along the periphery of the image, not overlapping with the center 1503, in order to suppress the reduction in visibility of the main subject which is likely to be captured near the center 1503 of the image. In this embodiment, it is the lower right portion of the image.

[0107] Figure 15(b) shows an example of SVG data generated when the date setting is off and the location setting is on. The place name string is superimposed on the first region (region 1501 in the illustration). The first region is the area where the date string was superimposed in Figure 15(a). Similar to the date string, the place name string is superimposed on the first region along the periphery of the image to suppress the reduction in visibility of the main subject, which is likely to be captured near the center 1503 of the image.

[0108] Figure 15(c) shows an example of SVG data generated when both the date setting and the location setting are enabled. The date string is superimposed on the first region (region 1501 in the figure), and the place name string is superimposed on the second region (region 1502 in the figure). The first region (region 1501 in the figure) is positioned further from the center 1503 of the image than the second region (region 1502 in the figure). Furthermore, the first region (region 1501 in the figure) and the second region (region 1502 in the figure) are positioned so that they do not overlap with each other. The second region is also positioned near the periphery of the image, not overlapping with the center 1503 of the image, in order to suppress the reduction in visibility of the main subject, which is likely to be captured near the center 1503 of the image. The second region is also positioned closer to the center 1503 of the image than the first region, and in this embodiment, it is above the first region. In this way, when superimposing both a place name and a date onto an image to be printed, the date information should be superimposed further away from the center of the image, while reducing the possibility of obscuring important subjects.

[0109] As can be seen by comparing Figure 15(a) and Figure 15(c), the position where the date string is superimposed is the first region in both cases: when the shooting location setting is off (Figure 15(a)) and when it is on (Figure 15(c)). In other words, the position where the date string is displayed is the same first region regardless of whether the place name is superimposed or not. This is because the function of superimposing date information onto the image is used more frequently by users than the function of superimposing place names onto the image. This difference in usage rates is because even imaging devices without GPS functionality can add shooting date and time information, which becomes the date string, to the image; that is, it is not a target of the function. This is because the images themselves contain more date information than place names. It is also due to the fact that imaging devices and image processing devices with date information superposition capabilities are more widespread in the market than those with place name superposition capabilities. If the position where the date string is superimposed changes depending on whether or not the place name string is superimposed, users may feel that it is inconsistent or lacks unity. In contrast, by designating the position where the date string is superimposed, regardless of whether or not the place name string is superimposed, as the first region, it is possible to suppress users from feeling that it is inconsistent or lacks unity.

[0110] On the other hand, as can be seen by comparing Figure 15(b) and Figure 15(c), the position where the place name string is superimposed differs between the case where the date string is superimposed (Figure 15(c)) and the case where the date string is not superimposed (Figure 15(b)). With regard to the place name string, priority is given to suppressing the reduction in visibility of the main subject by superimposing it as far away from the center 1503 of the image as possible, while avoiding the position where the date string is displayed. Furthermore, when both the date string and the place name string are superimposed, they are not divided into upper and lower parts, but both are superimposed on the lower right side. In this way, the situation in which strings are haphazardly superimposed in various positions in the image is suppressed, and the quality of the image in which both place name and date strings are superimposed is enhanced.

[0111] Furthermore, the control over the position where superimposed names such as place names and dates are placed, as explained in Figure 15, is executed according to the settings, even without user input to specify the superimposition position. Also, neither region 1501 nor region 1502 includes the center 1503 of the image.

[0112] In Figure 9, step S907 illustrates an example where the CPU 212 obtains location information from the attribute information of the image to be printed. However, this is not the only example; the CPU 212 may also obtain location information from the GPS unit 205 indicating the current location of the image processing device 200.

[0113] Furthermore, although the preview image displayed in area 302 or area 503 (the image on which the place name will be superimposed) is described as being selected from a photo on the terminal or from a web service, an image taken by the camera 203 may also be used. In this case, the location information may be obtained from the GPS unit 205, which is the location of the point where the image processing device 200 is currently located, rather than from the image's attribute information.

[0114] In Figure 11, step S1102 illustrates an example where the CPU 212 determines whether it was able to obtain second-level place name information from the place name information stored in the data memory 214. However, this process may also be performed on landmark information. Specifically, the CPU 212 determines whether it was able to obtain landmark information from the place name information stored in the data memory 214. If it was able to obtain landmark information, it sets the landmark information in the place name string 802 of the place name management information 800.

[0115] Furthermore, while Figure 11 illustrates an example of setting either the first-level or second-level place name information to be superimposed on the place name string during the place name string update process, it is also possible to set it to superimpose (output) both depending on the situation. For example, if the size of the output paper (print medium) is larger than a predetermined size, such as A3 size or larger, there is more space to superimpose the place name information. Therefore, if the size of the output medium is larger than a predetermined size and both the first-level and second-level place name information can be obtained, the place name strings corresponding to both can be superimposed side by side. If landmark information and third-level place name information can also be obtained, these can also be superimposed together. Figure 17 shows an example of an image in which all the obtained place name information is superimposed in parallel when the print medium size is A3 and all of the landmark information and first to third-level place name information can be obtained. Among the strings superimposed in area 1502, "Todoroki Ryokuchi" is the name of the landmark obtained as landmark information. Among the strings superimposed on area 1502, "Kanagawa Prefecture," "Kawasaki City," and "Nakahara Ward" are names obtained as place name information at the first to third levels, respectively.

[0116] In Figure 13, step S1305 illustrates an example where touching area 507 enables editing of the displayed text string. However, the location information acquired in S1101 may be stored and selected from it. Specifically, place name information is displayed in area 507 without any user input required to select a place name. Subsequently, when area 507 is touched, the system may be controlled to display place name information and landmark information from other acquired layers (first and third layers) as options for selection. The selected place name information is displayed in area 507 as the edited place name string and set as the place name string 802. In this way, when editing the place name string, if the user wishes to use acquired place name information or landmark information from other layers, they do not need to input characters using the soft keyboard, thus reducing the number of user operations.

[0117] Furthermore, the place name string set for one image (the place name string set in the place name string update process in Figure 11 or the place name string customized in S1306) may be applied to other images among the multiple images selected as print targets (overlay targets). For example, as shown in Figure 16, a checkbox 1601 that accepts an instruction operation to reflect the set place name string to other images is displayed on the shooting location setting screen 500. When the checkbox 1601 is checked, the CPU 212 sets the place name string set for the first displayed image to the place name strings 802 of the other images among the multiple images selected as overlay targets all at once. That is, the strings displayed in areas 504 and 507 for the first image are set to the place name strings 802 of the other images, including the second image, all at once. In this way, the place name string set for an image from which place name information could be obtained can be applied to an image from which place name information could not be obtained with a simple operation, reducing the operation required for the user to customize the place name string. Furthermore, a place name string that has been customized and edited for one image can be easily applied to other images, reducing the amount of effort users need to spend customizing place name strings.

[0118] Furthermore, the various controls described above, which are performed by the CPU212, may be performed by a single piece of hardware, or multiple pieces of hardware (for example, multiple processors or circuits) may share the processing to control the entire device.

[0119] Furthermore, although the present invention has been described in detail based on its preferred embodiments, the present invention is not limited to these specific embodiments, and various forms that do not depart from the spirit of the invention are also included in the present invention. Moreover, each of the embodiments described above is merely one embodiment of the present invention, and it is possible to combine each embodiment as appropriate.

[0120] Furthermore, the above-described embodiment was explained using the case where it is applied to a printing application in the image processing device 200 as an example. However, this is not limited to this example, and it can be applied to any electronic device that outputs the name of the output target related to the location indicated by the location information, or to any electronic device that superimposes multiple types of additional information onto an image in a visible manner. For example, it can be applied to an electronic device or application software that can post an image to a social networking service (SNS) along with the name related to the location indicated by the location information. The above-described embodiment can also be applied when superimposing multiple types of additional information, such as the date and place name, onto an image posted to an SNS.

[0121] Furthermore, this method is not limited to outputting place names in relation to images. For example, it can also be applied when recording the distribution route of goods from a traceability perspective. Specifically, at a distribution point for goods, a barcode or other identifier of the goods is read by an information processing device equipped with a GPS unit. The GPS unit then determines the location of the information processing device at the time of reading, and the information processing device requests place name information corresponding to the location information obtained from the GPS unit from the place name information management server 104. In response to the request, the obtained place name information is associated with the identification code of the read goods and displayed (output). Alternatively, the information processing device can send (output) it to a database that manages traceability. In this case, if second-level place name information can be obtained, the second-level place name information is displayed or transmitted without displaying or transmitting the first-level place name information. If second-level place name information cannot be obtained, the first-level place name information is displayed or transmitted.

[0122] Furthermore, this method can be applied to map applications and car navigation systems on information processing devices when displaying place names of the current location or past locations based on location information obtained from the GPS unit of the information processing device. In other words, if second-level place name information can be obtained, the second-level place name information will be displayed without displaying the first-level place name information. If second-level place name information cannot be obtained, the first-level place name information will be displayed.

[0123] (Other embodiments) The present invention can also be realized by performing the following process: supplying software (programs) that realize the functions of the embodiments described above to a system or device via a network or various storage media, and having the computer (or CPU, MPU, etc.) of that system or device read and execute the program code. In this case, the program and the storage media storing the program constitute the present invention.

Claims

1. A means of acquiring location information, A request means for requesting name information, which is information indicating the name of the place indicated by the location information acquired by the acquisition means, If name information is obtained in response to the above request, the system controls the display of the name to be superimposed based on the obtained name information in a first area that is not superimposed on the image, and to display the name to be superimposed in a second area that is superimposed on the image. If name information cannot be obtained in response to the aforementioned request, a control means controls the display of notification information that is not subject to being superimposed on the image in an area that is not superimposed on the image, and prevents the display of a name related to a location in the second area. An information processing device characterized by having the following features.

2. The information processing apparatus according to claim 1, characterized in that the control by the control means is performed after the request by the acquisition means without any operation from the user.

3. The information processing apparatus according to claim 1, characterized in that the control means controls not to display the notification information in the second range when name information cannot be obtained as a response to the request.

4. The information processing apparatus according to claim 1, characterized in that the control means controls the image so as not to superimpose a display object caused by the request when name information cannot be obtained in response to the request.

5. The information processing apparatus according to claim 1, characterized in that the control means displays the notification information in the first range when name information cannot be obtained as a response to the request.

6. The system further includes editing means for editing the content displayed in the first range in response to user operations, The information processing apparatus according to claim 5, characterized in that the control means controls the content displayed in the second range to be updated with the edited content when the content displayed in the first range by the editing means is edited.

7. The system further includes editing means for editing the content displayed in the first range in response to user operations, The information processing apparatus according to claim 6, characterized in that the control means controls the content displayed in the second range to be updated with the edited content when the content displayed in the first range by the editing means is edited.

8. The information processing apparatus according to claim 7, characterized in that, among a plurality of images selected as candidates for superimposing a name to be superimposed based on name information, the edited content is applied to a second image among the plurality of images based on the edited content edited by the editing means with respect to a first image.

9. The information processing device according to claim 1, characterized in that the notification information is a string of characters indicating that the name of the place indicated by the location information is unknown.

10. The information processing apparatus according to claim 1, characterized in that the acquisition means acquires location information assigned as attribute information of the image.

11. The information processing apparatus according to claim 8, characterized in that the control means controls the requesting means to issue a second notification, separate from the notification information, regarding the inability to make a request, when the requesting means cannot make a request because the image does not have location information attached to it.

12. The information processing apparatus according to claim 1, characterized in that the request means controls the transmission of the request to a system that manages name information corresponding to location information via the Internet.

13. The information processing apparatus according to claim 10, characterized in that the control means controls the requesting means to issue a third notification regarding the lack of internet connectivity as a separate notification from the notification information when the requesting means cannot make a request because it is not connected to the internet.

14. The requesting means makes a request to obtain, as names relating to the location information obtained by the acquisition means, the place name of the first hierarchy and the place name of the second hierarchy, which is a lower hierarchy than the first hierarchy. The control means is If the place name of the second hierarchy is obtained in response to the request, even without any user operation to select a place name after the request, the system controls the system to superimpose the place name of the second hierarchy onto the image within the second range as the superimposition target name without outputting the place name of the first hierarchy. If, in response to the aforementioned request, the place name of the second hierarchy cannot be obtained but the place name of the first hierarchy can be obtained, the system is controlled to superimpose the place name of the first hierarchy onto the image within the second range as the superimposed target name. The information processing apparatus according to feature 1.

15. The system further includes a first setting means for setting whether or not to superimpose a first type of additional information, different from the name of the location, onto the image. The control means is If the first setting means is set to superimpose the first type of additional information, then the first control is performed such that, among the first and second regions within the range of the second region, the first type of additional information is superimposed on the first region, and the superimposition target name is superimposed on the second region, which is a region further from the edge of the image than the first region. If the first setting means is set not to superimpose additional information of the first type, a second control is performed to superimpose the superimposed target name in the first area and not to superimpose additional information in the second area. The information processing apparatus according to feature 1.

16. The information processing apparatus according to claim 1, further comprising, as a function of specific application software for causing the information processing apparatus to function as the control means, an output means for outputting to a printing device a superimposed image on which the superimposed target name is superimposed, and a print instruction for the superimposed image.

17. The information processing apparatus according to claim 1, further comprising, as a function of specific application software for causing the information processing apparatus to function as the control means, an output means for outputting a superimposed image on which the superimposed target name is superimposed, so as to be posted to a social networking service.

18. The information processing device according to claim 1, characterized in that the name of the superimposed object superimposed on the image is visible to the user.

19. The acquisition step for obtaining location information, A request step which makes a request for name information, which is information indicating the name of the place indicated by the location information obtained in the acquisition step, If name information is obtained in response to the above request, the system controls the display of the name to be superimposed based on the obtained name information in a first area that is not superimposed on the image, and to display the name to be superimposed in a second area that is superimposed on the image. If name information cannot be obtained in response to the aforementioned request, a control step is performed to display notification information that is not subject to being superimposed on the image in an area that is not superimposed on the image, and to control the display of a name related to a location in the second area, A control method for an information processing device, characterized by having the following features.

20. A program for causing a computer to function as one of the means of an information processing device described in any one of claims 1 to 16.

21. A computer-readable storage medium storing a program for causing a computer to function as one of the means of an information processing device described in any one of claims 1 to 16.

Citation Information

Patent Citations

  • Image printer

    JP2010240899A