Information processing device, control method, and program

Abstract

To improve comfort of a user.SOLUTION: An information processing device comprises: display control means which performs a control for displaying a screen containing a first object and a second object different from the first object; first acquisition means for acquiring a depressed coordinate being a coordinate of the screen where an input operation by a user to the screen has been performed; and determination means for compering a first priority set to a type of the first object within a predetermined range from the depressed coordinate with a second priority set to a type of the second object within the predetermined range and determining the object selected by the input operation.SELECTED DRAWING: Figure 8

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, a control method, and a program.

Background Art

[0002] An information processing apparatus such as a PC or a smartphone can connect to a Web server on a network, acquire display information of a Web application (hereinafter referred to as a Web app), and utilize a function of displaying it using a Web browser. Some image forming apparatuses including a multifunction peripheral (MFP) having a copy function and a transmission function also include a Web browser for displaying a Web app. Components of the screen of a Web app displayed on the touch panel of these information processing apparatuses (hereinafter referred to as Web contents) can be selected by a user's operation. At this time, there is a possibility that the user may accidentally select unintended Web contents.

[0003] Patent Document 1 discloses a method of changing a selection target to small Web contents within a predetermined distance from the coordinates of a touch position as a method for avoiding misselection of Web contents.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, since factors causing misselection of Web contents can be considered other than the size of Web contents, there is a problem that the method of Patent Document 1 cannot appropriately suppress the occurrence of misselection of Web contents.

Means for Solving the Problems

[0006] An information processing apparatus according to an aspect of the present disclosure includes display control means for performing control to display a screen including a first object and a second object different from the first object, and first acquisition means for acquiring a pressing coordinate which is a coordinate of the screen where an input operation by a user on the screen has been performed, and compares a first priority set for the type of the first object within a predetermined range from the pressing coordinate with a second priority set for the type of the second object within the predetermined range, and determining means for determining an object selected by the input operation. It is characterized by comprising.

Effect of the Invention

[0007] According to the present disclosure, user comfort can be improved in the use of an information processing apparatus.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Mode for Carrying Out the Invention

[0009] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the present disclosure, and not all combinations of features described in the following embodiments are essential for the solution means of the present disclosure. For the same configuration, the same reference numerals will be used for description.

[0010] The Web browser included in the information processing apparatus can display a Web application. In a scenario where a small Web content on the screen of the Web application is selected, when selecting with the mouse cursor, the selection target can be visually recognized, but when selecting with a finger, the selection target may be covered by the finger and thus cannot be visually recognized. Since the selection target cannot be visually recognized, Web content unintended by the user may be selected as it is, resulting in inconveniences such as re-pressing the Web content and re-navigating to the Web application. Note that even if the selection target can be visually recognized, due to other factors, Web content unintended by the user may be selected. Also, even when the Web content to be selected is sufficiently large, mis-selection may occur due to overlapping with other Web content. In a scenario where a user selects Web content displayed on the Web browser, a method for appropriately avoiding such mis-selection is desired.

[0011] In the following embodiments, an image forming apparatus (specifically, an MFP) will be described as an example of an information processing apparatus equipped with a general web browser. However, the information processing apparatus is not limited to this. For example, the information processing apparatus may be a desktop PC, a notebook PC, a tablet terminal, a smartphone, or the like.

[0012] <<First Embodiment>> FIG. 1 is a diagram showing an example of the overall configuration of an information processing system according to an embodiment of the present disclosure. The information processing system includes an MFP 110 and a web application server 120. In the present embodiment, the MFP 110 will be described as an example of an image forming apparatus. In the information processing system, the MFP 110 is connected to the Internet 130 via a LAN 100. Further, a web application server 120 is connected to the Internet 130.

[0013] The MFP 110 includes an operation unit 111, a scanner unit 112, and a printer unit 113. The MFP 110 according to the embodiment functions as a client terminal that displays an operation screen of a web application using a built-in web browser and is operated by a user. The MFP 110 can transmit image data obtained by reading a document using the scanner unit 112 to the web application server 120 in response to receiving a predetermined instruction via the web application. Further, the MFP 110 can print the image data acquired from the web application server 120 using the printer unit 113.

[0014] The web application server 120 is a server that executes a web application. However, the configuration of the information processing system shown in FIG. 1 is merely an example, and the number of these devices and the like are not limited to this.

[0015] FIG. 2 is a block diagram showing an example of the hardware configuration of the MFP 110 according to the embodiment. The MFP 110 includes a control unit 200 that controls an operation unit 111, a scanner unit 112, and a printer unit 113. The control unit 200 includes a CPU 201, a ROM 202, a RAM 203, an HDD 204, an operation unit interface (hereinafter referred to as I / F) 205, a network I / F 206, a scanner I / F 207, an image processing unit 208, and a printer I / F 209.

[0016] The operation unit 111 has a display unit having a touch panel function and various hard keys, etc., receives a user's operation on the display unit and the hard keys, etc., and inputs information regarding the operation received via the operation unit I / F 205 described later to the control unit 200. The operation unit 111 performs display control for displaying various images via the operation unit I / F 205 according to the control of the control unit 200.

[0017] The scanner unit 112 reads an image on a document, creates image data of the read image, and supplies the created image data to the control unit 200 via the scanner I / F 207 described later. The printer unit 113 forms an image on a sheet based on information regarding printing including the image data received from the control unit 200 via the printer I / F 209 described later.

[0018] The control unit 200 is electrically connected to the operation unit 111, the scanner unit 112, and the printer unit 113, and is also connected to the LAN 100 via the network I / F 206 described later. Thereby, the MFP 110 can communicate using a communication protocol such as TCP / IP via the LAN 100.

[0019] In the control unit 200, the CPU 201, the ROM 202, the RAM 203, the HDD 204, the operation unit I / F 205, the network I / F 206, the scanner I / F 207, the image processing unit 208, and the printer I / F 209 are connected via a system bus 210.

[0020] The CPU 201 executes the boot program in the ROM 202, expands the OS and control programs stored in the HDD 204 into the RAM 203, and comprehensively controls the MFP 110 based on the expanded programs. This control also includes the execution of programs for realizing the flowchart described later.

[0021] The ROM 202 stores the boot program of the MFP 110 and various data. The RAM 203 provides a work memory for the operation of the CPU 201 and also provides an image memory for temporarily storing image data. The HDD 204 stores the OS, various programs, image data, and a priority table described later.

[0022] The operation unit I / F 205 is an I / F for connecting the operation unit 111 and the control unit 200. The network I / F 206 is an I / F for connecting the LAN 100 and the control unit 200, and performs input / output of information via the network. The scanner I / F 207 is an I / F for connecting the scanner unit 112 and the control unit 200.

[0023] The image processing unit 208 performs image processing such as rotation, color conversion, and image compression / expansion on the image data created by the scanner unit 112 and the image data to be output to the printer unit 113. The printer I / F 209 is an I / F for connecting the printer unit 113 and the control unit 200. The CPU 201 controls printing in the printer unit 113 according to the attribute data associated with the image data processed by the image processing unit 208 via the printer I / F 209.

[0024] Figure 3 is a block diagram showing an example of the hardware configuration of the Web application server 120 according to the embodiment. The Web application server 120 includes a CPU 301, a RAM 302, a ROM 303, an HDD 304, and a network I / F 305. In the Web application server 120, the CPU 301, the RAM 302, the ROM 303, the HDD 304, and the network I / F 305 are connected to each other via a system bus 306.

[0025] The CPU 301 expands the OS, control programs, etc. stored in the HDD 304 into the RAM 302 and executes the expanded programs, thereby realizing the functions of the Web application server 120. Also, the CPU 301 communicates with other devices on the network connected via the network I / F 305.

[0026] FIG. 4 is a diagram showing an example of the configuration of software modules of the MFP 110 according to the embodiment. The MFP 110 includes a touch processing unit 401, a window management unit 402, a Web browser 403, and a rendering engine 404. Also, the Web browser 403 includes a pressed coordinate storage unit 411, a candidate coordinate acquisition unit 412, a Web content comparison unit 413, and a coordinate substitution unit 414. These software modules are stored in the HDD 204 of the MFP 110 and are expanded into the RAM 203 and executed by the CPU 201 at the time of execution.

[0027] The touch processing unit 401 detects an input operation such as pressing on the operation unit 111 and converts the pressed analog position information into digital coordinate information. In this embodiment, although the pressing operation by the user is described as an example of the input operation on the operation unit, it is not limited thereto. For example, the input operation on the operation unit may be an instruction operation by a mouse. The touch processing unit 401 transmits the converted digital coordinate information to the window management unit 402. The window management unit 402 determines which application has been pressed based on the digital coordinate information received from the touch processing unit 401 and the layer information of a plurality of applications (including the browser) displayed on the operation unit. When the topmost application of the coordinate information is the browser, the window management unit 402 determines that it is a pressing operation on the browser 403 and transmits the coordinate information to the browser.

[0028] The web browser 403 displays a web application executed by the web application server 120. In addition to the general function of sending a request to the web application server 120 to display the web application on the operation unit 111, the web browser 403 includes a pressed coordinate storage unit 411, a candidate coordinate acquisition unit 412, a web content comparison unit 413, and a coordinate replacement unit 414.

[0029] The pressed coordinate storage unit 411 stores, in the HDD 204 as a web content information table, the coordinate information (hereinafter referred to as the pressed coordinates) acquired from the window management unit 402 and the HTML element at the coordinate position. Hereinafter, storing the coordinate information in the HDD 204 in a table format together with the information associated with the coordinate information is referred to as storing in the table. In this embodiment, the storage format of the coordinate information and the information associated with the coordinate information is not limited to a table. That is, any method that can manage the coordinate information and the information associated with the coordinate information is acceptable regardless of its format. An HTML element is known information indicating the constituent content of web content described by using HTML (HyperText Markup Language) or the like when creating a web application. In other words, an HTML element indicates the type of web content. In this embodiment, although web content is described by taking an image constituting a web application as an example, it may be an object such as an input form, a button, or a link.

[0030] Fig. 5 shows an example of a web content information table. The web content information table is composed of a coordinate 501, an HTML element 502, and a row 503. The coordinate 501 indicates the coordinate on the display area of the stored web browser. The HTML element 502 indicates the HTML element at the coordinate stored in the coordinate 501. In the row 503, before the coordinate replacement process described later is executed, the pressed coordinate and the HTML element at the pressed coordinate are stored. Specifically, as shown in Fig. 5, in the row 503, the coordinate {300, 200} and the input element as the HTML element at the coordinate {300, 200} are stored. Fig. 6 shows an example of a means for acquiring the HTML element at the pressed coordinate. The HTML element can be acquired by using JavaScript or the like according to the description 601 as shown in Fig. 6. The pressed coordinate storage unit 411 can acquire a character string representing the HTML element at the specified coordinate {300, 200} by the means shown in Fig. 6. In the present embodiment, the HTML element acquired for the pressed coordinate or the candidate coordinate described later is referred to as the HTML element at these coordinates.

[0031] Returning to Fig. 4, the candidate coordinate acquisition unit 412 acquires coordinates within a predetermined range from the pressed coordinate (hereinafter referred to as candidate coordinates) and the HTML element at the candidate coordinates. Hereinafter, the area within the predetermined range from the pressed coordinate is referred to as the defined range. By providing the defined range, it is possible to complement the deviation of the pressed position due to factors such as the selection target not being visible so that the selection operation intended by the user is achieved.

[0032] The web content comparison unit 413 compares the priority of the HTML element of the coordinate stored in the web content information table with the priority of the HTML element at the candidate coordinate. The web content comparison unit 413 determines the coordinate with the higher priority based on the priority of the HTML element defined in the priority table described later.

[0033] Fig. 7 shows an example of a priority table. The priority table is composed of a combination of a cost 701 and an HTML element 702. The cost 701 indicates the priority of the HTML element set for the cost. The cost 701 represents that the lower the numerical value, the higher the priority, and is used to compare the priorities of the coordinates associated with the HTML element. The HTML element 702 is an arbitrarily set HTML element. As shown in Fig. 7, rows 703 to 708 are set as HTML elements. A predetermined HTML element is set for the cost. Here, looking at rows 703 and 704, the cost corresponding to the input element is smaller than the cost corresponding to the button element. Therefore, the web content comparison unit 413 determines that the priority of the input element is high. Also, in the priority table, by providing a unique default element like row 708, all HTML elements not set in the HTML element 702 can be treated as the priority of the default element. The priority table is stored in a memory such as the HDD 204.

[0034] Returning to FIG. 4, the coordinate replacement unit 414 replaces the information stored in the web content information table with the coordinates determined to have a high priority by the web content comparison unit 413 and the information on the HTML element associated with the coordinates. As a result, information regarding the coordinates determined to have a high priority is stored in the web content information table. When the pressed coordinate and the img element as the HTML element at the pressed coordinate are stored in the web content information table, assume that the candidate coordinate acquisition unit 412 has acquired the candidate coordinate and the svg element as the HTML element at the candidate coordinate. In this case, based on the priority table in FIG. 7, the web content comparison unit 413 determines that the cost of the svg element is lower than that of the img element, that is, the candidate coordinate has a higher priority. Then, based on the determination of the web content comparison unit 413, the coordinate replacement unit 414 stores the candidate coordinate and the HTML element of the candidate coordinate in the web content information table. In other words, the coordinate replacement unit 414 can determine the web content at the coordinate determined to have a high priority as the web content selected by the user. By the web browser 403 executing such processing, the selection processing intended by the user can be realized. That is, the occurrence of the user's misselection can be suppressed. In the present embodiment, the web content corresponding to the acquired information (information such as HTML elements) regarding the pressed coordinate or the candidate coordinate is referred to as the web content at these coordinates.

[0035] The rendering engine 404 generates image data to be displayed on the operation unit 111 based on the resources of the web page returned in response to the request sent by the web browser 403. The rendering engine 404 receives coordinate information from the web browser 403 and executes processing according to the coordinate information finally stored in the web content information table by the coordinate replacement unit 414.

[0036] FIG. 8 is a flowchart showing an example of the coordinate conversion process executed by the MFP 110 in the present embodiment. The process shown in FIG. 8 is realized by the CPU 201 of the MFP 110 reading a program stored in the ROM 202 into the RAM 203 and executing it. Note that part or all of the functions of some of the steps in FIG. 8 may be realized by hardware such as an ASIC or an electronic circuit. The symbol "S" in the description of each process means that it is a step in the flowchart diagram (the same applies to the flowchart diagrams in this specification hereinafter).

[0037] In S801, the CPU 201 uses the pressed coordinate storage unit 411 to acquire the pressed coordinates transmitted from the window management unit 402 to the Web browser 403. Then, the CPU 201 acquires the HTML element at the pressed coordinates based on the coordinate information of the acquired pressed coordinates. After that, the CPU 201 proceeds to the process of S802.

[0038] In S802, the CPU 201 uses the pressed coordinate storage unit 411 to store the pressed coordinates and the information of the HTML element of the pressed coordinates in the Web content information table. After that, the CPU 201 proceeds to the process of S803.

[0039] In S803, the CPU 201 uses the candidate coordinate acquisition unit 412 to start a repetitive process for the candidate coordinates within the defined range from the pressed coordinates. The repetitive process is a process in which the CPU 201 executes the processes of S804 to S806 described later for each candidate coordinate within the defined range. Also, the repetitive process is repeatedly executed until the processes of S804 to S806 for all candidate coordinates are completed.

[0040] In S804, the CPU 201 uses the candidate coordinate acquisition unit 412 to acquire the coordinate information of the candidate coordinate during the repetitive process and the HTML element at the candidate coordinate. After that, the CPU 201 proceeds to the process of S805.

[0041] In S805, the CPU 201 uses the Web content comparison unit 413 to compare the HTML elements stored in the Web content information table with the HTML elements at the candidate coordinates acquired in S804 based on the priority table as shown in FIG. 7. That is, the CPU 201 compares the priorities of the HTML elements associated with the respective coordinates based on the priority table, thereby comparing the priorities of the respective coordinates. As a result of the comparison, when the CPU 201 determines that the priority of the candidate coordinates is higher (Yes) than the priority of the stored coordinates, the process proceeds to the process of S806. On the other hand, when the CPU 201 determines that the priority of the stored coordinates is higher or the same (No) than the priority of the candidate coordinates, the process proceeds to S807.

[0042] In S806, the CPU 201 uses the coordinate replacement unit 414 to replace the combination of the coordinates stored in the Web content information table and the HTML element of the coordinates with the combination of the candidate coordinates determined to have a high priority and the HTML element of the candidate coordinates.

[0043] In S807, if the CPU 201 has not executed the loop process for all the candidate coordinates within the defined range, the process proceeds to the process of S804. On the other hand, if the CPU 201 has executed the loop process for all the candidate coordinates within the defined range, the process proceeds to the process of S808.

[0044] In S808, the CPU 201 uses the Web browser 403 to transmit the coordinate information stored in the Web content information table to the rendering engine 404 and ends the process shown in FIG. 8.

[0045] FIG. 9 is a diagram showing an example of a display screen displayed on the operation unit 111 according to the present embodiment. The details of the process shown in FIG. 8 will be described with reference to specific cases as shown in FIGS. 9(a) to 9(c).

[0046] FIG. 9(a) is a diagram showing an example of a display screen of the web browser 403 displayed on the operation unit 111. The press-down coordinates 901 indicate the position of the press-down coordinates. The web content 902 is an image of a display advertisement with a size of 300 px × 300 px that constitutes a web application. The HTML element of the web content 902 indicates an img element. In S801, when the press-down coordinate storage unit 411 acquires the press-down coordinates 901, it acquires information indicating an img element as the HTML element of the web content 902 at the press-down coordinates 901. In S802, when the press-down coordinate storage unit 411 acquires the HTML element at the press-down coordinates 901 in S801, it stores the press-down coordinates 901 and the HTML element acquired in S801 in the web content information table.

[0047] FIG. 9(b) is a diagram showing a definition range for executing a repetition process on FIG. 9(a). The definition range 903 indicates a predetermined range for executing the repetition process. For example, the definition range 903 is a rectangular range of 61 px × 61 px within a distance of 30 px from the press-down coordinates 901. The web content 904 is a graphic of a delete icon for a display advertisement with a size of 15 px × 15 px arranged in the upper right on the web content 902. The HTML element of the web content 904 indicates an svg element. The web content 905 is a group area that groups other web contents. The HTML element of the web content 905 indicates a div element.

[0048] The repetition process in S803 is executed for 61×61 candidate coordinates on the definition range 903. In S804, when the coordinates on the web content 902 are the target of the repetition process, the candidate coordinate acquisition unit 412 acquires information indicating an img element as the HTML element of the candidate coordinates. Similarly, the candidate coordinate acquisition unit 412 acquires information indicating an svg element when the coordinates on the web content 904 are the target of the repetition process, and acquires information indicating a div element when the coordinates on the web content 905 are the target of the repetition process.

[0049] FIG. 9(c) is an enlarged view of a portion of the defined range 903 in FIG. 9(b). In FIG. 9(c), the symbols (1) to (3) indicate the positions of candidate coordinates within the defined range 903. Hereinafter, the coordinate shown in (1) is referred to as coordinate (1), and the coordinates shown in (2) and (3) are also referred to as coordinate (2) and coordinate (3), respectively (the same applies in the following embodiments). Also, in the order of coordinate (1), coordinate (2), and coordinate (3), it indicates that they are the objects of the repetition process. When coordinate (1) is the object of the repetition process, the HTML element of the coordinate stored in the web content information table is an img element, and the HTML element of coordinate (1) as a candidate coordinate is an img element. At this time, in S805, the web content comparison unit 413 determines that the priorities of both coordinates are the same because the costs of both HTML elements (specifically, img elements) are the same according to row 706 of the priority table in FIG. 7. In this case, the coordinate replacement unit 414 does not perform the replacement process as described above.

[0050] When coordinate (2) is the object of the repetition process, the HTML element of the coordinate stored in the web content information table is an img element, and the HTML element of coordinate (2) as a candidate coordinate is a div element. At this time, the web content comparison unit 413 determines that the priority of the stored coordinate is higher because the cost of the img element is lower than that of the div element according to rows 706 and 707 of the priority table in FIG. 7. In this case, the coordinate replacement unit 414 does not perform the replacement process as described above.

[0051] When the coordinate (3) is the target of the loop process, the HTML element of the coordinate stored in the web content information table is an img element, and the HTML element of the coordinate (3) as the candidate coordinate is an svg element. At this time, from rows 705 and 706 of the priority table in Fig. 7, the web content comparison unit 413 determines that the priority of the coordinate (3) is high because the cost of the svg element is lower than that of the img element. In S806, the coordinate replacement unit 414 replaces the combination of the coordinate stored in the web content information table and the HTML element of the coordinate with the combination of the candidate coordinate determined in S805 and the HTML element of the candidate coordinate. In S808, when the loop process ends, the combination of the HTML elements of the coordinates stored in the web content information table is the coordinate (3) and the svg element. Then, the web browser 403 sends this combination to the rendering engine 404.

[0052] According to this embodiment, by presetting a priority table based on the components of the web application that executes the process and executing the process shown in Fig. 8, it is possible to suppress the occurrence of misselection by the user. As shown in Fig. 9(a), assume a case where the user misselects the web content 904 which is the deletion icon of the display advertisement and presses the web content 902 which is the display advertisement. At this time, since the size of the web content 904 is relatively small compared to the size of the web content 902, it is considered highly likely that the operation of pressing the web content 902 is a misoperation. Therefore, the priority table is preset so that the cost of the HTML element of the web content 904 is low. As a result, the candidate coordinate in the web content 904 is reselected as the candidate coordinate with the highest priority from within the definition range 903, and the process of selecting the web content expected by the user can be realized.

[0053] In addition, for example, in addition to the determination condition of misselection based on the size of the web content, the cost of the HTML element of the web content to be prioritized as the selection target may be set low, and the cost of the HTML element of the web content that causes other misselection factors may be set high. As a result, coordinates are selected based on the priority reflecting a plurality of selection criteria, and it is possible to cope with the user's misselection due to factors other than the size of the web content, so that the user's comfort can be improved.

[0054] <<Second Embodiment>> It is assumed that there is a case where a plurality of web contents having HTML elements with low costs are included within the defined range in which the candidate coordinate acquisition unit 412 repeatedly executes processing. In the present embodiment, in such a case, a process capable of obtaining a result expected by the user for the selection operation of the web content will be described. In the following description, differences from the first embodiment may be described, and similar configurations may be omitted.

[0055] FIG. 10 is a display screen displayed on the operation unit 111 with an enlarged view of the defined range portion, and shows an example of a case where a plurality of web contents belonging to HTML elements with low costs are included within the defined range. FIG. 10(a) shows a case where the costs of the HTML elements of the web contents 1003 and 1005 are lower than the cost of the HTML element of the web content 1004, and the sizes of the web contents 1003 and 1005 are different. FIG. 10(b) shows a case where the costs of the HTML elements of the web contents 1006 and 1007 are lower than the cost of the HTML element of the web content 1003, and the sizes of the web contents 1006 and 1007 are the same.

[0056] The pressing coordinates 1001 in FIGS. 10(a) and 10(b) indicate the position of the pressing coordinates acquired by the web browser 403, which is the same as the pressing coordinates 901 in FIG. 9(a). The defined range 1002 in FIGS. 10(a) and 10(b) indicates a predetermined range for executing the repetitive process, which is the same as the defined range 903 in FIG. 9(b). The web content 1003 in FIGS. 10(a) and 10(b) is web content where the HTML element is an img element and its size is 300px × 300px. The web content 1004 in FIGS. 10(a) and 10(b) is web content where the HTML element is a div element. At this time, since there is web content 1003 on the pressing coordinates 1001, the img element is stored in the web content information table as the HTML element at the pressing coordinates 1001.

[0057] In FIG. 10(a), the web content 1005 is web content where the HTML element is an img element and its size is 15px × 15px. The symbol (1) indicates the position of the candidate coordinates, and the coordinates (1) are {705, 200}. In the example of FIG. 10(a), assume a case where the pressing coordinates 1001 are sent to the web browser 403 as a misselection of the web content 1005, and the process of FIG. 8 is executed based on the priority table of FIG. 7.

[0058] In the above case, when the coordinates (1) become the target of the repetitive process, the coordinates stored in the web content information table are the pressing coordinates 1001, and the candidate coordinates are the coordinates (1) in the web content 1005. In this case, the web content comparison unit 413 determines that the stored pressing coordinates 1001 and the coordinates (1) as the candidate coordinates have the same priority. When the repetitive process for all candidate coordinates within the defined range 1002 is completed, the replacement process by the coordinate replacement unit 414 is not performed. That is, since the web browser 403 determines that the web content 1003 is selected, in the case shown in FIG. 10(a), the user cannot obtain the expected result.

[0059] In FIG. 10(b), Web contents 1006 and 1007 are Web contents where the HTML element is an svg element and each has a size of 15 px × 15 px. The symbols (1) and (2) indicate the positions of candidate coordinates. Coordinate (1) is {690, 200}, and coordinate (2) is {705, 200}. Also, in the order of coordinate (1) and coordinate (2), it is shown that they are targets of repetitive processing. In the example of FIG. 10(b), assume a case where the pressed coordinate 1001 is transmitted to the Web browser 403 as a misselection of the Web content 1007, and the process of FIG. 8 is executed based on the priority table of FIG. 7.

[0060] In the above case, when coordinate (1) becomes the target of repetitive processing, the coordinate stored in the Web content information table is the pressed coordinate 1001, and the candidate coordinate is the coordinate (1) in the Web content 1006. In this case, the Web content comparison unit 413 determines that the priority of the candidate coordinate is high. At this time, the coordinate replacement unit 414 replaces the combination of the coordinate stored in the Web content information table and the HTML element at that coordinate with the combination of coordinate (1) and the HTML element at coordinate (1).

[0061] When coordinate (2) becomes the target of repetitive processing, since the candidate coordinate is the coordinate (2) in the Web content 1007, the Web content comparison unit 413 determines that the stored coordinate (1) and the candidate coordinate (2) have the same priority. When the repetitive processing for all candidate coordinates within the definition range 1002 is completed, the Web browser 403 determines that the Web content 1006 is selected. Therefore, in the case shown in FIG. 10(b), the user cannot obtain the expected result.

[0062] FIG. 11 is a flowchart showing an example of the coordinate replacement process executed by the MFP 110 in the present embodiment. Note that the processing contents of S1103, S1105, S1107, and S1108 shown in FIG. 11 are the same as the processing contents of S803, S805, S807, and S808 shown in FIG. 8, respectively.

[0063] In S1101, the CPU 201 acquires the press coordinates from the window management unit 402 using the press coordinate storage unit 411. Here, it is assumed that there is web content at the press coordinates. The CPU 201 uses the press coordinate storage unit 411 to acquire the HTML element of the web content at the press coordinates, the size of the web content, and the distance to the press coordinates (hereinafter referred to as web content information) based on the acquired coordinate information. FIG. 12 is a diagram showing an example of a means for acquiring the size of the web content at the press coordinates. The size of the web content can be acquired by using JavaScript or the like. According to description 1201, the press coordinate storage unit 411 can acquire the size of the web content at the specified coordinates {720, 220}.

[0064] In S1102, the CPU 201 uses the press coordinate storage unit 411 to store the press coordinates and the web content information of the press coordinates in the web content information table. FIG. 13 is a diagram showing an example of the stored web content information table. Coordinates 1301 and HTML element 1302 respectively correspond to coordinates 501 and HTML element 502 in FIG. 5. The size 1303 of the web content indicates the size of the web content at coordinates 1301. The distance 1304 to the press coordinates indicates a value representing the distance from coordinates 1301 to the press coordinates. Row 1305 shows the web content information of the stored press coordinates 1001, indicating that the coordinates are {720, 220}, the HTML element of the web content is an img element, the size is 90000 px, and the distance to the press coordinates is 0. Note that since the process of S1103 is the same as the process of S803, the description is omitted.

[0065] Returning to FIG. 11, in S1104, the CPU 201 uses the candidate coordinate acquisition unit 412 to acquire the candidate coordinates during the repetition process and the web content information of the candidate coordinates.

[0066] Here, a method for obtaining a value indicating the distance from the candidate coordinates to the press coordinates included in the web content information will be described. The candidate coordinate acquisition unit 412 acquires the distance from the candidate coordinates to the press coordinates based on the press coordinates acquired by the press coordinate storage unit 411 in S1101 and the candidate coordinates during the acquired repetition process. For example, the candidate coordinate acquisition unit 412 acquires the press coordinates {720, 200} from the press coordinate storage unit 411 and the candidate coordinates {710, 190} during the repetition process. Then, the candidate coordinate acquisition unit 412 acquires, as the distance information, the absolute value of (710 - 720) + the absolute value of (190 - 200), that is, a value of 20 px. Note that the method for obtaining the value indicating the distance from the candidate coordinates to the press coordinates is not limited to this. Any method that can obtain the value indicating the distance from the coordinates is acceptable, regardless of the calculation method or acquisition method.

[0067] In S1105, the CPU 201 uses the web content comparison unit 413 to compare the priority of the stored HTML element with the priority of the HTML element at the candidate coordinates based on the preset priority table shown in FIG. 7. Based on the comparison result of the priorities of the two HTML elements, when the CPU 201 determines that the priority of the candidate coordinates is higher (Yes) than the priority of the stored coordinates, the process proceeds to the process of S1106. On the other hand, when the CPU 201 determines that the priority of the candidate coordinates is lower than or the same as (No) the priority of the stored coordinates, the process proceeds to the process of S1109.

[0068] In S1106, the CPU 201 uses the coordinate replacement unit 414 to replace the combination of the stored coordinates and the web content information of the coordinates with the combination of the candidate coordinates determined to have a high priority and the web content information of the candidate coordinates.

[0069] In S1109, the CPU 201 determines the necessity of comparison based on other conditions using the Web content comparison unit 413. Specifically, the CPU 201 determines whether the priority of the candidate coordinates is the same as the priority of the stored coordinates. Here, in the cases shown in FIGS. 10(a) and 10(b), when the process shown in FIG. 8 is performed as described above, if the priority of the candidate coordinates is the same as the priority of the stored coordinates, the result expected by the user may not be obtained. That is, in this case, the Web content comparison unit 413 determines that there is a need for comparison based on other conditions so that the Web content intended by the user is determined as the selection target, and executes the processes after S1110. In S1109, when the CPU 201 determines that the priority of the candidate coordinates is the same as the priority of the stored coordinates (Yes), it proceeds to the process of S1110, and when it determines that the priority of the candidate coordinates is low (No), it proceeds to the process of S1107.

[0070] In S1110, the CPU 201 uses the Web content comparison unit 413 to compare the size of the Web content of the coordinates stored in the Web content information table with the size of the Web content at the candidate coordinates. When the CPU 201 determines that the size of the Web content at the candidate coordinates is smaller than the size of the Web content of the stored coordinates (Yes), it proceeds to the process of S1106. On the other hand, when the CPU 201 determines that the size of the Web content at the candidate coordinates is larger than or the same as the size of the Web content of the stored coordinates (No), it proceeds to the process of S1111.

[0071] In S1111, the CPU 201 uses the Web content comparison unit 413 to judge the necessity of comparison based on other conditions. Specifically, the CPU 201 determines whether the size of the Web content at the candidate coordinates is the same as the size of the Web content of the stored coordinates.

[0072] Here, in the case shown in Fig. 10(b), assuming that in the situation where the HTML elements of the web content 1006 at coordinate (1) and coordinate (1) are stored in the web content information table, and coordinate (2) is repeatedly processed as a candidate coordinate. The priorities and sizes of the web content 1006 at the stored coordinate (1) and the web content 1007 at coordinate (2) are the same. That is, even when the priority and the size of the web content are used as conditions, the result expected by the user may not be obtained. That is, in this case, the web content comparison unit 413 determines that there is a need for comparison based on other conditions so that the web content intended by the user is determined as the selection target, and executes the processing after S1112.

[0073] When the CPU 201 determines that the size of the web content at the candidate coordinate is the same as (Yes) the size of the web content at the stored coordinate, the process proceeds to the process of S1112, and when it determines otherwise (No), the process proceeds to the process of S1107.

[0074] In S1112, the CPU 201 uses the web content comparison unit 413 to compare the value indicating the distance from the candidate coordinate to the pressed coordinate with the value indicating the distance from the stored coordinate to the pressed coordinate. When the CPU 201 determines that the value indicating the distance from the candidate coordinate to the pressed coordinate is smaller than (Yes) the value indicating the distance from the stored coordinate to the pressed coordinate, the process proceeds to the process of S1106. On the other hand, when the CPU 201 determines that the value indicating the distance from the candidate coordinate to the pressed coordinate is larger than or the same as (No) the value indicating the distance from the stored coordinate to the pressed coordinate, the process proceeds to the process of S1107.

[0075] Referring to FIGS. 10(a) and 10(b), the details of the process shown in FIG. 11 will be described. First, in FIG. 10(a), assume that the pressed coordinates 1001 are sent from the window management unit 402 to the web browser 403 as a misselection of the web content 1005, and the process shown in FIG. 11 is executed based on the priority table of FIG. 7. When the coordinate (1) becomes the target of the iterative process, in S1105 and S1109, the web content comparison unit 413 determines that the stored coordinates and the candidate coordinates have the same priority and proceeds to the process of S1110. Here, the size of the web content 1003 of the stored coordinates is 90000 px, and the size of the web content 1005 at the candidate coordinates is 225 px. That is, in S1110, the web content comparison unit 413 determines that the size of the web content 1005 at the candidate coordinates is smaller than the size of the web content 1003 of the stored coordinates. In S1106, the coordinate replacement unit 414 replaces the combination of the stored coordinates and the web content information of the coordinates with the combination of the coordinate (1) and the web content information of the coordinate (1). When the iterative process for all candidate coordinates within the defined range 1002 is completed, it is determined that the web content 1005 is selected, so the user can obtain the expected result.

[0076] Next, in FIG. 10(b), assume that the pressed coordinates 1001 are sent from the window management unit 402 to the web browser 403 as a misselection of the web content 1007, and the process shown in FIG. 11 is executed based on the priority table of FIG. 7. When the coordinate (1) becomes the target of the iterative process, in S1105, the web content comparison unit 413 determines that the priority of the candidate coordinates is high. In S1106, the coordinate replacement unit 414 replaces the combination of the stored coordinates and the web content information of the coordinates with the combination of the coordinate (1) and the web content information of the coordinate (1).

[0077] When the coordinate (2) becomes the target of the loop process, in S1105 and S1109, the Web content comparison unit 413 determines that the stored coordinate and the candidate coordinate have the same priority and proceeds to the process of S1110. In S1110, the Web content comparison unit 413 determines that the size of the Web content of the stored coordinate is the same as the size of the Web content at the candidate coordinate and proceeds to the process of S1111. Here, assume that the candidate coordinate acquisition unit 412 has acquired 50px as the value indicating the distance from the stored coordinate to the pressed coordinate and 35px as the value indicating the distance from the candidate coordinate to the pressed coordinate. In S1111, the Web content comparison unit 413 determines that the value indicating the distance from the candidate coordinate to the pressed coordinate is smaller than the value indicating the distance from the stored coordinate to the pressed coordinate. In S1106, the coordinate replacement unit 414 replaces the combination of the stored coordinate (1) and the Web content information of the coordinate (1) with the combination of the coordinate (2) and the Web content information of the coordinate (2). When the loop process for all candidate coordinates within the definition range 1002 is completed, since Web content 1007 is determined to be selected, the user can obtain the expected result.

[0078] According to the present embodiment, by adding conditions in addition to the priority of the HTML element, the Web content expected by the user can be selected more appropriately.

[0079] <<Third Embodiment>> In the present embodiment, a process that enables the user to obtain the expected result for the selection operation of Web content by changing the definition range and the priority order of HTML elements used by the candidate coordinate acquisition unit 412 will be described. In the following description, differences from the first embodiment will be described, and similar configurations may be omitted.

[0080] Here, when the defined range is fixed, an example where the user cannot obtain the expected result for the selection operation on web content will be described. For example, it is assumed that the size of the range to be complemented by the defined range may vary for each user or according to the situation. The defined range is desirably set based on the resolution of the operation unit 111 so as to be a range that can be covered by the user's finger at the time of pressing in order to complement the deviation between the pressing position expected by the user and the pressing position detected by the touch processing unit 401. However, for users with a small build or users who do not touch strongly at the time of pressing, etc., the defined range may be larger than the portion covered by the finger, so there is a possibility that web content not expected by the user may be selected.

[0081] Also, when the priority of HTML elements is fixed, an example where the user cannot obtain the expected result for the selection operation on web content will be described. For example, it is assumed that the user uses a plurality of web applications. For example, in the priority table, by setting the cost based on the components of the web application such as reducing the cost of the target web content, the target web content expected by the user is prioritized. However, when the input moves from the target web application to the web application for image viewing, the purpose and the usage method of HTML elements may be different between the web applications before and after the movement. In this case, if the priority of HTML elements is fixed, the priority table becomes inappropriate, and there is a possibility that web content not expected by the user may be selected.

[0082] FIG. 14 is a diagram showing an example of the configuration of software modules of the MFP 110 according to the embodiment. The Web browser 403 in the present embodiment includes a setting value management unit 415 in addition to a pressed coordinate storage unit 411, a candidate coordinate acquisition unit 412, a Web content comparison unit 413, and a coordinate replacement unit 414. The setting value management unit 415 manages a table that combines a definition range used by the candidate coordinate acquisition unit 412, and a combination of a Web application and a priority table associated with the Web application, and setting values of priorities of HTML elements for each Web application. Hereinafter, the table that manages the combination of a Web application and a priority table associated with the Web application is referred to as a Web application table. Details of the setting values managed by the setting value management unit 415 will be described later.

[0083] FIG. 15 is a diagram showing an example of a display screen displayed on the operation unit 111 in the present embodiment. FIG. 15(a) is a diagram showing a display screen in which a Web application is displayed by the Web browser 403. The switching button 1501 is a button for setting the process shown in FIG. 8 or FIG. 11, that is, enabling or disabling the coordinate replacement function. In the initial state, the coordinate replacement function is disabled, and when the switching button 1501 is pressed while the function is in the disabled state, the coordinate replacement function becomes enabled. When the switching button 1501 is pressed while the coordinate replacement function is in the enabled state, the function becomes disabled. In a state where the coordinate replacement function is disabled, the pressed coordinates are directly transmitted from the Web browser 403 to the rendering engine 404. The setting button 1502 is a button for setting the Web browser 403. When the setting button 1502 is pressed, or when several hierarchical screens are transitioned after the setting button 1502 is pressed, the screen transitions to the screen such as FIG. 15(b) or FIG. 15(c).

[0084] FIG. 15(b) is a diagram showing a definition range setting screen. The range memory 1503 is a straight line with a memory that visually represents from the lower limit to the upper limit of the setting value of the definition range. The handle 1504 is a handle that visually represents the setting value during the selection of the definition range and can be moved on the range memory 1503 by the user's operation. The range 1505 is a diagram showing the actual definition range when the selected setting value is applied. The determination button 1506 is a button for determining the setting value of the selected definition range. After the user moves the handle 1504 within the range of the range memory 1503, when the determination button 1506 is pressed, the setting value management unit 415 can change the setting value of the definition range. The user can set an appropriate definition range by referring to the range 1505.

[0085] FIG. 15(c) is a diagram showing a selection screen of a web application for setting the priority of HTML elements for each web application. In the selection column 1507, the URLs of the web applications stored by the setting value management unit 415 are displayed as a list. The input column 1508 accepts the input of the URL of the web application to be stored. The add button 1509 is a button for storing the URL of the web application input in the input column 1508. After the user selects the input column 1508 and inputs the URL of the web application, the user presses the add button 1509. Thereafter, the setting value management unit 415 stores the combination of the input web application URL and the initial value of the priority table associated with the web application in the web application table. Specifically, the setting value management unit 415 stores the combination in a memory such as the HDD 204. The delete button 1510 is a button for deleting the combination stored in the web application table. The user selects the URL of any web application displayed in the selection column 1507 and presses the delete button 1510. Thereafter, the setting value management unit 415 deletes the combination on the web application table that matches the selected web application URL from the web application table. The OK button 1511 is a button for transitioning to the setting screen of the priority of the HTML elements of the selected web application. When the user selects the URL of any web application displayed in the selection column 1507 and presses the OK button 1511, the user transitions to the setting screen of the priority of the HTML elements of the selected web application as shown in FIG. 15(d) described later.

[0086] FIG. 15(d) is a diagram showing a setting screen for the priority of HTML elements of a web application. In the selection column 1512, the HTML elements of the web application selected on the screen of FIG. 15(c) are displayed as a list. In the left part of the selection column 1512, the costs representing the priorities are displayed in ascending order. Also, in the selection column 1512, the HTML elements corresponding to the costs are displayed. The up button 1513 and the down button 1514 are buttons for changing the priority of the HTML element selected in the selection column 1512.

[0087] The user selects any of the HTML elements displayed in the selection column 1512 and presses the up button 1513. Then, the setting value management unit 415 exchanges the priority orders of the selected HTML element and one HTML element with a lower cost (higher priority). Similarly, the user selects any of the HTML elements displayed in the selection column 1512 and presses the down button 1514. Then, the setting value management unit 415 exchanges the priority orders of the selected HTML element and one HTML element with a higher cost (lower priority).

[0088] According to the present embodiment, by enabling the user to change the setting values of the definition range and the priority order of the HTML elements, the web content expected by the user can be selected more appropriately.

[0089] <<Other embodiments>> The present disclosure can also be realized by supplying a program that realizes one or more functions of the above-described embodiment to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

[0090] The disclosure of the present embodiment includes configurations represented by the following examples of information processing apparatuses, examples of control methods for information processing apparatuses, and examples of programs.

[0091] <Configuration 1> Display control means for performing control to display a screen including a first object and a second object different from the first object; First acquisition means for acquiring a pressing coordinate that is the coordinate of the screen where a user input operation on the screen has been performed; Determination means for comparing a first priority set for the type of the first object within a predetermined range from the pressing coordinate with a second priority set for the type of the second object within the predetermined range, and determining the object selected by the input operation An information processing apparatus characterized by comprising

[0092] <Configuration 2> The first priority is a priority corresponding to an HTML element that indicates the type of the first object and is set in advance. The information processing apparatus according to Configuration 1, wherein the second priority is a priority corresponding to an HTML element that indicates the type of the second object and is set in advance.

[0093] <Configuration 3> The determination means compares the first priority and the second priority based on a priority order indicating the height of priorities corresponding to a plurality of HTML elements set in advance. The information processing apparatus according to Configuration 2.

[0094] <Configuration 4> When the first priority is higher than the second priority, the determination means determines the first object as the object selected by the input operation. The information processing apparatus according to any one of Configurations 1 to 3.

[0095] <Configuration 5> Even when the pressed coordinates are located on the second object, the determination means determines the first object as the object selected by the input operation. The information processing apparatus according to Configuration 4.

[0096] <Configuration 6> When the first priority and the second priority are the same, the determination means makes the determination based on the size of the first object and the size of the second object. The information processing apparatus according to any one of Configurations 1 to 3.

[0097] <Configuration 7> When the first object is smaller than the second object, the determination means determines the first object as the object selected by the input operation, according to the information processing apparatus described in Configuration 6.

[0098] <Configuration 8> When any of a plurality of candidate coordinates within the predetermined range is located at either the first object or the second object, the information processing apparatus according to any one of Configurations 1 to 7 further includes second acquisition means for acquiring a first candidate coordinate located at the first object and a second candidate coordinate located at the second object.

[0099] <Configuration 9> When the size of the first object is the same as the size of the second object, the determination means makes the determination based on a value indicating the distance from the first candidate coordinate to the press coordinate and a value indicating the distance from the second candidate coordinate to the press coordinate, according to the information processing apparatus described in Configuration 8.

[0100] <Configuration 10> When a value indicating the distance from the first candidate coordinate to the press coordinate is smaller than a value indicating the distance from the second candidate coordinate to the press coordinate, the determination means determines the first object as the object selected by the input operation, according to the information processing apparatus described in Configuration 9.

[0101] <Configuration 11> For each Web application, the information processing apparatus according to Configuration 3, wherein the priority levels corresponding to the plurality of HTML elements can be changed by a user operation.

[0102] <Configuration 12> The size of the predetermined range can be changed by a user operation, according to the information processing apparatus according to any one of Configurations 1 to 11.

[0103] <Configuration 13> The information processing apparatus is the image forming apparatus according to any one of Configurations 1 to 12.

[0104] <Configuration 14> An information processing apparatus having an operation unit, a first acquisition means for acquiring a depression coordinate which is the coordinate of the screen on which a user input operation is performed with respect to the screen displayed on the operation unit; a second acquisition means for acquiring a plurality of candidate coordinates within a predetermined range from the depression coordinate; a determination means for comparing a first priority set for the type of a first object where any one of the plurality of candidate coordinates is located with a second priority set for the type of a second object where any one of the plurality of candidate coordinates is located and which is different from the first object, and determining the object selected by the input operation; a transmission means for transmitting the coordinates of the object determined by the determination means to a rendering engine An information processing apparatus characterized by comprising the above.

[0105] <Configuration 15> a display control step for performing control to display a screen including a first object and a second object different from the first object; a first acquisition step for acquiring a depression coordinate which is the coordinate of the screen on which a user input operation is performed with respect to the screen; a determination step for comparing a first priority set for the type of the first object within a predetermined range from the depression coordinate with a second priority set for the type of the second object within the predetermined range, and determining the object selected by the input operation A control method for an information processing apparatus characterized by comprising the above.

[0106] <Configuration 16> A program for causing a computer to execute the control method for the information processing apparatus according to Configuration 15.

Explanation of Signs

[0107] 110 MFP 111 Operation Unit 120 Web Application Server

Claims

1. Display control means for performing control to display a screen including a first object and a second object different from the first object, First acquisition means for acquiring a press coordinate which is the coordinate of the screen where a user input operation on the screen has been performed, Determination means for comparing a first priority set for the type of the first object within a predetermined range from the press coordinate and a second priority set for the type of the second object within the predetermined range, and determining an object selected by the input operation An information processing apparatus comprising the same.

2. The first priority is a priority corresponding to an HTML element that is preset and indicates the type of the first object, The information processing apparatus according to claim 1, wherein the second priority is a priority corresponding to an HTML element that is preset and indicates the type of the second object.

3. The determination means performs the comparison between the first priority and the second priority based on a priority order indicating the height of priorities corresponding to a plurality of HTML elements preset. The information processing apparatus according to claim 2.

4. When the first priority is higher than the second priority, the determination means determines the first object as the object selected by the input operation. The information processing apparatus according to claim 1.

5. Even when the press coordinate is located on the second object, the determination means determines the first object as the object selected by the input operation. The information processing apparatus according to claim 4.

6. When the first priority and the second priority are the same, the determination means makes the determination based on the size of the first object and the size of the second object. The information processing apparatus according to claim 1.

7. When the first object is smaller than the second object, the determination means determines the first object as the object selected by the input operation. The information processing apparatus according to claim 6.

8. When any one of a plurality of candidate coordinates within the predetermined range is located on either the first object or the second object, the information processing apparatus according to claim 1, further comprising second acquisition means for acquiring a first candidate coordinate located on the first object and a second candidate coordinate located on the second object.

9. When the size of the first object is the same as the size of the second object, the determining means makes the determination based on a value indicating the distance from the first candidate coordinate to the pressing coordinate and a value indicating the distance from the second candidate coordinate to the pressing coordinate. The information processing apparatus according to claim 8.

10. When a value indicating the distance from the first candidate coordinate to the pressing coordinate is smaller than a value indicating the distance from the second candidate coordinate to the pressing coordinate, the determining means determines the first object as the object selected by the input operation. The information processing apparatus according to claim 9.

11. The information processing apparatus according to claim 3, characterized in that for each Web application, the priority level corresponding to the plurality of HTML elements can be changed by a user operation.

12. The information processing apparatus according to claim 1, characterized in that the size of the predetermined range can be changed by a user operation.

13. The information processing apparatus according to claim 1, characterized in that the information processing apparatus is an image forming apparatus.

14. An information processing apparatus having an operation unit, first acquisition means for acquiring a pressing coordinate which is the coordinate of the screen on which a user input operation is performed on the screen displayed on the operation unit; second acquisition means for acquiring a plurality of candidate coordinates within a predetermined range from the pressing coordinate; determining means for comparing a first priority set for the type of a first object where any one of the plurality of candidate coordinates is located and a second priority set for the type of a second object where any one of the plurality of candidate coordinates is located and which is different from the first object, and determining the object selected by the input operation; transmission means for transmitting the coordinates of the object determined by the determining means to a rendering engine An information processing apparatus characterized by comprising.

15. A display control step for performing control to display a screen including a first object and a second object different from the first object; A first acquisition step of acquiring a pressing coordinate which is a coordinate of the screen on which a user input operation has been performed on the screen; A determination step of comparing a first priority set for a type of the first object within a predetermined range from the pressing coordinate and a second priority set for a type of the second object within the predetermined range, and determining an object selected by the input operation; A control method for an information processing apparatus, comprising the above. [

16. ] A program for causing a computer to execute the control method for the information processing apparatus according to claim 15.

Images