Image processing device, image processing method, and program

Abstract

To provide an image that matches a user's request.SOLUTION: An image processing device includes: an object information obtaining unit that obtains information on a first object; an object detecting unit that detects, from image data, the first object, and a second object relevant to the first object; and a display mode changing unit that changes the display mode of the second object when the first object is detected.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an image processing device, an image processing method, and a program. [Background technology]

[0002] Conventionally, a technique has been disclosed in which, for video data visually recognized by a user, information indicating what kind of scene the video data is about is added based on image data output for each frame (for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2018-42253 Summary of the Invention [Problem to be solved by the invention]

[0004] However, when processing image data as in Patent Document 1, it is required to provide an image that meets the user's request.

[0005] The present invention has been made in view of the above, and has as its object to provide an image processing device, an image processing method, and a program that are capable of providing an image that meets a user's request. [Means for solving the problem]

[0006] The image processing device of the present invention includes an object information acquisition unit that acquires information about a first object, an object detection unit that detects the first object and a second object related to the first object from image data, and a display mode change unit that changes the display mode of the second object when the first object is detected.

[0007] The image processing device of the present invention comprises an object information acquisition unit that acquires information on a specific area and information on a first object; a location information processing unit that determines whether a user's location is within the specific area based on the user's location information; an object detection unit that detects the first object related to the specific area and a second object related to the first object from image data; and a display mode change unit that changes the display mode of the second object when it is determined that the user's location is within the specific area and the first object related to the specific area is detected.

[0008] The image processing method of the present invention includes the steps of acquiring information about a first object, detecting the first object and a second object related to the first object from image data, and, when the first object is detected, changing the display mode of the second object.

[0009] The program of the present invention includes the steps of acquiring information about a first object, detecting the first object and a second object related to the first object from image data, and, when the first object is detected, changing the display mode of the second object. [Effects of the Invention]

[0010] According to the present invention, it is possible to provide an image processing device that can provide an image that meets a user's request based on image data. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram showing an example of an image processing system according to this embodiment. [Figure 2] FIG. 2 is a diagram showing an example of an image displayed by the image processing device according to this embodiment. [Figure 3] FIG. 3 is a functional block diagram showing an example of an image processing system according to this embodiment. [Figure 4] FIG. 4 is a diagram showing an example of a main image obtained by superimposing a main image and a sub-image in the first embodiment. [Figure 5] FIG. 5 is a diagram showing an example of the display mode change information according to the present embodiment. [Figure 6] FIG. 6 is a flowchart according to this embodiment. [Figure 7] FIG. 7 is a diagram showing an example of a main image obtained by superimposing a main image and a sub-image in the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, embodiments of an image processing device, an image processing method, and a program according to the present invention will be described with reference to the accompanying drawings. Note that the present invention is not limited to these embodiments. Furthermore, the components in the present embodiments include those that are easily replaceable by those skilled in the art, or those that are substantially identical.

[0013] (First embodiment) FIG. 1 is a diagram illustrating an example of an image processing system according to the present embodiment. The image processing system 1 according to the first embodiment is a device that provides information to a user U by outputting visual stimuli to the user U. As shown in FIG. 1, the image processing system 1 is a so-called wearable device that is worn on the body of the user U. In the example of the present embodiment, the image processing system 1 includes an image processing device 100 that is worn on the eyes of the user U. The image processing device 100 worn on the eyes of the user U includes an output unit 120 (described below) that outputs visual stimuli (displays images) to the user U. However, the configuration of FIG. 1 is merely an example, and the number of devices and their positions on the user U may also be arbitrary. For example, the image processing system 1 is not limited to a wearable device and may be a device carried by the user U, such as a so-called smartphone or tablet terminal.

[0014] (Main statue) 2 is a diagram showing an example of an image displayed by the image processing device according to this embodiment. As shown in FIG. 2, the image processing system 1 provides a main image PM to the user U through the output unit 120. This allows the user U wearing the image processing system 1 to view the main image PM. In this embodiment, the main image PM is an image of the scenery that the user U would view if the user U were not wearing the image processing system 1, and can also be said to be an image of an actual object that falls within the field of view of the user U. The field of view refers to the range that can be seen without moving the eyes, centered on the line of sight of the user U.

[0015] In this embodiment, the image processing system 1 provides the user U with a main image PM by, for example, transmitting external light (ambient visible light) from the output unit 120. That is, in this embodiment, the user U directly views an image of an actual scene through the output unit 120. However, the image processing system 1 is not limited to allowing the user U to directly view an image of an actual scene, and may provide the user U with the main image PM through the output unit 120 by displaying an image of the main image PM on the output unit 120. In this case, the user U views the image of the scene displayed on the output unit 120 as the main image PM. In this case, the image processing system 1 displays an image captured by the imaging unit 200 (described later) that falls within the field of view of the user U as the main image PM on the output unit 120.

[0016] (Sub-image) As shown in Fig. 2, the image processing system 1 displays the sub-image PS on the output unit 120 so as to be superimposed on the main image PM provided through the output unit 120. As a result, the user U visually recognizes an image in which the sub-image PS is superimposed on the main image PM. The sub-image PS is an image superimposed on the main image PM, and can be said to be an image other than real scenery that falls within the field of view of the user U. In other words, the image processing system 1 can be said to provide the user U with AR (Augumented Reality) by superimposing the sub-image PS on the main image PM, which is real scenery.

[0017] In this way, the image processing system 1 provides the main image PM and the sub-image PS, but it may also display an image different from the main image PM and the sub-image PS on the output unit 120, and may be any image.

[0018] (Image processing system configuration) Fig. 3 is a functional block diagram showing an example of an image processing system according to this embodiment. As shown in Fig. 3, the image processing system 1 includes an image processing device 100 and an imaging unit 200. The image processing device 100 includes an input unit 110, an output unit 120, a storage unit 140, a communication unit 130, and a control unit 150.

[0019] (imaging unit) The imaging unit 200 is an imaging device that captures images of the periphery of the image processing system 1 by detecting visible light around the image processing system 1 as environmental information. The imaging unit 200 may be a video camera that captures images at a predetermined frame rate. The imaging unit 200 may be provided in any position and orientation in the image processing system 1. For example, the imaging unit 200 may be provided in the image processing device 100 shown in FIG. 1, and the imaging direction may be the direction in which the face of the user U is facing. This allows the imaging unit 200 to capture an object in the line of sight of the user U, i.e., an object within the field of view of the user U. The number of imaging units 200 is also arbitrary, and may be one or more.

[0020] (Input section) The input unit 110 is a device that accepts user operations, and may be, for example, a touch panel.

[0021] (output section) The output unit 120 is a display that outputs visual stimuli to the user U by displaying an image, and can also be referred to as a visual stimulus output unit. In this embodiment, the output unit 120 is a so-called HMD (Head Mount Display). As described above, the output unit 120 displays the sub-image PS. Note that the output unit 120 may also be provided with an audio output unit (speaker) that outputs audio, and a tactile stimulus output unit that outputs tactile stimuli to the user U. The tactile stimulus output unit outputs tactile stimuli to the user by physically operating, such as by vibration, but the type of tactile stimulus is not limited to vibration and may be any type.

[0022] (Communications Department) The communication unit 130 is a module that communicates with an external device, etc., and may include, for example, an antenna, etc. In this embodiment, the communication method used by the communication unit 130 is wireless communication, but any communication method may be used.

[0023] (Control unit) Control unit 150 is a calculation device, i.e., a CPU (Central Processing Unit). Control unit 150 includes image data acquisition unit 151, object information acquisition unit 152, object detection unit 153, and display mode change unit 154. Control unit 150 reads and executes a program (software) from storage unit 140, thereby realizing image data acquisition unit 151, object information acquisition unit 152, object detection unit 153, and display mode change unit 154 and performing these processes. Note that control unit 150 may perform these processes using a single CPU, or may be provided with multiple CPUs and perform the processes using the multiple CPUs. Furthermore, at least a portion of image data acquisition unit 151, object information acquisition unit 152, object detection unit 153, and display mode change unit 154 may be realized by hardware.

[0024] (Image data acquisition section) The image data acquisition unit 151 acquires image data through the imaging unit 200. In this embodiment, the image data is an image of the main image PM, which is an environmental image that the user U would visually recognize if the user U were not wearing the image processing system 1, and can also be said to be an image of an actual object within the field of view of the user U. The image data acquisition unit 151 may acquire the image data from the storage unit 140.

[0025] FIG. 4 is a diagram showing an example of a main image in which a main image and a sub-image are superimposed in the first embodiment. In the example of FIG. 4, the image data acquisition unit 151 acquires, as image data, a main image PM1 that is viewed by a user U. In the example of FIG. 4, the main image PM1 is a scene in which a child user U receives an injection from a nurse in the presence of a guardian, and includes a syringe O10 and a human face O20. Hereinafter, this embodiment will be described using an injection scene as an example, but this embodiment is not limited to this example.

[0026] (Object information acquisition section) The object information acquisition unit 152 acquires information about the first object. The information about the first object is information about the object designated as the first object. It can also be said that the object information acquisition unit 152 acquires information indicating the type of the first object (information indicating what kind of object the first object is). In this embodiment, the object information acquisition unit 152 acquires information about an object that makes the user U feel fear or disgust when gazing at it, as the information about the first object.

[0027] Here, an object refers to a real object that has a certain shape and can be perceived visually. In this embodiment, the first object is, for example, an object that evokes a sense of fear or disgust in the user U, and it can also be said that the first object is an object that may intensify the user U's sense of fear or disgust when the user U gazes at it. In the example of FIG. 4, a syringe O10 corresponds to the first object.

[0028] (Display mode change information) In this embodiment, the object information acquisition unit 152 acquires display mode change information D. FIG. 5 is a diagram illustrating an example of the display mode change information according to this embodiment. The display mode change information D is information including information about a first object, information about a second object, a predetermined condition, and a changed display mode of the second object. The display mode change information D can be said to be data in which the first object, the second object, the predetermined condition, and the changed display mode of the second object are associated. The second object is an object related to the first object, and can also be said to be an object that the user U is likely to view together with the first object. The predetermined condition refers to a condition related to the second object whose display mode is to be changed. In other words, the predetermined condition refers to a condition for selecting a second object whose display mode is to be changed from among multiple types of second objects. The changed display mode of the second object refers to the display mode of the second object that the user U will view, and more specifically, is information indicating a sub-image PS to be superimposed on the second object. The display mode change information D may include, for different first objects, information on the second object, a predetermined condition, and the display mode of the second object after the change. In other words, multiple types of first objects may be set, and the display mode change information D may be set for each of the first objects.

[0029] The object information acquisition unit 152 may acquire the display mode change information D by any method. For example, the user U may input the first object, the second object, a predetermined condition, and the display mode of the second object after the change. Alternatively, the object information acquisition unit 152 may determine the second object, the predetermined condition, and the display mode of the second object after the change based on the information of the first object input by the user U. Furthermore, setting the display mode change information D by input by the user U is not essential, and may be determined by default.

[0030] (Object detection section) The object detection unit 153 detects a first object and a related second object from the image data based on the display mode change information D. More specifically, the object detection unit 153 detects whether the first object specified in the display mode change information D and the second object associated with the first object in the display mode change information D are included in the image data (the main image PM1 viewed by the user). The object detection unit 153 may detect the first object and the second object using any method, for example, an AI (Artificial Intelligence) model. The AI ​​model in this case is stored in the storage unit 140 and is a model for extracting objects appearing in the image from the image data and identifying their types. The AI ​​model is a trained AI model constructed by learning from multiple datasets, with the image data and information indicating the types of objects appearing in the image as one dataset. In the example of FIG. 4, a syringe O10 is set as the first object and a human face O20 is set as the second object. Therefore, the object detection unit 153 detects the syringe O10, which is the first object, and the human face O20, which is the second object corresponding to the syringe O10 in the display mode change information D, from the image data.

[0031] (Display mode change section) When a first object is detected, the display mode change unit 154 changes the display mode of a second object. In this embodiment, when a first object and a second object are detected from the same image data, the display mode change unit 154 changes the display mode of the second object that satisfies a predetermined condition based on the display mode change information D. Specifically, the display mode change unit 154 determines whether the second object detected from the image data satisfies the predetermined condition indicated by the display mode change information D.

[0032] When multiple second objects are detected, the display mode change unit 154 determines whether each second object satisfies a predetermined condition indicated in the display mode change information D, and extracts the second objects that satisfy the predetermined condition. Then, the display mode change unit 154 changes the display mode of the second objects by displaying a sub-image PS at a position superimposed on the second objects that satisfy the predetermined condition. More specifically, the display mode change unit 154 displays the sub-image PS indicated in the display mode change information D at a position superimposed on the second objects that satisfy the predetermined condition. For second objects that do not satisfy the predetermined condition, the display mode change unit 154 does not display the sub-image PS at the superimposed position, and the display mode of the second objects is not changed.

[0033] In this embodiment, the sub-image PS is an image displayed on the second object to make it difficult for the user U to focus on the first object, which is a specific object included in the main image PM. Any image, such as text or an icon, may be used, or a combination of these, as long as it makes it difficult for the user U to focus on the first object. In the example of FIG. 4 , the condition for changing the display mode of the second object is that it must not be the face O22 of the user U's guardian. When a syringe O10 and a human face O21 are detected, the display mode change unit 154 superimposes, for example, an image of a rabbit's face as the sub-image PS1 only on the nurse's face O21, which satisfies the condition. On the other hand, the display mode change unit 154 does not superimpose the sub-image PS1 on the guardian's face O22, which does not satisfy the predetermined condition. In this case, the user U will view the guardian's face O22 as is.

[0034] In the above description, a combination of a first object, a second object, a predetermined condition, and a post-change display mode of the second object is preset as the display mode change information D. However, this is not limited to this. For example, the sub-image PS, which is the post-change display mode of the second object, does not need to be preset, and any image may be superimposed on the second object. Furthermore, the post-change display mode of the second object is not limited to the sub-image PS superimposed on the second object, but may be an optical process such as color adjustment or blurring of the second object. In the above description, a second object (here, a human face O20) is detected, and the display mode of only the second object (here, the nurse's face O21) that satisfies a predetermined condition is changed. However, this is not limited to this. For example, a predetermined condition may be imposed when detecting the second object, and the object detection unit 153 may detect the second object that satisfies the predetermined condition. That is, the object detection unit 153 may detect only the nurse's face O21 without detecting all human faces O20. Furthermore, the predetermined condition is not necessarily required, and the display mode change unit 154 may change the display mode of the second object when the first object is detected.

[0035] (Storage part) The storage unit 140 is a memory that stores various information such as the calculation contents and programs of the control unit 150, and includes at least one of a main storage device such as a RAM (Random Access Memory), a ROM (Read Only Memory), and an external storage device such as an HDD (Hard Disk Drive). The storage unit 140 stores display mode change information D. The display mode change information D and the programs for the control unit 150 stored in the storage unit 140 may be stored in a recording medium readable by the image processing system 1. The programs for the control unit 150 stored in the storage unit 140 and the display mode change information D are not limited to being stored in advance in the storage unit 140, and the image processing system 1 may obtain these data from an external device via the communication unit 130 when using the data.

[0036] (effect) Here, it is required to provide an image that meets the user's request. In response to this, according to this embodiment, by setting a first object and changing the display mode of a related second object, it is possible to direct the user U's attention to the second object. Therefore, by setting the first object to an object that, for example, evokes fear or disgust in the user U, it becomes difficult for the user U to focus on the first object. In this way, it is possible to provide an image that meets the user's request.

[0037] (flowchart) 6 is a flowchart according to this embodiment. The processing performed by the image processing device 100 will be described below.

[0038] The image data acquisition unit 151 acquires image data through the imaging unit 200 (step S10). Next, the object detection unit 153 detects a first object and a second object related to the first object from the image data based on the display mode change information D (step S20). If the first object is detected from the image data (step S30; Yes), and the second object satisfies a predetermined condition (step S40; Yes), the display mode change unit 154 changes the display mode of the second object (step S50). If the second object does not satisfy the predetermined condition (step S40; No), the display mode change unit 154 does not change the display mode of the second object. In this case, the user U will view an image of the main image PM in which the sub-image PS is superimposed on the second object that satisfies the predetermined condition, i.e., a main image in which the display mode of the second object that satisfies the predetermined condition has been changed. On the other hand, if the first object is not detected from the image data in step S30 (step S30; No), the display mode of the second object is not changed. At this time, the user U will only be able to view the main image PM.

[0039] (Second embodiment) The second embodiment differs from the first embodiment in that the display manner of the second object is changed to make it easier for the user U to recognize the first object. Descriptions of the configurations of the second embodiment common to the first embodiment will be omitted.

[0040] (Image data acquisition section) FIG. 7 is a diagram showing an example of a main image in which a main image and a sub-image are superimposed in the second embodiment. In the example of FIG. 7, the image data acquisition unit 151 acquires, as image data, a main image PM2 that a user U is viewing. In the example of FIG. 7, the main image PM2 is a scene in which the user U is searching for a sign for store A in a busy shopping district, and includes a sign O15 for store A and signs O25 for all stores. Hereinafter, this embodiment will be described using a scene of a store sign as an example, but this embodiment is not limited to this example.

[0041] (Object information acquisition section) In this embodiment, the object information acquisition unit 152 acquires information about an object that the user U needs to recognize as information about the first object. In this embodiment, the first object is, for example, an object that the user U wishes to recognize, and it can also be said that the first object is an object that the user U wishes to find from the main image PM2.

[0042] (Object detection section) In the example of FIG. 7, the object detection unit 153 detects, from the image data, a signboard O15 of store A, which is a first object, and signboards O25 of all stores, which are second objects corresponding to the signboard O15 of store A in the display mode change information D.

[0043] (Display mode change section) In this embodiment, the sub-image PS is an image displayed on the second object to facilitate recognition of the first object, which is a specific object included in the main image PM. Any image, such as text or an icon, may be used, or a combination of these, as long as it facilitates recognition of the first object by the user U. In the example of FIG. 7 , the condition for changing the display mode of the second object is that it must not be the sign O15 of store A. When the sign O15 of store A and the sign O25 of all stores are detected, the display mode change unit 154 performs processing such as superimposing the sub-image PS2 so as to erase the text information of the sign O26 of store B, which satisfies the condition, or superimposing the sub-image PS3 so as to erase the sign O27 of store C, which satisfies the condition. On the other hand, the sign O15 of store A, which does not satisfy the predetermined condition, is not superimposed with the sub-image PS2 or the sub-image PS3, and the user U views the sign O15 of store A as is.

[0044] (effect) According to this embodiment, by setting a first object and changing the display mode of a related second object, it is possible to draw the attention of the user U to the first object. Therefore, by setting the first object as, for example, an object that the user U wants to find, the user U can easily recognize the first object. This makes it possible to provide an image that meets the user's request.

[0045] (Third embodiment) The third embodiment differs from the first embodiment in that the control unit 150 further includes a location information processing unit and changes the display mode of the second object based on information about a specific area. Explanations of parts of the third embodiment that are common to the first embodiment will be omitted.

[0046] (Display mode change information) In this embodiment, the display mode change information D is information that further includes information about a specific region. The specific region is a specific geographical area where a user may be present, and refers to, for example, a region where the user U is expected to use the image processing system 1. Here, in this embodiment, the first object is, for example, an object that is characteristic of the specific region, and the first object can also be said to be an object that the user U is likely to view in the specific region. The display mode change information D may include, for different specific regions, information about the first object, information about the second object, and the changed display mode of the second object. In other words, a plurality of specific regions may be set, and display mode change information D may be set for each specific region.

[0047] (Location information processing unit) In this embodiment, the location information processing unit acquires the user's location information and determines whether the user's location is within a specific area based on the display mode change information D. Here, the user's location information refers to the geographical location where the user U actually exists. The location information processing unit may acquire the user's location information by any method, and may acquire the user's location information via the communication unit 130, for example.

[0048] (Object detection section) In this embodiment, the object detection unit 153 detects a first object associated with a specific region and a second object associated with the first object from the image data based on the display mode change information D. More specifically, the object detection unit 153 detects, based on the display mode change information D, whether the first object associated with the specific region and the second object associated with the first object in the display mode change information D are included in the image data (the main image viewed by the user).

[0049] (Display mode change section) In this embodiment, when the user's location is determined to be within a specific area and the first object and the second object are detected from the same image data, the display mode change unit 154 changes the display mode of the second object that satisfies a predetermined condition based on the display mode change information D.

[0050] In the above description, the display mode change information D is such that the first object is associated with a specific region and the second object is associated with the first object. However, this is not limiting. For example, the first object does not have to be associated with a specific region, and the second object may be associated with the specific region and the first object. That is, when the user is located within a specific region and the first object is detected from the image data, an arbitrary image may be superimposed on the second object associated with the specific region and the first object. In this case, the second object is an object related to the first object and the specific region, and can be said to be an object that the user U is likely to view together with the first object in the specific region.

[0051] In the above description, a combination of a specific region, a first object, a second object, a predetermined condition, and a changed display mode of the second object is set in advance as the display mode change information D, but this is not limited to this. For example, the first object does not have to be set, and when the user's location is within the specific region, an arbitrary image may be superimposed on the second object associated with the specific region. In this case, the second object is an object related to the specific region and can be said to be an object that the user U is likely to view in the specific region.

[0052] (effect) According to this embodiment, by setting a specific area and changing the display mode of the related second object, it is possible to change the display mode of the second object only when the user U is in the specific area, thereby making it possible to provide an image that meets the user's request.

[0053] (Effects of the present invention) The image processing device, image processing method, and program described in each embodiment can be understood, for example, as follows.

[0054] The image processing device of the first aspect includes an object information acquisition unit 152 that acquires information about a first object, an object detection unit 153 that detects the first object and a second object related to the first object from image data, and a display mode change unit 154 that changes the display mode of the second object when the first object is detected. With this configuration, it is possible to detect a specific object from image data in response to a user request and add information to the image data that changes the display mode of the object. This makes it possible to provide an image that meets the user's request.

[0055] The image processing device of the second aspect changes the display mode of the second object when the second object satisfies a predetermined condition, and does not change the display mode of the second object when the second object does not satisfy the predetermined condition. This makes it possible to selectively change the display mode of the second object, thereby better meeting user requests.

[0056] In the image processing device of the third aspect, the object information acquisition unit 152 acquires display mode change information D, which is data in which a first object, a second object, and a display mode of the second object after the change are associated with each other, and when the first object is detected, the display mode change unit changes the display mode of the second object based on the display mode change information D. This makes it possible to change the display modes of the second objects corresponding to a plurality of different first objects, thereby making it possible to better respond to user requests.

[0057] The image processing device of the fourth aspect changes the display mode of the second object so as to make it difficult for a user U viewing the image to gaze at the first object. As a result, when the user needs to avoid gazing at the first object, changing the display mode so that the second object stands out makes it easier for the user to avoid gazing at the first object, thereby making it possible to better meet the user's needs.

[0058] The image processing device of the fifth aspect changes the display mode of the second object so that a user U viewing the image can easily recognize the first object. Specifically, the image processing device of the fifth aspect changes the display mode of the second object to a display mode that deletes text information in the second object. As a result, when the user needs to recognize the first object, changing the display mode so that the second object does not stand out makes it easier to recognize the first object, thereby better meeting the user's needs.

[0059] The image processing device of the sixth aspect includes an object information acquisition unit 152 that acquires information on a specific region and information on a first object, a location information processing unit that determines whether the user's location is within the specific region based on the user's location information, an object detection unit 153 that detects a first object related to the specific region and a second object related to the first object from image data, and a display mode change unit 154 that changes the display mode of the second object when it is determined that the user's location is within the specific region and a first object related to the specific region is detected. With this configuration, it is possible to detect a specific object from image data in response to a request from a user who is present in the specific region and to add information to the image data that changes the display mode of the object. This makes it possible to provide an image that meets the user's request.

[0060] The image processing device of the seventh aspect includes an object information acquisition unit 152 that acquires information on a specific region and information on a first object, a location information processing unit that determines whether the user's location is within the specific region based on the user's location information, an object detection unit 153 that detects the first object and a second object related to the specific region and the first object from image data, and a display mode change unit 154 that changes the display mode of the second object when it is determined that the user's location is within the specific region and the first object is detected. With this configuration, it is possible to detect a specific object from image data in response to a request from a user who is present in the specific region and to add information to the image data that changes the display mode of the object. This makes it possible to provide an image that meets the user's request.

[0061] The image processing device of the eighth aspect includes a specific area information acquisition unit (object information acquisition unit 152) that acquires information about a specific area, a location information processing unit that determines whether the user's location is within the specific area based on the user's location information, an object detection unit 153 that detects an object (second object) related to the specific area from image data, and a display mode change unit 154 that changes the display mode of the object (second object) when it is determined that the user's location is within the specific area. With this configuration, it is possible to detect a specific object from image data in response to a request from a user who is present in the specific area, and to add information to the image data that changes the display mode of the object. This makes it possible to provide an image that meets the user's request.

[0062] The image processing method of the ninth aspect includes the steps of acquiring information about a first object, detecting the first object and a second object related to the first object from the image data, and, if the first object is detected, changing the display mode of the second object.

[0063] The program of the tenth aspect causes a computer to execute the steps of acquiring information about a first object, detecting the first object and a second object related to the first object from image data, and, when the first object is detected, changing the display mode of the second object.

[0064] Although the embodiments of the present invention have been described above, the embodiments are not limited to the contents of these embodiments. Furthermore, the above-described components include those that can be easily imagined by a person skilled in the art, those that are substantially the same, and those that are within the so-called equivalent range. Furthermore, the above-described components can be appropriately combined, and the configurations of each embodiment can also be combined. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the spirit of the above-described embodiments. [Explanation of symbols]

[0065] 1. Image processing system 100 Image processing device 110 Input section 120 Output section 130 Communications Department 140 Storage section 150 control section 151 Image data acquisition unit 152 Object information acquisition unit 153 Object Detection Unit 154 Display mode change unit 200 Imaging unit D. Display mode change information O10 syringe O15, O25, O26, O27 signs O20, O21, O22 face PM, PM1, PM2 Main image PS, PS1, PS2, PS3 sub-images U User

Claims

1. an object information acquisition unit that acquires information about a first object; an object detection unit that detects the first object and a second object related to the first object from image data; a display mode change unit that changes a display mode of the second object when the first object is detected and the second object is not a face of a predetermined person, and does not change a display mode of the second object when the first object is detected and the second object is a face of a predetermined person; An image processing device comprising:

2. the object information acquisition unit acquires display mode change information that is data in which the first object, the second object, and a display mode of the second object after the change are associated with each other; the display mode change unit changes the display mode of the second object based on the display mode change information when the first object is detected. The image processing device according to claim 1 .

3. the display mode change unit changes the display mode of the second object to a display mode in which character information in the second object is deleted; 3. The image processing device according to claim 1.

4. an object information acquisition unit that acquires information about a specific region and information about a first object; a location information processing unit that determines whether the user's location is within the specific area based on the user's location information; an object detection unit that detects the first object related to the specific area and a second object related to the first object from the image data; a display mode change unit that changes a display mode of the second object when it is determined that the user's location is within the specific area and the first object and the second object related to the specific area are detected; An image processing device comprising:

5. obtaining information of a first object; detecting the first object and a second object related to the first object from image data; a step of changing a display mode of the second object when the first object is detected and the second object is not a face of a predetermined person, and not changing a display mode of the second object when the first object is detected and the second object is a face of a predetermined person; An image processing method comprising:

6. obtaining information of a first object; detecting the first object and a second object related to the first object from image data; a step of changing a display mode of the second object when the first object is detected and the second object is not a face of a predetermined person, and not changing a display mode of the second object when the first object is detected and the second object is a face of a predetermined person; A program that causes a computer to execute the following.

Images