Information processing device, method for controlling information processing device, and program

Abstract

To provide an information processing device capable of appropriately and easily protecting privacy and preventing information leakage when outputting a composite image, a method for controlling the information processing device, and a program.SOLUTION: An information processing device (HMD 200) comprises: image acquisition means (imaging unit 210) for acquiring a captured image obtained by capturing a real object; first generation means (CPU 201) for generating a contour image including contours of the real object; second generation means (CPU 201) for generating a virtual image including a virtual object; first composition means (CPU 201) for compositing the captured image and the virtual image to generate a first composite image; second composition means (CPU 201) for compositing the contour image and the virtual image to generate a second composite image; selection means (privacy protection setting screen 510) for selecting one composite image out of the first composite image and the second composite image to be transmitted to an output destination; and transmission means (system bus 211) for transmitting the selected composite image to the output destination.SELECTED DRAWING: Figure 5A

Description

[Technical Field]

[0001] The present invention relates to an information processing device, a control method for an information processing device, and a program. [Background technology]

[0002] In recent years, technologies related to mixed reality (MR), which combines real space and virtual space, have been actively developed. One known example of this technology is a technology using a video see-through head-mounted display (HMD). By using an HMD, it is possible to display a mixed reality image in which a CG (Computer Graphics) image generated according to the position and orientation of an imaging device such as a video camera is superimposed on an image of real space captured by the imaging device. A user wearing the HMD can then view this mixed reality image. In addition, an HMD may be used by being communicatively connected to a communication means such as the Internet. In this case, the mixed reality image can be made public on an external video sharing platform.

[0003] As described above, mixed reality images include images (videos) of real space. Furthermore, real space images may also include images for which privacy protection or information leakage prevention is desired. In such cases, publishing mixed reality images as they are on an external video sharing platform may make it difficult to protect privacy or prevent information leakage. Therefore, real space images are processed to protect privacy or prevent information leakage. For example, Patent Document 1 discloses an information processing system that, when a captured image contains a specific object, performs a masking process to mask the specific object. The specific object is an image that shows personal information itself or an image that may contain personal information. In this way, the information processing system described in Patent Document 1 can protect privacy. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] International Publication No. 2020 / 049958 Summary of the Invention [Problem to be solved by the invention]

[0005] However, the information processing system described in Patent Document 1 must detect specific objects as privacy protection targets, which places a relatively large burden on the detection process. It is also necessary to register specific objects in advance, and masking is not performed on privacy protection targets that are not included in this registration. It is also known that privacy protection processes such as mosaic processing, substitution, and blurring are performed on the background of an image. Such privacy protection processes on the background result in increased loss of information contained in the background, making them unsuitable for mixed reality images.

[0006] The present invention has been made in view of the above-mentioned problems, and aims to provide an information processing device, a control method for the information processing device, and a program that can easily and adequately protect privacy and prevent information leaks when outputting a composite image. [Means for solving the problem]

[0007] In order to achieve the above-mentioned object, the information processing device of the present invention is characterized by comprising an image acquisition means for acquiring a captured image of a real object, a first generation means for generating a contour image including the contour of the real object, a second generation means for generating a virtual image including a virtual object, a first synthesis means for synthesizing the captured image with the virtual image to generate a first composite image, a second synthesis means for synthesizing the contour image with the virtual image to generate a second composite image, a selection means for selecting one of the first composite image and the second composite image to be sent to an output destination, and a transmission means for transmitting the one composite image selected by the selection means to the output destination. [Effects of the Invention]

[0008] According to the present invention, when a composite image is output, privacy protection and information leakage prevention can be easily performed without excess or deficiency. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing an example of a usage state when the information processing device according to the first embodiment is applied to an HMD (head mounted display). [Figure 2] FIG. 2 is a block diagram showing an example of a hardware configuration of the HMD in FIG. [Figure 3] FIG. 10 is a diagram for explaining a first composite image. [Figure 4] FIG. 10 is a diagram for explaining a second composite image. [Figure 5A] 10 is a flowchart showing processing executed by the HMD. [Figure 5B] FIG. 10 is a diagram illustrating an example of a screen displayed on an HMD. [Figure 6] FIG. 10 is a diagram illustrating an example of a usage state when the information processing device according to the second embodiment is applied to an HMD. [Figure 7] 10 is a flowchart showing processing executed by the HMD. DETAILED DESCRIPTION OF THE INVENTION

[0010] Each embodiment of the present invention will be described in detail below with reference to the drawings. However, the configurations described in each of the following embodiments are merely examples, and the scope of the present invention is not limited to the configurations described in each embodiment. For example, each component constituting the present invention can be replaced with any configuration that can perform the same function. Also, any component may be added. Furthermore, any two or more configurations (features) of each embodiment can be combined.

[0011] First Embodiment The first embodiment will be described below with reference to Figs. 1 to 5. Fig. 1 is a diagram showing an example of a usage state when an information processing device according to the first embodiment is applied to an HMD (head mounted display). As shown in Fig. 1, the HMD 200 is used in a state where it is worn on the head of a user 100 (hereinafter referred to as "wearing state"). The user 100 can experience mixed reality (MR) with the HMD 200.

[0012] FIG. 2 is a block diagram showing an example of the hardware configuration of the HMD in FIG. 1. As shown in FIG. 2, the HMD 200 includes a CPU 201, a ROM 202, a RAM 203, a GPU (Graphics Processing Unit) 204, and a mass storage unit 205. The HMD 200 also includes a communication unit 206, an operation unit 207, a posture detection unit 208, a display unit (display means) 209, and an imaging unit (image acquisition means) 210. These pieces of hardware included in the HMD 200 are connected to each other via a system bus 211 so as to be able to communicate with each other. The CPU 201 is a computer that controls the entire HMD 200. The ROM 202 stores a program for controlling the HMD 200. The CPU 201 can control the HMD 200 by reading the program from the ROM 202 and executing the program. The ROM 202 is not particularly limited, and may be, for example, a flash memory. The RAM 203 is used as the main memory of the CPU 201. The RAM 203 is not particularly limited and may be, for example, a volatile memory such as a dynamic random access memory (DRAM). The GPU 204 performs parallel data processing. The GPU 204 is not particularly limited and may be, for example, an LSI designed to perform various operations in rendering three-dimensional model data at high speed and in parallel. Alternatively, a reconfigurable logic circuit known as an FPGA (Field Programmable Gate Array) may be used instead of the GPU 204. The mass storage unit 205 stores programs for controlling the HMD 200, various data used by the programs, data acquired from the communication unit 206, and the like. The programs include, for example, programs for causing the CPU 201 to execute each unit and each means (control method of an information processing device) of the HMD 200. The mass storage unit 205 is not particularly limited and may be, for example, a semiconductor storage device such as an embedded multimedia card (eMMC) or a solid state disk (SSD).Furthermore, the mass storage unit 205 may be configured with a storage medium such as a memory card and an interface unit to which the storage medium is detachably attached.

[0013] The communication unit 206 has a wired communication function for performing wired communication or a wireless communication function for performing wireless communication, and transmits and receives data to and from an external device. The communication unit 206 is not particularly limited and can be configured, for example, with an antenna and a communication controller for controlling the antenna. The antenna may be an antenna for realizing wireless communication according to IEEE802.11a, IEEE802.11b, IEEE802.11g, IEEE802.11n, IEEE802.11ac, or IEEE802.11ax. The communication unit 206 may also be configured, for example, with a unit for realizing wired communication according to the USB standard. The external device is not particularly limited and can be, for example, an information processing device other than the HMD 200, such as a server on the Internet or a personal computer on a local network. The operation unit 207 detects input operations from the user. The operation unit 207 is not particularly limited and can be, for example, a physical button or a touchpad sensor. The operation unit 207 can also be configured with an antenna for realizing wireless communication according to Bluetooth (registered trademark) and a communication controller for controlling the antenna. In this case, the operation unit 207 receives operation information from a controller (not shown) held by the user 100.

[0014] The orientation detection unit 208 detects the orientation and position of the HMD 200. The orientation detection unit 208 is not particularly limited, and for example, an inertial measurement unit (IMU) or the like is used. The inertial measurement unit is composed of, for example, an acceleration sensor for detecting the acceleration of the HMD 200, a gyro sensor for detecting the angular velocity of the HMD 200, a geomagnetic sensor for detecting the orientation of the HMD 200, a signal processing circuit, etc. The display unit 209 displays a composite image (image) rendered by the GPU 204. The display unit 209 has a display device for the left eye and a display device for the right eye of the user 100. This makes it possible to display different composite images taking parallax into consideration, thereby enabling stereoscopic viewing. The display device is not particularly limited, and for example, a liquid crystal panel, an organic EL panel, etc. are used.

[0015] The imaging unit 210 acquires a captured image of a real object (object) (image acquisition process). For example, in FIG. 1, the real objects include the monitor 101, the photo frame 102, and the stand 103 on which the monitor 101 and the photo frame 102 are placed. However, this is not limited to this. The number of real objects to be captured, i.e., the subject, is not limited to multiple objects and may be, for example, one. The imaging unit 210 has two cameras (not shown) arranged on the left and right sides when worn. This allows distance information regarding the distance to the real object to be acquired through stereoscopic vision. In this embodiment, the imaging unit 210 also functions as a distance acquisition unit that acquires distance information. Note that the HMD 200 may have a section that functions as a distance acquisition unit separate from the imaging unit 210. In this case, a laser distance measurement device or the like may be used as the distance acquisition unit. The captured image acquired by the imaging unit 210 configured as described above undergoes various image processing by the CPU 201 and is stored in the RAM 203 as left and right image data. Each camera constituting the imaging unit 210 has, for example, an optical system that controls an optical lens unit, an aperture, a zoom, a focus, etc., and an imaging element that converts light (image) introduced from the optical system into an electrical video signal. The imaging element is not particularly limited, and for example, a CMOS imaging element (CMOS image sensor), a CCD imaging element (CCD image sensor), etc. can be used. Furthermore, each camera may have a ToF (Time of Flight) sensor that measures distance, or a LiDAR scanner that acquires the geometric shape of space.

[0016] FIG. 3 is a diagram illustrating the first composite image. FIG. 3 illustrates a virtual image 301, a captured image 302, and a first composite image 303. The virtual image 301 is an image including a virtual object. The virtual image 301 is generated by the CPU 201 (second generation step). In this embodiment, the CPU 201 also functions as a virtual image generating means (second generation means) that generates the virtual image 301. Note that in the HMD 200, a section functioning as a virtual image generating means may be provided separately from the CPU 201. The virtual object in FIG. 3 is a camera 304, but is not limited to this. Furthermore, the number of virtual objects included in the virtual image 301 is one in FIG. 3, but is not limited to this and may be, for example, multiple. The captured image 302 is an image acquired by the imaging unit 210. The captured image 302 includes real objects, such as a monitor 101, a photo frame 102, and a stand 103. Furthermore, information 305, such as a graph, is displayed on the monitor 101. A facial photograph 306 is placed in the photo frame 102. The first composite image 303 is an image obtained by combining the virtual image 301 and the photographed image 302, i.e., by superimposing the virtual image 301 on the photographed image 302. As a result, the first composite image 303 includes the camera 304, the monitor 101 displaying the information 305, the photo frame 102 containing the facial photograph 306, and the stand 103 on which the camera 304, the monitor 101, and the photo frame 102 are placed. The first composite image 303 is generated by the CPU 201 (first composition step). As described above, in this embodiment, the CPU 201 also functions as a first composite image generating means (first composition means) that generates the first composite image 303. Note that the HMD 200 may include a section that functions as the first composite image generating means, separate from the CPU 201. The first composite image 303 also includes color information of the photographed image 302 in real space.

[0017] As described above, the first composite image 303 is an image obtained by combining the virtual image 301 and the photographed image 302. The photographed image 302 may contain, for example, at least one of private information and confidential information. For example, in the photographed image 302, information 305 such as a graph is displayed on the monitor 101, and a face photo 306 is placed in the photo frame 102. The information 305 may be confidential information, and the face photo 306 may be privacy information. In this case, the first composite image 303 also contains at least one of private information and confidential information. If the first composite image 303 is output unintentionally (unintentionally), privacy protection and confidentiality for the first composite image 303 may be insufficient depending on the output destination. Furthermore, as described above, the first composite image 303 contains color information in the real space of the photographed image 302. As a result, first composite image 303 may contain information 305 that can be identified from color and / or a facial photograph 306. In this case, if first composite image 303 is output unintentionally, there is a risk that privacy protection and confidentiality for first composite image 303 may not be sufficient.

[0018] Therefore, the HMD 200 is configured to ensure sufficient privacy protection and confidentiality when outputting a composite image. The following describes this configuration and operation. FIG. 4 is a diagram illustrating the second composite image. FIG. 4 illustrates a virtual image 301, a contour image 402, and a second composite image 403. The contour image 402 is an image including contours of the monitor 101, the photo frame 102, and the stand 103 detected based on the distance acquired by the image capture unit 210, as well as other irregularities. In the HMD 200, the CPU 201 generates a contour image in which the contours of real objects appear based on the distance information acquired by the image capture unit 210 (first generation step). Here, the contour simply refers to the shape or silhouette of a real object. For example, a contour image can be generated by converting the value of the distance information into pixel values ​​so that closer objects appear redder and farther objects appear bluer. Note that the image may include information other than contours, as long as it can provide better privacy protection than a captured image. In this embodiment, the CPU 201 also functions as a first generating unit that generates a contour image in which the contour of a physical object appears. Note that, in the HMD 200, a unit that functions as the first generating unit may be provided separately from the CPU 201.

[0019] The second composite image 403 is an image obtained by combining the virtual image 301 and the outline image 402, i.e., by superimposing the virtual image 301 on the outline image 402. As a result, the second composite image 403 includes the camera 304, the monitor 101, the photo frame 102, and the stand 103 on which the camera 304, the monitor 101, and the photo frame 102 are placed. The relative positions of the camera 304, the monitor 101, the photo frame 102, and the stand 103 in the second composite image 403 are the same as the relative positions of the camera 304, the monitor 101, the photo frame 102, and the stand 103 in the first composite image 303. Note that in the second composite image 403, the monitor 101 is displayed as an outline, and therefore does not include the information 305 that is included in the first composite image 303. Similarly, the photo frame 102 in the second composite image 403 is displayed as an outline, and therefore does not include the facial photograph 306 like the first composite image 303. The second composite image 403 described above includes the same real objects as the first composite image 303, but both private information and confidential information are concealed, i.e., hidden. Furthermore, unlike the first composite image 303, the second composite image 403 does not include color information in the real space of the captured image 302. As a result, private information and confidential information that can be discerned from color are concealed in the second composite image 403. The second composite image 403 is generated by the CPU 201 (second synthesis step). As described above, in this embodiment, the CPU 201 also functions as second composite image generating means (second synthesis means) that generates the second composite image 403. Note that in the HMD 200, a section functioning as the second composite image generating means may be provided separately from the CPU 201. When generating the second composite image 403, the CPU 201 may change the overall color of the outline image 402 in accordance with the color of the camera 304. This can improve the visibility of the camera 304 in the second composite image 403.

[0020] FIG. 5A is a flowchart showing processing executed by the HMD. FIG. 5B is a diagram showing an example of a screen displayed on the HMD. A program based on the flowchart shown in FIG. 5A is repeated at a predetermined cycle. As shown in FIG. 5A, in step S501, the CPU 201 of the HMD 200 controls the imaging unit 210 to capture an image in front of the HMD 200. This results in the acquisition of a captured image 302 that includes, for example, the monitor 101, the photo frame 102, and the stand 103, which are real objects. The CPU 201 performs image processing on the captured image 302 and stores the captured image 302 in the RAM 203.

[0021] In step S502, the CPU 201 obtains distance information to the monitor 101, the photo frame 102, and the stand 103, which are physical objects, by using stereoscopic vision with the imaging unit 210.

[0022] In step S503, the CPU 201 acquires information about an arbitrary virtual object from the RAM 203. Note that information about a plurality of virtual objects is stored in advance in the RAM 203. The CPU 201 generates a virtual image 301 based on the information about the virtual object acquired from the RAM 203, the captured image 302 acquired in step S501, the distance information acquired in step S502, and the orientation of the HMD 200 acquired from the orientation detection unit 208. The virtual image 301 is an image that includes a camera 304, which is a virtual object. Note that, when generating the virtual image 301, it is preferable to take into consideration the position and orientation of the camera 304, occlusion of the camera 304 by a real object, and the like.

[0023] In step S504, the CPU 201 determines whether to use the outline image 402 when generating the composite image. This determination is made based on an operation on the privacy protection setting screen 510 shown in FIG. 5B. The privacy protection setting screen 510 is displayed on the display unit 209. The privacy protection setting screen 510 includes a checkbox 511 that is checked to enable the privacy protection setting and a checkbox 512 that is checked to disable the privacy protection setting. The privacy protection setting screen 510 also includes an OK button 513 and a Cancel button 514. By operating, i.e., pressing, the OK button 513 with the checkbox 511 checked, the privacy protection setting is enabled. In this case, the CPU 201 determines to use the outline image 402 when generating the composite image. As described above, the second composite image 403, which includes the outline image 402, is an image in which both private information and confidential information are concealed. As a result, the second composite image 403 can be said to be an image effective for privacy protection, etc. Furthermore, by operating, i.e., pressing, the OK button 513 with the checkbox 512 checked, the privacy protection setting is disabled. In this case, the CPU 201 determines that the outline image 402 will not be used when generating a composite image. Furthermore, by operating the cancel button 514, the selection state (setting state) on the privacy protection setting screen 510 is canceled, and the screen transitions to, for example, a home screen (not shown).

[0024] In this way, privacy protection setting screen 510 is a selection screen (selection means) on which an operation to select whether or not to perform privacy protection is performed. Based on this selection operation (selection step), in subsequent step 508, one of the first composite image and the second composite image is transmitted to mass storage unit 205, which is the output destination. Mass storage unit 205 stores the transmitted composite image. Then, if CPU 201 determines in step S504 that outline image 402 will be used, the process proceeds to step S505. On the other hand, if CPU 201 determines in step S504 that outline image 402 will not be used, the process proceeds to step S507.

[0025] In step S505, the CPU 201 generates the contour image 402 based on the distance information acquired in step S502. When generating the contour image 402, the CPU 201 may change the generation method based on the virtual image 301 generated in step S503.

[0026] In step S506, the CPU 201 generates a second composite image 403 by combining the virtual image 301 generated in step S503 and the contour image 402 generated in step S505.

[0027] In step S507, the CPU 201 generates a first composite image 303 by combining the captured image 302 acquired in step S501 and the virtual image 301 generated in step S503.

[0028] In step S508, CPU 201 transmits the second composite image 403 generated in step S506 or the first composite image 303 generated in step S507 to mass storage unit 205 as an output destination via system bus 211 (transmission means) (transmission step). Mass storage unit 205 stores the first composite image 303 or second composite image 403. After step S508 is executed, the process ends.

[0029] As described above, the HMD 200 allows the user to select whether or not to enable privacy protection on the privacy protection setting screen 510. Specifically, if privacy protection is desired, the user checks the checkbox 511. If privacy protection is not desired, the user checks the checkbox 512. When the checkbox 511 is checked, the second composite image 403, in which both private information and confidential information are concealed, is stored in the mass storage unit 205. On the other hand, when the checkbox 512 is checked, the first composite image 303, in which both private information and confidential information are displayed, is stored in the mass storage unit 205. Furthermore, the HMD 200 can omit identifying targets for privacy protection or information leakage prevention from among real objects, or performing mosaic processing, etc., on each target. Therefore, the HMD 200 can easily perform privacy protection or information leakage prevention as needed when outputting a composite image. Furthermore, in the HMD 200, regardless of whether the composite image transmitted to the mass storage unit 205 is the first composite image or the second composite image, the first composite image is displayed on the display unit 209. In this way, the display unit 209 is excluded as an output destination. This is because the composite image viewed by the user 100 on the display unit 209 does not need to be the second composite image 403 in which neither the private information nor the confidential information is concealed.

[0030] Second Embodiment The second embodiment will be described below with reference to FIGS. 6 and 7. Differences from the previous embodiment will be mainly described, and similar points will not be described again. This embodiment is similar to the first embodiment except for the output destination of the composite image. FIG. 6 is a diagram showing an example of a usage state when an information processing device according to the second embodiment is applied to an HMD. As shown in FIG. 6, a communication unit 206 (transmission means) of the HMD 200 is communicably connected to an information device 602, which is another information processing device different from the HMD 200, via the Internet 601. This allows the communication unit 206 to transmit the first composite image or the second composite image to the information device 602 as the output destination. The information device 602 is, for example, a desktop or notebook personal computer, a tablet terminal, or a smartphone. A user 603 using the information device 602 can share the composite image transmitted from the HMD 200.

[0031] Fig. 7 is a flowchart showing the processing executed by the HMD. In the flowchart shown in Fig. 7, steps S701 to S707 are executed sequentially. Steps S701 to S707 are the same as steps S501 to S507 in the flowchart shown in Fig. 5A. After step S706 or step S707 is executed, the processing proceeds to step S708.

[0032] In step S708, the CPU 201 of the HMD 200 transmits the second composite image 403 generated in step S706 or the first composite image 303 generated in step S707 to the information device 602 as the output destination via the communication unit 206. Then, in the information device 602, if the composite image from the HMD 200 is the first composite image 303, the user 603 can share the first composite image 303 with both the private information and the confidential information revealed. On the other hand, if the composite image from the HMD 200 is the second composite image 403, the user 603 can share the second composite image 403 with both the private information and the confidential information concealed. After step S708 is executed, the processing ends.

[0033] Although preferred embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments and various modifications and alterations are possible within the spirit and scope of the present invention. The present invention can also be realized by providing a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium. One or more general-purpose processors (ASICs) in the computer of the system or device read and execute the program. The present invention can also be realized by a dedicated processor (e.g., an ASIC or FPGA) that realizes one or more functions. Furthermore, the present invention can also be realized by a combination of a general-purpose processor and a dedicated processor. Note that the term "processor" here refers to a processor in a broad sense and includes both general-purpose and dedicated processors. Furthermore, the processing that realizes the present invention may be performed by a single processor alone, or may be performed by multiple processors located in physically separate locations in cooperation with each other. Furthermore, although the HMD 200 is used in the above-described embodiments as a device to which the information processing device can be applied, this is not limited thereto and can also be, for example, a desktop or notebook personal computer, a tablet terminal, a smartphone, or the like. In this case, the personal computer or the like is separately connected to the HMD so as to be able to communicate with it.

[0034] The disclosure of this embodiment includes the following configuration, method, and program. (Configuration 1) An image acquisition means for acquiring a photographed image of a real object; a first generation means for generating a contour image including a contour of the physical object; a second generating means for generating a virtual image including a virtual object; a first synthesis means for synthesizing the captured image and the virtual image to generate a first synthesized image; a second synthesis means for synthesizing the contour image and the virtual image to generate a second synthesized image; a selection means for selecting one of the first composite image and the second composite image to be transmitted to an output destination; a transmitting unit configured to transmit the one composite image selected by the selecting unit to the output destination. (Configuration 2) The photographed image is an image containing at least one of privacy information and confidential information, 2. The information processing device according to configuration 1, wherein when at least one of the pieces of information is to be protected, the second composite image is selected by the selection means. (Configuration 3) A display means for displaying a screen is provided, the display means being excluded from the output destination, 3. The information processing apparatus according to configuration 2, wherein the selection means has a selection screen displayed on the display means, on which an operation for selecting whether or not to protect the at least one piece of information is performed. (Configuration 4) A display means for displaying a screen is provided, the display means being excluded from the output destination, The information processing device according to any one of configurations 1 to 3, characterized in that the display means displays the first composite image regardless of whether the one composite image transmitted by the transmission means is the first composite image or the second composite image. (Configuration 5) A distance acquisition unit is provided for acquiring distance information relating to the distance to the physical object, 5. The information processing apparatus according to any one of configurations 1 to 4, wherein the first generating means generates the contour image based on the distance information acquired by the distance acquiring means. (Configuration 6) The information processing apparatus according to configuration 5, wherein the first generating means generates the contour image by setting pixel values ​​according to the distance information. (Configuration 7) The information processing device described in any one of configurations 1 to 6, characterized in that the second synthesis means, when generating the second synthesis image, is capable of changing the overall color of the contour image depending on the color of the virtual object. (Configuration 8) The information processing device according to any one of configurations 1 to 7, characterized in that it is a head-mounted display equipped with a display means for displaying an image. (Configuration 9) The information processing apparatus according to any one of configurations 1 to 8, wherein the transmitting means transmits the one composite image to a storage means capable of storing an image as the output destination. (Configuration 10) An information processing device described in any one of configurations 1 to 9, characterized in that the transmission means is connected to communicate with each other via the Internet and transmits one of the composite images to another information processing device different from the information processing device as the output destination. (Method 1) A method for controlling an information processing device, comprising: an image acquisition step of acquiring a photographed image of a real object; a first generation step of generating a contour image including a contour of the physical object; a second generation step of generating a virtual image including the virtual object; a first synthesis step of synthesizing the captured image and the virtual image to generate a first synthesized image; a second synthesis step of synthesizing the contour image and the virtual image to generate a second synthesized image; a selection step of selecting one of the first composite image and the second composite image to be sent to an output destination; a transmitting step of transmitting the one composite image selected in the selecting step to the output destination. (Program 1) A program for causing a computer to execute each means of the information processing device according to any one of configurations 1 to 10. [Explanation of symbols]

[0035] 200 HMD 201 CPU 210 Imaging unit 301 Virtual Images 302 Photographed Images 303 First composite image 402 Contour Image 403 Second composite image 510 Privacy protection setting screen

Claims

1. an image acquisition means for acquiring a photographed image of a real object; a first generating means for generating a contour image including a contour of the physical object; a second generating means for generating a virtual image including a virtual object; a first synthesis means for synthesizing the photographed image and the virtual image to generate a first synthesized image; a second synthesis means for synthesizing the contour image and the virtual image to generate a second synthesized image; a selection means for selecting one of the first composite image and the second composite image to be transmitted to an output destination; a transmitting unit configured to transmit the one composite image selected by the selecting unit to the output destination.

2. the captured image is an image including at least one of privacy information and confidential information, 2. The information processing apparatus according to claim 1, wherein the second composite image is selected by the selection means when at least one of the pieces of information is to be protected.

3. a display means for displaying a screen, the display means being excluded from the output destination; 3. The information processing apparatus according to claim 2, wherein the selection means has a selection screen displayed on the display means, on which an operation is performed to select whether or not to protect at least one of the pieces of information.

4. a display means for displaying a screen, the display means being excluded from the output destination; 2. The information processing device according to claim 1, wherein the display means displays the first composite image regardless of whether the one composite image transmitted by the transmission means is the first composite image or the second composite image.

5. distance acquisition means for acquiring distance information relating to the distance to the physical object; The information processing apparatus according to claim 1 , wherein the first generating means generates the contour image based on the distance information acquired by the distance acquiring means.

6. 6. The information processing apparatus according to claim 5, wherein the first generating means generates the contour image by setting pixel values ​​in accordance with the distance information.

7. 2 . The information processing apparatus according to claim 1 , wherein the second synthesis means is capable of changing the overall color of the outline image in accordance with the color of the virtual object when generating the second synthesized image.

8. 2. The information processing apparatus according to claim 1, wherein the information processing apparatus is a head-mounted display having display means for displaying an image.

9. 2. The information processing apparatus according to claim 1, wherein said transmitting means transmits said one composite image to a storage means capable of storing an image as said output destination.

10. 2. The information processing apparatus according to claim 1, wherein the transmitting means is communicably connected via the Internet and transmits the one composite image to another information processing apparatus different from the information processing apparatus as the output destination.

11. A method for controlling an information processing device, comprising: an image acquisition step of acquiring a photographed image of a real object; a first generation step of generating a contour image including a contour of the physical object; a second generation step of generating a virtual image including the virtual object; a first synthesis step of synthesizing the captured image and the virtual image to generate a first synthesized image; a second synthesis step of synthesizing the contour image and the virtual image to generate a second synthesized image; a selection step of selecting one of the first composite image and the second composite image to be transmitted to an output destination; a transmitting step of transmitting the one composite image selected in the selecting step to the output destination.

12. 2. A program for causing a computer to execute each means of the information processing apparatus according to claim 1.

Images