Projection control device, projection system, projection control method, and program

Abstract

To enable appropriate projection control according to an object.SOLUTION: A CPU of a control device in a projection system acquires image information including an image of an object and an identification image on the surface of the object, acquires related information on the object on the basis of shape information based on the image of the object and the identification image, and controls projection by the projector on the basis of the related information.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] The present invention relates to a projection control device, a projection system, a projection control method, and a program. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there is known a projection technology that recognizes an object (target object) and executes a process of projecting information relating to the object onto the object (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Special Publication No. 2013-541747 Summary of the Invention [Problem to be solved by the invention]

[0004] However, with the above-mentioned technology, it is sometimes difficult to accurately recognize the detailed type or title of an object with a common shape, such as a book or a CD (Compact Disc), and it is difficult to perform appropriate projection according to the object.

[0005] The present invention has been made in consideration of the above problems, and has an object to enable appropriate projection control according to the target object. [Means for solving the problem]

[0006] In order to solve the above problems, the projection control device according to the present invention comprises: Acquire image information including an image of an object and an identification image on a surface of the object; acquiring shape information based on the image of the object and related information about the object based on the identification image; Controlling projection by a projection device based on the related information. It has a control unit. Effect of the Invention

[0007] According to the present invention, appropriate projection control according to the object is possible. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a schematic diagram illustrating an example of the overall configuration of a projection system. [Diagram 2] FIG. 2 is a diagram showing an example of the projection system of FIG. 1 being installed in a bookstore. [Diagram 3] FIG. 2 is a diagram showing an example of the projection system of FIG. 1 being installed in a bookstore. [Figure 4] FIG. 11 is a diagram illustrating an example of data storage in a related information DB. [Diagram 5] FIG. 1A is a diagram showing a schematic view of the cover side of a book, and FIG. 1B is a diagram showing a schematic view of the back cover side of a book. [Figure 6] 4 is a flowchart showing the flow of a projection control process P1 executed by the control unit of FIG. 1 in the first embodiment. [Figure 7] 13 is a flowchart showing the flow of a projection control process P2 executed by the control unit of FIG. 1 in the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, the embodiments of the present invention will be described with reference to the drawings. However, the embodiments described below are subject to various limitations that are technically preferable for implementing the present invention. Therefore, the technical scope of the present invention is not limited to the following embodiments and illustrated examples.

[0010] <First embodiment> First, a first embodiment of the present invention will be described.

[0011] [Projection System Configuration] FIG. 1 is a block diagram showing an example of the configuration of a projection system 1 according to the first embodiment. 1, the projection system 1 includes a control device 10 (projection control device), a camera 20 (image acquisition device), and a projector 30 (projection device). The control device 10 is communicatively connected to the camera 20 and the projector 30 by wire or wirelessly, and is capable of transmitting and receiving data such as control signals and image data between the control device 10 and the camera 20 and the projector 30.

[0012] FIG. 2 is a diagram showing an example in which the projection system 1 is arranged in a bookstore. As shown in FIG. 2, the camera 20 is installed on, for example, the ceiling, and captures an image of a customer C in front of a bookshelf A and a book B held by the customer C, and transmits the obtained image to the control device 10. The projector 30 is installed on, for example, the ceiling, and projects related information about the book B held by the customer C under the control of the control device 10. As shown in FIG. 3, the camera 20 may also be arranged on the floor of the bookstore so that an image can be captured from the bottom of the book B held by the customer C. In addition, multiple cameras 20 may be arranged so that the book B can be captured from multiple directions, not limited to the top or bottom direction. In addition, multiple projectors 30 may be provided so that the image can be projected in multiple directions, or the projection direction may be changed. In the following description, an example will be described in which the projection system 1 is installed in a bookstore.

[0013] The control device 10 is a device that controls the projection by the projector 30 . As shown in FIG. 1, the control device 10 includes a CPU (Central Processing Unit) 11, a RAM (Random Access Memory) 12, a storage unit 13, and a communication unit 14, and these units are connected to each other via a bus 15.

[0014] The CPU 11 is a processor that reads and executes the program 131 stored in the storage unit 13 and performs various processes to control the operation of each part of the control device 10. In this embodiment, the CPU 11 corresponds to a "control unit" and a "computer." The control unit may have multiple processors (e.g., multiple CPUs), and the multiple processes performed by the CPU 11 may be executed by the multiple processors. In this case, the multiple processors correspond to a "control unit." In this case, the multiple processors may be involved in a common process, or the multiple processors may independently execute different processes in parallel.

[0015] The RAM 12 provides a working memory space for the CPU 11 and stores temporary data.

[0016] The storage unit 13 is a non-transitory recording medium readable by the CPU 11 as a computer, and stores a program 131 and various data. The storage unit 13 includes a non-volatile memory such as a hard disk drive (HDD) or a flash memory. The program 131 includes a program for executing a projection control process P1, which will be described later, and is stored in the storage unit 13 in the form of a computer-readable program code.

[0017] Furthermore, the storage unit 13 stores a related information DB (Data Base) 132. Fig. 4 is a diagram showing an example of data storage in the related information DB 132. As shown in Fig. 4, the related information DB 132 stores book JAN codes and related information corresponding to the book JAN codes in association with each other.

[0018] Fig. 5(a) is a diagram showing a schematic view of the cover side of book B. Fig. 5(b) is a diagram showing a schematic view of the back cover side of book B. As shown in Fig. 5(b), a barcode D (identification image) representing the book JAN code is provided on the surface of the back cover of book B. The book JAN code is information indicating the type of book (title, author, publisher, etc.). The related information is related information about a book specified by the book JAN code, and includes, for example, ratings, comments, advertising information (information on the book's cover, etc.) for the book. The ratings and comments may be, for example, registered by a salesperson at a bookstore, or may be obtained from an external server or site.

[0019] The communication unit 14 performs a communication operation according to a predetermined communication standard. Through this communication operation, the communication unit 14 transmits and receives data wirelessly or wired to and from the camera 20 and the projector 30. The communication unit 14 may also be capable of transmitting and receiving data to and from external devices other than the camera 20 and the projector 30.

[0020] The camera 20 includes a 2D camera 21 and a depth camera 22 . The 2D camera 21 includes an imaging lens, an imaging element such as an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-oxide Semiconductor), an A / D conversion circuit, etc. The 2D camera 21 converts an optical image that has passed through the imaging lens into a two-dimensional image signal by the imaging element to obtain image data (2D image). The depth camera 22 detects the depth (distance to an object) at each position in the shooting range from the depth camera 22, for example, by emitting infrared light and measuring the time it takes for the reflected infrared light to return, thereby acquiring a depth image. The CPU 11 can obtain information on the three-dimensional shape of the object (shape information) based on the depth image.

[0021] The positions and orientations of the 2D camera 21 and the depth camera 22 are set in advance so that a person (e.g., customer C) in front of the bookshelf A and a book (e.g., book B) held by the person are in the shooting range. At least the 2D camera 21 is preferably provided at a plurality of locations so that image information including an identification image (barcode) provided on the surface of the back cover of the book held by the person can be shot even if the back cover of the book faces up or down. In addition, the position and orientation of at least one of the depth cameras 22 is adjusted so that a depth image in the same direction as the projection direction of the projector 30 can be acquired.

[0022] The projector 30 is a projection device that projects (displays) a projection image on a projection surface by highly directing projection light having an intensity distribution according to projection data (projection image) input from the control device 10. In detail, the projector 30 includes a light source, a display element such as a digital micromirror device (DMD) that forms an optical image by adjusting the intensity distribution of the light output from the light source, and a projection lens group that collects the optical image formed by the display element and projects it as a projection image.

[0023] Projection System Behavior Next, the operation of the projection system 1 will be described. In the projection system 1 in the first embodiment, an object held by a person in front of the bookshelf A is regarded as a target object, and when the target object is a book, the projector 30 projects related information about the book.

[0024] 6 is a flowchart showing the flow of a projection control process P1 executed by the CPU 11 of the control device 10 in the first embodiment. The projection control process P1 is executed by the CPU 11 in cooperation with the program 131, for example, when the control device 10 is powered on or when a predetermined time (for example, the opening time of a bookstore) arrives.

[0025] First, the CPU 11 causes the 2D camera 21 and the depth camera 22 of the camera 20 to capture images, and acquires the 2D image captured by the 2D camera and the depth image captured by the depth camera 22 via the communication unit 14 (step S1).

[0026] Next, the CPU 11 analyzes the acquired 2D image and determines whether or not a person is present who is holding an object (step S2). When it is determined that no person is holding an object (step S2; NO), the CPU 11 proceeds to step S10.

[0027] If it is determined that there is a person holding an object (step S2; YES), the CPU 11 acquires three-dimensional shape information (shape information, including position and size) of the target object (object held by the person) contained in the acquired image based on the acquired 2D image and depth image (step S3). For example, the CPU 11 aligns the 2D image and the depth image to identify the position of the object in the depth image and obtain shape information of the object.

[0028] Next, the CPU 11 determines whether the object has a book shape based on the acquired shape information of the object (step S4). For example, the CPU 11 judges whether the object has a book shape based on whether the shape specified by the acquired shape information meets a predetermined criterion for judging the book shape. When it is determined that the object is not book-shaped (step S4; NO), the CPU 11 proceeds to step S10. That is, when the CPU 11 determines that the object does not have a book shape based on the acquired shape information, it controls so that acquisition of related information and projection of a projection image based on the related information by the projector 30 are not performed.

[0029] When it is determined that the object has a book shape (step S4; YES), the CPU 11 identifies the position of a barcode from the image area of ​​the object in the acquired 2D image, and starts reading (decoding) the barcode (step S5).

[0030] Next, the CPU 11 determines whether or not the barcode has been successfully read (step S6). If it is determined that the reading of the barcode has failed (step S6; NO), the CPU 11 proceeds to step S10.

[0031] If it is determined that the barcode has been successfully read (step S6; YES), the CPU 11 acquires related information based on the barcode information obtained by decoding (step S7). For example, the CPU 11 retrieves related information related to the object from the related information DB 132, the related information corresponding to the book JAN code as barcode information. The CPU 11 may acquire related information corresponding to the barcode information from an external server, site, or the like via the communication unit 14.

[0032] Next, the CPU 11 generates projection data (projection image) for projecting the related information on the object based on the acquired shape information and related information (step S8).

[0033] In step S8, first, CPU 11 determines whether or not it is possible to project the projection image onto the object based on the acquired shape information. For example, it determines whether or not it is possible to project the projection image onto the object based on whether or not the object has a planar area of ​​a predetermined size or more, whether or not the inclination of the planar area of ​​the object relative to projector 30 is within a predetermined range, etc.

[0034] When it is determined that the projection image can be projected onto the object, the CPU 11 identifies a planar area of ​​the object based on the acquired shape information, determines it as the projection object area, and generates a projection image showing the acquired related information with a size according to the determined projection object area. At this time, the CPU 11 identifies the orientation of the person based on the acquired 2D image, and adjusts the orientation of the related information in the projection image according to the orientation of the person. The CPU 11 also corrects (changes) the shape or size of the projection image based on the position, shape, or size of the projection object area on the object. For example, when the projection object area is tilted with respect to the projector 30, keystone correction is performed on the projection image. Alternatively, the projection image may be reduced according to the size of the part less affected by the tilt so that the related information is projected only on the part less affected by the tilt, and the area outside the reduced projection image of the image area according to the projection object area may be converted to black, thereby correcting the projection image so that it is not projected on the part more affected by the tilt.

[0035] If it is determined that projection onto the object is not possible, CPU 11 determines a position visible to the person holding the object, such as a wall or floor, as the projection target area, and generates a projection image for projecting the acquired related information, the size of which corresponds to the determined projection target area. For example, the CPU 11 identifies the direction of the person based on the 2D image, and determines a flat area such as a wall or floor in that direction as the projection target area based on the depth image, and generates a projection image for projecting the acquired related information with a size according to the determined projection target area. In this case, the CPU 11 adjusts the direction of the related information in the projection image and corrects the shape of the projection image, as in the case of determining the object as the projection target area. When there are multiple projectors 30, the CPU 11 determines the projector 30 to be used according to the direction of the person, and adjusts the direction of the related information in the projection image and corrects the shape of the projection image, taking into account the position of the determined projector 30. When the projection direction of the projector 30 can be changed, the CPU 11 determines the direction of the projector 30 to be used according to the direction of the person, and adjusts the direction of the related information in the projection image and corrects the shape of the projection image, taking into account the direction determined by the projector 30.

[0036] Next, the CPU 11 transmits the generated projection image to the projector 30 via the communication unit 14, and causes the projector 30 to project the projection image based on the projection image (step S9), and proceeds to step S10.

[0037] In step S10, the CPU 11 determines whether or not a predetermined end condition is met (step S10). The predetermined end condition is, for example, the arrival of a predetermined time (closing time of the bookstore), the power supply to the control device 10 being turned off, and the like. When it is determined that the predetermined end condition is not met (step S10; NO), the CPU 11 returns to step S1. If it is determined that a predetermined end condition is met (step S10; YES), the CPU 11 ends the projection control process P1.

[0038] In this way, the projection system 1 in the first embodiment acquires image information (2D image and depth image) including an identification image (barcode) on the object and on the surface of the object that indicates the type of object, acquires shape information of the object and related information corresponding to the barcode based on the acquired image information, and controls projection by the projector 30 based on the acquired information. Therefore, the type of the object can be accurately specified using the identification information, making it possible to perform appropriate projection control according to the object.

[0039] <Second embodiment> Next, a second embodiment of the present invention will be described. In the second embodiment, a case will be described in which the products handled at a bookstore are not limited to books, but include other products such as CDs, DVDs, and Blu-ray discs. In the following description, CDs, DVDs, and Blu-ray discs are collectively referred to as discs. A JAN barcode indicating the type of disc is attached to the disc case.

[0040] In the second embodiment, the related information DB 132 stored in the storage unit 13 of the control device 10 includes a related information DB for discs that stores JAN codes and related information of discs in association with each other, in addition to the related information DB for books shown in Fig. 5. Furthermore, in the related information DB 132 of the second embodiment, the JAN codes (book JAN codes) and related information are stored in association with attributes (age, sex, etc.) of people to whom the related information should not be projected. Furthermore, the programs 131 stored in the storage unit 13 include a program for the CPU 11 to execute a projection control process P2, which will be described later. The rest of the configuration of the projection system 1 is the same as in the first embodiment, so the explanation thereof will be cited, and the operation of the second embodiment will be explained below.

[0041] 7 is a flowchart showing the flow of a projection control process P2 executed by the CPU 11 of the control device 10 in the second embodiment. The projection control process P2 is executed by the CPU 11 in cooperation with the program 131, for example, when the control device 10 is powered on or when a predetermined time (for example, the opening time of a bookstore) arrives.

[0042] First, the CPU 11 causes the 2D camera 21 and the depth camera 22 of the camera 20 to capture images, and acquires the 2D image captured by the 2D camera and the depth image captured by the depth camera 22 via the communication unit 14 (step S21).

[0043] Next, the CPU 11 analyzes the acquired 2D image and determines whether or not a person is present who is holding an object (step S22). When it is determined that no person is holding an object (step S22; NO), the CPU 11 proceeds to step S32.

[0044] If it is determined that there is a person holding an object (step S22; YES), the CPU 11 acquires three-dimensional shape information (shape information, including position and size) of the target object (object held by the person) contained in the acquired image based on the acquired 2D image and depth image (step S23). For example, the CPU 11 aligns the 2D image and the depth image to identify the position of the object in the depth image and obtain shape information of the object.

[0045] Next, the CPU 11 determines whether or not the shape of the object is a shape onto which related information is to be projected, based on the acquired shape information of the object (step S24). For example, CPU 11 determines whether the shape of the object is a shape onto which related information is to be projected based on whether the shape identified by the acquired shape information meets predetermined criteria for determining the shape of a projection object (here, a book or a disc case).

[0046] When it is determined that the shape of the object is not a shape onto which related information is to be projected (step S24; NO), the CPU 11 proceeds to step S32. In other words, if the CPU 11 determines based on the acquired shape information that the object does not have a shape that is suitable for projection of related information, the CPU 11 controls the acquisition of related information and the projection of a projection image based on the related information by the projector 30.

[0047] If it is determined that the shape of the object is the shape of the object onto which the related information is to be projected (step S24; YES), CPU 11 identifies the position of the barcode from the image area of ​​the object in the acquired 2D image, and begins reading (decoding) the barcode (step S25).

[0048] Next, the CPU 11 determines whether or not the barcode has been successfully read (step S26). If it is determined that the reading of the barcode has failed (step S26; NO), the CPU 11 proceeds to step S32.

[0049] When it is determined that the barcode has been successfully read (step S26; YES), the CPU 11 acquires related information based on the shape information of the object and the barcode information obtained by decoding the barcode (step S27). For example, the CPU 11 identifies a source of related information about the object (a storage location of related information about the object) based on shape information about the object, and acquires related information corresponding to the barcode information from the identified source.

[0050] Specifically, CPU 11 judges whether the object is a book or a disc based on the shape information of the object. If CPU 11 judges that the object is a book, CPU 11 specifies that the DB in which related information about the object is stored is the related information DB for books, and acquires related information by searching for related information corresponding to the book JAN code, which is barcode information, from the related information DB for books in related information DB 132. If CPU 11 judges that the object is a disc, CPU 11 specifies that the DB in which related information about the object is stored is the related information DB for discs, and acquires related information by searching for related information corresponding to the JAN code, which is barcode information, from the related information DB for discs in related information DB 132. In this way, by identifying the acquisition destination of related information about an object (storage destination of related information about an object) based on shape information of the object, it becomes easy to acquire related information according to the object. The CPU 11 may acquire related information corresponding to the barcode information from an external server, site, or the like via the communication unit 14.

[0051] Next, the CPU 11 identifies the attributes (gender, age, etc.) of the person holding the object based on the 2D image (step S28), and determines whether or not related information can be projected (step S29). For example, CPU 11 performs face recognition on the 2D image to obtain a face image of the person holding the object, and identifies the attributes of the person holding the object based on the face image. CPU 11 then refers to related information DB 132 and determines whether related information can be projected onto the person with the identified attributes.

[0052] In step S29, when it is determined that the related information cannot be projected (step S29; NO), the CPU 11 proceeds to step S32.

[0053] In step S29, if it is determined that the related information can be projected (step S29; YES), the CPU 11 generates projection data (projection image) for projecting the related information based on the acquired shape information and related information (step S30). The process of step S30 is similar to that described in step S8 of FIG. 6, and therefore the description thereof will be used here.

[0054] Next, the CPU 11 transmits the generated projection image to the projector 30 via the communication unit 14, and causes the projector 30 to project the projection image based on the projection image (step S31), and proceeds to step S32.

[0055] In step S32, the CPU 11 determines whether or not a predetermined end condition is met (step S32). The predetermined end condition is, for example, the arrival of a predetermined time (closing time of the bookstore), the power supply to the control device 10 being turned off, and the like. When it is determined that the predetermined end condition is not met (step S32; NO), the CPU 11 returns to step S21. If it is determined that a predetermined end condition is met (step S3; YES), the CPU 11 ends the projection control process P2.

[0056] In this way, the projection system 1 in the second embodiment acquires image information (2D image and depth image) including an image of the object and an identification image (barcode) on the surface of the object, acquires shape information of the object and related information corresponding to the barcode based on the acquired image information, and controls projection by the projector 30 based on the acquired information. Therefore, the type of the object can be accurately specified using the identification information, making it possible to perform appropriate projection control according to the object.

[0057] In addition, in the second embodiment, the source of related information regarding the object (the storage location of related information regarding the object) is identified based on the shape information of the object, and related information corresponding to the barcode information is acquired from the identified source. Therefore, it becomes easy to obtain related information according to the object.

[0058] In the second embodiment, the attributes of the person who holds the object are identified, and based on the attributes of the person and the related information, it is controlled whether or not to project the projection image based on the related information by the projector 30. Therefore, for example, when there is an age restriction on viewing the related information, it is possible to perform appropriate control so as not to project the related information.

[0059] As described above, the CPU 11 of the control device 10 in the projection system 1 acquires image information including an image of an object and an identification image on the surface of the object, acquires relevant information about the object based on shape information based on the image of the object and the identification image, and controls the projection by the projector 30 based on the acquired relevant information. Therefore, the type of the object can be identified with high accuracy, making it possible to perform appropriate projection control according to the object.

[0060] For example, the CPU 11 generates a projection image for projecting the related information based on information about the three-dimensional shape of the object and the related information about the object, and causes the projector 30 to project the projection image based on the generated projection image. Therefore, it is possible to project related information according to the type of object.

[0061] Furthermore, for example, the CPU 11 controls whether or not to project a projection image from the projector 30, based on information about the three-dimensional shape of the object. Therefore, for example, it is possible to determine whether an object is a projection target or not from the three-dimensional shape of the object, and perform appropriate projection. In the above embodiment, whether or not to project the projection image is determined based on the three-dimensional shape of the object, but this is not limited to the above. The projection may be determined based on the size and color of the object, and the surface condition of the projectable surface, such as the color and pattern.

[0062] Also, for example, the CPU 11 acquires image information of a person holding an object, identifies attributes of the person based on the acquired image information of the person, and controls whether or not to project a projection image from the projector 30 based on the identified attributes and related information of the person. Therefore, for example, when the related information has an age restriction, it is possible to perform appropriate control so as not to project the related information.

[0063] Furthermore, the CPU 11 causes the projector 30 to project a projection image onto an object. Therefore, it is possible to provide a user who is looking at an object with relevant information about the object by projecting it onto the object.

[0064] Furthermore, CPU 11 determines whether or not it is possible to project a projection image onto the object based on information about the three-dimensional shape of the object, and if projection is possible, causes projector 30 to project the projection image onto the object. Thus, projection can be performed on an object if the shape of the object is suitable for projection. In the above embodiment, whether or not it is possible to project an image onto an object is determined based on the three-dimensional shape of the object, but this is not limited to the above. It may be configured to determine whether or not it is possible to project an image onto an object by taking into consideration the size and color of the object, and the surface condition of the object, such as the color and pattern of the surface onto which the image can be projected.

[0065] Furthermore, the CPU 11 changes the shape or size of the projection image based on information about the three-dimensional shape or size of the object. Therefore, projection can be performed in a manner that is easy for the user to view, in accordance with the three-dimensional shape and size of the object.

[0066] Furthermore, the CPU 11 acquires image information of a person who is holding an object, identifies the orientation of the person, and causes the projector 30 to project an image at a position where the person can see the image. Therefore, information related to the object can be projected at a position that is easily visible to the person holding the object.

[0067] Furthermore, the CPU 11 identifies a source of related information regarding the object based on information about the three-dimensional shape of the object, and acquires the related information from the identified source. Therefore, it becomes easy to obtain related information according to the object.

[0068] In addition, the object is a product, and the related information includes at least one of an evaluation, a comment, or advertising information for the object. Therefore, evaluations, comments, and advertising information regarding the object can be provided to a person holding the object, thereby making the person interested in the object.

[0069] The above description of the embodiment is merely a preferred example of the projection system, the control device, the projection area determination method, and the program according to the present invention, and the present invention is not limited to this.

[0070] For example, in the above embodiment, the control device 10, the camera 20, and the projector 30 of the projection system 1 are each an independent device, but these devices may be integrated into one device. Alternatively, the control device 10 and the projector 30 may be integrated into one device, and the camera 20 may be a separate device. For example, the function of the control device 10 may be provided in the housing of the projector 30. Alternatively, the camera 20 and the projector 30 may be integrated into one device, and the control device 10 may be a separate device. Alternatively, the control device 10 and the camera 20 may be integrated into one device, and the projector 30 may be a separate device.

[0071] In the above embodiment, the identification image is a barcode, but other images such as a QR code (registered trademark) may be used as long as the image can identify the type of object.

[0072] In the above embodiment, an example is disclosed in which the HDD or flash memory of the storage unit 13 is used as a computer-readable medium for the program according to the present invention, but the present invention is not limited to this example. As other computer-readable media, information recording media such as CD-ROMs can be applied. In addition, carrier waves are also applied to the present invention as a medium for providing data of the program according to the present invention via a communication line.

[0073] Furthermore, it goes without saying that the detailed configurations and detailed operations of the components of the control device 10, projector 30, and depth camera 22 in the above embodiment can be modified as appropriate without departing from the spirit of the present invention. [Explanation of symbols]

[0074] 1 Projection System 10 Control device 11 CPU 12 RAM 13 Storage section 131 Programs 14 Communications Department 15 Bus 20 Camera 21 2D Camera 22 Depth Camera 30 Projector

Claims

1. Acquire image information including an image of an object and an identification image on a surface of the object; acquiring shape information based on the image of the object and related information about the object based on the identification image; Controlling projection by a projection device based on the related information. A projection control device having a control unit.

2. The control unit is generating a projection image for projecting the related information based on information on the three-dimensional shape of the object and the related information; projecting a projection image by the projection device based on the generated projection image; The projection control device according to claim 1 .

3. The control unit is controlling whether or not to project the projection image by the projection device based on information about the three-dimensional shape of the object; The projection control device according to claim 2 .

4. The control unit is acquiring image information of a person holding the object, and identifying attributes of the person based on the image information of the person; controlling whether or not to project the projection image by the projection device based on the attributes of the person and the related information; The projection control device according to claim 2 .

5. The control unit is projecting the projection image onto the object by the projection device; The projection control device according to claim 2 .

6. The control unit is controlling whether or not to project the projection image onto the object by the projection device based on a three-dimensional shape, a size, a color, or a surface condition of the object; The projection control device according to claim 5 .

7. The control unit is determining whether or not the projection image can be projected onto the object based on a three-dimensional shape, a size, a color, or a surface condition of the object, and if projection is possible, projecting the projection image onto the object by the projection device; The projection control device according to claim 5 .

8. The control unit is changing a shape or a size of the projection image based on information of a three-dimensional shape or a size of the object; The projection control device according to claim 5 .

9. The control unit is acquiring image information of a person holding the object and identifying a direction of the person; projecting the projection image by the projection device at a position where the person can see the projection image; The projection control device according to claim 2 .

10. The control unit is identifying a source of the related information based on information about the three-dimensional shape of the object, and acquiring the related information from the identified source; The projection control device according to claim 1 .

11. The object is a product, The related information includes at least one of an evaluation, a comment, or advertising information for the object. The projection control device according to claim 1 .

12. A projection control device according to any one of claims 1 to 11, A projection device; A projection system comprising:

13. 13. The projection system of claim 12, further comprising an image capture device configured to capture image information including an image of the object and an identification image on a surface of the object.

14. A projection control method for a computer that controls a projection device, comprising: acquiring image information including an image of an object and an identification image on a surface of the object; acquiring shape information based on an image of the object and related information about the object based on the identification image; controlling projection by a projection device based on the related information; A projection control method comprising:

15. The computer that controls the projection device Acquire image information including an image of an object and an identification image on a surface of the object; acquiring shape information based on the image of the object and related information about the object based on the identification image; Controlling projection by a projection device based on the related information. A program for executing a process.

Images