Projection management apparatus and program

Abstract

To provide a projection management apparatus and a program that can define the projection position easily visible to a viewer even if the position of the projector apparatus is indefinite.SOLUTION: The projection management apparatus includes a line-of-sight estimator, a position estimator, and a definer. The line-of-sight estimator estimates the line of sight of a person in a cabin of a vehicle. The position estimator estimates the position of the projector apparatus that is installed in the vehicle and projects an image in the cabin. The definer defines the projection direction of the projector apparatus using the line of sight and the position.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a projection management device and a program.

Background Art

[0002] There is a technique for controlling the projection position of a projection device installed in a vehicle according to the state of seats in the vehicle.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In this technique, the position of the projection device is fixed. Therefore, this technique cannot cope with the case where the position of the projection device is indefinite. The case where the position of the projection device is indefinite is, for example, the case where the projection device is retrofitted.

[0005] The problem to be solved by the embodiments of the present invention is to provide a projection management device and a program capable of determining a projection position that is easy for a viewer to see even when the position of the projection device is indefinite.

Means for Solving the Problems

[0006] The projection management device according to the embodiment includes a line-of-sight estimation unit, a position estimation unit, and a determination unit. The line-of-sight estimation unit estimates the line of sight of a person in the passenger compartment of the vehicle. The position estimation unit estimates the position of a projection device installed in the vehicle and projecting an image into the passenger compartment. The determination unit determines the projection direction of the projection device using the line of sight and the position.

Effects of the Invention

[0007] The present invention can determine a projection position that is easy for a viewer to see even when the position of the projection device is indefinite.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Embodiments for Carrying Out the Invention

[0009] Hereinafter, a projection system according to an embodiment will be described with reference to the drawings. Note that the scales of each part in the following drawings may be appropriately changed. Also, each drawing used in the following description of the embodiment may show the configuration with some parts omitted for the sake of explanation. Further, in each drawing and this specification, the same reference numerals denote the same elements. FIG. 1 is a block diagram showing an example of the main configuration of a projection system 1 according to an embodiment and the components included in the projection system 1. Note that each component of the device may be built-in or externally attached. The projection system 1 is a system that projects an image inside the vehicle cabin of the vehicle 100. The projection system 1 is a system that determines the projection position of the projected image using the line of sight of a person inside the vehicle cabin of the vehicle 100. The projection system 1 includes, as an example, the vehicle 100 and the projection device 200. Note that the projection system 1 may include a part of these.

[0010] The vehicle 100 is, for example, an automobile. The type of the automobile is not limited. The vehicle 100 includes, as an example, a control device 110, a camera 120, and a seat 130. However, the control device 110 does not have to be provided in the vehicle 100.

[0011] The control device 110 is a device capable of controlling the projection device 200. The control device 110 is, for example, an in-vehicle device of the vehicle 100. The in-vehicle device is, for example, an ECU (electronic control unit), a car navigation system, or an ETC (electronic toll collection) in-vehicle unit, etc. Further, the control device 110 may be a smartphone, a tablet terminal, or a PC (personal computer), etc. Alternatively, the projection device 200 may include the control device 110. As an example, the control device 110 includes a processor 111, a ROM (read-only memory) 112, a RAM (random-access memory) 113, an auxiliary storage device 114, a communication interface 115, a display device 116, and an input device 117. And a bus 118, etc., connects these respective parts. The control device 110 may include a camera 120. Note that the control device 110 is an example of a projection management device.

[0012] Processor 111 is the central part of a computer that performs operations such as calculations and controls necessary for the operation of control device 110, and performs various calculations and processes. Processor 111 is, for example, a CPU (central processing unit), MPU (micro processing unit), SoC (system on a chip), DSP (digital signal processor), GPU (graphics processing unit), ASIC (application specific integrated circuit), PLD (programmable logic device), or FPGA (field-programmable gate array), etc. Alternatively, processor 111 is a combination of a plurality of these. Also, processor 111 may be a combination of these with a hardware accelerator or the like. Processor 111 controls each part in order to realize various functions of control device 110 based on programs such as firmware, system software, and application software stored in ROM 112 or auxiliary storage device 114, etc. Also, processor 111 executes the processes described later based on the program. Note that part or all of the program may be incorporated in the circuit of processor 111.

[0013] ROM 112 and RAM 113 are the main storage devices of a computer centered around processor 111. ROM 112 is a non-volatile memory used exclusively for reading data. ROM 112 stores, for example, firmware among the above programs. Also, ROM 112 stores data used by processor 111 when performing various processes.

[0014] RAM 113 is a memory used for reading and writing data. RAM 113 is utilized as a work area or the like that stores data temporarily used by processor 111 when performing various processes. RAM 113 is typically a volatile memory.

[0015] The auxiliary storage device 114 is an auxiliary storage device of a computer centered on the processor 111. The auxiliary storage device 114 is, for example, an EEPROM (electric erasable programmable read-only memory), an HDD (hard disk drive), or a flash memory. The auxiliary storage device 114 stores, among the above programs, for example, system software and application software. The auxiliary storage device 114 also stores data used by the processor 111 to perform various processes, data generated by the processes in the processor 111, and various setting values.

[0016] The communication interface 115 is an interface for the control device 110 to communicate with other devices. This communication may be wireless communication or wired communication. This wireless communication may be a mixture of wireless communication and wired communication.

[0017] The display device 116 displays a screen for notifying various information to the operator of the vehicle 100 or the control device 110. The display device 116 is, for example, a display such as a liquid crystal display or an organic EL (electro-luminescence) display.

[0018] The input device 117 receives operations by the operator of the vehicle 100 or the control device 110. The input device 117 is, for example, a keyboard, a keypad, a touch pad, or a controller. The input device 117 may also be a device for voice input. As the display device 116 and the input device 117, a touch panel can also be used. In this case, the display panel included in the touch panel functions as the display device 116. And the pointing device by touch input included in the touch panel functions as the input device 117.

[0019] The bus 118 includes a control bus, an address bus, a data bus, etc., and transmits signals exchanged among the respective parts of the control device 110.

[0020] The camera 120 is installed inside the vehicle 100. A plurality of cameras 120 may be installed in the vehicle 100. The camera 120 photographs the interior of the vehicle 100. Further, the camera 120 outputs the photographed image data. Note that a moving image is a kind of image.

[0021] The seat 130 is a chair on which a person riding in the vehicle 100 sits. The vehicle 100 includes, as an example, a seat 130 for the driver, a seat 130 for the passenger seat, and a seat 130 for the rear seats. The seat 130 may be deformable. The deformation of the seat 130 is, for example, reclining, front-back sliding, and change in the height of the seat surface. Note that the seat 130 may be provided with a sensor that detects that a person is sitting on the seat 130.

[0022] The control device 110 can acquire seat information. The seat information is information indicating the deformed state of the seat 130. The deformed state includes, for example, the reclining angle of the seat 130, the front-back position of the seat 130, and the height of the seat surface of the seat 130. The control device 110 acquires seat information from, for example, a device that controls the seat 130. The device that controls the seat 130 can detect the deformed state of the seat 130. The device that controls the seat 130 may be able to control the seat 130 to be deformed. The device that controls the seat 130 is, for example, an in-vehicle device of the vehicle 100. Alternatively, the seat 130 may be provided with a device that controls the seat 130. Further, the control device 110 may be a device that controls the seat 130. In this case, the processor 111 of the control device 110 acquires seat information by, for example, detecting the deformed state of the seat.

[0023] Alternatively, the processor 111 of the control device 110 may acquire seat information by detecting the deformed state of the seat by other methods. For example, the processor 111 detects the deformed state of the seat 130 by analyzing an image captured by the camera 120. The seat 130 is shown in the image.

[0024] The projection device 200 is also called a projector. The projection device 200 is a device that projects an image onto a projection target by projecting light. In the embodiment, the projection target is somewhere in the passenger compartment of the vehicle 100. Examples of the projection destination of the image include the ceiling, walls, doors, and floor in the passenger compartment of the vehicle 100, the back side of the backrest of the seat 130, the window glass, and the dashboard. The projection device 200 is, for example, used by being placed inside the vehicle 100. The projection device 200 is, for example, installed inside the vehicle 100. The projection device 200 may be pre-installed in the vehicle 100. As an example, the projection device 200 is installed between the seats of the rear seats.

[0025] As an example, the projection device 200 includes a processor 201, a ROM 202, a RAM 203, an auxiliary storage device 204, a communication interface 205, and a projection device 206. And a bus 207 or the like connects these components.

[0026] The processor 201 is the central part of a computer that performs processes such as operations and controls necessary for the operation of the projection device 200, and performs various operations and processes. The processor 201 is, for example, a CPU, MPU, SoC, DSP, GPU, ASIC, PLD, or FPGA, etc. Alternatively, the processor 201 is a combination of a plurality of these. Also, the processor 201 may be a combination of these with a hardware accelerator or the like. The processor 201 controls each part to realize various functions of the projection device 200 based on programs such as firmware, system software, and application software stored in the ROM 202 or the auxiliary storage device 204, etc. Also, the processor 201 executes the processes described later based on the program. Note that part or all of the program may be incorporated in the circuit of the processor 201.

[0027] The ROM 202 and the RAM 203 are the main storage devices of a computer centered around the processor 201. The ROM 202 is a non-volatile memory used exclusively for reading data. The ROM 202 stores, for example, firmware among the above programs. Also, the ROM 202 stores data used by the processor 201 when performing various processes, etc.

[0028] The RAM 203 is a memory used for reading and writing data. The RAM 203 is utilized as a work area or the like that stores data temporarily used by the processor 201 when performing various processes. The RAM 203 is typically a volatile memory.

[0029] The auxiliary storage device 204 is an auxiliary storage device of a computer centered around the processor 201. The auxiliary storage device 204 is, for example, an EEPROM, an HDD, or a flash memory. The auxiliary storage device 204 stores, among the above programs, for example, system software and application software. Further, the auxiliary storage device 204 stores data used by the processor 201 to perform various processes, data generated by the processes in the processor 201, and various setting values.

[0030] The communication interface 205 is an interface for the projection device 200 to communicate with other devices. This communication may be wireless communication or wired communication. This communication may be a mixture of wireless communication and wired communication.

[0031] The projection device 206 is a display device that projects an image onto a projection target by projecting light. The projection device 206 includes, for example, a light source and a lens. The light source emits light. The lens projects the light onto the projection target.

[0032] The bus 207 includes a control bus, an address bus, a data bus, etc., and transmits signals exchanged among the respective parts of the projection device 200.

[0033] Hereinafter, the operation of the projection system 1 according to the embodiment will be described based on FIG. 2 and the like. Note that the content of the processes in the following operation description is an example, and various processes capable of obtaining the same results can be appropriately used. FIG. 2 is a flowchart showing an example of the processes by the processor 111 of the control device 110. The processor 111 executes the processes in FIG. 2 based on a program stored in, for example, the ROM 112 or the auxiliary storage device 114.

[0034] In step ST11 of FIG. 2, the processor 111 of the control device 110 determines whether to execute the change process. The change process is a process for changing the projection position of the image by the projection device 200 to an optimal position based on the line of sight of the viewer. Note that it does not matter whether the projection device 200 is projecting light or projecting an image at the time of executing the change process. Here, the viewer refers to a person who is riding in the vehicle 100 and is viewing the image. The processor 111 determines to execute the change process, for example, when there is an operation input instructing the input device 117 to perform the change process. If the processor 111 determines not to execute the change process, it determines No in step ST11 and repeats the process of step ST11. On the other hand, if the processor 111 determines to execute the change process, it determines Yes in step ST11 and proceeds to step ST12.

[0035] In step ST12, the processor 111 acquires an image of the interior of the vehicle 100 taken by the camera 120. Note that the processor 111 may acquire a plurality of such images.

[0036] From the above, by performing the process of step ST12, the processor 111 functions as an example of an image acquisition unit that acquires an image of the interior of the vehicle.

[0037] In step ST13, the processor 111 acquires seat information.

[0038] From the above, by performing the process of step ST13, the processor 111 functions as an example of a seat information acquisition unit that acquires seat information indicating the state of the seat.

[0039] In step ST14, the processor 111 identifies the seat 130 on which the viewer is sitting. For example, the processor 111 identifies the seat 130 on which the viewer is sitting by performing image analysis on the image acquired in step ST12. In addition, when there are a plurality of viewers, the processor 111 identifies on which seat 130 each of the plurality of viewers is sitting.

[0040] Alternatively, the processor 111 may identify on which seat 130 the viewer is sitting by using the sensor provided in the seat 130.

[0041] In step ST15, the processor 111 estimates the line of sight of the viewer by using at least one of the image acquired in step ST12 and the seat information acquired in step ST13. For example, the processor 111 estimates the direction of the line of sight by any one of the following methods (A1) to (A4).

[0042] (A1) The processor 111 estimates the position of the viewer's eyes by performing image analysis on the image acquired in step ST12. When it is difficult to directly estimate the position of the eyes, such as when the viewer's eyes are not shown in the image or the accuracy of the image analysis is low, the processor 111 may estimate the position of the viewer's head and then estimate the position of the eyes from the position of the head. In addition, the processor 111 identifies the angle of the backrest of the seat 130 on which the viewer is sitting by using the seat information acquired in step ST13. For example, the processor 111 sets a vector parallel to the normal direction of the backrest starting from the estimated position of the viewer's eyes as the line-of-sight vector representing the viewer's line of sight.

[0043] (A2) The processor 111 identifies the position of the viewer's eyes by performing image analysis on the image acquired in step ST12, and then identifies the direction in which the eyes are facing by performing image analysis on the image. For example, the processor 111 sets a vector in the identified direction starting from the estimated position of the viewer's eyes as the line-of-sight vector representing the viewer's line of sight.

[0044] (A3) The processor 111 identifies the position of the viewer's eyes by performing image analysis on the image acquired in step ST12. Then, the processor 111 identifies the angle of the backrest of the seat 130 on which the viewer is sitting by performing image analysis on the image acquired in step ST12. For example, the processor 111 uses a vector parallel to the normal direction of the backrest starting from the estimated position of the viewer's eyes as the line-of-sight vector representing the viewer's line of sight.

[0045] (A4) The processor 111 estimates the position of the viewer's eyes using the seat information acquired in step ST13. For example, the processor 111 estimates the position of the eyes using information indicating the height of the viewer's eyes. Information indicating the height of the viewer's eyes is, for example, the seat height, the height from the floor to the eyes in an upright body state, or the height from the seat surface to the eyes in a state of sitting on the chair with the upper body straight. Note that the viewer or the administrator of the control device 110, etc., sets in advance information indicating the height of the viewer's eyes. The auxiliary storage device 114 stores the information indicating the height of the eyes. Alternatively, the processor 111 may estimate the height of the viewer's eyes using information indicating the height of the eyes of a general person. Further, the processor 111 identifies the angle of the backrest of the seat 130 on which the viewer is sitting using the seat information acquired in step ST13. For example, the processor 111 uses a vector parallel to the normal direction of the backrest starting from the estimated position of the viewer's eyes as the line-of-sight vector representing the viewer's line of sight.

[0046] Note that when there are a plurality of viewers, the processor 111 estimates the line of sight for any one of the viewers. Alternatively, the processor 111 estimates the line of sight for all the viewers. Alternatively, the processor 111 may calculate the average line of sight of a plurality of viewers. The processor 111 calculates the average vector of the line-of-sight vectors of a plurality of viewers. The average vector indicates the average of the lines of sight of a plurality of viewers.

[0047] As described above, by performing the process of step ST15, the processor 111 functions as an example of a line-of-sight estimation unit that estimates the line of sight of a person in the vehicle interior of the vehicle 100.

[0048] In step ST16, the processor 111 estimates the viewing point of the viewer using the line of sight estimated in step ST15. For example, the processor 111 sets the position where the line of sight estimated in step ST15 is directed as the viewing point. That is, for example, the processor 111 sets as the viewing point the point where the extension line obtained by extending the line-of-sight vector estimated in step ST15 in the direction of the line-of-sight vector first hits an object. The object and the viewing point are somewhere within the vehicle 100.

[0049] Note that when there are a plurality of viewers, the processor 111 estimates the viewing point for any one of the viewers. Alternatively, the processor 111 estimates the viewing point for all viewers. Alternatively, the processor 111 estimates the viewing point using the average line of sight of a plurality of viewers.

[0050] In step ST17, the processor 111 estimates the position of the projection device 200 by performing image analysis on the image acquired in step ST12. However, it is assumed that the projection device 200 is shown in the image. The processor 111 may estimate the position of the lens provided in the projection device 200 as the position of the projection device 200. Note that the image used for image analysis in step ST15 and the image used for image analysis in step ST16 may be different images or the same image.

[0051] As described above, by performing the process of step ST17, the processor 111 functions as an example of a position estimation unit that estimates the position of a projection device installed in the vehicle and projecting an image into the vehicle interior.

[0052] In step ST18, the processor 111 determines the projection position of the projection device 200. The processor 111 uses the viewpoint estimated in step ST16 as the center of the projection position. When the processor 111 estimates a plurality of viewpoints in step ST16, for example, it uses any one of the viewpoints as the center of the projection position. Alternatively, when the processor 111 estimates a plurality of viewpoints in step ST16, it uses the average position of the plurality of viewpoints as the center of the projection position.

[0053] In step ST19, the processor 111 uses the position estimated in step ST17 and the projection position determined in step ST18 to determine the direction in which the projection device 200 projects light, that is, the direction in which the projection device 200 projects an image (hereinafter referred to as the "projection direction"). The projection direction determined in step ST19 is hereinafter referred to as the "determined direction". For example, the processor 111 sets the direction from the position estimated in step ST17 to the projection position as the determined direction.

[0054] From the above, by performing the process of step ST19, the processor 111 functions as an example of a determination unit that determines the projection direction of the projection device using the line of sight and the position of the projection device.

[0055] In step ST20, the processor 111 instructs the projection device 200 via the communication interface 205 to change the projection direction of the projection device 200 to the determined direction. The processor 201 of the projection device 200 controls the projection device 206 based on the instruction to change the projection direction to the determined direction. When the determined direction is outside the projection range of the projection device 200, the processor 111 may change the projection direction of the projection device 200 to the direction closest to the determined direction within the projection range.

[0056] From the above, by performing the process of step ST20, the processor 111 functions as an example of a change unit that controls the projection device to change the projection direction of the projection device to the projection direction determined by the determination unit.

[0057] In step ST21, the processor 111 determines whether there is an event inappropriate for the projection of an image by the projection device 200. The processor 111 makes this determination, for example, by performing image analysis on an image acquired from the camera 120. Examples of events inappropriate for the projection of an image are shown below as (B1) and (B2). (B1) The determined direction is inappropriate as the projection position of the projection device 200. (B2) The installation position of the projection device 200 is unstable.

[0058] Examples of (B1) are shown below as (B1-1) to (B1-3). (B1-1) The unevenness of the projection range is too severe. The projection range is the range in which the projection device 200 projects light. (B1-2) There is an obstacle between the projection object on which the projection device 200 projects light and the projection device 200. (B1-3) The determined direction is outside the projection range of the projection device 200.

[0059] From the above, the processor 111 functions as an example of a determination unit that determines that there is an event inappropriate for the projection of an image by the projection device by performing the process of step ST21.

[0060] If the processor 111 does not determine that there is an event inappropriate for the projection of an image by the projection device 200, it determines No in step ST21 and returns to step ST11. On the other hand, if the processor 111 determines that there is an event inappropriate for the projection of an image by the projection device 200, it determines Yes in step ST21 and proceeds to step ST22.

[0061] In step ST22, the processor 111 notifies a person in the vehicle 100 of the fact that there is an event inappropriate for the projection of an image by the projection device 200, the content of the event, and the solution to the event. The processor 111 performs this notification, for example, by causing a display device 116 to display an image indicating the notification content. Also, the processor 111 may perform this notification by causing a speaker to output a voice indicating the notification content.

[0062] The solution to the event is, for example, to change the installation position of the projection device 200. The solution to the event may include a proposal for the installation position of the projection device 200 that can solve the event. The processor 111 proposes a predetermined installation position. Alternatively, the processor 111 may determine the installation position by searching for an installation position that can solve the event, for example, using image analysis of an image acquired from the camera 120.

[0063] A person inside the vehicle 100 can change the position of the projection device 200 upon seeing this notification.

[0064] As described above, when it is determined by the determination unit that there is an inappropriate event, the processor 111 functions as an example of a proposal unit that proposes the installation position of the projection device 200 by performing the process of step ST22.

[0065] In step ST23, the processor 111 determines whether the installation position of the projection device 200 has been changed. The processor 111 determines whether the installation position of the projection device 200 has been changed, for example, using image analysis of an image acquired from the camera 120. If the installation position of the projection device 200 has not been changed within a predetermined time, for example, the processor 111 deems it timed out and determines that the installation position of the projection device 200 has not been changed. If an operation indicating that the installation position of the projection device 200 is not to be changed is performed on the input device 117, for example, the processor 111 determines that the installation position of the projection device 200 has not been changed. If the processor 111 determines that the installation position of the projection device 200 has been changed, it determines Yes in step ST23 and returns to step ST12. On the contrary, if the processor 111 determines that the installation position of the projection device 200 has not been changed, it determines No in step ST23 and returns to step ST11.

[0066] The control device 100 of the embodiment estimates the line of sight of a viewer in the vehicle interior of the vehicle 100. Further, the control device 100 of the embodiment estimates the position of the projection device 200. Then, the control device 100 of the embodiment determines the projection direction of the projection device 200 using the estimated line of sight and the estimated position of the projection device 200. In this way, since the control device 100 of the embodiment can estimate the position of the projection device 200, it is possible to determine a projection direction and a projection position that are easy for the viewer to see even when the position of the projection device 200 is indefinite.

[0067] Further, the control device 100 of the embodiment changes the projection direction of the projection device 200 to the determined projection direction. As a result, viewers and the like do not need to manually change the projection direction of the projection device 200.

[0068] Further, the control device 100 of the embodiment estimates the line of sight of the viewer using the state of the seat 130. Thereby, the accuracy of the control device 100 of the embodiment in estimating the line of sight of the viewer is improved.

[0069] Further, the control device 100 of the embodiment estimates the line of sight of the viewer using an image captured of the interior of the vehicle 100. By using an image, the control device 100 of the embodiment can estimate the line of sight of the viewer at a lower cost than using various sensors.

[0070] Further, the control device 100 of the embodiment estimates the position of the projection device 200 using an image captured of the interior of the vehicle 100. By using an image, the control device 100 of the embodiment can estimate the position of the projection device 200 at a lower cost than using various sensors.

[0071] Further, when there is an event inappropriate for the projection of an image by the projection device 200, the control device 100 of the embodiment proposes an installation position of the projection device 200. Thereby, the control device 100 of the embodiment can reinstall the projection device 200 at a more suitable position.

[0072] In addition, the control device 100 of the embodiment estimates the lines of sight of a plurality of viewers. Then, the control device 100 of the embodiment determines the projection direction of the projection device 200 using the estimated lines of sight of the plurality of viewers. Thereby, the control device 100 of the embodiment can determine a projection direction and a projection position that are easy for the viewers to see even when there are a plurality of viewers.

[0073] The above embodiment can be modified as follows. The change of the projection direction of the projection device 200 may be manual. In this case, the processor 111 of the control device 100 notifies the person in the vehicle 100 of the determined direction. The person can change the projection direction of the projection device 200 to the determined direction according to the notification.

[0074] The processor 111 of the control device 100 may estimate the position of the projection device 200 using a method other than image analysis. For example, the processor 111 estimates the position of the projection device 200 using the sensing results of various sensors such as an infrared sensor, a radar, and a LIDAR (light detection and ranging). For example, the processor 111 estimates the position of the projection device 200 using the communication intensity of the communication by the projection device 200.

[0075] The processor 111 of the control device 100 may estimate the line of sight of the viewer using the sensing results of various sensors such as an infrared sensor, a radar, and a LIDAR.

[0076] The processor 111 of the control device 100 may specify the angle of the backrest of the seat 130 using the sensing results of various sensors such as an infrared sensor, a radar, and a LIDAR.

[0077] The projection device 200 may have a moving function. In this case, instead of or in addition to notifying in step ST22, the processor 111 of the control device 100 may move the projection device 200. The destination of the movement of the projection device 200 is an installation position of the projection device 200 that can solve an event inappropriate for image projection by the projection device 200. The processor 111 instructs the projection device 200 via the communication interface 205 to move to the installation position. The processor 201 of the projection device 200 moves the projection device 200 to the installation position based on the instruction.

[0078] Each device of the embodiment may be composed of a plurality of devices.

[0079] The processor 111 and the processor 201 may realize part or all of the processing realized by the program in the above embodiment by the hardware configuration of the circuit.

[0080] The program for realizing the processing of the embodiment is transferred, for example, in a state stored in a non-temporary computer-readable storage medium in the device. However, the device may be transferred without the program being stored. And the program may be transferred separately and written into the device. The transfer of the program at this time can be realized, for example, by recording on a removable non-temporary computer-readable storage medium or by downloading via a network such as the Internet or a LAN (local area network).

[0081] The embodiments of the present invention have been described above, but are shown as examples and do not limit the scope of the present invention. The embodiments of the present invention can be implemented in various modes without departing from the gist of the present invention.

Explanation of Reference Numerals

[0082] 1 Projection system 100 Vehicle 110 Control device 111,201 Processor 112,202 ROM 113,203 RAM 114,204 Auxiliary storage device 115,205 Communication interface 116 Display device 117 Input device 118,207 Bus 120 Camera 130 Seat 200 Projection device 206 Projection device

Claims

1. A line-of-sight estimation unit that estimates the line of sight of a person in the vehicle interior of a vehicle, A position estimation unit that estimates the position of a projection device installed in the vehicle and that projects an image into the vehicle interior, A projection management device comprising a determination unit that determines the projection direction of the projection device using the line of sight and the position.

2. The projection management device according to claim 1, further comprising a changing unit that controls the projection device to change the projection direction of the projection device to the projection direction determined by the determination unit.

3. The projection management device according to claim 1, further comprising a seat information acquisition unit that acquires seat information indicating the state of a seat, wherein the line-of-sight estimation unit estimates the line of sight using the seat information.

4. The projection management device according to claim 1, further comprising an image acquisition unit that acquires an image of the vehicle interior, wherein the line-of-sight estimation unit estimates the line of sight using the image acquired by the image acquisition unit.

5. The projection management device according to claim 1, further comprising an image acquisition unit that acquires an image of the vehicle interior, wherein the position estimation unit estimates the position using the image acquired by the image acquisition unit.

6. A determination unit that determines that there is an event inappropriate for projection of an image by the projection device, The projection management device according to claim 1, further comprising a proposal unit that proposes an installation position of the projection device when the determination unit determines that there is the inappropriate event.

7. The line-of-sight estimation unit estimates the lines of sight of a plurality of the people in the vehicle interior, wherein the determination unit determines the projection direction using the lines of sight of a plurality of the people in the vehicle interior.

8. A program that causes a processor included in a projection management device to function as a line-of-sight estimation unit that estimates the line of sight of a person in the vehicle interior of a vehicle, a position estimation unit that estimates the position of a projection device installed in the vehicle and that projects an image into the vehicle interior, and a determination unit that determines the projection direction of the projection device using the line of sight and the position.

Images