Projection management device and program

Abstract

To provide a projection management apparatus and a program that can define the projection position easily visible to a viewer even if the position of the projector apparatus is indefinite.SOLUTION: The projection management apparatus includes a line-of-sight estimator, a position estimator, and a definer. The line-of-sight estimator estimates the line of sight of a person in a cabin of a vehicle. The position estimator estimates the position of the projector apparatus that is installed in the vehicle and projects an image in the cabin. The definer defines the projection direction of the projector apparatus using the line of sight and the position.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a projection management device and a program. [Background technology]

[0002] There is a technique for controlling the projection position of a projection device installed in a vehicle in accordance with the state of seats in the vehicle. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2020-83204 Summary of the Invention [Problem to be solved by the invention]

[0004] In this technique, the position of the projection device is fixed. Therefore, this technique cannot be used when the position of the projection device is indefinite, such as when a projection device is installed later.

[0005] An object of the present invention is to provide a projection management device and a program that can determine a projection position that is easy for viewers to see even when the position of the projection device is uncertain. [Means for solving the problem]

[0006] The projection management device of the embodiment includes a line of sight estimation unit, a position estimation unit, and a determination unit. The line of sight estimation unit estimates the line of sight of a person in a vehicle cabin. The position estimation unit estimates the position of a projection device installed in the vehicle that projects an image into the vehicle cabin. The determination unit determines the projection direction of the projection device using the line of sight and the position. [Effects of the Invention]

[0007] The present invention can determine a projection position that is easy for the viewer to see even when the position of the projection device is uncertain. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a projection system according to an embodiment and essential components included in the projection system. [Figure 2] 2 is a flowchart showing an example of processing by a processor of the control device in FIG. 1; DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, a projection system according to an embodiment will be described with reference to the drawings. Note that the scale of each part in each drawing used in the following description of the embodiment may be changed as appropriate. Also, for the sake of explanation, each drawing used in the following description of the embodiment may omit configurations. Also, in each drawing and in this specification, the same reference numerals indicate similar elements. FIG. 1 is a block diagram showing an example of the configuration of a projection system 1 according to an embodiment and the main components included in the projection system 1. Note that each component of the device may be built-in or external. The projection system 1 is a system that projects an image into the interior of a vehicle 100. The projection system 1 is a system that determines the projection position of the projected image using the line of sight of a person inside the vehicle 100. The projection system 1 includes, as an example, the vehicle 100 and a projection device 200. Note that the projection system 1 may include some of these.

[0010] The vehicle 100 is, for example, an automobile. The type of automobile is not important. The vehicle 100 includes, for example, a control device 110, a camera 120, and a seat 130. However, the control device 110 does not have to be included in the vehicle 100.

[0011] The control device 110 is a device capable of controlling the projection device 200. The control device 110 is, for example, an on-board device of the vehicle 100. The on-board device is, for example, an ECU (electronic control unit), a car navigation system, or an ETC (electronic toll collection) on-board device. The control device 110 may also be a smartphone, a tablet terminal, or a PC (personal computer). Alternatively, the projection device 200 may include the control device 110. For example, the control device 110 includes a processor 111, a ROM (read-only memory) 112, a RAM (random-access memory) 113, an auxiliary storage device 114, a communication interface 115, a display device 116, and an input device 117. A bus 118 or the like connects these components. The control device 110 may also include a camera 120. The control device 110 is an example of a projection management device.

[0012] The processor 111 is the central part of a computer that performs various calculations and processes, such as calculations and controls, necessary for the operation of the control device 110. The processor 111 is, for example, a central processing unit (CPU), a microprocessing unit (MPU), a system on a chip (SoC), a digital signal processor (DSP), a graphics processing unit (GPU), an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a field-programmable gate array (FPGA). Alternatively, the processor 111 may be a combination of several of these. The processor 111 may also be a combination of these with a hardware accelerator or the like. The processor 111 controls each component to realize various functions of the control device 110 based on programs such as firmware, system software, and application software stored in the ROM 112 or the auxiliary storage device 114. The processor 111 also executes the processes described below based on the programs. Note that some or all of the programs may be incorporated into the circuitry of the processor 111.

[0013] The ROM 112 and RAM 113 are main storage devices of the computer centered around the processor 111. The ROM 112 is a non-volatile memory used exclusively for reading data. The ROM 112 stores, for example, firmware among the above programs. The ROM 112 also stores data used by the processor 111 when it performs various processes.

[0014] The RAM 113 is a memory used for reading and writing data. The RAM 113 is used as a work area for storing data that is temporarily used when the processor 111 performs various processes. The RAM 113 is typically a volatile memory.

[0015] The auxiliary storage device 114 is an auxiliary storage device of a computer centered around the processor 111. The auxiliary storage device 114 is, for example, an EEPROM (electric erasable programmable read-only memory), an HDD (hard disk drive), or a flash memory. The auxiliary storage device 114 stores, for example, system software and application software among the above programs. The auxiliary storage device 114 also stores data used by the processor 111 when performing various processes, data generated by the processes in the processor 111, various setting values, and the like.

[0016] The communication interface 115 is an interface for the control device 110 to communicate with other devices. This communication may be wireless communication or wired communication. This wireless communication may be a mixture of wireless communication and wired communication.

[0017] The display device 116 displays a screen for notifying various pieces of information to the operator of the vehicle 100 or the control device 110. The display device 116 is, for example, a display such as a liquid crystal display or an organic EL (electro-luminescence) display.

[0018] The input device 117 accepts operations by an operator of the vehicle 100 or the control device 110. The input device 117 is, for example, a keyboard, a keypad, a touchpad, or a controller. The input device 117 may also be a device for voice input. A touch panel may also be used as the display device 116 and the input device 117. In this case, the display panel included in the touch panel functions as the display device 116. And, a pointing device included in the touch panel that is capable of receiving touch input functions as the input device 117.

[0019] The bus 118 includes a control bus, an address bus, a data bus, etc., and transmits signals exchanged among the various parts of the control device 110 .

[0020] The camera 120 is installed inside the vehicle 100. A plurality of cameras 120 may be installed in the vehicle 100. The camera 120 captures images of the interior of the vehicle 100. The camera 120 also outputs captured image data. Note that a moving image is a type of image.

[0021] The seats 130 are chairs in which passengers in the vehicle 100 sit. For example, the vehicle 100 is provided with a driver's seat 130, a passenger seat 130, and rear seats 130. The seats 130 may be transformable. The transformation of the seats 130 may include, for example, reclining, sliding forward and backward, and changing the seat height. The seats 130 may also be provided with a sensor that detects that a person is sitting in the seats 130.

[0022] The control device 110 can acquire seat information. The seat information is information indicating the deformation state of the seat 130. The deformation state includes, for example, the reclining angle of the seat 130, the fore-aft position of the seat 130, and the height of the seat surface of the seat 130. The control device 110 acquires the seat information, for example, from a device that controls the seat 130. The device that controls the seat 130 can detect the deformation state of the seat 130. The device that controls the seat 130 may be able to control the seat 130 to deform the seat 130. The device that controls the seat 130 is, for example, an in-vehicle device of the vehicle 100. Alternatively, the seat 130 may be equipped with a device that controls the seat 130. Furthermore, the control device 110 may be the device that controls the seat 130. In this case, the processor 111 of the control device 110 acquires the seat information by, for example, detecting the deformation state of the seat.

[0023] Alternatively, the processor 111 of the control device 110 may acquire the seat information by detecting the deformation state of the seat in other ways. For example, the processor 111 detects the deformation state of the seat 130 by performing image analysis on an image captured by the camera 120. The image shows the seat 130.

[0024] The projection device 200 is also called a projector. The projection device 200 is a device that projects an image onto a projection target by projecting light. In the embodiment, the projection target is somewhere inside the cabin of the vehicle 100. Examples of the projection destination of the image include the ceiling, walls, doors, and floor inside the cabin of the vehicle 100, the back of the backrest of the seat 130, the window glass, and the dashboard. The projection device 200 is used, for example, by placing it inside the vehicle 100. The projection device 200 is installed, for example, inside the vehicle 100. The projection device 200 may be pre-installed in the vehicle 100. As an example, the projection device 200 is installed between the rear seats.

[0025] The projection device 200 includes, for example, a processor 201, a ROM 202, a RAM 203, an auxiliary storage device 204, a communication interface 205, and a projection device 206. A bus 207 or the like connects these components together.

[0026] The processor 201 is the central part of a computer that performs various calculations and processes, such as calculations and controls, necessary for the operation of the projection device 200. The processor 201 is, for example, a CPU, MPU, SoC, DSP, GPU, ASIC, PLD, or FPGA. Alternatively, the processor 201 may be a combination of several of these. The processor 201 may also be a combination of these with a hardware accelerator or the like. The processor 201 controls each component to realize various functions of the projection device 200 based on programs such as firmware, system software, and application software stored in the ROM 202 or the auxiliary storage device 204. The processor 201 also executes the processes described below based on the programs. Note that some or all of the programs may be incorporated into the circuitry of the processor 201.

[0027] The ROM 202 and RAM 203 are main storage devices of the computer centered around the processor 201. The ROM 202 is a non-volatile memory used exclusively for reading data. The ROM 202 stores, for example, firmware among the above programs. The ROM 202 also stores data used by the processor 201 when it performs various processes.

[0028] The RAM 203 is a memory used for reading and writing data. The RAM 203 is used as a work area for storing data that is temporarily used when the processor 201 performs various processes. The RAM 203 is typically a volatile memory.

[0029] The auxiliary storage device 204 is an auxiliary storage device of a computer centered around the processor 201. The auxiliary storage device 204 is, for example, an EEPROM, a HDD, or a flash memory. The auxiliary storage device 204 stores, for example, system software and application software among the above programs. The auxiliary storage device 204 also stores data used by the processor 201 when performing various processes, data generated by the processes in the processor 201, various setting values, and the like.

[0030] The communication interface 205 is an interface for the projection device 200 to communicate with other devices. This communication may be wireless communication or wired communication. This communication may be a mixture of wireless communication and wired communication.

[0031] The projection device 206 is a display device that projects an image onto a projection target by projecting light. The projection device 206 includes, for example, a light source and a lens. The light source emits light. The lens projects the light onto the projection target.

[0032] The bus 207 includes a control bus, an address bus, a data bus, etc., and transmits signals exchanged among the various components of the projection device 200 .

[0033] The operation of the projection system 1 according to the embodiment will be described below with reference to Fig. 2 and other figures. Note that the processing content in the following description of the operation is an example, and various processing that can obtain similar results can be used as appropriate. Fig. 2 is a flowchart showing an example of processing by the processor 111 of the control device 110. The processor 111 executes the processing of Fig. 2 based on a program stored in, for example, the ROM 112 or the auxiliary storage device 114.

[0034] In step ST11 of FIG. 2, the processor 111 of the control device 110 determines whether to execute the change process. The change process is a process for changing the projection position of the image by the projection device 200 to an optimal position based on the viewer's line of sight. Note that it does not matter whether the projection device 200 is projecting light at the time the change process is executed. It also does not matter whether the projection device 200 is projecting an image at the time the change process is executed. Here, the viewer refers to a person aboard the vehicle 100 who views the image. The processor 111 determines to execute the change process when, for example, an operation input instructing to execute the change process is made to the input device 117. If the processor 111 does not determine to execute the change process, it determines No in step ST11 and repeats the process of step ST11. On the other hand, if the processor 111 determines to execute the change process, it determines Yes in step ST11 and proceeds to step ST12.

[0035] In step ST12, the processor 111 acquires an image of the interior of the vehicle 100 from the camera 120. The processor 111 may acquire a plurality of such images.

[0036] As described above, processor 111 performs the process of step ST12, thereby functioning as an example of an image acquisition unit that acquires an image of the interior of the vehicle.

[0037] In step ST13, processor 111 acquires seat information.

[0038] As described above, processor 111 performs the process of step ST13, thereby functioning as an example of a seat information acquisition unit that acquires seat information indicating the state of a seat.

[0039] In step ST14, processor 111 identifies seats 130 in which the viewers are sitting. Processor 111 identifies seats 130 in which the viewers are sitting, for example, by performing image analysis on the image acquired in step ST12. Note that, if there are multiple viewers, processor 111 identifies in which seats 130 each of the multiple viewers is sitting.

[0040] Alternatively, the processor 111 may use a sensor provided in the seat 130 to identify in which seat 130 the viewer is sitting.

[0041] In step ST15, processor 111 estimates the viewer's line of sight using at least one of the image acquired in step ST12 and the seat information acquired in step ST13. Processor 111 estimates the line of sight direction by, for example, one of the following methods (A1) to (A4).

[0042] (A1) Processor 111 estimates the viewer's eye position by analyzing the image acquired in step ST12. When it is difficult to directly estimate the eye position, such as when the viewer's eyes are not visible or when the accuracy of the image analysis is low, processor 111 may estimate the viewer's head position. Processor 111 then estimates the eye position from the head position. Processor 111 also identifies the angle of the backrest of seat 130 in which the viewer is sitting, using the seat information acquired in step ST13. Processor 111 determines, for example, a line-of-sight vector representing the viewer's line of sight, which is a vector parallel to the normal direction of the backrest and has the estimated viewer's eye position as its starting point.

[0043] (A2) Processor 111 identifies the position of the viewer's eyes by performing image analysis on the image acquired in step ST12. Processor 111 then identifies the direction in which the eyes are facing by performing image analysis on the image. Processor 111, for example, determines a vector that starts from the estimated position of the viewer's eyes and points in that direction as a line-of-sight vector representing the viewer's line of sight.

[0044] (A3) Processor 111 identifies the position of the viewer's eyes by performing image analysis on the image acquired in step ST12. Processor 111 then identifies the angle of the backrest of seat 130 in which the viewer is sitting by performing image analysis on the image acquired in step ST12. Processor 111 determines, for example, a vector that has the estimated viewer's eye position as its starting point and is parallel to the normal direction of the seat backrest as a line-of-sight vector that represents the viewer's line of sight.

[0045] (A4) Processor 111 estimates the viewer's eye position using the seat information acquired in step ST13. Processor 111 estimates the eye position using, for example, information indicating the viewer's eye height. Information indicating the viewer's eye height can be, for example, seat height, the height from the floor to the eyes when the viewer is standing upright, or the height from the seat to the eyes when the viewer is sitting in a chair with the upper body straight. Note that the viewer or an administrator of control device 110 sets information indicating the viewer's eye height in advance. Auxiliary storage device 114 stores the information indicating the eye height. Alternatively, processor 111 may estimate the viewer's eye height using information indicating the eye height of an average person. Processor 111 also identifies the angle of the backrest of seat 130 in which the viewer is sitting using the seat information acquired in step ST13. Processor 111 determines, for example, a line-of-sight vector representing the viewer's line of sight, which is a vector parallel to the normal direction of the backrest, with the estimated viewer's eye position as its starting point.

[0046] When there are multiple viewers, processor 111 estimates the gaze of any one of the viewers. Alternatively, processor 111 estimates the gaze of all viewers. Alternatively, processor 111 may calculate the average gaze of the multiple viewers. Processor 111 calculates the average vector of the gaze vectors of the multiple viewers. The average vector indicates the average of the gazes of the multiple viewers.

[0047] As described above, processor 111 functions as an example of a gaze estimation unit that estimates the gaze of a person inside vehicle 100 by performing the process of step ST15.

[0048] In step ST16, processor 111 estimates the viewer's viewpoint using the line of sight estimated in step ST15. Processor 111 determines, for example, the position to which the line of sight estimated in step ST15 is directed as the viewpoint. That is, processor 111 determines, for example, the point at which an extension of the line of sight vector estimated in step ST15 in the direction of the line of sight vector first collides with an object as the viewpoint. The object and the viewpoint are somewhere within vehicle 100.

[0049] When there are multiple viewers, the processor 111 estimates the viewpoint for one of the viewers, or for all viewers, or by using the average line of sight of the multiple viewers.

[0050] In step ST17, the processor 111 estimates the position of the projection device 200 by performing image analysis on the image acquired in step ST12. However, it is assumed that the projection device 200 is shown in the image. The processor 111 may estimate the position of the lens provided in the projection device 200 as the position of the projection device 200. Note that the image used for image analysis in step ST15 and the image used for image analysis in step ST16 may be different images or may be the same image.

[0051] As described above, by performing the process of step ST17, processor 111 functions as an example of a position estimation unit that estimates the position of a projection device that is installed in a vehicle and projects an image into the vehicle interior.

[0052] In step ST18, processor 111 determines the projection position of projection device 200. Processor 111 sets the viewpoint estimated in step ST16 as the center of the projection position. If multiple viewpoints are estimated in step ST16, processor 111 sets, for example, the viewpoint of one of the viewpoints as the center of the projection position. Alternatively, if multiple viewpoints are estimated in step ST16, processor 111 sets the average position of the multiple viewpoints as the center of the projection position.

[0053] In step ST19, processor 111 determines the direction in which projection device 200 projects light, i.e., the direction in which projection device 200 projects an image (hereinafter referred to as the "projection direction"), using the position estimated in step ST17 and the projection position determined in step ST18. The projection direction determined in step ST19 is hereinafter referred to as the "determined direction." Processor 111 determines, for example, the direction from the position estimated in step ST17 toward the projection position as the determined direction.

[0054] As described above, by performing the process of step ST19, processor 111 functions as an example of a determination unit that determines the projection direction of the projection device using the line of sight and the position of the projection device.

[0055] In step ST20, the processor 111 instructs the projection device 200 via the communication interface 205 to change the projection direction of the projection device 200 to the determined direction. Based on the instruction, the processor 201 of the projection device 200 controls the projection device 206 to change the projection direction to the determined direction. Note that if the determined direction is outside the projection range of the projection device 200, the processor 111 may change the projection direction of the projection device 200 to a direction that is closest to the determined direction within the projection range.

[0056] As described above, by performing the process of step ST20, processor 111 functions as an example of a change unit that controls the projection device and changes the projection direction of the projection device to the projection direction determined by the determination unit.

[0057] In step ST21, processor 111 determines whether or not there is an event that makes it unsuitable for projection of an image by projection device 200. Processor 111 makes this determination, for example, by performing image analysis on an image acquired from camera 120. Examples of events that make it unsuitable for projection of an image are shown below as (B1) and (B2). (B1) The determined direction is inappropriate as the projection position of the projection device 200. (B2) The installation position of the projection device 200 is unstable.

[0058] As examples of (B1), (B1-1) to (B1-3) are shown below. (B1-1) The projection range has unevenness greater than a predetermined value. The projection range is the range onto which the projection device 200 projects light. (B1-2) There is an obstacle between the projection device 200 and the hidden projection object onto which the projection device 200 projects light. (B1-3) The determined direction is outside the range in which the projection device 200 can project.

[0059] As described above, by performing the process of step ST21, processor 111 functions as an example of a determination unit that determines that an event that is inappropriate for the projection of an image by the projection device has occurred.

[0060] If processor 111 does not determine that an event that is unsuitable for projection of an image by projection device 200 exists, it determines No in step ST21 and returns to step ST11. On the other hand, if processor 111 determines that an event that is unsuitable for projection of an image by projection device 200 exists, it determines Yes in step ST21 and proceeds to step ST22.

[0061] In step ST22, the processor 111 notifies people inside the vehicle 100 that an event has occurred that makes it unsuitable for the projection of an image by the projection device 200, the details of the event, and how to resolve the event. The processor 111 makes the notification by, for example, displaying an image indicating the notification content on the display device 116. Alternatively, the processor 111 may make the notification by outputting a sound indicating the notification content from the speaker.

[0062] A method for solving the event is, for example, changing the installation position of the projection device 200. The method for solving the event may include proposing an installation position of the projection device 200 that can solve the event. The processor 111 proposes a predetermined installation position. Alternatively, the processor 111 may determine the installation position by searching for an installation position that can solve the event using, for example, image analysis of an image acquired from the camera 120.

[0063] A person inside the vehicle 100 can see this notification and change the position of the projection device 200.

[0064] As described above, by performing the process of step ST22, processor 111 functions as an example of a suggestion section that suggests an installation position for projection device 200 when the determination section determines that an inappropriate event has occurred.

[0065] In step ST23, the processor 111 determines whether the installation position of the projection device 200 has been changed. The processor 111 determines that the installation position of the projection device 200 has been changed, for example, by using image analysis of an image acquired from the camera 120. For example, if the installation position of the projection device 200 has not been changed within a predetermined time, the processor 111 considers this to be a timeout and determines that the installation position of the projection device 200 has not been changed. For example, if an operation indicating that the installation position of the projection device 200 will not be changed is performed on the input device 117, the processor 111 determines that the installation position of the projection device 200 has not been changed. If the processor 111 determines that the installation position of the projection device 200 has been changed, the processor 111 determines Yes in step ST23 and returns to step ST12. On the other hand, if the processor 111 determines that the installation position of the projection device 200 has not been changed, the processor 111 determines No in step ST23 and returns to step ST11.

[0066] The control device 100 of the embodiment estimates the line of sight of a viewer inside the vehicle 100. The control device 100 of the embodiment also estimates the position of the projection device 200. The control device 100 of the embodiment then determines the projection direction of the projection device 200 using the estimated line of sight and the estimated position of the projection device 200. In this way, the control device 100 of the embodiment can estimate the position of the projection device 200, and therefore can determine a projection direction and projection position that are easy for the viewer to view even when the position of the projection device 200 is uncertain.

[0067] Furthermore, the control device 100 of the embodiment changes the projection direction of the projection device 200 to the determined projection direction, thereby eliminating the need for viewers or the like to manually change the projection direction of the projection device 200.

[0068] Furthermore, the control device 100 of the embodiment estimates the viewer's line of sight using the state of the seat 130. This improves the accuracy with which the control device 100 of the embodiment estimates the viewer's line of sight.

[0069] Furthermore, the control device 100 of the embodiment estimates the viewer's gaze using an image captured inside the vehicle cabin 100. By using an image, the control device 100 of the embodiment can estimate the viewer's gaze at a lower cost than when using various sensors.

[0070] Furthermore, the control device 100 of the embodiment estimates the position of the projection device 200 using an image captured of the interior of the vehicle 100. By using the image, the control device 100 of the embodiment can estimate the position of the projection device 200 at a lower cost than when using various sensors.

[0071] Furthermore, if an event occurs that makes the projection of an image by the projection device 200 unsuitable, the control device 100 of the embodiment suggests an installation position for the projection device 200. This allows the control device 100 of the embodiment to re-install the projection device 200 in a more suitable position.

[0072] Furthermore, the control device 100 of the embodiment estimates the lines of sight of multiple viewers. Then, the control device 100 of the embodiment determines the projection direction of the projection device 200 using the estimated lines of sight of the multiple viewers. As a result, the control device 100 of the embodiment can determine the projection direction and projection position that are easy for the viewers to view, even when there are multiple viewers.

[0073] The above embodiment can be modified as follows. The projection direction of the projection device 200 may be changed manually. In this case, the processor 111 of the control device 100 notifies a person in the vehicle 100 of the determined direction. The person can change the projection direction of the projection device 200 to the determined direction in accordance with the notification.

[0074] The processor 111 of the control device 100 may estimate the position of the projection device 200 using a method other than image analysis. For example, the processor 111 estimates the position of the projection device 200 using sensing results from various sensors such as an infrared sensor, radar, and LIDAR (light detection and ranging). For example, the processor 111 estimates the position of the projection device 200 using the communication strength of communication by the projection device 200.

[0075] The processor 111 of the control device 100 may estimate the viewer's line of sight using the sensing results of various sensors such as an infrared sensor, radar, and LIDAR.

[0076] The processor 111 of the control device 100 may determine the angle of the backrest of the seat 130 using sensing results from various sensors such as an infrared sensor, radar, and LIDAR.

[0077] The projection device 200 may have a movement function. In this case, the processor 111 of the control device 100 may move the projection device 200 in step ST22, instead of or in addition to issuing a notification. The destination of the projection device 200 is an installation position of the projection device 200 that can resolve the event that makes the projection device 200 unsuitable for projecting an image. The processor 111 instructs the projection device 200 to move to the installation position via the communication interface 205. The processor 201 of the projection device 200 moves the projection device 200 to the installation position based on the instruction.

[0078] Each device in the embodiment may be made up of multiple devices.

[0079] The processor 111 and the processor 201 may implement part or all of the processing that is implemented by a program in the above-described embodiments by a hardware circuit configuration.

[0080] A program for implementing the processes of the embodiments may be transferred in a state where it is stored in a non-transitory computer-readable storage medium within the device. However, the device may also be transferred without the program stored therein. The program may then be transferred separately and written to the device. In this case, the program may be transferred by, for example, recording it on a removable non-transitory computer-readable storage medium or by downloading it via a network such as the Internet or a local area network (LAN).

[0081] Although the embodiments of the present invention have been described above, they are merely examples and are not intended to limit the scope of the present invention. The embodiments of the present invention can be implemented in various forms without departing from the spirit of the present invention. [Explanation of symbols]

[0082] 1. Projection System 100 vehicles 110 Control device 111,201 processors 112,202 ROM 113,203 RAM 114,204 Auxiliary storage device 115,205 Communication Interface 116 Display Devices 117 Input Devices 118,207 buses 120 Camera 130 seats 200 Projection device 206 Projection Device

Claims

1. A seat information acquisition unit that acquires seat information indicating the status of a seat; a gaze estimation unit that estimates the gaze of a person in a vehicle cabin by estimating the eye position from the head position, specifying the angle of the backrest of the seat from the seat information, and estimating the gaze by defining a gaze vector that indicates the gaze and is parallel to a normal direction of the backrest with the estimated eye position as a starting point; a position estimation unit that estimates a position of a projection device that is installed in the vehicle and projects an image into the vehicle interior; a determination unit that determines a projection direction of the projection device using the line of sight and the position.

2. The projection management device according to claim 1 , further comprising a change unit that controls the projection device to change the projection direction of the projection device to the projection direction determined by the determination unit.

3. An image acquisition unit that acquires an image of the interior of the vehicle, The projection management device according to claim 1 , wherein the line-of-sight estimation unit estimates the line of sight using the image acquired by the image acquisition unit.

4. An image acquisition unit that acquires an image of the interior of the vehicle, The projection management device according to claim 1 , wherein the position estimation unit estimates the position of the head using the image acquired by the image acquisition unit.

5. a determination unit that determines whether an event that is inappropriate for the projection of an image by the projection device exists; The projection management device according to claim 1 , further comprising: a suggestion unit that suggests an installation location for the projection device when the determination unit determines that the inappropriate event has occurred.

6. the line-of-sight estimation unit estimates the line of sight of the plurality of people in the vehicle cabin; The projection management device according to claim 1 , wherein the determination unit determines the projection direction using the lines of sight of the plurality of people in the vehicle cabin.

7. The processor included in the projection management device is a gaze estimation unit that estimates the gaze of a person in a vehicle cabin by estimating the eye position from the head position, specifying the angle of the backrest of the seat from seat information, and estimating the gaze by using a gaze vector that indicates the gaze and is parallel to a normal direction of the backrest and has the estimated eye position as a starting point; a position estimation unit that estimates a position of a projection device that is installed in the vehicle and projects an image into the vehicle interior; a program that functions as a determination unit that determines a projection direction of the projection device using the line of sight and the position;

Images