Control device and program

Abstract

To provide a control device and a program which can hardly cause motion sickness.SOLUTION: A control device includes an estimation section, an acquisition section and a determination section. The estimation section estimates the position of a face of a person in a cabin of a vehicle. The acquisition section acquires a position of an image displayed by a display device which is installed on the vehicle and displays an image. The determination section determines a display size of the image according to a distance between the position of the face and the position of the image. The determination section may decrease the display size as the above-described distance is short.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a control device and a program.

Background Art

[0002] There is a need for a person riding in a vehicle to watch videos during breaks or the like. For this purpose, a vehicle may be equipped with a liquid crystal display. However, the space inside the vehicle has limited locations for installing a liquid crystal display or the like. Therefore, it is desirable to use a projector to display a large screen inside the vehicle.

[0003] For example, Patent Document 1 discloses a technique in which a mobile projection device controls the height position of the place where an image is projected according to the number of viewers detected from the captured image of a camera. Note that the projection device of Patent Document 1 is not a projector for vehicles.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] When a projector is used for viewing inside a vehicle, the distance from the viewer's face to the screen is short, and depending on the projection size of the screen, motion sickness may occur. In the technique described in Patent Document 1, even if the height of the screen is changed according to the number of people, it is not possible to prevent motion sickness due to the projection size of the screen.

[0006] The problem to be solved by the embodiments of the present invention is to provide a control device and a program that can make it difficult to cause motion sickness.

Means for Solving the Problems

[0007] The control device of the embodiment includes an estimation unit, an acquisition unit, and a determination unit. The estimation unit estimates the position of a person's face in the vehicle cabin of the vehicle. The acquisition unit acquires the position of an image displayed by a display device installed in the vehicle and displaying an image. The determination unit determines the display size of the image according to the distance between the position of the face and the position of the image.

Advantages of the Invention

[0008] The present invention can make it difficult to cause video-induced motion sickness.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Modes for Carrying Out the Invention

[0010] Hereinafter, the projection system according to the embodiment will be described with reference to the drawings. Note that the scales of the respective parts in the following drawings may be appropriately changed. In addition, the respective drawings used in the following description of the embodiment may show the configuration with omissions for the sake of explanation. Also, in each drawing and this specification, the same reference numerals denote the same elements. FIG. 1 is a block diagram showing an example of the main configuration of the projection system 1 according to the embodiment and the main components included in the projection system 1. Note that each component of the device may be built-in or externally attached. The projection system 1 is a system that projects an image in the vehicle cabin of the vehicle 100. The projection system 1 is a system that determines the projection size of the projected image using the position of a person's face in the vehicle cabin of the vehicle 100. The projection system 1 includes the vehicle 100 as an example.

[0011] Vehicle 100 is, for example, an automobile. The type of the automobile is not limited. Vehicle 100 includes, as an example, a control device 110, a sensor 120, a projection device 130, and vehicle equipment 140. However, the control device 110 may not be included in Vehicle 100. Also, the projection device 130 may not be included in Vehicle 100.

[0012] The control device 110 is a device capable of controlling the projection device 130. The control device 110 is, for example, an in-vehicle device of Vehicle 100. The in-vehicle device is, for example, an ECU (electronic control unit), a car navigation system, or an ETC (electronic toll collection) in-vehicle unit, etc. Also, the control device 110 may be a smartphone, a tablet terminal, or a PC (personal computer), etc. Alternatively, the projection device 130 may include the control device 110. The control device 110 includes, as an example, a processor 111, a ROM (read-only memory) 112, a RAM (random-access memory) 113, an auxiliary storage device 114, a communication interface 115, a display device 116, and an input device 117. And a bus 118, etc., connects these components. The control device 110 may include the sensor 120. Note that the control device 110 is an example of a projection management device.

[0013] Processor 111 is the central part of a computer that performs processes such as calculations and controls necessary for the operation of control device 110, and performs various calculations and processes. Processor 111 is, for example, a CPU (central processing unit), MPU (micro processing unit), SoC (system on a chip), DSP (digital signal processor), GPU (graphics processing unit), ASIC (application specific integrated circuit), PLD (programmable logic device), or FPGA (field-programmable gate array), etc. Alternatively, processor 111 is a combination of a plurality of these. Also, processor 111 may be a combination of these with a hardware accelerator or the like. Processor 111 controls each part in order to realize various functions of control device 110 based on programs such as firmware, system software, and application software stored in ROM 112 or auxiliary storage device 114, etc. Also, processor 111 executes the processes described later based on the program. Note that part or all of the program may be incorporated in the circuit of processor 111.

[0014] ROM 112 and RAM 113 are the main storage devices of a computer centered around processor 111. ROM 112 is a non-volatile memory used exclusively for reading data. ROM 112 stores, for example, firmware among the above programs. Also, ROM 112 stores data used by processor 111 when performing various processes, etc.

[0015] RAM 113 is a memory used for reading and writing data. RAM 113 is utilized as a work area or the like that stores data temporarily used by processor 111 when performing various processes. RAM 113 is typically a volatile memory.

[0016] The auxiliary storage device 114 is an auxiliary storage device of a computer centered on the processor 111. The auxiliary storage device 114 is, for example, an EEPROM (electric erasable programmable read-only memory), an HDD (hard disk drive), or a flash memory. The auxiliary storage device 114 stores, among the above programs, for example, system software and application software. The auxiliary storage device 114 also stores data used by the processor 111 to perform various processes, data generated by the processes in the processor 111, and various setting values.

[0017] The communication interface 115 is an interface for the control device 110 to communicate with other devices. This communication may be wireless communication or wired communication. This communication may also be a mixture of wireless communication and wired communication. The control device 110 communicates with the sensor 120, the projection device 130, and the vehicle equipment 140 via the communication interface 115. The control device 110 controls the projection device 130 using the communication with the projection device 130.

[0018] The display device 116 displays a screen for notifying various information to the operator of the vehicle 100 or the control device 110. The display device 116 is, for example, a display such as a liquid crystal display or an organic EL (electro-luminescence) display.

[0019] The input device 117 receives operations by the operator of the vehicle 100 or the control device 110. The input device 117 is, for example, a keyboard, a keypad, a touch pad, or a controller. Also, the input device 117 may be a device for voice input. Further, a touch panel can also be used as the display device 116 and the input device 117. In this case, the display panel included in the touch panel functions as the display device 116. And the pointing device by touch input included in the touch panel functions as the input device 117.

[0020] The bus 118 includes a control bus, an address bus, a data bus, etc., and transmits signals exchanged among the respective parts of the control device 110.

[0021] The sensor 120 is a sensor installed inside the vehicle 100. The sensor 120 is a sensor used to estimate the position of the face of the passenger in the vehicle 100. The sensor 120 is, for example, a camera, an infrared sensor, a radar, LIDAR (light detection and ranging), etc. The sensor 120 outputs sensor information. The sensor information is information including the measurement results by the sensor 120. When the sensor 120 is a camera, the sensor information includes an image captured by the camera. Note that a moving image is a kind of image. A plurality of sensors 120 may be installed in the vehicle 100. A plurality of types of sensors 120 may be installed in the vehicle 100.

[0022] The projection device 130 is also called a projector. The projection device 130 is a device that projects an image onto a projection target by projecting light. In an embodiment, the projection target is somewhere inside the vehicle cabin of the vehicle 100. Examples of the projection destination of the image include the ceiling, wall, door, and floor inside the vehicle cabin of the vehicle 100, the back side of the seat backrest, the window glass, and the dashboard. The projection device 130 is, for example, used by being placed inside the vehicle 100. The projection device 130 is, for example, installed inside the vehicle 100. The projection device 130 may be pre-equipped in the vehicle 100. As an example, the projection device 130 is installed between the seats of the rear seats. Note that the projection device 130 is an example of a display device that displays an image.

[0023] The projection device 130 includes, as an example, a processor 131, a ROM 132, a RAM 133, an auxiliary storage device 134, a communication interface 135, and a projection device 136. And a bus 137 or the like connects these respective parts.

[0024] The processor 131 is a central part of a computer that performs processes such as operations and controls necessary for the operation of the projection device 130, and performs various operations and processes. The processor 131 is, for example, a CPU, MPU, SoC, DSP, GPU, ASIC, PLD, or FPGA. Alternatively, the processor 131 is a combination of a plurality of these. Also, the processor 131 may be a combination of these with a hardware accelerator or the like. The processor 131 controls each part to realize various functions of the projection device 130 based on programs such as firmware, system software, and application software stored in the ROM 132 or the auxiliary storage device 134. Also, the processor 131 executes the processes described later based on the program. Note that part or all of the program may be incorporated in the circuit of the processor 131.

[0025] ROM 132 and RAM 133 are the main memory devices of a computer centered around the processor 131. ROM 132 is a non-volatile memory exclusively used for reading data. ROM 132 stores, for example, firmware among the above programs. Also, ROM 132 stores data used by the processor 131 for performing various processes.

[0026] RAM 133 is a memory used for reading and writing data. RAM 133 is utilized as a work area for storing data temporarily used by the processor 131 for performing various processes. RAM 133 is typically a volatile memory.

[0027] The auxiliary storage device 134 is an auxiliary storage device of a computer centered around the processor 131. The auxiliary storage device 134 is, for example, an EEPROM, HDD, or flash memory. The auxiliary storage device 134 stores, for example, system software and application software among the above programs. Also, the auxiliary storage device 134 stores data used by the processor 131 for performing various processes, data generated by the processing in the processor 131, and various setting values.

[0028] The communication interface 135 is an interface for the projection device 130 to communicate with other devices. This communication may be wireless communication or wired communication. This communication may also be a mixture of wireless communication and wired communication. The projection device 130 communicates with the control device 110 via the communication interface 135.

[0029] The projection device 136 is a display device that projects an image onto a projection target by projecting light. The projection device 136 includes, for example, a light source and a lens. The light source emits light. The lens projects the light onto the projection target. It is preferable that the projection device 136 can change the projection position and projection direction of the image.

[0030] The bus 137 includes a control bus, an address bus, a data bus, etc., and transmits signals exchanged among various parts of the projection device 130.

[0031] The vehicle equipment 140 is equipment provided in the vehicle 100. The vehicle equipment 140 includes, for example, power windows. A power window is a window that can be opened and closed by electric control.

[0032] Hereinafter, the operation of the projection system 1 according to the embodiment will be described based on FIGS. 2 and 3, etc. Note that the content of the processing in the following operation description is an example, and various processes capable of obtaining the same result can be appropriately used. FIGS. 2 and 3 are flowcharts showing an example of the processing by the processor 111 of the control device 110. The processor 111 executes the processing of FIGS. 2 and 3 based on a program stored in, for example, the ROM 112 or the auxiliary storage device 114.

[0033] The processor 111 of the control device 110 starts the processing of FIGS. 2 and 3, for example, when starting the control of the projection device 130.

[0034] In step ST11 of FIG. 2, the processor 111 of the control device 110 instructs the projection device 130 to start projecting an image. The projection device 130 controls the projection device 136 to start projecting an image in response to the instruction. The projection device 136 starts projecting an image based on the control.

[0035] In step ST12, the processor 111 acquires sensor information from the sensor 120.

[0036] In step ST13, the processor 111 estimates the position of the viewer's face using the sensor information obtained in step ST12. Here, the viewer refers to a person who is riding in the vehicle 100 and watches the image projected by the projection device 130. The processor 111 preferably estimates the position of the viewer's eyes. Then, the processor 111 uses the position of the eyes as the position of the viewer's face. Alternatively, the processor 111 may regard the position of the head as the position of the face. When the sensor information includes an image of the interior of the vehicle cabin, the processor 111 estimates the position of the viewer's face by, for example, performing image analysis on the image in which the viewer is reflected. Note that the processor 111 may estimate the position of the viewer's face multiple times within a certain period. Then, the processor 111 may calculate the average of the positions of the viewer's face estimated multiple times and use the calculation result as the estimation result in step ST12. Alternatively, the processor 111 may adopt the most frequent one among the positions of the viewer's face estimated multiple times and use the adopted one as the estimation result in step ST13. Note that when the processor 111 estimates the position of the viewer's face multiple times, it is preferable to repeatedly estimate the position of the viewer's face behind other processes instead of estimating the direction of the viewer's face multiple times after starting the process in step ST13.

[0037] Note that when there are multiple viewers, the processor 111 estimates the position of the face for any one of the viewers. Alternatively, the processor 111 estimates the position of the face for all the viewers. Alternatively, the processor 111 may calculate the average position of the faces of multiple viewers.

[0038] From the above, by performing the process in step ST13, the processor 111 functions as an example of an estimation unit that estimates the position of the face of a person in the vehicle cabin of the vehicle.

[0039] In step ST14, the processor 111 estimates the orientation of the viewer's face using the sensor information obtained in step ST12. The processor 111 may also estimate the orientation of the viewer's face using the position of the viewer's face estimated in step ST13. For example, the processor 111 estimates the orientation of the face by detecting the parts of the face. When the sensor information includes an image taken inside the vehicle cabin, the processor 111 estimates the orientation of the viewer's face by, for example, performing image analysis on the image in which the viewer is reflected. Note that the processor 111 may estimate the orientation of the viewer's face multiple times within a certain period. Then, the processor 111 may calculate the average of the orientations of the viewer's face estimated multiple times and use the calculation result as the estimation result of step ST14. Alternatively, the processor 111 may adopt the orientation of the viewer's face with the highest frequency among those estimated multiple times and use the adopted one as the estimation result of step ST14. Note that when the processor 111 estimates the orientation of the viewer's face multiple times, it is preferable that the processor 111 repeatedly estimates the orientation of the viewer's face behind other processes, rather than starting to estimate the orientation of the viewer's face multiple times after starting the process of step ST14.

[0040] Note that when there are multiple viewers, the processor 111 estimates the orientation of the face for any one of the viewers. Alternatively, the processor 111 estimates the orientation of the face for all the viewers. Alternatively, the processor 111 may estimate the average orientation of the faces of multiple viewers.

[0041] From the above, by performing the process of step ST14, the processor 111 functions as an example of an estimation unit that estimates the orientation of the face.

[0042] In step ST15, the processor 111 determines an optimal projection position according to the orientation of the viewer's face. Here, the optimal projection position is, for example, the position where the probability of motion sickness is the lowest. The processor 111 determines, for example, a position on the extension line of the orientation of the viewer's face as the optimal projection position. The processor 111 uses, for example, the point where the extension line of the vector indicating the orientation of the viewer's face first hits somewhere on the vehicle 100 as the center of the image to be projected. The starting point of the vector is, for example, the position of the viewer's face. Note that the center is, for example, the centroid. The image projected by the projector is typically rectangular. The center of the rectangle coincides with the intersection of the diagonals.

[0043] Note that when there are multiple viewers, the processor 111 determines the optimal projection position using the orientation of the face of any one of the viewers. Alternatively, the processor 111 determines the optimal projection position using the average face orientation of multiple viewers.

[0044] From the above, by performing the process of step ST15, the processor 111 functions as an example of a determination unit that determines the display position of the image according to the face orientation.

[0045] In step ST16, the processor 111 controls the projection device 130 so as to project the image at the projection position determined in step ST15. Based on the control, the projection device 130 controls the projection device 136 to change the projection position of the image.

[0046] In step ST17, the processor 111 acquires the position of the projected image. The processor 111 acquires the position of the center of the image as the position of the image. The processor 111 acquires the position of the image, for example, by estimating the position of the center. The processor 111 estimates the position of the image, for example, using the sensor information acquired in step ST12. When the sensor information includes an image capturing the interior of the vehicle, the processor 111 estimates the position of the image, for example, by analyzing the image in which the viewer is reflected. Note that the projection device 130 may have a function of measuring the position of the image. In this case, the processor 111 may acquire the position of the image from the projection device 130.

[0047] From the above, by performing the process of step ST17, the processor 111 functions as an example of an acquisition unit that acquires the position of the image displayed by the display device that displays the image and is installed in the vehicle.

[0048] In step ST18, the processor 111 estimates the viewing distance of the viewer. That is, the processor 111 estimates the distance between the position of the face estimated in step ST13 and the position of the image acquired in step ST17. The processor 111 estimates the distance, for example, by calculating the norm of the difference between the position vector indicating the position of the face and the position vector indicating the position of the image.

[0049] Note that when there are a plurality of viewers, the processor 111 estimates the viewing distance for any one of the viewers. Alternatively, the processor 111 estimates the viewing distance for all the viewers. Alternatively, the processor 111 estimates the viewing distance using the average face position of the plurality of viewers.

[0050] In step ST19, the processor 111 determines an optimal projection size according to the viewing distance. Here, the optimal projection size is, for example, the largest projection size at which the probability of experiencing motion sickness is below a predetermined level. The processor 111 determines the projection size, for example, according to the following formula. Note that the projection size is the length of a predetermined part of the projected image. When the projected image is rectangular, the predetermined part is, for example, the diagonal of the rectangle. (Projection size) = (predetermined coefficient) × (viewing distance) (1)

[0051] Here, the predetermined coefficient is a predetermined value. The predetermined coefficient can also be interpreted as the projection size when the viewing distance is the unit distance. The value of the predetermined coefficient is determined, for example, by the designer, seller, or administrator of the projection system 1. The value of the predetermined coefficient may be changeable by the operator of the control device 110 or the operator of the projection device 130.

[0052] Note that the formula for determining the projection size is not limited to the above formula. Also, the formula for determining the projection size may be non - linear.

[0053] When the processor 111 estimates a plurality of viewing distances in step ST18, for example, it determines the projection size using the viewing distance of any one person. Alternatively, when the processor 111 estimates a plurality of viewing distances in step ST18, it determines the projection size using the average viewing distance of the plurality of viewing distances.

[0054] From the above, by performing the process of step ST19, the processor 111 functions as an example of a determination unit that determines the display size of an image according to the distance between the position of the face and the position of the image.

[0055] In step ST20, the processor 111 controls the projection device 130 to project an image with the projection size determined in step ST19. Based on this control, the projection device 130 controls the projection device 136 to change the projection size of the image.

[0056] In step ST21 of FIG. 3, the processor 111 acquires sensor information from the sensor 120.

[0057] In step ST22, the processor 111 determines whether the viewer is motion sick from watching the video. For example, the processor 111 determines whether the viewer is motion sick from watching the video by using the sensor information acquired in step ST21. When the sensor information includes an image capturing the interior of the vehicle cabin, the processor 111 determines whether the viewer is motion sick from watching the video by, for example, performing image analysis on the image in which the viewer appears. The processor 111 determines whether the viewer is motion sick from watching the video by using, for example, at least any one of the presence, number, and frequency of the viewer's yawns, facial color, presence and amount of cold sweat, presence, number, and frequency of the action of swallowing saliva, and facial expression. When the processor 111 determines whether the viewer is motion sick from watching the video by using the viewer's facial color, for example, the processor 111 determines whether the viewer is motion sick from watching the video by using whether the viewer's face is pale. Also, the action of swallowing saliva increases as the amount of saliva increases. When the processor 111 determines whether the viewer is motion sick from watching the video by using the viewer's facial expression, for example, the processor 111 determines whether the viewer is motion sick from watching the video by using a change in facial expression due to discomfort such as nausea of the viewer. Note that the determination of whether the viewer is motion sick from watching the video may be such that even if the viewer is actually suffering from car sickness rather than motion sickness from watching the video, it is determined that the viewer is motion sick from watching the video. If the processor 111 determines that the viewer is motion sick from watching the video, it determines Yes in step ST22 and proceeds to step ST23. When there are a plurality of viewers, the processor 111 determines Yes in step ST22, for example, when one or more of them are motion sick from watching the video. Alternatively, the processor 111 determines Yes in step ST22 when the ratio of the number of viewers who are motion sick from watching the video is equal to or greater than a predetermined value.

[0058] From the above, by performing the process of step ST22, the processor 111 functions as an example of a determination unit that determines that a person in the vehicle cabin of the vehicle is motion sick from watching the video.

[0059] In step ST23, the processor 111 starts measuring the time during which the viewer is suffering from video sickness. If the processor 111 is already measuring the time, it skips the process of step ST23.

[0060] In step ST24, the processor 111 determines whether the viewer's video sickness continues for a predetermined time or more. If the time measured in step ST23 is equal to or more than a predetermined time T1, the processor 111 determines that the viewer's video sickness continues for a predetermined time or more. If the viewer's video sickness does not continue for a predetermined time or more, the processor 111 determines No in step ST24 and proceeds to step ST25.

[0061] In step ST25, the processor 111 starts control to reduce video sickness caused by the projected video (hereinafter referred to as "reduction control"). The reduction control may have multiple levels. The higher the level of the reduction control, the greater the degree of reduction of video sickness. In step ST25, the processor 111 starts reduction control at level 1, for example. If the processor 111 is performing reduction control at level 2 or higher, it ends the reduction control at level 2 or higher and starts reduction control at level 1.

[0062] As an example, the reduction control has three levels: level 1 to level 3. Examples (A1) to (A8) of the reduction control from level 1 to level 3 are shown below.

[0063] (A1) Level 1: The processor 111 controls the projection device 130 to reduce the projection size of the image. Level 2: The processor 111 controls the projection device 130 to reduce the projection size of the image to be smaller than that of the lower level. Level 3: The processor 111 controls the projection device 130 to end the projection of the image.

[0064] (A2) Level 1: Processor 111 controls vehicle equipment 140 to open the power window. Level 2: Processor 111 controls projection device 130 to reduce the projection size of the image. Level 3: Processor 111 controls projection device 130 to end the projection of the image.

[0065] (A3) Level 1: Processor 111 controls projection device 130 to reduce the projection size of the image. Level 2: Processor 111 controls projection device 130 to make the projection size of the image smaller than that of the lower level. Level 3: Processor 111 controls projection device 130 to make the projection size of the image smaller than that of the lower level.

[0066] (A4) Level 1: Processor 111 controls projection device 130 to reduce the projection size of the image. Level 2: Processor 111 controls projection device 130 to end the projection of the image. Level 3: Processor 111 controls vehicle equipment 140 to open the power window.

[0067] (A5) Level 1: Processor 111 controls projection device 130 to change the content of the projected image to something less likely to cause drunkenness. Level 2: Processor 111 controls projection device 130 to reduce the projection size of the image. Level 3: Processor 111 controls projection device 130 to end the projection of the image.

[0068] (A6) Level 1: Processor 111 controls projection device 130 to change the content of the projected image to something less likely to cause drunkenness. Level 2: Processor 111 controls projection device 130 to reduce the projection size of the image. Level 3: The processor 111 controls the projection device 130 to make the projection size of the image smaller than that of the lower level.

[0069] (A7) Level 1: The processor 111 controls the projection device 130 to change the content of the image to be projected into something less likely to cause dizziness. Level 2: The processor 111 controls the vehicle equipment 140 to open the power window. Level 3: The processor 111 controls the projection device 130 to make the projection size of the image smaller.

[0070] (A8) Level 1: The processor 111 controls the projection device 130 to change the content of the image to be projected into something less likely to cause dizziness. Level 2: The processor 111 controls the vehicle equipment 140 to open the power window. Level 3: The processor 111 controls the projection device 130 to end the image projection.

[0071] Note that the reduction controls for Levels 1 to 3 may be those obtained by swapping the control contents of Levels 1 to 3 in the above example. The control contents of Level 1 and Level 2 may be the same. The control contents of Level 2 and Level 3 may be the same. The control contents of Levels 1 to 3 may all be the same. The reduction controls for Levels 1 to 3 may be those obtained by making Level 2 the same as Level 1 in the above example. The reduction controls for Levels 1 to 3 may be those obtained by making Level 1 the same as Level 2 in the above example. The reduction controls for Levels 1 to 3 may be those obtained by making Level 3 the same as Level 2 in the above example. The reduction controls for Levels 1 to 3 may be those obtained by making Level 2 the same as Level 3 in the above example.

[0072] Also, the processor 111 may perform multiple controls at one level. For example, the level including the control to reduce the projection size of the image may also include the control to open the power window. The level including the control to end the image projection may also include the control to open the power window. The level to change the content of the image to be projected may also include the control to open the power window. The level including the control to reduce the projection size of the image may also include the control to change the content of the image to be projected to be less likely to cause dizziness.

[0073] From the above, when a person is suffering from video-induced dizziness or vomiting, the processor 111 functions as an example of a control unit that controls the display device for displaying an image to reduce the display size of the image or end the display by performing reduction control. Also, when a person is suffering from video-induced dizziness, the processor 111 functions as an example of a control unit that opens the window of the vehicle by performing the process of step ST25.

[0074] On the other hand, if the video-induced dizziness of the viewer continues for a predetermined time or more, the processor 111 determines Yes in step ST24 and proceeds to step ST26.

[0075] In step ST26, the processor 111 starts the reduction control. In step ST26, the processor 111 starts, for example, the reduction control of level 2. If the processor 111 is in the reduction control of level 3 or higher, it ends the reduction control of level 3 or higher and starts the reduction control of level 2.

[0076] From the above, when the video-induced dizziness of a person continues for a predetermined time or more, the processor 111 functions as an example of a control unit that reduces the display size of the image or ends the display by performing the process of step ST26.

[0077] If the processor 111 determines that the viewer is not suffering from video-induced dizziness, it determines No in step ST22 and proceeds to step ST27.

[0078] In step ST27, the processor 111 ends the mitigation control.

[0079] After the processing of step ST25, step ST26, or step ST27, the processor 111 proceeds to step ST28.

[0080] In step ST28, the processor 111 determines whether the viewer has vomited. The processor 111 determines whether the viewer has vomited, for example, using the sensor information acquired in step ST21. When the sensor information includes an image that captures the interior of the vehicle cabin, the processor 111 determines whether the viewer has vomited, for example, by performing image analysis on the image in which the viewer appears. If the processor 111 determines that the viewer has vomited, it determines Yes in step ST28 and proceeds to step ST29.

[0081] As described above, by performing the processing of step ST28, the processor 111 functions as an example of a determination unit that determines that a person in the vehicle cabin of the vehicle has vomited.

[0082] In step ST29, the processor 111 starts the mitigation control. In step ST26, the processor 111 starts, for example, the mitigation control at level 3. The processor 111 may continue the mitigation control at level 3 for a predetermined time or more and then end the processing of step ST29. The processor 111 may end the mitigation control at level 3 at the end of the processing of step ST29. If the processor 111 ends the mitigation control at level 3, it may start the mitigation control at level 1 or level 2. After the processing of step ST29, the processor 111 returns to step ST21.

[0083] If the viewer has not vomited, the processor 111 determines No in step ST28 and proceeds to step ST29.

[0084] In step ST30, the processor 111 determines whether the orientation of the viewer's face has changed by a predetermined amount or more. For example, the processor 111 estimates the orientation of the viewer's face in the same manner as in step ST14 using the sensor information acquired in step ST21. At this time, the processor 111 may estimate the position of the viewer's face in the same manner as in step ST13. Then, when the orientation of the face estimated in step ST14 and the orientation of the face estimated in step ST30 differ by a predetermined amount or more, the processor 111 determines that the position of the viewer's face has changed by a predetermined amount or more. Alternatively, the processor 111 determines that the orientation of the viewer's face has changed by a predetermined amount or more when the time during which the position of the face estimated in step ST14 and the orientation of the face estimated in step ST30 differ by a predetermined amount or more continues for a predetermined amount or more. If the orientation of the viewer's face has not changed by a predetermined amount or more, the processor 111 determines No in step ST30 and returns to step ST21.

[0085] On the other hand, if the orientation of the viewer's face has changed by a predetermined amount or more, the processor 111 determines Yes in step ST30 and returns to step ST12 in FIG. 2. As a result, the processor 111 performs the processes of steps ST12 to ST20 again. By the processes of steps ST12 to ST20 performed again, the projection position and the projection size become the optimal projection position and projection size according to the changed orientation of the face.

[0086] In step ST31, the processor 111 determines whether the position of the viewer's face has changed by a predetermined amount or more. The processor 111 estimates the position of the viewer's face in the same manner as in step ST13 using, for example, the sensor information acquired in step ST21. Alternatively, the processor 111 may use the position of the face estimated in step ST30. Then, when the position of the face estimated in step ST13 and the position of the face estimated in step ST30 or step ST31 are separated by a predetermined amount or more, the processor 111 determines that the position of the viewer's face has changed by a predetermined amount or more. Alternatively, the processor 111 determines that the position of the viewer's face has changed by a predetermined amount or more when the time during which the position of the face estimated in step ST13 and the position of the face estimated in step ST30 or step ST31 are separated by a predetermined amount or more continues for a predetermined amount or more. If the processor 111 does not determine that the position of the viewer's face has changed by a predetermined amount or more, it determines No in step ST31 and returns to step ST21. As described above, the processor 111 repeats the processes of steps ST21 to ST31 and starts the mitigation control when the viewer is suffering from motion sickness, the viewer's motion sickness continues for a predetermined amount or more, or the viewer vomits.

[0087] If the processor 111 determines that the position of the viewer's face has changed by a predetermined amount or more, it determines Yes in step ST31 and returns to step ST12. However, when the processor 111 returns from step ST31 to step ST12, it skips the processes of steps ST14 to ST16. That is, after the process of step ST13, the processor 111 proceeds to step ST17. Therefore, the processor 111 performs the processes of steps ST12 to ST13 and steps ST17 to ST20 again. By performing the processes of steps ST12 to ST13 and steps ST17 to ST20 again, the projection size becomes the optimal projection size according to the changed position of the face.

[0088] According to the projection system 1 of the embodiment, the control device 110 estimates the position of a person's face in the vehicle interior of the vehicle 100. Further, the control device 110 of the embodiment acquires the position of the image projected by the projection device 130. Then, the control device 110 of the embodiment determines the projection size of the image according to the distance between the face position and the image position. Thereby, the control device 110 of the embodiment can determine an optimal projection size according to the distance. The optimal projection size is, for example, a projection size at which the probability of experiencing motion sickness is equal to or less than a predetermined value. Therefore, it is less likely for a person in the vehicle interior to experience motion sickness.

[0089] Further, according to the projection system 1 of the embodiment, the control device 110 reduces the projection size of the image as the distance becomes shorter. Motion sickness is more likely to occur as the apparent size is larger. Therefore, the control device 110 of the embodiment can make it less likely to cause motion sickness by reducing the projection size as the distance becomes shorter.

[0090] Further, according to the projection system 1 of the embodiment, the control device 110 sets the center of the projected image as the position of the image. Thereby, the control device 110 of the embodiment can correctly grasp the position of the image.

[0091] Further, according to the projection system 1 of the embodiment, the control device 110 estimates the orientation of a person's face in the vehicle interior of the vehicle 100. Then, the control device 110 of the embodiment determines the projection position of the image according to the orientation of the face. The control device 110 of the embodiment can suppress motion sickness of a person in the vehicle interior by aligning the projection position of the image with the orientation of the face.

[0092] Further, according to the projection system 1 of the embodiment, the control device 110 determines at least one of whether a person in the vehicle interior of the vehicle 100 is experiencing motion sickness and has vomited. Then, when a person in the vehicle interior is experiencing motion sickness or has vomited, the control device 110 of the embodiment reduces the projection size of the image projected by the projection device 130 or ends the projection. Thereby, the control device 110 of the embodiment can reduce motion sickness caused by the projected video.

[0093] Also, according to the projection system 1 of the embodiment, when a person in the vehicle interior of the vehicle 100 is suffering from motion sickness due to the video, the control device 110 opens the power window. And, the control device 110 of the embodiment reduces the projection size of the image projected by the projection device 130 or ends the projection when the motion sickness of the person in the vehicle interior continues for a predetermined time or more. Thereby, the control device 110 of the embodiment can reduce the motion sickness caused by the projected video.

[0094] The above embodiment can be modified as follows. In the above embodiment, the reduction control has three levels: level 1 to level 3. However, the reduction control may have four or more levels. In this case, for example, when the time elapsed since the measurement started in step ST23 is equal to or longer than a predetermined time T2, the processor starts the reduction control at a level greater than level 2 and less than level 3. Note that the time T2 is longer than the time T1.

[0095] In the above embodiment, the control device 110 determines and changes the projection size based on the position of the viewer's face and determines and changes the projection position based on the orientation of the viewer's face. However, the control device 110 of the embodiment may perform only any one of these.

[0096] In the above embodiment, the projection device 130 projects an image to display the image. However, the projection system of the embodiment may include a display device other than a projector instead of the projection device 130. The display device may be, for example, a display. The display may be a head-up display or a head-mounted display. The head-mounted display may be a VR (virtual reality) goggle.

[0097] In the above embodiment, the projection device 130 is installed inside the vehicle 100. However, the above embodiment can also be applied to the projection device 130 installed outside the vehicle 100.

[0098] Each device in the embodiment may be composed of a plurality of devices.

[0099] The processor 111 and the processor 131 may implement part or all of the processing realized by the program in the above embodiment by the hardware configuration of the circuit.

[0100] The program for realizing the processing of the embodiment is transferred, for example, in a state stored in a non-temporary computer-readable storage medium in the device. However, the device may be transferred without the program being stored. And the program may be transferred separately and written into the device. The transfer of the program at this time can be realized, for example, by recording it on a removable non-temporary computer-readable storage medium or by downloading via a network such as the Internet or a LAN (local area network).

[0101] As described above, the embodiments of the present invention have been described, but they are shown as examples and do not limit the scope of the present invention. The embodiments of the present invention can be implemented in various forms without departing from the gist of the present invention.

Explanation of Reference Numerals

[0102] 1 Projection system 100 Vehicle 110 Control device 111, 131 Processor 112, 132 ROM 113, 133 RAM 114, 134 Auxiliary storage device 115, 135 Communication interface 116 Display device 117 Input device 118,137 buses 120 sensors 130 projection devices 136 projection devices 140 vehicle equipment

Claims

1. An estimation unit that estimates the position of a person's face in the passenger compartment of a vehicle; An acquisition unit that acquires the position of an image displayed by a display device installed in the vehicle and that displays the image; A control device comprising a determination unit that determines the display size of the image according to the distance between the face position and the image position.

2. The control device according to claim 1, wherein the determination unit makes the display size smaller as the distance becomes shorter.

3. The control device according to claim 1, wherein the position of the image is the center of the image.

4. The estimation unit estimates the orientation of the face, The control device according to claim 1, wherein the determination unit determines the display position of the image according to the orientation of the face.

5. A determination unit that determines at least one of whether a person in the passenger compartment of the vehicle is motion sick and has vomited; A control device comprising a control unit that, when the person is motion sick or has vomited, controls a display device that displays an image to reduce the display size of the image or terminate the display.

6. The control device according to claim 5, wherein the control unit opens a window of the vehicle when the person is motion sick, and reduces the display size of the image or terminates the display when the person's motion sickness continues for a predetermined period or longer.

7. A program that causes a processor included in a control device to function as an estimation unit that estimates the position of a person's face in the passenger compartment of a vehicle; an acquisition unit that acquires the position of an image displayed by a display device installed in the vehicle and that displays the image; a determination unit that determines the projection size of the image according to the distance between the face position and the image position.

8. A program that causes a processor included in a control device to be A determination unit that determines whether a person in the vehicle interior of a vehicle is suffering from motion sickness or has vomited; A program that functions as a control unit that, when the person is suffering from motion sickness or has vomited, controls a display device that displays an image to reduce the display size of the image or terminate the display.

Images