Projection system

Abstract

To improve convenience by allowing information displayed in an interior of a vehicle to be moved to any position.SOLUTION: A projection system includes: a first projection part 75a which projects and displays projection information PD onto a hand 101 of a passenger 100, belongings BG, BK, installations 20 in a vehicle interior 21 by a projector 4; a movement determination part 73 which determines whether a predetermined movement condition for moving the projection information PD is satisfied after the projection information PD is displayed by the first projection part 75a; and a second projection part 75b which moves and displays the projection information PD displayed on the hand 101 of the passenger 100, the belongings BG, BK, the installations 20 in the vehicle interior 21 by the first projection part 75a onto a hand 101 of another passenger 100, the belongings BG, BK, the installations 20 in the vehicle interior 21 by the projector 4 when the movement condition is determined to be satisfied by the movement determination part 73.SELECTED DRAWING: Figure 1

Description

[[Technical Field]]

[0001] The present invention relates to a projection system that performs desired display in the cabin of a vehicle such as an automobile. [[Background Art]]

[0002] Conventionally, for example, a user interface system for a vehicle such as the one described in Patent Document 1 is known. This user interface system projects an operation image onto the hand of a seated person, and determines the seated person's intention by using the movement of the hand onto which the operation image is projected. [[Prior Art Documents]] [[Patent Documents]]

[0003] [[Patent Document 1]] Japanese Unexamined Patent Application Publication No. 2018-180851 [[Summary of the Invention]] [[Problem to be Solved by the Invention]]

[0004] However, in the above conventional user interface system, the operation image is only projected onto the hand of a seated person, and cannot be moved to other seated persons or objects inside the vehicle. For this reason, there has been a problem in that convenience is low because a plurality of people cannot share the image or move the image to a position that is easy to view.

[0005] Accordingly, the present invention has been made in view of the above problems, and an object of the present invention is to provide a projection system capable of improving convenience by enabling information displayed in the cabin of a vehicle to be moved to any position. [[Means for Solving the Problem]]

[0006] The present invention provides a projection system (1) including: a projection unit (4) provided in a cabin of a vehicle (2); and a control unit (70) that controls the projection unit (4) to perform desired display, wherein the control unit (70) displays predetermined information (PD) in the cabin This is the surface of installed objects 23-30.A first projection process in which the projection unit 4 projects and displays onto the first projection areas 101, 20, BG, BK, and after the display of the predetermined information PD by the first projection process, the projection unit 4 projects and displays the information from the first projection areas 101, 20, BG, BK to the interior of the room. The surface of the hand 101 of the passenger 100 of the vehicle, or the surface of the personal belongings BG, BK possessed by the passenger 100. The process includes: a movement determination process that determines whether predetermined movement conditions have been met for moving the predetermined information PD to the second projection area 101, 20, BG, BK; and a second projection process that, if the movement determination process determines that the movement conditions have been met, moves the predetermined information PD, which was displayed in the first projection area 101, 20, BG, BK, to the second projection area 101, 20, BG, BK, using the projection unit 4, and projects and displays it in the second projection area 101, 20, BG, BK. The second projection regions 101, 20, BG, BK can be moved by the passenger 101, and the control unit 70 moves the predetermined information PD to the second projection regions 101, 20, BG, BK, and then moves the predetermined information PD to follow the movement of the second projection regions 101, 20, BG, BK. It is characterized by the following: [Effects of the Invention]

[0007] According to the present invention, a projection system can be provided that enhances convenience by allowing information displayed inside a vehicle to be moved to any position. [Brief explanation of the drawing]

[0008] [Figure 1] A functional block diagram showing the configuration of a projection system according to an embodiment of the present invention. [Figure 2] A schematic diagram of the interior of a vehicle equipped with the projection system according to this embodiment. [Figure 3] An explanatory diagram showing a first specific example of the transfer process of projection information performed by the projection system according to the embodiment. [Figure 4] An explanatory diagram showing a first specific example of the transfer process of projection information performed by the projection system according to the embodiment. [Figure 5] An explanatory diagram showing a first specific example of the transfer process of projection information performed by the projection system according to the embodiment. [Figure 6] An explanatory diagram showing a first specific example of the transfer process of projection information performed by the projection system according to the embodiment. [Figure 7]Explanatory diagram showing a second specific example of projection information movement processing executed by the projection system according to the embodiment. [Figure 8] Explanatory diagram showing a third specific example of projection information movement processing executed by the projection system according to the embodiment. [Figure 9] Explanatory diagram showing a third specific example of projection information movement processing executed by the projection system according to the embodiment. [Figure 10] Explanatory diagram showing a fourth specific example of projection information movement processing executed by the projection system according to the embodiment. [Figure 11] Explanatory diagram showing a fifth specific example of projection information movement processing executed by the projection system according to the embodiment. [Figure 12] Explanatory diagram showing a fifth specific example of projection information movement processing executed by the projection system according to the embodiment. [Figure 13] Explanatory diagram showing a sixth specific example of projection information movement processing executed by the projection system according to the embodiment. [Figure 14] Explanatory diagram showing a seventh specific example of projection information movement processing executed by the projection system according to the embodiment. [Figure 15] Explanatory diagram showing an eighth specific example of projection information movement processing executed by the projection system according to the embodiment. [Figure 16] Explanatory diagram showing an eighth specific example of projection information movement processing executed by the projection system according to the embodiment. [Figure 17] Explanatory diagram showing a specific example of projection information. [Figure 18] Explanatory diagram showing a specific example of projection information. [Figure 19] Explanatory diagram showing a specific example of projection information. DESCRIPTION OF EMBODIMENTS

[0009] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0010] <Configuration of Projection System> FIG. 1 is a functional block diagram showing the configuration of a projection system according to an embodiment, and FIG. 2 is a schematic diagram of the interior of a vehicle equipped with the projection system according to the embodiment. The projection system 1 includes: a non-contact sensor 3 that measures a measurement target inside the cabin 21 of a vehicle 2; a projector 4 (projection unit) provided in the cabin 21 that projects and displays projection information PD (predetermined information) onto a predetermined position of the cabin 21; a speaker 5 that outputs sound into the cabin 21; and a projection control device 6 that controls the projector 4 based on measurement information MD acquired from the non-contact sensor 3 to perform desired display.

[0011] The non-contact sensor 3 is composed of, for example, a visible light camera, an infrared camera, a TOF (Time of Flight) camera, a millimeter-wave sensor, or the like. It is preferable that a plurality of non-contact sensors 3 are installed, but one unit may be sufficient as long as it can detect a necessary range within the cabin 21. The measurement targets of the non-contact sensor 3 include an occupant 100 of the vehicle 2, belongings carried by the occupant 100 (e.g., bags, books, etc.), fixtures 20 inside the cabin 21 (e.g., roof 22, dashboard 23, pillar 24, door 25, window glass 26, seat 27, floor 28, headrest 29, steering wheel 30, etc.), the hands or belongings of the occupant 100 from the projection by the projector 4, and projection information PD displayed on the fixtures 20 inside the cabin 21, and two-dimensional information or three-dimensional information thereof is measured. For example, as shown in FIG. 2, the non-contact sensor 3 is installed on the roof 22 of the vehicle 2. Note that the non-contact sensor 3 may be installed on the roof 22 above the rear seat in addition to or instead of the above position. The non-contact sensor 3 measures, for example, the movement and shape of the hands of the occupant 100 in the driver's seat, front passenger seat, and rear seat, the belongings of each occupant 100, the fixtures 20 corresponding to each seat, and the projection information PD displayed on the hands of the occupant 100, belongings, and fixtures 20.

[0012] Projector 4 can be a known projector that uses, for example, a liquid crystal device, a digital mirror device, etc. It is preferable to install multiple projectors 4, but one is sufficient as long as it can project onto the required projection area in the passenger compartment 21. For example, as shown in Figure 2, projector 4 is installed on the roof 22 of the vehicle 2. In addition to or instead of the above location, projector 4 may be installed on the roof 22 above the rear seats, or on the pillars 24 or the inner walls of the doors 25 in the passenger compartment 21, or at any other appropriate location. Under the control of the projection control device 6, projector 4 projects and displays projection information PD onto the projection area in the passenger compartment 21 of the vehicle 2. The projection area on which projection information PD is displayed can be various locations, such as the surface of the passenger's body (e.g., hands, arms, legs, face, etc.), the surface of the passenger's belongings, or the surface of each installed object 20 in the passenger compartment 21.

[0013] Speaker 5 outputs sound information into the vehicle interior 21. Speaker 5 outputs, for example, voice from the navigation system, voice from the AI ​​agent described later, and audio from various content (music, television, movies, games, etc.). In Figure 2, for example, Speaker 5 is installed on the inside of the passenger side and driver side doors 25.

[0014] The projection control device 6 is a computer that controls the overall operation of the projection system 1 and comprises a control unit 70 consisting of a CPU (Central Processing Unit), etc., and a storage unit 80 consisting of memory such as ROM (Read Only Memory) and RAM (Random Access Memory), and a hard disk, etc.

[0015] The control unit 70 includes a sensor information acquisition unit 71 that acquires measurement information MD measured by the non-contact sensor 3, a state analysis unit 72 that analyzes the state of the measurement target by image recognition based on the acquired measurement information MD, a movement determination unit 73 that determines whether or not the movement conditions stored in the movement condition storage unit 81 of the storage unit 80 have been met based on the state of the measurement target analyzed by the state analysis unit 72, an output information acquisition unit 74 that acquires information to be output from the projector 4 or speaker 5 from the output information storage unit 82 of the storage unit 80 or the internet 90 (or, if necessary, an in-vehicle system such as a navigation system or a communication system other than the internet such as vehicle-to-vehicle communication), a projector control unit 75 that controls the projector 4 to display each piece of information acquired by the output information acquisition unit 74 as projection information PD, and a speaker control unit 76 that controls the speaker 5 to output sound-related information from the information acquired by the output information acquisition unit 74 to the vehicle interior 21.

[0016] The projector control unit 75 comprises a first projection unit 75a and a second projection unit 75b. The first projection unit 75a controls the projector 4 to project and display projection information PD onto the surface of the passenger's body 100, the surface of the passenger's belongings 100, and the surface of each installed object 20 inside the vehicle compartment 21. The surface of the passenger's body 100, the surface of the passenger's belongings 100, and the surface of each installed object 20 inside the vehicle compartment 21, onto which the projection information PD is projected by the first projection unit 75a, correspond to an example of a first projection area, and the process of projecting and displaying the projection information PD by the first projection unit 75a corresponds to an example of a first projection process.

[0017] The second projection unit 75b controls the projector 4 to move and display the projection information PD, which was displayed by the first projection unit 75a, to an area different from the area where the projection information PD is currently projected, namely the surface of the passenger's body, the surface of the passenger's belongings, and the surfaces of each installed object 20 inside the vehicle 21, when the movement determination unit 73 determines that the movement conditions have been met. The surface of the passenger's body, the surface of the passenger's belongings, and the surfaces of each installed object 20 inside the vehicle 21, to which the projection information PD is projected by the second projection unit 75b, correspond to an example of the second projection area, and the process of moving and displaying the projection information PD by the second projection unit 75b corresponds to an example of the second projection process.

[0018] Furthermore, the passenger 100 can freely move the projected information PD any number of times by fulfilling the movement conditions. For example, the projected information PD displayed by the first projection unit 75a is moved and displayed by the second projection unit 75b when the movement conditions are met, and the projected information PD displayed by the second projection unit 75b is moved and displayed by the first projection unit 75a when the movement conditions are met again. Thereafter, the first projection unit 75a and the second projection unit 75b repeat the same process alternately, so that the projected information PD is moved many times. Before the second movement of the projected information PD as described above, the surface of the passenger 100's body, the surface of the passenger 100's belongings, and the surface of each installed object 20 inside the vehicle compartment 21, onto which the projected information PD is projected by the second projection unit 75b, are examples of the first projection area, and the process of projecting and displaying the projected information PD by the second projection unit 75b is an example of the first projection process. Furthermore, after the second movement of the projection information PD, the surface of the passenger's body, the surface of the passenger's belongings, and the surface of each installed object 20 inside the vehicle compartment 21, onto which the projection information PD is projected by the first projection unit 75a, correspond to an example of a second projection area, and the process of moving and displaying the projection information PD by the first projection unit 75a corresponds to an example of a second projection process.

[0019] The memory unit 80 includes a movement condition memory unit 81 in which predetermined movement conditions for moving the display position after the display of projection information PD by the first projection unit 75a are stored, and an output information memory unit 82 in which information to be provided to the passenger 100, such as an AI agent that can be displayed as projection information PD, and various content information such as television programs, movies, games, and music.

[0020] The processing details of each processing unit in the control unit 70 are described below. The sensor information acquisition unit 71 receives measurement information MD measured by the non-contact sensor 3 at a predetermined detection cycle and passes it to the state analysis unit 72. The state analysis unit 72 first determines whether the measurement information MD includes the object to be measured by image recognition using, for example, a known feature point calculation method such as pattern matching. If the state analysis unit 72 determines that the measurement information MD includes the hand of the passenger 100, the passenger 100's belongings, the installed objects 20 in the vehicle compartment 21, and the projection information PD projected onto them, it analyzes the positional relationship between the measurement objects, the recognized hand movements, shapes, etc.

[0021] The movement determination unit 73 determines whether the movement conditions stored in the movement condition storage unit 81 of the storage unit 80 have been met, based on the positional relationship between the measurement objects analyzed by the state analysis unit 72, the recognized hand movements, shape, etc. This determination process by the movement determination unit 73 is an example of the movement determination process. Movement conditions include, for example, that at least one of the measurement objects moves so that the distance between them becomes less than or equal to a predetermined value. Movement conditions also include, for example, that another measurement object moves closer to the displayed projection information PD so that the other measurement object overlaps (conceals) the projection information PD in the projection direction. In addition, the movement conditions may also include the state in which the distance between the measurement objects becomes less than or equal to a predetermined value, or the state in which the measurement object overlaps the projection information PD, continuing for a predetermined time or longer. When the above movement conditions are met, the projector control unit 75 moves the projected information PD, which was displayed by the first projection unit 75a on, for example, the hands or belongings of the passenger 100, or the installed objects 20 inside the vehicle compartment 21, to the nearby or overlapping hands or belongings of the passenger 100, or the installed objects 20 inside the vehicle compartment 21, and displays it using the second projection unit 75b.

[0022] The movement conditions also include the detection of a predetermined movement instruction action by the passenger 100. Movement instruction actions include, for example, a gesture of pinching the displayed projection information PD, or a gesture of touching the displayed projection information PD. When the above movement instruction action is detected, the projector control unit 75 moves the projection information PD, which was displayed by the first projection unit 75a on, for example, the passenger 100's belongings or an object 20 installed in the vehicle compartment 21, to the surface of the passenger 100's hand (palm or back of hand) using the second projection unit 75b and displays it.

[0023] The movement instruction operation also includes, for example, an action in which a predetermined number of fingers on the hand are extended. When the above movement instruction operation is detected, the projector control unit 75 moves the projection information PD, which was displayed by the first projection unit 75a on, for example, the passenger's hand or belongings, or the installed object 20 in the vehicle interior 21, to the passenger's hand or belongings, or the installed object 20 in the vehicle interior 21, according to the detected number of extended fingers, and displays it there. The number of fingers and the destination location are pre-associated and stored in the movement condition storage unit 81. For example, if one finger is extended, the destination is the driver's seat; if two fingers are extended, it is the passenger seat; if three fingers are extended, it is the right rear seat; if four fingers are extended, it is the left rear seat, and so on.

[0024] Furthermore, the movement instruction operation includes, for example, an operation in which a predetermined type of finger on the hand is extended. When the above movement instruction operation is detected, the projector control unit 75 moves the projection information PD, which was displayed by the first projection unit 75a on, for example, the passenger's hand or belongings, or the installed objects 20 in the vehicle interior 21, to the passenger's hand or belongings, or the installed objects 20 in the vehicle interior 21, according to the type of extended finger detected, and displays it. The type of finger and the destination location are pre-associated and stored in the movement condition storage unit 81. For example, if the extended finger is the thumb, the destination is the driver's seat; if it is the index finger, it is the passenger seat; if it is the middle finger, it is the right rear seat; if it is the little finger, it is the left rear seat, and so on.

[0025] Furthermore, movement instruction actions include, for example, the action of pointing a fingertip in a predetermined direction. When the above movement instruction action is detected, the projector control unit 75 moves the projection information PD, which was displayed by the first projection unit 75a on, for example, the passenger's hand or belongings, or the installed object 20 in the vehicle compartment 21, to the location of the passenger's hand or belongings, or the installed object 20 in the vehicle compartment 21, according to the direction pointed by the detected fingertip, and displays it.

[0026] The movement conditions also include the fact that the movement instruction operation was performed by the hand of passenger 100 located at a predetermined distance from the displayed projection information PD. The projector control unit 75 moves the projection information PD, which was displayed by the first projection unit 75a on, for example, the hand or belongings of passenger 100 or an object 20 inside the vehicle interior 21 on the left side of the rear seat, to a location based on a movement instruction operation, such as that of passenger 100 on the right side of the rear seat or passenger 100FL in the passenger seat, and displays it.

[0027] <Specific example of processing the movement of projection information> A specific example of the movement process of projection information PD performed by the projection system 1 with the configuration described above will be explained using Figures 3 to 16.

[0028] As a first concrete example, using Figures 3 to 6, we will explain a case in which, for example, a passenger 100 in the rear seat picks up the projected information PD displayed on the headrest 29 of the driver's or passenger's seat, enjoys the content, and then moves it onto a bag BG placed on their lap.

[0029] As shown in Figure 3, the first projection unit 75a of the projector control unit 75 displays projection information PD on the rear side of the headrest 29 of the driver's seat or passenger seat. In this example, for example, an image of an AI agent is displayed as projection information PD. The AI ​​agent is controlled by artificial intelligence and communicates with the passenger 100, performing various processes based on the passenger's instructions and requests. In its communication with the passenger 100, the AI ​​agent can, for example, converse, change facial expressions, and express emotions. The AI ​​agent may be stored in the output information storage unit 82, or it may be obtained from an external server via the Internet 90.

[0030] Next, as shown in Figure 4, the passenger 100 in the rear seat brings their hand 101 close to the projected information PD, which includes the AI ​​agent, displayed on the rear side of the headrest 29, and makes a gesture, for example, to pinch the AI ​​agent. In addition to the pinching gesture, other gestures such as touching or placing the hand 101 over the projected information PD may also be used. The control unit 70 recognizes the projected information PD displayed on the rear side of the headrest 29 and the passenger 100's hand 101 using the state analysis unit 72, and analyzes the distance between the projected information PD and the hand 101 and the movement of the hand 101. In this example, the movement determination unit 73 determines that the movement conditions have been met because the distance between the projected information PD and the hand 101 is below a predetermined value and a pinching gesture by the hand 101 has been detected.

[0031] As a result, as shown in Figure 5, the projection unit 75b of the projector control unit 75 moves the projection information PD, including the AI ​​agent, from the headrest 29 to the hand 101 (either the palm or the back of the hand) of the rear-seat passenger 100. This allows the rear-seat passenger 100 to enjoy conversing with the AI ​​agent displayed on their hand 101, having the AI ​​agent play their favorite music, or displaying their favorite content on their hand 101. Furthermore, if the passenger 100 moves their hand 101, the projection unit 75b moves the projection information PD to follow that movement. This allows the passenger 100 to enjoy the experience as if the AI ​​agent were actually on their hand 101.

[0032] Next, as shown in Figure 6, the rear-seat passenger 100, with the projection information PD including the AI ​​agent displayed on their hand 101, brings their hand 101 closer to the bag BG and makes a gesture of touching the bag BG. In addition to the touching gesture, other gestures such as tilting the palm to drop the AI ​​agent are also acceptable. The control unit 70 recognizes the projection information PD displayed on the hand 101 and the bag BG using the state analysis unit 72, and analyzes the distance between the projection information PD and the bag BG and the movement of the hand 101. In this example, the movement determination unit 73 determines that the movement conditions have been met because the distance between the projection information PD and the bag BG is less than or equal to a predetermined value and a touching gesture by the hand 101 has been detected. As a result, as shown in Figure 6, the projection information PD including the AI ​​agent is moved from the hand 101 to the surface of the bag BG by the second projection unit 75b (or first projection unit 75a) of the projector control unit 75.

[0033] As a second specific example, using Figure 7, we will explain a case in which, for example, passenger 100RL on the left side of the rear seat moves the projected information PD, including the AI ​​agent displayed on the passenger seat headrest 29, to a book BK held by passenger 100RL, bringing the book BK closer to the headrest 29, and passenger 100RR on the right side of the rear seat performs the gesture that triggers this.

[0034] As shown in Figure 7, the first projection unit 75a of the projector control unit 75 displays projection information PD, including the AI ​​agent, on the rear side of the passenger seat headrest 29. Next, the passenger 100RL brings the book BK they are holding closer to the projection information PD displayed on the headrest 29. In this state, the passenger 100RR performs a gesture that triggers the movement of the projection information PD. This gesture is not particularly limited, but could be, for example, extending or moving the fingers of the hand 101 in the direction that moves the projection information PD. The control unit 70, using the state analysis unit 72, recognizes the projection information PD displayed on the headrest 29, the book BK held by the passenger 100RL, and the passenger 100RR's hand 101, and analyzes the distance between the projection information PD and the book BK and the movement of the passenger 100RR's hand 101. In this example, the movement determination unit 73 determines that the movement conditions have been met because the distance between the projected information PD and the book BK is less than or equal to a predetermined value, and a gesture is detected by the hand 101 of the passenger 100RR, which is located further than a predetermined distance from the projected information PD. As a result, the projected information PD, including the AI ​​agent, moves from the headrest 29 to the book BK.

[0035] Note that the distance condition between the projected information PD and the book BK, and the gesture condition by the passenger 100RR, can be met in either order. If the distance condition is met first, the projected information PD will move when the gesture by the passenger 100RR's hand 101 is detected. If the gesture is detected first, the projected information PD displayed on the headrest 29 will move to the object that comes closest to it first (in this example, the book BK).

[0036] Furthermore, the gesture to move the projected information PD displayed on the headrest 29 to the book BK may be performed by the passenger 100RL holding the book BK, rather than by the passenger 100RR on the right side of the rear seat.

[0037] As a third specific example, using Figures 8 and 9, we will explain a case where, for example, passenger 100RL in the left rear seat displays projection information PD, including the AI ​​agent, on their hand 101 to enjoy the content, and then sends it to passenger 100FL in the front passenger seat.

[0038] First, the rear-seat passenger 100RL enjoys conversing with the AI ​​agent displayed on hand 101, having the AI ​​agent play their favorite music, and having their favorite content displayed on hand 101. The projected information PD, including the AI ​​agent, may be displayed on hand 101 from the beginning, or it may be initially displayed on the headrest 29 and then moved to hand 101 using the aforementioned pinching or touching gestures.

[0039] Next, as shown in Figure 8, the rear-seat passenger 100RL displays projection information PD, including the AI ​​agent, on their hand 101, and performs an action such as bending a predetermined number of fingers to extend a predetermined number of fingers. The number of extended fingers and the seat position are pre-associated and stored in the movement condition storage unit 81. For example, if one finger is extended, it is the driver's seat; if two fingers are extended, it is the passenger seat; if three fingers are extended, it is the right rear seat; if four fingers are extended, it is the left rear seat, and so on. In Figure 8, for example, by bending the middle, ring, and little fingers of hand 101, the thumb and index finger are extended, and the passenger seat is indicated as the destination for the projection information PD.

[0040] The control unit 70 recognizes the hand 101 of passenger 100RL using the state analysis unit 72 and analyzes the shape of the hand 101. In this example, when an action is detected in which two fingers of the hand 101 are extended, the movement determination unit 73 determines that the movement condition for moving the projection information PD to the passenger seat has been met. As a result, as shown by the dotted arrow in Figure 9, the projection information PD, including the AI ​​agent, moves from the hand 101 of passenger 100RL to the hand 101 of passenger 100FL in the passenger seat.

[0041] Alternatively, instead of directly moving the projected information PD to the hand 101 of the passenger 100FL in the front seat, it may be moved to the installation 20 corresponding to the passenger seat (for example, the dashboard 23), as shown by the dashed arrow in Figure 9. In this case, the passenger 100FL in the front seat may move the information to their hand 101 using the aforementioned pinching or touching gestures.

[0042] As a fourth specific example, using Figure 10, we will explain a case where, for example, passenger 100RL in the left rear seat displays projection information PD, including an AI agent, on the back of the passenger seat headrest 29 to enjoy the content, and then sends it to passenger 100FL in the passenger seat.

[0043] First, the rear-seat passenger 100RL can enjoy themselves by conversing with the AI ​​agent displayed on the headrest 29, having the AI ​​agent play their favorite music, or having their favorite content displayed on the headrest 29.

[0044] Next, as shown in Figure 10, the rear-seat passenger 100RL, with the projection information PD including the AI ​​agent displayed on the headrest 29, moves their hand 101 closer to the headrest 29 while performing an action that extends a predetermined number of fingers, for example, by bending a predetermined number of fingers. As described above, the number of extended fingers and the destination are pre-associated and stored in the movement condition storage unit 81, and in Figure 10, the passenger seat is indicated as the destination of the projection information PD.

[0045] The control unit 70 recognizes the projection information PD displayed on the headrest 29 and the hand 101 of passenger 100RL via the state analysis unit 72, and analyzes the distance between the projection information PD and the hand 101, as well as the shape of the hand 101. In this example, when the distance between the projection information PD and the hand 101 becomes less than or equal to a predetermined value, and when an action is detected in which two fingers of the hand 101 are extended, the movement determination unit 73 determines that the movement conditions for moving the projection information PD to the passenger seat have been met. As a result, as shown by the dotted arrow in Figure 10, the projection information PD, including the AI ​​agent, moves from the headrest 29 of the passenger seat to the hand 101 of passenger 100FL in the passenger seat.

[0046] As previously mentioned, instead of directly moving the projected information PD to the hand 101 of the passenger 100FL in the passenger seat, it may be moved to the installation 20 corresponding to the passenger seat (for example, the dashboard 23), as shown by the dashed arrow in Figure 10. In this case, the passenger 100FL in the passenger seat may move it to their hand 101 using the aforementioned pinching or touching gestures.

[0047] Furthermore, in the third and fourth specific examples described above, the destination of the projection information PD may be specified by the type of finger rather than by the number of fingers. For example, if the extended finger is the thumb, it may be the driver's seat; if it is the index finger, the passenger seat; if it is the middle finger, the right rear seat; and if it is the little finger, the left rear seat.

[0048] As a fifth specific example, using Figures 11 and 12, we will explain a case in which, for example, a passenger 100 displays projection information PD, including an AI agent, on their hand 101 to enjoy the content, and then moves it onto a bag BG placed on their lap.

[0049] First, passenger 100 enjoys conversing with the AI ​​agent displayed on hand 101, having the AI ​​agent play their favorite music, or having their favorite content displayed on hand 101. The projected information PD, including the AI ​​agent, may be displayed on hand 101 from the beginning, or it may be initially displayed on, for example, the dashboard 23 or headrest 29, and then moved to hand 101 using the aforementioned pinching or touching gestures.

[0050] Next, as shown in Figure 11, the passenger 100, with the projection information PD including the AI ​​agent displayed on their hand 101, performs an action such as extending their index finger so that the fingertip points in a predetermined direction. Alternatively, they may extend other fingers to point in the predetermined direction, or use two or more fingers to point in the predetermined direction. Furthermore, they may specify the predetermined direction using methods other than extending their fingers (such as extending a bent finger). For example, in Figure 12, the passenger is pointing their index finger at a bag BG placed on their lap. The control unit 70, using the state analysis unit 72, recognizes the passenger 100's hand 101, the projection information PD displayed on the hand 101, and the bag BG, and analyzes the distance between the projection information PD and the bag BG, as well as the shape of the hand 101. In this example, the movement determination unit 73 determines that the movement conditions for moving the projection information PD to the bag BG have been met, as the movement of the fingertip pointing in the predetermined direction is detected in the hand 101, and the distance between the projection information PD and the bag BG located in the predetermined direction is less than or equal to a predetermined value.

[0051] As a result, as shown in Figure 12, the projection information PD, including the AI ​​agent, moves from the passenger's hand 101 to a predetermined position on the surface of the bag BG. This predetermined position is, for example, the position where the surface of the bag BG intersects with the vector in the pointing direction.

[0052] As a sixth specific example, using Figure 13, we will explain a case in which, for example, a passenger 100RL in the rear seat displays projection information PD, including an AI agent, on their hand 101 to enjoy the content, and then sends it to a passenger 100FL in the front passenger seat.

[0053] First, passenger 100RL in the back seat enjoys conversing with the AI ​​agent displayed on hand 101, having the AI ​​agent play their favorite music, and having their favorite content displayed on hand 101.

[0054] Next, as shown in Figure 13, the rear-seat passenger 100RL displays the projection information PD, which includes the AI ​​agent, on their hand 101, and performs an action such as extending their index finger so that the fingertip points towards the passenger seat. The control unit 70 recognizes the passenger 100RL's hand 101 using the state analysis unit 72 and analyzes the shape of the hand 101. In this example, since the action of the fingertip pointing towards the passenger seat is detected in the hand 101, the movement determination unit 73 determines that the movement condition for moving the projection information PD to the passenger seat has been met. As a result, as shown by the dotted arrow in Figure 13, the projection information PD, which includes the AI ​​agent, moves from the passenger 100RL's hand 101 to the passenger 100FL's hand 101 in the passenger seat.

[0055] Furthermore, instead of directly moving the projected information PD to the hand 101 of the passenger 100FL in the front seat, it may be moved to the corresponding installation 20 (e.g., dashboard 23) in the front seat, as shown by the dashed arrow in Figure 13. In this case, the passenger 100FL may move the information to their hand 101 using the aforementioned pinching or touching gestures. In addition, instead of simply specifying the seat with the fingertip direction, it may be possible to specify a more precise location (such as a specific body part of the passenger 100 or a specific installation 20).

[0056] As a seventh specific example, using Figure 14, we will explain a case in which, for example, passenger 100RL on the left side of the rear seat moves the projected information PD, including the AI ​​agent displayed on the headrest 29 of the passenger seat, to a book BK held by passenger 100RL, bringing the book BK closer to the headrest 29, and passenger 100RR on the right side of the rear seat performs the gesture that triggers this.

[0057] As shown in Figure 14, the first projection unit 75a of the projector control unit 75 displays projection information PD, including the AI ​​agent, on the rear side of the passenger seat headrest 29. Next, the passenger 100RL brings the book BK they are holding closer to the projection information PD displayed on the headrest 29. In this state, the passenger 100RR makes a gesture to specify the destination of the projection information PD. This gesture is, for example, extending the index finger so that the fingertip points in the direction of the book BK. The control unit 70, using the state analysis unit 72, recognizes the projection information PD displayed on the headrest 29, the book BK held by the passenger 100RL, and the passenger 100RR's hand 101, and analyzes the distance between the projection information PD and the book BK and the movement of the passenger 100RR's hand 101. In this example, the movement determination unit 73 determines that the movement conditions have been met when the distance between the projection information PD and the book BK becomes less than or equal to a predetermined value, and a gesture is detected by the passenger 100RR, who is located more than a predetermined distance from the projection information PD, pointing towards the book BK. As a result, the projection information PD, including the AI ​​agent, moves from the headrest 29 to the book BK.

[0058] Furthermore, the movement condition may not include the condition that the distance between the projected information PD and the book BK is less than or equal to a predetermined value. In this case, the movement condition is satisfied when a gesture by passenger 100RR pointing towards the book BK is detected. For example, as shown by the dashed arrow in Figure 14, the projected information PD may be moved directly to the book BK, which is located away from the headrest 29 (for example, on the seat of the rear seat). Also, the gesture of pointing to the destination may be performed not by passenger 100RR on the right side of the rear seat, but by passenger 100RL who is holding the book BK.

[0059] As an eighth specific example, using Figures 15 and 16, we will explain a case where, for example, passenger 100RL in the left rear seat displays projection information PD, including the AI ​​agent, on their hand 101 to enjoy the content, and then simultaneously sends it to passenger 100FL in the front passenger seat and passenger 100FR in the driver's seat.

[0060] First, passenger 100RL in the back seat enjoys conversing with the AI ​​agent displayed on hand 101, having the AI ​​agent play their favorite music, and having their favorite content displayed on hand 101.

[0061] Next, as shown in Figure 16, the passenger 100RL, with projection information PD including the AI ​​agent displayed on hand 101, extends, for example, the index and middle fingers and points in two predetermined directions. Alternatively, fingers other than the index and middle fingers (for example, the index and little fingers) may be extended to point in two directions, or three or more fingers may be used to point in three or more directions. Furthermore, it is not necessary to point in two directions with one hand; for example, fingers of the right hand and fingers of the left hand may be used to point in two predetermined directions. In addition, a predetermined gesture may be set to specify all seats. For example, in Figure 16, the index finger of hand 101 points towards the passenger seat, and the middle finger points towards the driver's seat.

[0062] The control unit 70 recognizes the hand 101 of passenger 100RL using the state analysis unit 72 and analyzes the shape of the hand 101. In this example, when the movement of the fingertips of the hand 101 is detected pointing towards the passenger seat and the driver's seat, the movement determination unit 73 determines that the movement conditions for moving the projection information PD to the passenger seat and the driver's seat have been met. As a result, as shown in Figure 16, the projection information PD, including the AI ​​agent, moves simultaneously from the hand 101 of passenger 100RL to the hand 101 of passenger 100FL in the passenger seat and the hand 101 of passenger 100FR in the driver's seat.

[0063] Although not shown in the diagram, the projected information PD may be moved not directly to the hands 101 of passenger 100FL in the passenger seat and the hands 101 of passenger 100FR in the driver's seat, but to the corresponding mounting 20 for the passenger seat (e.g., dashboard 23) and the corresponding mounting 20 for the driver's seat (e.g., steering wheel 30). In this case, passenger 100FL in the passenger seat and passenger 100FR in the driver's seat may move the information to their hands 101 using the aforementioned pinching or touching gestures.

[0064] Figures 17 to 19 show specific examples of projection information PD. In Figure 17, an image of the AI ​​agent is displayed as projection information PD on the hand 101 of the passenger 100. As mentioned above, the AI ​​agent is controlled by artificial intelligence and converses with the passenger 100, and performs various processes based on the passenger 100's instructions and requests. In Figure 18, image content is displayed as projection information PD on the hand 101 of the passenger 100. This image content may be, for example, recommended image content suggested by the AI ​​agent, or favorite image content acquired through the passenger 100's instructions and requests. In Figure 19, video content is displayed as projection information PD on the hand 101 of the passenger 100. This video content may be, for example, recommended video content suggested by the AI ​​agent, or favorite video content acquired through the passenger 100's instructions and requests. The above image content and video content are acquired by the output information acquisition unit 74, for example, via the output information storage unit 82 of the storage unit 80 or the internet 90. Furthermore, when image or video content is displayed on hand 101, passenger 100 can give instructions to the AI ​​agent by voice.

[0065] <Effects of the Embodiment> According to the projection system 1 of the embodiment described above, by satisfying predetermined movement conditions, the projected information PD displayed in a predetermined location within the passenger compartment 21 can be moved and displayed in other locations. For example, the displayed projected information PD can be moved to any position between each installed object 20 within the passenger compartment 21, the passenger's hand 101, and the passenger's belongings. This allows the projected information PD displayed in the interior space of the vehicle 2 to be moved to any position. As a result, it becomes possible for multiple passengers 100 to share the projected information PD, or for passengers 100 to move the projected information PD to any position they like, such as a position that is easy to see or a position they prefer, thereby increasing convenience.

[0066] Furthermore, in this embodiment in particular, the passenger 100 can easily move the displayed projected information PD by moving their hand 101 or belongings (such as a bag BG or book BK) and bringing their hand 101 or belongings closer to the displayed projected information PD. In addition to bringing them closer, the passenger 100 can also easily move the displayed projected information PD by overlapping their hand 101 or belongings with the displayed projected information PD.

[0067] Furthermore, in this embodiment in particular, the passenger 100 can easily move the displayed projection information PD by performing a predetermined movement of their hand 101. For example, the passenger 100 can easily move the displayed projection information PD by pinching it with their hand 101 or by making a gesture of touching the projection information PD. This makes it possible to intuitively manipulate the projection information PD, thereby improving operability.

[0068] Furthermore, in this embodiment in particular, when the passenger 100 moves the projected information PD by moving their hand 101, the destination can be easily specified depending on how many fingers of the hand 101 are extended, which fingers are extended, and in which direction the fingertips are pointed. In this case, the passenger 100 can customize the correspondence between the number or type of fingers and their locations to their liking. In addition, since the destination can be specified by the direction pointed, it can be operated intuitively, and the destination can be specified in detail.

[0069] Furthermore, in this embodiment, a passenger 100 located far away from the passenger 100 located near the projected information PD can easily move the displayed projected information PD by moving their hand 101 in a predetermined motion. For example, a parent can operate and move the projected information PD displayed on a child's hand, allowing the parent to manage the child's viewing of content.

[0070] Furthermore, in this embodiment, the AI ​​agent can be shared among multiple passengers 100, and the AI ​​agent can be moved to any position that is easily visible to the passengers 100 or to their preferred location. Passengers 100 can also use the functions of the AI ​​agent to perform various processes, such as suggesting recommended content or retrieving and displaying their favorite content, allowing them to enjoy themselves.

[0071] <Variation> The embodiments described above are not limited to those described above, and various modifications are possible without departing from their purpose and technical concept.

[0072] For example, in the above example, the projection information PD is moved as a trigger when some gesture is made by the passenger 100's hand 101, but this is not limited to this. For example, the projection information PD may be moved without a gesture by the passenger 100's hand 101 if the distance between the passenger 100's hand 101 or belongings and the installed object 20 in the vehicle compartment 21 falls below a predetermined value, or if the passenger 100's hand 101 or belongings overlap with the projection information PD projected onto the installed object 20 in the vehicle compartment 21. In this case, the movement may also occur if the state of the distance being below a predetermined value or the overlapping state continues for a predetermined time or longer. [Explanation of Symbols]

[0073] 1. Projection System 2 vehicles 3. Non-contact sensors 4. Projector (projection unit) 5 speakers 6. Projection control device 20 Installations 21 Cabin 22. Roof (Installed object) 23 Dashboard (Installed Item) 24 Pillars (Installed Objects) 25 Doors (Installed items) 26. Window glass (installed item) 27 Sheets (Installed items) 28 Floor (installation) 29. Headrest (installed item) 30 Handle (Installed object) 70 Control Unit 71 Sensor Information Acquisition Unit 72 State Analysis Unit 73 Movement determination section 74 Output Information Acquisition Unit 75 Projector Control Unit 75a 1st projection section 75b Second projection section 76 Speaker Control Unit 80 Storage section 81 Movement Condition Storage Unit 82 Output Information Storage Unit 90 Internet 100 passengers 100FL Passenger in the front passenger seat 100FR Passenger in the driver's seat 100RL Rear seat passenger on the left side 100RR Rear seat passenger on the right side 101 Hand BG Bag (Possessions) BK Books (personal belongings) MD measurement information PD projection information (prescribed information)

Claims

1. A projection unit installed inside the vehicle, A control unit that controls the projection unit to perform a desired display, A projection system having, The control unit, A first projection process in which predetermined information is projected and displayed by the projection unit onto a first projection area which is the surface of an object installed in the room, After the display of the predetermined information by the first projection process, a movement determination process is performed to determine whether predetermined movement conditions have been met for moving the predetermined information from the first projection area to a second projection area which is the surface of the hand of the passenger in the vehicle inside the room, or an item held by the passenger. If the movement determination process determines that the movement condition has been met, the projection unit moves the predetermined information that was displayed in the first projection area to the second projection area and projects and displays it in the second projection area. Execute, The second projection area can be moved by the passenger. The control unit, After moving the predetermined information to the second projection region, the predetermined information is moved in accordance with the movement of the second projection region. A projection system characterized by the following:

2. The aforementioned movement conditions are: This includes the fact that the distance between the first projection region and the second projection region becomes less than or equal to a predetermined value as the second projection region moves. The projection system according to claim 1, characterized in that it is as described above.

3. The aforementioned movement conditions are: The movement of the second projection region includes the second projection region overlapping the first projection region in the projection direction relative to the first projection region. The projection system according to claim 2, characterized in that it is as described above.

4. The aforementioned movement conditions are: This includes the detection of a predetermined movement instruction operation performed by the aforementioned hand. The projection system according to claim 1, characterized in that it is as described above.

5. The aforementioned movement instruction operation is, Includes an action of pinching the predetermined information displayed in the first projection area, or an action of touching the predetermined information displayed in the first projection area. The projection system according to claim 4, characterized in that it is the same as described in claim 4.

6. The aforementioned movement instruction operation is, This includes an action in which a predetermined number of fingers in the hand are extended, The control unit, in the second projection process, The predetermined information displayed in the first projection area is moved to the second projection area at a location corresponding to the number of extended fingers detected in the movement determination process, and then projected and displayed in the second projection area. The projection system according to claim 4, characterized in that it is the same as described in claim 4.

7. The aforementioned movement instruction operation is, This includes an action in which a predetermined type of finger is extended in the hand, The control unit, in the second projection process, The predetermined information displayed in the first projection area is moved to the second projection area at a location corresponding to the type of extended finger detected in the movement determination process, and then projected and displayed in the second projection area. The projection system according to claim 4, characterized in that it is the same as described in claim 4.

8. The aforementioned movement instruction operation is, The aforementioned hand includes the action of pointing the fingertips in a predetermined direction, The control unit, in the second projection process, The predetermined information displayed in the first projection area is moved to a second projection area corresponding to the direction pointed to by the fingertip detected in the movement determination process, and then projected and displayed in the second projection area. The projection system according to claim 4, characterized in that it is the same as described in claim 4.

9. The aforementioned movement conditions are: This includes the detection of a predetermined movement instruction action performed by the passenger's hand, which is located at a distance greater than a predetermined distance from the first projection area. The projection system according to feature 4.

10. The aforementioned predetermined information is, It is an AI agent controlled by artificial intelligence, which communicates with the passenger and performs predetermined processes based on the passenger's instructions. The projection system according to any one of claims 1 to 9, characterized in that

Images