Vehicle systems and methods of transportation

Abstract

The objective is to provide a vehicle system that can be used in vehicles and enhance the entertainment value for individual occupants. [Solution] The vehicle system S comprises an imaging device 20 that images the occupants and generates an image including the occupants' faces, an image processing device 80 that processes the image generated by the imaging device and generates a processed image, and a display device 30 that displays the processed image generated by the image processing device. The image processing device 80 has a face recognition unit that recognizes the occupants' faces based on the image, and an image processing unit that processes the image by adding virtual objects to the positions corresponding to the occupants' faces recognized by the face recognition unit and generates a processed image. The display device 30 displays the processed image generated by the image processing device 80, divided by occupant.

Description

Technical Field

[0001] The present invention relates to a vehicle system and a vehicle method, and particularly to a vehicle system and a vehicle method including an imaging device, a video processing device, and a display device.

Background Art

[0002] Conventionally, a vehicle system including an imaging device that is used in a vehicle and captures an image of an occupant, a video processing device that processes the image to generate a processed video, and a display device that displays the processed video is known (see, for example, Patent Documents 1 and 2). In the display control system described in Patent Document 1, it is described that a virtual object (effect) such as a character is superimposed on an imaging video of the interior of a vehicle and displayed. Thereby, an attempt is made to provide a comfortable vehicle space for the occupant.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, in vehicle systems such as Patent Documents 1 and 2, there has been a demand for a device capable of enhancing the entertainment value by individual occupants in the vehicle. For example, there has been a demand for a device capable of capturing an image for each occupant, performing processing such as attaching a virtual object to the image of each occupant, and displaying the processed image for each occupant.

[0005] An object of the present invention is to provide a vehicle system and a vehicle method that are used in a vehicle and capable of enhancing the entertainment value by individual occupants. [Means for solving the problem]

[0006] The aforementioned problems are solved by the vehicle system of the present invention, which is a vehicle system used in a vehicle, comprising: an imaging device that images an occupant and generates an image including the occupant's face; an image processing device that processes the image generated by the imaging device and generates a processed image; and a display device that displays the processed image generated by the image processing device, wherein the image processing device has a face recognition unit that recognizes the occupant's face based on the image, and an image processing unit that processes the image by adding virtual objects to the position corresponding to the occupant's face recognized by the face recognition unit and generates the processed image, and the display device displays the processed image generated by the image processing device divided for each occupant. The above configuration makes it possible to realize a vehicle system that enhances the entertainment value for individual passengers within the vehicle. More specifically, this system recognizes the faces of the crew members based on their video footage, adds virtual objects to the video at positions corresponding to the crew members' faces to generate processed video, and can then divide and display the processed video. In other words, it can display the video of each crew member separately, and also display processed video with virtual objects added to each crew member. This can improve the entertainment value for individual crew members.

[0007] In this case, the imaging device comprises a first imaging device and a second imaging device, the first imaging device imaging an occupant seated in a first vehicle seat, the second imaging device imaging an occupant seated in a second vehicle seat located behind the first vehicle seat, the image processing device receiving a selection operation by the occupant and processing the image by adding a predetermined virtual object, generating the processed image for each occupant, and the display device preferably divides and displays the processed image generated for each occupant. With the above configuration, it is possible to accept selection operations from the crew and display processed images with virtual objects preferred by the crew member to each crew member.

[0008] In this case, the vehicle seat comprises a seat body on which an occupant can sit, a movable device for moving part or all of the seat body, and an operation control device for controlling the operation of the movable device, wherein the operation control device controls the operation of the movable device to move the seat body on which a predetermined occupant is seated, based on the type of virtual object included in the processed image. With the above configuration, the seat body in which a predetermined occupant is seated can be operated based on the type of virtual object. In other words, the operation of the seat body associated with the virtual object can be performed automatically. For example, if the virtual object is an image of "the sky," the height of the seat body can be raised (the height adjustment device can be driven).

[0009] In this case, the movable device is a vibration device that provides vibration to an occupant seated in the vehicle seat, and the motion control device controls the operation of the vibration device based on a predetermined virtual object included in the processed image. With the above configuration, when a processed video with a predetermined virtual object attached is selected (displayed), the vibration device in a predetermined vehicle seat can be activated.

[0010] In this case, the system is equipped with a collision detection unit that detects collisions of the vehicles, and the motion control device is configured to prevent the movable device from operating when the collision detection unit detects a collision of the vehicles, regardless of the type of virtual object included in the processed video. With the above configuration, when a vehicle collision is predicted, the operation of the movable device can be stopped regardless of the type of virtual object.

[0011] In this case, the vehicle interior is equipped with an object assignment unit for assigning predetermined virtual objects to the video or processed video of a predetermined occupant, the object assignment unit detects the operation by the occupant and transmits detection data to the video processing device, the video processing device performs processing to assign virtual objects based on the detection data to the video and generates the processed video, or performs processing to change the virtual objects included in the processed video to virtual objects based on the detection data and generates a new processed video, and the display device displays the processed video or the new processed video generated by the video processing device. With the above configuration, an object assignment unit (object assignment sensor) placed in the vehicle's interior can be used to assign a predetermined virtual object (associated virtual object) to one's own video feed. Alternatively, a predetermined virtual object can be assigned to the video feed of another occupant.

[0012] In this case, the object assignment unit is attached to the interior components of the vehicle in multiple locations, and a virtual object corresponding to the attachment location of the interior components of the vehicle is associated with the object assignment unit. When the video processing device receives detection data from the object assignment unit, it performs processing to assign a virtual object corresponding to the attachment location to the video or the processed video, thereby generating the processed video or the new processed video. With the above configuration, by operating the object assignment unit, it is possible to display a processed image with virtual objects assigned according to the installation location. For example, operating the object assignment unit located on the dashboard would ideally assign a virtual object representing a "virtual party." Alternatively, operating the object assignment unit located on the vehicle door would ideally assign a virtual object representing "nature."

[0013] In this case, the system includes an audio acquisition device that acquires the voice of an occupant seated in the vehicle seat, the video processing device has a keyword extraction unit that extracts predetermined keywords based on the occupant's voice obtained by the audio acquisition device, the video processing device performs processing on the video by assigning virtual objects based on the keywords to the video, thereby generating the processed video, or performs processing on the processed video by changing the virtual objects included in the processed video to virtual objects based on the keywords, thereby generating a new processed video, and the display device displays the processed video or the new processed video. With the above configuration, virtual objects based on keywords spoken by the crew can be attached to the crew's video feed. This facilitates communication among the crew.

[0014] In this case, the vehicle seat is provided with an imaging operation unit for operating the imaging device, the imaging device receives the operation of the imaging operation unit by the occupant and generates a captured image by capturing a part of the image or the processed image, and the image processing device has a storage unit for storing the captured image. With the above configuration, for example, it is possible to capture and store images (still images) of when a passenger smiles. Furthermore, since the image capture operation unit is installed on the vehicle seat, the passenger can operate the image capture operation unit while seated.

[0015] In this case, the vehicle is equipped with a driving motion detection unit that detects when the occupant has finished driving the vehicle, and the display device may use the detection data from the driving motion detection unit as a trigger to display the captured video stored in the storage unit. With the above configuration, passengers can review memorable videos (photos) taken inside the vehicle upon arrival at their destination, enhancing the entertainment value. Furthermore, individual passengers can create their own personalized memorable videos.

[0016] Further, according to the vehicle method of the present invention, there is provided a vehicle method used in a vehicle, wherein a computer acquires an image including the face of a passenger generated by an imaging device, processes the obtained image to generate a processed image, and outputs the generated processed image for display. When generating the processed image, the computer recognizes the face of the passenger based on the image, performs a process of adding a virtual object to a position corresponding to the face of the passenger in the image to generate the processed image, and when outputting the processed image, divides and displays the processed image for each passenger on the display screen of a display device, thereby solving the problem.

Advantages of the Invention

[0017] According to the present invention, it is possible to realize a vehicle system capable of enhancing the entertainment of individual passengers in a vehicle. Specifically, it is possible to divide and display the images of passengers for each passenger, and also display a processed image with a virtual object added for each passenger. Further, according to the present invention, it is possible to display, for each passenger, a processed image with a virtual object that the passenger prefers. Further, according to the present invention, based on the type of the virtual object, it is possible to operate the seat body on which a predetermined passenger is seated. For example, it is possible to drive a vibration device in a predetermined vehicle seat. Further, according to the present invention, when a collision of the vehicle is predicted, it is possible to stop the operation of the movable device regardless of the type of the virtual object. Further, according to the present invention, by operating an arbitrary object adding unit, it is possible to display a processed image with a virtual object added according to the attachment position. Further, according to the present invention, it is possible to add a virtual object based on a keyword uttered by a passenger to the image of the passenger. Further, according to the present invention, it is possible to store an image when a passenger smiles as a captured image. Also, it is possible to operate an imaging operation unit in a state where the passenger is seated. Further, according to the present invention, when arriving at a destination, passengers can review memory images (memory photos) in the vehicle.

Brief Description of the Drawings

[0018] [Figure 1] A view showing the interior of a vehicle and explaining a vehicle system. [Figure 2] A perspective view showing an operation terminal (operation unit) provided in an interior part for a vehicle. [Figure 3] A view showing an operation screen of the operation terminal. [Figure 4] A view showing a display screen of a display device. [Figure 5] A block diagram showing the hardware configuration and functions of a vehicle system. [Figure 6] A view showing an example of a display screen of a display device and an example of a seat operation. [Figure 7] A view showing an example of a display screen of a display device and an example of a seat operation. [Figure 8] A side view of a vehicle seat, showing an object change operation unit and an imaging operation unit. [Figure 9] A flowchart showing an example of the processing of a vehicle system. [Figure 10] A view showing the interior of a vehicle and explaining a vehicle system according to a second embodiment.

Embodiments for Carrying Out the Invention

[0019] Hereinafter, embodiments of the present invention will be described with reference to FIGS. 1 to 10. This embodiment relates to a "vehicle system" used in a vehicle and capable of enhancing the entertainment for individual passengers. Note that the "front-rear direction of the vehicle" means the front-rear direction during normal running of the vehicle. The "inner side in the width direction of the vehicle" means the interior side (inside the vehicle) with respect to the vehicle door. The "outer side in the width direction of the vehicle" means the exterior side (outside the vehicle) with respect to the vehicle door.

[0020] As shown in Figures 1 to 5, the vehicle system S is mounted on the vehicle V and captures "images" including the faces of the occupants, processes these images by adding "virtual objects (effects)" to generate "processed images," and displays the processed images for each occupant. Furthermore, the vehicle system S operates part or all of the vehicle seat 1 (seat body 1a) in which the occupant is seated, based on the "virtual objects" added to the images. This system can enhance the entertainment value within the vehicle V, as shown in Figures 6 and 7, for example. Furthermore, the seat configuration of the vehicle seat 1 can be arranged to ensure passenger comfort. The processing of adding virtual objects to the occupant's video allows for the addition of arbitrary virtual objects through selection by the occupant, as well as the addition of virtual objects corresponding to their mounting locations within the vehicle V by operating the object-adding sensor 50 located inside the vehicle V. Then, a "processed video" with the predetermined virtual objects added to the occupant's face video is displayed, and the "operation of the vehicle seat" based on that processed video can be performed in conjunction.

[0021] A "virtual object," also known as an effect, refers to a virtual object that is superimposed and displayed in real space. Virtual objects can take various forms, such as text, icons, characters, or animations. Examples of virtual objects include three-dimensional objects that are stationary in a virtual space, and characters that move according to predetermined rules in a virtual space.

[0022] For example, as shown in Figure 7, the rear seat 1D displays a processed image in which a "virtual object of the sky (clouds)" is added to the occupant's face image. Then, as a "seat operation" based on the "virtual object of the sky," the height device 6 is driven to raise the seat body 1a.

[0023] <Vehicle System Hardware Configuration> The vehicle system S comprises a plurality of vehicle seats 1, each positioned inside the vehicle V, a plurality of imaging devices 20, a display device 30, a plurality of operating terminals 40, a plurality of object-assigning sensors 50, a collision detection sensor 60, a driving motion detection sensor 65, and a control device 70. The control device 70 comprises an image processing device 80 and an operation control device 90. Note that the image processing device 80 and the operation control device 90 may each be independent devices (computers).

[0024] <<Vehicles>> Vehicle V is a vehicle (automobile), as shown in Figure 1. Vehicle V comprises a vehicle floor V1, a vehicle front V2, a vehicle side V3, a vehicle rear V4, and a vehicle roof V5. Furthermore, vehicle V is equipped with a dashboard V6, instrument panel V7, interior panel V8, center cluster V9, and steering wheel V10 in the vehicle front V2. Furthermore, vehicle V is equipped with a vehicle door V11 (door lining V11a) on the vehicle side V3, a center console V12 on the vehicle floor V1, and a rearview mirror V13 on the vehicle roof V5. The vehicle floor V1 has multiple vehicle seats 1 arranged in a row. The center console V12 is positioned between the front seats 1A and 1B. Dashboard V6, instrument panel V7, interior panel V8, center cluster V9, steering wheel V10, vehicle doors V11, center console V12, and rearview mirror V13 are considered "vehicle interior parts".

[0025] The area enclosed by the vehicle floor V1, vehicle front V2, vehicle side V3, vehicle rear V4, and vehicle roof V5 constitutes the "cabin" (interior space) of vehicle V. Occupants will spend their time inside the cabin while vehicle V is in motion. Furthermore, the vehicle battery (onboard battery) is located below the vehicle floor V1. The vehicle battery is electrically connected to the vehicle V's drive system, various electrical devices, control devices, and vehicle seats, and supplies power to these devices.

[0026] Multiple imaging devices 20, a rearview mirror V13, and a display device 30 are fixed to the front part of the vehicle roof V5. Multiple object-assigning sensors 50 are attached to the surfaces of various vehicle interior components V6 to V13. Furthermore, it is preferable that a collision detection sensor 60, a driving motion detection sensor 65, and a control device 70 be arranged inside the center cluster V9.

[0027] As shown in Figure 2, a first movable body V12b and a second movable body V12c are attached to the top surface of the center console V12, and these can be separated from the console body V12a and moved. A first operating terminal 40A, which is operated by occupants seated in the front seats 1A and 1B, is fixed to the first movable body V12b. A second operating terminal 40B, which is operated by occupants seated in the rear seats 1C and 1D, is fixed to the second movable body V12c.

[0028] <<Vehicle Seats>> As shown in Figures 1 and 2, the vehicle seat 1 comprises a front seat 1A (driver's seat), a front seat 1B (passenger seat), a rear seat 1C, and a rear seat 1D. Each vehicle seat 1 comprises a seat body 1a having a seat cushion 2, a seat back 3, and a headrest 4, a rail device 5, a height device 6, a reclining device 7, a vibration device 8, a blower device 9, a sound acquisition device 10, a seating sensor 11, an imaging operation unit 12 (see Figure 8), and an object change operation unit 13 (see Figure 8). The seat cushion 2, seat back 3, and headrest 4 correspond to the "seat body 1a". In addition, the rail device 5, height device 6, reclining device 7, vibration device 8, and blower device 9 correspond to the "movable device".

[0029] As shown in Figures 1 and 2, the seat cushion 2 is a seating portion that supports the occupant from below, and comprises a cushion frame 2a that forms the skeleton, a pad material 2b placed on the cushion frame 2a, and a surface material 2c that covers the cushion frame 2a and the pad material 2b. The seat back 3 is a backrest that supports the occupant from behind, and comprises a back frame 3a that forms the skeleton, a pad material 2b, and a surface material 3c. The headrest 4 is a headrest that supports the occupant's head from the rear, and comprises a pillar 4a which serves as a core material, a pad material 4b, and a surface material 4c. Furthermore, an imaging device and a display device may be attached to the rear surface of the seatback 3 or headrest 4.

[0030] As shown in Figure 1, the rail device 5 is a device that supports the seat body 1a so that it can move back and forth relative to the vehicle floor V1, and is installed between the seat cushion 2 and the vehicle floor V1 in the vertical direction. The rail device 5 is fixed to the vehicle floor V1 and includes left and right lower rails 5a extending in the front-rear direction, left and right upper rails 5b supported so as to be slidable along the lower rails 5a, a locking member that locks the upper rails 5b so as not to slide relative to the lower rails 5a, and a rail operating lever that releases the locked state of the locking member. Seat cushions 2 are attached to the upper surfaces of the left and right upper rails 5b via height adjustment devices 6.

[0031] As shown in Figure 1, the height device 6 is a height link device that raises and lowers the seat cushion 2 relative to the vehicle floor V1, and is installed between the rail device 5 and the seat cushion 2. The height adjustment device 6 comprises left and right first links 6a located on the front side of the seat, left and right second links 6b located on the rear side of the seat, a locking member that locks the seat cushion 2 so that it cannot be raised or lowered, and a height adjustment lever that releases the locked state of the locking member. The height adjustment device 6 can adjust the height of the seat cushion 2, for example, by using the second link 6b as a drive link.

[0032] As shown in Figure 1, the reclining device 7 is a device that rotatably connects the seat back 3 to the seat cushion 2. The reclining device 7 includes a reclining body 7a that is driven when the seat back 3 is rotated, a back rotation shaft 7b, a spiral spring that biases the seat back 3 to rotate forward around the back rotation shaft 7b, and a reclining operation lever (not shown) that releases the locked state of the seat back 3.

[0033] The reclining unit 7a has a locking mechanism that allows the seat back 3 to be switched between a "locked state" in which it is fixed to the seat cushion 2 and an "unlocked state" in which it can rotate relative to the seat cushion 2. The back pivot axis 7b is pivotally supported by the seat cushion 2 and the seat back 3 in the seat width direction. The spiral spring has one end locked to the seat cushion 2 side and the other end locked to the seat back 3 side.

[0034] As shown in Figure 1, the vibration device 8 is a device that provides vibration (stimulation) to an occupant seated in the vehicle seat 1, and is, for example, a vibration motor (unbalanced mass motor). The vibration device 8 is positioned on the surface of the seat cushion 2 and the seat back 3, and operates based on control signals received from the control device 70 (operation control device 90) to deliver vibrations to the occupant.

[0035] As shown in Figure 1, the blower device 9 is a device that blows air towards the occupant seated in the vehicle seat 1. Alternatively, the blower device 9 may be a device that draws air in from the seated side. The blower device 9 is positioned on the surface of the seat cushion 2 and the seat back 3, and operates based on control signals received from the control device 70 (operation control device 90) to blow air onto the occupant. The blower device 9 includes a blower body that supplies air, a duct through which air passes, and an outlet that blows air towards the seated person.

[0036] As shown in Figure 1, the voice acquisition device 10 is a device that acquires the voice of an occupant seated in a vehicle seat 1, and is, for example, a microphone, a voice recorder, etc. The voice acquisition device 10 acquires the voice of the crew, generates "voice data," and transmits the "voice data" to the control device 70. The voice acquisition device 10 is located, for example, on the upper surface of the seat back 3.

[0037] As shown in Figure 1, the seating sensor 11 is a seating detection unit that detects whether an occupant is seated in the vehicle seat 1. The seating sensor 11 is, for example, a pressure sensor, and when it detects that an occupant is seated, it outputs "detection data" to the control device 70. The seating sensor 11 is attached to the surface of the seat cushion 2. The imaging operation unit 12 and the object modification operation unit 13 will be described later.

[0038] <<Imaging device, display device, operating terminal>> As shown in Figure 1, the imaging device 20 is a small camera (wide-angle camera) that captures images of the occupant (occupant's face) seated in the vehicle seat 1. The imaging device 20 captures images of the occupants, generates "video (video data)" including the occupants' faces, and transmits the "video (video data)" to the display device 30. Furthermore, the imaging device 20 may be an imaging camera equipped with AI (artificial intelligence) capable of analyzing and interpreting captured images. The imaging device 20 may also be a 360-degree omnidirectional camera (a camera equipped with a fisheye lens), etc.

[0039] Multiple imaging devices 20 are provided, and they are positioned and oriented to capture images of occupants (the faces of occupants) seated in the front seat 1A, front seat 1B, rear seat 1C, and rear seat 1D, respectively. Specifically, the imaging devices 20A, 20B, 20C, and 20D are each mounted on the front part of the vehicle roof V5, positioned in a location forward and above the front seats 1A and 1B. Imaging devices 20A and 20B correspond to the "first imaging device," and imaging devices 20C and 20D correspond to the "second imaging device." The number and mounting positions of the imaging devices 20 can be changed as appropriate. For example, imaging devices 20C and 20D may be mounted on the rear of the front seats 1A and 1B. In this way, imaging devices 20C and 20D can capture images of occupants seated in the rear seats 1C and 1D from directly in front.

[0040] As shown in Figures 1 and 4, the display device 30 is a device having a display screen that is used by an occupant seated in a vehicle seat 1. The display device 30 has a rectangular display that is elongated in the left-right direction, and is positioned in the center of the vehicle V in the left-right direction, and is positioned in front of the vehicle seats 1A to 1D. The display device 30 displays the "crew member images" generated by the imaging device 20, divided and shown for each crew member. It also displays the "processed crew member images (images with virtual objects attached)" generated by the image processing device 80, divided and shown for each crew member. In other words, the display screen 31 of the display device 30 has multiple display areas 31a, 31b, 31c, and 31d that display images for each occupant. The first display area 31a displays an image of the occupant seated in the front seat 1A.

[0041] As shown in Figure 1, the display device 30 has one display screen, but it may have as many display screens as there are crew members. The display device 30 is fixed to the front of the vehicle roof V5 and positioned directly below the rearview mirror V13, but is not limited to this position. The display device 30 is preferably positioned in front of the vehicle seats 1A to 1D. The display device 30 is positioned directly below the rearview mirror V13, but the rearview mirror V13 may be made unnecessary, and a device that combines the functions of both a display and a rearview mirror may be installed.

[0042] As shown in Figures 1 to 3, the operating terminal 40 is a computer terminal operated by the occupant and is fixed to the front and rear portions of the center console V12. The operation screen 41 of the operation terminal 40 displays a video of the crew member 41a and a list of virtual objects 41b to be attached to the video of the crew member (crew member's face). The system can accept selection operations from the crew through the operation screen 41 of the control terminal 40 and perform processing to assign a virtual object 41b to the video 41a. Specifically, the crew can assign a predetermined virtual object to the crew's video by selecting a predetermined virtual object through the touch panel operation screen 41. In addition to the operation screen 41, the operating terminal 40 may also display the car navigation display screen, the map information display screen, the music selection operation screen, and so on.

[0043] <<Sensor>> As shown in Figure 1, the object-assigning sensor 50 is a sensor (sensor switch) that assigns a predetermined virtual object to the occupant's video, and is attached to the surface of various vehicle interior components. Furthermore, the object assignment sensor is not limited to a sensor type; for example, a switch-type object assignment unit may also be used. The object assignment sensor 50 detects operations performed by the occupants and transmits the detection data to the control device 70 (image processing device 80).

[0044] The object assignment sensor 50 includes a first sensor 51 provided on the dashboard V6, a second sensor 52 provided on the instrument panel V7, a third sensor 53 provided on the interior panel V8, a fourth sensor 54 provided on the center cluster V9, a fifth sensor 55 provided on the vehicle door V11, a sixth sensor 56 provided on the vehicle roof V5, a seventh sensor 57 provided on the side of the seat cushion 2, an eighth sensor 58 provided on the side of the seat back 3, and a ninth sensor 59 provided on the side of the headrest 4. Each of the sensors 51-59 is associated with a virtual object corresponding to the mounting location of the vehicle's interior components (including the vehicle seat 1).

[0045] For example, when the first sensor 51 located on the dashboard V6 is operated, a virtual object representing a "virtual party" is assigned. When the fifth sensor 55 located on the vehicle door V11 is operated, a virtual object representing "nature" is assigned. In addition, when the ninth sensor 59 located on the headrest 4 is operated, a virtual object resembling a "shark costume" is added. As described above, by operating the arbitrary object assignment sensor 50, it is possible to display a processed image with virtual objects assigned according to the installation location.

[0046] The collision detection sensor 60, also called a collision sensor, is a sensor that detects collisions (or precursors to collisions) involving a vehicle V, as shown in Figure 1, and is, for example, an acceleration sensor. The collision detection sensor 60 is mounted inside the vehicle V (center cluster V9) and transmits a detection signal (detection data) to the control device 70 when it detects a collision (or precursor to a collision) involving the vehicle V.

[0047] The driving motion detection sensor 65 is a detection unit that detects when the occupant has finished driving the vehicle V, and is mounted inside the instrument panel V7 or the center cluster V9. The driving motion detection sensor 65 is, for example, an ignition sensor (ignition detection unit) that transmits a detection signal (detection data) to the control device 70 when the occupant removes the key from the ignition cylinder of the vehicle V. Alternatively, the driving motion detection sensor 65 is a sensor that detects the stopping motion of the vehicle V, and when the vehicle V stops for a certain period of time (under predetermined conditions), it considers the driving motion to be complete and transmits a detection signal (detection data) to the control device 70. Alternatively, the driving motion detection sensor 65 may be connected to a navigation system mounted on the vehicle V, and may transmit a detection signal (detection data) to the control device 70 when the vehicle V arrives at its destination.

[0048] <<Control devices (video processing devices, motion control devices)>> As shown in Figures 1 and 5, the control device 70 is a device that comprehensively controls the electrical operation of the vehicle V, and is, for example, an engine control unit (ECU). The control unit 70 is mounted inside the center cluster V9. The control device 70 is connected to the rail device 5, height device 6, reclining device 7, vibration device 8, blower device 9, voice acquisition device 10, seating sensor 11, imaging operation unit 12, object change operation unit 13, imaging device 20, display device 30, operation terminal 40, object assignment sensor 50, collision detection sensor 60, and driving motion detection sensor 65 via an in-vehicle network. Specifically, the control device 70 is a computer equipped with a CPU (processor) as a data calculation and control processing device, ROM and RAM as storage devices, an HDD, and a communication interface for sending and receiving information data via an in-vehicle network.

[0049] The control device 70 combines the functions of the video processing device 80 and the motion control device 90. The image processing device 80 processes the "image" generated by the imaging device 20 and generates a "processed image." Specifically, it accepts selection operations from the crew, processes the "image" by adding predetermined virtual objects, and generates a "processed image" for each crew member. The motion control device 90 controls the operation of the "movable device" to move the seat body 1a in which a predetermined occupant is seated, based on the types of virtual objects included in the "processed image".

[0050] The control device 70's storage device stores a main program that performs the necessary functions of a computer, as well as a "vehicle program" according to this embodiment. The vehicle system S functions when this program is executed by the CPU (processor). In other words, the image processing device 80 stores an "image processing program," and the motion control device 90 stores an "motion control program." These programs are executed by the CPU, thereby enabling the image processing and seat motion control functions to be performed. The following describes some of the functions of the control device 70, which performs overall control, including the functions of the video processing device 80 and the functions of the motion control device 90.

[0051] <Functions of the vehicle system> As shown in Figure 5, the video processing device 80, in terms of its functions, mainly comprises a storage unit 81 for storing various programs and various data, a determination unit 82, a face recognition unit 83, a video processing unit 84, and a keyword extraction unit 85. Functionally, the motion control device 90 mainly consists of a storage unit 91 for storing various programs and data, and a motion control unit 92. These consist of a CPU (processor), ROM, RAM, HDD, communication interface, and various programs.

[0052] The memory unit 81 stores "video data," "processed video data," "virtual object-corresponding data," "keyword-corresponding data," etc. "Video data" is data obtained from the imaging device 20. Both "video data" and "processed video data" are centrally managed and stored. "Virtual object correspondence data" is data that associates the mounting location of the object assignment sensor 50 with the type of virtual object. "Keyword correspondence data" is data that associates keywords spoken by the occupant with the type of virtual object. This correspondence data is also centrally managed and stored. By referring to "virtual object correspondence data," the video processing device 80 can assign a virtual object to the video corresponding to a predetermined object assignment sensor 50 when the occupant operates the sensor 50. Furthermore, by referring to "keyword correspondence data," the device can assign a virtual object to the video corresponding to a keyword spoken by the occupant.

[0053] The determination unit 82 determines whether an occupant is seated in the vehicle seat 1. Specifically, the determination unit 82 acquires "detection data" from the seating sensors 11 provided on seats 1A to 1D and determines whether or not an occupant is seated on seats 1A to 1D based on the "detection data". When the determination unit 82 determines that an occupant is seated in a designated vehicle seat 1, the imaging device 20 corresponding to the designated vehicle seat 1 begins imaging the occupant. The image of the occupant is then displayed on the display device 30. At this time, the display device 30 performs a split display corresponding to the number of occupants.

[0054] The facial recognition unit 83 recognizes the face of the occupant seated in the vehicle seat 1. Specifically, the face recognition unit 83 acquires "video (video data)" captured by the imaging device 20, recognizes the faces of the occupants (shape and structure of the faces) based on the "video data," and acquires "recognition information related to faces." More specifically, the face recognition unit 83 detects positional information of the occupant's facial components and angle information indicating the tilt angle of the head based on the "video data." Then, it acquires recognition information related to the face based on this positional and angle information. This allows for the appropriate processing of video (video data) to assign virtual objects to the positions corresponding to the faces of the occupants. Furthermore, the face recognition unit 83 may recognize the occupant's face (shape and structure of the face) as well as their facial expression and acquire "recognition information related to facial expression." In that case, the video processing device 80 may suggest recommended virtual object candidates based on the occupant's face information and facial expression information. For example, predetermined virtual object candidates may be displayed preferentially at the top of the list information.

[0055] The video processing unit 84 processes the "crew member's video" by adding virtual objects to the positions corresponding to the crew member's face recognized by the face recognition unit 83, thereby generating a "processed video." Specifically, the video processing unit 84 receives selection operations from the crew via the operation terminal 40 (operation screen 41), performs processing to add virtual objects to the video, and generates a processed video. Furthermore, when the video processing unit 84 receives detection data from the object assignment sensor 50, it performs processing to assign a predetermined virtual object based on the "detection data" and "virtual object correspondence data," and generates a processed video.

[0056] The video processing unit 84 generates a processed video (a video with virtual objects added) based on the video of each crew member, and outputs the "processed video (processed video data)". The display device 30 can acquire the "processed video (processed video data)" generated by the video processing unit 84 and display the "processed video" for each occupant.

[0057] The keyword extraction unit 85 extracts predetermined keywords based on the voices of the crew members obtained by the voice acquisition device 10. Specifically, the keyword extraction unit 85 acquires "audio data" from the voice acquisition device 10 and extracts predetermined keywords based on the "audio data" and "keyword correspondence data". The video processing unit 84 acquires the "keywords (keyword data)" extracted by the keyword extraction unit 85. Then, based on the "keywords" and the "keyword-corresponding data," it processes the video of the crew by assigning virtual objects based on the "keywords" to the video, and generates a "processed video." This allows for the assignment of virtual objects based on keywords spoken by the crew, and the display of processed images. As a result, it can promote communication among crew members and enhance the entertainment value.

[0058] The memory unit 91 stores "sheet operation corresponding data," etc. "Sheet operation-related data" is data that associates the type of virtual object with the manner of sheet operation, and is centrally managed and stored. By referring to the "sheet motion data," the motion control device 90 can control the operation of a predetermined movable device based on a predetermined virtual object included in the processed video. For example, as shown in Figure 6, the front seat 1A displays a processed image of the occupant with a "virtual summer object" added to it. The blower device 9 is then driven as a "seat operation" based on the "virtual summer object." The blower device 9 can blow air towards the occupant seated in the front seat 1A. Furthermore, the memory unit 91 may also store "movement amount data" indicating the amount of movement (movement) of the sheet. This allows for control of the amount of movement (strength of the blowing force) of the blower device 9, in addition to operating the blower device 9 based on the virtual object.

[0059] The motion control unit 92 controls the operation of the movable device to move the seat body in which a predetermined occupant is seated, based on the type of virtual object included in the processed image. Specifically, the motion control unit 92 controls the operation of a movable device mounted on a predetermined vehicle seat 1 based on the "processed image (virtual object)" and the "seat motion-corresponding data". The motion control unit 92 may also control the seat body so that, after moving part or all of the seat body from the "reference position (a position in which an occupant can sit)" to the "moved position," it returns to the "reference position" after a predetermined time has elapsed.

[0060] The motion control unit 92 controls the operation of the height adjustment device 6, the reclining device 7, the vibration device 8, and the blower device 9 based on the type of virtual object, for example, as shown in Figures 6 and 7. Below, an example of control by the operation control unit 92 will be explained in detail with reference to Figures 6 and 7.

[0061] <<Specific actions>> Figures 6 and 7 show an example of the display screen and sheet operation of the display device 30, respectively. As shown in Figure 6, in the right front seat 1A (driver's seat), the display screen 31 of the display device 30 shows a processed image of the occupant with a virtual object representing "summer" attached to it. Then, as a "seat operation" based on the "summer virtual object," the blower device 9 mounted on the front seat 1A blows air towards the occupant seated in the seat 1A. In this way, when a crew member feels hot, they can select a "virtual summer object," which will activate the blower device 9 associated with that "virtual summer object."

[0062] As shown in Figure 6, in the right rear seat 1C, the display screen 31 of the display device 30 shows a processed image of the occupant with a virtual object representing "night." Then, as a "seat operation" based on the "night virtual object," the reclining device 7 mounted on the rear seat 1C moves to tilt the seat back 3 backward. In this way, when a crew member feels sleepy, they can select a "virtual night object," which will activate (tilt backward) the reclining device 7 associated with that "virtual night object."

[0063] As shown in Figure 7, in the left front seat 1B (passenger seat), the display screen 31 of the display device 30 shows a processed image of the occupant with a virtual object representing a "party" attached to it. Then, as a "seat operation" based on the "virtual party object," the vibration device 8 mounted on the front seat 1B vibrates the occupant seated in the seat 1B. As shown in Figure 7, in the left rear seat 1D, the display screen 31 of the display device 30 shows a processed image of the occupant with a virtual object representing "emptiness" attached to it. Then, as a "seat operation" based on the "virtual object of emptiness," the height device 6 mounted on the rear seat 1D operates to raise the seat cushion 2.

[0064] In the above configuration, as shown in Figure 8, an imaging operation unit 12 and an object modification operation unit 13 are attached to the outer surface of the vehicle seat 1 (seat cushion 2). Furthermore, the imaging operation unit 12 and the object modification operation unit 13 should be positioned in a location that is easily accessible to the occupant seated in the vehicle seat 1. The imaging operation unit 12 receives an operation from the crew and generates a "captured image" which is a part of the image or processed image displayed on the display device 30. The "captured video" generated by the imaging operation unit 12 is stored in the storage unit 81. This allows, for example, the system to capture and save still images of the moment a passenger smiles. In other words, it can capture and save still images of a specific moment. Furthermore, since the imaging control unit 12 is located on the vehicle seat 1, the passenger can operate the imaging control unit 12 while seated.

[0065] The video processing device 80 may also generate a "movie" by editing together a "captured video" which is a captured portion of the processed video, and the "conversation content" which was recorded at that time. When the vehicle V arrives at its destination, the video processing device 80 may then play the movie through the display device 30 (display screen 31). The video processing device 80 may also output "sound (fictional sound)" corresponding to a predetermined virtual object. For example, it may also output "laughter" to liven up the scene.

[0066] The object modification operation unit 13 receives operations from the crew and modifies the virtual object in the processed image displayed on the display device 30. Specifically, the object change operation unit 13 can accept operations from the crew and switch virtual objects sequentially from the virtual object list. This allows occupants to switch between virtual objects while maintaining their seated position, facilitating smooth communication with other occupants. Furthermore, occupants can switch between virtual objects without taking their eyes off the vehicle V while driving.

[0067] In the above configuration, when the driving motion detection sensor 65 detects that the vehicle V has arrived at its destination, it transmits a "detection signal (detection data)" to the video processing device 80. Then, the video processing device 80 (video processing unit 84) outputs the "captured video" stored in the memory unit 81 to the display device 30. In other words, the display device 30 uses the "detection data" from the driving motion detection sensor 65 as a trigger to display the "captured video" stored in the storage unit 81. This allows passengers to review memorable footage (captured images) from inside the vehicle upon arrival at their destination, enhancing the entertainment value. Individual passenger-specific memorable footage could also be displayed.

[0068] Furthermore, in the above configuration, when the collision detection sensor 60 detects a collision with the vehicle V, the motion control unit 92 controls the movable device so as not to operate, regardless of the type of virtual object included in the processed image. This allows for the emergency shutdown of the movable device, regardless of the type of virtual object, when a collision with vehicle V is predicted.

[0069] In addition, the vehicle system S may perform the following processes: (1) The vehicle seat 1 is equipped with a seat heater, and when a virtual object representing "winter" is displayed, the seat heater may warm the seat body 1a. (2) The video processing device 80 may recognize the smile of the occupant seated in the vehicle seat 1 and perform processing to assign a virtual object based on the occupant's smile.

[0070] (3) When the imaging device 20 captures images of the occupants, the motion control device 90 may operate the movable device. For example, it may adjust the front-to-back position of the seat, the seat height, the reclining angle, and the rotation position of the seat when rotated around an axis in the vertical direction. (4) In addition, when the imaging device 20 captures images of the occupants, the vehicle system S may adjust the light intensity by operating the lighting device mounted on the vehicle V.

[0071] (5) When the right turn signal of vehicle V is activated, the fourth display area 31d (the rightmost area) of the display device 30 (display screen 31) may display an image of the right rear as seen from vehicle V. (6) The display screen used by occupants seated in front seats 1A and 1B may only show the video of occupants seated in rear seats 1C and 1D. Similarly, the display screen used by occupants seated in rear seats 1C and 1D may only show the video of occupants seated in front seats 1A and 1B. (7) A predetermined virtual object may be displayed based on weather information and seasonal information outside of the vehicle V.

[0072] (8) The vehicle system S is equipped with a cover that covers the imaging device 20 from the outside, and it is preferable that map information is displayed on the display device 30 (display screen 31) when the cover covers the imaging device 20. Alternatively, an image (processed image) may be displayed on a part of the display screen 31, and map information may be displayed on the other part of the display screen 31.

[0073] With the above-described vehicle system S, it is possible to enhance the entertainment value for individual occupants within the cabin space of vehicle V.

[0074] <Transportation methods> Next, an example of the processing of a vehicle program (vehicle method) executed by the vehicle system S will be explained based on Figure 9. The program described above in this embodiment is a program that implements the aforementioned determination unit 82, face recognition unit 83, image processing unit 84, keyword extraction unit 85, and motion control unit 92 as functional components of the control device 70 having memory units 81 and 91. The CPU (processor) of the control device 70 executes this vehicle program. The above program is executed, for example, when the system S is started by an operation performed by a crew member (user).

[0075] In the flow shown in Figure 9, the process begins with step S1 (S1), in which the video processing device 80 (determination unit 82) determines whether or not an occupant is seated in the vehicle seat 1. Specifically, the determination unit 82 acquires "detection data" from the seating sensors 11 provided on seats 1A to 1D and determines whether or not an occupant is seated on seats 1A to 1D based on the "detection data".

[0076] If it is determined that an occupant is seated (Step S1: Yes), the process proceeds to Step S2, in which the imaging device 20 begins imaging the occupant and generates video (video data). On the other hand, if it is determined that no occupants are seated (Step S1: No), the process proceeds to Step 7. If at least one occupant is seated in a vehicle seat 1, the other vehicle seats 1 remain in standby mode. When an occupant is seated, the imaging device 20 corresponding to the seat in which the occupant is seated begins imaging.

[0077] In step S3, the display device 30 displays the "crew images" generated by the imaging device 20, divided and shown for each crew member. Specifically, the display screen is as shown in Figure 4. Furthermore, if two occupants are seated in the vehicle seat 1, the display device 30 should split the display screen into two to show the images.

[0078] In step S4, the video processing device 80 (video processing unit 84) determines whether a predetermined virtual object has been selected. If a virtual object is selected (Step S4: Yes), proceed to Step S5. On the other hand, if no virtual object is selected (Step S4: No), return to Step S3, and the display device 30 continues to display the "crew member's image".

[0079] In step S5, the display device 30 divides and displays the "processed image" generated by the image processing unit 84 for each occupant. Specifically, first, the face recognition unit 83 recognizes the face of the occupant seated in the vehicle seat 1. Based on the "occupant's video," the face recognition unit 83 recognizes the occupant's face (shape and structure of the face) and acquires "recognition information related to the face." Then, the video processing unit 84 processes the "crew member's video" by adding virtual objects to the positions corresponding to the crew member's face recognized by the face recognition unit 83, and generates a "processed video". The video processing unit 84 outputs a "processed video (video with virtual objects added)" for each crew member. The display device 30 then acquires the "processed video (processed video data)" and displays the "processed video" on the display screen for each occupant.

[0080] In step S6, the motion control unit 92 operates the movable device of the vehicle seat 1 in which a predetermined occupant is seated, based on the type of virtual object included in the "processed image". Specifically, the motion control unit 92 controls the operation of a movable device mounted on a predetermined vehicle seat 1 based on the "processed image (virtual object)" and the "seat motion-corresponding data". For example, as shown in Figure 6, the front seat 1A displays a processed image in which a "virtual summer object" is added to the occupant's face image. Based on this "virtual summer object," the motion control unit 92 controls the operation of the blower device 9 as a "seat operation." The blower device 9 can blow air towards the occupant.

[0081] In step S7, the video processing device 80 determines whether or not it has received a request to stop the vehicle system S by the occupant's operation. If it has received a request to stop the system S (step S7: Yes), it terminates the process shown in Figure 9. On the other hand, if it has not received a request to stop (step S7: No), it returns to step S1 and repeats the process.

[0082] With the above vehicle program, it is possible to enhance the entertainment value for individual occupants within the cabin space of vehicle V.

[0083] <Vehicle system of the second embodiment> Next, the vehicle system S2 of the second embodiment will be described with reference to Figure 10. Note that explanations that overlap with the aforementioned vehicle system S will be omitted.

[0084] As shown in Figure 10, the vehicle system S2 includes a plurality of vehicle seats 1, a plurality of imaging devices 20, a plurality of display devices 30, a plurality of operating terminals 40, a plurality of object assignment sensors 50, a collision detection sensor 60, a driving motion detection sensor 65, and a control device 70. The control device 70 comprises an image processing device 80 and an operation control device 90.

[0085] Compared to the vehicle system S, the imaging device 20 and display device 30 are positioned directly in front of each vehicle seat 1. In addition, the object-assigning sensor 50 is positioned in a different location. Specifically, the imaging device 20A and display device 30A are located on the handle V10. The imaging device 20B and display device 30B are located on the interior panel V8. The imaging device 20C is preferably positioned behind the headrest 4 of the front seat 1A. The display device 30C is preferably positioned behind the seatback 3 of the front seat 1A. The imaging device 20D is preferably positioned behind the headrest 4 of the front seat 1B. The display device 30D is preferably positioned behind the seatback 3 of the front seat 1B. In this way, the layout of each component can be changed as needed.

[0086] <Other>

[0087] In the above embodiment, a vehicle seat system used in automobiles was described as a specific example, but the vehicle seat system is not particularly limited and can be used not only in trains and buses, but also in airplanes, ships, and other vehicles.

[0088] The above embodiments mainly described a vehicle seat system according to the present invention. However, the embodiments described above are merely examples to facilitate understanding of the present invention and do not limit it. The present invention can be modified and improved without departing from its spirit, and of course, equivalents thereof are included. [Explanation of Symbols]

[0089] V Vehicles V1 Vehicle Floor V2 Vehicle Front V3 Vehicle Side V4 vehicle rear V5 Vehicle Roof V6 Dashboard V7 Instrument Panel V8 Interior Panel V9 Center Cluster V10 Handle V11 Vehicle Door V11a Door Lining V12 Center Console V12a Console Unit V12b 1st movable body V12c 2nd movable body V13 Rearview Mirror S, S2 Vehicle System 1. Vehicle seats (seats for vehicles) 1A Front seat (driver's seat, first-passenger seat) 1B Front seat (passenger seat, first vehicle seat) 1C, 1D Rear seats (second vehicle seats) 1a Sheet body 2 seat cushions 2a Cushion frame 2b Pad material 2c Skin material 3 Seatback 3a Backframe 3b Pad material 3c Skin material 4 headrests 4a Pillar 4b Pad material 4c Skin material 5. Rail device (movable device) 5a Lower Rail 5b Upper Rail 6. Height adjustment device (movable device) 6a First Link 6b Second Link 7. Reclining device (movable device) 7a Reclining chair body 7b Back rotation axis 8 Vibration device 9. Blower device 10. Voice acquisition device 11. Seat sensor (seat detection unit) 12 Imaging control unit 13 Object Modification Operation Section 20 Imaging device 20A, 20B Imaging device (First imaging device) 20C, 20D Imaging device (second imaging device) 30 Display device 30A, 30B, 30C, 30D display device 31 Display screen 31a~31d Display area 40 (40A, 40B) Operating Terminal 41 Operation screen 41a Crew footage 41b List of virtual objects 50 Object assignment sensor (object assignment unit) 51 First Sensor 52 Second Sensor 53 Third Sensor 54. Fourth Sensor 55 Fifth Sensor 56. Sensor No. 6 57. Sensor No. 7 58. Sensor No. 8 59. Sensor No. 9 60. Collision detection sensor (collision detection unit) 65. Operation detection sensor 70 Control device 80 Video Processing Device 81 Storage section 82 Judgment section 83 Face Recognition Unit 84. Video Processing Department 85 Keyword Extraction Unit 90. Operation control device 91 Memory section 92 Operation Control Unit

Claims

1. A vehicle system used in vehicles, An imaging device that captures images of the crew and generates images including the faces of the crew, An image processing device that processes the image generated by the imaging device and generates a processed image, The system includes a display device that displays the processed image generated by the image processing device, The aforementioned video processing device is A face recognition unit that recognizes the face of the crew member based on the aforementioned video, The system includes a video processing unit that processes the aforementioned video by adding virtual objects to the positions corresponding to the faces of the occupants recognized by the face recognition unit, thereby generating the processed video. The vehicle system is characterized in that the display device divides and displays the processed image generated by the image processing device for each occupant.

2. The imaging device comprises a first imaging device and a second imaging device. The first imaging device captures images of an occupant seated in a first vehicle seat, The second imaging device captures images of an occupant seated in a second vehicle seat located behind the first vehicle seat. The video processing device receives a selection operation by the occupant, performs processing to add a predetermined virtual object to the video, and generates the processed video for each occupant. The vehicle system according to claim 1, characterized in that the display device divides and displays the processed video generated for each occupant.

3. A vehicle seat comprising a seat body in which an occupant can sit, and a movable device for moving part or all of the seat body, The movable device comprises an operation control device for controlling the operation of the movable device, The vehicle system according to claim 2, characterized in that the motion control device controls the operation of the movable device to move the seat body in which a predetermined occupant is seated, based on the type of virtual object included in the processed image.

4. The movable device is a vibration device that applies vibration to an occupant seated in the vehicle seat, The vehicle system according to claim 3, characterized in that the motion control device controls the operation of the vibration device based on a predetermined virtual object included in the processed image.

5. It includes a collision detection unit that detects collisions of the aforementioned vehicles, The vehicle system according to claim 3, characterized in that the motion control device, when the collision detection unit detects a collision of the vehicle, controls the movable device not to operate, regardless of the type of virtual object included in the processed image.

6. Attached to the interior components of the vehicle, and comprising an object assignment unit for assigning a predetermined virtual object to the image or processed image of a predetermined occupant, The object assignment unit detects the operation performed by the occupant and transmits the detection data to the video processing device. The aforementioned video processing device is The image is processed by adding virtual objects based on the detected data to the image, thereby generating the processed image, or The processed video is modified to change the virtual objects contained in the processed video to virtual objects based on the detected data, thereby generating a new processed video. The vehicle system according to any one of claims 1 to 5, characterized in that the display device displays the processed image or the new processed image generated by the image processing device.

7. Multiple object-attaching units are attached to the interior components of the vehicle. The object assignment unit is associated with a virtual object corresponding to the mounting location of the vehicle's interior components. The vehicle system according to claim 6, characterized in that when the image processing device receives detection data from the object assignment unit, it performs processing to assign virtual objects corresponding to the attachment location to the image or the processed image, and generates the processed image or the new processed image.

8. The vehicle is equipped with a voice acquisition device that acquires the voice of an occupant seated in the aforementioned vehicle seat, The video processing device has a keyword extraction unit that extracts predetermined keywords based on the voice of the occupant obtained by the voice acquisition device, The aforementioned video processing device is The process involves assigning virtual objects based on the keywords to the aforementioned video, thereby generating the processed video, or, The processed video is modified to change the virtual objects contained in the processed video to virtual objects based on the keywords, thereby generating a new processed video. The vehicle system according to any one of claims 1 to 5, characterized in that the display device displays the processed image or the newly processed image.

9. It is provided on the seat of a vehicle and includes an imaging operation unit for operating the imaging device, The imaging device receives an operation of the imaging operation unit by the crew member and generates a captured image which is a part of the video or the processed video. The vehicle system according to any one of claims 1 to 5, characterized in that the video processing device has a storage unit for storing the captured video.

10. The vehicle is equipped with a driving operation detection unit that detects when the occupant has finished driving the vehicle, The vehicle system according to claim 9, characterized in that the display device displays the captured video stored in the storage unit as a trigger for the detection data from the driving motion detection unit.

11. A method of transportation used for vehicles, Computers Acquiring images, including the faces of the crew members, generated by the imaging device, The obtained video is processed to generate a processed video, The process of outputting the generated processed video for display, and In generating the aforementioned processed video, Based on the aforementioned video, the face of the crew member is recognized, The process involves adding virtual objects to the aforementioned video at positions corresponding to the faces of the occupants, thereby generating the processed video. A vehicle method characterized in that, when outputting the processed video, the processed video is divided and displayed on the display screen of the display device for each occupant.

Images