Automobile

The installation of door path video cameras and a rear seat space control unit addresses the challenge of rear seat passengers safely viewing the door path, ensuring safe door opening by providing a clear view and automatic locking in unsafe conditions.

JP2024164670APending Publication Date: 2024-11-27YKS IP EVALUATION INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
JP2023080328
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-15
Publication Date
2024-11-27

AI Technical Summary

Technical Problem

Passengers in the rear seats of vehicles face difficulty in safely checking the area behind the door when opening it, as the rear view displayed on the driver's seat display is obstructed by the seat or display, and existing rear cameras only show the view when the vehicle is reversing, not when stopped.

Method used

Installation of door path video cameras on the left and right sides of the vehicle, a rear display between the rear seat and the front seat, and a rear seat space control unit that manages the display and other functions to provide a clear view of the door path and ensure safety when opening the rear door.

Benefits of technology

Enables passengers to safely open the rear door without awkward positioning, with the system locking the door if unsafe conditions are detected, enhancing rear seat passenger safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024164670000001_ABST
    Figure 2024164670000001_ABST
Patent Text Reader

Abstract

To enable confirmation of safety to be performed easily when an occupant in a back seat of an automobile gets out a vehicle.SOLUTION: An automobile includes: door route video cameras 0101, 0102 that acquire a video of an existence allowable region of a movable body whose door direction movement is hindered by a door if the door is opened, in order to enable a person seating on a back seat to easily check a rearward video 0104 of a door side surface so as to be able to check whether there is a movable body that may collide with the door even when the door of the back seat is opened 0103; and a rear display 0105 that enables an occupant of the back seat to easily check the video.SELECTED DRAWING: Figure 1A
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] This invention relates to the technology of a car equipped with a camera and display for the rear seats that makes it easy to check for safety when opening the rear doors, and a car equipped with an information system that can control the door opening operation by automatically performing this safety check. [Background technology]

[0002] If the display that shows the rear view is located for the first row of seats in a car and has the function of showing the rear view even when the car is stopped, the person sitting in the driver's seat or passenger seat can view the rear view of their car by switching the image on the display to the rear view. [Prior art documents] [Non-patent literature]

[0003] CarNext article: Backup cameras are now mandatory! When will they be required? Is it necessary to install them later? (cmgroup.jp / column / 11387 / ) Summary of the Invention [Problem to be solved by the invention]

[0004] However, even if it were possible, it would be cumbersome to switch the display installed in the driver's seat to a rear view image when the vehicle is stopped.

[0005] Non-Patent Document 1 states that rearview cameras will become mandatory, but the purpose of installing a rearview camera is to allow the driver to recognize hazards behind the vehicle when backing up. In other words, the image is used solely for backing up, and is primarily used to view the road surface behind the vehicle through the rear window. With this image, it was difficult to determine the position of the open door in the image when the vehicle's door was opened. Therefore, the image from the rearview camera is basically displayed when the vehicle is backing up, but cannot be used when the vehicle is stopped. Even if the image displays the view behind the vehicle when stopped, there are problems with viewing the driver's seat display from the back seat, such as being obstructed by the seat or a display located on the seat. Therefore, in this invention, cameras are placed on the left and right sides of the vehicle, and a display is installed in the rear seat space so that the view behind the seat door can be seen when the vehicle is stopped, making it possible for passengers to check for safety when opening the rear door without having to turn around or assume an awkward position. [Means for solving the problem]

[0006] As a first invention, a door path image camera is provided on each of the left and right sides of a vehicle body, which captures door path images including images of an area where the path is obstructed by an open door when a rear door of the second or subsequent row of a vehicle having two or more rows of seats is opened; a rear display that is arranged in a space between a rear seat corresponding to the rear door and the back of the seat in front of the rear seat (including the back and the rear door), and that displays a door path image corresponding to each seat so that it can be seen by a person sitting in the rear seat; a rear seat space control unit that controls the rear display and also controls one or more of the rear doors, rear seats, temperature control devices, rear seat lighting, and AV devices; To provide a vehicle having the above.

[0007] As a second invention, based on the first invention, there is provided a vehicle in which the door path imaging cameras are provided on the left and right front doors or the left and right front fenders.

[0008] As a third invention, based on either the first or second invention, a vehicle is provided in which the rear display is installed on a center pillar corresponding to the rear door or seat used by passengers in the rear seats to get in and out.

[0009] As a fourth invention, based on any one of the first to third inventions, there is provided a vehicle further having an exit possibility determination unit that determines whether passengers (regardless of the seat they are sitting in) are able to exit the vehicle, and the rear seat space control unit displays a door path image on the rear display when the exit possibility determination unit determines that passengers are able to exit the vehicle.

[0010] As a fifth invention, based on any one of the first to fourth inventions, a new boarding determination unit is provided for determining whether a person sitting in a seat has disembarked and a new person is to board the seat,

[0011] The rear seat space control unit has an on-board image control means that, when the new passenger determination unit determines that a seated person has disembarked and a new passenger will take that seat, displays one or more of an icon, button, or switch that receives a control command to the rear seat space control unit on the rear display corresponding to the seat determined by the new passenger determination unit.

[0012] As a sixth invention, based on any one of the first to fifth inventions, there is provided a vehicle in which the door path image camera has a door rear image acquisition means for acquiring, as the door path image, a door rear image that is an image including at least a portion of the outer surface of the rear door corresponding to the rear seat and a rear image that is an image behind the rear door.

[0013] As a seventh invention, based on any one of the first to sixth inventions, the rear seat space control unit includes door lock means for locking the door from opening, door unlock means for unlocking the door, unlock lock means for locking the door from being unlocked, unlock validity determination means for determining whether door unlocking is valid or invalid based on the door path image, and door lock control means for controlling the door to be unlocked when the unlock validity determination means determines that the door is valid, and for controlling the door not to be unlocked when the unlocking is invalid; The present invention provides a vehicle further comprising:

[0014] As an eighth invention, based on any one of the first to seventh inventions, there is provided a vehicle in which the rear seat space control unit has an opening angle control means for controlling the possible opening angle of the door based on a door path image.

[0015] As a ninth invention, based on the eighth invention, there is provided a vehicle having a door opening / closing motor that opens and closes the door, the door opening / closing motor being configured to open the door in accordance with the opening angle control means.

[0016] As a tenth aspect of the present invention, there is provided a method for operating a computer that constitutes the front or part of each of the first to ninth aspects of the present invention, and an operating program that can be read by the computer. The operating program may also be recorded on a recording medium.

[0017] It should be noted that the above-mentioned components are not necessarily limited to being housed in a single housing. [Effects of the Invention]

[0018] By solving the above problems, passengers in the back seats do not have to strain their bodies to see what is behind them when getting out of the car, and can open the door after confirming that it is safe. If the car determines that it is not safe, the door will remain locked. [Brief explanation of the drawings]

[0019] [Figure 1A] Conceptual diagram showing the overall outline of the first embodiment of the invention [Figure 1B] A conceptual diagram showing the rear display of the first embodiment of the present invention. [Figure 1C] FIG. 1 shows the position where the door path video camera of the first embodiment is installed at the rear. [Figure 1D] Conceptual diagram of an application of an electronic door mirror in the first embodiment of the present invention [Figure 1E] 1 is a diagram illustrating computer hardware according to the first embodiment of the present invention. [Figure 2] FIG. 1 is a diagram showing an example of a door path image according to the first embodiment of the present invention. [Figure 3] Functional block diagram of the invention according to embodiment 1 [Figure 4] Flowchart of the invention according to the first embodiment [Figure 5] Functional block diagram of the invention according to the fourth embodiment [Figure 6A] Flowchart of the invention according to the fourth embodiment [Figure 6B] FIG. 4 is a diagram illustrating computer hardware according to the fourth embodiment of the present invention. [Figure 7] Functional block diagram of the invention according to embodiment 5 [Figure 8A] Operation flowchart of the invention according to the fifth embodiment [Figure 8B] FIG. 5 is a diagram illustrating computer hardware according to the fifth embodiment of the present invention. [Figure 9A] Functional block diagram of the invention according to the sixth embodiment [Figure 9B] 6 is a diagram illustrating computer hardware according to the sixth embodiment of the present invention. [Figure 10] Functional block diagram of the invention according to embodiment 7 [Figure 11A] Operation flowchart of the invention according to the seventh embodiment [Figure 11B] FIG. 7 is a diagram illustrating computer hardware according to the seventh embodiment of the present invention. [Figure 12] Functional block diagram of the invention according to embodiment 8 [Figure 13A] Flowchart of the invention according to embodiment 8 [Figure 13B] FIG. 8 is a diagram illustrating computer hardware according to the eighth embodiment of the present invention. [Figure 14A] Functional block diagram of the invention according to embodiment 9 [Figure 14B] 9 is a diagram illustrating computer hardware according to the ninth embodiment of the present invention. [Figure 15] A basic conceptual diagram of computer hardware for providing a preliminary explanation of the computers used in the inventions shown in Embodiments 1 to 9. DETAILED DESCRIPTION OF THE INVENTION

[0020] <Prerequisites for the explanation of all embodiments>

[0021] <Hardware that can constitute the present invention>

[0022] While the present invention is essentially an invention that utilizes a computer, it is also realized, at least in part, by software, hardware, or the collaboration of software and hardware. In this case, the software uses hardware resources to perform various calculations and realize various functions through the data and information required. It can be said that information processing by software is specifically realized using hardware resources. Furthermore, since the present invention is an invention of an automobile, it is in principle equipped with the hardware and software that make up the automobile.

[0023] The hardware and software used in the present invention basically include a door path video camera, a rear seat corresponding to the rear door, a rear display, and a rear seat space control unit that controls the rear display and one or more of the rear door, rear seat, temperature control device, rear seat lighting, and AV device. The hardware and software may also include either an exit availability determination unit that determines whether passengers (regardless of the seat they are sitting in) are able to exit the vehicle, or a new passenger determination unit that determines whether a passenger has exited a seat and a new passenger is taking that seat. The rear seat space control unit may also be configured to include an entry video control means.

[0024] The door path video camera may be configured to include a door rear video acquisition means for acquiring a door rear video, which is a video including an outer surface of the rear door corresponding to the rear seat and a rear video, which is a video of the area behind the rear door, as the door path video. In some cases, the door path video camera may be equipped with a wide-angle lens or a fisheye lens.

[0025] The rear seat space control unit may be configured to have door lock means for locking the door from opening, door unlock means for unlocking the door, unlock lock means for locking the door from being unlocked, unlock validity determination means for determining whether door unlocking is valid or invalid based on the door path image, and door lock control means for controlling the door to be unlocked when the unlock validity determination means determines that the door is valid, and for controlling the door not to be unlocked when the unlocking is determined to be invalid.

[0026] The rear seat space control unit may be configured to include an opening angle control unit that controls the possible opening angle of the door based on the door path image. The rear seat space control unit may further include a door opening / closing motor that opens and closes the door, and the door opening / closing motor (mainly a stepping motor) may be configured to open the door in accordance with the opening angle control unit. The stepping motor may also be configured to rotate a gear with the door support shaft as its central axis via a reducer (such as a harmonic drive).

[0027] The invention in question is an automobile, and therefore includes the basic components of an automobile. A simple explanation is as follows:

[0028] Engine: The power source that drives a vehicle. Engine types include gasoline engines, diesel engines, electric motors, and hybrid engines. Note that vehicles driven by electric motors can obtain power from secondary batteries or fuel cells.

[0029] Transmission: The mechanism used to transmit power from the engine to the wheels. Generally, the transmission is called a gearbox and regulates the vehicle's speed and engine RPM.

[0030] Suspension: A system that supports the wheels and absorbs bumps and shocks in the road. The suspension includes coil springs, dampers, arms, etc.

[0031] Brakes: A system used to stop a vehicle. When you press the brake pedal, the brake pads press against the tires, bringing the wheels to a halt.

[0032] Steering: A system for operating a vehicle in which the front wheels move left and right by turning the steering wheel.

[0033] Body: This is the part that forms the exterior of a car and is made of materials such as steel plate, aluminum, and carbon fiber. The body has openings such as doors, a hood, and a trunk.

[0034] Windows: There are front windows, rear windows, door windows, etc. In principle, door windows can be moved up and down.

[0035] The control unit includes the following control units:

[0036] Engine Control Unit (ECU): A control device that controls the engine's fuel injection, ignition, valve timing, etc. The ECU receives signals from sensors and adjusts the amount of fuel, airflow, etc. to optimize engine operation.

[0037] Transmission Control Unit (TCU): A control device that controls a vehicle's transmission. The TCU selects optimal shift points based on engine RPM, vehicle speed, and driver input.

[0038] Brake Control Unit (BCU): A control device that controls the brakes of an automobile. The BCU is equipped with safety functions such as ABS (Anti-lock Braking System) and EBD (Electronic Brakeforce Distribution), and prevents the tires from locking up during sudden braking, safely controlling the vehicle.

[0039] Steering Control Unit (SCU): A control device that controls the steering of a vehicle. The SCU controls steering force based on the vehicle speed and vehicle behavior, allowing the driver to precisely control the vehicle.

[0040] Airbag Control Unit (ACU): A control device that controls the airbags in a vehicle. The ACU receives signals from collision detection sensors and deploys the airbags at the appropriate time to ensure the safety of the driver and passengers.

[0041] The following equipment is also provided:

[0042] Battery: A device that provides the power needed to start a vehicle's electrical system. The battery powers the starter to start the vehicle's engine.

[0043] Generator: A device that generates electricity while the engine is running in order to charge the battery. The generator effectively charges the battery and provides power to run the vehicle's various electrical devices.

[0044] Starter: A device required to start a vehicle's engine. The starter receives power from the battery and helps start the engine.

[0045] Ignition System: This is a device necessary for the engine to start properly. The ignition system sends a spark to the spark plug, providing the ignition needed to combust the fuel-air mixture.

[0046] Lighting devices: Vehicle lights such as headlights, taillights, and turn signals.

[0047] Furthermore, the following configurations may be provided for automatic driving or automatic driving assistance, and these may be configured to cooperate with the present invention, particularly from the viewpoint of ensuring safety.

[0048] Camera: Used to monitor the environment around the automobile. The camera detects objects and obstacles around the vehicle and, in combination with an infrared sensor or laser scanner, can track the obstacles. The door path video camera of the present invention may be included in this camera.

[0049] Sensors: Sensors are used to measure the environment around the vehicle. There are a wide variety of sensors, from GPS sensors to receive radio waves from the Michibiki satellite to measure the vehicle's speed, position, and orientation, to ultrasonic sensors to measure the distance and speed of objects. Radar may also be used. In the case of autonomous vehicles and autonomous driving assistance vehicles, radar is primarily used to detect surrounding vehicles, pedestrians, and obstacles. Radar plays an important role in enhancing the safety of autonomous vehicles, as it can accurately detect obstacles even when there are obstacles in the field of view and in bad weather such as rain and fog.

[0050] Because radar uses high frequencies, it can detect obstacles in the field of view and is capable of accurate detection even at night, independent of the brightness of the surrounding light. Radar detection is generally used in combination with camera detection, including the camera of this invention, and is one of the sensors essential for achieving more advanced autonomous driving and safety when exiting a vehicle.

[0051] Generally, vehicles are equipped with two radars, either one at the front or one at the front and one at the rear. These radars are used to monitor the surrounding environment and are one of the essential sensors for ensuring autonomous driving functions and safe exiting of the vehicle. As described above, not only camera radars including the camera of the present invention, but also radars, ultrasonic sensors, LiDAR, and other sensors complement each other and integrate information obtained from multiple sources, making it possible to achieve more advanced autonomous driving and safer exiting of the vehicle.

[0052] These sensors may cooperate with the rear seat space control unit of the present invention, particularly the door lock and door opening / closing functions.

[0053] Lidar: Lidar is used to automatically control vehicle speed, steering, and other operations. Lidar in autonomous vehicles includes automatic braking, automatic steering, and automatic acceleration. Lidar may also be configured to work with the rear seat space control unit of the present invention to ensure safety.

[0054] Maps: Maps are used to provide information about the terrain and roads around the vehicle. Self-driving cars can use digital maps to recognize road lanes, intersections, traffic lights, and other important terrain information.

[0055] Computers: The autonomous driving systems of self-driving cars require sophisticated computer systems that collect information from sensors, integrate it with map information, and control the autonomous lidar to ensure safe autonomous driving.

[0056] It is also convenient to have the following facilities in the rear seat space:

[0057] Air conditioning and heating: Some cars come with air conditioning and heating in the rear seats, allowing rear seat passengers to set the temperature to their liking and stay comfortable.

[0058] Entertainment systems: Some vehicles are equipped with rear-seat entertainment systems, such as LCD displays and DVD players, to keep you entertained even on long journeys.

[0059] USB ports and power outlets: Some cars have USB ports and power outlets in the backseat, allowing you to charge and use devices like smartphones and tablets.

[0060] Folding table: Some vehicles have a folding table in the back seat, which allows you to eat, work, etc.

[0061] Heated seats: Some cars come with heated seats in the back, helping passengers stay warm in cold weather.

[0062] Ceiling-mounted glove compartment: Some vehicles have a ceiling-mounted glove compartment, which allows rear seat passengers to store small items.

[0063] In addition, the vehicle may be equipped with a refrigerator, a warming cabinet, an aroma device, a back or foot massager, an ottoman, a computer, a navigation device, automatic curtains, a sunshade, a satellite phone, an emergency food storage area, an umbrella storage area, a foldable spare seat, an electric partition between the seat and the driver's seat, a communication device between the seat and the driver's seat, an internet connection device, etc.

[0064] The navigation system is as follows:

[0065] An automobile navigation system is a technology that provides drivers with route guidance and map information. It generally consists of the following elements:

[0066] GPS (Global Positioning System): The navigation system communicates with the GPS satellite network to obtain current location information. GPS receives signals from satellites and can accurately determine the vehicle's location. Note that GPS and Michibiki satellite location information can be used together, or location information from Michibiki satellites alone can be used.

[0067] Map Database: The navigation system incorporates a pre-collected map database, which contains information on roads, intersections, points of interest (tourist attractions, gas stations, restaurants, etc.), etc. In particular, the map database of the navigation system of the present invention preferably includes data on areas where passengers can disembark, as well as areas where disembarkation is not suitable or possible.

[0068] Route planning: A navigation system plans the best route to reach your destination. Based on your current location and destination, it selects the best roads and intersections from a map database to create your route. Typically, it may offer different route options, such as the fastest route, the shortest route, or one that avoids highways.

[0069] Voice Guidance: The navigation system provides audible directions to the driver while driving, providing information such as upcoming turns and estimated arrival times at destinations, helping the driver stay focused on the road without relying on visual cues.

[0070] Traffic information: Many navigation systems provide real-time traffic information, including information on congestion, accidents, road construction, etc., and take this information into account when planning your route to select the best route.

[0071] Additional Features: Navigation systems have many options for additional features, which may include parking locations and prices, weather forecasts, gas station price comparisons, and more.

[0072] These navigation functions provide the following convenience:

[0073] Accurate directions: Navigation systems use accurate location and map data to guide you, helping you arrive at your destination without getting lost, reducing stress and confusion while driving.

[0074] Route optimization: The navigation system helps save time and fuel by planning the optimal route, taking into account real-time traffic and road conditions and suggesting routes that avoid congestion and construction areas.

[0075] Improved road safety: Navigation systems help reduce the risk of road accidents. Accurate guidance and advance road information promote safer driving by reducing sudden turns and lane changes.

[0076] Point of Interest (POI) Information: The navigation system includes POI information such as gas stations, restaurants, and hotels, making it easy to find the locations of facilities and services around your destination, enhancing your travel and daily life.

[0077] Stay focused with voice guidance: The navigation system provides voice guidance, allowing drivers to keep their attention on the road without relying on visual cues, improving alertness while driving and reducing the risk of accidents.

[0078] The hardware that realizes all or part of the above-mentioned constituent elements (referring to parts) of the present invention is composed of the basic components of a computer, such as a CPU, memory, bus, input / output devices, various peripheral devices, and user interfaces. The various peripheral devices may include storage devices, internet interfaces, internet devices, LAN devices, Wifi (registered trademark) devices, displays, display interfaces, keyboards, mice, speakers, microphones, cameras, videos, televisions, CD devices, DVD devices, Blu-ray devices, USB memory, USB memory interfaces, removable hard disks, general hard disks, projector devices, SSDs, telephones, fax machines, copy machines, printers, movie editing devices, and various sensor devices.

[0079] Furthermore, this system does not necessarily have to be configured from a single unit, but may be configured by connecting multiple units through communication. Communication may be via LAN, WAN, Wi-Fi (registered trademark), Bluetooth (registered trademark), infrared communication, ultrasonic communication, near field communication (NFC), or a mobile phone network, and some of the systems may be installed across national borders.

[0080] <Fulfillment of the Laws of Nature in All Embodiments of the Present Invention>

[0081] The present invention is equipped with the basic components of a car and functions in cooperation with a computer and software. From this perspective, if we judge the resources of the present invention, such as a computer, based on the matters described in the claims and specification and the common general knowledge related to those matters, the present invention is deemed to utilize the laws of nature.

[0082] <Applicant's understanding of the significance of utilizing the laws of nature required by patent law>

[0083] The Patent Act requires that an invention be industrially applicable and contribute to the development of industry. This requirement ensures that the invention is industrially applicable. In other words, the invention must be industrially useful; that is, the effects of the invention declared in the patent application must be reproducible with a certain degree of certainty through the practice of the invention. From this perspective, the application of a law of nature is interpreted as the use of a law of nature to achieve the functions of each of the invention's defining features (invention elements) that constitute the invention. Furthermore, the effect of an invention is determined solely by the possibility of providing a specific utility to users of the invention, rather than by how users perceive or think about that utility. Therefore, even if the benefits of the electricity billing system for consumers who purchase and consume electricity, suppliers who sell and supply electricity to consumers, and those involved in the system's operation and management are psychological (e.g., peace of mind), these effects themselves are not considered when determining whether the invention has the required law of nature.

[0084] <Hardware configuration>

[0085] 15 shows the basic configuration of a computer used to perform calculations in the present invention. However, instead of adopting the configuration of a general-purpose computer, a computer may be designed as a dedicated computer.

[0086] As shown in this diagram, the computer is comprised of a motherboard containing a chipset, CPU, non-volatile memory, main memory, various buses, a BIOS (or UEFI), various peripheral devices and communication line connection interfaces such as USB and LAN, a real-time clock, and expansion cards such as a graphics card. These components operate in conjunction with an operating system, device drivers (for various interfaces such as USB, cameras, microphones, speakers or headphones, displays, and other built-in devices), and various programs. The various programs and data constituting the present invention are configured to efficiently utilize these hardware resources to execute various processes, using input signals from a keyboard or mouse connected via a USB terminal (or PS / 2 port). The computer is connected to the Internet via a LAN terminal or other means. The Internet connection may also be established using Wi-Fi (registered trademark) or via a mobile phone network.

[0087] The following describes the main components that make up a computer as hardware, but the present invention is not limited to these examples.

[0088] Chipset

[0089] A "chipset" is a set of large-scale integrated circuits (LSIs) mounted on a computer motherboard that integrates a bridge function, i.e., a communication function between the CPU's external bus and a standard bus that connects the motherboard to nonvolatile memory and peripheral devices. Traditionally, chipsets consisted of two chips: a northbridge connected to the CPU and performing high-speed processing, such as between the main memory and a graphics card equipped with a graphics processing unit (GPU), and a southbridge connected to the northbridge and performing processing between relatively slower interfaces. In recent years, the northbridge function has been integrated into the CPU, leaving only the former southbridge, but the term "chipset" continues to be used. This specification describes a single-chip configuration consisting of only the southbridge, with the northbridge function built into the CPU. The benefits of the present invention remain the same whether the two-chip configuration (northbridge and southbridge) described above is used or if there is no chipset with the southbridge function integrated into the CPU.

[0090] (Southbridge) When the chipset is a single chip, the southbridge handles I / O functions such as PCI Express interfaces (slots), SATA (Serial ATA) or eSATA interfaces, USB interfaces, LAN (Ethernet) interfaces, and real-time clocks, as well as sound functions. When the chipset is a single chip, it is responsible for controlling interfaces such as displays, external connections like USB and LAN ports, SATA for connecting to HDDs and SSDs, and PCI Express, and is connected to the CPU via a point-to-point hardware interface (such as DMI: Direct Media Interface). Some chips support RAID (Redundant Arrays of Inexpensive Disks, a technology that allows multiple HDDs to be recognized and displayed as a single drive) for non-volatile memory (such as HDDs). In addition, to support devices that are less commonly used in recent years and where high-speed operation is not required or possible, such as PS / 2 ports, floppy disk drives, serial ports such as RS-232C, parallel ports such as IEEE1284 for printers, and ISA buses, a separate LSI called a super I / O chip is used, which connects to the south bridge via a low pin count bus.

[0091] Bus

[0092] There are two types of buses: parallel buses and serial buses. A parallel bus provides signal lines for the number of bits and transmits data synchronized with a clock. A dedicated line for the clock signal is set up in parallel with the data line, and data demodulation is synchronized on the receiving side. A serial bus transfers data one bit at a time. Buses are used to connect the CPU (MPU) to peripheral devices and various control units on the motherboard. While internal buses connect the CPU core to cache memory and other components within the CPU, buses connecting the CPU to external memory and other components are called external buses. The external bus connecting the CPU's built-in memory controller to main memory is a 64-bit parallel bus, for example, in the case of a DDR4-3200 memory standard, which uses DDR4-SDRAM (Double-Data-Rate 4 Synchronous Dynamic Random Access Memory). For example, a DDR4-3200 memory standard provides a bandwidth of 25.6 GB / s (maximum memory operating frequency 3200 MHz x 64 (bit) bus width ÷ 8 (bit to byte conversion). The connection between the CPU and southbridge uses a point-to-point connection such as DMI (Direct Media Interface), as mentioned above. External expansion buses such as PCI Express and SATA are connected by chipsets. Parallel buses include GPIB, IDE / (parallel) ATA, SCSI, and PCI. A serial bus transfers data one bit at a time. Because there is a limit to how fast it can be, PCI Express, an improved version of PCI, uses point-to-point wiring and a serial transfer method. USB and SATA also transfer data serially.

[0093] CPU

[0094] The CPU sequentially reads, interprets, and executes a sequence of instructions called a program stored in main memory, outputting signal information to the main memory. The CPU functions as the center of calculations within a computer. The CPU consists of the CPU core, which is the center of calculations, and its peripheral components, including registers, cache memory (primary, secondary, and tertiary), an internal bus connecting the cache memory to the CPU core, a memory controller, a timer, and an interface with the bus connecting to the south bridge. If the CPU has integrated graphics functionality (GPU), the interface also includes a graphics interface and an internal bus connecting to the CPU core. If an external graphics board is used with a CPU with a built-in GPU, it is connected to the CPU's built-in graphics interface (such as PCI Express). Note that a single CPU (chip) may have multiple CPU cores. The embodiments are described as being of a two-core type, but this is not limiting. A configuration having multiple CPU chips is also possible. A program can also be embedded in the CPU.

[0095] <Non-volatile memory>

[0096] (HDD)

[0097] The basic structure of a hard disk drive consists of a magnetic disk, a magnetic head, and an arm on which the magnetic head is mounted. External interfaces include SATA (formerly ATA) and SAS (Serial Attached SCSI, formerly SCSI). HDD interfaces are broadly divided into the aforementioned ATA and SCSI types. ATA systems send data unilaterally to the physically connected device and, because they rely on the BIOS (or UEFI) on the motherboard, constantly require CPU processing time. SCSI systems send data accurately while checking the status of the connected device and, because the HDD has a control system built into it, reduce CPU load. ATA systems are inexpensive and have large capacities, while SCSI systems, developed from systems for servers, excel in speed and scalability. Their ability to process SCSI commands in a multi-threaded manner ensures high reliability even under high-load environments.

[0098] HDDs have an excellent cost per unit of capacity, but as mentioned above, they contain moving parts, which means that access takes time and there is a concern of mechanical failure. Therefore, for server equipment that requires high reliability, RAID can be used to distribute reading and writing to multiple HDDs simultaneously, or to write the same file to multiple HDDs.

[0099] (flash memory)

[0100] Currently, two types of flash memory are commonly used: NAND flash memory and NOR flash memory. While there are pros and cons to read / write speeds, NAND flash memory is more advantageous for high integration and is used for data storage purposes. Compared to hard disk drives, NOR flash memory has no moving parts, making it smaller and generating no vibration or noise during operation. However, the cost per unit capacity has not yet fallen to the point where it can replace hard disk drives.

[0101] Although it is more expensive than a hard disk drive, it has the advantage of allowing for smaller devices and being more resistant to shocks. Smartphones and mobile information terminals usually have a built-in data storage capacity of around 64GB to 256GB, so flash memory is used to make them smaller and lighter. In PCs and other devices, solid-state drives (SSDs) made of flash memory are increasingly being used for frequently accessed drives that store the operating system and application software.

[0102] <Main memory>

[0103] The CPU directly accesses and executes various programs in main memory. Main memory is volatile memory and uses DRAM. Programs in main memory are expanded from non-volatile memory to main memory upon receiving a program startup command. The CPU then executes the program according to various execution commands and execution procedures within the program.

[0104] Operating System (OS)

[0105] An operating system is used to manage computer resources for use by applications, to manage various device drivers, and to manage the computer itself (the hardware). In small computers, firmware is sometimes used as the operating system.

[0106] ≪UEFI≫

[0107] In recent years, the Unified Extensible Firmware Interface (UEFI), which serves a similar purpose as an evolved successor to the previously used BIOS, has come into use. Like the BIOS, the UEFI is stored in flash ROM and installed on the motherboard. The flash ROM chip containing the UEFI instructs the CPU to execute procedures for starting up the computer hardware and running the operating system, and is most typically the first piece of hardware the CPU reads when it receives a boot command. This contains the address of the operating system stored on disk (non-volatile memory), and the UEFI loaded into the CPU sequentially loads the operating system into main memory, making it operational.

[0108] The UEFI also has a function to check the presence or absence of various devices connected to the bus. The results of the check are stored in main memory and made available to the operating system as appropriate. The UEFI may also be configured to check for external devices.

[0109] As shown in the figure, the present invention can basically be configured with a general-purpose computer program and various devices. The computer basically operates by loading a program recorded in non-volatile memory into main memory, and then executing processing using the main memory, CPU, and various devices. Communication with devices is performed via an interface connected to a bus line. Possible interfaces include a display interface, USB, LAN terminal, PCI Express interface, and communication buffer.

[0110] Each functional block constituting the present invention can be realized by hardware, software, or both. Specifically, in the case of a computer, examples include hardware components such as a CPU, main memory, GPU, image memory, graphic board, bus, or secondary storage device (non-volatile memory such as a hard disk or flash memory, storage media such as CDs or DVDs, and read drives for those media), input devices such as operation buttons used for information input, a mouse, a touch panel, an electronic pen used solely for touching a touch panel, a joystick or a joystick-like pointer position input device, and other external peripheral devices, as well as interfaces for those external peripheral devices, communication interfaces such as a LAN terminal, a GPS receiving interface, a GPS computing unit, a gyro sensor, an acceleration sensor, a rotation detection sensor, signal processing devices for these sensors, a camera, an image file processing circuit, a speaker, a microphone, an audio file processing circuit, communication interfaces, a barcode reader, an electronic card reader, a POS terminal, a face authentication device, an encryption device, a fingerprint authentication device, a palm print authentication device, a retina authentication device, and other biometric authentication devices, as well as driver programs and other application programs for controlling those hardware.

[0111] In particular, it uses smartphones, tablet devices, mobile phones, smartwatches, personal computers, data center server equipment, wired and wireless networks and interfaces, etc.

[0112] The CPU performs arithmetic processing in accordance with the program deployed in main memory, processing and storing data input from input devices and other interfaces and held in memory or hardware, and generating instructions for controlling the hardware and software. The program may be realized as multiple modularized programs, or may be realized as a single program by combining two or more programs.

[0113] The present invention can also be partially configured as software, and storage media on which such software is recorded are naturally included within the technical scope of the present invention (this applies not only to this embodiment but also throughout the entire specification).

[0114] <Terminology used in the present invention>

[0115] "Identification information" refers to symbols, letters, codes, etc. used to identify something. However, the identification information itself may be the information being identified. For example, the identification information that identifies character string record A may be character string record A itself.

[0116] The term "association" is used herein to mean not only a case where two or more pieces of information are directly associated, but also a case where two or more pieces of information are indirectly associated via one or more other pieces of information. Indirect association is not necessarily limited to association within one device (a device with a single housing), but also includes association across multiple devices.

[0117] "Based on" includes both cases where it is based on the object itself and cases where it is based on the object after some processing has been performed on it.

[0118] "Automobile" is limited to automobiles that have at least rear seats behind the driver's seat. It is also assumed that each rear seat is equipped with a door. Rear seats do not exclude those with rear seats in the third row or beyond. There are no particular restrictions on the type of door. Hinged door (normal door): A door attached with a normal hinge, used in most automobiles. Sliding door: A door used in vehicles such as vans and minivans, which opens and closes by sliding sideways. Gullwing door: A door with a unique opening and closing method that opens upwards, used in luxury cars and sports cars. Doors other than these are also acceptable.

[0119] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0120] <Embodiment 1>

[0121] <Embodiment 1 Overview Mainly Claim 1>

[0122] The automobile of embodiment 1 is equipped with a camera and a display so that, particularly when a passenger sitting in the rear seat of the automobile opens the door to get out, they can easily see cars, motorcycles, bicycles, people, etc. approaching from behind the door toward the door.

[0123] <Functional Configuration of Embodiment 1>

[0124] FIG. 1A shows the overall concept of the invention of embodiment 1.

[0125] The above conceptual diagram is merely an example for implementing the present invention, and functions may be omitted or new functions may be added as appropriate within the scope that does not contradict the problems to be overcome by the present invention and its effects. The same applies to the following explanations of embodiment 1 and subsequent embodiments. FIG. 3 shows the configuration of an automobile 0300 of embodiment 1 as functional blocks. The functional blocks include door path video cameras 0301a, 0301b, rear displays 0302a, 0302b, rear doors, rear seats, temperature control devices, AV devices, rear seat lighting, and other control target devices 0303 in the rear seat space, and a rear seat space control unit 0304 for controlling these devices.

[0126] <Configuration of Embodiment 1>

[0127] As shown in FIG. 1A, the automobile of the first embodiment has a door path video camera 0101, a rear display 0105, and a rear seat space control unit (not shown).

[0128] <Embodiment 1: Door path video camera>

[0129] The "door path video camera" is a camera 0101, 0102 installed on each side of the vehicle body, which captures door path video including video of the area 0104 where the path is obstructed by the open door when the rear door of the second or subsequent row of a vehicle with two or more rows of seats is opened 0103. Therefore, since there is usually only one rear camera that captures the rear of the vehicle through the rear window from inside the vehicle, it does not fall under the category of cameras installed on each side as referred to in this invention. The door path video is in principle a real-time video.

[0130] The reason for the phrase "installed on each side of the car body" is that the images corresponding to the left and right doors of the car are shown to the passengers in the back seat. Images taken through the rear window of a car generally do not show the left and right sides of the car, which makes it difficult to know which part of the image to pay attention to in relation to the open door.

[0131] "Specific camera installation location"

[0132] Specific camera installation locations include where door mirrors were previously installed, or on the door or door visor. In locations where door mirrors were previously installed, the top, bottom, or side of the glass holder that holds the door mirror glass are possible locations. Furthermore, in vehicles equipped with camera-type door mirrors, these cameras could also be used for other purposes. When installing the camera on the door, it can also be installed on the door handle, the door sash, or the garnish that frames the door glass.

[0133] <Embodiment 1 Door Path Video Camera Figure 1A>

[0134] 1 is a diagram showing the angle of view 0104 of a door path video camera. In the figure, a door path video camera 0101 placed in the position of a conventional door mirror is configured to have an angle of view 0104 that views the outermost edge of the limit opening angle or planned opening position 0103 when the door is opened. A real-time door path video image of the door path video camera at the angle of view 0104 is displayed on a rear display 0105 in the rear seat. The door path video cameras are configured to include a door path video camera 0101 on the right side of the vehicle in the direction of travel, as well as a door path video camera 0102 on the left side in the direction of travel.

[0135] <Embodiment 1 Door Path Video Camera Figure 1C>

[0136] As shown in Fig. 1C, door path video cameras C0301 and C0302 may be installed near the rear window inside the vehicle. In this case, it is preferable to use a wide-angle camera, and it is preferable to configure the camera so that only the image portion of the rear window inside the vehicle with an angle of view corresponding to the door path video is cut out and displayed on the rear display as the door path video. Furthermore, it is preferable that the door path video camera can capture not only video through the rear window but also video through the door windows of the rear doors, and it is preferable to position the camera so that it can capture so-called blind spots of the vehicle.

[0137] Furthermore, even when the door path video camera captures video through the rear window, it is preferable to configure it so that it can simultaneously capture video through the left and right rear passenger windows. The video thus captured is preferably configured so that the video through the right rear passenger window is displayed to passengers sitting in the rear seats on the right side of the vehicle, and similarly, the video through the left rear passenger window is displayed to passengers sitting in the left seat.

[0138] The combined image of the rear window and the rear passenger window also includes the image of the back pillar behind the rear seats. The door path camera may be a fisheye camera mounted on the ceiling above the center armrest of the rear seats. The fisheye camera images may be digitally processed and displayed on the displays for the right-seat passenger, the left-seat passenger, and the driver, who sees the entire rear view.

[0139] It is preferable to display the image on a driver's seat display that can be seen from the driver's seat so that the image of the rear of the vehicle, including the blind spot, can be confirmed from the driver's seat. A camera that can capture such images is thought to use a camera that uses a fisheye lens.

[0140] <Embodiment 1 Rear Display>

[0141] The "rear display" is placed in the space between the rear seat corresponding to the rear door and the back of the seat in front of the rear seat (including the back and the rear door), and is configured to display door path images corresponding to each seat so that they can be seen by people sitting in the rear seat.

[0142] The "space between the rear seat corresponding to the rear door and the back of the seat in front of this rear seat" is divided into left and right spaces corresponding to the rear seats. The space corresponding to the right seat is the right space, and the space corresponding to the left seat is the left space. This space also includes the back of the front row seats and the rear doors corresponding to each seat.

[0143] As shown in FIG. 1, when the rear display 0105 is installed on the back side of the front row seats, it may be a display that is shared with one or more of the following functions: watching television, browsing the Internet, and watching and operating car navigation.

[0144] In that case, as in the embodiment corresponding to claim 4, it is preferable to configure the system so that, when it becomes possible to disembark, the door path image is output by forcibly interrupting the screens for watching television, browsing the Internet, and viewing and operating the car navigation system.

[0145] <Embodiment 1 Rear Display Figure 1B>

[0146] As shown in FIG. 1B, the rear display may be provided on the inner side of the door on which the corresponding door path image is displayed. As an example, as shown in FIG. 1B, the rear display B0201 may be provided in the armrest. It may also be provided separately from the armrest, for example, near the door handle (door lever, door opener). When the rear display is provided in the door, it is preferable to position the display screen facing the area where the face of the passenger sitting in the corresponding seat is located. This is particularly true when the display is a liquid crystal display (LCD), as it is preferable that the line of sight coincides with the normal direction of the display. The rear display may be configured to include two types of rear displays: a rear display B0201 provided on the armrest or the like as shown in FIG. 1B, and the aforementioned shared rear display B0202 provided on the back of the front seat B0204. The operation of these two types of displays may be switched using a steering panel or the like provided in part of the center armrest B0205 of the front seat.

[0147] <Embodiment 1 Overall layout of the display (Fig. 1D)>

[0148] Figure 1D is a diagram showing the overall layout of displays, including the rear display. A door path video camera D0503 is mounted integrally with the door mirror D0501 on the right side of the vehicle, and the video of the door path on the right side of the vehicle can be displayed on the rear display D0508 on the right side of the rear seat, as well as on the driver's seat display D0505 on the right side of the driver's seat. For example, in a vehicle such as a taxi where the rear door can be opened and closed from the driver's seat, the driver can check the door path video from the driver's seat and confirm safety before opening or closing the rear door.

[0149] A door path video camera D0504 is also installed on the left side of the vehicle, and the video of the door path on the left side of the vehicle is displayed on the rear display D0507 of the left rear seat and on the passenger seat display D0506. This configuration makes it possible to confirm safety before opening and closing the doors of not only the rear seats but also the first row seats.

[0150] <Embodiment 1: Rear seat space control unit>

[0151] The "rear seat space control unit" is configured to control the rear display and also to control one or more of the rear doors, rear seats, temperature control device, rear seat lighting, and AV device. <Embodiment 1: Rear seat space control unit, rear display control>

[0152] The essential control of the "rear seat space control unit" is the control of the rear display. In particular, it is to display the door path image obtained from the door path image camera on the rear display in real time when necessary. The displayed image may be digitally processed to mark objects that require attention. Typical examples of objects that require attention include objects approaching from behind the vehicle, such as other vehicles, motorcycles, bicycles, carts, and people. The rear space control unit may be configured to perform image analysis of the door path image, recognize other approaching vehicles, motorcycles, bicycles, carts, people, etc., and provide audio guidance such as "A vehicle is approaching the right door from behind."

[0153] <Embodiment 1: Rear seat space control unit, rear door control>

[0154] "Rear door control" can be configured to control the automatic opening and closing of the door using a motor, as described below, in addition to locking the rear doors. It can also be configured to control the deployment of airbags from the doors, the up and down movement of the door windows, the shading of the door windows using LCDs, the curtain control of the door windows, the angle and height control of the door armrests, and so on. The system can be configured to display the reception of these control inputs and the control status on the rear display.

[0155] <Embodiment 1: Rear seat space control unit: Rear seat control>

[0156] The "rear seat control" can be configured to include rear seat reclining control, rear seat heater control, back massage control for rear seat occupants, rear seat foot rest control, rear seat armrest height control, angle control, beverage storage temperature control provided in the rear seat, etc. The system can be configured to display these control inputs and control status indications on the rear display.

[0157] <Embodiment 1: Rear seat space control unit: Temperature control device control>

[0158] "Temperature control device control" can be configured to control temperature, humidity, temperature-controlled airflow, type and strength of fragrance, etc. These control inputs and control status can be displayed on the rear display.

[0159] <Embodiment 1: Rear seat space control unit: Rear seat lighting control>

[0160] "Rear seat lighting control" can be configured to control the lighting provided in the rear seats. The lighting may include practical lighting for reading and the like, as well as decorative lighting. Decorative lighting includes decorative lighting on the ceiling of the rear seats, and decorative lighting placed on the doors and backs of the front seats. Specifically, this includes LED rods, LED tapes, organic EL rods, organic EL tapes, etc. that emit various colors. The system can be configured to accept these control inputs and display the control status on the rear display.

[0161] <Embodiment 1: Rear seat space control unit: AV device control>

[0162] "AV device control" is configured to be able to control AV devices inside a vehicle. The AV device may be a dedicated device, such as a device dedicated to the left or right side of the rear seat, or it may be an AV device for the entire vehicle. The AV device may be a music-only device or a video device. If it is dedicated to a seat, the audio can be heard through headphones. Control targets may include content selection, sound volume adjustment, picture quality adjustment, display viewing angle adjustment, etc. These control inputs and control status indications can be configured to be displayed on the rear display.

[0163] <Embodiment 1: Rear seat space control unit and others>

[0164] In addition, a movable shield can be installed between the driver's seat and the rear seat, and this can be controlled. Furthermore, it can be configured to control car telephones and internet connections. The internet connection can be controlled to periodically obtain information on road conditions leading to the destination and parking lot conditions around the destination. The system can be configured to display these control inputs and control status on the rear display.

[0165] <Embodiment 1: Control Computer (Hardware)>

[0166] 1E is a hardware conceptual diagram of a computer for controlling the door path video camera, rear display, and rear seat space control unit of embodiment 1. As shown in this diagram, a door path video camera control program, a rear display control program, and a rear seat space control program are recorded in nonvolatile memory, and door path video data is also recorded. When the computer is started, the programs in the nonvolatile memory are copied to the main memory and executed.

[0167] Furthermore, when a door path image is acquired by the door path image camera control program that is running, it is configured to be recorded as data in the data recording area of ​​the main memory. However, once a passenger gets off the vehicle, the doors are closed, and the passenger is no longer seated in the seat, there is less need to process the image, so it is preferably configured to be transferred to non-volatile memory and the image data in the main memory is erased, in order to make effective use of the main memory space.

[0168] <Processing flow of embodiment 1>

[0169] <Embodiment 1 Processing Flow Overview>

[0170] The door path video camera, rear display, and rear seat space control unit, which are the components of the first embodiment, are driven by a computer.

[0171] <Explanation of processing flow in embodiment 1>

[0172] The first embodiment is processed by a computer in the following steps.

[0173] As shown in FIG. 4, a computer installed in the automobile processes the following steps: a door path image camera driving step 0401 provided on each of the left and right sides of the automobile body for obtaining door path images including an image of an area in which the path is obstructed by the open door when the rear door of the second or subsequent row of an automobile having two or more rows of seats is opened; and a rear display driving step 0402 provided in the space between the rear seat corresponding to the rear door and the back of the seat in front of the rear seat (including the back and the rear door) for displaying the door path images corresponding to each seat so that they can be seen by a person sitting in the rear seat.

[0174] In addition, the rear seat space control step 0403, which controls the rear display and also controls one or more of the rear doors, rear seats, temperature control device, rear seat lighting, and AV device, may be configured to be processed by a computer also installed in the automobile.

[0175] <Effects of Embodiment 1>

[0176] In the first embodiment, even rear seat passengers can easily check for safety behind the side of the door when getting out of the vehicle without having to unfasten their seat belts and look back, thereby improving the safety of rear seat passengers when getting out of the vehicle.

[0177] <Embodiment 2 mainly relates to claim 2>

[0178] <Outline of Embodiment 2>

[0179] This embodiment is based on the first embodiment, and the door path imaging cameras are provided on the left and right front doors or the left and right front fenders of the automobile.

[0180] <Configuration of Embodiment 2>

[0181] The configuration of the second embodiment is basically the same as that of the first embodiment, and the automobile of the second embodiment has a door path video camera, a rear display, and a rear seat space control unit. However, the placement position of the door path video camera is limited to an optimal position. The explanation of the components that have already been explained will be omitted.

[0182] <Embodiment 2 Door Path Video Camera: Installed on the Left and Right Front Doors>

[0183] The path imaging camera may be installed in the left and right front doors. A typical example of the left and right front doors is where conventional door mirrors are installed. In practice, the door mirrors may be replaced with electronic side mirrors, or the path imaging camera may be used in combination with the electronic side mirrors.

[0184] <Embodiment 2: Door path video cameras: installed on the left and right front fenders>

[0185] The path imaging camera may be installed on the left and right front fenders. A typical example of installing it on the left and right front fenders is a position where, when the left and right doors of the first row on the driver's side are opened, the rear of the vehicle can be viewed from the space created between the open door and the vehicle body (front pillar). If it is installed on the door, the view of the path imaging will change when the front door is opened, but if it is installed on the left and right front fenders, this can be avoided.

[0186] <Embodiment 2 Others>

[0187] The path imaging cameras may be mounted on the left and right front pillars near the roof of the vehicle, or on the center pillar near the roof of the vehicle, or on both. It is preferable that the path imaging cameras have a wide angle of view.

[0188] <Effects of Embodiment 2>

[0189] When the installation position of the door path video camera is determined as in embodiment 2, the door path video camera is installed in a position that is easily visible from the driver's seat, so even if the door path video camera is located on the left or right side of the vehicle, it is easy to avoid collision with an obstacle.

[0190] <Embodiment 3, mainly relating to claim 3>

[0191] <Outline of Embodiment 3>

[0192] Embodiment 3 is based on embodiment 1 or embodiment 2, and is an automobile in which the rear display is installed on the interior side of the rear door used by passengers sitting in the rear seats to get in and out, or on the interior side of the center pillar corresponding to the seat. <Configuration of Embodiment 3>

[0193] The automobile of the third embodiment basically has the same configuration as the first and second embodiments. That is, the automobile of this embodiment has a door path video camera, a rear display, and a rear seat space control unit. However, in this embodiment, the position of the rear display has been optimized. Explanation of the components that have already been explained will be omitted. <Configuration of Third Embodiment>

[0194] The door path image should be visible to people exiting the vehicle without them even thinking about it. People exiting the vehicle naturally look towards the door that they must open in order to exit. Therefore, one possible location for the rear display is the door armrest or its surrounding area. Door armrests have a structure that people can grab when opening or closing the door. For example, a door pocket. When people try to open a door, they put their hand in the door pocket, and at that time their eyes naturally move to the area around the door armrest. If the rear display is located on the path of this eye movement, the door path image will be visible without them even thinking about it, allowing them to check for safety without even thinking about it.

[0195] Therefore, it is preferable to tilt the front end of the upper surface of the door armrest upward and place the rear display on that tilted surface. In this case, when the rear display is to display an input screen for controlling one or more of the rear doors, rear seats, climate control device, rear seat lighting, and AV device as described above, the rear display will be at the tip of the driver's hand when the driver places their arm on the door armrest, which improves operability.

[0196] Another candidate for placing the rear display is the center pillar inside the vehicle, corresponding to the door used for exiting the vehicle. When a person exiting the vehicle, their eyes naturally first turn in the direction the vehicle is moving, but as they exit, their gaze gradually moves toward the window of the door that they will be opening. When moving their gaze from the front to the window on their side, their gaze naturally passes over the center pillar inside the vehicle. Therefore, without even realizing it, their gaze passes over the rear display mounted on the center pillar, and they can check the image of the door path to ensure safety.

[0197] As shown in Figure 1B, from the above perspectives, it is preferable that the rear display B0201 be installed on the door armrest of the door that the seated person uses to exit the vehicle, or on the center pillar corresponding to that door. Furthermore, in this case, the shape of the rear display is such that the door path image is intended to focus attention particularly on the area extending to the rear of the vehicle, so more information is required in the vertical direction of the screen, rather than the horizontal direction. Therefore, it is preferable that the rear display screen be a portrait-oriented screen as seen by the seated person. Specifically, it is considered preferable that the horizontal:vertical aspect ratio be approximately 1:2 to 1:3. However, it is not limited to this, and it can be approximately 1:4. The screen is preferably an LCD display or an organic EL display with touch panel functionality.

[0198] It is also convenient to configure the rear display so that it can be attached and detached from the door armrest or center pillar. This is because it is convenient to be able to place it closer to the driver when complex inputs are required using the rear display's touch panel function. Furthermore, to prevent the left and right rear displays from being swapped, if the rear display is detachable, it must be possible to return the removed rear display only to the correct position. This is particularly necessary when communication between the rear display and the vehicle is wireless rather than wired.

[0199] <Effects of Embodiment 3>

[0200] When the rear display is installed in the position as in embodiment 3, the line of sight of rear seat passengers when they exit the vehicle is positioned on the line of sight of the passengers when they exit the vehicle, so that the passengers can naturally check the screen of the rear display without being particularly conscious of it, which has the effect of allowing them to check the rear display naturally.

[0201] <Embodiment 4 mainly relates to claim 4>

[0202] <Outline of Embodiment 4>

[0203] Embodiment 4 is based on any one of embodiments 1 to 3, and further includes an alighting possibility determination unit that determines whether passengers (regardless of the seat they are sitting in) are able to alight, and the rear seat space control unit displays a door path image on the rear display when the alighting possibility determination unit determines that passengers are able to alight.

[0204] <Configuration of Embodiment 4>

[0205] The configuration of the automobile of embodiment 4 is basically the same as that of embodiments 1, 2, and 3, and as shown in Fig. 5, the automobile of this embodiment has door path video cameras 0501a and 0501b, rear displays 0502a and 0502b, and a rear seat space control unit 0504 (prerequisite: a controlled device 0503 in the rear seat space). However, a distinctive feature of this embodiment is that it further has an exit possibility determination unit 0505, and the rear seat space control unit is configured to operate in accordance with the determination result. Descriptions of components that have already been explained will be omitted.

[0206] <Configuration of Embodiment 4>

[0207] <Embodiment 4: Exit possibility determination unit>

[0208] The "disembarkation possibility determination unit" is configured to determine whether passengers (regardless of the seat they are sitting in) are able to disembark. A situation in which passengers are able to disembark can be considered when a moving vehicle has come to a stop. However, in order to distinguish this from a parked state, it is necessary to distinguish between a state in which a vehicle was moving with passengers present and a stopped state. In the future, when satellite Michibiki and other systems begin full-scale operation, the vehicle's computer (disembarkation possibility determination unit) will be able to recognize the vehicle's own position to an accuracy of several centimeters, which will enable it to determine whether a stopped vehicle is at a location due to a traffic light or because of congestion, making it possible to more accurately determine whether it is possible to disembark.

[0209] Although there is some positional error, this can also be configured to make the determination using current GPS satellites. For example, it is conceivable to embed information on the navigation map that distinguishes between areas where disembarking is permitted and areas where it is not, and have the vehicle determine in which area it is stopped. In particular, in the case of autonomous driving, when the driver is absent and only passengers who are unable to adequately judge their own safety, such as young children, are on board, it is conceivable to determine whether disembarking is permitted based on position information from satellites such as Michibiki and GPS satellites, information on areas where disembarking is permitted and areas where disembarking is not permitted on the navigation map, and door path images, and to configure the vehicle to automatically open the doors.

[0210] It is also possible to configure the system to make this determination by searching for door path images on Google Street View (registered trademark) and determining the vehicle's location. If the exit possibility determination unit is configured to determine whether exiting is possible by also using door path images, it may be possible to determine whether exiting is possible separately for the left and right doors. This is because there may be cases where it is determined that there is an approaching moving object at one door but not at the other. It is also possible to configure the system so that the doors will not open unless the exit possibility determination unit determines that exiting is possible.

[0211] Furthermore, it is preferable to configure the vehicle so that functions such as temperature control within the vehicle do not stop when it is not determined that the vehicle is ready to exit, to prevent children or other persons from suffering from heatstroke if left behind inside the vehicle. The difference in function between the exit possibility determination unit and the release validity determination unit described below is that the exit possibility determination unit determines whether the vehicle is in a stopped state where it is ready to exit, but does not have the function to determine whether it is safe to open the door, whereas the release validity determination unit determines whether it is ready to exit and whether it is safe to open the door.

[0212] <Embodiment 4: Additional Function of Rear Seat Space Control Unit>

[0213] The "rear seat space control unit" is configured to display the door path image on the rear display when the exit possibility determination unit determines that exit is permitted. This is because checking the door path image is necessary only when it is determined that exit is permitted. Therefore, at other times, it is preferable that the rear display display, as described above, buttons, icons, switches, etc. for receiving input to control one or more of the rear doors, rear seats, climate control device, rear seat lighting, and AV device using the rear seat space control unit, and be in a state where control commands can be received via touch panel input.

[0214] Other standby screens may also be used. If a rear display is installed on the back of the front seats and can be used for broadcasting television, displaying navigation maps, or working on a computer, the driver may select one of these functions and the display may be set according to the selection. The computer may be located on the back of the front seats and configured as a table that can be used by tilting it upside down around the table support shaft. Alternatively, the computer may be stored in the rear seat center console and can be pulled out and deployed like an airplane table.

[0215] Alternatively, the table may be box-shaped, with a lid on the surface that can be removed (sliding or rotating) to reveal a keyboard. This keyboard is preferably configured to function as a wireless keyboard for a laptop computer brought in. If the rear display is also used for dual-purpose applications as described above, it is also preferably configured to be usable via a rear display that can wirelessly connect to a laptop computer brought in. While the personal computer in this case primarily refers to a laptop computer carried by the passenger, it may also be configured to communicate over the Internet with a company computer or cloud storage area that is permanently installed in the vehicle and stores the passenger's necessary data.

[0216] <Embodiment 4: Conceptual diagram of computer (hardware)>

[0217] 6B is a conceptual diagram of a computer according to this embodiment. In addition to the basic configuration shown in embodiment 1, this embodiment is characterized by the fact that a dismounting permission determination program is recorded in nonvolatile memory, and when the computer is started, this program is copied to main memory and executed. In addition, data for determining whether dismounting is permitted is recorded in nonvolatile memory or main memory as dismounting permission determination data.

[0218] <Processing flow of embodiment 4>

[0219] The flow of processing by the computer in the fourth embodiment is as follows. As shown in FIG. 6A, it is assumed that two processes of embodiment 1 (door path video camera drive step 0601, rear display drive step 0602) have been executed. It may also be assumed that a rear seat space control step has been executed. An automobile deceleration detection step 0603 is executed to constantly detect whether the automobile has decelerated, and when the automobile begins to decelerate toward a stop, the computer performs processing to detect the deceleration. This is the basic detection step. Then, when the automobile stops, an automobile stop detection step 0604, which is processing to detect the stopping of the automobile, is executed. Furthermore, an exit possibility determination processing step 0605 is executed to determine whether passengers (regardless of the seat they are sitting in) are able to exit the automobile. Whether exit is possible is determined by performing the processing described in the exit possibility determination unit.

[0220] It is preferable that the rear display displays a screen for accepting rear seat space control commands until it is determined that it is possible to exit the vehicle. Icons, buttons, switches, etc. are displayed on the touch panel, and the door path image is not displayed as a general rule. Then, once it is determined that it is possible to exit the vehicle, a process is performed to display the door path image on the rear display. In this case, icons, buttons, switches, etc. are not displayed as a general rule, but icons, buttons, switches, etc. for accepting commands to open the door motors and commands to unlock the doors may also be displayed. Finally, an exit determination step 0607 is executed to determine whether the passengers have exited the vehicle.

[0221] <Effects of Embodiment 4>

[0222] Because of the configuration as in embodiment 4, it is possible to display the door path image only when necessary without constantly displaying it on the rear display. This allows the rear display to be used for other functions when it is not time to disembark, improving the display efficiency and reducing passenger distraction.

[0223] <Embodiment 5, mainly relating to claim 5>

[0224] <Outline of Embodiment 5>

[0225] Embodiment 5 is a vehicle based on any one of embodiments 1 to 4, and its characteristic feature is that the rear display is configured to display a screen for receiving control commands for equipment in the rear seat space when the vehicle is operating except when the driver is getting out of the vehicle. <Configuration of Embodiment 5>

[0226] Taking an example based on embodiments 1 to 3, the functional block diagram of the automobile of this embodiment, as shown in FIG. 7, includes door path video cameras 0701a and 0701b, rear displays 0702a and 0702b, and a rear seat space control unit 0704. Note that a rear seat space control device 0703 is provided as a prerequisite. Furthermore, as a characteristic configuration, a new boarding determination unit 0706 is further included, and the rear seat space control unit 0704 includes boarding video control means 0705, which functions characteristically. Note that, when embodiment 4 is used as a base, an exit possibility determination unit is further included, and the rear seat space control unit operates to have other characteristic functions. Below, a description of the configurations already described will be omitted, and only the characteristic configurations of this embodiment will be described.

[0227] <Description of Configuration of Fifth Embodiment>

[0228] <Fifth embodiment: New passenger determination unit>

[0229] The "new passenger determination unit" is configured to determine whether a person sitting in a seat has disembarked and a new passenger is taking that seat. The determination of a new passenger is made by using a motion sensor or the like to determine whether a person is sitting in the seat, and it can be determined that a new passenger has taken the seat when the door corresponding to that seat opens or when the motion sensor detects a person in a previously unoccupied seat. Note that even if a door opens and it is determined that a new passenger has taken the seat, if a new person cannot be detected in the seat corresponding to that door within a specified time, the determination can be overturned, assuming that no new passenger has taken the seat. Note that the specified time should be designed to be around 10 to 30 seconds.

[0230] The presence of a person in a seat can be detected by a human presence sensor. The following types of sensors can be used: (1) Pressure sensor: A pressure sensor is attached to the seat and detects whether a person is sitting in it by the weight applied. This method can be implemented at a relatively low cost, so it is often used for seat detection in automobiles. (2) Optical Sensor: Optical sensors can detect the presence of people using infrared light. The optical sensor installed on the seat detects whether a person is sitting there and sends the information to the central processing unit. (3) Ultrasonic Sensor: Ultrasonic sensors can detect the presence of people using sound waves. The ultrasonic sensors installed on the seats detect whether a person is sitting or not and send the information to the central processing unit. (4) Camera: By using a camera to analyze the video above the seat, it is possible to detect whether someone is sitting in the seat. This method is relatively expensive and requires specialized hardware, but it allows for more advanced analysis, and can analyze not only the seat status but also the passenger's facial expressions and behavioral patterns.

[0231] These sensors can be used individually, but combining multiple sensors enables more accurate seat detection. These sensors can be used not only to obtain static information such as whether a seat is vacant or occupied, but also to determine dynamic events such as when a new passenger takes a seat that was previously vacant, or when a passenger disembarks and the seat becomes vacant. Using these dynamic determinations, the rear display can be used to display a rear seat space control reception screen (when a new passenger boards the vehicle) or to turn off the display (when a rear seat becomes vacant, extending the display's lifespan and saving power).

[0232] <Embodiment 5: Additional Function of Rear Seat Space Control Unit>

[0233] <Embodiment 5: Video control means during riding>

[0234] The rear seat space control unit is configured to have an on-board image control means for, when the new passenger determination unit determines that a new passenger is or has been in a specific seat, displaying on the rear display corresponding to the seat for which the determination has been made one or more of an icon, button, or switch for receiving a control command to the rear seat space control unit. It is preferable that any of the icon, button, or switch is not displayed until it is determined that a new passenger is or has been in a specific seat.

[0235] In principle, it is preferable to configure the display so that power can be saved by turning it off. Also, when one or more of the icons, buttons, and switches are displayed, it is preferable to provide a voice guide to inform the driver that one or more of these have been displayed on the rear display. It is also preferable to configure the display to be continuously displayed while a person is seated in the corresponding seat, and to display the door path image on the screen only when the alighting determination unit determines that it is possible to alight.

[0236] <Embodiment 5: Conceptual diagram of computer (hardware diagram)>

[0237] As shown in Figure 8B, if the basic configuration of this embodiment is the same as that of embodiment 1, the hardware configuration of the computer further includes a boarding image control subprogram and a new boarding determination program in non-volatile memory and, after the computer is started, in main memory in addition to the programs and data of embodiment 1. Furthermore, new boarding determination result data is recorded in the main memory and non-volatile memory as needed.

[0238] <Processing flow of embodiment 5>

[0239] As shown in Figure 8A, the vehicle's computer performs the following processing in this embodiment. In principle, it is characterized by the processing of any one of embodiments 1 to 4 (the processing flow of embodiments 2 and 3 is the same as that of embodiment 1). That is, first there is step 0801 of determining whether the vehicle's engine has started, and if it is determined that the vehicle's engine has started, there is processing step 0802 of putting the rear display into standby mode. Then, in this standby mode, processing step 0803 is executed to determine whether there is a new passenger in the rear seat, and if it is determined that there is a new passenger in the rear seat, there is processing step 0804 of displaying a rear seat space control command reception screen on the rear display.

[0240] Thereafter, processing step 0805 is executed to determine whether the automobile has departed, and after departed, the automobile decelerates and stops, and processing step 0806 is executed to determine whether it is possible to disembark for each seat. If it is determined that it is possible to disembark, processing step 0807 is executed to display a door path image on the rear display. Thereafter, processing step 0808 is executed to determine whether each seat determined to be possible to disembark has already been disembarked, and the door path image continues to be displayed on the rear display unless it is determined that disembarkation has already been completed and the automobile does not depart. If the automobile departs without disembarking, processing step 0804 is executed to display a rear seat space control command reception screen on the rear display.

[0241] If it is determined in the step of determining whether the passenger has exited the vehicle, processing step 0810 is executed to turn off the video player and put the vehicle into standby mode. Processing step 0811 is then executed to determine whether the vehicle engine has stopped. If it is not determined that the vehicle engine has stopped, it is determined whether a new passenger will occupy that seat, and this process is repeated. When the vehicle engine stops and an end command is received, the series of processes ends. This end command can be configured to be issued, for example, when it is detected that all passengers have exited the vehicle, the vehicle is left unoccupied, and the doors are locked. It is also possible to configure the vehicle to automatically lock all doors when it is detected that no passengers are left and the electronic door lock key has been removed from the vehicle.

[0242] <Effects of Embodiment 5>

[0243] By configuring as in embodiment 5, when a new passenger gets in, the rear display can display a rear seat space control command reception screen that meets the passenger's desire to newly optimize the rear seat space, rather than a door path image, which is relatively less necessary.

[0244] <Embodiment 6: Mainly relating to claim 6>

[0245] <Outline of Sixth Embodiment>

[0246] Embodiment 6 is a vehicle based on any one of embodiments 1 to 5, in which the door path video camera acquires a door rear video, which is a video including the outer surface of the rear door corresponding to the rear seat and a rear video, which is a video of the area behind the rear door, as the door path video, and displays it on the rear display.

[0247] <Configuration of Embodiment 6>

[0248] As shown in Fig. 9A, taking an example based on embodiments 1 to 3, the automobile of this embodiment includes door path video cameras 0901a and 0901b, rear displays 0903a and 0903b, and a rear seat space control unit 0905. As a premise, the automobile includes rear seat space control target devices 0904, which are one or more of the rear doors, rear seats, a climate control device, an AV device, and rear seat lighting, as devices to be controlled in the rear seat space. A distinctive feature of this configuration is that the door path video cameras include door rear image acquisition means 0902a and 0902b for acquiring, as door path images, images of the outer surfaces of the rear doors corresponding to the rear seats and rear images of the area behind the rear doors.

[0249] In addition, when based on embodiment 4, it further has an exit possibility determination unit, and the rear seat space control unit operates to have other characteristic functions. Furthermore, when based on embodiment 5, it further has a new boarding determination unit, and the rear seat space control unit operates to have other characteristic functions. Below, we will omit explanations of the configurations that have already been explained, and will explain the new functions of the door path video camera, which is a characteristic configuration of this embodiment.

[0250] <Additional function of the door path video camera>

[0251] The door path video camera may capture an image of an object approaching the rear door from the left rear diagonally, rather than a straight line from behind. For example, in the case of a right-side door, the camera may widen the field of view and transmit an image of the left side, rather than transmitting the image to the rear display as a normal image. To achieve this function, the door path video camera captures an image wide enough to the left, and displays only the image from the door side as the normal door path image on the rear display. If image recognition identifies a dangerous object approaching the rear door from outside the image, the display on the rear display may expand to include that area. There are various image recognition technologies, but when an object in the image expands as the size of an approximate object approaches, the camera calculates its direction vector. If it is determined that the direction vector is heading toward the rear door, the object is recognized as a dangerous object, and the above-mentioned processing is performed.

[0252] <Embodiment 6: Computer Conceptual Diagram (Hardware)>

[0253] FIG. 9B is a conceptual diagram of a computer according to the sixth embodiment. An example will be described based on the first to third embodiments. The non-volatile memory and main memory store a door path image camera control program, a rear display control program, and a rear seat space control program, which are basic programs according to the first to third embodiments. A feature of this embodiment is that each of these programs stores a door rear image acquisition subprogram. This door rear image acquisition subprogram may be configured to be executed only when a command is received based on a predetermined command, or it may be configured to be executed constantly.

[0254] In one example of a configuration in which the program is constantly executed, the door path video camera is an electronic door mirror of a vehicle with a wide field of view, providing the driver with a wider-angle image than a conventional door mirror, and the door rear image acquisition subprogram is configured to extract and acquire the door rear image from that image. In other words, the image from one camera is processed and acquired. It is preferable to configure the program so that the door rear image data is stored in the non-volatile memory and the main memory.

[0255] <Effects of Embodiment 6>

[0256] By configuring as in the sixth embodiment, the passenger can visually recognize the door path image including the side of the door, which has the effect of making it easier to grasp the space.

[0257] <Embodiment 7, mainly relating to claim 7>

[0258] <Outline of Embodiment 7>

[0259] The seventh embodiment is based on any one of the first to sixth embodiments and has the further feature of determining whether it is safe to unlock the door based on the door path image, and allowing the door to be unlocked if it is determined to be safe.

[0260] <Configuration of Embodiment 7>

[0261] As shown in FIG. 10, the functional blocks of the automobile 1000 of this embodiment, when based on embodiments 1 to 3, include door path video cameras 0901a and 0901b, rear displays 0903a and 0903b, a rear seat space control unit 0905, and a controlled device 1003 in the rear seat space, which are the same as those of embodiments 1 to 3, and the rear seat space control unit is configured to include a door locking means 1005, a door lock releasing means 1006, a release locking means 1007, a release validity determining means 1008, and a door lock control means 1009.

[0262] Furthermore, although not specifically mentioned, it may also have the characteristic constituent elements of the fourth to sixth embodiments.

[0263] <Description of the Configuration of Embodiment 7>

[0264] <Embodiment 7: Rear seat space control unit and door lock unit>

[0265] The "door locking means of the rear seat space control unit" has the function of locking the door from opening. This is to prevent accidents such as the door opening accidentally and throwing a passenger in the rear seat out of the vehicle. For example, it can be configured to automatically activate when it detects that a person has sat in the rear seat, or when it detects that the vehicle has started moving. It can also be configured to notify the user when the door has been locked. This notification may be made by voice.

[0266] <Embodiment 7: Rear seat space control unit and door lock release means>

[0267] The "door lock release means of the rear seat space control unit" has a function of unlocking the doors. This function is generally used when exiting the vehicle. The door lock release command may be received from the passenger via a door lock release button, icon, switch, etc. that is displayed together with the door path image on a rear display having a touch panel function provided on the armrest of the door. The door unlock button, icon, switch, etc. may be provided on the armrest of the door. It may also be provided on the center console of the rear seat, but it is more convenient to have it on the door you want to open, as it helps to avoid accidentally touching the wrong door. It is preferable to configure the device to notify you when the door is unlocked, as this is because there is a possibility that you may accidentally touch the door unlock button, icon, switch, etc. It is also preferable to configure the device to notify you that the unlock command is locked even when the door is locked.

[0268] <Embodiment 7: Rear seat space control unit release lock means>

[0269] The "rear seat space control unit's unlocking / locking means" has a function of locking the command to unlock the doors. Generally, when exiting the vehicle, the unlocking validity determining means, which determines whether unlocking the doors is valid or not (described later), determines whether it is safe to exit the vehicle, and if it is determined to be unsafe, the means controls the vehicle so that the command to unlock the doors is not executed even if it is received from the passenger.

[0270] The door unlock command by the unlock lock means is suspended, invalidated, or deleted for each door. For example, even if the right door unlock command is suspended, the left door unlock command is executed to unlock the door. This is because the safety of opening the door may differ between the left and right sides of the vehicle. When a door unlock command is suspended, it is preferable to have the unlock validity determination means continue to make a determination until the occupant is able to exit the vehicle, and when the determination result thereafter changes to a determination that door unlocking is valid, the door unlock is released and the door unlock command is executed.

[0271] <Embodiment 7: Rear seat space control unit: Cancellation validity determination means>

[0272] The "rear seat space control unit release appropriateness determination means" has the function of determining whether or not it is appropriate to unlock the door based on the door path video. In principle, this determines whether it is appropriate to unlock the door using this means when the car is stopped and it is determined that it is possible to exit the car. Door unlocking is appropriate when opening the door is not expected to result in a collision with a moving object, or when opening the door is not expected to hit an adjacent parked car, motorcycle, bicycle, wall, pillar, etc. Door unlocking is not appropriate when the opposite of these cases occurs. This determination process is performed door by door. The release validity determination means is configured to perform image recognition of the door path image and make a determination through digital analysis of the image. A moving object moving toward the door in the door path image is identified from the change in the size of the image. Since the car is stopped, objects that are not moving do not change in size. However, objects that are moving and are moving toward the car door will gradually change in size in an approximately linear manner. In other words, a roughly approximated shape gradually becomes larger. The direction of change can also be determined by recognizing how minute changes in the approximated shape occur.

[0273] By using this type of image recognition and digital image analysis, it is possible to determine whether a moving object is moving in the direction of the door and how long it will take to reach the object. This determination can also be made using the AI ​​of the release validity determination means. Furthermore, whether there is a stationary object that will collide with the door when it is opened can be determined by whether an image of a stationary object exists at a predetermined position in the door's path image, based on spatial recognition in the image of where the tip of the door would reach if the door were opened. The distance can also be determined by emitting a flashing light so that it can be distinguished from distant objects. Alternatively, a laser beam can be emitted to determine the distance based on the linearity of the flash. These determinations can be made by analyzing the door's path image.

[0274] <Other Configurations of Embodiment 7>

[0275] <Embodiment 7 Other Configurations: Use of a Rear Camera and Sensors>

[0276] In addition to door path cameras, cars may be equipped with other features such as a backup camera that takes pictures of the area in front of the rear window and backup sensors. Working together with these features, it is possible to detect moving objects approaching from behind. In the case of backup sensors, they often sound a warning sound and turn on a warning light when the distance to a moving object approaches.

[0277] <Embodiment 7 Other Configurations: Use of Radar and LIDAR>

[0278] Automobiles can also be equipped with sensors such as radar and LIDAR. These sensors can detect distance, speed, etc. with high accuracy. If they can detect a moving object approaching from behind, they can close the door or issue a warning, cooperating with the deactivation validity determination means of this embodiment.

[0279] <Embodiment 7 Other Configurations Use of AI-based Image Recognition Technology>

[0280] Recently, AI-based image recognition technology has become available to detect moving objects approaching from behind based on door path video. Images are acquired in cooperation with the vehicle's rearview camera, and the onboard AI analyzes the video to detect moving objects. Because the AI ​​learns the shape and movement of moving objects, it can demonstrate high detection accuracy. This AI can be configured as part of the unlocking validity determination method. Door locking, door unlocking, and door unlocking can also be performed without using the door path video from the door path video camera.

[0281] <Embodiment 7: Computer Conceptual Diagram (Hardware)>

[0282] FIG. 11B shows a conceptual diagram of a computer according to embodiment 7. The following describes the features based on the conceptual diagrams of the computers according to basic embodiments 1 to 3. The features are that a door lock subprogram, a door unlock subprogram, a lock release subprogram, a lock release validity determination subprogram, and a door lock control subprogram are stored in nonvolatile memory, and when the computer is started, these are copied to main memory and each program is put into execution mode. Furthermore, the unlock validity determination program uses door path video data as data to determine the validity of door lock release. It is also possible to configure the computer to have this feature based on the conceptual diagrams of embodiments 4 to 6.

[0283] <Processing flow of embodiment 7>

[0284] FIG. 11A shows an example of the processing flow of the computer in this embodiment. In the fifth embodiment, the entry stage was described. Next, in the exit stage, a door unlock command is received from the passenger via the rear display or a button or switch on the door armrest. At this time, the door path image may be displayed simultaneously on the rear display that receives the door unlock command. The door unlock command may be the same as the command to open the door by the motor. Next, the computer executes an unlock validity determination process that determines whether or not door unlocking is valid based on the door path image or based on other sensors and the door path image.

[0285] If the result of the unlock validity determination process is that the unlocking is valid, a door unlocking process is executed to unlock the doors, and if the result of the determination process is that the unlocking is invalid, an unlock lock process is executed to lock the unlocking of the doors in response to the door unlock command. This may be a process to ignore or suspend the door unlock command, or a process to invalidate or cancel the door unlock command.

[0286] The specifics will be explained in order. First, at the boarding stage, there is a processing step 1101 in which it is determined whether a door unlocking request for a new boarding has been made. If it is determined that a door unlocking request for a new boarding has been made, a door unlocking processing step 1102 is executed. Thereafter, a processing step 1103 is executed in which it is determined whether a new passenger has taken a seat. Even if the door lock has been released, if the passenger is simply taking out luggage that has been placed inside the vehicle, the passenger does not necessarily take a seat, so it is separately determined whether the passenger has taken a seat.

[0287] If it is determined that a new seat has been occupied, step 1104 of seat-responsive locking processing (door locking processing) is automatically executed. If a door unlocking request is received in this state, the doors are unlocked (1104). Next, step 1106 of processing is executed to determine whether the car is moving, and if it is determined that the car is moving, the door unlocking request is rejected even if it is received (1107).

[0288] Thereafter, processing step 1108 is executed to determine whether it is possible to exit the vehicle, and if it is determined that it is possible to exit, processing step 1109 is executed to determine whether a door unlock request has been received. If it is determined that the door unlock request has been received, processing step 1110 is executed to determine whether door unlocking is appropriate. If it is determined that door unlocking is appropriate, the doors are unlocked, and the door locks remain unlocked until the vehicle exits through the unlocked door 1111, 1112. Note that even before exiting the vehicle, if it is determined that door unlocking is not appropriate, the vehicle is allowed to exit, and the doors remain locked until it is determined again that door unlocking is appropriate (not shown).

[0289] If it is determined in step 1112 that the passenger has exited the vehicle through the unlocked door, step 1113 is executed to automatically lock the exit door. The door can be configured to close automatically.

[0290] <Effects of Embodiment 7>

[0291] By configuring as in the seventh embodiment, it is possible to reduce accidents caused by passengers failing to visually check the door path image or by visual errors when getting off the vehicle.

[0292] <Embodiment 8, mainly relating to claim 8>

[0293] <Outline of Embodiment 8>

[0294] This embodiment is based on any one of the first to seventh embodiments and is characterized by controlling the possible opening angle of the door based on the door path image. The door is configured to open only up to the possible opening angle. This configuration not only avoids problems such as collisions between the door and moving objects that may occur when the door is opened, but also prevents collisions between the door and stationary objects near the door when the door is opened.

[0295] <Configuration of Embodiment 8>

[0296] When based on embodiments 1 to 3, the basic components of an automobile 1200 of this embodiment, as shown in Fig. 12, include door path video cameras 1201a and 1201b, rear displays 1202a and 1202b, a rear seat space control unit 1204, and, as a prerequisite, a rear space control device 1203, and the rear seat space control unit further includes possible opening angle information acquisition means 1205 and opening angle control means 1206. The opening angle control means characteristic of this embodiment will be described below.

[0297] <Embodiment 8: Rear seat space control unit: Means for acquiring information on available opening angle>

[0298] The "possible opening angle information acquisition means of the rear seat space control unit" is configured to acquire possible opening angle information, which is information indicating the possible opening angle of the door, based on the door path image. The possible opening angle of the door is the angle at which the door can be opened without any problems. For example, this information indicates up to what angle the center line of the door in the longitudinal direction (the overall length of the vehicle) can be opened with the door hinge as the center.

[0299] As mentioned above, regarding whether there is a stationary object that will collide with the door when it is opened, the position where the tip of the door will reach if the door is opened is recognized for each of the angles, and based on spatial recognition in the image of the door path image, it can be determined whether an image of a stationary object exists at a specified position where the tip of the door will reach in the door path image.

[0300] In addition, the system may be configured to judge distance by flashing light so that it can be distinguished from distant objects. Alternatively, it may be configured to emit laser light and judge distance from the linearity of the flash. These can be judged by analyzing the door path image.

[0301] <Embodiment 8: Rear seat space control unit, opening angle control means>

[0302] "Angle control" may be performed by controlling the door so that it does not open beyond a predetermined angle when opened manually. For example, the angle can be adjusted using a gear. If the door cannot be opened further manually, a brake can be applied to the gear. If the door opens automatically, the door opening operation may be controlled to stop at a predetermined angle.

[0303] <Embodiment 8: Computer Conceptual Diagram (Hardware)>

[0304] As shown in Figure 13B, this embodiment will be described based on the conceptual computer diagrams of Embodiments 1 to 3. In the computer, a door path image camera control program, a rear display control program, a rear seat space control program, and door path image data are basically stored in a non-volatile memory and, after the computer is started, in a main memory. A distinctive feature of this embodiment is that a boarding image control subprogram, a possible opening angle information acquisition subprogram, an opening angle control subprogram, and possible opening angle information data are stored in a non-volatile memory and a main memory. If the possible opening angle information data is stored in the non-volatile memory in association with the vehicle's stopping position, it can be used as reference information the next time the vehicle stops at the same stopping position.

[0305] <Processing flow of embodiment 8>

[0306] The vehicle's computer controls the door's possible opening angle using the following processing procedure. First, as shown in Figure 13A, processing step 1301 is executed to determine whether exiting the vehicle is possible. If it is determined that exiting is possible, the computer executes a step (not shown) of acquiring a door path image, and then executes step 1302, which acquires possible opening angle information based on the acquired door path image through a processing step of image recognition and digital image analysis. During image recognition, a flashing light may be emitted as described above to determine whether the object is near or far.

[0307] Alternatively, a laser beam may be emitted and the distance may be determined from the linearity of the flash. As described above, the computer recognizes the movement position of the door tip according to the door opening angle, and each tip position is associated with an opening angle. The computer then calculates the furthest edge free from obstacles, and calculates and outputs the possible opening angle when that position becomes the door tip. Step 1303 is executed to control the door so that it can be opened up to the output possible opening angle and does not open any further. The process is completed when the door is opened and then closed, but the loop process ends if, for example, the engine is stopped and the door is locked with no passengers on board.

[0308] <Effects of Embodiment 8>

[0309] By configuring as in the eighth embodiment, it is possible to avoid accidents such as the door colliding with not only moving objects in the door path image but also structures on the side of the door, resulting in damage to the door.

[0310] <Embodiment 9, mainly relating to claim 9>

[0311] <Overview of Embodiment 9>

[0312] This embodiment is an invention based on embodiment 8, and is an automobile having a door opening / closing motor unit and a door opening / closing motor control unit that open and close the doors, and the door opening / closing motor is configured so that the door opening / closing motor control unit opens the doors to a predetermined angle in accordance with the opening angle control means described in embodiment 8.

[0313] <Configuration of Embodiment 9>

[0314] As shown in FIG. 14A, the automobile of this embodiment is the automobile described in embodiment 8, which has a door opening / closing motor unit including a motor that opens and closes the door, and a door opening / closing motor unit control unit that controls the door opening / closing motor unit to open the door according to the possible opening angle information.

[0315] When based on embodiments 1 to 3, embodiment 8 has, as basic components, door path video cameras 1401a and 1401b, rear displays 1402a and 1402b, and a rear seat space control unit 1404. It is also assumed to have one or more rear seat space control devices 1403, such as a rear door, a rear seat, a climate control device, an AV device, and rear seat lighting. The rear seat space control unit further has a possible opening angle information acquisition means 1405 and an opening angle control means 1406, and further has a door opening / closing motor unit 1408 and a door opening / closing motor unit control unit 1406. The door opening / closing motor, which is a feature of this embodiment, will be described below.

[0316] <Embodiment 9: Door Opening / Closing Motor>

[0317] The "door opening / closing motor unit" includes a motor for opening and closing the door, as well as other components necessary for driving the motor. It is configured to open the door in accordance with the opening angle control means of embodiment 8. Specifically, a stepping motor is used as the door opening / closing motor. Stepping motors have the following main features: Accurate positioning is possible through open-loop control. Furthermore, position control is simple because the rotation angle is proportional to the number of pulses from the digital input. Furthermore, they are capable of rotation at low speeds and have excellent self-holding power when stopped. Therefore, they have the great advantage of not requiring a sensor to detect the rotational position of the shaft and allowing for easy and accurate positioning, making them ideal for door opening / closing motors.

[0318] <Embodiment 9: Door motor control unit>

[0319] The "door motor control unit" utilizes control information from the opening angle control means in accordance with the possible opening angle information acquired by the possible opening angle information acquisition means, which is a characteristic configuration of embodiment 8. Then, it is configured to control the door opening / closing motor unit so as to open the door in accordance with this control information. Specifically, if the door opening / closing motor is a stepping motor, it controls the number of rotations of the stepping motor by outputting a predetermined number of pulses to the stepping motor, thereby controlling the door opening angle to a predetermined angle. <Embodiment 9: Raising the vehicle height>

[0320] If the door path image indicates that the bottom edge of the door will come into contact with a raised sidewalk or other roadside barrier, the vehicle height can be raised to avoid contact. There are two main types of mechanisms for adjusting the vehicle height:

[0321] <Embodiment 9: Raising vehicle height: Air suspension>

[0322] Air suspension can raise the vehicle height by compressing air and filling it into the suspension, and lower the vehicle height by releasing the air.Air suspension is often used in luxury cars, trucks, SUVs, etc. because it can adjust the ride comfort and vehicle height.

[0323] <Embodiment 9: Coilover system for raising vehicle height>

[0324] The coilover system is a combination of shock absorbers and springs mounted on the top of the suspension, allowing you to adjust the vehicle height. To raise the vehicle height, shorten the spring, and to lower the vehicle height, lengthen the spring. Coilover systems are often used in sports cars and drift cars.

[0325] <Embodiment 9: Computer Conceptual Diagram (Hardware)>

[0326] Fig. 14B is a conceptual diagram of a computer according to this embodiment. This embodiment is based on the eighth embodiment, and therefore basically follows the computer structure of the eighth embodiment. That is, as shown in Fig. 13B, if this embodiment is described based on the conceptual diagrams of the computers according to the first to third embodiments, the computer basically stores a door path image camera control program, a rear display control program, a rear seat space control program, and door path image data in a nonvolatile memory and, after the computer is started, in a main memory. This embodiment is characterized in that a boarding image control subprogram, a possible opening angle information acquisition subprogram, an opening angle control subprogram, and possible opening angle information data are stored in a nonvolatile memory and a main memory.

[0327] If the possible opening angle information data is associated with the stopping position of the vehicle and recorded in a nonvolatile memory, it can be used as reference information the next time the vehicle stops at the same stopping position.

[0328] In addition to the computer structure of the eighth embodiment, in this embodiment, a door opening / closing motor control program is stored in the nonvolatile memory and the main memory after the computer is started, and is executed.

[0329] <Processing flow of embodiment 9>

[0330] First, it confirms that the car is stopped. The car's computer can recognize that the car is stopped using the method already described. Then, it obtains information about the door's possible opening angle. It outputs a command to the stepping motor, which is the door opening and closing motor, to rotate the door at the hinge to the possible opening angle. However, if the angle is too small, people will not be able to exit the car in the first place, so if the possible opening angle is 40 degrees or less, it controls the door so that it does not start opening. It then issues an announcement to notify the user that the door cannot be opened sufficiently. Depending on the circumstances, the passenger may wish to open the door even if it is less than 40 degrees, so if the passenger voices this, it controls the door to open to its maximum angle.

[0331] The voice is acquired and interpreted by a voice recognition device. The door is kept open until the passenger has finished disembarking. After the door path camera and image recognition from that camera determine that the passenger has disembarked and is sufficiently far away from the door, the door opening / closing motor is controlled to close the door after a warning such as a voice is given.

[0332] <Effects of Embodiment 9>

[0333] By configuring it as in embodiment 9, while maintaining the effects of embodiment 8, it is possible to reduce problems such as wear and tear on the door and breakdowns caused by excessive force being applied to the door by human hands, and also to reduce the frequency with which passengers touch the door, thereby avoiding the door from becoming dirty or, conversely, coming into contact with dirt or bacteria adhering to the door. [Explanation of symbols]

[0334] <Configuration of Embodiment 1> <Symbols in Embodiment 1> 0101: Door path video camera 0105: Rear display <Symbols in Embodiment 2> The symbols in the second embodiment are basically the same as those in the first embodiment. However, the placement of the door path video camera is limited to the most optimal location. <Symbols in Embodiment 3> The automobile of the third embodiment basically has the same symbols as the first and second embodiments. However, in this embodiment, the placement of the rear display has been optimized. <Symbols in Embodiment 4> 0501a, 0501b: Door path video camera 0502a, 0502b: Rear display 0504: Rear seat space control unit 0503: Controlled equipment in rear seat space 0505: Disembarkation decision section <Symbols in Embodiment 5> 0701a, 0701b: Door path video camera 0702a, 0702b: Rear display 0704: Rear seat space control unit 0703: Rear seat space control device 0706: New Passenger Judgment Department 0704: Rear seat space control unit 0705: Video control means when boarding <Symbols in Embodiment 6> 0901a, 0901b: Door path video camera 0903a, 0903b: Rear display 0905: Rear seat space control unit 0904: Rear seat space control device 0902a, 0902b: Door rear image acquisition means <Symbols in Embodiment 7> 0901a, 0901b: Door path video camera 0903a, 0903b: Rear display 0905: Rear seat space control unit 1003: Controlled equipment in rear seat space 1005: Door locking means 1006: Door unlocking means 1007: Release lock means 1008: Cancellation validity judgment means 1009: Door lock control means <Symbols in embodiment 8> 1201a, 1201b: Door path video camera 1202a, 1202b: Rear display 1204: Rear seat space control unit 1203: Rear Saki spatial control device 1205: Possible opening angle information acquisition means 1206: Opening angle control means <Symbols in Embodiment 9> 1408: Door opening / closing motor 1407: Door opening / closing motor control unit

Claims

1. a door path image camera provided on each of the left and right sides of a vehicle body for acquiring door path images including images of areas in which the path of a moving object (such as a car, a motorcycle, a bicycle, a handcart, a person, etc.) approaching the vehicle is obstructed by the open door when the rear door of the second or subsequent row of a vehicle having two or more rows of seats is opened; a rear display that is disposed in a space between a rear seat corresponding to the rear door and the back of a seat in front of the rear seat (including the back and the rear door) and displays door path images corresponding to each seat so that a person seated in the rear seat can see the images; a rear seat space control unit that controls the rear display and also controls one or more of a rear door, a rear seat, a temperature control device, a rear seat light, and an AV device; A vehicle having the above structure.

2. 2. The automobile according to claim 1, wherein the door path imaging camera is provided on a left or right front door or a left or right front fender.

3. 2. The automobile according to claim 1, wherein the rear display is installed on a center pillar corresponding to a rear door or a seat used by passengers seated in the rear seats to get in and out of the automobile.

4. The vehicle further includes an alighting availability determination unit that determines whether a passenger (regardless of the seat they are sitting in) is able to alight, When the alighting possibility determination unit determines that the alighting is possible, 2. The vehicle of claim 1, wherein the door path image is displayed on a rear display.

5. A new boarding determination unit is provided for determining whether a person sitting in a seat has disembarked and a new boarding person is to board the seat, The rear seat space control unit includes: A vehicle as described in any one of claims 1 to 4, further comprising an on-board image control means which, when the new passenger determination unit determines that a passenger has disembarked and a new passenger will board the seat, displays on the rear display corresponding to the seat determined to be occupied by one or more icons, buttons, and switches that accept control commands to the rear seat space control unit.

6. The door path image camera has a door rear image acquisition means for acquiring a door rear image, which is an image including the outer surface of the rear door corresponding to the rear seat and a rear image, which is an image behind the rear door, as the door path image.

7. The rear seat space control unit includes: a door lock means for locking the door from opening; a door unlocking means for unlocking a door; an unlocking / locking means for locking the unlocking of the door; A door unlock validity determination means for determining whether or not the door unlock is valid based on the door path image; a door lock control means for controlling the door lock to be released when the release validity determination means determines that the door lock is valid, and for preventing the door lock from being released when the release validity determination means determines that the door lock is invalid; 5. The vehicle according to claim 1, further comprising:

8. 6. The automobile according to claim 5, wherein the rear seat space control unit has an opening angle control unit for controlling a possible opening angle of the door based on the door path image.

9. A door opening / closing motor for opening and closing the door is provided, 8. The automobile according to claim 7, wherein a door opening / closing motor is configured to open the door in accordance with the opening angle control means.