Information processing method and information processing device
The information processing method and device address the issue of unauthorized steering wheel operation by identifying and validating the driver's steering inputs, ensuring secure and safe vehicle control.
Patent Information
- Application Number
- PCT/JP2024/028843
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-13
- Publication Date
- 2026-02-19
AI Technical Summary
Conventional steering systems for vehicles with two steering wheels do not account for situations where one wheel is operated by someone other than the driver.
An information processing method and device that determines the identity of operators for each steering wheel and controls the steering angle based on the valid operation, invalidating unauthorized steering inputs.
Prevents unauthorized steering operations by ensuring the vehicle's steering angle is controlled only by the intended operator, enhancing safety and security.
Smart Images

Figure JP2024028843_19022026_PF_FP_ABST
Abstract
Description
Information processing method and information processing device
[0001] The present invention relates to an information processing method and an information processing device.
[0002] Conventionally, there has been known a steering device having two steering rods for steering a vehicle such as an automobile. For example, Patent Document 1 listed below discloses a steering device having a pair of steering levers (steering rods) that change the steering angle by being moved in the fore-and-aft direction of the vehicle.
[0003] Japanese Patent Application Laid-Open No. 2019-064558
[0004] However, the above-described conventional technology has a problem in that it does not take into consideration the case where one of the two steering wheels is operated by someone other than the driver.
[0005] In one aspect, the present invention has been made in consideration of the above circumstances, and its object is to provide an information processing method and information processing device that can also handle cases in which one of the steering wheels is operated by someone other than the driver for a vehicle equipped with two steering wheels, each capable of accepting steering operations.
[0006] In order to solve the above-mentioned problems, one aspect of the present invention provides an information processing method that causes a processor to execute a process for controlling the steering angle of a vehicle that has a first operator and a second operator, each of which can accept a steering operation, wherein the processor executes the steps of: determining the identity of a first operator who operates the first operator and a second operator who operates the second operator; and, if it is determined in the step of determining identity that the first operator and the second operator are different, controlling the steering angle based on the operation performed on the first operator or the operation performed on the second operator.
[0007] According to the present invention, it is possible to provide an information processing method and information processing device that can also handle cases in which one of the steering wheels is operated by someone other than the driver for a vehicle equipped with two steering wheels, each capable of accepting steering operations.
[0008] 1 is a block diagram showing a schematic configuration of a vehicle equipped with an information processing device according to an embodiment; FIG. 2 illustrates an example of an operator according to the embodiment; FIG. 3 illustrates a case in which two steering wheels are operated by one person and a case in which two people operate them; FIG. 4 is a schematic illustration of an example of a hardware configuration of an information processing device according to an embodiment; FIG. 5 is a schematic illustration of an example of a software configuration of an information processing device according to an embodiment; and FIG. 6 illustrates an example of a processing procedure of an information processing device according to an embodiment.
[0009] An embodiment according to one aspect of the present invention (hereinafter also referred to as "the present embodiment") will be described below with reference to the drawings. However, the present embodiment described below is merely an example of the present invention in all respects. Needless to say, various improvements and modifications can be made without departing from the scope of the present invention. In other words, when implementing the present invention, specific configurations according to the embodiment may be appropriately adopted. Note that, although data appearing in the present embodiment are described in natural language, more specifically, they are specified using pseudo-language, commands, parameters, machine language, etc. that can be recognized by a computer.
[0010] §1 Application Example Fig. 1 is a block diagram showing a schematic configuration of a vehicle VH equipped with an information processing device (information processing device 1) according to this embodiment. The vehicle VH is an example of the "vehicle" of the present invention. The vehicle VH includes the information processing device 1, a first operator 2F, a second operator 2S, a first operator processing unit 3F, a second operator processing unit 3S, and a steering ECU (Electronic Control Unit) 4.
[0011] The first operator 2F and the second operator 2S are each an operator that can receive a steering operation SO (e.g., a steering operation SO with one hand) by the driver DR of the vehicle VH. In this embodiment, when there is no need to particularly distinguish between the first operator 2F and the second operator 2S, they may be simply referred to as "operators 2."
[0012] The operator 2 may be configured as a joystick, for example, as illustrated in FIG. 2A , or may be configured as a joystick that can be held in one hand. In particular, the first operator 2F and the second operator 2S may be configured as joysticks (a pair of left and right joysticks) provided on the left and right sides of the driver's seat where the driver DR sits. Furthermore, the first operator 2F and the second operator 2S may be configured as a pair of left and right joysticks that can pivotally move together by sharing a single virtual rotation axis (in other words, a virtual rotation center), as illustrated in FIG. 3 ( FIG. 3A and FIG. 3B ). The first operator 2F and the second operator 2S may be configured to be held (operated) by the driver DR while his or her left and right arms are resting on a pair of left and right armrests 21F and 21S, as illustrated in FIG. 3 .
[0013] The operator 2 may be configured as a dial-type operator (in other words, a disk-type operator) as shown in FIG. 2B , for example, and may be a dial-type device that can be held from above with one hand or a dial-type device that can be held from the side with one hand. In particular, the first operator 2F and the second operator 2S may be configured as dial-type devices provided on the left and right sides of the driver's seat (a pair of left and right dial-type devices). The first operator 2F and the second operator 2S may be configured as a pair of left and right disk-type operators that can rotate mutually from their respective neutral positions.
[0014] The first operator processing unit 3F executes various processes related to the first operator 2F (e.g., a process for accepting a steering operation SO to the first operator 2F, a process for controlling the operation of the first operator 2F (for example, synchronization and interlocking with the second operator 2S)). Similarly, the second operator processing unit 3S executes various processes related to the second operator 2S (e.g., a process for accepting a steering operation SO to the second operator 2S, a process for controlling the operation of the second operator 2S (for example, synchronization and interlocking with the first operator 2F)). As with the operators 2, in the following description, when there is no need to particularly distinguish between the first operator processing unit 3F and the second operator processing unit 3S, they may be simply referred to as the "operator processing unit 3." The operator processing unit 3 includes a CPU, RAM, and ROM (not shown), and the CPU may execute programs read from the ROM using the RAM as a work area to execute the various processes described above. The operator processing units 3 (each of the first operator processing unit 3F and the second operator processing unit 3S) and the information processing device 1 are connected, for example, by a CAN (Controller Area Network) or other in-vehicle LAN, and can communicate with each other (send and receive information).
[0015] The operator processing unit 3 includes a steering operation detection unit 32, a biometric information detection unit 34, and a motion control unit 36. In the example shown in FIG. 1 , the first operator processing unit 3F includes a first steering operation detection unit 32F as the steering operation detection unit 32, a first biometric information detection unit 34F as the biometric information detection unit 34, and a first motion control unit 36F as the motion control unit 36. Similarly, the second operator processing unit 3S includes a second steering operation detection unit 32S as the steering operation detection unit 32, a second biometric information detection unit 34S as the biometric information detection unit 34, and a second motion control unit 36S as the motion control unit 36. In the following description, when there is no need to particularly distinguish between the first steering operation detection unit 32F and the second steering operation detection unit 32S, they may be simply referred to as the "steering operation detection unit 32." When there is no need to particularly distinguish between the first biological information detection unit 34F and the second biological information detection unit 34S, they may be simply referred to as the "biological information detection unit 34." When there is no need to particularly distinguish between the first operation control unit 36F and the second operation control unit 36S, they may be simply referred to as the "operation control unit 36."
[0016] The steering operation detection unit 32 detects a steering operation SO of the operator 2. For example, if the operator 2 is configured as a joystick, the steering operation detection unit 32 may detect the tilt state of the joystick in the forward / backward direction and left / right direction (e.g., the tilt, tilt angle TA from the neutral position) as the steering operation SO. Specifically, the first steering operation detection unit 32F detects a steering operation SO of the first operator 2F (first steering operation SOF), and detects, for example, the tilt angle TA (first tilt angle TAF) of the first operator 2F in each of the forward / backward direction and left / right direction. Similarly, the second steering operation detection unit 32S detects a steering operation SO of the second operator 2S (second steering operation SOS), and detects, for example, the tilt angle TA (second tilt angle TAS) of the second operator 2S in each of the forward / backward direction and left / right direction.
[0017] Furthermore, for example, if the operator 2 is configured as a dial-type device, the steering operation detection unit 32 may detect the amount of rotation of the dial-type device (for example, the amount of rotation from a neutral position (operation amount θ)) as the steering operation SO. Specifically, the first steering operation detection unit 32F detects the steering operation SO of the first operator 2F (first steering operation SOF), and detects, for example, the operation amount θ of the first operator 2F (first operation amount θF). Similarly, the second steering operation detection unit 32S detects the steering operation SO of the second operator 2S (second steering operation SOS), and detects, for example, the operation amount θ of the second operator 2S (second operation amount θS).
[0018] The steering operation detection unit 32 outputs (transmits) operation information IO indicating the detected steering operation SO (for example, the tilt angle TA or the operation amount θ) to the information processing device 1. In this embodiment, the steering operation detection unit 32 transmits, to the information processing device 1, first operation information IOF indicating the first steering operation SOF and second operation information IOS indicating the second steering operation SOS.
[0019] The biological information detection unit 34 detects biological information IB of a person touching the operator 2. In other words, the biological information detection unit 34 detects biological information IB of a person operating the operator 2. The biological information detection unit 34 detects, as the biological information IB, information indicating at least one of instantaneous pulse rate, pulse rate, blood pressure, blood oxygen concentration, body temperature, skin conductance, myocardial infarction risk, stroke risk, arrhythmia, stress, anxiety, depression, cardiovascular disease risk, stroke risk, heart attack risk, pulse rate variability, instantaneous heart rate, heart rate variability, heart rate, cardiac load, BMI (Body Mass Index), skin age, and diabetes risk. The biological information detection unit 34 is provided at a position where it will come into contact with a person operating (holding) the operator 2; for example, it is provided on the "surface of the operator 2" that the person's hand will come into contact with. The biological information detection unit 34 may be provided on the surface of a joystick-type operator 2, as exemplified in Fig. 2A, or may be provided on the surface of a dial-type operator 2, as exemplified in Fig. 2B. However, what is shown in Fig. 2 is merely an example, and the position where the biological information detection unit 34 is provided is not particularly limited as long as it is a position where it comes into contact with a person who operates (holds) the operator 2.
[0020] In this embodiment, the first biometric information detection unit 34F detects biometric information IB (first biometric information IBF) of a person (first operator ORF) touching the first operator 2F (e.g., operating the first operator 2F). Similarly, the second biometric information detection unit 34S detects biometric information IB (second biometric information IBS) of a person (second operator ORS) touching the second operator 2S (e.g., operating the first operator 2F). The biometric information detection unit 34 outputs (transmits) the detected biometric information IB (i.e., the first biometric information IBF and the second biometric information IBS) to the information processing device 1.
[0021] As will be described in detail later, the information processing device 1 determines the identity of the first operator ORF and the second operator ORS, i.e., determines whether the first operator ORF and the second operator ORS are the same person. Below, an example will be described in which the information processing device 1 determines the identity of the first operator ORF and the second operator ORS based on whether the first biometric information IBF of the first operator ORF and the second biometric information IBS of the second operator ORS correspond (e.g., match). However, it is not essential for the information processing device 1 to determine the identity of the first operator ORF and the second operator ORS using the first biometric information IBF and the second biometric information IBS. The information processing device 1 may also determine the identity of the first operator ORF and the second operator ORS based on information other than the "biometric information IB of the first operator ORF and the second operator ORS."
[0022] For example, the information processing device 1 may determine whether the first operator ORF and the second operator ORS are identical based on information indicating whether a body area network (hereinafter abbreviated as "BAN") has been established between the first operator 2F and the second operator 2S. If the first operator ORF touching (operating) the first operator 2F and the second operator ORS touching (operating) the second operator 2S are the same person, a BAN should be established between the first operator 2F (e.g., an electrode provided on the first operator 2F) and the second operator 2S (e.g., an electrode provided on the second operator 2S). On the other hand, if the first operator ORF and the second operator ORS are different, a BAN is not established between the first operator 2F and the second operator 2S. That is, by checking whether a BAN has been established between the first operator 2F and the second operator 2S, it is possible to determine whether the person holding the first operator 2F and the person holding the second operator 2S are the same. Therefore, the operator processing unit 3 may transmit information indicating whether a BAN has been established between the first operator 2F and the second operator 2S to the information processing device 1, instead of or together with the biometric information IB of the person touching (e.g., operating) each operator 2. The information processing device 1 may determine whether the first operator ORF and the second operator ORS are identical based on the information indicating whether a BAN has been established.
[0023] The operation control unit 36 controls the operation and state (e.g., pivoting, rotation) of the operator 2 (at least one of the first operator 2F and the second operator 2S), and in particular controls the operation and state of the operator 2 in accordance with instructions from the information processing device 1. In this embodiment, the operation control unit 36 controls the operation and state of the operator 2 in accordance with a synchronization control signal SS obtained (received) from the information processing device 1, etc.
[0024] For example, if the first operator 2F and the second operator 2S are configured as a pair of left and right joysticks, the operation control unit 36 may link the first operator 2F and the second operator 2S as follows. That is, the operation control unit 36 may tilt at least one of the first operator 2F and the second operator 2S from its neutral position in accordance with a synchronization control signal SS that synchronizes (links) the tilt state of the first operator 2F with the tilt state of the second operator 2S. For example, the operation control unit 36 may tilt at least one of the first operator 2F and the second operator 2S from its neutral position in accordance with a synchronization control signal SS that matches the first tilt angle TAF and the second tilt angle TAS. In the present embodiment, the first movement control unit 36F tilts the first operation element 2F from its neutral position in accordance with a synchronization control signal SS (first synchronization control signal SSF) that synchronizes the "first tilt angle TAF of the first operation element 2F" with the second steering operation SOS of the second operation element 2S (the second tilt angle TAS achieved by the associated second steering operation SOS). Also, the second movement control unit 36S tilts the second operation element 2S from its neutral position in accordance with a synchronization control signal SS (second synchronization control signal SSS) that synchronizes the "second tilt angle TAS of the second operation element 2S" with the first steering operation SOF of the first operation element 2F (the first tilt angle TAF achieved by the associated first steering operation SOF).
[0025] Furthermore, for example, when the first operator 2F and the second operator 2S are configured as a pair of left and right dial-type devices, the operation control unit 36 may link the first operator 2F and the second operator 2S as follows. That is, the operation control unit 36 may rotate at least one of the first operator 2F and the second operator 2S from its neutral position in accordance with a synchronization control signal SS that synchronizes (links) the rotational state of the first operator 2F (e.g., the amount of rotation from the neutral position) with the rotational state of the second operator 2S. In this embodiment, the first operation control unit 36F rotates the first operator 2F from its neutral position in accordance with a synchronization control signal SS (first synchronization control signal SSF) that synchronizes the "amount of rotation of the first operator 2F from the neutral position" with the second operation amount θS of the second operator 2S. In addition, the second operation control unit 36S rotates the second operator 2S from its neutral position in accordance with a synchronization control signal SS (second synchronization control signal SSS) that synchronizes the "amount of rotation of the second operator 2S from the neutral position" with the first operation amount θF to the first operator 2F.
[0026] The steering ECU 4 controls the traveling direction of the vehicle VH, and in particular, controls the direction of the steered wheels (steered angle SA) of the vehicle VH in accordance with a steering angle control signal ACS from the information processing device 1. The steering ECU 4 is communicatively connected to the information processing device 1, for example, via an in-vehicle LAN, and acquires (receives) the steering angle control signal ACS from the information processing device 1. The steering ECU 4 changes the steering angle SA of the vehicle VH in accordance with the acquired steering angle control signal ACS, for example, by driving an electric motor capable of changing the direction of the steered wheels, causing the electric motor to change the direction of the steered wheels. The steering angle control signal ACS is, for example, a signal (control signal) that specifies the steering amount of the vehicle VH. In accordance with the steering angle control signal ACS, the steering ECU 4 changes the steering angle SA of the vehicle VH, for example, by steering the steered wheels of the vehicle VH by the steering amount indicated by the steering angle control signal ACS.
[0027] As described above, the vehicle VH includes a first operator 2F and a second operator 2S, each of which can receive a steering operation. In the vehicle VH, the driver DR typically operates the first operator 2F and the second operator 2S, as illustrated in Fig. 3A. In the example shown in Fig. 3A, the driver DR holds (e.g., operates) the first operator 2F with his left hand and holds (e.g., operates) the second operator 2S with his right hand.
[0028] However, as illustrated in (B) of Figure 3, when the driver DR is operating only one of the first operator 2F and the second operator 2S, a case may be envisioned in which a person other than the driver DR attempts to operate the other operator 2. For example, a person other than the driver DR sitting in the passenger seat or the back seat may mischievously attempt to operate the operator 2 that is not being operated (held) by the driver DR (to intervene in the steering operation SO by the driver DR). (B) of Figure 3 illustrates a case in which the second operator 2S is being operated by the driver DR, but the first operator 2F, which is not being held by the driver DR, is operated by a person other than the driver DR.
[0029] In a case where a person other than the driver DR maliciously attempts to intervene in the steering operation SO performed by the driver DR, as illustrated in (B) of Figure 3, the steering operation SO by such a person other than the driver DR should not be permitted. Therefore, the information processing device 1 determines whether the first operator ORF touching (e.g., operating) the first operator 2F is the same as the second operator ORS touching (e.g., operating) the second operator 2S. If the information processing device 1 determines that the first operator ORF and the second operator ORS are different, the information processing device 1 controls the steering angle SA of the vehicle VH based on the "steering operation SO for the first operator 2F (first steering operation SOF)" or the "steering operation SO for the second operator 2S (second steering operation SOS)." For example, if the information processing device 1 determines that the first operator ORF and the second operator ORS are different, it validates only one of the first steering operation SOF and the second steering operation SOS and invalidates the other steering operation SO. The information processing device 1 then controls the steering angle SA of the vehicle VH based solely on the validated steering operation SO (the first steering operation SOF or the second steering operation SOS). For example, if the information processing device 1 determines that, without a valid reason, someone other than the driver DR is operating one of the two operators 2 while the driver DR is operating the other operator 2, it controls the steering angle SA of the vehicle VH based solely on the steering operation SO by the driver DR. An example of a "valid reason" is when "the driver DR is experiencing physical abnormalities, and someone other than the driver DR attempts to control the vehicle VH as an emergency response." Through this control, the information processing device 1 can also handle cases where, for the vehicle VH, one of two operators 2, each capable of receiving a steering operation SO, is operated by a person other than the driver DR. For example, the information processing device 1 can invalidate a steering operation SO by a person other than the driver DR who is attempting to maliciously intervene in the steering operation SO by the driver DR, and control the steering angle SA of the vehicle VH based only on the steering operation SO by the driver DR. The information processing device 1, whose overview has been described above, will now be described in detail using Figures 4 to 6.
[0030] §2 Configuration Example [Hardware Configuration] Fig. 4 schematically illustrates an example of the hardware configuration of the information processing device 1 according to this embodiment. As shown in Fig. 4, the information processing device 1 according to this embodiment is a computer to which a control unit 11, a storage unit 12, a communication interface 13, an external interface 14, an input device 15, an output device 16, and a drive 17 are electrically connected. In Fig. 4, the communication interface and the external interface are referred to as a "communication I / F" and an "external I / F."
[0031] The control unit 11 includes a hardware processor such as a central processing unit (CPU), a random access memory (RAM), and a read-only memory (ROM), and is configured to execute information processing based on programs and various data. The CPU is an example of a processor resource. A graphics processing unit (GPU) may be used as the processor resource instead of or in addition to the CPU. The storage unit 12 is an example of a memory resource, and is configured, for example, with a hard disk drive or a solid-state drive. In this embodiment, the storage unit 12 stores various information such as an information processing program PG.
[0032] The information processing program PG is a program for causing the information processing device 1 to execute information processing (FIG. 6, etc.) described below for controlling the steering angle SA of the vehicle VH. The information processing program PG includes a series of instructions for the information processing.
[0033] The communication interface 13 is, for example, a wired LAN (Local Area Network) module, a wireless LAN module, or the like, and is an interface for performing wired or wireless communication via a network. As described above, the communication interface 13 may be an interface for performing communication via a CAN or other in-vehicle LAN. The information processing device 1 may use this communication interface 13 to perform data communication via a network with other information processing devices (e.g., the operator processing unit 3, the steering ECU 4, etc.). The external interface 14 is, for example, a USB (Universal Serial Bus) port, a dedicated port, or the like, and is an interface for connecting to an external device. The type and number of external interfaces 14 may be selected appropriately depending on the type and number of external devices to be connected.
[0034] For example, the information processing device 1 is connected to another information processing device via at least one of the communication interface 13 and the external interface 14, and performs the following communications with the other information processing device. That is, the information processing device 1 is connected to the operator processing unit 3, and acquires (receives) operation information IO indicating a steering operation SO (e.g., tilt angle TA or operation amount θ) of the operator 2 from the operator processing unit 3. In this embodiment, the information processing device 1 acquires first operation information IOF indicating a first steering operation SOF of the first operator 2F from the first operator processing unit 3F. Similarly, the information processing device 1 acquires second operation information IOS indicating a second steering operation SOS of the second operator 2S from the second operator processing unit 3S.
[0035] The information processing device 1 also acquires (receives) biometric information IB of a person touching the manipulator 2 (e.g., operating the manipulator 2) from the manipulator processing unit 3. In this embodiment, the information processing device 1 acquires first biometric information IBF of a first operator ORF operating the first manipulator 2F from the first manipulator processing unit 3F. Similarly, the information processing device 1 acquires second biometric information IBS of a second operator ORS operating the second manipulator 2S from the second manipulator processing unit 3S.
[0036] Furthermore, the information processing device 1 outputs (transmits) a synchronization control signal SS to the operator processing unit 3. In this embodiment, the information processing device 1 transmits the synchronization control signal SS to at least one of the first operator processing unit 3F and the second operator processing unit 3S to synchronize the state of the first operator 2F (e.g., the tilt angle TA or the amount of rotation from the neutral position) with the state of the second operator 2S. For example, the information processing device 1 transmits a first synchronization control signal SSF to the first operator processing unit 3F (particularly, the first operation control unit 36F) to tilt or rotate the first operator 2F from the neutral position so that the "first tilt angle TAF or the amount of rotation from the neutral position of the first operator 2F" is linked to the "second tilt angle TAS or the amount of rotation from the neutral position (second operation amount θS) of the second operator 2S." Similarly, the information processing device 1 sends a second synchronization control signal SSS to the second operator processing unit 3S (particularly, the second operation control unit 36S) to tilt or rotate the second operator 2S from its neutral position so that the "second tilt angle TAS or rotation amount from the neutral position of the second operator 2S" is linked to the "first tilt angle TAF or rotation amount from the neutral position (first operation amount θF) of the first operator 2F."
[0037] The information processing device 1 is connected to the steering ECU 4 and outputs (transmits) a steering angle control signal ACS to the steering ECU 4. The information processing device 1 transmits the steering angle control signal ACS to the steering ECU 4 to control (change) the steering angle SA of the vehicle VH, for example, to steer the steered wheels of the vehicle VH by the steering amount indicated by the steering angle control signal ACS.
[0038] The input device 15 is a device for inputting information, such as a mouse or a keyboard. The output device 16 is a device for outputting information, such as a display or a speaker. An operator such as a user can operate the information processing device 1 by using the input device 15 and the output device 16.
[0039] The drive 17 is, for example, a CD drive, a DVD drive, or the like, and is a drive device for reading various information, such as programs, stored in a storage medium 91. The storage medium 91 is a medium that stores information, such as programs, electrically, magnetically, optically, mechanically, or chemically, so that a computer or other device, machine, or the like can read the stored information. The information processing program PG may be stored in the storage medium 91. The information processing device 1 may acquire the information processing program PG from the storage medium 91. Note that FIG. 4 illustrates a disk-type storage medium, such as a CD or DVD, as an example of the storage medium 91. However, the type of the storage medium 91 is not limited to a disk-type storage medium and may be other than a disk-type storage medium. Examples of storage media other than a disk-type storage medium include semiconductor memories, such as flash memories. The type of the drive 17 may be selected arbitrarily depending on the type of the storage medium 91.
[0040] Note that, with regard to the specific hardware configuration of the information processing device 1, components may be omitted, replaced, or added as appropriate depending on the embodiment. For example, the processor resource may include multiple hardware processors. The hardware processor may be configured with a microprocessor, a field-programmable gate array (FPGA), a digital signal processor (DSP), or the like. The storage unit 12 may be configured with RAM and ROM included in the control unit 11. At least one of the communication interface 13, the external interface 14, the input device 15, the output device 16, and the drive 17 may be omitted. The information processing device 1 may be configured with multiple computers. In this case, the hardware configurations of the computers may or may not be identical. Furthermore, the information processing device 1 may be an information processing device designed specifically for the service provided, as well as a general-purpose server device, a PC (Personal Computer), or the like.
[0041] [Software Configuration] FIG. 5 schematically illustrates an example of the software configuration of the information processing device 1 according to this embodiment. The control unit 11 of the information processing device 1 loads the information processing program PG stored in the storage unit 12 onto the RAM. The control unit 11 then uses the CPU to interpret and execute instructions included in the information processing program PG loaded onto the RAM to control each component. As a result, as shown in FIG. 5 , the information processing device 1 according to this embodiment operates as a computer including a biometric information acquisition unit 110, an identity determination unit 120, a physical condition confirmation unit 130, a main / sub setting unit 140, an operation information acquisition unit 150, a steering angle control unit 160, and a synchronization control unit 170 as software modules. That is, in this embodiment, each software module of the information processing device 1 is realized by the control unit 11 (CPU).
[0042] The biometric information acquisition unit 110 acquires biometric information IB of a person touching the operator 2 (e.g., operating the operator 2) from the operator processing unit 3. For example, the biometric information acquisition unit 110 acquires first biometric information IBF of the first operator ORF from the first operator processing unit 3F (particularly, the first biometric information detection unit 34F). Similarly, the biometric information acquisition unit 110 acquires second biometric information IBS of the second operator ORS from the second operator processing unit 3S (particularly, the second biometric information detection unit 34S). The biometric information acquisition unit 110 notifies the identity determination unit 120 and the physical condition confirmation unit 130 of the acquired first biometric information IBF and second biometric information IBS.
[0043] The identity determination unit 120 determines whether the first operator ORF and the second operator ORS are identical, and notifies the steering angle control unit 160 and the synchronization control unit 170 of the determination result. For example, the identity determination unit 120 determines whether the first operator ORF and the second operator ORS are identical based on whether the first biometric information IBF and the second biometric information IBS acquired by the biometric information acquisition unit 110 correspond to each other. If the first biometric information IBF and the second biometric information IBS correspond to each other, the identity determination unit 120 determines that the first operator ORF and the second operator ORS are identical (the same person). If the first biometric information IBF and the second biometric information IBS do not correspond to each other, the identity determination unit 120 determines that the first operator ORF and the second operator ORS are different from each other. The identity determination unit 120 can improve the accuracy of such determination by determining the identity of the first operator ORF and the second operator ORS based on the biometric information IB of the person touching (e.g., operating) each of the first operator 2F and the second operator 2S.
[0044] However, it is not essential for the identity determination unit 120 to use the biometric information IB of the person touching each of the first and second operators 2F and 2S in determining the identity of the first operator ORF and the second operator ORS. The identity determination unit 120 only needs to be able to determine the identity of the first operator ORF and the second operator ORS, and there are no particular limitations on the information on which it bases this determination.
[0045] For example, the biometric information acquisition unit 110 may acquire information indicating whether a BAN has been established between the first operator 2F and the second operator 2S, instead of or together with the biometric information IB. The identity determination unit 120 may then determine whether the first operator ORF and the second operator ORS are identical based on this information. That is, if a BAN has been established between the first operator 2F and the second operator 2S, the identity determination unit 120 may determine that the first operator ORF and the second operator ORS are identical. Alternatively, if a BAN has not been established between the first operator 2F and the second operator 2S, the identity determination unit 120 may determine that the first operator ORF and the second operator ORS are different. The identity determination unit 120 determines the identity of the first operator ORF and the second operator ORS based on whether or not a BAN has been established between the first operator 2F and the second operator 2S, thereby reducing the time required for such determination, and for example, making such a determination instantaneous.
[0046] When the identity determination unit 120 determines that the first operator ORF and the second operator ORS are different, it may notify at least one of the first operator ORF and the second operator ORS of the result of this determination. As will be described in detail later, the information processing device 1 designates one of the first operator 2F and the second operator 2S as a main operator and the other as a sub-operator. Therefore, when the identity determination unit 120 determines that the first operator ORF and the second operator ORS are different, it may notify the result of this determination to a person (e.g., the driver DR) who is touching (operating) the operator 2 designated as the main operator. For example, the identity determination unit 120 may vibrate the operator 2 designated as the main operator to notify the driver DR that the operator 2 designated as the sub-operator is being touched (operated) by someone other than the driver DR. Furthermore, the identity determination unit 120 may vibrate the operator 2 designated as the sub-operator to prompt "a person touching (operating) the operator 2 designated as the sub-operator" (e.g., a person other than the driver DR) to refrain from touching or operating the operator 2 designated as the sub-operator. Furthermore, the identity determination unit 120 may notify at least one of the first operator ORF and the second operator ORS of the determination result by outputting information indicating the determination result that the first operator ORF and the second operator ORS are different to the interior of the vehicle VH. For example, the identity determination unit 120 may notify a person in the interior of the vehicle VH of the determination result that the first operator ORF and the second operator ORS are different by generating an alarm. By making such a notification, the identity determination unit 120 can make those present in the vehicle VH aware that someone other than the first operator ORF (e.g., the driver DR) has intervened in the steering operation SO (first steering operation SOF) by the first operator ORF.
[0047] The physical condition confirmation unit 130 confirms the physical conditions of the first operator ORF and the second operator ORS and notifies the steering angle control unit 160 of the confirmation results. For example, the physical condition confirmation unit 130 confirms the physical conditions of the first operator ORF and the second operator ORS using the first biological information IBF and the second biological information IBS acquired by the biological information acquisition unit 110. That is, the physical condition confirmation unit 130 confirms whether the first biological information IBF indicates that "an abnormality has occurred in the first operator ORF (e.g., the first operator ORF is feeling unwell)." Similarly, the physical condition confirmation unit 130 confirms whether the second biological information IBS indicates that "an abnormality has occurred in the second operator ORS (e.g., the second operator ORS is feeling unwell)." The physical condition confirmation unit 130 notifies the steering angle control unit 160 of the results of the above-mentioned confirmation, i.e., "whether or not an abnormality has occurred in the first operator ORF" and "whether or not an abnormality has occurred in the second operator ORS."
[0048] The main / sub setting unit 140 designates one of the first operator 2F and the second operator 2S as the main operator (main operator 2) and the other as the sub operator (sub operator 2). As described above, the first operator 2F and the second operator 2S are a pair of left and right operators 2 provided at the driver's seat. The information processing device 1 then determines whether the first operator ORF operating the first operator 2F is the same as the second operator ORS operating the second operator 2S. If the information processing device 1 determines that the first operator ORF and the second operator ORS are different, the information processing device 1 controls the steering angle SA of the vehicle VH based on only one of the first steering operation SOF and the second steering operation SOS. For example, when the information processing device 1 determines that the first operator ORF and the second operator ORS are different, it controls the steering angle SA of the vehicle VH based only on the steering operation SO for the operator 2 that is designated as the main operator out of the first operator 2F and the second operator 2S. For the above-mentioned processing by the information processing device 1, the main / sub setting unit 140 designates one of the first operator 2F and the second operator 2S as the main operator and the other as the sub-operator.
[0049] For example, the main / sub-setting unit 140 may designate, of the first operator 2F and the second operator 2S, the operator 2 on the door side of the driver's seat where the driver DR sits as the main operator, and the operator 2 on the console side of the driver's seat as the sub-operator. If the vehicle VH is a so-called right-hand drive vehicle in which the driver's seat is located on the right side with respect to the forward direction of the vehicle VH, the main / sub-setting unit 140 may designate, of the first operator 2F and the second operator 2S, the operator 2 on the right side of the driver's seat as the main operator, and the operator 2 on the left side as the sub-operator. If the vehicle VH is a so-called left-hand drive vehicle in which the driver's seat is located on the left side with respect to the forward direction of the vehicle VH, the main / sub-setting unit 140 may designate, of the first operator 2F and the second operator 2S, the operator 2 on the left side of the driver's seat as the main operator, and the operator 2 on the right side as the sub-operator.
[0050] As described above, when the information processing device 1 determines that the first operator ORF and the second operator ORS are different, it controls the steering angle SA of the vehicle VH based only on the steering operation SO to the operator 2 designated as the primary operator. Therefore, it is desirable to designate the operator 2, of the first operator 2F and the second operator 2S, that is likely to be operated by the driver DR as the "primary operator" and the operator 2 that can be operated by someone other than the driver DR as the "secondary operator." Furthermore, for someone other than the driver DR, the operator 2 on the console side of the driver's seat is generally easier to operate than the operator 2 on the door side of the driver's seat. In other words, the operator 2 on the console side of the driver's seat is more likely to be operated by someone other than the driver DR than the operator 2 on the door side of the driver's seat. Therefore, the primary / secondary setting unit 140 designates the operator 2 on the door side of the driver's seat as the primary operator and the operator 2 on the console side of the driver's seat as the secondary operator. By setting the main / sub for the first operator 2F and the second operator 2S in this manner, the main / sub setting unit 140 can set the operator 2 that is more likely to be operated by someone other than the driver DR, out of the first operator 2F and the second operator 2S, as the "sub operator." In other words, the main / sub setting unit 140 can set the operator 2 that is more likely to be operated by the driver DR, out of the first operator 2F and the second operator 2S, as the "main operator."
[0051] For example, the main / sub setting unit 140 may designate one of the first and second operators 2F and 2S, which is closer to a seat other than the driver's seat (e.g., a passenger seat or a rear seat), as the sub-operator, and the other operator 2 as the main operator. The main / sub setting unit 140 may designate one of the first and second operators 2F and 2S, which is farther from persons other than the driver DR, as the main operator, and the other operator 2 as the sub-operator. By setting the main / sub for the first and second operators 2F and 2S in this manner, the main / sub setting unit 140 can designate, as the "sub-operator," the operator 2 of the first and second operators 2F and 2S that is more likely to be operated by persons other than the driver DR.
[0052] For example, the main / sub-setting unit 140 may designate the operator 2 with a higher operation frequency (frequency of steering operation SO) between the first operator 2F and the second operator 2S as the main operator, and the operator 2 with a lower operation frequency as the sub-operator. As an example, the main / sub-setting unit 140 may detect the operation frequency of each of the first operator 2F and the second operator 2S and determine which operator 2 has a higher operation frequency. The main / sub-setting unit 140 may then designate the operator 2 with a higher operation frequency between the first operator 2F and the second operator 2S as the main operator, and the operator 2 with a lower operation frequency as the sub-operator. The operator 2 with a higher operation frequency between the first operator 2F and the second operator 2S is considered to be the operator 2 operated by the driver DR. By setting the main / sub for the first operator 2F and the second operator 2S in this manner, the main / sub setting unit 140 can set the operator 2 that is most likely to be operated by the driver DR, out of the first operator 2F and the second operator 2S, as the "main operator."
[0053] For example, the main / sub setting unit 140 may designate one of the first operator 2F and the second operator 2S as the main operator and the other as the sub operator based on a user (e.g., the driver DR) operation. For example, the main / sub setting unit 140 may accept a user operation to set the main / sub status of the first operator 2F and the second operator 2S, and set the main / sub status of the first operator 2F and the second operator 2S in accordance with the user operation. The user operation may be accepted by a button (switch) provided on the driver's seat door side or by a touch panel display or the like provided near the driver's seat. By setting the main / sub status of the first operator 2F and the second operator 2S in this manner, the main / sub setting unit 140 can set the main / sub status of the first operator 2F and the second operator 2S based on the user operation.
[0054] The operation information acquisition unit 150 acquires (receives) the steering operation SO of each operator 2 from the operator processing unit 3. For example, the operation information acquisition unit 150 acquires first operation information IOF indicating a first steering operation SOF (e.g., a first tilt angle TAF or a first operation amount θF) from the first operator processing unit 3F (particularly, the first steering operation detection unit 32F). Similarly, the operation information acquisition unit 150 acquires second operation information IOS indicating a second steering operation SOS (e.g., a second tilt angle TAS or a second operation amount θS) from the second operator processing unit 3S (particularly, the second steering operation detection unit 32S). The operation information acquisition unit 150 notifies the steering angle control unit 160 of the acquired first operation information IOF and second operation information IOS.
[0055] The steering angle control unit 160 controls the steering angle SA of the vehicle VH, for example, by generating a steering angle control signal ACS and transmitting the generated steering angle control signal ACS to the steering ECU 4, thereby controlling the steering angle SA of the vehicle VH.
[0056] In particular, when identity determination unit 120 determines that the first operator ORF and the second operator ORS are different, steering angle control unit 160 controls the steering angle SA of vehicle VH based on the first steering operation SOF for first operator 2F or the second steering operation SOS for second operator 2S. In other words, when the first operator ORF and the second operator ORS are different, steering angle control unit 160 controls the steering angle SA based on the first steering operation SOF by the first operator ORF or the second steering operation SOS by the second operator ORS. For example, steering angle control unit 160 generates steering angle control signal ACS based on the first steering operation SOF indicated by the first operation information IOF or the second steering operation SOS indicated by the second operation information IOS. For example, the steering angle control unit 160 determines the steering amount of the vehicle VH based on the first steering operation SOF (first tilt angle TAF or first operation amount θF) or the second steering operation SOS (second tilt angle TAS or second operation amount θS), and generates a steering angle control signal ACS that specifies the determined steering amount.
[0057] In other words, when the first operator ORF and the second operator ORS are different, steering angle control unit 160 controls the steering angle SA of vehicle VH based on only one of the first steering operation SOF and the second steering operation SOS. For example, when it is determined that first operator 2F is operated by driver DR and second operator 2S is operated by a person other than driver DR, steering angle control unit 160 controls the steering angle SA based on only one of the steering operation SO by driver DR and the steering operation SO by a person other than driver DR.
[0058] Therefore, for a vehicle VH that is equipped with a first operator 2F and a second operator 2S, even when one operator 2 is operated by the driver DR and the other operator 2 is operated by a person other than the driver DR, the steering angle control unit 160 can control the steering angle SA based on the steering operation SO by the driver DR or the steering operation SO by a person other than the driver DR. In other words, for a vehicle VH that is equipped with two operators 2 that are each capable of receiving a steering operation SO, even when one operator 2 is operated by a person other than the driver DR, the steering angle control unit 160 can handle such cases by controlling the steering angle SA of the vehicle VH based on the steering operation SO by the driver DR or the steering operation SO by a person other than the driver DR.
[0059] As described above, one of first operator 2F and second operator 2S is designated as the main operator and the other as the sub-operator by main / sub setting unit 140. Therefore, when identity determination unit 120 determines that first operator ORF and second operator ORS are different, steering angle control unit 160 may control steering angle SA of vehicle VH as follows. That is, steering angle control unit 160 may control steering angle SA based on the steering operation SO for the operator 2 designated as the main operator out of first operator 2F and second operator 2S.
[0060] For example, main / sub setting unit 140 sets, as the "main operator," the "operator 2 that is likely to be operated by driver DR" out of first operator 2F and second operator 2S. Therefore, when first operator ORF and second operator ORS are different, steering angle control unit 160 controls the steering angle SA based on the steering operation SO for the operator 2 that is set as the main operator out of first operator 2F and second operator 2S. Through this control, for a vehicle VH equipped with first operator 2F and second operator 2S, in a case where one operator 2 is operated by the driver DR and the other operator 2 is operated by someone other than the driver DR, steering angle control unit 160 can control the steering angle SA based on the steering operation SO by the driver DR.
[0061] However, if there is a "justifiable reason," steering angle control unit 160 may control steering angle SA based on a steering operation SO by "a person other than the driver DR." In the present embodiment, steering angle control unit 160 may control steering angle SA of vehicle VH using the results of the confirmation by physical condition confirmation unit 130. For example, if identity determination unit 120 determines that "the first operator ORF and the second operator ORS are different," and physical condition confirmation unit 130 confirms that "the physical condition of one of the first operator ORF and the second operator ORS is normal and the physical condition of the other is abnormal," steering angle control unit 160 may control steering angle SA as follows. That is, steering angle control unit 160 may control steering angle SA based on a steering operation SO by the first operator ORF or the second operator ORS confirmed by physical condition confirmation unit 130 to be "normal in physical condition."
[0062] For example, if the first operator ORF is the driver DR and the first operator 2F is the main operator, and the first operator ORF and the second operator ORS are different, and the first operator ORF (driver DR) is in an abnormal physical condition and the second operator ORS (someone other than the driver DR) is in a normal physical condition, the steering angle control unit 160 controls the steering angle SA based on the second steering operation SOS by the second operator ORS. That is, the steering angle control unit 160 controls the steering angle SA based on the second steering operation SOS for the second operator 2S, which is the auxiliary operator. That is, the steering angle control unit 160 controls the steering angle SA based on the second steering operation SOS by a person other than the driver DR, instead of the steering operation SO (first steering operation SOF) by the driver DR who is in an abnormal physical condition. With this control, even if the first operator ORF (driver DR) becomes unwell, the steering angle SA can be controlled based on the steering operation SO (second steering operation SOS) of the second operator ORS (person other than the driver DR).
[0063] As described above, when the first operator ORF and the second operator ORS are different, and one of the first operator ORF and the second operator ORS is in a normal physical condition while the other is in an abnormal physical condition, the steering angle control unit 160 controls the steering angle SA based on the steering operation SO by the person in "normal physical condition." During such control, the steering angle control unit 160 may further invalidate the steering operation SO by the person in "abnormal physical condition." Through such control, the steering angle control unit 160 can prevent the steering angle SA of the vehicle VH from being controlled by a person who may be having difficulty performing a safe steering operation SO due to the occurrence of an abnormality.
[0064] In the present embodiment, the process of "invalidating" the steering operation SO (the first steering operation SOF or the second steering operation SOS) may include a process of "prohibiting" the steering operation SO. Furthermore, the process of "invalidating (or prohibiting)" the steering operation SO may include a process of "locking" the operator 2 so that the operator 2 is not operated. However, the "invalidating" process does not necessarily include at least one of the "prohibiting" process and the "locking" process. For the information processing device 1, "invalidating" the first steering operation SOF or the second steering operation SOS may simply mean not accepting the first steering operation SOF or the second steering operation SOS as the steering operation SO. Furthermore, "invalidating" the first steering operation SOF or the second steering operation SOS may mean that the information processing device 1 controls the steering angle SA without based on the first steering operation SOF or the second steering operation SOS. Making one of the first steering operation SOF and the second steering operation SOS "invalid" and the other "valid" may mean controlling the steering angle SA based only on the steering operation SO that is "valid," and not based on the steering operation SO that is "invalid."
[0065] Until the identity determination process by identity determination unit 120 is completed, steering angle control unit 160 may control steering angle SA based on the steering operation SO for the operator 2, of the first operator 2F and the second operator 2S, that has been designated as the "main operator" by main / sub-setting unit 140. As described above, information processing device 1 (particularly main / sub-setting unit 140) sets, as the "main operator," the "operator 2 that is likely to be operated by the driver DR," of the first operator 2F and the second operator 2S. Therefore, until the identity determination process by identity determination unit 120 is completed, steering angle control unit 160 controls steering angle SA based on the steering operation SO for the operator 2, of the first operator 2F and the second operator 2S, that has been designated as the main operator. In other words, until it is confirmed that the person (first operator ORF) touching (e.g., operating) first operator 2F is the same as the person (second operator ORS) touching (e.g., operating) second operator 2S, steering angle control unit 160 controls steering angle SA based on the steering operation SO to "operator 2 (main operator) that is likely to be operated by driver DR." Through this control, it is possible for steering angle control unit 160 to control steering angle SA based on the steering operation SO to "operator 2 (main operator) that is likely to be operated by driver DR" until it is confirmed that the first operator ORF and the second operator ORS are the same as each other.
[0066] When the identity determination unit 120 determines that the first operator ORF and the second operator ORS are the same, the synchronization control unit 170 synchronizes the operation (state) of the first operator 2F with the operation of the second operator 2S. In other words, the synchronization control unit 170 links the first operator 2F with the second operator 2S when the first operator 2F and the second operator 2S are operated by the same person (e.g., the driver DR). For example, the synchronization control unit 170 links the first operator 2F with the second operator 2S by transmitting a synchronization control signal SS to at least one of the first operator processing unit 3F (particularly, the first movement control unit 36F) and the second operator processing unit 3S (particularly, the second movement control unit 36S). That is, the synchronization control unit 170 transmits a first synchronization control signal SSF to the first movement control unit 36F to link the tilt state or rotation of the first operator 2F to the second steering operation SOS of the second operator 2S (the tilt state or rotation of the second operator 2S achieved by the second steering operation SOS). Similarly, the synchronization control unit 170 transmits a second synchronization control signal SSS to the second movement control unit 36S to link the tilt state or rotation of the second operator 2S to the first steering operation SOF of the first operator 2F (the tilt state or rotation of the first operator 2F achieved by the first steering operation SOF). Through this control, the synchronization control unit 170 can mutually link the first operator 2F and the second operator 2S that are operated (or touched) by the same person (e.g., the driver DR).
[0067] Furthermore, when the identity determination unit 120 determines that the first operator ORF and the second operator ORS are different, the synchronization control unit 170 does not interlock the first operator 2F and the second operator 2S. Through this control, the synchronization control unit 170 can cancel the interlock between the first operator 2F and the second operator 2S, which are operated (or touched) by different people. When the first operator ORF and the second operator ORS are different, the synchronization control unit 170 may, in addition to canceling the interlock as described above, further prohibit operation of the operator 2 designated as the sub-operator by the main / sub-setting unit 140. For example, when the first operator ORF and the second operator ORS are different, the synchronization control unit 170 may lock the operator 2 designated as the sub-operator to prohibit operation of the operator 2.
[0068] §3 Operation Example Figure 6 is a flowchart showing an example of the processing procedure of the information processing device 1 according to this embodiment. The processing procedure described below is an example of the processing procedure of an information processing method PM that causes a processor (e.g., the CPU of the information processing device 1) to execute the process of "controlling the steering angle SA of the vehicle VH." However, the processing procedure described below is merely an example, and each step may be modified as much as possible. Furthermore, steps may be omitted, replaced, or added to the processing procedure described below as appropriate depending on the embodiment.
[0069] (Step S110) In step S110, the control unit 11 operates as the main / sub setting unit 140 and sets one of the first operator 2F and the second operator 2S as the main operator and the other as the sub-operator. The control unit 11 may set the operator 2 of the first operator 2F and the second operator 2S on the driver's door side as the main operator and the operator 2 on the console side of the driver's seat as the sub-operator. The control unit 11 may set the operator 2 closer to a seat other than the driver's seat as the sub-operator and the other operator 2 as the main operator. The control unit 11 may set the operator 2 of the first operator 2F and the second operator 2S that is operated more frequently as the main operator and the other operator 2 as the sub-operator based on a user operation. The control unit 11 designates, for example, the operator 2 that is most likely to be operated by the driver DR among the first operator 2F and the second operator 2S as the "main operator," and the operator 2 that can be operated by someone other than the driver DR as the "secondary operator."
[0070] For ease of understanding, the following description will be given by way of example, in which the first operator 2F is the “main operator” and the second operator 2S is the “sub-operator.” In accordance with the settings for the first operator 2F and the second operator 2S, in the following description, the first operator ORF operating (touching) the first operator 2F may be referred to as the “main operator,” and the second operator ORS operating (touching) the second operator 2S may be referred to as the “sub-operator.”
[0071] (Step S120) In step S120, the control unit 11 operates as the biometric information acquisition unit 110 and acquires the first biometric information IBF of the first operator ORF operating the first operator 2F and the second biometric information IBS of the second operator ORS operating the second operator 2S.
[0072] (Step S130) In step S130, the control unit 11 operates as the operation information acquisition unit 150 and acquires first operation information IOF and second operation information IOS. As described above, the first operation information IOF indicates the first steering operation SOF, for example, the first tilt angle TAF or the first operation amount θF. Furthermore, the second operation information IOS indicates the second steering operation SOS, for example, the second tilt angle TAS or the second operation amount θS.
[0073] (Step S140) In step S140, the control unit 11 operates as the identity determination unit 120 and determines whether the main operator (first operator ORF) and the sub-operator (second operator ORS) are the same, that is, whether the first operator ORF and the second operator ORS are identical. The control unit 11 may determine whether the first operator ORF and the second operator ORS are identical based on the first biometric information IBF and the second biometric information IBS acquired in step S120. Alternatively, the control unit 11 may determine whether the first operator ORF and the second operator ORS are identical based on whether a BAN is established between the first operator 2F and the second operator 2S, instead of or in addition to the biometric information IB. If the control unit 11 determines that the main operator (first operator ORF) and the sub-operator (second operator ORS) are the same (Yes in step S140), the control unit 11 proceeds to step S150. If the control unit 11 determines that the main operator and the sub-operator are different (No in step S140), the control unit 11 proceeds to step S170.
[0074] (Step S150) In step S150, the control unit 11 operates as the synchronization control unit 170 and synchronizes the operation (state) of the first operator 2F with the operation of the second operator 2S, i.e., links the first operator 2F with the second operator 2S.
[0075] (Step S160) In step S160, the control unit 11 operates as the steering angle control unit 160 and controls the steering angle SA of the vehicle VH based on the first steering operation SOF for the main operator (first operator 2F) or the second steering operation SOS for the sub-operator (second operator 2S). In other words, if the main operator (first operator ORF) and the sub-operator (second operator ORS) are the same person (for example, if the driver DR is operating (touching) both the main operator and the sub-operator), the control unit 11 permits the second steering operation SOS for the sub-operator by the driver DR.
[0076] (Step S170) In step S170, the control unit 11 operates as the synchronization control unit 170 and does not synchronize the operation (state) of the first operator 2F with the operation of the second operator 2S, that is, does not link the first operator 2F with the second operator 2S. In step S170, the control unit 11 may also cancel the link between the first operator 2F and the second operator 2S.
[0077] (Step S180) In step S180, the control unit 11 operates as the physical condition checking unit 130 and checks whether the main operator (first operator ORF) is experiencing an abnormality (e.g., poor physical condition). For example, the control unit 11 may determine whether "an abnormality has occurred in the first operator ORF" based on the first biometric information IBF of the first operator ORF. If the control unit 11 confirms that an abnormality has occurred in the main operator (first operator ORF) (Yes in step S180), the control unit 11 proceeds to step S190. If the control unit 11 confirms that an abnormality has not occurred in the main operator (No in step S180), the control unit 11 proceeds to step S200.
[0078] (Step S190) In step S190, the control unit 11 operates as the steering angle control unit 160 and controls the steering angle SA of the vehicle VH based on the second steering operation SOS for the sub-operator (second operator 2S). In other words, when the main operator (first operator ORF) and the sub-operator (second operator ORS) are different and an abnormality has occurred in the main operator, the control unit 11 permits the second steering operation SOS for the sub-operator by the sub-operator. Then, the control unit 11 controls the steering angle SA of the vehicle VH based on the second steering operation SOS for the sub-operator by the sub-operator. In addition to permitting the "second steering operation SOS for the sub-operator by the sub-operator," the control unit 11 may also prohibit the main operator from performing a first steering operation SOF for the main operator (first operator 2F). For example, the control unit 11 may lock the main operator to prohibit the main operator from performing a first steering operation SOF for the main operator.
[0079] (Step S200) In step S200, the control unit 11 operates as the steering angle control unit 160 and controls the steering angle SA of the vehicle VH based on the first steering operation SOF of the main operator (first operator 2F). In other words, if the main operator (first operator ORF) and the sub-operator (second operator ORS) are different and no abnormality has occurred in the main operator, the control unit 11 controls the steering angle SA of the vehicle VH based on the first steering operation SOF by the main operator. In addition to "controlling the steering angle SA based on the first steering operation SOF," the control unit 11 may also prohibit the sub-operator (second operator ORS) from performing a second steering operation SOS on the sub-operator (second operator 2S). For example, the control unit 11 may lock the sub-operator to prohibit the sub-operator from performing a second steering operation SOS on the sub-operator.
[0080] [Features] As described above, information processing device 1 according to the present embodiment is an information processing device that controls the steering angle SA of vehicle VH, which has first operator 2F and second operator 2S, each of which is capable of receiving a steering operation SO. Information processing device 1 includes identity determination unit 120 and steering angle control unit 160. Identity determination unit 120 determines whether a first operator ORF, who operates first operator 2F (steering operation), is the same as a second operator ORS, who operates second operator 2S. When identity determination unit 120 determines that "the first operator ORF and the second operator ORS are different," steering angle control unit 160 controls the steering angle SA of vehicle VH based on the first steering operation SOF for first operator 2F or the second steering operation SOS for second operator 2S.
[0081] The information processing method PM according to this embodiment is an information processing method that causes a processor (e.g., the CPU of the information processing device 1) to execute a process for controlling the steering angle SA of the vehicle VH. The information processing method PM causes the processor to execute step S140 and step S190 or step S200, as illustrated in FIG. 6 . In step S140, the processor determines whether the main operator (first operator ORF) and the sub-operator (second operator ORS) are the same. If the main operator (first operator ORF) and the sub-operator (second operator ORS) are different, the processor executes step S190 or step S200. In step S190, the processor controls the steering angle SA of the vehicle VH based on a second steering operation SOS for the sub-operator (second operator 2S). In step S200, the processor controls the steering angle SA of the vehicle VH based on a first steering operation SOF for the main operator (first operator 2F). In other words, if it is determined in step S140 that "the first operator ORF and the second operator ORS are different," the processor controls the steering angle SA of the vehicle VH based on the first steering operation SOF for the first operator 2F or the second steering operation SOS for the second operator 2S.
[0082] As explained above, the information processing device 1 (information processing method PM) determines whether the first operator ORF performing the steering operation SO with respect to the first operator 2F is the same as the second operator ORS performing the steering operation SO with respect to the second operator 2S. If the first operator ORF and the second operator ORS are different, the information processing device 1 (information processing method PM) controls the steering angle SA of the vehicle VH based on only one of the steering operations SO, the first steering operation SOF by the first operator ORF and the second steering operation SOS by the second operator ORS. For example, if it is determined that the first operator 2F is operated by the driver DR and the second operator 2S is operated by a person other than the driver DR, the information processing device 1 (information processing method PM) controls the steering angle SA of the vehicle VH based on only one of the steering operations SO by the driver DR and the steering operation SO by a person other than the driver DR. Therefore, for a vehicle VH equipped with a first operator 2F and a second operator 2S, even when one operator 2 is operated by the driver DR and the other operator 2 is operated by a person other than the driver DR, the information processing device 1 (information processing method PM) can control the steering angle SA based on the steering operation SO by the driver DR or the steering operation SO by a person other than the driver DR. In other words, the information processing device 1 (information processing method PM) can handle cases where one of the operators 2 of a vehicle VH, each of which is capable of accepting a steering operation SO, is operated by a person other than the driver DR, by controlling the steering angle SA of the vehicle VH based on the steering operation SO by the driver DR or the steering operation SO by a person other than the driver DR.
[0083] §4 Modifications Although the embodiments of the present invention have been described in detail above, the above description is merely illustrative of the present invention in every respect. It goes without saying that various improvements or modifications can be made without departing from the scope of the present invention. For example, the following modifications are possible. Note that, below, the same reference numerals are used for components similar to those in the above embodiment, and descriptions of similar points to those in the above embodiment are omitted where appropriate. The following modifications can be combined as appropriate.
[0084] In the above embodiment, an example has been described in which the information processing device 1, the operator processing unit 3, and the steering ECU 4 are each configured as separate computers. However, the configuration of the information processing device according to this embodiment is not limited to this example and may be determined appropriately depending on the embodiment. For example, the information processing device 1 may be configured as a computer integrated with at least one of the operator processing unit 3 and the steering ECU 4. Furthermore, at least one of the information processing device 1, the operator processing unit 3, and the steering ECU 4 may be configured as a plurality of computers.
[0085] The vehicle VH may be equipped with an imaging device (camera) that captures images of the interior of the vehicle VH. The imaging device has an angle of view adjusted so as to capture at least the person operating the first operator 2F and the person operating the second operator 2S. If a single imaging device cannot capture the image of the person operating the first operator 2F and the person operating the second operator 2S, multiple imaging devices may be provided, and the multiple imaging devices may be configured to capture the image of the person operating the first operator 2F and the person operating the second operator 2S. The imaging device may be provided, for example, near the front of the driver's seat. For example, the imaging device may be provided near the top of the windshield, approximately in the center of the vehicle width direction of the vehicle VH.
[0086] The identity determination unit 120 may acquire captured images of "a person operating the first operator 2F and a person operating the second operator 2S" from the above-mentioned imaging device, and use the acquired captured images to determine the identity of the first operator ORF and the second operator ORS.
[0087] Similarly, the physical condition confirmation unit 130 may use the captured image to confirm the physical condition of each of the first operator ORF and the second operator ORS. For example, the physical condition confirmation unit 130 may confirm the physical condition of each of the first operator ORF and the second operator ORS by determining whether the eyes are closed, the body (head) is unsteady, or the posture is poor from the "face (head) and body of each of the first operator ORF and the second operator ORS" captured in the captured image. Furthermore, if the captured image is captured by an infrared camera, the physical condition confirmation unit 130 may confirm the physical condition of each of the first operator ORF and the second operator ORS by determining whether the body temperature of each of the first operator ORF and the second operator ORS is abnormally high or low.
[0088] REFERENCE SIGNS LIST 1...information processing device, 2F...first operator (first operator), 2S...second operator (second operator), 120...identity determination unit, 160...steering angle control unit, IB...biometric information, ORF...first operator, ORS...second operator, PM...information processing method, SA...steering angle, SO...steering operation, VH...vehicle
Claims
1. An information processing method that causes a processor to execute a process for controlling the steering angle of a vehicle that has a first operator and a second operator that can each receive a steering operation, wherein the processor executes the following steps: determining whether a first operator who operates the first operator is the same as a second operator who operates the second operator; and, if it is determined in the step of determining whether the first operator and the second operator are different, controlling the steering angle based on the operation performed on the first operator or the operation performed on the second operator.
2. The information processing method of claim 1, wherein the processor further executes a step of designating one of the first operator and the second operator as a main operator and the other as a sub-operator, and when it is determined in the step of determining identity that the first operator and the second operator are different, in the step of controlling the steering angle the processor controls the steering angle based on the operation on the main operator.
3. The information processing method of claim 1 or 2, wherein the processor further executes a step of acquiring biometric information of each of the first operator and the second operator, and in the step of determining identity, the processor determines whether the biometric information of the first operator acquired in the step of acquiring biometric information matches the biometric information of the second operator.
4. The information processing method according to claim 1 or 2, wherein in the step of determining identity, the processor determines whether a body area network (BAN) has been established between the first operator and the second operator.
5. The information processing method of claim 1, wherein the processor further executes a step of checking the physical condition of each of the first operator and the second operator, and in the controlling step, when the step of determining identity determines that the first operator and the second operator are different and the step of checking the physical conditions confirms that the physical condition of one of the first operator and the second operator is normal and the physical condition of the other is abnormal, the processor controls the steering angle based on the operation by the first operator or the second operator whose physical condition has been confirmed to be normal.
6. The information processing method of claim 5, wherein, in the step of checking the physical condition, if it is confirmed that the physical condition of one of the first operator and the second operator is normal and the physical condition of the other is abnormal, the processor invalidates operations from the first operator or the second operator whose physical condition is confirmed to be abnormal.
7. An information processing method according to claim 1 or 2, wherein, when it is determined in the step of determining identity that the first operator and the second operator are the same, the processor further executes a step of controlling the operation of at least one of the first operator and the second operator to link the first operator and the second operator with each other.
8. The information processing method according to claim 7, wherein if it is determined in the step of determining identity that the first operator and the second operator are different, the processor does not execute the step of linking.
9. The information processing method according to claim 2, wherein the processor controls the steering angle based on the operation on the main operator until the execution of the step of determining the identity is completed.
10. The information processing method described in claim 2, wherein the first operator and the second operator are a pair of left and right operators provided at the driver's seat of the vehicle, and the processor designates, of the first operator and the second operator, the operator on the door side of the driver's seat as the main operator, and the operator on the console side of the driver's seat as the sub-operator.
11. The information processing method described in claim 2, wherein the first operator and the second operator are a pair of left and right operators provided at the driver's seat of the vehicle, and the processor designates the operator of the first operator and the second operator that is closer to a seat other than the driver's seat as the auxiliary operator, and the other operator as the main operator.
12. The information processing method of claim 2, wherein the first operator and the second operator are a pair of left and right operators provided on the driver's seat of the vehicle, and the processor further executes a step of determining which of the first operator and the second operator is operated more frequently, and the processor designates the operator of the first operator and the second operator that is operated more frequently as the main operator, and the operator that is operated less frequently as the sub-operator.
13. The information processing method described in claim 2, wherein the first operator and the second operator are a pair of left and right operators provided on the driver's seat of the vehicle, and the processor designates one of the first operator and the second operator as the main operator and the other as the sub-operator based on a user operation to select the main operator and the sub-operator.
14. An information processing method as described in claim 1 or 2, wherein, when it is determined in the step of determining identity that the first operator and the second operator are different, the processor notifies at least one of the first operator and the second operator of the determination result that the first operator and the second operator are different.
15. An information processing device that controls the steering angle of a vehicle equipped with a first operator and a second operator, each capable of receiving a steering operation, comprising: an identity determination unit that determines whether a first operator who operates the first operator is the same as a second operator who operates the second operator; and a steering angle control unit that controls the steering angle based on the operation performed on the first operator or the operation performed on the second operator when the identity determination unit determines that the first operator and the second operator are different.
Citation Information
Patent Citations
Moving body driving device
JP2006273202A
Right and left interlocking operation device
JP2011138311A
Auxiliary steering gear of vehicle
JP2017178145A
Vehicle control system, vehicle control method, and vehicle control program
JP2017206153A
Steering device
JP2024001626A