Information processing apparatus and information processing method

Abstract

An information processing apparatus includes: a first display; an operation unit arranged in parallel with the first display; a second display disposed on at least one surface of the operation unit; and a controller configured to move display content displayed on the second display from the second display to the first display, and display the display content on the first display.

Description

Technical Field

[0001] The present disclosure relates to an information processing device and an information processing method. Background Art

[0002] An operating device of Japanese Patent Application Publication No. 2018-34675 (hereinafter referred to as Patent Document 1) includes a dial knob and a detection unit configured to detect a flick operation on the tip surface of the dial knob, selects one of a plurality of change targets related to the vehicle air conditioner based on the detected flick operation, and displays an image on a display unit, the image showing the state of the selected change target.

[0003] In the device of Patent Document 1, the display area is limited to a narrow space on the top surface of the dial knob, so it is difficult for the user to recognize the display content.

[0004] Specifically, when the dial knob is operated, the display is blocked by the user's hand, and it is difficult to recognize the display content when the dial knob is operated. Summary of the invention

[0005] One aspect of an embodiment of the present disclosure is: in controlling information processing of a second display provided on at least one surface of an operating unit arranged in parallel with a first display, the visibility of display content displayed on the second display is improved by moving the display content displayed on the second display to the first display, wherein the display space is not limited by the size of the operating unit.

[0006] The embodiments of the present disclosure take an information processing device as an example. The information processing device includes: a first display; an operation unit arranged in parallel with the first display; a second display provided on at least one surface of the operation unit; and a controller configured to move display content displayed on the second display from the second display and display the display content on the first display.

[0007] The controller of the present disclosure can improve visibility of displayed content in information processing of controlling a second display provided on at least one surface of an operation unit arranged in parallel with a first display. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Exemplary embodiments of the present disclosure will be described in detail based on the following drawings, in which:

[0009] Figure 1 is an external perspective view showing a display device and an operation unit of a CID serving as an in-vehicle system according to the first embodiment;

[0010] Figure 2 is a diagram showing a schematic configuration of a display device and an operation unit;

[0011] Figure 3 is an exploded perspective view showing the structure of an operating unit;

[0012] Figure 4 is a diagram showing the effect achieved by the optical fiber bundle within the operating unit;

[0013] Figure 5 Shown by Figure 4 Effects achieved by the modified example of the operation unit shown;

[0014] Figure 6 shows the hardware configuration of the vehicle-mounted system;

[0015] Figure 7 is an example of a character that personifies display content provided by an operating unit of an in-vehicle system;

[0016] Figure 8 is an example of display content provided by an operating unit of an in-vehicle system;

[0017] Fig. 9 is a diagram showing a display control process in an in-vehicle system;

[0018] Fig.10 is a diagram showing an example of changing a display mode of displayed content;

[0019] Fig.11 is a diagram showing a modified example of the operation unit;

[0020] Fig.12 is a diagram showing a drive control process of an operation unit in an in-vehicle system;

[0021] Fig.13 is a diagram showing a hardware configuration of an in-vehicle system according to a second embodiment;

[0022] Fig.14 is a diagram showing a display control process in the in-vehicle system according to the second embodiment;

[0023] Fig.15 is a diagram showing a hardware configuration of an in-vehicle system according to a third embodiment;

[0024] Fig.16 is a diagram showing a display control process in a vehicle-mounted system according to a third embodiment;

[0025] Fig.17 is a diagram showing an example of a process of moving display content to a position where a touch operation is performed;

[0026] Fig.18 is a diagram showing an example of a function selection menu;

[0027] Fig.19It shows Fig.18 A diagram showing a state in which a function icon in is moved;

[0028] Fig. 20 is a diagram showing a hardware configuration of an in-vehicle system according to a fourth embodiment;

[0029] Fig.21 is a diagram showing the arrangement of a display unit in a vehicle;

[0030] Fig. 22 is a diagram showing an example in which a character 61 moves between display units provided on seats arranged left and right;

[0031] Fig.23 is a diagram showing an example in which a character 61 moves between display units provided on seats arranged front and back;

[0032] Fig.24 is a diagram showing an example in which a display unit on the driver's seat side and a display unit on the passenger's seat side are provided on a pillar;

[0033] Fig.25 is a diagram showing an example in which a display device is provided on a ceiling surface; and

[0034] Fig.26 is a diagram showing an example including a projection device that projects an image onto a floor surface. DETAILED DESCRIPTION

[0035] First embodiment

[0036] Hereinafter, a vehicle-mounted system 100 according to an embodiment and an information processing method performed by the vehicle-mounted system 100 will be described with reference to the accompanying drawings. The vehicle-mounted system 100 includes, for example, a central information display (CID) provided in front of a driver's seat of a vehicle, and performs processing of an interactive system that performs display output to a user according to an operation performed by the user on an operation unit.

[0037] Configuration

[0038] Figure 1 is an external perspective view showing the display device 14 and the operation unit 20 serving as the CID of the in-vehicle system 100, and Figure 2 is a diagram showing a schematic configuration of the display device 14 and the operation unit 20, wherein Figure 2 (A) shows a front view and Figure 2 (B) shows a side view. Figure 1 and Figure 2 In the example shown, the display device 14 is embedded in a dashboard 40 of the vehicle.

[0039] The operation unit 20 includes a shell 201 and a support mechanism 30 that supports the shell 201, and the operation unit 20 is a physical interface that can accept user operations. The shell 201 has a tubular shape, for example, and has two end surfaces perpendicular to the central axis. The shell 201 has openings formed on the two end surfaces, and the edges of the openings and the cross-section of the shell 201 are annular. The operation unit 20 may have a cylindrical shape or may have a rectangular tube shape. However, the shape of the operation unit 20 is not limited to a tubular shape, a cylindrical shape, a rectangular tube shape, and the like, and may be various shapes, such as a polyhedron shape, a cylindrical shape and a rectangular tube shape having a taper, a slope, and the like, and a shape including a quadratic surface. The operation unit 20 is arranged on the lower side of the display device 14 as the first display in parallel with the display device 14. At Figure 1 In the example, the operating unit 20 is disposed at the center of the lower side of the display device 14 in the left-right direction, the upper portion of the operating unit 20 is located above the lower side of the display device 14, and the lower portion of the operating unit 20 is located below the lower side of the display device 14. The present disclosure is not limited to this, and the entire operating unit 20 may be located above the lower side of the display device 14, or may be located completely below the lower side of the display device 14. Although the operating unit 20 of the present embodiment is disposed adjacent to the display device 14, the present disclosure is not limited to this, and the operating unit 20 may be disposed together with the display device 14 at a position where the user can view the display device 14, and may be disposed separately from the display device 14. Here, the rear surface of the housing 201 facing the display device 14 is referred to as a facing surface, and the surface opposite to the facing surface is referred to as a display surface 202. Inside the housing 201, an optical fiber bundle 203 (see Figures 3 to 5 ) is arranged in a direction in which the opening of the display surface 202 is connected to the opening of the facing surface (rear surface), and a light guide path is formed to project the light from the display element 14A of the display device 14 onto the display surface 202. Therefore, in the operation unit 20, the display surface 202 acts as a second display, and a portion of the display element 14A facing the facing surface (rear surface) as a surface opposite to the display surface 202 can be projected onto the display surface 202. The operation unit 20 is not limited to a configuration in which light displayed on the display device 14 is guided to the display surface 202, and the operation unit 20 itself may have a function as a display device. Specifically, a display device such as a liquid crystal display or an organic light emitting display (OLED) may be provided in the housing 201, and the display may be wired via a support mechanism 30 or the like.

[0040] The operation unit 20 is supported from below in the vertical direction by the support mechanism 30. As described above, since the display device 14 of the present embodiment is embedded in the instrument panel 40 of the vehicle, the left-right direction of the display element 14A is the left-right direction relative to the traveling direction of the vehicle.

[0041] Figure 3 20 is an exploded perspective view showing the structure of the operation unit 20. Figure 1 and Figure 2 As described above, the operation unit 20 is installed so that its rear surface faces the display device 14. Figure 3 As shown, the operation unit 20 includes a housing 201, a fingerprint sensor 22, a touch sensor 23, a dial switch 25, a button switch 26, and an optical fiber 203. The operation unit 20 displays the processing status of the in-vehicle system 100 and the like on a display surface 202 serving as a second display, and receives input from a user via the fingerprint sensor 22, the touch sensor 23, the dial switch 25, the button switch 26, and the like. Figure 3 In addition to the configuration shown, the operating unit 20 also includes a thermal sensor 24A, an infrared sensor 24B, and an illuminance sensor 27 ( Figure 6 ).

[0042] The housing 201 has a tubular shape, forms a side surface of the operating unit 20 having an annular cross section, and has an annular edge at both ends of the tubular shape. Therefore, the housing 201 forms a shell having an annular opening at both ends. The housing 201 may be decorated and is also referred to as a decorative portion.

[0043] A flat and circular touch sensor 23 is provided on the display surface 202 of the operating unit 20. The touch sensor 23 has a configuration similar to a touch panel provided in a general mobile device (e.g., a smart phone). For example, the touch sensor 23 includes a first electrode row arranged in parallel along a first direction (referred to as the X-axis direction) on a plane and a second electrode row arranged in parallel along a second direction (referred to as the Y-axis direction) perpendicular to the first direction. The touch sensor 23 uses two electrode rows to detect the operation of the user's finger based on a change in the capacitance of the user's finger by using X-axis and Y-axis coordinate values. However, the touch sensor 23 is not limited to a capacitive sensor, and may be, for example, a pressure-sensitive sensor. Although Figure 3 Although not shown in the figure, a transparent protective film may be provided on the upper surface of the touch sensor 23 (on the display surface 202 side).

[0044] The fingerprint sensor 22 is, for example, a capacitive sensor. The fingerprint sensor 22 measures capacitance based on the unevenness of the fingerprint in contact with the front surface (display surface 202) of the operation unit 20, and forms a two-dimensional image, thereby forming a fingerprint image. However, the fingerprint sensor 22 is not limited to a capacitive sensor. For example, the fingerprint sensor 22 may be an array of a charge coupled device (CCD) or a metal oxide semiconductor (MOS) image sensor. When the fingerprint sensor 22 is an array of image sensors, a fingerprint image is generated in the same manner as the camera 21.

[0045] When the user rotates the housing 201 clockwise or counterclockwise, the dial switch 25 outputs a physical quantity or an electrical signal corresponding to the rotation amount. The in-vehicle system 100 obtains the value of the physical quantity or the value of the electrical signal strength corresponding to the rotation amount from the dial switch 25. The dial switch 25 has a tubular shape, which is slidably inscribed in the tubular inner surface of the housing 201.

[0046] When the user rotates the housing 201 clockwise or counterclockwise, the contact point between the inner surface of the housing 201 and the dial switch 25 changes, and the resistance value, voltage value, etc. between the terminals drawn from the dial switch 25 change. The vehicle-mounted system 100 detects the rotation amount and rotation direction of the housing 201 based on the change in the resistance value, voltage value, etc. between the terminals of the dial switch 25. For example, when the housing 201 rotates clockwise, the resistance value, voltage value, etc. increase (or decrease) from the initial value. For example, when the housing 201 rotates counterclockwise, the resistance value, voltage value, etc. decrease (or increase) from the initial value. If the change in the resistance value, voltage value, etc. between the terminals output from the dial switch 25 is within the reference value, the vehicle-mounted system 100 determines that the switch is disconnected, and if the change exceeds the reference value, the vehicle-mounted system 100 determines that the switch is turned on. As described above, the operation unit 20 can accept the user's rotation operation. That is, the operation unit 20 can be physically rotatable. However, the dial switch 25 can be omitted. If the dial switch 25 is omitted, the housing 201 of the operation unit 20 may not rotate. When the housing 201 of the operation unit 20 does not rotate, the operation unit 20 may detect a rotation operation performed by a user's hand through the touch sensor 23 .

[0047] The dial switch 25 is not limited to a dial switch that detects changes in resistance values, voltage values, etc. between terminals. For example, a general rotary encoder can be used as the dial switch 25. For example, the dial switch 25 can be a dial switch in which a plurality of windows are arranged in the tubular side wall in the circumferential direction, and it is determined whether light is transmitted between the inside and outside (the inner surface side of the housing 201) of the tubular side wall of the dial switch 25. For example, a light emitting unit such as an LED can be arranged on the inner surface side of the housing 201, and a light receiving unit such as a photodiode can be arranged inside the tubular side wall of the dial switch 25 to receive light passing through the window from the light emitting unit. By changing and arranging the windows in stages such as large, medium, and small, the amount of light received by the light receiving unit or the light receiving time changes. The direction of rotation can also be determined depending on whether the direction of the change is large, medium, or small.

[0048] When the button switch 26 is pressed, the contact point is closed, the electrical signal flows between the contact points, and the user's operation is detected. In the present embodiment, four button switches 26 are arranged between the dial switch 25 and the ring 204, and the ring 204 is arranged at the lower side of the dial switch 25. Four button switches 26 are arranged at the center position of each arc area, and the arc area divides the ring 204 into, for example, four fan-shaped arcs, and the fan-shaped arc divides the circular ring 204 into 90 degrees at the center of the ring 204. Therefore, when the user presses the housing 201 uniformly, the four button switches 26 can be turned from disconnected to on at the same time. When the user presses the position corresponding to the middle of one of the two ring parts divided from the ring 204 on the housing 201, the two button switches 26 can be turned from disconnected to on. In addition, when the user presses the position corresponding to the four 90-degree fan-shaped parts divided from the ring 204 on the housing 201, only one button switch 26 can be turned from disconnected to on. The number of the button switches 26 is not limited to 4, and may be 1 to 3, or 5 or more. If the number of the button switches 26 is less than four, the in-vehicle system 100 can construct a simple user interface. If the number of the button switches 26 is five or more, the in-vehicle system 100 can detect user operations in detail.

[0049] The optical fiber 203 is inserted into a bundle in a tubular space inside the housing 201 and between an opening in the rear surface of the operating unit 20 and an opening in the display surface 202. The optical fiber 203 bundle projects a portion of the display element 14A facing the rear surface of the operating unit 20 onto the display surface 202 of the operating unit 20.

[0050] Figure 4 2 is a diagram showing the effect achieved by the bundle of optical fibers 203 in the operating unit 20. Figure 3 As shown, a portion of the rear surface of the display element 14A facing the operation unit 20 is projected onto the display surface 202 of the operation unit 20 through the optical fiber 203 .

[0051] Figure 5 Shown by Figure 4 The effect achieved by the modified example of the operation unit 20 shown in FIG. Figure 5In the embodiment of the present invention, the optical fiber 203 bundle gradually expands in the range from the rear surface of the operation unit 20 to the display surface 202, and has a tapered shape. That is, in the optical fiber 203 bundle, the gaps between the optical fibers 203 at the portion close to the rear surface of the operation unit 20 are narrow and dense, and the gaps between the optical fibers 203 at the portion close to the display surface 202 of the operation unit 20 are wide. Alternatively, the outer diameter of each optical fiber 203 may be thinner at the portion close to the rear surface of the operation unit 20, and the outer diameter of the optical fiber 203 may be thicker at the portion close to the display surface 202 of the operation unit 20. Due to this optical fiber 203 bundle, the number of pixels per unit area of ​​the image on the display surface 202 is lower than the number of pixels of the display element 14A of the display device 14, and the fineness (resolution) is reduced, but the entire image is magnified. That is, the portion of the display element 14A facing the rear surface of the operation unit 20 is magnified and projected onto the display surface 202. In this case, even if the display element 14A has a substantially rectangular shape, the lower side of the display surface 202 may be provided to protrude below the lower side of the display device 14 .

[0052] Figure 6 1 shows a hardware configuration of an in-vehicle system 100. The in-vehicle system 100 includes a control unit 10 and external devices connected to the control unit 10 via an interface (I / F). The control unit 10 includes a CPU 11 and a main storage device 12. The external devices include an external storage device 13, a display device 14, an input unit 15, a communication device 16, a microphone 17, a camera 21, a speaker 28, an operation unit 20, and a car navigation system 50.

[0053] The CPU 11 executes a computer program loaded in the main storage device 12 in an executable manner, and provides the functions of the vehicle-mounted system 100. The CPU 11 is also referred to as a processor. However, the CPU 11 is not limited to a single processor, and can be implemented by multiple processors. The CPU 11 can be a single processor connected by a single socket, and can have a multi-core configuration. In addition, at least a portion of the processing of the vehicle-mounted system 100 can be provided by a dedicated processor (e.g., a digital signal processor (DSP), a graphics processing unit (GPU), a numerical calculation processor, a vector processor, and an image processing processor, an application-specific integrated circuit (ASIC), etc.). At least a portion of the vehicle-mounted system 100 can be a dedicated large-scale integration (LSI), such as a field programmable gate array (FPGA) or other digital circuits. At least a portion of the vehicle-mounted system 100 can include an analog circuit.

[0054] The main storage device 12 is also simply referred to as a memory, and stores computer programs executed by the CPU 11, data processed by the CPU 11, etc. The main storage device 12 is a dynamic random access memory (DRAM), a static random access memory (SRAM), a read only memory (ROM), or the like.

[0055] The external storage device 13 is used as a storage area for supplementing the main storage device 12, and stores a computer program executed by the CPU 11, data processed by the CPU 11, etc. The external storage device 13 is a hard disk drive, a solid state drive (SSD), etc. In addition, the in-vehicle system 100 may be provided with a drive device for a removable storage medium. The removable storage medium is, for example, a Blu-ray disc, a digital versatile disc (DVD), a compact disc (CD), or a flash memory card.

[0056] The display device 14 is, for example, a liquid crystal display or an electroluminescent panel. The input unit 15 is, for example, a keyboard or a pointing device. In the present embodiment, a touch panel is exemplified as a pointing device. The communication device 16 exchanges data with other devices on a wireless network. The wireless network is, for example, a mobile phone network. The microphone 17 obtains the user's voice. That is, the microphone 17 acts as a voice detection unit that detects the user's voice. The number of microphones 17 is not limited to one, and a plurality of microphones may be provided. The microphone 17 may be provided in the operating unit 20.

[0057] The camera 21 may be provided near the operation unit 20, or may be provided anywhere in the passenger compartment. The camera 21 has an array of, for example, CCD or MOS image sensors, and transmits an image as pixel array data to the CPU 11. The CPU 11 obtains a video from the camera 21 at a predetermined frame rate (for example, 10 frames / second to 120 frames / second). In the present embodiment, an image including a plurality of series of frames is referred to as a video. An object included in one frame is referred to simply as an image.

[0058] The speaker 28 includes, for example, a piezo element. The speaker 28 receives an electrical signal, converts the electrical signal into mechanical vibration of the piezo element, and generates sound in front of the display device 14. The speaker 28 may be provided near the operation unit 20. The speaker 28 may be provided anywhere in the passenger compartment. The car navigation system 50 includes map information, and has a function of determining the position of the own vehicle and displaying the position of the own vehicle on a map, and a function of providing route guidance to a set destination.

[0059] The operation unit 20 includes a touch sensor 23, a thermal sensor 24A, an infrared sensor 24B, a dial switch 25, a button switch 26, and an illumination sensor 27. Each part of the operation unit 20 is connected to the CPU 11 via an interface I / F. The touch sensor 23, the dial switch 25, and the button switch 26 are Figure 3 The touch sensor 23, dial switch 25 and button switch 26 described in FIG.

[0060] The thermal sensor 24A is also called a thermal imaging camera. The thermal sensor 24A measures the temperature distribution of the object to be captured based on the intensity of infrared or far infrared in the image using infrared or far infrared. The thermal sensor 24A uses an array of, for example, pixel sensors to output infrared image data. The pixel sensor is, for example, an element made of a compound semiconductor (e.g., InGaAs, GaAs, ALGaAs, InAs or GaSb) or a stack thereof, such as a photodiode or a phototransistor. However, as a pixel sensor, an array of thermocouples (thermopiles) can be used instead of an array of compound semiconductor elements. The thermal sensor 24A may include a filter that selects infrared within a specific wavelength range from the reflected light from the object. The thermal sensor 24A may be disposed at the edge of the operating unit 20 (housing 201). The thermal sensor 24A may be separated from the operating unit 20 and disposed near the operating unit 20. The thermal sensor 24A may be disposed at an optional position in the passenger compartment and away from the operating unit 20.

[0061] The infrared sensor 24B measures the temperature of the object based on the intensity of the infrared rays from the object. However, the infrared sensor 24B does not measure the temperature distribution of the object like the thermal sensor 24A, but measures the temperature based on the amount of infrared rays emitted from a specific position of the object, for example. The infrared sensor 24B includes, for example, a thermopile. However, the infrared sensor 24B can utilize the pyroelectric effect of ferroelectric ceramics. Similar to the thermal sensor 24A, the infrared sensor 24B can use an element made of a compound semiconductor (e.g., a photodiode or a phototransistor). The infrared sensor 24B can be arranged at the edge of the operating unit 20 (housing 201). The infrared sensor 24B can be separated from the operating unit 20 and arranged near the operating unit 20. The infrared sensor 24B can be arranged at an optional position in the passenger compartment and away from the operating unit 20.

[0062] The illuminance sensor 27 measures the illuminance near the display surface 202 of the operation unit 20 by using elements such as a photodiode, a phototransistor, and a photoresistor. The illuminance sensor 27 may be provided at the edge of the operation unit 20 (housing 201).

[0063] Show examples

[0064] refer to Figure 7 and Figure 8 The display contents in the in-vehicle system 100 are shown. Figure 7 is an example of a character 61 that personifies display content provided by the operation unit 20 of the in-vehicle system 100. Here, the character 61 is a symbolic graphic expression for expressing the state of the operation unit 20. The in-vehicle system 100 uses the operation of the operation unit 20, the detection of a specific voice, the touch operation (touch gesture) on the display device 14, etc. as a movement trigger (movement opportunity) to move the character 61 displayed on the display surface 202 of the operation unit 20 to the display device 14, and display the character 61 on the display device 14.

[0065] Figure 7 (A) in FIG. 1 shows a state where the character 61 is displayed on the display surface 202 as the second display. Figure 7 (B) in FIG. 1 shows a process in which the character 61 is moving from the display surface 202 to the display device 14. Figure 7 In (B), the character 61 is deformed so as to pull the tail 61a, but the character 61 can move without being deformed. Figure 7 (C) in FIG. 1 shows a state where the character 61 is displayed on the display device 14 as the first display. Figure 7 In (C), the tail 61a is shown as being broken and the droplets 61b remain on the trajectory of the character, but the droplets 61b do not necessarily have to be displayed. For example, when the character 61 is displayed on the display device 14, the droplets 61b may be displayed continuously, or the droplets 61b may be erased over time in order of distance from the character 61. In this way, the in-vehicle system 100 moves the character 61 displayed on the display surface 202 to the display device 14 whose display space is not limited by the size of the operation unit 20, and displays the character 61 on the display device 14, so that the character 61 can be displayed in a large size and the visibility of the character 61 can be improved. By performing a display in which the character 61 pulls the tail 61a or leaves the droplets 61b when the character 61 moves, the in-vehicle system 100 can visually indicate more clearly that the character 61 is moving.

[0066] Figure 8 is an example of the display content 62 provided by the operation unit 20 of the in-vehicle system 100. Here, the display content 62 is a graphical expression showing a numerical value, an icon, etc. for expressing the state of the operation unit 20. Figure 8In the example of , the user selects the temperature setting function of the air conditioner of the in-vehicle system 100, and the display content 62 is the set temperature of the air conditioner. The in-vehicle system 100 uses the operation of the operation unit 20, the detection of a specific voice, the touch operation on the display device 14, etc. as a movement trigger to move the display content 62 displayed on the display surface 202 of the operation unit 20 to the display device 14 and display the display content 62 on the display device 14. Figure 8 (A) in FIG. 1 shows a state where the display content 62 is displayed on the display surface 202 as the second display. Figure 8 (B) in FIG. 1 shows the process in which the display content 62 is moving from the display surface 202 to the display device 14 . Figure 8 (C) in FIG. 1 shows a state where the display content 62 is displayed on the display device 14 as the first display. In this way, the in-vehicle system 100 moves the display content 62 displayed on the display surface 202 to the display device 14 whose display space is not limited by the size of the operation unit 20, and displays the display content 62 on the display device 14, so that the display content 62 can be displayed in a large size and the visibility of the display content 62 can be improved. Figure 8 In the example of , display effects such as deforming the display content 62 so as to pull a tail as the display content 62 moves or leaving droplets on the movement track of the display content 62 are also applied, and it can be visually indicated more clearly that the display content 62 is moving. Figure 8 The example is a case where the user selects the temperature setting function of the air conditioner of the vehicle-mounted system 100, and the displayed content 62 is a number representing the set temperature, but the present embodiment can also be applied to functions other than the temperature setting function of the air conditioner, such as the air volume setting function, the voice volume setting function, and the radio or TV channel selection function of the air conditioner, and in this case, the displayed content 62 can be a number representing the air volume or voice volume, or a number representing the radio frequency or TV channel.

[0067] Processing Example

[0068] The control unit 10 of the vehicle-mounted system 100 executes the computer program loaded into the main storage device 12 in an executable manner. Fig. 9 Processing shown.

[0069] Fig. 9 1 is a diagram showing a display control process in the in-vehicle system 100. For example, the control unit 10 of the in-vehicle system 100 periodically executes the display control process from the start to the stop of the in-vehicle system 100. Fig. 9 Display control processing in .

[0070] If you start Fig. 9, the in-vehicle system 100 determines whether an operation performed by the user on the operation unit 20 is detected (S51). For example, if there is a change in the detection result obtained by the touch sensor 23, the fingerprint sensor 22, the dial switch 25, or the button switch 26, the in-vehicle system 100 determines "YES", and if there is no change in the detection result, determines "NO".

[0071] If "No" is determined in step S51, the in-vehicle system 100 determines whether a specific voice is detected via the microphone (S52). Here, the specific voice is a predetermined phrase, and may be, for example, a voice of a user for a character, such as "Hey! ○○○ (○○○ is the name of the character)". The specific voice may be a phrase indicating an operation such as "lower the temperature of the air conditioner", "turn up the voice volume", or "turn on the radio".

[0072] If "No" is determined in step S52, the in-vehicle system 100 detects the user's action from the image of the camera 21 and determines whether a specific gesture is detected (S53). Here, the specific gesture is a predetermined action, such as "waving", "making a gesture to operate the operation unit", or "pointing to the operation unit 20".

[0073] If "No" is determined in step S53, the vehicle-mounted system 100 identifies the position of the user's eyes and the position of the operation unit 20 from the image of the camera 21, and if the operation unit 20 is viewed from the position of the user's eyes, the vehicle-mounted system 100 determines whether an object such as a steering wheel or luggage is covering the operation unit 20 (S54).

[0074] If “NO” is determined in step S54 , the in-vehicle system 100 determines whether the temperature inside the vehicle reaches a predetermined value for issuing a push notification based on information from the thermal sensor 24A ( S55 ).

[0075] If "No" is determined in step S55, the in-vehicle system 100 determines whether there is traffic information for issuing a push notification based on the information of the car navigation system 50 (S56). If "No" is determined in step S56, the in-vehicle system 100 ends. Fig. 9 in the processing.

[0076] If "yes" is determined in steps S51 to S56, that is, if a motion trigger is detected, the in-vehicle system 100 performs the following steps: Figure 7 and Figure 8 The mobile display process of the display content shown (S57) is performed. The in-vehicle system 100 changes the display mode of the display content based on the input information (S58). Fig.10 is a diagram showing an example of changing the display mode of displayed content. Fig.10 As shown in (A) in FIG. 1 , when the user rotates the operation unit 20, the in-vehicle system 100 rotates the character 61 according to the rotation amount of the operation unit 20. When the user presses the operation unit 20, the in-vehicle system 100 can perform a display in which the character 61 temporarily moves to the back. Fig.10 As shown in (B), when the user performs a grip operation on the operation unit 20, the in-vehicle system 100 can display the character 61 in a manner that narrows its width. By changing the display mode according to the operation in this manner, feedback that the operation is performed can be provided to the user, and the user can easily understand the operation.

[0077] When the value of the voice volume or the set temperature is changed by the operation of the operation unit 20, the brightness or color of the display content 62 can be changed according to the changed value. For example, when the voice volume is increased, the brightness can be increased according to the increase amount, and when the voice volume is decreased, the brightness can be decreased according to the decrease amount. When the set temperature is set high, the display can be performed in a warm color such as red, and when the set temperature is set low, the display can be performed in a cool color such as blue. Fig.10 As shown in (C) in FIG. 1 , the in-vehicle system 100 may display the same Figure 8 , and the display content can be displayed in a rotational manner in conjunction with the rotation operation of the operation unit 20. In this case, a numerical value moved to the center of the display device 14 (directly above the operation unit 20) by rotation can be made effective as a setting value. For example, when the display content represents the temperature setting value of the air conditioner, "24" representing 24°C is first displayed in the center of the display device 14, and when "23" representing 23°C is moved to the center of the display device 14 in conjunction with the rotation operation of the operation unit 20, 23°C becomes effective as the temperature setting value of the air conditioner. Instead of rotating the display content, the cursor placed on the display item or the highlight can be moved. For example, in a state where the cursor is first placed on "24" representing 24°C in the display content or "24" is highlighted, when the cursor or the highlight is moved to "23" representing 23°C in conjunction with the rotation operation of the operation unit 20, 23°C can become effective as the temperature setting value of the air conditioner. Furthermore, a scale 63 may be displayed that can rotate together with the operation unit 20, and the rotation amount of the operation unit 20 may be displayed in an easily understandable manner by using the scale 63. If the movement display control is performed without any operation performed by the user (e.g., push notification), the change of the display mode in step S58 may be skipped.

[0078] After step S58, the in-vehicle system 100 determines whether a return condition of the display content is satisfied (S59), and the return condition includes, for example, a case where the user's gaze is away from the display device 14 or the display surface 202 for a predetermined time or longer, or a case where no operation is performed on the in-vehicle system 100 for a predetermined time or longer. For example, the in-vehicle system 100 detects the user's gaze from the image captured by the camera 21, and determines whether the gaze is toward the display device 14 or the display surface 202. That is, the camera 21 also serves as a gaze detection unit. The gaze detection unit is not limited to a camera, and may also be a gaze detection sensor.

[0079] If "yes" is determined in step S59, the in-vehicle system 100 uses the determination result as a return trigger to perform a process (return process) of returning the display content of the display device 14 to the display surface 202 (S60). Figure 7 and Figure 8 Instead, the in-vehicle system 100 displays an operation in which the display content is moved from the display device 14 to the display surface 202. In this way, the in-vehicle system 100 of the present embodiment performs display control so that the display content can be exchanged between the display device 14 and the display surface 202.

[0080] Effects of the Embodiments

[0081] As described above, the in-vehicle system 100 of the present embodiment includes the control unit 10 that controls the display device (first display) 14 and the second display (display surface 202) provided on the outer surface of the operation unit 20 arranged in parallel with the display device 14. The control unit 10 moves the display content displayed on the second display from the second display, and displays the display content on the display device 14. Therefore, the in-vehicle system 100 of the present embodiment can move the display content to the first display whose display space is not limited by the size of the operation unit 20, and display the display content on the first display, so that the visibility of the display content can be improved.

[0082] The control unit 10 moves the display content to the display device 14 in response to detecting an operation performed by the user on the operation unit 20. Therefore, even if the user operates the operation unit 20 and the display content is blocked by the user's hand, the in-vehicle system 100 of the present embodiment can move the display content to the display device 14 and display the display content on the display device 14, so that the visibility of the display content can be improved.

[0083] The in-vehicle system 100 of the present embodiment further includes a voice detection unit that detects the user's voice, and in response to detecting the user's specific voice, the control unit 10 moves the display content on the second display to the display device 14. Therefore, the in-vehicle system 100 can move and display the display content with the user's voice as a trigger.

[0084] The control unit 10 changes the display mode of the display content displayed on the second display and moves the display content to the first display. Therefore, the in-vehicle system 100 can display the display content in an easily visualized manner.

[0085] The control unit 10 moves a portion of the display content displayed on the second display to the first display. Therefore, the in-vehicle system 100 can indicate a state in which the display content is moving.

[0086] In the in-vehicle system 100 of this embodiment, the display content may be a character imitating a face. Therefore, the in-vehicle system 100 can provide a user-friendly user interface.

[0087] If the user's voice for the character is detected, the control unit 10 moves the character 61 to the display device 14. Therefore, the in-vehicle system 100 can be operated in an interactive manner with the character 61 by the user's voice, and an easy-to-understand user interface can be provided.

[0088] Modification

[0089] Fig.11 20X is a diagram showing a modified example of the operation unit 20X. Fig.11 The operation unit 20X in the display device 14 includes a display element 211 on the display surface 202 side, and the control unit 10 displays display contents related to the operation of the operation unit 20X. The support mechanism 30A supports the operation unit 20X so that it can move forward and backward relative to the display surface 149 of the display device 14. The support mechanism 30A includes an actuator 301, and is displaced between a state (a first state) in which the operation unit 20X protrudes from the display surface 149 of the display device 14 and a state (a second state) in which the operation unit 20X is accommodated in the display device 14 according to control of the control unit 10.

[0090] If a part or all of the operation unit 20X is included in the inner area of ​​the display device 14 when the display device 14 is viewed from the front, a notch or a hole may be provided in the portion of the display device 14 that interferes with the operation unit 20X, and the operation unit 20X may pass through the notch or the hole. When the notch or the hole of the display device 14 reaches the display element 14A, the notch or the hole may also be provided in the display element 14A itself. In this case, although it is impossible to perform display in the portion corresponding to the notch or the hole of the display element 14A, the display element 211 may compensate for the missing display area.

[0091] Fig.12 1 is a diagram showing a driving control process of the operation unit 20X in the vehicle-mounted system 100. For example, the control unit 10 of the vehicle-mounted system 100 performs the operation from the start to the stop of the vehicle-mounted system 100. Fig. 9 The display control processing in the Fig.12 Processing shown.

[0092] When to start Fig.12 During the drive control processing in the vehicle-mounted system 100, the vehicle-mounted system 100 obtains information indicating the state of the user (state information) from the camera 21 and the proximity sensor 29 (S71). For example, the vehicle-mounted system 100 detects the user's gaze and the user's posture based on the image of the camera 21. The vehicle-mounted system 100 uses the proximity sensor 29 to detect that the user's hand approaches the operation unit 20X.

[0093] The in-vehicle system 100 determines whether the user attempts to operate the operation unit 20X based on the state information of the user obtained in step S71 ( S72 ).

[0094] In step S72, if the user attempts to operate the operation unit 20X ("Yes" in S72), the in-vehicle system 100 determines whether the operation unit 20X is in the first state (S73). Here, if the operation unit 20X is in the first state ("Yes" in S73), the control unit 100 ends. Fig.12 , and if the operation unit 20X is not in the first state (No in S73), the control unit 10 controls the support mechanism 30A to advance the operation unit 20X to enter the first state, and moves the display content displayed on the second display (display surface 202) to the first display (display device 14) (S74). The amount (protrusion amount) by which the tip of the operation unit 20X protrudes from the display surface of the display device 14 when the operation unit 20X is in the first state can be set in advance to a desired protrusion amount depending on the thickness of the fingers of the user's hand, the length of the nails, etc.

[0095] On the other hand, if the user does not attempt to operate the operation unit 20X in step S72 (No in S72), the in-vehicle system 100 determines whether the operation unit 20X is in the second state (S75). Here, if the operation unit 20X is in the second state (Yes in S75), the control unit 100 ends the operation. Fig.12 , and if the operating unit 20X is not in the second state ("No" in S75), the control unit 10 controls the supporting mechanism 30A to retract the operating unit 20X to enter the second state, and moves the display content displayed on the first display (display device 14) to the second display (display surface 202) (S76).

[0096] In this way, according to the present modification, if the user does not perform an operation, the operation unit 20X is set to the accommodated state (second state), and only when the user attempts to perform an operation, the operation unit 20X can enter the protruding state (first state), so that an intelligent system can be provided. Then, if the user attempts to perform an operation, the display content displayed on the second display (display surface 202) is moved to the first display (display device 14), so that even if the display content on the second display is blocked by the user's hand, the visibility of the display content can be improved.

[0097] Second embodiment

[0098] In the first embodiment described above, the movement display processing of the display content is performed with the operation of the operation unit as a movement trigger, but in this embodiment, the configuration is different from the first embodiment in that the movement display processing of the display content is performed when the user's hand approaches the operation unit 20. The other configurations are the same as those in the first embodiment, and therefore, the same elements are denoted by the same reference numerals and will not be described again.

[0099] Fig.13 1 is a diagram showing a hardware configuration of a vehicle-mounted system 100A according to a second embodiment. In addition to the configuration of the first embodiment, the vehicle-mounted system 100A further includes a proximity sensor (proximity detection unit) 29 that detects the approach of a user's hand to the operation unit 20. The proximity sensor 29 calculates the distance to the object by calculating the relationship between the speed of sound and the time required from sending an ultrasonic signal to the area to be detected until receiving a signal reflected by the object. When the user's hand approaches the operation unit 20 and the proximity sensor 29 detects that the distance from the hand (object) to the operation unit is less than a predetermined value, the control unit 10 performs a mobile display process on the display content.

[0100] Fig.14 is a diagram showing a display control process in the in-vehicle system 100A according to the second embodiment. Fig.14In the display control process in the vehicle-mounted system 100A, the vehicle-mounted system 100A determines whether the user's hand is close to the operation unit 20 (S50). If "yes" is determined in step S50, the vehicle-mounted system 100A performs the mobile display process (S57). The other processes are the same as those in the above-mentioned first embodiment.

[0101] The in-vehicle system 100A of the present embodiment further includes an approach detection unit that detects the approach of the user's hand to the operation unit 20, and moves the display content if the approach of the user's hand is detected. Therefore, the in-vehicle system 100A performs display control processing of the display content simply by the user bringing his or her hand close to the operation unit 20, and therefore, the visibility of the display content can be easily improved.

[0102] Third embodiment

[0103] The present embodiment is different from the above-mentioned second embodiment in that a touch operation on the display device 14 is detected and the display content is moved to the position where the touch operation is performed. The other configurations are the same as those in the second embodiment, and therefore, the same elements are represented by the same reference numerals and will not be described again.

[0104] Fig.15 is a diagram showing the hardware configuration of the vehicle-mounted system 100B according to the third embodiment. In addition to the configuration of the second embodiment, the vehicle-mounted system 100B also includes a touch panel 14B, which detects a touch operation on the display device 14. The touch panel 14B is a transparent panel and is arranged to overlap with the display surface side (user side) of the display element 14A. When the user touches the touch panel 14B (touch operation), the touch panel 14B inputs the contact position to the control unit 10. The touch operation (touch gesture) can be a predetermined number of contacts, a predetermined time of contact, an operation of moving multiple contact positions along a predetermined trajectory, etc. (for example, single-click, double-click, long press, flick, pinch, and pinch).

[0105] Fig.16 is a diagram showing a display control process in the in-vehicle system 100B according to the third embodiment. Fig.16 In the display control process in, the vehicle-mounted system 100B determines whether a touch operation on the display device 14 is detected (S41). If the vehicle-mounted system 100B determines "No" in step S41, the process proceeds to step S50, and if it is determined "Yes" in step S41, the vehicle-mounted system 100B moves the display content to the position where the touch operation is performed, and displays the display content at that position (S42). After step S42, the vehicle-mounted system 100B proceeds to step S58 and changes the display mode. The other processes are the same as those in the above-mentioned second embodiment.

[0106] Fig.17 is a diagram showing an example of a process of moving display content to a position where a touch operation is performed. Fig.17 In (A), a touch operation is performed at a position PX on the display device 14. In this case, as Fig.17 As shown in (B) in FIG. 2 , the control unit 10 moves the character 61 displayed on the display surface 202 to the position PX on the display device 14 , and displays the character 61 .

[0107] Fig.18 is a diagram showing an example of a function selection menu, and Fig.19 It shows Fig.18 Figure 1 shows the state where the function icons in the image are moved. Fig.18 As shown, when the user performs an operation of displaying a selection menu on the in-vehicle system 100B, the control unit 10 displays the selection menu on the display device 14 and the display surface 202. In this case, the control unit 10 moves the character 61 displayed on the display surface 202 to the display device 14, and displays the character 61 on the display device 14. In this selection menu, a plurality of function icons (menu icons) displayed on the display device 14 and at least one function icon displayed on the display surface 202 are arranged in a row along a predetermined moving direction. In the present embodiment, the function icons F1 to F7 are arranged along the left-right direction of the display device 14, and the left-right direction is the moving direction of the function icons F1 to F7. Among the plurality of function icons F1 to F7, the function icon set at the position of the operation unit 20 is displayed on the display surface 202 of the operation unit 20. In the present embodiment, the moving direction (arrangement direction) of the function icons F1 to F7 is a straight line oriented along the left-right direction, but is not limited thereto, and may be configured to move in a vertical direction or in a curved manner.

[0108] When the user performs a slide operation on the function icons F1 to F7, the control unit 10 moves and displays the function icons F1 to F7 according to the slide operation. In this case, one of the function icons F1 to F7 moved to the position of the operation unit 20 by the slide operation is displayed on the display surface 202, and the function indicated by the function icon displayed on the display surface 202 is selected. Fig.18 In the example, the music icon F4 is displayed on the display surface 202, and the music function is selected. When one of the function icons F1 to F7 is moved to the right, the phone icon F3 is displayed on the display surface 202, and the phone function is selected. When each of the function icons F1 to F7 is selected in this way, Fig.16 In step S58 of , the display mode of each of the function icons F1 to F7 is changed according to the selected function. Fig.18In the music function, the character 61 is changed to a state of wearing headphones to enjoy music. Fig.19 In (A), the telephone function is selected, and the character 61 is changed to a state of holding a telephone receiver to make a telephone call. Fig.19 As shown in (B) in FIG. 1 , when a touch operation is performed on the position PX of the display device 14 in this state, the changed character 61 is displayed at the position where the touch operation is performed.

[0109] In the present embodiment, if the character 61 is not displayed or if the operation unit 20 is not provided, when a touch operation is performed on the display device 14 , the control unit 10 may display a selection menu at the position of the touch operation.

[0110] The in-vehicle system 100B of the present embodiment further includes a touch panel (touch detection unit) 14B that detects a touch operation performed by the user on the display device 14 and moves the display content to the position where the touch operation is performed on the display device 14. Therefore, the in-vehicle system 100B can display the display content at the position selected by the user, and the convenience can be improved.

[0111] The in-vehicle system 100B of the present embodiment is the same as that of the second embodiment, and may be the same as that of the first embodiment, except for a configuration for moving display content to a position where a touch operation is performed.

[0112] Fourth embodiment

[0113] The difference between this embodiment and the above-mentioned third embodiment is that: this embodiment includes multiple sets of display devices 14 and display surfaces 202 (display units), and the other configurations are the same as the first embodiment. Therefore, the same elements will be given the same figure marks and will not be described again.

[0114] Fig. 20 100C is a diagram showing a hardware configuration of a vehicle-mounted system 100C according to the fourth embodiment. The vehicle-mounted system 100C includes a plurality of display units 140 . Fig.21is a diagram showing the arrangement of display units in a vehicle. The display unit 140 is a user interface that includes a set of display devices 14 and a display surface 202, and is provided at a position that can be operated by a user of each seat in the vehicle. For example, a display unit 140A provided in the front seat (driver's seat) is embedded in the dashboard 40 in front of the driver's seat, and a display unit 140B provided in the front seat (passenger seat) is embedded in the dashboard 40 in front of the passenger seat. The display units 140A and 140B of the front seats may be embedded in the pillars (A pillars) in front of the front seats. In addition, a display unit 140C provided in the seat behind the driver's seat (rear seats) is embedded in the rear surface of the headrest of the driver's seat or the rear surface of the seat back, and a display unit 140D provided in the seat behind the passenger seat (rear seats) is embedded in the rear surface of the headrest of the passenger seat or the rear surface of the seat back. The display of the rear seat may be embedded in the pillar in front of the seat (B pillar in the center of the vehicle) or in the ceiling surface. Fig.21 In the embodiment, the vehicle has four seats in total, two seats in the front side and two seats in the rear side, but the present disclosure is not limited thereto, and may have a configuration without rear seats or a configuration with multiple rows of rear seats. The in-vehicle system 100C may include the display unit 140 in all of these seats, or may include the display unit 140 in only some of the seats. The vehicle is not limited to a passenger car, and may be a bus, a taxi, or the like.

[0115] The display units 140 of the present embodiment each include a camera 21, a proximity sensor (proximity detection unit) 29, a microphone 17, and a speaker 28. Therefore, the user's operation of the in-vehicle system 100C and the output from the in-vehicle system 100C to the user can be performed at each seat in the same manner as in the above-described embodiment.

[0116] When the display unit 140 provided at each seat receives an operation performed by the user (for example, when a voice such as "Hey, ○○" for performing an operation is obtained through the microphone 17, or when a user's gesture for performing an operation is obtained through the camera 21), if an operation to the operation unit 20 is detected, the in-vehicle system 100C feeds back to the user that the operation is detected. For example, the in-vehicle system 100C may perform feedback by outputting a voice message such as "An operation is detected" or "Do you need anything?" from the speaker 28, or performing a display such as blinking the display surface 202, increasing the brightness of the display surface 202, and displaying a message on the display device 14.

[0117] In response to receiving an operation performed by a user, the in-vehicle system 100C of the present embodiment feeds back the reception of the operation by moving the character 61 to the display device (third display) 14 of the display unit 140 that received the operation. The in-vehicle system 100C of the present embodiment displays the character 61 only on one display surface 202 among the plurality of display units 140. If a movement mark is generated in a case where an operation of a display unit 140 on which the character 61 is not displayed is detected by a user, etc., the control unit 10 of the in-vehicle system 100C moves the character 61 from the display unit 140 that displays the character 61 to the display unit 140 that generates the movement mark. The generation of the movement mark is not limited to the case where the operation of the user is detected, and may be generated in a case where, for example, the approach of the user's hand to the operation unit 20 is detected, the voice of the user is detected, or the touch operation on the display device 14 is detected. That is, among the display units 140 of the seats, the display device 14 of the display unit 140 that generates the movement mark is set as the movement destination, and the character 61 is moved to the movement destination.

[0118] Fig. 22 1 is a diagram showing an example of the character 61 moving between the display units 140 provided on the seats arranged left and right. For example, when the character 61 is displayed on the display surface 202 of the display unit 140B at the passenger seat, if a movement mark is generated on the display unit 140A of the seat (driver's seat) arranged in the horizontal direction relative to the passenger seat in the vehicle, the control unit 10 moves the character 61 from the display unit 140B set as the movement source to the display unit 140A set as the movement destination. In this case, the control unit 10 displays the operation (animation) on the display device 14 according to the arrangement of the display units 140A and 140B, so that it can be known which display unit 140 the character 61 moves to or from which display unit 140 the character 61 moves.

[0119] exist Fig. 22, the control unit 10 displays the following operation on the display device 14: move the character 61 from the display surface 202 of the display unit 140B as the movement source to the predetermined position 141 of the display device 14 (directly above the display surface 202), and then move the character 61 in a direction corresponding to the position of the display unit 140A as the movement destination. That is, the control unit 10 displays the following operation (cut-out): move the character 61 from the predetermined position 141 of the display device 14 of the display unit 140B in the right direction, and make the character 61 disappear (move outward) from one side (right side) 14R in the direction of the display device (third display) of the display unit 140A as the movement destination. The control unit 10 displays the character (display content) 61 on the display device 14 of the movement destination in a manner that it appears from one side in the direction of the display device 14 where the movement source exists. For example, since the display unit 140B serving as the movement source is located on the left side of the display unit 140A, the control unit 10 displays the following operation (cut-in) on the display device 14 of the display unit 140A: appearing from the left side 14L of the display device 14, and moving in the direction of the predetermined position 141 (right direction). Therefore, the in-vehicle system 100C can notify the user at the passenger seat that the character 61 is moved to the display unit 140A at the driver's seat, and can also notify the user at the driver's seat that the character 61 is moved from the passenger seat. The in-vehicle system 100C can provide feedback to the user at the driver's seat on the situation in which the operation is detected through the movement of the character 61. When the character 61 is displayed on the display surface 202 of the display unit 140A at the driver's seat, if a movement mark is generated on the display unit 140B at the passenger seat, the control unit 10 performs a cut-in operation along the same direction as the character 61. Fig. 22 When the character 61 is displayed on the display surface 202 of the display unit 140D at the left rear seat, the control unit 10 can also move the character 61 in the opposite direction to the direction shown. Fig. 22 The character 61 is similarly moved from the display unit 140D set as the movement source to the display unit 140C set as the movement destination, and the character 61 is displayed.

[0120] Fig.23 1 is a diagram showing an example of the character 61 moving between the display units 140 provided on the seats arranged front and rear. For example, when the character 61 is displayed on the display surface 202 of the display unit 140B at the passenger seat, if a movement mark is generated on the display unit 140D of the seat (left rear seat) arranged in the front-rear direction relative to the passenger seat in the vehicle, the control unit 10 moves the character 61 from the display unit 140B set as the movement source to the display unit 140D set as the movement destination.

[0121] exist Fig.23 , the control unit 10 displays the following operation on the display device 14 of the movement source: moving the character 61 from the display surface 202 of the display unit 140B as the movement source to a predetermined position 141 of the display device 14 (just above the display surface 202), and then moving the character 61 toward one side in the direction of the display device (third display) 14 where the display unit 140A as the movement destination exists, and making the character 61 disappear. For example, the control unit 10 displays the following operation (cut-out): moving the character 61 from the predetermined position 141 of the display device 14 of the display unit 140B in the upward direction, moving the character 61 toward one side (upper side) 14U corresponding to the position of the main display unit 140D, and making the character 61 disappear. The control unit 10 displays the character (display content) 61 on the display device 14 of the movement destination (third display) in such a manner that it appears from one side in the direction of the display device 14 where the movement source exists. For example, since the display unit 140B as the movement source is located on the front side of the display unit 140D, the control unit 10 displays the following operation (cut-in) on the display device 14 of the display unit 140D: appearing from the upper side 14U of the display device 14, and moving in the direction of the predetermined position 141 (downward direction). Therefore, the in-vehicle system 100C can notify the user at the passenger seat that the character 61 is moved to the display unit 140A at the left rear seat, and can also notify the user at the left rear seat that the character 61 is moved from the passenger seat. When the character 61 is displayed on the display surface 202 of the display unit 140D at the left rear seat, if a movement mark is generated on the display unit 140B at the passenger seat, the control unit 10 can Fig.23 The character 61 is similarly moved and displayed. When the character 61 is displayed on the display surface 202 of the display unit 140A at the driver's seat, if a movement mark is generated in the display unit 140C at the right rear seat, or when the character 61 is displayed on the display surface 202 of the display unit 140C at the right rear seat, if a movement mark is generated in the display unit 140A at the driver's seat, the control unit 10 may Fig.23 The character 61 is similarly moved and displayed.

[0122] exist Fig.23In the embodiment, when the central axis of the up-down direction is set as the up-down axis 143 on the display surface of the display device 14, for example, when the character 61 is moved from the display unit 140B to the display unit 140D, the control unit 10 moves the character 61 directly upward from the predetermined position 141 along the up-down axis 143. On the other hand, for example, when the character 61 is moved from the display unit 140B to the display unit 140C, the control unit 10 may tilt the moving direction of the character 61 from the up-down axis 143 diagonally upward to the right according to the position of the display unit 140C. When the character 61 is moved from the display unit 140C to the display unit 140B, the control unit 10 may move the character 61 from the right side of the upper side 14U to the lower left direction diagonally according to the position of the display unit 140C, and display the character 61 until it moves to the predetermined position 141.

[0123] exist Fig.23 In the example of , the control unit 10 may perform display in the following manner: the character 61 to be cut out is moved to exit from the upper side 14U, and after moving the character 61 in the upward direction from the predetermined position 141, a U-turn is made and the character 61 is moved in the downward direction to exit from the lower side 14D. The control unit 10 may move the cut-in character 61 in the upward direction from the lower side 14D, then make a U-turn, and move the character 61 in the downward direction to the predetermined position 141 to display the character 61.

[0124] Fig.24 140A on the driver's seat side and the display unit 140B on the passenger's seat side are provided on the pillar 41. Fig.24 As shown, when the display units 140A and 140B are provided on the pillars, similar to the case where they are provided on the instrument panel 40 as described above, it is possible to accept operations performed by a user (driver) at the driver's seat and provide feedback to the user, and to accept operations performed by a user at the passenger seat and provide feedback to the user. In addition to the display units 140A and 140B being provided on the instrument panel 40, additional display devices may be provided as shown in FIG. Fig.24 As shown, the character 61 is arranged on a column, and feedback of the detected operation can be displayed on the display device at the column. In this case, the control unit 10 can move the character 61 to the display device 14 of the moving destination, and then further move the character 61 to the display device at the column to display the character 61.

[0125] in addition, Fig.251 is a diagram showing an example in which display devices 142A to 142D are provided on the ceiling surface. Display devices 142A to 142D are additional display devices provided on the ceiling surface of the seat and separate from the display units 140A to 140D of the seat. Display devices 142A to 142D may be projection devices that project display images. If an operation performed by a user at each seat is detected, the control unit 10 causes the display devices 142A to 142D of the seat to perform a display indicating that the operation is detected, and provides feedback that the operation is detected to the user at the seat.

[0126] Fig.26 1 is a diagram showing an example including projection devices 143A to 143D that project images onto a floor surface. The projection devices 143A to 143D are examples of additional display devices that are provided on the ceiling surface of the seat and are separate from the display units 140A to 140D of the seat. The projection devices 143A to 143D may be projection devices that project display images. If an operation performed by a user at each seat is detected, the control unit 10 causes the projection devices 143A to 143D of the seat to perform a display indicating that the operation is detected, and provides feedback that the operation is detected to the user at the seat.

[0127] The in-vehicle system 100C of the present embodiment is the same as the third embodiment, and may be the same as the first embodiment or the second embodiment, except for the configuration including a plurality of display units 140. Although the movement of the character 61 is mainly described in the present embodiment, the display content to be moved is not limited to the character 61, but may be any display content related to the operation of the operation unit 20, such as the set temperature of the air conditioner or the icon of the selected function.

[0128] As described above, the in-vehicle system 100C of the present embodiment can improve the visibility of the display content by moving the display content of the operation unit 20 to the display device and displaying the display content on the display device. The in-vehicle system 100C of the present embodiment feeds back to the user that an operation performed by the user is detected, so that a difference between the operation of the in-vehicle system 100C receiving the operation and the recognition of the user performing the operation can be prevented.

[0129] In addition, the vehicle-mounted system 100C of the present embodiment moves the character 61 displayed on any one of the multiple display units 140 to the display unit 140 that generates a moving mark, and displays the character 61 on the display unit 140, thereby providing a user-friendly system in which the character 61 existing somewhere among the multiple display units 140 is called by the user and moved within the system.

[0130] In the present embodiment, the character 61 is displayed on any one of the plurality of display units 140, but the character 61 may be displayed on some or all of the plurality of display units 140. For example, the character 61 may be displayed on one of the display units 140A and 140B at the front seat and one of the display units 140C and 140D at the back seat.

[0131] like Fig.11 As shown, when the support mechanism 30A supports the operation unit 20 so as to be movable forward and backward, the operation unit 20 may be in the first state in the display unit 140 displaying the character, and may be in the second state in the display unit 140 displaying the character.

[0132] other

[0133] In the above-described embodiment, the vehicle-mounted system 100 is used as an example of a computer system that performs a process of moving the display content on the display surface 202 of the operation unit 20. However, the configuration of the above-described embodiment is not limited to the vehicle-mounted system. That is, the configuration of the above-described embodiment can be applied to various systems that serve as interactive systems, such as general-purpose personal computers, multimedia terminals at convenience stores, and game consoles.

[0134] Computer readable recording medium

[0135] A program that enables a computer or another machine or device (hereinafter referred to as a computer, etc.) to implement any of the above functions may be recorded on a computer-readable recording medium. Functions can be provided by causing a computer, etc. to read and execute the program on the recording medium.

[0136] Here, a computer-readable recording medium refers to a recording medium that stores information such as data and programs through electrical, magnetic, optical, mechanical or chemical action and can be read by a computer, etc. Among such recording media, media that can be removed from a computer, etc. include, for example, memory cards such as floppy disks, magneto-optical disks, CD-ROMs, CD-R / W, DVDs, Blu-ray disks, DATs, 8mm magnetic tapes, and flash memories. In addition, as recording media fixed in a computer, etc., there are hard disks, read-only memories (ROMs), etc. In addition, a solid-state drive (SSD) can be used as a recording medium that can be removed from a computer, etc., or as a recording medium fixed to a computer, etc.

Claims

1. An information processing device, comprising: a first display; An operating unit, arranged in parallel with the first display; a second display, disposed on at least one surface of the operating unit; as well as A controller is configured to move display content displayed on the second display from the second display to the first display, and display the display content on the first display.

2. The information processing device according to claim 1, wherein: In response to detecting an operation performed on the operation unit by a user, the controller moves the display content from the second display to the first display.

3. The information processing device according to claim 1, further comprising: A proximity detector is configured to detect the proximity of a user's hand to the operating unit, wherein: In response to detecting the approach of the hand, the controller moves the display content from the second display to the first display.

4. The information processing device according to claim 1, further comprising: A voice detector is configured to detect the user's voice, wherein In response to detecting the specific voice of the user, the controller moves the display content from the second display to the first display.

5. The information processing device according to claim 1, further comprising: a touch detection detector configured to detect a touch operation performed by a user on the first display, wherein The controller is configured to move the display content from the second display to a position where the touch operation is performed on the first display.

6. The information processing device according to claim 5, wherein: The controller is configured to display a menu icon as the display content at a position on the first display where the touch operation is performed.

7. The information processing device according to claim 1, wherein: When the display content displayed on the second display is moved to the first display, the controller changes a display mode of the display content and displays the display content on the first display.

8. The information processing device according to claim 1, wherein: The controller is configured to move a portion of the display content displayed on the second display to the first display.

9. The information processing device according to any one of claims 1 to 8, wherein: The displayed content is a character imitating a face.

10. The information processing device according to claim 9, wherein: In response to detecting a user's voice directed to the character, the controller moves the character from the second display to the first display.

11. The information processing device according to claim 9, wherein: When a predetermined function is selected while the character is displayed on the first display, the controller displays an icon related to the selected function on the second display.

12. The information processing device according to claim 11, wherein: The controller is configured to change a display mode of the character displayed on the first display depending on the selected function.

13. The information processing device according to claim 11, wherein: The controller is configured to: arranging a plurality of icons displayed on the first display and at least one icon displayed on the second display in a row along a predetermined moving direction, and moving the plurality of icons along the moving direction according to a sliding operation performed on the icons by a user, After the movement, selecting a function indicated by an icon displayed on the second display, and Depending on the selected function, a display mode of the character moved to the first display is changed.

14. The information processing device according to claim 1, further comprising: A third display, wherein The controller moves the display content from the second display to the first display, and moves the display content from the first display to the third display.

15. The information processing device according to claim 14, wherein: The first display and the third display are arranged to correspond to seats arranged in a horizontal direction of the vehicle, respectively, and When the display content is moved, after the display content on the first display moves toward a side in the direction in which the third display exists and disappears, the controller displays the display content on the third display so that the display content appears from a side in the direction in which the first display exists.

16. The information processing device according to claim 14, wherein: The first display and the third display are provided to correspond to seats arranged in a front-rear direction of the vehicle, respectively, and When the display content is moved from the first display to the third display, after the display content on the first display moves toward one side in an upward direction and disappears, the controller displays the display content on the third display so that the display content appears from one side in the upward direction.

17. The information processing device according to claim 15 or 16, wherein: In response to detecting an operation performed by a user on the third display, the controller moves the display content from the first display to the third display.

18. An information processing device, comprising: A controller configured to control a first display and a second display, wherein the second display is provided on at least one surface of an operation unit arranged in parallel with the first display, wherein The controller is configured to move display content displayed on the second display from the second display to the first display and display the display content on the first display.

19. The information processing device according to any one of claims 1 to 8, 14 to 16 and 18, wherein: The controller uses detection of any one of an operation performed by a user on the operating unit, the approach of the user's hand to the operating unit, the user's voice, and a touch operation performed by the user on the first display as a trigger to move the display content displayed on the second display from the second display to the first display and display the display content on the first display.

20. An information processing method executed by a controller, wherein: The controller is configured to control a first display and a second display, the second display being provided on at least one surface of an operation unit arranged in parallel with the first display, and The information processing method comprises: The display content displayed on the second display is moved from the second display to the first display, and the display content is displayed on the first display.

Images