Vehicle display device and vehicle display method

Abstract

To provide a vehicle display device and the like capable of achieving drawing among multiple display devices having different drawing capabilities.SOLUTION: The vehicle display device for transferring image information to a forwarding destination 30 as a display device placed in a vehicle 2, includes: a transfer method determining unit 25 that determines an image information transfer method depending on the drawing ability of the forwarding destination 30 based on the image information, and the drawing capacity of the transfer source 20, which is the vehicle display device, and the drawing ability of the destination 30; and a transfer processing unit 27 that converts the preset transfer method into a transfer method determined by the transfer method determining unit 25, and transfers the image information to the destination 30 according to the converted transfer method.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present disclosure relates to a display device for a vehicle. and Vehicle markings By law Regarding. [Background technology]

[0002] In recent years, in a display control system composed of a plurality of display devices, it is required to realize drawing simultaneously on all the display devices. For example, in Patent Document 1, between a first control unit and a second control unit which control the display of information images on a plurality of display devices, the first control unit switches the transfer method when transferring an information image to the second control unit to either a first transfer method which requires drawing processing at the transfer source, or a second transfer method which requires drawing processing at the transfer destination. This makes it possible to suppress delays during transfer of information images in the display control system. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-140133 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the display control system of Patent Document 1, no information is provided regarding the hardware configuration of the control unit, and there is a problem that the processing of the transferred contents may fail depending on the hardware configuration provided.

[0005] Therefore, an object of the present disclosure is to provide a display device for a vehicle, a display method for a vehicle, and a program that can realize drawing between a plurality of display devices having different drawing capabilities. [Means for solving the problem]

[0006] A vehicle display device according to one aspect of the present disclosure is a vehicle display device that transfers image information to a transfer destination that is a display device mounted on a vehicle, and includes a transfer method determination unit that determines a transfer method for the image information according to the hardware information of the transfer destination based on the image information, hardware information of the transfer source that is the vehicle display device, and the hardware information of the transfer destination, and a transfer processing unit that converts a preset transfer method into the transfer method determined by the transfer method determination unit and transfers the image information to the transfer destination by the converted transfer method, and the hardware information includes the presence or absence of a CPU, the presence or absence of a GPU, the presence or absence of a decoder, and the presence or absence of an encoder. and the transfer method determination unit determines the transfer method to be the stream transfer method when the hardware information of the transfer source indicates that the transfer source has a CPU, a GPU, and an encoder, and the hardware information of the transfer destination indicates that the transfer destination has a CPU and a decoder, and determines the transfer method to be the command transfer method when the hardware information of the transfer source indicates that the transfer source has a CPU and an encoder, and the hardware information of the transfer destination indicates that the transfer destination has a CPU and a GPU. .

[0007] A display method for a vehicle according to one aspect of the present disclosure is a display method for a vehicle in which a source transfers image information to a destination which is a display device mounted on a vehicle, the display method including: determining a transfer method for the image information according to a drawing capability of the destination based on the image information, hardware information of the source, and hardware information of the destination; converting a preset transfer method into the determined transfer method; and transferring the image information to the destination by the converted transfer method, the hardware information including the presence or absence of a CPU, the presence or absence of a GPU, the presence or absence of a decoder, and the presence or absence of an encoder. and when the hardware information of the transfer source indicates that the transfer source has a CPU, a GPU, and an encoder, and when the hardware information of the transfer destination indicates that the transfer destination has a CPU and a decoder, the transfer method is determined to be the stream transfer method, and when the hardware information of the transfer source indicates that the transfer source has a CPU and an encoder, and when the hardware information of the transfer destination indicates that the transfer destination has a CPU and a GPU, the transfer method is determined to be the command transfer method. .

[0008] A program according to an aspect of the present disclosure is a program for causing a computer to execute a vehicle display method. Effect of the Invention

[0009] According to the vehicle display device and the like of the present disclosure, drawing can be realized between a plurality of display devices having different drawing capabilities. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a schematic diagram showing a display system according to an embodiment mounted on a vehicle. [Diagram 2]FIG. 2 is a block diagram showing a display system according to the embodiment. [Diagram 3] FIG. 3 is a flowchart illustrating a process performed by a transfer source according to the embodiment. [Figure 4] FIG. 4 is a flowchart illustrating a processing operation of a transfer destination according to the embodiment. [Diagram 5] FIG. 5 is a diagram illustrating examples of cases where drawing fails and succeeds when drawing data is transferred from a transfer source to a transfer destination. [Figure 6] FIG. 6 is a block diagram showing a display system according to the first modification of the embodiment. [Figure 7] FIG. 7 is a flowchart illustrating a process performed by a transfer source according to the first modification of the embodiment. [Figure 8] FIG. 8 is a flowchart illustrating a processing operation of the repeater according to the first modification of the embodiment. [Figure 9] FIG. 9 is another diagram illustrating an example of a case where drawing fails and a case where drawing succeeds when drawing data is transferred from a transfer source to a transfer destination. [Figure 10] FIG. 10 is a block diagram showing a display system according to the second modification of the embodiment. [Figure 11] FIG. 11 is a block diagram showing a display system according to the third modification of the embodiment. [Figure 12] FIG. 12 is a block diagram showing a display system according to the fourth modification of the embodiment. [Figure 13] FIG. 13 is a flowchart illustrating a process performed by a transfer source according to the fourth modification of the embodiment. [Figure 14] FIG. 14 is yet another diagram illustrating a case where drawing is successful when drawing data is transferred from a transfer source to a transfer destination. [Figure 15] FIG. 15 is a block diagram showing a display system according to another modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] The embodiments described below are all comprehensive or specific examples. The numerical values, shapes, materials, components, component arrangements and connection forms, steps, and order of steps shown in the following embodiments are merely examples and are not intended to limit the present disclosure. Furthermore, among the components in the following embodiments, components that are not described in the independent claims are described as optional components.

[0012] In addition, each drawing is a schematic diagram and is not necessarily a precise illustration. In addition, in each drawing, the same components are denoted by the same reference numerals.

[0013] Hereinafter, the embodiment will be specifically described with reference to the drawings.

[0014] (Embodiment) <Functional configuration> First, a display system 1 according to the present embodiment will be described with reference to FIGS.

[0015] Fig. 1 is a schematic diagram showing a display system 1 according to an embodiment that is disposed in a vehicle 2. Fig. 2 is a block diagram showing the display system 1 according to the embodiment.

[0016] 1, the display system 1 is a system for displaying a plurality of images on the display screens of one or more display devices. The display system 1 can display images on the display screens of one or more display devices automatically or manually by a passenger.

[0017] The display system 1 is used in a vehicle 2 or the like in which one or more display devices are arranged. For this reason, in this embodiment, the images displayed by one or more display devices are images based on an application, and include, for example, information such as vehicle gauges, operating status of in-vehicle devices, navigation information, captured images, and surrounding vehicle information. The vehicle gauges are, for example, a speedometer, a direction indicator lamp, a warning lamp, an odometer, a shift position, a fuel gauge, and a water temperature gauge. The in-vehicle devices are, for example, an audio device, an in-vehicle lighting device, and a seat device. The navigation information is information for providing the user with route guidance to the current position and destination while the vehicle 2 is traveling. The captured images are images of the surroundings of the vehicle 2 or the interior of the vehicle cabin captured by an imaging device mounted on the vehicle 2. The surrounding vehicle information is information indicating the presence or absence, number, speed, and distance from the vehicle 2 to other vehicles present around the vehicle 2.

[0018] The display devices are displays such as a PC (Personal Computer) equipped with a liquid crystal display or the like, a mobile terminal such as a smartphone, a car navigation system, an electronic mirror system, a multi-information display, etc., that are installed in the vehicle 2. In Fig. 1, the multiple display devices 3 are exemplified by a car navigation system 3a arranged in the center of the vehicle width, an electronic mirror system that functions as a left side mirror 3b and a right side mirror 3c, and multiple multi-information displays 3d, 3e, and 3f. These display devices 3 are arranged side by side so that passengers in the vehicle 2 can view the multiple display devices all at once.

[0019] The display system 1 includes a transfer source 20 and a transfer destination 30. In FIG. 2, as an example of the transfer destination 30, a case where the display system 1 includes a first transfer destination 40 and a second transfer destination 50 is illustrated. In the present embodiment, the first transfer destination 40 and the second transfer destination 50 may be collectively referred to simply as the transfer destination 30. Note that in the present embodiment, the first transfer destination 40 and the second transfer destination 50 are illustrated as examples of the transfer destination 30, but are not limited to the first transfer destination 40 and the second transfer destination 50. The number of transfer destinations 30 may be one, or three or more.

[0020] [Source 20] The transfer source 20 is a vehicle display device that transfers drawing data to the transfer destination 30, which is a display device mounted on the vehicle 2. The transfer source 20 may also be a display device mounted on the vehicle 2. The drawing data is data transferred from the transfer source 20 to the transfer destination 30, and includes textures, frames, etc. The drawing data is included in the image information.

[0021] A specific functional configuration of the transfer source 20 will be described.

[0022] The transfer source 20 includes a distributed display information acquisition unit 21 , a drawing capability information acquisition unit 22 , an application analysis unit 23 , an application 24 , a transfer method determination unit 25 , a transfer path determination unit 26 , and a transfer processing unit 27 .

[0023] The distributed display information acquisition unit 21 acquires distributed display information from the multiple transfer destinations 30. For example, when drawing data is transferred from the transfer source 20 to the multiple transfer destinations 30, the distributed display information is information indicating whether the multiple transfer destinations 30 are simultaneously performing remote drawing, that is, whether the drawing data is synchronously displayed at the multiple transfer destinations 30. By the distributed display information acquisition unit 21 acquiring the distributed display information, the transfer source 20 can cause each of the multiple transfer destinations 30 to synchronously display the drawing data. The distributed display information acquisition unit 21 outputs the acquired distributed display information to the transfer method determination unit 25.

[0024] The drawing capability information acquisition unit 22 acquires drawing capability information indicating the drawing capability of the transfer source 20 that the unit itself has, and the drawing capability of the transfer destination 30. Here, the drawing capability information is hardware information related to the transfer source 20 and the transfer destination 30. The hardware information is the presence or absence of a CPU (Central Processing Unit), the presence or absence of a GPU (Graphics Processing Unit), the presence or absence of a decoder, the presence or absence of an encoder, the display resolution, the name of the display device, and the like.

[0025] For example, the drawing capability information acquisition unit 22 acquires the drawing capability information from a storage unit (not shown) that stores a drawing capability information table indicating the drawing capability of the transfer source 20 and the drawing capability of the transfer destination 30. The drawing capability information acquisition unit 22 may acquire the drawing capability information table by communicating with a display device and an in-vehicle device mounted on the vehicle 2. The drawing capability information table is linked with the drawing capability information, the configuration information of the virtual machine, and the like. The storage unit may be mounted on the vehicle display device or another in-vehicle device. In FIG. 2, the first transfer destination 40 and the second transfer destination 50 are illustrated as examples of the multiple transfer destinations 30 that are multiple display devices provided on the vehicle 2. In this embodiment, as shown in FIG. 2, the drawing capability information acquisition unit 22 acquires drawing capability information indicating the drawing capability of the transfer source 20, drawing capability information indicating the drawing capability of the first transfer destination 40, and drawing capability information indicating the drawing capability of the second transfer destination 50.

[0026] The drawing capability information acquisition unit 22 outputs the drawing capability information indicating the acquired drawing capability of the transfer source 20 and the drawing capability of the transfer destination 30 to the transfer method determination unit 25 and the transfer path determination unit 26 .

[0027] The application analysis unit 23 analyzes the application 24 for displaying drawing data on the transfer destination 30, which is a display device. The application analysis unit 23 transfers content information, which is a result of analyzing the application 24, to the transfer method determination unit 25. The content information is included in the image information.

[0028] Application 24 includes, for example, content information (parts images) relating to vehicle instruments such as a vehicle speed display that shows the vehicle speed and engine RPM, content information relating to the operating status of in-vehicle equipment such as the ON / OFF status of the air conditioning system and the volume of the audio system, content information relating to navigation information such as a route map, content information indicating the degree of danger regarding the driving of vehicle 2, and the like.

[0029] The transfer method determination unit 25 acquires distributed display information from the distributed display information acquisition unit 21, acquires drawing capability information indicating the drawing capability of the transfer source 20 and the drawing capability of the transfer destination 30 from the drawing capability information acquisition unit 22, and acquires content information from the application analysis unit 23.

[0030] When the transfer source 20 can directly transfer image information to the transfer destination 30, the transfer method determination unit 25 determines a transfer method according to the drawing ability of the transfer destination 30 based on the content information, the drawing ability of the transfer source 20 which is the vehicle display device, and the drawing ability of the transfer destination 30. In this embodiment, as shown in FIG. 2, the transfer method determination unit 25 determines a transfer method from the transfer source 20 to the first transfer destination 40 and a transfer method from the transfer source 20 to the second transfer destination 50.

[0031] For example, assume that the first transfer destination 40 has a GPU but does not have a decoder, and the second transfer destination 50 does not have a GPU but has a decoder. In this case, the transfer processing unit 27 determines the transfer method to the first transfer destination 40 from the preset transfer method to the command transfer method, and determines the transfer method to the second transfer destination 50 from the preset transfer method to the stream transfer method.

[0032] The transfer method determination unit 25 outputs the distributed display information, the determined transfer method, and the content information to the transfer path determination unit .

[0033] The transfer path determination unit 26 acquires the distributed display information, the determined transfer method, and the content information from the transfer method determination unit 25. In addition, the transfer path determination unit 26 acquires drawing capability information indicating the drawing capability of the transfer source 20 and the drawing capability of the transfer destination 30 from the drawing capability information acquisition unit 22.

[0034] The transfer path determination unit 26 determines a transfer path from the transfer source 20 to the transfer destination 30. The transfer path determination unit 26 may determine the transfer path from the transfer source 20 to the transfer destination 30 based on the determined transfer method and drawing capability information. In this embodiment, as shown in FIG. 2, the transfer path determination unit 26 determines a transfer path from the transfer source 20 to the first transfer destination 40 and a transfer path from the transfer source 20 to the second transfer destination 50. The transfer path determination unit 26 outputs the distributed display information, the determined transfer path, and the transfer method determined by the transfer method determination unit 25 to the transfer processing unit 27.

[0035] The transfer processing unit 27 acquires the distributed display information, the determined transfer path, and the determined transfer method from the transfer path determination unit 26 .

[0036] The transfer processing unit 27 converts (switches) a preset transfer method to the determined transfer method. If the drawing capabilities of the first transfer destination 40 and the second transfer destination 50 are different, the transfer method to the first transfer destination 40 and the transfer method to the second transfer destination 50 may be different. For this reason, the transfer processing unit 27 converts the transfer method to a transfer method corresponding to each of the first transfer destination 40 and the second transfer destination 50. In this embodiment, as shown in FIG. 2, the transfer processing unit 27 converts a preset transfer method to a transfer method determined by the transfer path determination unit 26 (a transfer method that can be transferred from the transfer source 20 to the first transfer destination 40) and converts a preset transfer method to a transfer method determined by the transfer path determination unit 26 (a transfer method that can be transferred from the transfer source 20 to the second transfer destination 50).

[0037] For example, assume that the first transfer destination 40 has a GPU but does not have a decoder, and the second transfer destination 50 does not have a GPU but has a decoder. In this case, the transfer processing unit 27 converts the transfer method for the first transfer destination 40 from a preset transfer method to the command transfer method, and converts the transfer method for the second transfer destination 50 from the preset transfer method to the stream transfer method.

[0038] The transfer processing unit 27 generates drawing commands for drawing the content information and drawing data including textures, frames, and the like of the content information, based on the distributed display information and content information acquired from the transfer method determination unit 25. Here, the image is a still image or a moving image. The drawing commands may be included in the image information.

[0039] The transfer processing unit 27 transfers the drawing commands and drawing data to the transfer destination 30 by the converted transfer method. In this embodiment, as shown in Fig. 2, the transfer processing unit 27 transfers the drawing commands and drawing data to the first transfer destination 40 by the transfer method determined by the transfer path determination unit 26 so that the drawing commands and drawing data can be transferred from the transfer source 20 to the first transfer destination 40, and transfers the drawing commands and drawing data to the second transfer destination 50 by the transfer method determined by the transfer path determination unit 26 so that the drawing commands and drawing data can be transferred from the transfer source 20 to the second transfer destination 50.

[0040] [First forwarding destination 40 and second forwarding destination 50] Each of the first transfer destination 40 and the second transfer destination 50 is a display device mounted on the vehicle 2. For example, each of the first transfer destination 40 and the second transfer destination 50 is a PC equipped with a liquid crystal panel or the like, a mobile terminal such as a smartphone, a car navigation system mounted on the vehicle 2, an electronic mirror system, a multi-information display, or the like. The first transfer destination 40 and the second transfer destination 50 may have the same configuration or different configurations.

[0041] The first destination 40 includes a drawing data receiving unit 41, a drawing processing unit 42, and a display unit 43. The second destination 50 includes a drawing data receiving unit 51, a drawing processing unit 52, and a display unit 53.

[0042] The drawing data receiving units 41, 51 receive the drawing commands and drawing data transferred from the transfer source 20. The drawing data receiving units 41, 51 output the received drawing commands and drawing data to the drawing processing units 42, 52.

[0043] The drawing processing units 42, 52 execute drawing processing for adjusting the display mode of the drawing data based on the drawing command. The drawing processing units 42, 52 output images (drawing contents) obtained by drawing the drawing data to the display units 43, 53.

[0044] The display units 43 and 53 are display screens that display images acquired from the drawing processing units 42 and 52. The multiple display units 43 and 53 synchronously display the acquired images so as to create a sense of overall unity.

[0045] The display units 43 and 53 are, for example, display panels such as a liquid crystal panel, an organic EL (Electro Luminescence) panel, etc. The display units 43 and 53 display, for example, a map for car navigation, menu images for various in-vehicle devices, or a GUI (Graphical User Interface) for operating images such as a search image.

[0046] <Processing Operation> The processing operations of the vehicle display device, the vehicle display method, and the program according to the present embodiment will be described with reference to FIGS. 2 and 3. FIG.

[0047] FIG. 3 is a flowchart showing the processing operation of the transfer source 20 according to the embodiment.

[0048] First, there is a case where an image displayed by a display device is also displayed on another display device. For this reason, when drawing data of the transfer source 20 is transferred to and displayed on each of the first transfer destination 40 and the second transfer destination 50, which are other display devices, an event occurs (S11). In other words, the transfer source 20 acquires an event for displaying an image on each of the first transfer destination 40 and the second transfer destination 50.

[0049] Next, due to the occurrence of the event in step S11, the transfer destination 30, that is, the first transfer destination 40 and the second transfer destination 50 are determined (S12).

[0050] Next, the transfer method determination unit 25 acquires the content information of the application 24 from the application analysis unit 23 (S13).

[0051] Next, the transfer method determination unit 25 acquires drawing capability information indicating the drawing capability of the transfer source 20 and the drawing capability of the transfer destination 30 from the drawing capability information acquisition unit 22 (S14). Specifically, the drawing capability information acquisition unit 22 acquires drawing capability information indicating the drawing capability of the transfer source 20, drawing capability information indicating the drawing capability of the first transfer destination 40, and drawing capability information indicating the drawing capability of the second transfer destination 50.

[0052] Next, when the transfer source 20 can directly transfer the image information to the transfer destination 30, the transfer method determination unit 25 determines a transfer method of the drawing data according to the drawing ability of the transfer destination 30 based on the content information, the drawing ability of the transfer source 20 which is the vehicle display device, and the drawing ability of the transfer destination 30 (S15). Specifically, the transfer method determination unit 25 determines a transfer method from the transfer source 20 to the first transfer destination 40 and a transfer method from the transfer source 20 to the second transfer destination 50.

[0053] Next, the transfer path determination unit 26 determines whether the transfer method determination unit 25 transfers method Then, the transfer path determination unit 26 determines a transfer path from the transfer source 20 to the first transfer destination 40 and a transfer path from the transfer source 20 to the second transfer destination 50 (S16).

[0054] Next, the transfer processing unit 27 executes the transfer process (S17).

[0055] Specifically, the transfer processing unit 27 determines whether the transfer method determination unit 25 transfers method When the transfer processing unit 27 determines the transfer method, the transfer processing unit 27 converts the preset transfer method to the determined transfer method. More specifically, the transfer processing unit 27 converts the preset transfer method to the transfer method determined by the transfer path determination unit 26 (a transfer method that can be transferred from the transfer source 20 to the first transfer destination 40), and converts the preset transfer method to the transfer method determined by the transfer path determination unit 26 (a transfer method that can be transferred from the transfer source 20 to the second transfer destination 50).

[0056] Furthermore, the transfer processing unit 27 acquires the content information from the transfer method determination unit 25, and generates drawing data including a drawing command for drawing the content information, and textures and frames of the content information.

[0057] Next, the transfer processing unit 27 transfers the drawing commands and the drawing data including textures, frames, etc. to the transfer destination 30 by the converted transfer method (S18). Specifically, the transfer processing unit 27 transfers the drawing commands and the drawing data to the first transfer destination 40 by the transfer method determined by the transfer path determination unit 26 so that the drawing commands and the drawing data can be transferred from the transfer source 20 to the first transfer destination 40, and transfers the drawing commands and the drawing data to the second transfer destination 50 by the transfer method determined by the transfer path determination unit 26 so that the drawing commands and the drawing data can be transferred from the transfer source 20 to the second transfer destination 50. Note that the drawing commands and the drawing data transferred to the first transfer destination 40 are different from the drawing commands and the drawing data transferred to the second transfer destination 50, but may be the same.

[0058] Then, the transfer source 20 ends the processing operation of the flowchart showing the processing operation of FIG. 3, and the transfer destination 30 starts the processing operation of the flowchart showing the processing operation of FIG.

[0059] FIG. 4 is a flowchart showing the processing operation of the transfer destination 30 according to the embodiment.

[0060] 2 and 4, the drawing data receiving units 41 and 51 receive the drawing commands and drawing data transferred from the transfer source 20 (S21). The drawing data receiving units 41 and 51 output the received drawing commands and drawing data to the drawing processing units 42 and 52.

[0061] Next, the drawing processing units 42, 52 execute drawing processing to adjust the display mode of the drawing data based on the drawing command (S22). The drawing processing units 42, 52 output to the display units 43, 53 an image obtained by drawing the drawing data.

[0062] Next, the display units 43, 53 display the acquired video (S23). In the display system 1 of this operation example, the times of the multiple display devices are synchronized, so that the display units 43, 53 can synchronously display the drawing commands and drawing data transferred from the transfer source 20 to the first transfer destination 40 and the second transfer destination 50, respectively.

[0063] Then, the processing operations of the flowchart showing the processing operations of the first transfer destination 40 and the second transfer destination 50 are completed.

[0064] Here, the operation of the vehicle display device, the vehicle display method, and the program when the vehicle 2 is actually traveling will be described in a specific example with reference to FIG.

[0065] FIG. 5 is a diagram illustrating examples of cases where drawing fails and succeeds when drawing data is transferred from a transfer source 20 to a transfer destination 30. In FIG.

[0066] For example, as shown in (a) and (b) of FIG. 5, a case will be described in which the transfer source is a car navigation system having a CPU, a GPU, and an encoder, and the transfer destination is a rear display having a CPU and a decoder.

[0067] In this display system 1, while the vehicle 2 is traveling, a map application screen, information about tourist attractions, a notification of sudden acceleration, and the like may be displayed on the rear display.

[0068] In this case, as shown in (a) of Figure 5, when the source car navigation system transfers an OpenGL (Open Graphics Library) command to the destination using the command transfer method, the destination rear display does not have a GPU and is therefore unable to process the OpenGL command, which may result in failure of the drawing process.

[0069] However, according to this embodiment, as shown in (b) of Figure 5, when the car navigation system of the transfer source 20 transfers a drawing frame to the transfer destination 30 using a stream transfer method, the drawing frame can be processed by a decoder on the rear display of the transfer destination 30, and the drawing process is successful.

[0070] In another example, as shown in (c) and (d) of Figure 5, a case will be described in which the source of transfer is a camera system ECU having a CPU and an encoder, and the destination of transfer is a HUD (Head-Up Display) having a CPU and a GPU.

[0071] In this display system 1, when the vehicle 2 is traveling and changing lanes or turning right or left, a camera image of the vehicle's surroundings may be displayed on the HUD.

[0072] In this case, as shown in (c) of Figure 5, when the source camera-system ECU (Electronic Control Unit) transfers the drawing frame to the destination using a stream transfer method, the destination HUD does not have a decoder and is therefore unable to process the drawing frame, which may result in the drawing process failing.

[0073] However, according to this embodiment, as shown in (d) of FIG. 5, when the camera system ECU of the transfer source 20 transfers the OpenGL command to the transfer destination 30 using the command transfer method, the HUD of the transfer destination 30 is able to process the OpenGL command using a GPU, and therefore the drawing process is successful.

[0074] <Action and effect> Next, the effects of the vehicle display device, the vehicle display method, and the program according to the present embodiment will be described.

[0075] As described above, the vehicle display device of this embodiment is a vehicle display device that transfers image information to the destination 30, which is a display device mounted on the vehicle 2, and includes a transfer method determination unit 25 that determines a transfer method for the image information according to the drawing capabilities of the destination 30 based on the image information, the drawing capabilities of the source 20, which is the vehicle display device, and the drawing capabilities of the destination 30, and a transfer processing unit 27 that converts a preset transfer method into the transfer method determined by the transfer method determination unit 25 and transfers the image information to the destination 30 using the converted transfer method.

[0076] According to this, the drawing data can be transferred to the transfer destination 30 after being converted into a transfer method according to the hardware configurations of the transfer source 20 and the transfer destination 30. Therefore, the transfer destination 30 can obtain the drawing data using a transfer method according to its own drawing capabilities, and can perform drawing processing on the obtained drawing data.

[0077] Therefore, the vehicle display device can realize drawing among a plurality of display devices having different drawing capabilities. As a result, the transfer destination 30 can display an image obtained by drawing processing the drawing data, thereby realizing remote drawing among a plurality of display devices.

[0078] Furthermore, the vehicle display method according to this embodiment is a vehicle display method in which a transfer source 20 transfers image information to a transfer destination 30, which is a display device mounted on a vehicle 2, and includes determining a transfer method for the image information according to the drawing capabilities of the transfer destination 30 based on the image information, the drawing capabilities of the transfer source 20, and the drawing capabilities of the transfer destination 30, converting a pre-set transfer method into the determined transfer method, and transferring the image information to the transfer destination 30 using the converted transfer method.

[0079] This method also provides the same effects as those described above.

[0080] The program according to the present embodiment is a program for causing a computer to execute a vehicle display method.

[0081] This program also provides the same effects as those described above.

[0082] Furthermore, in the vehicle display device of this embodiment, when the source 20 can directly transfer image information to the destination 30 using the converted transfer method, the transfer method determination unit 25 determines a transfer method according to the drawing capabilities of the destination 30 based on the image information, the drawing capabilities of the source 20, and the drawing capabilities of the destination 30.

[0083] This allows the source 20 to transfer drawing data directly to the destination 30 without going through a relay, which is expected to suppress an increase in communication volume and processing load in the system including the destination 30 and the source 20.

[0084] (First Modification of the Embodiment) This modified example differs from the embodiment in that drawing data is transferred to the transfer destination 30 via a relay device 140. Other configurations in this modified example are the same as those in the embodiment unless otherwise specified, and the same configurations are denoted by the same reference numerals and detailed description of the configurations is omitted.

[0085] <Functional configuration> A display system 1a according to this modification will be described with reference to Fig. 6. Fig. 6 is a block diagram showing a display system 1a according to the first modification of the embodiment.

[0086] In the display system 1a of this modified example, a repeater 140 is set when drawing commands and drawing data cannot be directly transferred from the transfer source 20a to the transfer destination 30. The repeater 140 relays between the transfer source 20a and the transfer destination 30, and is capable of transferring the drawing commands and drawing data by a transfer method that allows drawing at the transfer destination 30. The repeater 140 is, for example, a display device mounted on the vehicle 2, an in-vehicle device, or the like.

[0087] First, the transfer source 20a of the display system 1a in this modified example will be described.

[0088] The transfer source 20a includes a distributed display information acquisition unit 21, a drawing capability information acquisition unit 22, an application analysis unit 23, an application 24, a transfer method determination unit 25, a transfer path determination unit 26, and a transfer processing unit 27, as well as a system load monitoring unit 122 and a repeater diagnosis unit 121.

[0089] The system load monitoring unit 122 monitors the load of the candidate relays and the transfer source 20a when the candidate relays 140 are extracted from the display devices, in-vehicle devices, etc. mounted on the vehicle 2. In particular, when there are multiple candidate relays, the system load monitoring unit 122 monitors the load of the multiple candidate relays and the load of the transfer source 20a. The system load monitoring unit 122 outputs relay information indicating the candidate relays to the transfer path determination unit 26. For example, the system load monitoring unit 122 may set priorities for the candidate relays according to the loads. In addition, the system load monitoring unit 122 may output relay information indicating the candidate relay with the smallest load and relay information indicating the load of each of the multiple candidate relays to the transfer path determination unit 26.

[0090] The repeater diagnostic unit 121 diagnoses candidate repeaters included in the repeater information output by the system load monitor unit 122 to the transfer path determination unit 26. The repeater diagnostic unit 121 outputs the diagnosis result for the diagnosed candidate repeater to the transfer path determination unit 26. For example, if a candidate repeater is out of order, it cannot function as the repeater 140, and therefore the repeater diagnostic unit 121 outputs the diagnosis result for excluding such a candidate repeater to the transfer path determination unit 26.

[0091] The transfer path determination unit 26 acquires the diagnosis result from the relay diagnosis unit 121, acquires the determined transfer method from the transfer method determination unit 25, and acquires the relay information from the system load monitoring unit 122, and then determines a transfer path from the transfer source 20a to the transfer destination 30. In other words, the transfer path determination unit 26 determines a transfer path from the transfer source 20a to the transfer destination 30 via the relay 140 based on the diagnosis result, the determined transfer method, and the relay information.

[0092] When the transfer source 20a cannot directly transfer the drawing command and the drawing data to the transfer destination 30, the transfer path determination unit 26 selects a candidate repeater from among the multiple display devices and determines whether the selected candidate repeater can transfer (is usable) the drawing command and the drawing data to the transfer destination 30 by a transfer method according to the drawing capability of the transfer destination 30. That is, the transfer path determination unit 26 selects a candidate repeater based on the diagnosis result, the determined transfer method, and the repeater information, and can determine whether the candidate repeater is usable based on the diagnosis result of the selected candidate repeater. When the transfer path determination unit 26 can determine that the selected candidate repeater is usable based on the diagnosis result, the transfer path determination unit 26 determines a transfer path from the transfer source 20a to the transfer destination 30 via the repeater 140.

[0093] 6, in this modification, when the transfer path determination unit 26 determines that the selected candidate relay can transfer the drawing command and drawing data to the transfer destination 30 by a transfer method corresponding to the drawing capability of the transfer destination 30, the transfer path determination unit 26 determines the candidate relay as a relay 140 included in the transfer path, and determines a transfer path from the transfer source 20a to the first transfer destination 40 via the determined relay 140. In addition, when the drawing command and drawing data can be transferred directly from the transfer source 20a to the second transfer destination 50, the transfer path determination unit 26 determines a transfer path from the transfer source 20a to the second transfer destination 50.

[0094] The transfer path determination unit 26 outputs the determined transfer path and the transfer method determined by the transfer method determination unit 25 to the transfer processing unit 27.

[0095] In addition, if the transfer path determination unit 26 determines that the candidate repeater selected based on the diagnosis result is not usable, it selects the next candidate repeater, obtains the diagnosis result of the next candidate repeater from the repeater diagnosis unit 121, and again determines whether the next candidate repeater is usable or not.

[0096] The transfer processing unit 27 transfers the drawing commands, drawing data, etc. to the transfer destination 30 and the relay 140. In this modification, as shown in Fig. 6, the transfer processing unit 27 transfers the drawing commands and drawing data from the transfer source 20a to the relay 140 by a transfer method set in advance, and transfers the drawing commands, drawing data, etc. from the transfer source 20a to the second transfer destination 50 by a transfer method that allows transfer.

[0097] Next, the repeater 140 of the display system 1a in this modified example will be described.

[0098] Moreover, the display system 1a of this modified example includes a repeater 140 in addition to the transfer source 20a and the transfer destination 30.

[0099] The relay 140 is set by the transfer source 20a when the transfer source 20a cannot directly transfer the drawing command, the drawing data, and the like to the transfer destination 30. The relay 140 includes a drawing data receiving unit 141, a transfer method conversion unit 142, and a transfer processing unit 143.

[0100] The drawing data receiving unit 141 receives the determined transfer method, the determined transfer path, the drawing command, and the drawing data transferred from the transfer source 20a. The drawing data receiving unit 141 outputs the determined transfer method, the determined transfer path, the drawing command, and the drawing data to the transfer method conversion unit 142.

[0101] The transfer method conversion unit 142 acquires the determined transfer method, the determined transfer path, the drawing command, and the drawing data. Based on the determined transfer method, the transfer method conversion unit 142 converts a preset transfer method into a transfer method according to the drawing capability of the transfer destination 30 determined by the transfer method determination unit 25. In this modified example, as shown in FIG. Transfer method conversion unit 142 converts a preset transfer method into a transfer method that allows transfer from the relay device 140 to the first transfer destination 40.

[0102] Based on the determined transfer path, the transfer processing unit 143 transfers the drawing command and drawing data to the first transfer destination 40 using the transfer method converted by the transfer method conversion unit 142, i.e., a transfer method that can be transferred from the repeater 140 to the first transfer destination 40.

[0103] <Processing Operation> The processing operations of the vehicular display device, the vehicular display method, and the program according to this modification will be described with reference to FIGS.

[0104] FIG. 7 is a flowchart showing the processing operation of the transfer source 20a according to the first modification of the embodiment.

[0105] In this operation example, the same processing operations as those in Fig. 3 are denoted by the same reference numerals and the description thereof will be omitted as appropriate. Also, in this operation example, as an example, a case where a relay device 140 is interposed between the transfer source 20a and the first transfer destination 40 is assumed. Note that this operation example is merely an example, and a case where a relay device 140 is interposed between the transfer source 20a and the second transfer destination 50 may also be used.

[0106] First, through the processing operations of steps S11 to S15, the repeater diagnosis unit 121 acquires drawing capability information of the candidate repeater 140 indicated in the repeater information output by the system load monitoring unit 122 to the transfer path determination unit 26 (S15a).

[0107] Next, when the transfer source 20a cannot directly transfer the drawing data to the first transfer destination 40, the transfer path determination unit 26 selects a candidate repeater from among the multiple display devices (S15b). The transfer path determination unit 26 selects one candidate repeater from one or more candidate repeaters indicated in the repeater information acquired from the system load monitoring unit 122. The transfer path determination unit 26 outputs information indicating the selected candidate repeater to the repeater diagnosis unit 121.

[0108] Next, the repeater diagnostic unit 121 diagnoses whether the selected candidate repeater is usable or not based on the information indicating the selected candidate repeater (S15c). For example, the repeater diagnostic unit 121 diagnoses the drawing capability, the presence or absence of a malfunction, etc. of the selected candidate repeater. The repeater diagnostic unit 121 outputs the diagnosis result regarding the selected candidate repeater to the transfer path determination unit 26.

[0109] Next, the transfer path determination unit 26 determines whether the candidate relay selected in step S15b can transfer the drawing data to the first transfer destination 40 by a transfer method according to the drawing capability of the first transfer destination 40. That is, the transfer path determination unit 26 determines whether the selected candidate relay is usable or not based on the acquired diagnosis result (S15d).

[0110] If the transfer path determination unit 26 determines that the selected candidate repeater is not available (NO in S15d), it determines based on the repeater information whether or not there is any undiagnosed candidate that has the drawing capability required for the repeater 140 (S15e).

[0111] When the transfer path determination unit 26 determines that the undiagnosed candidates include one having the rendering capability required for the relay 140 (YES in S15e), the process returns to step S15b.

[0112] On the other hand, if the transfer path determination unit 26 determines that there is no undiagnosed candidate that has the drawing capability required for the relay 140 (NO in S15e), it executes processing for when the candidate relay is unavailable (S15f). Then, the processing operation of the flowchart showing the processing operation of the first transfer destination 40 shown in FIG. 7 is terminated.

[0113] Returning to the description of step S15d, the transfer path determination unit 26, when it has determined that the selected candidate relay can transfer drawing data to the first transfer destination 40 by a transfer method according to the drawing capability of the first transfer destination 40, determines the candidate relay as the relay 140 included in the transfer path. Furthermore, the transfer path determination unit 26 determines a transfer path from the transfer source 20a to the first transfer destination 40 via the determined relay 140. That is, when the transfer path determination unit 26 has determined that the selected candidate relay is usable (YES in S15d), the transfer source 20a ends the processing operation of the flowchart showing the processing operation of the transfer source 20a shown in FIG. 7 via steps S16 to S18. Then, the relay 140 starts the processing operation of the flowchart showing the processing operation of the relay 140 in FIG. 8.

[0114] FIG. 8 is a flowchart showing a processing operation of repeater 140 according to the first modification of the embodiment.

[0115] 8, the drawing data receiving unit 141 of the repeater 140 receives the determined transfer method, the determined transfer path, the drawing command, and the drawing data transferred from the transfer source 20a (S31). The drawing data receiving unit 141 outputs the determined transfer method, the determined transfer path, the drawing command, and the drawing data to the transfer method conversion unit 142.

[0116] Next, the transfer method conversion unit 142 acquires the determined transfer method, the determined transfer path, and the received drawing command and drawing data. Based on the determined transfer method, the transfer method conversion unit 142 converts the preset transfer method into a transfer method according to the drawing capability of the transfer destination 30 determined by the transfer method determination unit 25 (S32).

[0117] Next, the transfer processing unit 143 transfers the drawing command and the drawing data to the transfer destination 30 using the transfer method converted by the transfer method conversion unit 142 (S33). Then, the relay device 140 ends the processing operation of the flowchart showing the processing operation of Fig. 8, and the first transfer destination 40 starts the processing operation of the flowchart showing the processing operation of Fig. 4.

[0118] Here, a specific example of the processing operations of the vehicular display device, the vehicular display method, and the program when the vehicle 2 is actually traveling will be described with reference to FIG.

[0119] FIG. 9 is another diagram illustrating an example of a case where drawing fails and a case where drawing succeeds when drawing data is transferred from the transfer source 20a to the transfer destination 30. In FIG.

[0120] For example, as shown in (a) and (b) of FIG. 9, a case will be described in which the transfer source is a detection system ECU having a CPU, and the transfer destination is an electronic mirror having a CPU and a decoder.

[0121] In this display system 1a, if a vehicle approaches ahead while the user is looking at the electronic mirror while the vehicle 2 is traveling, a graphical warning may be displayed on the electronic mirror.

[0122] In this case, as shown in (a) of Figure 9, when the source detection ECU transfers an OpenGL command to the destination using the command transfer method, the destination electronic mirror does not have a GPU and is therefore unable to process the OpenGL command, which may result in failure of the drawing process.

[0123] However, according to this modification, as shown in (b) of Fig. 9, when a car navigation system having a CPU, GPU, and encoder is set as the repeater 140, the detection system ECU of the transfer source 20a transfers the OpenGL command to the repeater 140 by the command transfer method. The car navigation system of the repeater 140 converts from the command transfer method to the stream transfer method, and transfers the drawing frame to the transfer destination 30 by the stream transfer method. In the electronic mirror of the transfer destination 30, the decoder can process the drawing frame, so the drawing process is successful.

[0124] <Action and effect> Next, the effects of the vehicle display device, the vehicle display method, and the program according to this modification will be described.

[0125] As described above, in the vehicle display device according to this modification, a plurality of display devices are provided in the vehicle 2. The vehicle display device according to this modification also includes a transfer path determination unit 26 that determines a transfer path from the transfer source 20a to the transfer destination 30. When the transfer source 20a cannot directly transfer image information to the transfer destination 30, the transfer method determination unit 25 selects a candidate repeater from among the plurality of display devices and determines whether the selected candidate repeater can transfer image information to the transfer destination 30 by a transfer method according to the drawing capability of the transfer destination 30.

[0126] According to this, it is possible to select a candidate relay and determine whether the candidate relay is available. Therefore, if the candidate relay is available, even if the drawing data cannot be directly transferred from the transfer source 20a to the transfer destination 30, it becomes possible to transfer the drawing data from the transfer source 20a to the transfer destination 30 via the relay 140.

[0127] In addition, in the vehicle display device of this modified example, when the transfer path determination unit 26 determines that the selected candidate repeater is capable of transferring image information to the destination 30 using a transfer method corresponding to the drawing capability of the destination 30, it determines the candidate repeater as a repeater 140 included in the transfer path, and determines the transfer path from the source 20a to the destination 30 via the determined repeater 140.

[0128] According to this, a transfer path from the transfer source 20a to the transfer destination 30 via the relay device 140 can be determined according to the hardware configurations of the transfer source 20a, the relay device 140, and the transfer destination 30. Therefore, even if the transfer source 20a cannot directly transfer drawing data to the transfer destination 30, Original 20a The drawing data can then be transferred to the transfer destination 30 via the repeater 140. As a result, the transfer destination 30 can display an image that has been rendered based on the drawing data.

[0129] Furthermore, in the vehicle display device according to this modified example, the transfer method determination unit 25 determines a transfer method according to the drawing capabilities of the transfer destination 30 based on the image information, the drawing capabilities of the transfer source 20a, and the drawing capabilities of the transfer destination 30, and the repeater 140 determined by the transfer path determination unit 26 converts the pre-set transfer method into a transfer method according to the drawing capabilities of the transfer destination 30 determined by the transfer method determination unit 25, and transfers the image information to the transfer destination 30 using the converted transfer method.

[0130] According to this, the drawing data can be converted into a transfer method according to the hardware configurations of the repeater 140 and the transfer destination 30 and transferred to the transfer destination 30. The transfer destination 30 can acquire the drawing data by a transfer method according to its own drawing capability, and can perform drawing processing on the acquired drawing data. For example, even if the transfer source 20a cannot directly transfer drawing data to the transfer destination 30, the vehicle display device according to this modified example can realize remote drawing among a plurality of display devices.

[0131] This modified example also provides the same effects as those described above.

[0132] (Modification 2 of the embodiment) This modified example differs from the modified example 1 of the embodiment in that the second transfer destination 250 serves as a relay to transfer drawing commands and drawing data to the first transfer destination 40, and the second transfer destination 250 serves as a display device to display an image indicated by the drawing data. Unless otherwise specified, the other configurations of this modified example are the same as those of the embodiment, the modified example 1 of the embodiment, etc., and the same components are denoted by the same reference numerals and detailed description of the configurations will be omitted.

[0133] <Functional configuration> A display system 1b according to this modified example will be described with reference to Fig. 10. Fig. 10 is a block diagram showing a display system 1b according to modified example 2 of the embodiment.

[0134] In this modified example, a case will be illustrated in which the second transfer destination 250 functions as a repeater and a display device, and the final transfer destination 30 is the first transfer destination 40. Note that the first transfer destination 40 may function as a repeater and a display device, and the final transfer destination 30 may be the second transfer destination 50.

[0135] The second transfer destination 250, which is a relay in this modified example, displays the first drawing data included in the drawing data acquired from the transfer source 20b. In addition, the second transfer destination 250 converts the transfer method into one corresponding to the drawing capability of the transfer destination 30 determined by the transfer method determination unit 25, and transfers the second drawing data included in the drawing data to the transfer destination 30 by the converted transfer method. The first drawing data is an example of first image information, and the second drawing data is an example of second image information.

[0136] Specifically, the second destination 250 includes a drawing data receiving unit 51 , a drawing processing unit 52 , a display unit 53 , a transfer method conversion unit 252 , and a transfer processing unit 253 .

[0137] The drawing data receiving unit 51 receives the determined transfer method, the determined transfer path, and the drawing command and drawing data (first drawing data and second drawing data) transferred from the transfer source 20b. The drawing data receiving unit 51 outputs the drawing command and the first drawing data to the drawing processing unit 52. In addition, the drawing data receiving unit 51 outputs the determined transfer method, the determined transfer path, the drawing command, and the second drawing data to the transfer method conversion unit 252.

[0138] The drawing processing unit 52 executes drawing processing for adjusting the display mode of the first drawing data based on the drawing command. The drawing processing unit 52 outputs to the display unit 53 an image obtained by drawing the first drawing data.

[0139] The display unit 53 displays the image acquired from the drawing processing unit 52 .

[0140] The transfer method conversion unit 252 acquires the determined transfer method, the determined transfer path, the drawing command, and the second drawing data. Based on the determined transfer method, the transfer method conversion unit 252 converts a preset transfer method to the determined transfer method. In this modification, as shown in FIG. Format conversion unit 252 converts a preset transfer method into a determined transfer method (a transfer method that allows transfer from the second transfer destination 250 to the first transfer destination 40).

[0141] The transfer processing unit 253 transfers the drawing command and the second drawing data to the first destination 40 in the transfer method converted by the transfer method conversion unit 252 , that is, in a transfer method that allows transfer from the second destination 250 to the first destination 40 .

[0142] <Action and effect> Next, the effects of the vehicle display device, the vehicle display method, and the program according to this modification will be described.

[0143] As described above, in the vehicle display device according to this modified example, the repeater determined by the transfer path determination unit 26 has a display unit 53 that displays the first image information included in the image information acquired from the transfer source 20b. The repeater then converts a preset transfer method into a transfer method according to the drawing capability of the transfer destination 30 determined by the transfer method determination unit 25, and transfers the second image information included in the image information to the transfer destination 30 by the converted transfer method.

[0144] 10 can function as a relay and a display device. Therefore, the second transfer destination 250 can display the first image information acquired from the transfer source 20b, and can display the second image information acquired from the transfer source 20b. Furthermore, the drawing data can be converted into a transfer method according to the hardware configuration of the relay and the transfer destination 30 and transferred to the first transfer destination 40.

[0145] This modified example also provides the same effects as those described above.

[0146] (Third Modification of the Embodiment) This modified example differs from the embodiment and the modified examples 1 and 2 of the embodiment in that when there is no available relay device, RAW data is transferred to the first transfer destination 40. Unless otherwise specified, other configurations in this modified example are the same as those in the embodiment and the modified examples 1 and 2 of the embodiment, and the same configurations are given the same reference numerals and detailed description of the configurations is omitted. Note that, in this modified example, the first transfer destination 40 is used as an example of the transfer destination 30, but the second transfer destination 50 may also be used as an example of the transfer destination 30.

[0147] <Functional configuration> A display system 1c according to this modified example will be described with reference to Fig. 11. Fig. 11 is a block diagram showing a display system 1c according to a modified example 3 of the embodiment.

[0148] In this modified example, there may be a case where there is no relay capable of transferring drawing data by a transfer method corresponding to the drawing capability of the first transfer destination 40. In this case, the transfer source 20c estimates the frame rate of the first transfer destination 40 to determine whether or not to transfer the content information as RAW data.

[0149] Specifically, the transfer source 20c includes a distributed display information acquisition unit 21, a drawing capability information acquisition unit 22, an application analysis unit 23, an application 24, a transfer method determination unit 25, a transfer path determination unit 26, and a transfer processing unit 27, as well as a performance estimation unit 321.

[0150] The performance estimation unit 321 acquires performance information indicating the performance of the first transfer destination 40 from the first transfer destination 40 or a storage unit, and estimates the frame rate of the first transfer destination 40 based on the performance information indicating the performance of the first transfer destination 40. The performance estimation unit 321 outputs the estimation result of the frame rate of the first transfer destination 40 to the transfer path determination unit 26.

[0151] When the frame rate of the first transfer destination 40 is greater than a predetermined threshold, the transfer path determination unit 26 transfers the RAW data directly to the first transfer destination 40, which is the determined transfer path. In other words, when the transfer path determination unit 26 determines that the selected candidate relay is not capable of transferring the drawing data to the first transfer destination 40 by a transfer method corresponding to the drawing capability of the first transfer destination 40, the transfer source 20c transfers the RAW data to the first transfer destination 40 without converting the transfer method.

[0152] Furthermore, the transfer path determination unit 26 stops the transfer of the rendering data and the RAW data to the first destination 40 when the frame rate of the first destination 40 is equal to or lower than a predetermined threshold value.

[0153] <Action and effect> Next, the effects of the vehicle display device, the vehicle display method, and the program according to this modification will be described.

[0154] As described above, in the vehicle display device of this modified example, if the transfer path determination unit 26 determines that the selected candidate repeater is not capable of transferring image information to the destination 30 using a transfer method that corresponds to the drawing capabilities of the destination 30, the transfer source 20c transfers the image information to the destination 30 without converting the transfer method.

[0155] According to this, for example, when the specifications of the transfer destination 30 are low, by transferring the data as RAW data, the transfer destination 30 can display the RAW data as an image.

[0156] The vehicle display device according to this modification also includes a performance estimation unit 321 that estimates a frame rate of the destination 30 based on performance information indicating the performance of the destination 30. The source 20c transfers image information to the destination 30 when the frame rate of the destination 30 is higher than a predetermined threshold.

[0157] For example, if the frame rate of the transfer destination 30 is higher than a predetermined threshold, it is considered that the transfer destination 30 can display the RAW data as an image even if RAW data is transferred to the transfer destination 30. Therefore, if the estimated frame rate of the transfer destination 30 is higher than a predetermined threshold, the transfer destination 30 can display the RAW data as an image by transferring the data as RAW data.

[0158] This modified example also provides the same effects as those described above.

[0159] (Fourth Modification of the Embodiment) This modification differs from the third modification of the embodiment in that a new forwarding destination is displayed. Unless otherwise specified, other configurations in this modification are the same as those in the third modification of the embodiment, and the same components are denoted by the same reference numerals and detailed description of the configurations is omitted.

[0160] <Functional configuration> A display system 1d according to the fourth modification will be described with reference to Fig. 12. Fig. 12 is a block diagram showing a display system 1d according to a fourth modification of the embodiment.

[0161] In this modification, there may be no relay capable of transferring drawing data by a transfer method according to the drawing capability of the transfer destination 30. In this modification, the first transfer destination 40 is illustrated as an example of the transfer destination 30. Note that in this modification, the second transfer destination 50 may also be used as an example of the transfer destination 30.

[0162] In this case, the transfer source 20d estimates the frame rate of the first transfer destination 40 to determine whether or not to transfer the content information as RAW data.

[0163] The transfer source 20d includes a distributed display information acquisition unit 21, a drawing capability information acquisition unit 22, an application analysis unit 23, an application 24, a transfer method determination unit 25, a transfer path determination unit 26, a transfer processing unit 27, a repeater diagnosis unit 121, and a system load monitoring unit 122, as well as a performance estimation unit 321 and a presentation unit 421.

[0164] If the transfer path determination unit 26 determines that the selected candidate relay device is not capable of transferring drawing data to the first transfer destination 40 using a transfer method that corresponds to the drawing capability of the first transfer destination 40, the transfer source 20d transfers the RAW data to the first transfer destination 40 without converting the transfer method.

[0165] Specifically, if the repeater diagnosis unit 121 diagnoses that all of the candidate repeaters selected by the transfer path determination unit 26 are not usable, there is no repeater among the multiple display devices that can transfer drawing data using a transfer method that corresponds to the drawing capabilities of the first transfer destination 40.

[0166] In this case, the transfer path determination unit 26 determines a transfer path from the transfer source 20d to the first transfer destination 40 without going through a repeater. The transfer path determination unit 26 directly transfers the RAW data of the content information to the first transfer destination 40, which is the determined transfer path. The RAW data is an example of image information.

[0167] Furthermore, the performance estimation unit 321 acquires performance information indicating the performance of the first transfer destination 40 from the first transfer destination 40 or the storage unit, and estimates the frame rate of the first transfer destination 40 based on the performance information indicating the performance of the first transfer destination 40. The performance estimation unit 321 outputs the estimation result of the frame rate of the first transfer destination 40 to the transfer path determination unit 26.

[0168] When the frame rate of the first transfer destination 40 is greater than a predetermined threshold, it is considered that the drawing processing capability of the CPU, etc. of the first transfer destination 40 is sufficient. Therefore, when the frame rate of the first transfer destination 40 is greater than a predetermined threshold, the transfer path determination unit 26 transfers the RAW data directly to the first transfer destination 40, which is the determined transfer path.

[0169] Also, when the frame rate of the first transfer destination 40 is equal to or lower than a predetermined threshold, it is considered that the drawing processing capability of the CPU, etc., of the first transfer destination 40 is insufficient. For this reason, as shown by the two-dot chain line in FIG. 12, when the frame rate of the first transfer destination 40 is equal to or lower than a predetermined threshold, the transfer path determination unit 26 stops the transfer of the drawing data and the RAW data to the first transfer destination 40 and determines that the data cannot be displayed. At this time, when the transfer path determination unit 26 determines that the selected candidate relay device is not capable of transferring the drawing data and the RAW data to the first transfer destination 40 by a transfer method according to the drawing capability of the first transfer destination 40, the transfer source 20d outputs a list of new transfer destinations from among a plurality of display devices. Specifically, since the hardware information of the drawing capability information includes the name of the display device, the transfer source 20d can output a list of new transfer destinations. This allows the user to select the third transfer destination 50d for displaying the drawing data from the list of new transfer destinations.

[0170] Further, the transfer source 20d outputs a message to the presentation unit 421 indicating that the transfer of the drawing data and the RAW data has been stopped. The presentation unit 421 is, for example, a display device or an audio device. The transfer source 20d may cause the display device, which is the presentation unit 421 mounted on the vehicle 2, to display a message to the effect that the transfer of the drawing data and the RAW data has been stopped, or may cause the audio device, which is the presentation unit 421 mounted on the vehicle 2, to output a sound to the effect that the transfer of the drawing data and the RAW data has been stopped.

[0171] Furthermore, when the transfer path determination unit 26 determines that the selected candidate repeater is not capable of transferring image information to the first transfer destination 40 by a transfer method corresponding to the drawing capability of the first transfer destination 40, the transfer source 20d outputs to the presentation unit 421 that the repeater cannot be used. For example, the transfer source 20d may cause a display device mounted on the vehicle 2 to display that the repeater cannot be used, or may cause an audio device mounted on the vehicle 2 to output a sound that the repeater cannot be used.

[0172] <Processing Operation> The processing operations of the vehicular display device, the vehicular display method, and the program according to this modification will be described with reference to FIG. 12 and FIG.

[0173] Fig. 13 is a flowchart showing the processing operations of the transfer source 20d according to the modified example 4 of the embodiment. In this operation example, the same processing operations as those in Fig. 3 are denoted by the same reference numerals and the description thereof will be omitted as appropriate.

[0174] First, a repeater is selected as a candidate based on the diagnosis result obtained from the repeater diagnosis unit 121. No If the transfer path determination unit 26 determines that it is possible (the repeater is unavailable), the transfer path determination unit 26 determines to use a method of directly transferring the RAW data of the content information (S41). In other words, the transfer path determination unit 26 determines a transfer path for directly transferring the RAW data from the transfer source 20d to the first transfer destination 40.

[0175] Next, the performance estimation unit 321 estimates the frame rate when the RAW data is directly transferred from the transfer source 20d to the first transfer destination 40 (S42). The performance estimation unit 321 outputs the estimated frame rate to the transfer path determination unit .

[0176] Next, the transfer path determination unit 26 determines whether or not the frame rate of the first destination 40 is greater than a predetermined threshold value (S43).

[0177] Next, when the transfer path determination unit 26 determines that the frame rate of the first transfer destination 40 is higher than the predetermined threshold value (YES in S43), the transfer source 20d completes the processing operation of the flowchart showing the processing operation of the transfer source 20d shown in Fig. 13 via steps S16 to S18. The first transfer destination 40 starts the processing operation of the flowchart showing the processing operation of Fig. 4.

[0178] If the frame rate of the first destination 40 is equal to or lower than a predetermined threshold (NO in S43), the transfer path determination unit 26 stops the transfer of the rendering data and RAW data to the first destination 40 (stops determining the path) and determines that display is not possible.

[0179] Next, the repeater diagnostic unit 121 of the transfer source 20d outputs a warning (S44). Specifically, the repeater diagnostic unit 121 outputs a warning to the effect that the transfer of the drawing data and the RAW data has been stopped to the presentation unit 421. As a result, the presentation unit 421 outputs a warning to the effect that the transfer of the drawing data and the RAW data has been stopped.

[0180] Next, the repeater diagnosis unit 121 outputs a list of new transfer destinations from among the multiple display devices, that is, display devices to which the data can be directly transferred from the transfer source, to the presentation unit 421 (S45). This allows the user to select the first transfer destination 40 for displaying the drawing data from the list of new transfer destinations.

[0181] Next, the repeater diagnosis unit 121 confirms with the user whether or not to display the drawing data on another display device (S46). Specifically, the repeater diagnosis unit 121 causes the presentation unit 421 to present a confirmation item for whether or not to display the drawing data on another display device.

[0182] Next, the transfer source 20d determines whether or not the user has selected to display the drawing data on another display device that is the new transfer destination (S47). That is, the transfer source 20d determines whether or not the user has selected to display the drawing data on another display device via the operation input unit mounted on the vehicle 2.

[0183] When the transfer source 20d determines that display on another display device has been selected (YES in S47), the process proceeds to step S16.

[0184] On the other hand, when the transfer source 20d determines that display on another display device has not been selected (NO in S47), it ends the processing operation of the flowchart showing the processing operation of the transfer source 20d shown in FIG.

[0185] Here, a specific example of the processing operation of the vehicular display device, the vehicular display method, and the program when the vehicle 2 is actually traveling will be described with reference to Fig. 14. Fig. 14 is yet another diagram illustrating a case where drawing is successful when drawing data is transferred from the transfer source 20d to the first transfer destination 40.

[0186] For example, as shown in (a) of Figure 14, a case will be described in which the source 20d has a CPU, a GPU, and an encoder, and the destination 30 has a CPU, and as shown in (b) of Figure 14, a case will be described in which the detection system ECU of the source 20d has a CPU, and the electronic mirror of the destination 30 has a CPU and a decoder.

[0187] In this modification, as shown in (a) of Fig. 14, when there is no relay between the source and destination and the destination only has a CPU, if the frame rate of the destination 30 is greater than a predetermined threshold, the CPU of the source 20d transfers the RGBA RAW data to the destination. 30 ahead Since RAW data is obtained, the drawing process is successful.

[0188] 14(b), in the present modification, when the transfer source 20d is a detection system ECU having a CPU and the transfer destination 30 is an electronic mirror having a CPU and a decoder, if there is no repeater between the transfer source 20d and the transfer destination 30 and the frame rate of the transfer destination 30 is greater than a predetermined threshold, the detection system ECU of the transfer source 20d transfers the RAW data to the transfer destination 30. Since the transfer destination 30 acquires the RAW data, the drawing process is successful.

[0189] <Action and effect> Next, the effects of the vehicle display device, the vehicle display method, and the program according to this modification will be described.

[0190] As described above, in the vehicle display device of this modified example, when the frame rate of the transfer destination 30 is below a predetermined threshold, the transfer source 20d stops transferring image information to the transfer destination 30 and outputs a signal to the effect that the transfer of image information has been stopped.

[0191] According to this, by outputting the fact that the transfer has been stopped, the user can recognize that the drawing data could not be displayed as an image at the transfer destination 30. This allows the user to take another measure.

[0192] In addition, in the vehicle display device of this modified example, if the transfer path determination unit 26 determines that the selected candidate repeater is not capable of transferring image information to the destination 30 using a transfer method that corresponds to the drawing capabilities of the destination 30, the transfer source 20d outputs a message indicating that the repeater cannot be used.

[0193] According to this, by outputting the message that the repeater cannot be used, the user can try to see whether the drawing data can be displayed as an image at the transfer destination 30 using a different repeater.

[0194] In addition, in the vehicle display device of this modified example, if the transfer path determination unit 26 determines that the selected candidate repeater is not capable of transferring image information to the destination 30 using a transfer method corresponding to the drawing capability of the destination 30, the source 20d outputs a list of third destinations 50d (list of candidates for the third destination 50d) from among the multiple display devices.

[0195] According to this, the user can visually check the list of the third transfer destinations 50d (list of candidates for the third transfer destinations 50d), and can select a desired transfer destination 30 from the list of the third transfer destinations 50d. As a result, an image obtained by rendering the drawing data can be displayed in the newly selected transfer destination 30.

[0196] This modified example also provides the same effects as those described above.

[0197] (Other variations) The vehicle display device, vehicle display method, and program according to the present disclosure have been described above based on the above-mentioned embodiment and modified examples 1 to 4 of the embodiment, but the present disclosure is not limited to these embodiment and modified examples 1 to 4 of the embodiment. As long as the modifications do not deviate from the spirit of the present disclosure, those having ordinary skill in the art may also be modified in various ways to the embodiment and modified examples 1 to 4 of the embodiment, which are included in the scope of the present disclosure.

[0198] For example, the vehicle display device according to the above embodiment and the first to fourth modifications of the embodiment may have a configuration as shown in FIG. 15. FIG. 15 is a block diagram showing a display system according to another modification. Specifically, the transfer source 20e, which is the vehicle display device, may include a distributed display information acquisition unit 21, a drawing capability information acquisition unit 22, an application analysis unit 23, an application 24, a transfer method determination unit 25, a transfer path determination unit 26, a transfer processing unit 27, a system load monitoring unit 122, a repeater diagnosis unit 121, a performance estimation unit 321, a drawing data receiving unit 551, a drawing processing unit 552, a display unit 553, and a transfer method conversion unit 554. Each component of the transfer source 20e may be the same as the content shown in the above embodiment and the first to fourth modifications of the embodiment.

[0199] In the vehicle display device, vehicle display method, and program according to the above-described embodiment and modified examples 1 to 4 of the embodiment, modified examples 3 and 4 of the embodiment may be executed as an example of step S15f of FIG.

[0200] In addition, in the vehicle display device, vehicle display method, and program according to the above-mentioned embodiment and variants 1 to 4 of the embodiment, since the drawing capability information table includes virtual machine configuration information, etc., the transfer destination may be able to obtain drawing commands and drawing data from the cloud server.

[0201] In addition, since the rendering capability information includes configuration information of the virtual machine, the transfer destination may be a virtual machine running in the control device. For example, when a first virtual machine for controlling the HUD and a second virtual machine for controlling the vehicle instrument are running on a hypervisor on the ECU, the first virtual machine and / or the second virtual machine may be selected as the transfer destination. That is, in the vehicle display device, the vehicle display method, and the program according to the above-mentioned embodiment and the first to fourth modifications of the embodiment, the transfer destination may be selected on a virtual machine basis. The selected virtual machine of the transfer destination may be able to acquire the rendering command and the rendering data.

[0202] In addition, in the vehicle display device, vehicle display method, and program according to the above-mentioned embodiment and the first to fourth variations of the embodiment, it may be determined whether to convert the transfer method according to the content information of the application. In this case, the application may store a table of transfer methods corresponding to the content information. method The determination unit may determine the transfer method using the table acquired by the application analysis unit from the application. For example, when the amount of transfer of drawing data is larger than a reference value due to a large amount of texture, etc., the command transfer method may be converted to the stream transfer method. In the case of the stream transfer method, data is compressed before transfer, so that it is expected that the amount of transfer can be reduced. In another example, in the case of drawing data containing a transparent alpha component, the command transfer method may be selected since the data cannot be rendered by the stream transfer method. In addition, the transfer source may set a displayable area or a display restricted area from among a plurality of display devices according to the type of content information.

[0203] In addition, in the vehicle display device, vehicle display method, and program relating to the above-mentioned embodiment and variants 1 to 4 of the embodiment, if the content information is one in which there is no difference in image quality between the command transfer method and the stream transfer method, or if the content information is one in which the quality difference is within an acceptable range, the content information may be transferred from the destination to the source via a repeater.

[0204] In addition, in the vehicular display device, the vehicular display method, and the program according to the above-mentioned embodiment and the first to fourth modified examples of the embodiment, when the content information has an unacceptable difference in quality between the command transfer method and the stream transfer method, a warning to stop the transfer may be output and the transfer of the drawing data and the RAW data via the repeater may be stopped. In this case, a new transfer destination to which the data can be directly transferred may be determined, and the data may be transferred to the new transfer destination at the discretion of the user.

[0205] In the vehicular display device, vehicular display method, and program according to the above-mentioned embodiment and the first to fourth modified examples of the embodiment, when there are a plurality of candidates for the transfer path, the transfer path determination unit may determine the optimal transfer path based on the content information, the drawing capability information, and the like. In this case, the repeater diagnostic unit diagnoses the repeaters of the transfer path in order from the preferred transfer path (the transfer path with the highest priority) for the candidate transfer paths, and if there is no problem, the transfer path determination unit may determine the preferred transfer path. The priority of the transfer paths may be determined, for example, in terms of the shortest time it takes for the transfer destination to display the drawing data after transferring drawing data from the transfer source to the transfer destination.

[0206] In addition, the transfer method determination unit, the transfer path determination unit, the transfer processing unit, the repeater diagnosis unit, the system load monitoring unit, the performance estimation unit, the transfer method conversion unit, the drawing processing unit, and the like included in the vehicle display device according to the above embodiment and the first to fourth variations of the embodiment are typically realized as an LSI, which is an integrated circuit. These may be individually integrated into one chip, or may be integrated into one chip so as to include some or all of them.

[0207] The integrated circuit is not limited to an LSI, but may be realized by a dedicated circuit or a general-purpose processor. A field programmable gate array (FPGA) that can be programmed after the LSI is manufactured, or a reconfigurable processor that can reconfigure the connections and settings of the circuit cells inside the LSI may also be used.

[0208] In the above-mentioned embodiment and the first to fourth variations of the embodiment, each component may be configured with dedicated hardware, or may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

[0209] In addition, the division of functional blocks in the block diagram is an example, and multiple functional blocks may be realized as one functional block, one functional block may be divided into multiple blocks, or some functions may be transferred to another functional block. Furthermore, the functions of multiple functional blocks having similar functions may be processed in parallel or in a time-sharing manner by a single piece of hardware or software.

[0210] In addition, the order in which each step is performed in the flowchart is merely for illustrative purposes and may be other than the above. In addition, some of the steps may be performed simultaneously (in parallel) with other steps.

[0211] In addition, the present disclosure also includes forms obtained by applying various modifications that a person skilled in the art may conceive of to the above-described embodiment and modified examples 1 to 4 of the embodiment, as well as forms realized by arbitrarily combining the components and functions of the embodiment and modified examples 1 to 4 of the embodiment within the scope of the present disclosure.

[0212] (Additional Note) The following describes features of the vehicle display device, the vehicle display method, and the program described based on the above embodiment and the first to fourth modified examples of the embodiment.

[0213] <Technology 1> A display device for a vehicle that transfers image information to a transfer destination that is a display device mounted in a vehicle, a transfer method determination unit that determines a transfer method of the image information according to a drawing capability of the transfer destination based on the image information, a drawing capability of the transfer source which is the vehicle display device, and a drawing capability of the transfer destination; a transfer processing unit that converts a preset transfer method into the transfer method determined by the transfer method determination unit, and transfers the image information to the transfer destination by the converted transfer method. Vehicle display device.

[0214] <Technology 2> When the transfer source can directly transfer the image information to the transfer destination by the converted transfer method, the transfer method determination unit determines the transfer method according to the drawing capability of the transfer destination based on the image information, the drawing capability of the transfer source, and the drawing capability of the transfer destination. The vehicle display device according to Technology 1.

[0215] <Technology 3> The display device is provided in plurality in the vehicle, a transfer path determination unit that determines a transfer path from the transfer source to the transfer destination; When the source cannot directly transfer the image information to the destination, the transfer method determination unit selects a candidate relay from among the plurality of display devices, and determines whether the selected candidate relay can transfer the image information to the destination by the transfer method according to a drawing capability of the destination. The vehicle display device according to Technology 1.

[0216] <Technology 4> When the transfer path determination unit determines that the selected candidate relay is capable of transferring the image information to the transfer destination by the transfer method corresponding to the drawing capability of the transfer destination, the transfer path determination unit determines the candidate relay as a relay included in the transfer path, and determines the transfer path from the transfer source to the transfer destination via the determined relay. The vehicle display device according to Technology 3.

[0217] <Technology 5> the transfer method determination unit determines the transfer method according to a drawing capability of the transfer destination based on the image information, a drawing capability of the transfer source, and a drawing capability of the transfer destination; The relay determined by the transfer path determination unit converts a preset transfer method into the transfer method corresponding to the drawing capability of the transfer destination determined by the transfer method determination unit, and transfers the image information to the transfer destination by the converted transfer method. The vehicle display device according to claim 4.

[0218] <Technology 6> The relay determined by the transfer path determination unit is a display unit that displays first image information included in the image information acquired from the transfer source, converting a preset transfer method into the transfer method according to the drawing capability of the transfer destination determined by the transfer method determination unit, and transferring second image information included in the image information to the transfer destination by the converted transfer method; The vehicle display device according to any one of claims 4 to 5.

[0219] <Technology 7> If the transfer path determination unit determines that the selected candidate relay device is not capable of transferring the image information to the transfer destination device by the transfer method corresponding to the drawing capability of the transfer destination device, the transfer source device transfers the image information to the transfer destination device without converting the transfer method. The vehicle display device according to Technology 3.

[0220] <Technology 8> a performance estimation unit that estimates a frame rate of the destination based on performance information indicating a performance of the destination, The source transfers the image information to the destination when the frame rate of the destination is greater than a predetermined threshold. The vehicle display device according to claim 7.

[0221] <Technology 9> When the frame rate of the transfer destination is equal to or lower than the predetermined threshold, the transfer source stops the transfer of the image information to the transfer destination and outputs a message indicating that the transfer of the image information has been stopped. The vehicle display device according to claim 8.

[0222] <Technology 10> When the transfer path determination unit determines that the selected candidate relay device is not capable of transferring the image information to the transfer destination device by the transfer method corresponding to the drawing capability of the transfer destination device, the transfer source device outputs a message indicating that the relay device is not available. The display device for a vehicle according to any one of the seventh to ninth aspects of the present invention.

[0223] <Technology 11> When the transfer path determination unit determines that the selected candidate relay device is not capable of transferring the image information to the transfer destination device by the transfer method corresponding to the drawing capability of the transfer destination device, the transfer source device outputs a list of new transfer destination devices from among the plurality of display devices. The display device for a vehicle according to any one of the seventh to tenth aspects of the present invention.

[0224] <Technology 12> A display method for a vehicle in which a source device transfers image information to a destination device that is a display device mounted on the vehicle, comprising: determining a transfer method of the image information according to the drawing capability of the transfer destination based on the image information, the drawing capability of the transfer source, and the drawing capability of the transfer destination; and converting a preset transfer method into the determined transfer method and transferring the image information to the transfer destination by the converted transfer method. Vehicle display method.

[0225] <Technology 13> A method for causing a computer to execute the vehicle display method described in Technology 12. program. [Industrial Applicability]

[0226] The present disclosure can be used, for example, in vehicles equipped with a plurality of display devices, as well as in other devices and systems other than vehicles. [Explanation of symbols]

[0227] 2 Vehicles 3 Display device 20, 20a, 20b, 20c, 20d, 20e Source of transfer (vehicle display device) 25 Transfer Method Determination Unit 26 Transfer route determination unit 27, 253 Transfer processing unit 30 Transfer destination 40 1st forwarding destination (forwarding destination) 50 Second forwarding destination (forwarding destination) 140 Repeater 250 Second transfer destination (repeater) 321 Performance estimation part

Claims

1. A display device for a vehicle that transfers image information to a transfer destination that is a display device mounted in a vehicle, a transfer method determination unit that determines a transfer method of the image information according to the hardware information of the transfer destination based on the image information, hardware information of the transfer source which is the vehicle display device, and hardware information of the transfer destination; a transfer processing unit that converts a preset transfer method into the transfer method determined by the transfer method determination unit, and transfers the image information to the transfer destination by the converted transfer method; The transfer method determination unit When the hardware information of the transfer source indicates that the transfer source has a CPU, a GPU, and an encoder, and the hardware information of the transfer destination indicates that the transfer destination has a CPU and a decoder, determining the transfer method to be a stream transfer method; When the hardware information of the transfer source indicates that the transfer source has a CPU and an encoder, and the hardware information of the transfer destination indicates that the transfer destination has a CPU and a GPU, the transfer method is determined to be the command transfer method. Vehicle display device.

2. A display method for a vehicle in which a source device transfers image information to a destination device that is a display device mounted on the vehicle, comprising: determining a transfer method of the image information according to the hardware information of the transfer destination based on the image information, the hardware information of the transfer source, and the hardware information of the transfer destination; converting a preset transfer method into the determined transfer method, and transferring the image information to the transfer destination by the converted transfer method; When the hardware information of the transfer source indicates that the transfer source has a CPU, a GPU, and an encoder, and the hardware information of the transfer destination indicates that the transfer destination has a CPU and a decoder, determining the transfer method to be a stream transfer method; When the hardware information of the transfer source indicates that the transfer source has a CPU and an encoder, and the hardware information of the transfer destination indicates that the transfer destination has a CPU and a GPU, the transfer method is determined to be the command transfer method. Vehicle display method.

Images