Display control system, and display control method

Abstract

To provide a technique capable of improving the expressiveness of composite images in a system using an application unit that restricts the output of transparency information.SOLUTION: A GUIApp 22 of a IVI processor 20 passes data of the first GUI object that uses pre-prepared GUI components to be displayed over the meter image data for a second GUI object that specifies the transparency of the first GUI object to a GUI framework 24. The GUI framework 24 generates a first image that specifies the color information to be displayed over the meter image based on the first GUI object data, and generates a second image that specifies the transparency of the first image based on the data of the second GUI object. An image synthesis unit 35 of the meter processor 30 generates a composite image of the first image with transparency set based on the second image overlaid on the meter image.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to data processing technology, and more particularly to a display control system and a display control method. [Background technology]

[0002] The following Patent Document 1 describes an image merging unit that combines images generated by multiple application units and outputs the combined images to multiple display devices. The image merging unit has a control unit that controls which application unit's screen is displayed on each display device. Each application unit generates screen data for two or more display modes (normal, simple, etc.). The control unit selectively combines the screen data in accordance with the characteristics of each display device and outputs the combined results to each display device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2014 / 118943 Summary of the Invention [Problem to be solved by the invention]

[0004] GUI frameworks and window systems commonly used in application units have limitations on settings for outputting transparency information to output images. Therefore, when these output images are combined in an image merging unit, the expressiveness of the combined image is limited. One objective of the present disclosure is to provide a technology for improving the expressiveness of a combined image in a system using an application unit with limited output of transparency information. [Means for solving the problem]

[0005] In order to solve the above problems, a display control system according to one embodiment of the present disclosure includes a rendering unit that generates a first image that specifies color information to be displayed overlaid on a predetermined image and a second image that specifies the transparency of the first image, and a compositing unit. The rendering unit generates the first image based on data of a first GUI object that uses a pre-prepared GUI component, and generates the second image based on data of a second GUI object that outputs an image that specifies the transparency of the first GUI object, and the compositing unit generates a composite image by overlaying the first image, with the transparency set based on the second image, on the predetermined image.

[0006] Another aspect of the present disclosure is a display control method, in which a computer executes a first process for generating a first image that specifies color information to be overlaid on a predetermined image and a second image that specifies the transparency of the first image, and a second process for generating a composite image by overlaying the first image, the transparency of which is set based on the second image, on the predetermined image, in which the first process generates the first image based on data of a first GUI object that uses a prepared GUI component, and generates the second image based on data of a second GUI object that outputs an image that specifies the transparency of the first GUI object.

[0007] Any combination of the above components, or any conversion of the expression of the present disclosure between an apparatus, a computer program, a recording medium on which a computer program is recorded, etc., is also valid as an aspect of the present disclosure. [Effects of the Invention]

[0008] According to the technology of the present disclosure, it is possible to improve the expressive power of a composite image in a system that uses an application unit with limited transparency information output. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a block diagram showing functional blocks of a display control system according to an embodiment; [Figure 2] FIG. 10 is a diagram showing an example of display GUI data. [Figure 3]FIG. 10 is a diagram illustrating an example of layout information. [Figure 4] FIG. 1 is a diagram illustrating an example of a conventional composite image. [Figure 5] 1 is a flowchart illustrating the operation of an IVI device. [Figure 6] FIG. 10 is a diagram showing an example of GUI data with transparency added. [Figure 7] FIG. 10 is a diagram showing an example of GUI data with transparency added. [Figure 8] FIG. 10 is a diagram showing an example of a GUI image with added transparency. [Figure 9] FIG. 10 is a diagram illustrating an example of layout information. [Figure 10] 4 is a flowchart showing the operation of the meter device. [Figure 11] FIG. 10 is a diagram illustrating an example of a composite image according to an embodiment. [Figure 12] FIG. 10 is a diagram showing an example of a GUI image with added transparency according to a modified example. DETAILED DESCRIPTION OF THE INVENTION

[0010] The subject of the device or method of this disclosure includes a computer. The computer executes a program to realize the functions of the subject of the device or method of this disclosure. The computer's main hardware component is a processor that operates according to the program. The processor may be of any type, as long as it can realize the functions by executing the program. The processor may be composed of one or more electronic circuits, including a semiconductor integrated circuit (IC) or large-scale integration (LSI). While IC or LSI is used here, the term may be used depending on the degree of integration, and may be referred to as a system LSI, very large-scale integration (VLSI), or ultra-large-scale integration (ULSI). Field programmable gate arrays (FPGAs), which are programmed after LSI fabrication, or reconfigurable logic devices that can reconfigure the connections within the LSI or set up circuit blocks within the LSI, can also be used for the same purpose. Multiple electronic circuits may be integrated on a single chip or on multiple chips. The multiple chips may be integrated into one device, or may be provided in multiple devices. The program may be recorded on a non-transitory recording medium such as a computer-readable read-only memory (ROM), optical disk, or hard disk drive, or on a temporary storage medium such as a computer-readable random access memory (RAM). The program may be pre-stored on a recording medium, or may be supplied to the recording medium or storage medium via a wide area communication network including the Internet.

[0011] The display control system of the embodiment is a system including two or more processors mounted in physically separate units. The two or more processors include an IVI (In-Vehicle Infotainment) processor and a meter processor. The IVI processor includes a general IVI operating system (OS) and a GUI application that runs on the OS. The OS includes a GUI framework and a window system. The GUI application uses the GUI framework and the window system to generate an IVI image (e.g., an image showing navigation information) to be displayed on the meter display. The window system transmits the IVI image to the meter.

[0012] The IVI image in this embodiment includes a color information area (a display GUI image, described later) that depicts the color information of a GUI object, and a transparency area (a transparency GUI image, described later) that depicts transparency as color information. The meter-side processor combines the image of the color information area, in which transparency is set based on the color information of the transparency area, with the image of the meter. In this embodiment, "image" includes either or both of video (moving image) and still image.

[0013] 1 is a block diagram showing functional blocks of a display control system 10 according to an embodiment. Each block shown in the block diagram of the present disclosure can be realized in terms of hardware by elements and mechanical devices, such as a computer's CPU and memory, and in terms of software by a computer program, etc. However, the functional blocks shown here are realized by the cooperation of these elements. Those skilled in the art will understand that these functional blocks can be realized in various ways by combining hardware and software.

[0014] The display control system 10 is a data processing system installed in a vehicle. The display control system 10 includes an IVI device 12 and a meter device 14. The IVI device 12 is an in-vehicle information device that performs processes such as navigation, video streaming playback, and music playback. The meter device 14 is a device that performs processes related to the display of vehicle meters such as a speedometer and an engine tachometer. The IVI device 12 and the meter device 14 have different safety requirements. That is, the meter device 14 requires higher safety than the IVI device 12. Safety can also be referred to as security, or the robustness or accuracy of information.

[0015] The IVI devices 12 and the meter devices 14 transmit and receive video signals using a general-purpose video transmission interface such as GVIF (registered trademark) (Gigabit Video Interface), HDMI (registered trademark) (High-Definition Multimedia Interface), GMSL (Gigabit Multimedia Serial Link), etc. The IVI devices 12 and the meter devices 14 also transmit and receive messages (e.g., layout information) using a data transmission interface, such as TCP / IP, that is different from the video transmission interface.

[0016] The IVI device 12 includes an IVI processor 20 and an IVI display 21. The IVI processor 20 executes various data processing operations in the IVI device 12. The IVI processor 20 includes a CPU and memory. The IVI processor 20 may be implemented as an ECU (Electronic Control Unit) or an SoC (System on a Chip). The IVI display 21 displays IVI images output from the IVI processor 20. The IVI images may include, for example, navigation images or streaming video.

[0017] The IVI processor 20 includes a GUIApp 22 and an IVIOS 23. The functions of each functional block in the IVI processor 20 may be implemented in a computer program. The IVI processor 20 may implement the functions of each functional block by executing the computer program.

[0018] IVIOS 23 is a general OS (in other words, system software) installed in the IVI processor 20. IVIOS 23 includes a GUI framework 24 and a window system 25. GUIApp 22 is a GUI application that runs on IVIOS 23 and generates images related to IVI. IVIOS 23 (GUI framework 24) does not store transparency information in the drawing data. Furthermore, since IVIOS 23 is a ready-made product, it is not possible to add new functions such as storing transparency information in the drawing data.

[0019] The meter device 14 includes a meter processor 30 and a meter display 31. The meter processor 30 executes various data processing in the meter device 14. The meter processor 30 includes a CPU and a memory. The meter processor 30 may be implemented as an ECU or an SoC. The meter display 31 displays images of various meters output from the meter processor 30.

[0020] The meter processor 30 includes GUI software 32 and a display control unit 33. The functions of each functional block in the meter processor 30 may be implemented in a computer program. The meter processor 30 may fulfill the functions of each functional block by executing the computer program.

[0021] The GUI software 32 generates images of various meters. The meter images include, for example, an image of a speedometer and an image of an engine tachometer. The GUI software 32 may include a GUI application, a GUI framework, and a window system. The display control unit 33 controls the display content of the meter display 31. The display control unit 33 displays the meter images output from the GUI software 32 on the meter display 31.

[0022] The display control system 10 of the embodiment displays a composite image on the meter display 31, in which an IVI GUI image generated by an IVI processor 20 is combined with a meter image generated by a meter processor 30. First, a conventional configuration for displaying the composite image will be described.

[0023] The GUI App 22 of the IVI processor 20 serves as a generating unit and generates data of GUI objects related to IVI to be displayed superimposed on a meter image (hereinafter also referred to as "display GUI data"). The display GUI data is data of GUI objects that use pre-prepared GUI components. In the embodiment, the pre-prepared GUI components are GUI components defined in HTML (HyperText Markup Language). The display GUI data in the embodiment is data that uses one or more GUI components (e.g., containers, buttons, etc.) selected by a developer (screen designer, etc.) from multiple GUI components defined in HTML. The display GUI data may be an HTML document. The GUI App 22 outputs the display GUI data to the GUI framework 24.

[0024] The GUI framework 24 of the IVI processor 20 serves as a drawing unit and generates data for a display GUI image based on the display GUI data output from the GUI App 22. The GUI framework 24 includes, for example, an HTML rendering engine. The display GUI image is an image to be combined with a meter image and includes a GUI object that indicates information related to the IVI. The data for the display GUI image includes pixel values ​​of the GUI object.

[0025] 2 shows an example of display GUI data. Display GUI data 50 includes container style data 51, button style data 52, text style data 53, and content data 54. The container style data 51 is data that defines the style of a container object. The button style data 52 is data that defines the style of a button object. The text style data 53 is data that defines the style of text. The content data 54 is data that specifies the content to be displayed on the screen (i.e., the display GUI image 72).

[0026] 1, the window system 25 of the IVI processor 20 includes a frame buffer that temporarily stores image data. The GUI framework 24 stores the generated GUI image data for display in the frame buffer. The window system 25 transmits the GUI image data for display stored in the frame buffer to the meter device 14 via the video transmission interface.

[0027] The GUI App 22 of the IVI processor 20 also generates layout information that specifies the display mode of the GUI image to be displayed on the meter display 31. The GUI App 22 transmits the layout information to the meter device 14 via a data transmission interface that is different from the video transmission interface.

[0028] FIG. 3 shows an example of layout information. The layout information includes a source attribute and a destination attribute. The source attribute is information that specifies the position of the cutout area. For example, the source attribute includes the horizontal and vertical coordinates of the upper left corner of the display GUI image in the image data input from the IVI device 12 to the meter device 14, and the size (width and height) of the display GUI image. The destination attribute is information that specifies the position to be combined. For example, the destination attribute is an area within the meter image, and includes the horizontal and vertical coordinates of the upper left corner of the area where the IVI image is combined, and the size (width and height) of the area to be combined.

[0029] The GUI software 32 of the meter device 14 generates images of various meters. The GUI software 32 further generates layout information that defines the display mode of the meter images. The display control unit 33 of the meter device 14 includes a composite layout management unit 34 and a video composition unit 35. The GUI software 32 outputs meter image data to the video composition unit 35 and outputs layout information to the composite layout management unit 34.

[0030] The composite layout management unit 34 acquires layout information of the IVI images transmitted from the IVI processor 20 via the data transmission interface. The composite layout management unit 34 also acquires layout information of the meter images output from the GUI software 32. The composite layout management unit 34 inputs the layout information of the IVI images and the layout information of the meter images to the video composition unit 35.

[0031] The video composition unit 35 serves as a composition unit and generates composite image data by superimposing an IVI image (for example, the above-mentioned display GUI image 72) transmitted from the IVI processor 20 via the video transmission interface onto a meter image output from the GUI software 32. The video composition unit 35 may generate the composite image using a known alpha blend. The video composition unit 35 outputs the composite image data to the meter display 31, causing the meter display 31 to display the composite image.

[0032] FIG. 4 shows an example of a composite image according to the prior art. Composite image 40 includes a meter image 41 and an IVI image 42. IVI image 42 corresponds to display GUI image 72 in FIG. 2. In the prior art, it was difficult to set transparency for IVI image 42, limiting the expressive power of composite image 40. As mentioned above, IVIOS 23, an operating system commonly used in IVI devices 12, does not store transparency information in drawing data. Therefore, the video composition unit 35 had no choice but to composite the opaque IVI image 42 onto meter image 41. Furthermore, even if transparency could be set for the entire IVI image 42, transparency could not be set on a pixel-by-pixel basis, resulting in insufficient expressive power of composite image 40.

[0033] Therefore, in the embodiment, a technique is proposed to improve the expressiveness of a composite image when using a system with limited transparency settings (e.g., IVIOS23). Returning to Fig. 1, the features of each functional block in the display control system 10 of the embodiment will be described.

[0034] The GUI App 22 of the IVI processor 20 holds data of a first GUI object related to IVI to be displayed superimposed on a meter image (hereinafter also referred to as "display GUI data"). The GUI App 22 also holds data of a second GUI object (hereinafter also referred to as "transparency GUI data") that specifies the transparency of the first GUI object. Both the display GUI data and the transparency GUI data are data of GUI objects that use GUI components (e.g., containers, buttons, etc.) prepared in advance in HTML. In the embodiment, the display GUI data and the transparency GUI data use the same type of GUI component. Alternatively, the display GUI data and the transparency GUI data may use different types of GUI components. The transparency GUI data may specify the transparency of the first GUI object indicated by the display GUI data using a GUI component different from the GUI component used by the display GUI data. The IVI processor 20 may also store a separate GUI component used by the transparency GUI data, separate from the GUI component used by the display GUI data. The transparency GUI data may specify the transparency of the first GUI object indicated by the display GUI data using the separate GUI component.

[0035] The data of the first GUI object (display GUI data) and the data of the second GUI object (transparency GUI data) may be stored in advance in the GUI App 22. Alternatively, the GUI App 22 may dynamically generate the display GUI data and the transparency GUI data according to the operating state of the IVI device 12. The transparency specified by the transparency GUI data can be said to be the transparency of the first GUI object (in other words, the IVI image) when the first GUI object (in other words, the IVI image) is superimposed on the meter image.

[0036] The GUI framework 24 of the IVI processor 20 generates an image of a first GUI object (hereinafter also referred to as a "display GUI image") based on the display GUI data. The display GUI image is a first image that specifies color information to be displayed superimposed on the image to be superimposed (a meter image in this embodiment). The GUI framework 24 further generates an image of a second GUI object (hereinafter also referred to as a "transparency GUI image") based on the transparency GUI data. The transparency GUI image is a second image that specifies the transparency of the display GUI image when the display GUI image is superimposed on the meter image. The video synthesis unit 35 of the meter processor 30 generates a synthesized image by superimposing the display GUI image, the transparency of which has been set based on the transparency GUI image, on the meter image.

[0037] In the embodiment, the GUI App 22 generates data of a third GUI object including display GUI data and transparency GUI data (hereinafter also referred to as "transparency-added GUI data"). The GUI App 22 further generates layout information including the position of the second GUI object (transparency GUI image) in the third GUI object (transparency-added GUI image described below).

[0038] The GUI framework 24 generates an image of the third GUI object (hereinafter also referred to as a "transparency-added GUI image") based on the transparency-added GUI data. The transparency-added GUI image is a single image that aggregates the display GUI image and the transparency GUI image, and is a single image in which the display GUI image and the transparency GUI image are arranged in different areas. The video composition unit 35 extracts the display GUI image and the transparency GUI image from the transparency-added GUI image based on the above layout information.

[0039] The operation of the display control system 10 configured as above will now be described. 5 is a flowchart showing the operation of the IVI device 12. When information (e.g., navigation information) that should be displayed on the meter display 31 to notify vehicle occupants is generated (Y in S10), the GUI App 22 of the IVI processor 20 generates transparency-added GUI data (S11).

[0040] 6 and 7 show examples of transparency-added GUI data. FIG. 6 shows the header portion of an HTML document as transparency-added GUI data, and FIG. 7 shows the body portion of an HTML document as transparency-added GUI data. The transparency-added GUI data 70 includes the display GUI data 50 (container style data 51, button style data 52, text style data 53, and content data 54) already described in relation to FIG. 2. Information to be notified to vehicle occupants is set in the content data 54.

[0041] The transparency-added GUI data 70 further includes transparency GUI data 60. The transparency GUI data 60 includes container style data 61 corresponding to the container style data 51, button style data 62 corresponding to the button style data 52, text style data 63 corresponding to the text style data 53, and content data 64 corresponding to the content data 54. Although a black outer frame is drawn on the GUI image corresponding to the container style data 61, in reality there is no outer frame. The content data 64 is data for setting an image (i.e., a transparency GUI image 74) that specifies the transparency of the display GUI image 72.

[0042] The transparency GUI data 60 of the embodiment is data defining a GUI object that has the same shape as the GUI object of the display GUI data 50 and is black and white. In the embodiment, the GUI object of the transparency GUI data 60 is set to be darker in color as the transparency of the corresponding GUI object of the display GUI data 50 decreases. In other words, the GUI object of the transparency GUI data 60 is set to be whiter in color as the transparency of the corresponding GUI object of the display GUI data 50 increases. As a variation, contrary to the embodiment, the GUI object of the transparency GUI data 60 may be set to be whiter in color as the transparency of the corresponding GUI object of the display GUI data 50 decreases.

[0043] 6, in order to display the container object defined by the container style data 51 transparently, the "background-color" of the container style data 61 is set to white. Also, in order to display the button object defined by the button style data 52 semi-transparently, the alpha value of the "background-color" of the button style data 62 is set to 0.5. In this embodiment, the GUIApp 22 is implemented to generate a transparency GUI image 74 that reflects the transparency that should be set for the display GUI image 72 from a design perspective.

[0044] 5, the GUI framework 24 of the IVI processor 20 analyzes the HTML document as the transparency-added GUI data and generates a transparency-added GUI image based on the transparency-added GUI data (S12). The window system 25 of the IVI processor 20 transmits the transparency-added GUI image to the meter device 14 via the video transmission interface (S13).

[0045] FIG. 8 shows an example of a transparency-added GUI image. The transparency-added GUI image 76 includes a display GUI image 72 and a transparency GUI image 74. In this embodiment, the transparency-added GUI image 76 is an image in which the display GUI image 72 and the transparency GUI image 74 are arranged side by side. In the example of FIG. 8, the outer edge of the display GUI image 72 is black, while the outer edge of the transparency GUI image 74 is white. Therefore, the outer edge of the display GUI image 72 is displayed with a high degree of transparency and is treated as transparent, for example.

[0046] Returning to FIG. 5, the GUI App 22 of the IVI processor 20 generates layout information related to transparency-added GUI data (transparency-added GUI image) (S14). The GUI App 22 transmits the layout information generated in S14 to the meter device 14 via a data transmission interface different from the video transmission interface (S15). If no information is generated that should be displayed on the meter display 31 and notified to the vehicle occupants (N in S10), the processing from S11 onwards is skipped. The IVI device 12 repeatedly executes the processing shown in FIG. 5. Note that the processing of S11 to S13 and the processing of S14 to S15 may be executed in parallel.

[0047] Figure 9 shows an example of layout information. Layout information related to transparency-added GUI data (transparency-added GUI image) includes a transparency option attribute (TransparentOptions) in addition to the source attribute and destination attribute shown in the layout information of Figure 3. The transparency option attribute includes the horizontal and vertical coordinates of the upper left corner of the transparency GUI image in the transparency-added GUI image, and the size (width and height) of the transparency GUI image. Layout information with the transparency option attribute added can also be considered information indicating that an image with transparency information (transparency GUI image) added has been sent.

[0048] 10 is a flowchart showing the operation of the meter device 14. The image synthesizing unit 35 of the meter processor 30 acquires a meter image generated by the GUI software 32 of the meter processor 30. The image synthesizing unit 35 also receives a transparency-added GUI image transmitted from the IVI device 12 via the image transmission interface (S20).

[0049] The composite layout management unit 34 of the meter processor 30 acquires the layout information generated by the GUI software 32 of the meter processor 30. The composite layout management unit 34 also receives the layout information transmitted from the IVI device 12 via the data transmission interface (S21). The composite layout management unit 34 passes the acquired or received layout information to the video composition unit 35.

[0050] The video composition unit 35 detects whether the transparency option attribute is specified in the layout information transmitted from the IVI device 12. If the transparency option attribute is not specified in the layout information transmitted from the IVI device 12 (N in S22), the video composition unit 35 generates a composite image by combining the IVI image transmitted from the IVI device 12 with the meter image using a conventional method (S23). Specifically, the video composition unit 35 extracts a display GUI image from the image data transmitted from the IVI device 12 based on the source attribute of the layout information. The video composition unit 35 generates a composite image by combining the display GUI image with the area of ​​the meter image indicated by the destination attribute of the layout information. The video composition unit 35 displays the composite image on the meter display 31 (S26).

[0051] If the layout information transmitted from the IVI device 12 specifies a transparency option attribute (Y in S22), the video composition unit 35 extracts a display GUI image from the transparency-added GUI image based on the source attribute of the layout information. At the same time, the video composition unit 35 extracts a transparency GUI image from the transparency-added GUI image based on the transparency option attribute of the layout information (S24).

[0052] The video composition unit 35 generates a composite image by combining the display GUI image, whose transparency is set in pixel units based on the transparency GUI image, with the area of ​​the meter image indicated by the destination attribute of the layout information (S25).The video composition unit 35 displays the composite image on the meter display 31 (S26).

[0053] The processing of the video composition unit 35 in S25 will be described in detail. Here, the RGB pixel values ​​for each corresponding pixel among the display GUI image, transparency GUI image, and meter image to be composed (area specified by the destination attribute) are expressed as follows: RGB pixel values ​​of the GUI image for display: (S1r, S1g, S1b) RGB pixel values ​​of the transparency GUI image: (S2r, S2g, S2b) RGB pixel values ​​of the meter image: (S3r, S3g, S3b) RGB pixel values ​​of the composite image: (Dr, Dg, Db)

[0054] The transparency α for each pixel is α=1−S2r. Therefore, the video composition unit 35 calculates the RGB pixel values ​​of the composite image as follows. Dr=S3r×(1-α)+S1r=S3r×S2r+S1r Dg=S3g×(1-α)+S1g=S3g×S2r+S1g Db=S3b×(1-α)+S1b=S3b×S2r+S1b Here, a mathematical formula is shown in which pixel values ​​are expressed as 0 to 1 (closer to 0 means blacker, closer to 1 means whiter), but as a variant, pixel values ​​may be expressed as 0 to 255 (closer to 0 means blacker, closer to 255 means whiter). Video composition unit 35 performs the above calculation for all pixels to be composed, and calculates each pixel value of the composite image.

[0055] In the embodiment, as shown in FIG. 6, pixel values ​​pre-multiplied by transparency are stored in the display GUI image. That is, in the embodiment, when transparency is specified for the first GUI object in the display GUI data, the GUI framework 24 of the IVI processor 20 generates a display GUI image showing the color resulting from multiplying the color specified for the first GUI object in the display GUI data by the transparency specified in the display GUI data. As a variant, pixel values ​​for which transparency is not set may be stored in the display GUI image. In this case, the video composition unit 35 may calculate the RGB pixel values ​​of the composite image as follows: Dr=S3r×(1-α)+S1r×α=S3r×S2r+S1r×(1-S2r) Dg=S3g×(1-α)+S1g×α=S3g×S2r+S1g×(1-S2r) Db=S3b×(1-α)+S1b×α=S3b×S2r+S1b×(1-S2r)

[0056] 11 shows an example of a composite image according to an embodiment. The composite image 40 according to an embodiment includes an IVI image 42 (the composite image described above) with transparency set. For example, in the IVI image 42, transparency is set for the container image and button images, allowing the meter image 41 in the background to be seen through. Meanwhile, the text and the frames of the button images are displayed opaque.

[0057] According to the display control system 10 of the embodiment, even when using IVIOS 23 (GUI framework 24) with limited transparency settings, it is possible to improve the expressiveness of the composite image displayed on the meter display 31. The display control system 10 can specify the transparency of the composite image on a pixel-by-pixel basis, and can also set transparency for only a portion of the composite image. Furthermore, the display control system 10 can also set transparency for non-rectangular objects such as rounded rectangles.

[0058] Furthermore, according to the display control system 10 of the embodiment, when a processor of a meter device 14, which requires a relatively high level of safety, combines an image generated by a processor of an IVI device 12, which requires a relatively low level of safety, with a meter image, the expressiveness of the combined image can be improved. Furthermore, according to the display control system 10, a display GUI image and a transparency GUI image can be extracted from a transparency-added GUI image of the IVI by utilizing an existing mechanism for generating a combined image based on layout information.

[0059] The present disclosure has been described above based on the embodiments. The embodiments are merely examples, and it will be understood by those skilled in the art that various modifications are possible in the combination of each component or each treatment process of the embodiments, and that such modifications are also within the scope of the present disclosure.

[0060] A first modification will be described. In the embodiment, the GUI framework 24 of the IVI device 12 includes an HTML rendering engine. However, as a modification, the GUI framework 24 may include another type of rendering engine. For example, the GUI framework 24 may include a Flutter (trademark or registered trademark) rendering engine or an Android (trademark or registered trademark) rendering engine. The GUIApp 22 of the IVI processor 20 may generate transparency-added GUI data in a format that corresponds to the type of rendering engine used by the GUI framework 24.

[0061] A second modified example will be described. In the embodiment, the display GUI image and the transparency GUI image use the same plurality of GUI components. As a modified example, the display GUI image and the transparency GUI image may have different configurations of GUI components. The GUI App 22 of the IVI processor 20 may generate transparency GUI data in which some GUI components that are not related to transparency among the plurality of GUI components used in the display GUI image are not set as the transparency GUI image.

[0062] For example, if there is an opaque frame object (such as a button) and text is displayed without transparency inside it, the transparency of the text inside does not need to be reflected in the transparency GUI image. In this case, a black frame object (indicating opacity) can be set as the transparency GUI image. This modification reduces the load on the IVI processor 20 for generating the transparency GUI image.

[0063] A third modified example will be described. In the embodiment, the GUI App 22 of the IVI processor 20 is implemented to generate transparency-added GUI data including display GUI data and transparency GUI data corresponding to the display GUI data. As a modified example, the GUI App 22 may have a function (referred to as an "additional data setting unit" here) to automatically generate at least a part of the transparency GUI data based on the display GUI data.

[0064] The additional data setting unit may generate transparency GUI data including data of GUI components (such as containers and buttons) that are the same as the GUI components set in the display GUI data. In this case, the "background-color" of the GUI component in the transparency GUI data may be set to the alpha value of the "background-color" of the corresponding GUI component in the display GUI data. This modification reduces the burden on the developer of the GUI App 22 of manually implementing the GUI App 22 by generating transparency GUI data corresponding to the display GUI data. Note that the developer may add attribute information to the display GUI data indicating whether each GUI component should be reflected in the transparency GUI data, so that the additional data setting unit can distinguish between GUI components that should be reflected in the transparency GUI data and GUI components that should not be reflected.

[0065] A fourth modified example will be described. In the embodiment, the layout information is written in JSON (JavaScript Object Notation) format ("JavaScript" is a trademark or registered trademark), but the layout information may be written in other formats. In addition, in the layout information of the embodiment, the position and size of the IVI image are specified in pixel units on the meter device 14 side, but more abstract values ​​may be used. For example, the layout information may specify a percentage of the screen (or meter image) at which the IVI image is to be displayed. The composite layout management unit 34 of the meter processor 30 may then calculate the specific display position of the IVI image.

[0066] A fifth modified example will be described. In the embodiment, the display GUI image and the transparency GUI image have the same resolution. However, because transparency information is less important than color information, the resolution of the transparency GUI image may be lower than the resolution of the display GUI image. In other words, the GUI App 22 of the IVI processor 20 may generate transparency-added GUI data including transparency GUI data that generates a transparency GUI image with a lower resolution than the display GUI image. This modified example reduces the amount of image data transferred from the IVI processor 20 to the meter processor 30.

[0067] FIG. 12 shows an example of a modified transparency-added GUI image. This figure shows an example in which the horizontal resolution of the transparency GUI image 74 is one-fourth of the horizontal resolution of the display GUI image 72. The vertical resolution of the transparency GUI image 74 is the same as the vertical resolution of the display GUI image 72. In this modified example, the image synthesis unit 35 of the meter processor 30 may associate one pixel of the transparency GUI image 74 with multiple pixels of the display GUI image 72. In the example of FIG. 12, the image synthesis unit 35 may associate one horizontal pixel of the transparency GUI image 74 with four horizontal pixels of the display GUI image 72.

[0068] A sixth modified example will be described. The GUI App 22 of the IVI processor 20 may generate transparency-added GUI data including transparency GUI data that generates a transparency GUI image in a chromatic color other than black and white. This makes it possible to obtain a composite image that looks like it has been subjected to a color filter, which cannot be obtained with a transparency GUI image that is only black and white. For example, by using a transparency GUI image filled with blue, it is possible to give the composite image a blue tint. Also, by using a transparency GUI image filled with red, it is possible to give the composite image a red tint.

[0069] In the embodiment, the video synthesis unit 35 of the meter processor 30 uses the pixel value (S2r) of the R channel of the transparency GUI image as the transparency of the synthesis of all RGB channels. In this modification, the pixel values ​​(S2r, S2g, S2b) of the RGB of the transparency GUI image may be used as the transparency of the synthesis of each channel, as shown in the following formula: Dr=S3r×(1-α)+S1r=S3r×S2r+S1r Dg=S3g×(1-α)+S1g=S3g×S2g+S1g Db=S3b×(1-α)+S1b=S3b×S2b+S1b

[0070] A seventh modified example will be described. In the embodiment, the video synthesis unit 35 of the meter processor 30 calculates the RGB pixel values ​​(Dr, Dg, Db) of the synthesized image as follows. Dr=S3r×S2r+S1r Dg = S3g × S2r + S1g Db = S3b × S2r + S1b In this calculation, if the calculation result of each channel exceeds 1 (which can also be considered the maximum value as a pixel value), a process of setting the result to 1 (also called saturation calculation) may be performed.

[0071] In this modification, the IVI processor 20 can transmit to the meter processor 30 a transparency-added GUI image that includes a display GUI image and a transparency GUI image whose combined RGB pixel values ​​exceed 1. In a typical transparency GUI image in this modification, the value of S2r is set to 1. According to this modification, a composite image in which light is added to the meter image can be obtained.

[0072] An eighth modified example will be described. In the embodiment, a first processor (i.e., IVI processor 20) that generates a first image to be combined and a second processor (i.e., meter processor 30) that generates a second image to be combined are stored in separate units. As a modified example, the IVI processor 20 and the meter processor 30 may be stored in a single unit. In this case, the IVI processor 20 and the meter processor 30 may share a memory space, allowing image data and layout information to be transmitted and received between the IVI processor 20 and the meter processor 30.

[0073] In addition, both the IVI processor 20 and the meter processor 30 may be virtual processors. A single physical processor may execute both the processes of the IVI processor 20 and the meter processor 30. In other words, the functions of the IVI processor 20 (e.g., GUI App 22, GUI framework 24, window system 25) and the functions of the meter processor 30 (e.g., GUI software 32, composite layout manager 34, and video composite unit 35) may be implemented on a single physical processor. The single physical processor may include a first OS (referred to herein as "IVIOS") on which the functions of the IVI processor 20 run and a second OS (referred to herein as "meter OS") on which the functions of the meter processor 30 run. The meter OS typically requires different security than the IVIOS, specifically, a higher security level than the IVIOS. In this case, image data and layout information may be transmitted and received between the IVI processor 20 and the meter processor 30 using a memory shared by multiple virtual processors.

[0074] Any combination of the above-described embodiments and modifications is also useful as an embodiment of the present disclosure. A new embodiment resulting from a combination combines the effects of the combined embodiments and modifications. It will also be understood by those skilled in the art that the functions to be performed by each component recited in the claims can be realized by each component shown in the embodiments and modifications, either alone or in combination.

[0075] <Additional Notes> The above description of the embodiment and modifications discloses the following techniques. [Technology 1] a drawing unit that generates a first image that specifies color information to be displayed over a predetermined image, and a second image that specifies the transparency of the first image; a synthesis unit; Equipped with the drawing unit generates the first image based on data of a first GUI object that uses a prepared GUI component, and generates the second image based on data of a second GUI object that outputs an image that specifies the transparency of the first GUI object; the combining unit generates a combined image by superimposing a first image, the transparency of which is set based on the second image, on the predetermined image. Display control system. According to this display control system, in a system that uses an application unit (for example, a drawing unit) that is limited in the output of transparency information, it is possible to improve the expressive power of a composite image. [Technology 2] the drawing unit generates the first image showing a color resulting from multiplying the color designated for the first GUI object by a predetermined transparency. The display control system according to technology 1. This display control system can further improve the expressive power of the composite image. [Technology 3] the drawing unit generates, as a single image to be transmitted to the synthesis unit, a single image in which the first image and the second image are arranged in different regions; The display control system according to any one of the first and second aspects. According to this display control system, it is possible to reduce the number of times images are sent and received between a processor on the drawing unit side (for example, the IVI processor 20) and a processor on the composition unit side (for example, the meter processor 30). [Technology 4] a generating unit that generates layout information including a position of the second image in the one image, the combining unit extracts the first image and the second image from the one image based on the layout information; The display control system according to technology 3. According to this display control system, a first image and a second image can be extracted from one image by utilizing an existing mechanism for generating a composite image based on layout information. [Technology 5] the rendering unit is implemented in a first processor; The synthesis unit is implemented in a second processor having a different security requirement from that of the first processor. A display control system according to any one of techniques 1 to 4. According to this display control system, when a second processor having a different security requirement from that of the first processor generates a composite image using images generated by the first processor, the expressive power of the composite image can be improved. [Technology 6] the drawing unit and the compositing unit are implemented in a single processor; the single processor includes a first OS on which the drawing unit runs and a second OS on which the compositing unit runs; The second OS has a different security requirement than the first OS. A display control system according to any one of techniques 1 to 4. According to this display control system, when a synthesis unit running on a second OS, which has different security requirements than the first OS, generates a synthetic image using an image generated by a drawing unit running on the first OS, the expressiveness of the synthetic image can be improved. [Technology 7] the rendering unit is implemented in a processor of an information device mounted on the vehicle, The synthesis unit is implemented in a processor of a meter device mounted on the vehicle. A display control system according to any one of techniques 1 to 4. According to this display control system, when the processor of the meter device generates a composite image using an image generated by the processor of the information device, the expressiveness of the composite image can be improved. [Technology 8] a first process for generating a first image that specifies color information to be displayed over a predetermined image, and a second image that specifies the transparency of the first image; a second process of generating a composite image by superimposing the first image, the transparency of which is set based on the second image, on the predetermined image; The computer executes the first processing generates the first image based on data of a first GUI object that uses a prepared GUI component, and generates the second image based on data of a second GUI object that outputs an image that specifies the transparency of the first GUI object; Display control method. According to this display control method, it is possible to improve the expressive power of a composite image in a system that uses an application unit in which the output of transparency information is limited. [Explanation of symbols]

[0076] 10 Display control system, 12 IVI device, 14 Meter device, 20 IVI processor, 22 GUIApp, 24 GUI framework, 25 Window system, 30 Meter processor, 34 Composite layout management unit, 35 Video composition unit.

Claims

1. a drawing unit that generates a first image that specifies color information to be displayed over a predetermined image, and a second image that specifies the transparency of the first image; a synthesis unit; Equipped with the drawing unit generates the first image based on data of a first GUI object that uses a prepared GUI component, and generates the second image based on data of a second GUI object that outputs an image that specifies the transparency of the first GUI object; the combining unit generates a combined image by superimposing a first image, the transparency of which is set based on the second image, on the predetermined image. Display control system.

2. the drawing unit generates the first image showing a color resulting from multiplying a color designated for the first GUI object by a predetermined transparency; The display control system according to claim 1 .

3. the drawing unit generates, as a single image to be transmitted to the synthesis unit, a single image in which the first image and the second image are arranged in different regions; The display control system according to claim 1 or 2.

4. a generating unit that generates layout information including a position of the second image in the one image, the combining unit extracts the first image and the second image from the one image based on the layout information; The display control system according to claim 3 .

5. the rendering unit is implemented in a first processor; the synthesis unit is implemented in a second processor having a different required security from that of the first processor; The display control system according to claim 1 or 2.

6. the drawing unit and the compositing unit are implemented in a single processor; the single processor includes a first OS on which the drawing unit runs and a second OS on which the composition unit runs; The second OS has a different security requirement than the first OS. The display control system according to claim 1 or 2.

7. the rendering unit is implemented in a processor of an information device mounted on the vehicle, The synthesis unit is implemented in a processor of a meter device mounted on the vehicle. The display control system according to claim 1 or 2.

8. a first process for generating a first image specifying color information to be displayed over a predetermined image, and a second image specifying the transparency of the first image; a second process of generating a composite image by superimposing the first image, the transparency of which is set based on the second image, on the predetermined image; The computer executes The first processing generates the first image based on data of a first GUI object that uses a GUI component prepared in advance, and generates the second image based on data of a second GUI object that outputs an image that specifies the transparency of the first GUI object. Display control method.

Images