Display control system, and display control method

Abstract

To provide a technique capable of supporting accurate synchronization of images with layout.SOLUTION: A GUIApp 22 of an IVI processor 20 generates data of a third GUI object including a first GUI object and a second GUI object, in which color information is set to the numerical value related to the display aspect of the first GUI object as color information. A GUI framework 24 of the IVI processor 20 generates an image of the third GUI object based on the data of the third GUI object. An image synthesis unit 35 of a meter processor 30 is configured to display the first GUI object in a mode based on the color information of the second GUI object included in the image of the third GUI object.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to data processing technology, and more particularly to a display control system and a display control method. [Background technology]

[0002] The following Patent Document 1 describes an image merging unit that combines images generated by multiple application units and outputs the combined images to multiple display devices. The image merging unit has a control unit that controls which application unit's screen is displayed on each display device. Each application unit generates screen data for two or more display modes (normal, simple, etc.). The control unit selectively combines the screen data in accordance with the characteristics of each display device and outputs the combined results to each display device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2014 / 118943 Summary of the Invention [Problem to be solved by the invention]

[0004] In the display control system described in Patent Document 1, an application unit generates images according to a layout specified by an image integration unit. There is a time lag between when the image integration unit specifies layout information and when an image is generated in accordance with that information, and this time lag depends on the processing performance of the application unit. Therefore, the image integration unit cannot accurately determine whether an image acquired from the application unit was created according to old layout information or new layout information. Therefore, when the layout changes, it can be difficult to synchronize the timing of acquiring images from the application unit with the timing of the layout change, which can limit the expression of animations and other such content. One objective of the present disclosure is to provide a technology that supports accurate synchronization between images and layouts. [Means for solving the problem]

[0005] In order to solve the above problem, a display control system according to one embodiment of the present disclosure includes a generation unit that generates data of a third GUI object including a first GUI object and a second GUI object in which a numerical value related to the display mode of the first GUI object is set as color information, a drawing unit that generates an image of the third GUI object based on the data of the third GUI object, and a display control unit that displays the first GUI object in a mode based on the color information of the second GUI object included in the image of the third GUI object.

[0006] Another aspect of the present disclosure is a display control method, executed by a computer, that generates data of a third GUI object including a first GUI object and a second GUI object having color information set to a numerical value related to a display mode of the first GUI object, generates an image of the third GUI object based on the data of the third GUI object, and displays the first GUI object in a mode based on the color information of the second GUI object included in the image of the third GUI object.

[0007] Any combination of the above components, or any conversion of the expression of the present disclosure between an apparatus, a computer program, a recording medium on which a computer program is recorded, etc., is also valid as an aspect of the present disclosure. [Effects of the Invention]

[0008] The techniques of this disclosure can assist in accurate synchronization of images and layouts. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a block diagram showing functional blocks of a display control system according to an embodiment; [Figure 2] FIG. 10 is a diagram illustrating an example of IVI display data. [Figure 3] FIG. 10 is a diagram illustrating an example of layout information. [Figure 4] FIG. 1 is a diagram illustrating a problem with the conventional technology. [Figure 5] 1 is a flowchart illustrating the operation of an IVI device. [Figure 6] FIG. 10 is a diagram illustrating an example of layout-added IVI display data. [Figure 7] FIG. 10 is a diagram showing an example of a layout-added IVI image. [Figure 8] FIG. 10 is a diagram illustrating an example of layout information. [Figure 9] 4 is a flowchart showing the operation of the meter device. DETAILED DESCRIPTION OF THE INVENTION

[0010] The subject of the device or method of this disclosure includes a computer. The computer executes a program to realize the functions of the subject of the device or method of this disclosure. The computer's main hardware component is a processor that operates according to the program. The processor may be of any type, as long as it can realize the functions by executing the program. The processor may be composed of one or more electronic circuits, including a semiconductor integrated circuit (IC) or large-scale integration (LSI). While IC or LSI is used here, the term may be used depending on the degree of integration, and may be referred to as a system LSI, very large-scale integration (VLSI), or ultra-large-scale integration (ULSI). Field programmable gate arrays (FPGAs), which are programmed after LSI fabrication, or reconfigurable logic devices that can reconfigure the connections within the LSI or set up circuit blocks within the LSI, can also be used for the same purpose. Multiple electronic circuits may be integrated on a single chip or on multiple chips. The multiple chips may be integrated into one device, or may be provided in multiple devices. The program may be recorded on a non-transitory recording medium such as a computer-readable read-only memory (ROM), optical disk, or hard disk drive, or on a temporary storage medium such as a computer-readable random access memory (RAM). The program may be pre-stored on a recording medium, or may be supplied to the recording medium or storage medium via a wide area communication network including the Internet.

[0011] The display control system of the embodiment is a system including two or more processors mounted in physically separate units. The two or more processors include an IVI (In-Vehicle Infotainment) processor and a meter processor. The IVI processor includes a general IVI operating system (OS) and a GUI application running on the OS. The OS includes a GUI framework and a window system. The GUI application uses the GUI framework and the window system to generate an image to be displayed on the IVI display and an image to be displayed on the meter display (e.g., an image showing navigation information). The latter image is sent to the meter processor via the window system.

[0012] In addition, the image transmitted from the IVI-side processor to the meter-side processor includes a color information area ("IVI image" described below) in which color information of the GUI object is stored, and a layout area ("layout image" described below) in which numerical values ​​related to the display mode (also referred to as the display layout) of the image of the color information area are stored as color information. The meter-side processor displays the image of the color information area on the meter-side display in a mode based on the color information of the layout area. In the embodiment, the meter-side processor displays a composite image in which the image of the color information area is combined with a predetermined image generated on the meter side in a combination mode based on the color information of the layout area. In the embodiment, "image" includes one or both of video (moving image) and still image.

[0013] 1 is a block diagram showing functional blocks of a display control system 10 according to an embodiment. Each block shown in the block diagram of the present disclosure can be realized in terms of hardware by elements and mechanical devices, such as a computer's CPU and memory, and in terms of software by a computer program, etc. However, the functional blocks shown here are realized by the cooperation of these elements. Those skilled in the art will understand that these functional blocks can be realized in various ways by combining hardware and software.

[0014] The display control system 10 is a data processing system installed in a vehicle. The display control system 10 includes an IVI device 12 and a meter device 14. The IVI device 12 is an in-vehicle information device that performs processes such as navigation, video streaming playback, and music playback. The meter device 14 is a device that performs processes related to the display of vehicle meters such as a speedometer and an engine tachometer. The IVI device 12 and the meter device 14 have different safety requirements. That is, the meter device 14 requires higher safety than the IVI device 12. Safety can also be referred to as security, or the robustness or accuracy of information.

[0015] The IVI devices 12 and the meter devices 14 transmit and receive video signals using a general-purpose video transmission interface such as GVIF (registered trademark) (Gigabit Video Interface), HDMI (registered trademark) (High-Definition Multimedia Interface), GMSL (Gigabit Multimedia Serial Link), etc. The IVI devices 12 and the meter devices 14 also transmit and receive messages (e.g., layout information) using a data transmission interface, such as TCP / IP, that is different from the video transmission interface.

[0016] The IVI device 12 includes an IVI processor 20 and an IVI display 21. The IVI processor 20 executes various data processing operations in the IVI device 12. The IVI processor 20 includes a CPU and memory. The IVI processor 20 may be implemented as an ECU (Electronic Control Unit) or an SoC (System on a Chip). The IVI display 21 displays IVI images output from the IVI processor 20. The IVI images may include, for example, navigation images or streaming video.

[0017] The IVI processor 20 includes a GUIApp 22 and an IVIOS 23. The functions of each functional block in the IVI processor 20 may be implemented in a computer program. The IVI processor 20 may implement the functions of each functional block by executing the computer program.

[0018] The IVIOS 23 is a general OS (in other words, system software) installed in the IVI processor 20. The IVIOS 23 includes a GUI framework 24 and a window system 25. The GUIApp 22 is a GUI application that runs on the IVIOS 23 and generates images related to the IVI.

[0019] The meter device 14 includes a meter processor 30 and a meter display 31. The meter processor 30 executes various data processing in the meter device 14. The meter processor 30 includes a CPU and a memory. The meter processor 30 may be implemented as an ECU or an SoC. The meter display 31 displays images of various meters output from the meter processor 30.

[0020] The meter processor 30 includes GUI software 32 and a display control unit 33. The functions of each functional block in the meter processor 30 may be implemented in a computer program. The meter processor 30 may fulfill the functions of each functional block by executing the computer program.

[0021] The GUI software 32 generates images of various meters. The meter images include, for example, an image of a speedometer and an image of an engine tachometer. The GUI software 32 may include a GUI application, a GUI framework, and a window system. The display control unit 33 controls the display content of the meter display 31. The display control unit 33 displays the meter images output from the GUI software 32 on the meter display 31.

[0022] The display control system 10 of the embodiment displays a composite image on the meter display 31, in which an IVI-related GUI image generated by the IVI processor 20 is combined with a meter image generated by the meter processor 30. First, a conventional configuration for displaying the composite image will be described.

[0023] The GUIApp 22 of the IVI processor 20 serves as a generator and generates data of a first GUI object (hereinafter also referred to as "IVI display data") including information related to IVI. The IVI display data is data of a GUI object that uses pre-prepared GUI components. In the embodiment, the pre-prepared GUI components are GUI components defined in HTML (HyperText Markup Language). The IVI display data of the embodiment is data that uses one or more GUI components (e.g., containers, buttons, etc.) selected by a developer (screen designer, etc.) from multiple GUI components defined in HTML. The IVI display data may be an HTML document. The GUIApp 22 outputs the IVI display data to the GUI framework 24.

[0024] The GUI framework 24 of the IVI processor 20 serves as a drawing unit and generates data for GUI images (hereinafter also referred to as "IVI images") related to the IVI based on the IVI display data. The GUI framework 24 includes, for example, an HTML rendering engine. The IVI image is an image to be combined with a meter image and includes GUI objects that indicate information related to the IVI. The IVI image data includes pixel values ​​of the GUI objects.

[0025] 2 shows an example of IVI display data. IVI display data 50 includes container style data 51, button style data 52, text style data 53, and content data 54. The container style data 51 is data that defines the style of a container object. The button style data 52 is data that defines the style of a button object. The text style data 53 is data that defines the style of text. The content data 54 is data that specifies the content (i.e., the IVI image 42) to be displayed on the screen.

[0026] 1, the window system 25 of the IVI processor 20 includes a frame buffer that temporarily stores image data. The GUI framework 24 stores the generated IVI image data in the frame buffer. The window system 25 transmits the IVI image data stored in the frame buffer to the meter device 14 via the video transmission interface.

[0027] The GUI App 22 of the IVI processor 20 also generates layout information that specifies the display mode of the IVI image on the meter display 31. The GUI App 22 transmits the layout information to the meter device 14 via a data transmission interface that is different from the video transmission interface.

[0028] 3 shows an example of layout information. The layout information includes a source attribute and a destination attribute. The source attribute is information that specifies the position of the cutout area. For example, the source attribute includes the horizontal and vertical coordinates of the upper left corner of the IVI image in the image data input from the IVI device 12 to the meter device 14, and the size (width and height) of the IVI image. The destination attribute is information that specifies the position to be combined. For example, the destination attribute is an area within the meter image, and includes the horizontal and vertical coordinates of the upper left corner of the area where the IVI image is combined, and the size (width and height) of the area to be combined.

[0029] The GUI software 32 of the meter device 14 generates images of various meters. The GUI software 32 further generates layout information that defines the display mode of the meter images. The display control unit 33 of the meter device 14 includes a composite layout management unit 34 and a video composition unit 35. The GUI software 32 outputs meter image data to the video composition unit 35 and outputs layout information to the composite layout management unit 34.

[0030] The composite layout management unit 34 acquires layout information of the IVI image transmitted from the IVI processor 20 via the data transmission interface. The composite layout management unit 34 also acquires layout information of the meter image output from the GUI software 32. The composite layout management unit 34 inputs the layout information of the IVI image and the layout information of the meter image to the video composition unit 35.

[0031] The video composition unit 35 receives an IVI image (e.g., the above-mentioned IVI image 42) transmitted from the IVI processor 20 via the video transmission interface, and generates composite image data by overlaying the received IVI image on the meter image output from the GUI software 32. The video composition unit 35 composites the IVI image in an area of ​​the meter image specified by the destination attribute of the layout information of the IVI image input from the composite layout management unit 34. The video composition unit 35 may generate the composite image using known alpha blending. The video composition unit 35 outputs the composite image data to the meter display 31, and causes the meter display 31 to display the composite image.

[0032] FIG. 4 is a diagram illustrating a problem with the conventional technology. A composite image 40 in FIG. 4 is obtained by combining an IVI image 42 with a meter image 41 that shows the status of various meters and gears. In FIG. 4, the IVI image 42 slides from bottom to top as an effect that changes over time, and the text in the IVI image 42 also changes accordingly. To achieve this effect, it is necessary to (1) move the display position of the IVI image 42 on the meter image 41 (in other words, the position where the IVI image 42 is combined with the meter image 41) from bottom to top, and (2) change the IVI image 42 so that the text in the IVI image 42 moves from top to bottom.

[0033] If the above (1) and (2) are not synchronized, the characters in the IVI image 42 may move unnaturally while the position of the IVI image 42 is moving from bottom to top. However, the content of the IVI image is determined by the GUI App 22 of the IVI processor 20, while the video composition unit 35 of the meter processor 30 composes the IVI image at the position specified by the layout information. Also, the path for transmitting the IVI image from the IVI processor 20 to the meter processor 30 is different from the path for transmitting the layout information from the IVI processor 20 to the meter processor 30. Therefore, there is a possibility that a synchronization error may occur between the IVI image and the layout information that cannot be calculated by the GUI App 22 of the IVI processor 20.

[0034] Therefore, in the embodiment, a technology is proposed that improves the expressiveness of a composite image and supports accurate synchronization between an IVI image and layout information. Specifically, the GUI App 22 of the IVI processor 20 encodes and sets information indicating the desired display mode (e.g., composite position) of the IVI image to be drawn as pixel data (i.e., color information) in the upper pixel of the IVI image. The GUI framework 24 and window system 25 of the IVI processor 20 output the image with the color information indicating the display mode added, in the same way as a normal image. The video composition unit 35 of the meter processor 30 decodes the data embedded in the upper pixel of the received image and composites the IVI image and meter image according to the display mode indicated by the decoded data.

[0035] Returning to FIG. 1, the features of each functional block in the display control system 10 of the embodiment will be described below. The GUI App 22 of the IVI processor 20 generates data for a third GUI object, which includes a first GUI object related to the IVI to be displayed overlaid on the meter image and a second GUI object in which a numerical value related to the display mode of the first GUI object is set as color information. The data for the first GUI object corresponds to the IVI display data described above. The data for the second GUI object is hereinafter referred to as "additional layout data," and the data for the third GUI object is hereinafter referred to as "layout-additional IVI display data."

[0036] The GUI framework 24 of the IVI processor 20 generates an image of a third GUI object, including an image of the first GUI object and an image of the second GUI object, based on the layout-added IVI display data. The image of the first GUI object corresponds to the IVI image described above. The image of the second GUI object is hereinafter referred to as the "layout image," and the image of the third GUI object is hereinafter referred to as the "layout-added IVI image."

[0037] The display control unit 33 of the meter processor 30 causes the meter display 31 to display the IVI image in a manner based on the color information of the layout image included in the layout-added IVI image.

[0038] The IVI image of the embodiment (in other words, the GUI object indicated by the IVI image) is displayed after being composited with a predetermined image. The layout image of the embodiment is obtained by setting, as color information, numerical values ​​related to the manner in which the IVI image is composited with the predetermined image. The predetermined image is a meter image generated by GUI software 32 of meter processor 30. The display control unit 33 (video composition unit 35) generates a composite image by superimposing the IVI image on the meter image in the manner indicated by the color information of the layout image.

[0039] The GUI App 22 of the IVI processor 20 further generates layout information including the position of the layout image in the layout-added IVI image. The display control unit 33 (video synthesis unit 35) of the meter processor 30 extracts the IVI image and the layout image from the layout-added IVI image based on the layout information provided by the IVI processor 20.

[0040] The operation of the display control system 10 configured as above will now be described. 5 is a flowchart showing the operation of the IVI device 12. When information (e.g., navigation information) that should be displayed on the meter display 31 to notify vehicle occupants is generated (Y in S10), the GUI App 22 of the IVI processor 20 generates layout-added IVI display data (S11). The GUI framework 24 of the IVI processor 20 analyzes the HTML document serving as the layout-added IVI display data and generates a layout-added IVI image that is an image based on the layout-added IVI display data (S12). The window system 25 of the IVI processor 20 transmits the layout-added IVI image to the meter device 14 via the video transmission interface (S13).

[0041] Fig. 6 shows an example of layout-added IVI display data. Fig. 6 shows an HTML document as the layout-added IVI display data. The layout-added IVI display data 60 in Fig. 6 includes the IVI display data 50 (container style data 51, button style data 52, text style data 53, and content data 54) already described in relation to Fig. 2. Information to be notified to vehicle occupants is set in the content data 54.

[0042] 7 shows an example of a layout-added IVI image 70. The layout-added IVI image 70 includes an IVI image 42 based on the IVI display data 50.

[0043] 6 further includes additional layout data 61. The GUI framework 24 of the IVI processor 20 generates a layout image 71 based on the layout-added IVI display data 60 of Fig. 6. In the embodiment, the GUI framework 24 generates a layout-added IVI image 70 in which the layout image 71 is positioned above the IVI image 42, as shown in Fig. 7, in accordance with the content data 54 of the layout-added IVI display data 60.

[0044] 6, the additional layout data 61 includes information specifying an area in the meter image where the IVI image 42 should be composited (hereinafter also referred to as a "composite area"). In the embodiment, the additional layout data 61 includes a composite area X coordinate 62a, a composite area Y coordinate 62b, a composite area width 62c (horizontal width of the composite area), a composite area height 62d (vertical width of the composite area), and a composite area transparency 62e. The composite area X coordinate 62a, the composite area Y coordinate 62b, the composite area width 62c, and the composite area height 62d correspond to the destination attributes of the layout information in FIG. 3.

[0045] Each value of composite area X coordinate 62a to composite area transparency 62e is specified as the value of "background-color" of "layout-element" (a GUI object of 16 pixels wide and 8 pixels high). Normally, when a hexadecimal color code is specified in "background-color," the first and second digits specify the brightness of the red component, the third and fourth digits specify the brightness of the green component, and the fifth and sixth digits specify the brightness of the blue component. In this embodiment, GUIApp 22 of IVI processor 20 sets the values ​​of additional layout data 61 in the first, third, and fifth digits as the value of "background-color" of "layout-element."

[0046] Specifically, the value of the X coordinate of the compositing area is set as the value of "background-color" of the compositing area X coordinate 62a. In Fig. 6, 0x1F4 (same as Fig. 3, 500 in decimal) is set as the value of the X coordinate. In addition, the value of the Y coordinate of the compositing area is set as the value of "background-color" of the compositing area Y coordinate 62b. In Fig. 6, 0x12C (same as Fig. 3, 300 in decimal) is set as the value of the Y coordinate. In addition, the value of the width of the compositing area is set as the value of "background-color" of the compositing area width 62c. In Fig. 6, 0x0fa (same as Fig. 3, 250 in decimal) is set as the value of the width.

[0047] Furthermore, the value of the height of the merging area is set as the value of "background-color" of the merging area height 62d. In FIG. 6, the height value is set to 0x064 (the same as in FIG. 3, 100 in decimal). Furthermore, the transparency value of the merging area is set as the value of "background-color" of the merging area transparency 62e. In FIG. 6, the transparency value is set to 0x000 (0 in decimal, i.e., transparency 0). The merging area transparency 62e may be the transparency set in the IVI image 42 during merging. As described above, in the embodiment, 16 levels of color are used for each of RGB as the values ​​of each item of the additional layout data 61, and numerical values ​​from 0 to 4095 (16^3=4096) can be expressed.

[0048] Layout image 71 in FIG. 7 includes GUI objects 72a, 72b, 72c, 72d, and 72e. Color information of GUI object 72a corresponds to the value of composite area X coordinate 62a in FIG. 6 (value of "background-color," the same applies below). Color information of GUI object 72b corresponds to the value of composite area Y coordinate 62b in FIG. 6. Color information of GUI object 72c corresponds to the value of composite area width 62c in FIG. 6. Color information of GUI object 72d corresponds to the value of composite area height 62d in FIG. 6. Color information of GUI object 72e corresponds to the value of composite area transparency 62e in FIG. 6.

[0049] Returning to FIG. 5, the GUI App 22 of the IVI processor 20 generates layout information related to layout-added IVI display data (layout-added IVI image) (S14). The GUI App 22 transmits the layout information generated in S14 to the meter device 14 via a data transmission interface different from the video transmission interface (S15). If no information is generated that should be displayed on the meter display 31 and notified to the vehicle occupants (N in S10), the processing from S11 onwards is skipped. The IVI device 12 repeatedly executes the processing shown in FIG. 5. Note that the processing of S11 to S13 and the processing of S14 to S15 may be executed in parallel.

[0050] FIG. 8 shows an example of layout information. Layout information related to layout-added IVI display data (layout-added IVI image) includes an additional layout attribute (AdditionalLayout) in addition to the source and destination attributes shown in the layout information in FIG. 3. The additional layout attribute includes the horizontal and vertical coordinates of the upper left corner of the layout image placed in the layout-added IVI image, as well as the size (width and height) of the layout image. The additional layout attribute in FIG. 8 corresponds to layout image 71 in FIG. 7 and indicates the positions where five "layout-element" objects are placed. Layout information with the additional layout attribute added can also be considered information indicating that an IVI image with color information (i.e., a layout image) indicating the layout information has been sent.

[0051] 9 is a flowchart showing the operation of the meter device 14. The video composition unit 35 of the meter processor 30 acquires the meter image generated by the GUI software 32 of the meter processor 30. The video composition unit 35 also receives the layout-added IVI image transmitted from the IVI device 12 via the video transmission interface (S20).

[0052] The composite layout management unit 34 of the meter processor 30 acquires the layout information generated by the GUI software 32 of the meter processor 30. The composite layout management unit 34 also receives the layout information transmitted from the IVI device 12 via the data transmission interface (S21). The composite layout management unit 34 passes the acquired or received layout information to the video composition unit 35.

[0053] The video composition unit 35 detects whether the layout information transmitted from the IVI device 12 specifies additional layout attributes. If the layout information transmitted from the IVI device 12 does not specify additional layout attributes, the image transmitted from the IVI device 12 is a normal IVI image without an additional layout image. In this case, the video composition unit 35 generates a composite image using the conventional method described above. Specifically, the video composition unit 35 extracts an IVI image from the image data transmitted from the IVI device 12 based on the source attribute of the layout information. The video composition unit 35 generates a composite image by combining the IVI image with the area of ​​the meter image indicated by the destination attribute of the layout information. In Figure 6 of this embodiment, the background-color attribute of the HTML DIV element is used to generate the layout image, but this is just one example, and methods using other types of elements or other attributes may also be used as long as a similar image can be generated.

[0054] If the layout information transmitted from the IVI device 12 specifies additional layout attributes, the video composition unit 35 extracts an IVI image from the layout-added IVI image based on the source attributes of the layout information. At the same time, the video composition unit 35 extracts a layout image from the layout-added IVI image based on the additional layout attributes of the layout information (S22).

[0055] The video composition unit 35 identifies layout information from the extracted layout image. As a premise, in this embodiment, color information for one item of layout information is set as color information for a GUI object (hereinafter also referred to as a "unit object") that is 16 pixels wide and 8 pixels high. The video composition unit 35 acquires color information (a 6-digit hexadecimal color code in this embodiment) of each unit object included in the layout image. The video composition unit 35 acquires the first, third, and fifth digits of the 6-digit hexadecimal color code as the value of the layout information.

[0056] The image composition unit 35 stores in advance the correspondence between each unit object arranged in the layout image and each item of the layout information. In this embodiment, each unit object in the layout image corresponds to each item of the destination attribute of the layout information.

[0057] For example, the video composition unit 35 derives a value of the composition area X coordinate (e.g., 0x1f4) based on the color information of the GUI object 72a in FIG. 7. The video composition unit 35 also derives a value of the composition area Y coordinate (e.g., 0x12c) based on the color information of the GUI object 72b in FIG. 7. The video composition unit 35 also derives a value of the composition area width (e.g., 0x0fa) based on the color information of the GUI object 72c in FIG. 7. The video composition unit 35 also derives a value of the composition area height (e.g., 0x064) based on the color information of the GUI object 72d in FIG. 7. The video composition unit 35 also derives a value of the composition area transparency (e.g., 0x000) based on the color information of the GUI object 72e in FIG. 7.

[0058] The video composition unit 35 extracts an IVI image from the image data transmitted from the IVI device 12 based on the source attribute of the layout information. Regardless of the value indicated by the destination attribute of the layout information, the video composition unit 35 composites an IVI image, with the transparency indicated by the composite area transparency, into an area in the meter image specified by the values ​​of the composite area X coordinate, composite area Y coordinate, composite area width, and composite area height derived from each unit object of the layout image (S23). The video composition unit 35 displays the composite image, in which the IVI image is composited with the meter image, on the meter display 31 (S24).

[0059] According to the display control system 10 of the embodiment, the IVI image to be displayed on the meter display 31 and layout data related to the display mode of the IVI image (e.g., the mode of combining with the meter image) can be transmitted to the meter processor 30 (e.g., the video combining unit 35) at the same time. This allows the timing of the change in the IVI image and the change in the display mode of the IVI image (e.g., the change in the combining position with the meter image) to be accurately matched, thereby improving the expressiveness of the combined image.

[0060] Furthermore, according to the display control system 10 of the embodiment, when the processor of the meter device 14, which requires a relatively high level of safety, combines an image generated by the processor of the IVI device 12, which requires a relatively low level of safety, with a meter image, the expressiveness of the combined image can be improved. Furthermore, according to the display control system 10, an IVI image and a layout image can be extracted from a layout-added IVI image by utilizing an existing mechanism for generating a combined image based on layout information.

[0061] The present disclosure has been described above based on the embodiments. The embodiments are merely examples, and it will be understood by those skilled in the art that various modifications are possible in the combination of each component or each treatment process of the embodiments, and that such modifications are also within the scope of the present disclosure.

[0062] A first modification will be described. In the above embodiment, color information corresponding to the value of the destination attribute of the layout information related to the layout-added IVI image is set in the layout image within the layout-added IVI image. Therefore, the layout information related to the layout-added IVI image does not need to include a destination attribute specification. However, it is desirable that the destination attribute be specified in the layout information related to the layout-added IVI image. This is because image synthesis based on the destination attribute becomes possible even in a conventional meter processor that does not use color information of the layout image as layout information.

[0063] A second modification will be described. In the above embodiment, 16 levels of color are used for each of RGB as the color information of the layout image, allowing values ​​from 0 to 4095 to be expressed. As a modification, the color information of the layout image may be determined based on a more complex calculation formula. Furthermore, the layout image may include color information corresponding to data for a checksum or CRC (Cyclic Redundancy Check). This makes it possible to detect errors in data transmission from the IVI processor 20 to the meter processor 30. Furthermore, the GUI App 22 of the IVI processor 20 may set the color of at least some of the GUI objects in the layout image to a predetermined pattern that indicates that it is a layout image. This allows the video composition unit 35 of the meter processor 30 to accurately detect the layout image placed in the layout-added IVI image.

[0064] A third modified example will be described. In the embodiment, the GUI framework 24 of the IVI device 12 includes an HTML rendering engine. However, as a modified example, the GUI framework 24 may include another type of rendering engine. For example, the GUI framework 24 may include a Flutter (trademark or registered trademark) rendering engine or an Android (trademark or registered trademark) rendering engine. The GUIApp 22 of the IVI processor 20 may generate layout-added IVI display data in a format that corresponds to the type of rendering engine used by the GUI framework 24.

[0065] A fourth modified example will be described. In the embodiment, the layout information is written in JSON (JavaScript Object Notation) format ("JavaScript" is a trademark or registered trademark), but the layout information may be written in other formats. In addition, in the layout image and layout information of the embodiment, the position and size of the IVI image are specified in pixel units on the meter device 14 side, but more abstract values ​​may be used. For example, the layout image and layout information may specify a percentage of the screen (or meter image) at which the IVI image is to be displayed. The composite layout management unit 34 of the meter processor 30 may be configured to calculate the specific display position of the IVI image.

[0066] A fifth modified example will be described. In the embodiment, the layout image is placed above the IVI image, but the layout image may be placed at another position within the layout-added IVI image. For example, the layout image may be placed below the IVI image. When the layout image is placed below the IVI image, the coordinate values ​​of the IVI image do not change depending on whether or not the layout image is added. Therefore, even if the same layout-added IVI image is sent to both a meter processor that supports the function of acquiring layout information from an IVI image and a meter processor that does not support the function, the composition process can be performed without any problems in either meter processor.

[0067] A sixth modified example will be described. In the embodiment, a first processor (i.e., IVI processor 20) that generates a first image to be combined and a second processor (i.e., meter processor 30) that generates a second image to be combined are stored in separate units. As a modified example, the IVI processor 20 and the meter processor 30 may be stored in a single unit. In this case, image data and layout information may be transmitted and received between the IVI processor 20 and the meter processor 30 by sharing a memory space between them.

[0068] In addition, both the IVI processor 20 and the meter processor 30 may be virtual processors. A single physical processor may execute both the processes of the IVI processor 20 and the meter processor 30. In other words, the functions of the IVI processor 20 (e.g., GUI App 22, GUI framework 24, window system 25) and the functions of the meter processor 30 (e.g., GUI software 32, display control unit 33, composite layout management unit 34, and video composition unit 35) may be implemented on a single physical processor. The single physical processor may include a first OS (referred to herein as "IVIOS") on which the functions of the IVI processor 20 run and a second OS (referred to herein as "meter OS") on which the functions of the meter processor 30 run. The meter OS typically requires different security than the IVIOS, specifically, a higher security level. In this case, image data and layout information may be transmitted and received between the IVI processor 20 and the meter processor 30 using a memory shared by multiple virtual processors.

[0069] In the above embodiment, a single numerical value in the layout information is directly converted into color information for a single rectangular component. However, as a modification, a single numerical value in the layout information may be expressed as color information for multiple GUI components. Furthermore, in the above embodiment, the layout information is expressed using all RGB colors. However, as a modification, the layout information may be expressed using a black and white dot pattern or the like. As another modification, the IVI processor 20 may add the layout information as a two-dimensional barcode image, and the meter processor 30 may read the two-dimensional barcode image.

[0070] Any combination of the above-described embodiments and modifications is also useful as an embodiment of the present disclosure. A new embodiment resulting from a combination combines the effects of the combined embodiments and modifications. It will also be understood by those skilled in the art that the functions to be performed by each component recited in the claims can be realized by each component shown in the embodiments and modifications, either alone or in combination.

[0071] <Additional Notes> The above description of the embodiment and modifications discloses the following techniques. [Technology 1] a generating unit that generates data of a third GUI object including a first GUI object and a second GUI object in which a numerical value related to a display mode of the first GUI object is set as color information; a drawing unit that generates an image of the third GUI object based on data of the third GUI object; a display control unit that displays the first GUI object in a manner based on color information of the second GUI object included in an image of the third GUI object; A display control system comprising: According to this display control system, the image to be displayed (first GUI object) and a numerical value related to the display mode of that image are transmitted to the display control unit at the same time, so that the timing of changes in the image and changes in the display mode of the image can be accurately matched. [Technology 2] the first GUI object is displayed by being synthesized with a predetermined image, the second GUI object is configured by setting, as color information, a numerical value relating to the manner in which the first GUI object is to be combined with the predetermined image; The display control system according to technology 1. According to this display control system, the image to be displayed (first GUI object) and the numerical value related to the composite mode of that image are transmitted to the display control unit at the same time, so that the timing of the change in the image and the change in the composite mode of the image can be accurately matched. [Technology 3] the generating unit and the rendering unit are implemented in a first processor; the display control unit is implemented in a second processor having a different required security from that of the first processor; The display control system according to any one of the first and second aspects. According to this display control system, when a second processor, which has a different safety requirement than the first processor, displays an image generated by the first processor, the timing of changes in the image and changes in the display mode of the image can be accurately synchronized. [Technology 4] the drawing unit and the display control unit are implemented in a single processor, the single processor includes a first OS on which the drawing unit runs and a second OS on which the display control unit runs; The second OS has a different security requirement than the first OS. The display control system according to any one of the first and second aspects. [Technology 5] the generating unit and the drawing unit are implemented in a processor of an information device mounted on the vehicle, The display control unit is implemented in a processor of a meter device mounted on the vehicle. The display control system according to any one of the first and second aspects. According to this display control system, when the processor of the meter device displays an image generated by the processor of the information device, the timing of the change in the image and the change in the display mode of the image can be accurately synchronized. [Technology 6] the generating unit further generates layout information including a position of the second GUI object in the third GUI object; the display control unit extracts an image of the first GUI object and an image of the second GUI object from an image of the third GUI object based on the layout information. A display control system according to any one of techniques 1 to 5. According to this display control system, an existing mechanism for specifying a screen layout using layout information can be used to extract an image of the first GUI object and an image of the second GUI object from an image of the third GUI object. [Technology 7] generating data of a third GUI object including a first GUI object and a second GUI object in which a numerical value related to the display mode of the first GUI object is set as color information; generating an image of the third GUI object based on the data of the third GUI object; displaying the first GUI object in a manner based on color information of the second GUI object included in an image of the third GUI object; A display control method in which a computer executes the above. According to this display control method, the image to be displayed (first GUI object) and a numerical value related to the display mode of the image are transmitted to the display control unit at the same time, so that the timing of the change in the image and the change in the display mode of the image can be accurately matched. [Explanation of symbols]

[0072] 10 Display control system, 12 IVI device, 14 Meter device, 20 IVI processor, 22 GUIApp, 24 GUI framework, 25 Window system, 30 Meter processor, 33 Display control unit, 34 Composite layout management unit, 35 Video composition unit.

Claims

1. a generating unit that generates data of a third GUI object including a first GUI object and a second GUI object in which a numerical value related to a display mode of the first GUI object is set as color information; a drawing unit that generates an image of the third GUI object based on data of the third GUI object; a display control unit that displays the first GUI object in a manner based on color information of the second GUI object included in an image of the third GUI object; A display control system comprising:

2. the first GUI object is displayed by being synthesized with a predetermined image, the second GUI object is set with color information that indicates a numerical value related to a manner in which the first GUI object is to be combined with the predetermined image; The display control system according to claim 1 .

3. the generating unit and the rendering unit are implemented in a first processor; the display control unit is implemented in a second processor having a required level of security different from that of the first processor; The display control system according to claim 1 or 2.

4. the drawing unit and the display control unit are implemented in a single processor, the single processor includes a first OS on which the drawing unit runs and a second OS on which the display control unit runs; The second OS has a different security requirement than the first OS. The display control system according to claim 1 or 2.

5. the generating unit and the drawing unit are implemented in a processor of an information device mounted on the vehicle, The display control unit is implemented in a processor of a meter device mounted on the vehicle. The display control system according to claim 1 or 2.

6. the generating unit further generates layout information including a position of the second GUI object in the third GUI object; the display control unit extracts an image of the first GUI object and an image of the second GUI object from an image of the third GUI object based on the layout information; The display control system according to claim 1 or 2.

7. generating data of a third GUI object including a first GUI object and a second GUI object in which a numerical value related to a display mode of the first GUI object is set as color information; generating an image of the third GUI object based on the data of the third GUI object; displaying the first GUI object in a manner based on color information of the second GUI object included in an image of the third GUI object; A display control method in which a computer executes the above.

Images