Display control device, display system, and display control method

Abstract

Inspection of a warping process is achieved at a low cost. This display control device has: an insertion unit that inserts an evaluatory image into a static region, in which pixel values do not change as time passes, in a time series image; a processing unit that performs a warping process on the image into which the evaluatory image has been inserted; and an evaluation unit that evaluates whether the result of a CRC calculation with regard to the static region of the image that has been subjected to the warping process agrees with first reference information.

Description

[Technical Field]

[0001] The present disclosure relates to a display control device, a display system, and a display control method. [Background technology]

[0002] There is known a display control device that can check whether warping processing has been properly performed on an image displayed on a display device such as a head-up display, etc. In such a display control device, the check is performed by, for example, performing a CRC (Cyclic Redundancy Check) operation on a predetermined area of ​​the image after the warping processing has been performed.

[0003] Specifically, the inspection is performed by using two warping engines to perform warping independently and determining whether the results of CRC calculations on predetermined areas of the warped images match. Alternatively, after performing warping, the inspection is performed by using an inverse warping engine to perform inverse warping and determining whether the results of CRC calculations on predetermined areas of the images before and after warping match. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2021-163011 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in the case of a display control device that is inspected using a plurality of engines, the inspection costs are high.

[0006] One aspect of the present invention aims to realize inspection of warping processing at low cost. [Means for solving the problem]

[0007] According to one aspect, the display control device has the following configuration: A display control device that checks whether warping processing is properly performed on an image displayed on a display device, an insertion unit that inserts a determination image into a static region in a time-series image where pixel values ​​do not change over time; a processing unit that executes a warping process on the image into which the determination image has been inserted; The result of the CRC calculation on the static region of the warped image is A reference CRC according to the type of warp map used in the warping process. a determination unit that determines whether or not the first reference information matches; , and If they match, the determining unit determines that the warping process has been properly performed, and if they do not match, the determining unit determines that the warping process has not been properly performed. . [Effects of the Invention]

[0008] The warping process can be inspected at low cost. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a first diagram illustrating an example of a system configuration of a display system. [Figure 2] FIG. 2 is a first diagram illustrating an example of a hardware configuration of a display controller. [Figure 3] FIG. 3 is a first diagram illustrating an example of the functional configuration of a display controller. [Figure 4] FIG. 4 is a diagram showing a specific example of a static area. [Figure 5] FIG. 5 is a diagram showing a specific example of processing by the watermark image inserting unit. [Figure 6] FIG. 6 is a diagram showing a specific example of processing by the warping unit. [Figure 7] FIG. 7 is a diagram showing a specific example of the processing by the inspection unit and the removal unit. [Figure 8] FIG. 8 is a diagram showing a specific example of processing by the inspection unit. [Figure 9] FIG. 9 is an example of a first flowchart showing the flow of the inspection process. [Figure 10] FIG. 10 is an example of a second flowchart showing the flow of the inspection process. [Figure 11] FIG. 11 is a second diagram illustrating an example of the system configuration of the display system. [Figure 12] FIG. 12 is a second diagram illustrating an example of the hardware configuration of the display controller. [Figure 13] FIG. 13 is a second diagram illustrating an example of the functional configuration of the display controller. [Figure 14] FIG. 14 is an example of a third flowchart showing the flow of the inspection process. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, each embodiment will be described with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant description will be omitted.

[0011] [First embodiment] <Display system configuration> First, the system configuration of an in-vehicle display system in which warping processing is performed will be described. Fig. 1 is a first diagram showing an example of the system configuration of a display system. As shown in Fig. 1, the display system 100 includes a head unit 110, a serializer 120, a deserializer 130, a display controller 140, and a display 150.

[0012] The head unit 110 generates time-series images to be displayed on the display 150. The head unit 110 also outputs the time-series images and control information (information used for control when sequentially displaying the time-series images on the display 150) to the serializer 120 (see reference numerals 161 and 162).

[0013] The serializer 120 is a circuit that serializes the time-series image and control information signals output from the head unit 110 in order to send them onto a single transmission line (video link). The serializer 120 transmits the serialized signal to the deserializer 130 (see reference numeral 170) via a video link (for example, LVDS (Low Voltage Differential Signaling), APIX (registered trademark), etc.).

[0014] The deserializer 130 is a circuit that parallelizes the serial signals transmitted via the video link, and outputs the time-series images and control information obtained by the parallelization to the display controller 140 (see reference numerals 181 and 182).

[0015] The display controller 140 is an example of a display control device, and performs warping processing on each of the time-series images to be displayed on the display 150, and controls the display of each of the images after the warping processing on the display 150 based on control information.

[0016] Furthermore, the display controller 140 inserts a watermark image (an example of an image for determination) into the static area of ​​the image before the warping process is performed. Then, the display controller 140 performs a CRC operation on the static area of ​​the image after the warping process to check whether the warping process has been performed properly. The static area refers to an area of ​​the image area of ​​a time-series image where pixel values ​​do not change over time (details will be described later).

[0017] In this embodiment, for example, before the display system 100 is mounted on a vehicle, the generation device 10 is connected to the display controller 140. As a result, reference information (referred to as "reference CRC") generated in advance by the generation device 10 is stored in the display controller 140. The reference CRC is predetermined information obtained by performing a CRC operation on the image of the static area after warping processing when a watermark image (an example of an image for determination) is inserted into the static area and warping processing is performed.

[0018] The display controller 140 warps an image in which a watermark image has been inserted into a static area, and compares the CRC calculation result obtained by performing a CRC calculation on the static area of ​​the warped image with a pre-stored reference CRC. This allows the display controller 140 to check whether the warping process has been performed properly. The reference CRC includes, as part of it, target area information for CRC calculation, which specifies the range of the static area of ​​the warped image to be subjected to the CRC calculation. The target area for CRC calculation is set to include the area of ​​the watermark image after warping. The display controller 140 performs the CRC calculation on the static area in which the watermark image has been inserted based on the target area information.

[0019] The display 150 is an example of a display device, and is configured, for example, by a HUD (Head Up Display), and displays the image after warping processing under the control of the display controller 140 .

[0020] <Display controller hardware configuration> Next, the hardware configuration of the display controller 140 will be described. Fig. 2 is a first diagram showing an example of the hardware configuration of the display controller. As shown in Fig. 2, the display controller 140 has a display engine 200, a memory 221, and a processor 222. The display engine 200, the memory 221, and the processor 222 are connected via a bus 210.

[0021] The display engine 200 has hardware for executing processes such as acquiring the time-series images transmitted by the deserializer 130, inserting a watermark image, warping, inspection, removal, and outputting a display image to the display 150. Note that the hardware in the display engine 200 executes display control processing for displaying the warped image on the display 150 based on the control information transmitted by the deserializer 130, but the display control processing will be omitted from the following description.

[0022] 2, the display engine 200 includes a capture circuit 201, a memory 202, a warping engine 203, an inspection circuit 204, a removal circuit 205, and an output circuit 206. The elements in the display engine 200 (the capture circuit 201 to the output circuit 206) are connected to one another via a predetermined interface 207 (for example, a register interface).

[0023] The time-series images transmitted by the deserializer 130 are sequentially subjected to the above-described processing (acquisition processing to output processing) by each element in the display engine 200, and are output as display images (see dashed dotted lines).

[0024] The memory 221 stores various data used when the warping process and the inspection process are performed by the display engine 200. In this embodiment, the memory 221 stores a watermark image to be inserted into a static area of ​​an image, and multiple warp maps to be used when the warping process is performed. The memory 221 also stores multiple reference CRCs (which may include multiple reference CRCs (for inspection) and reference CRCs (for removal); details will be described later) generated in advance by the generation device 10 before the display system 100 is installed in a vehicle. The multiple reference CRCs are used in the inspection process.

[0025] The processor 222 controls the warping process and the inspection process performed by the display engine 200. Specifically, it acquires the type of warp map used in the warping process and writes it to the memory 221. As a result, the warping engine 203 reads out a warp map corresponding to the written type from among multiple warp maps pre-stored in the memory 221 and performs the warping process. Furthermore, the inspection circuit 204 reads out a reference CRC corresponding to the type of the written warp map from the memory 221 and performs the inspection process. In other words, the processor 222 controls switching of the processing contents of the warping process and the inspection process performed by the display engine 200 depending on the type of the warp map.

[0026] <Display controller functional configuration> Next, the functional configuration of the display controller 140 will be described. Fig. 3 is a first diagram showing an example of the functional configuration of the display controller. The display controller 140 performs the following functions by operating each element included in the hardware configuration of Fig. 2. Image input unit 301, Storage section 302, Warping unit 303, Inspection department 304, ·Removal unit 305, Image output unit 306, A watermark image insertion unit 307, Reference CRC storage unit 308, It functions as:

[0027] Of these, the image input unit 301 is realized by the capture circuit 201, and sequentially acquires time-series images from the deserializer .

[0028] The watermark image inserting unit 307 is an example of an inserting unit, and is realized by the capture circuit 201. The watermark image inserting unit 307 inserts a watermark image read from the memory 221 into the static area of ​​each of the acquired time-series images.

[0029] The storage unit 302 is realized by the memory 202, and sequentially stores images in which a watermark image has been inserted into the static area by the watermark image insertion unit 307.

[0030] The warping unit 303 is an example of a processing unit, and is realized by the warping engine 203. The warping unit 303 sequentially reads out images stored in the storage unit 302 and performs warping processing. The warping unit 303 reads out a warp map according to the specified type of warp map from the memory 221 functioning as the reference CRC storage unit 308, performs warping processing, and notifies the inspection unit 304 of the image after warping processing.

[0031] The check unit 304 is an example of a determination unit, and is realized by the check circuit 204. The check unit 304 performs a CRC calculation on the static area of ​​the image after warping processing, and obtains the result of the CRC calculation.

[0032] Furthermore, the check unit 304 reads out a reference CRC (for check) (an example of first reference information) corresponding to the type of the specified warp map from the memory 221 functioning as the reference CRC storage unit 308 (an example of a storage unit). The check unit 304 also compares the result of the CRC calculation with the read reference CRC (for check) to determine whether they match.

[0033] 3, it is assumed that a plurality of reference CRCs (for inspection) corresponding to the type of warp map are stored in advance in the reference CRC storage unit 308. Each of the plurality of reference CRCs (for inspection) differs depending on the type of warp map. Specifically, the generating device 10: Insert a watermark image into the static area, -Warping is performed on the static area where the watermark image is inserted using each warp map, - Perform CRC calculation on the static area image after warping processing. The result of the CRC calculation obtained by this is stored as a reference CRC (for inspection). The example in Figure 3 shows that Code 1, Code 2, etc. are stored as reference CRC (for inspection).

[0034] It is also assumed that the reference CRC storage unit 308 also stores in advance a reference CRC (for removal) (an example of second reference information) for removing the inserted watermark image. For example, you can perform warping using any warp map without inserting a watermark image into the static area. - Perform CRC calculation on the static area image after warping processing. The result of the CRC calculation obtained by this is stored as the reference CRC (for removal). The example in Figure 3 shows that code 0 is stored as the reference CRC (for removal).

[0035] If the result of the CRC calculation on the static region of the warped image matches the reference CRC (for inspection), inspection unit 304 determines that the warping process by warping engine 203 has been performed appropriately. In this case, inspection unit 304 notifies removal unit 305 of the warped image. Furthermore, if the result of the CRC calculation on the static region of the warped image does not match the reference CRC (for inspection), inspection unit 304 determines that the warping process by warping engine 203 has not been performed appropriately. In this case, inspection unit 304 performs error processing and notifies image output unit 306 of the image after the error processing.

[0036] Here, the image after error processing is, for example, a static image of the image after warping processing, in which at least a part of the dynamic area has been converted to black or the like, and is an image intended to notify the viewer of display 150 that the warping processing was not performed properly.

[0037] A dynamic region refers to a region in a time-series image where pixel values ​​change over time, i.e., an image region includes dynamic regions and static regions.

[0038] In addition, in this embodiment, the function of converting at least a part of a designated area in an image area including a dynamic area and a static area to black as error processing is referred to as a “black display function.” The inspection unit 304 is also an example of a black conversion unit that converts at least a part of a designated area in a dynamic area to black using the black display function.

[0039] The removal unit 305 is an example of a change unit, and is realized by the removal circuit 205. The removal unit 305 performs removal processing to remove the watermark image after warping processing from the static area where the watermark image has been inserted, from the image after warping processing notified by the inspection unit 304, and returns the image to the state where no watermark image has been inserted. Note that the state where no watermark image has been inserted refers to the state where warping processing has been performed without inserting a watermark image into the static area.

[0040] The removal unit 305 also notifies the image output unit 306 of the image after removal of the warped watermark image in the static region.

[0041] The image output unit 306 is an example of an output unit, and is realized by the output circuit 206. The image output unit 306 transmits the image notified by the removal unit 305 to the display 150. Note that, when error processing is performed by the inspection unit 304, the image output unit 306 transmits the image after the error processing to the display 150.

[0042] In the above description, it has been explained that the removal unit 305 performs a removal process on the static area to remove the watermark image after the warping process, thereby returning the static area to the state it was in when the watermark image was not inserted.

[0043] However, the process for restoring the static area to the state it was in when the watermark image was not inserted is not limited to this. For example, if the result of the CRC calculation matches the reference CRC (for inspection), the inspection unit 304 may further read the reference CRC (for removal) from the memory 221 functioning as the reference CRC storage unit 308, and compare the result of the CRC calculation with the reference CRC (for removal). Here, a code that does not match the result of the CRC calculation is intentionally selected as the reference CRC (for removal) to operate the black conversion function.

[0044] In this case, the inspection unit 304 determines that the result of the CRC calculation for the static area of ​​the warped image does not match the reference CRC (for removal), and therefore activates the black display function described above. At this time, by limiting the target for which the black display function is activated to the static area into which a watermark image has been inserted, the static area into which the watermark image has been inserted is converted to black. In other words, if the state of the static area would be black if a watermark image had not been inserted, the inspection unit 304 can restore the static area to the state it would have been in if a watermark image had not been inserted by activating the black display function. The inspection unit 304 is an example of a change unit, and includes a black conversion unit that converts at least a specified region of the static area to black using the black display function.

[0045] In this way, by using the black display function, it is possible to return the static area to the state it would have been in if no watermark image had been inserted, without operating the removal unit 305.

[0046] <Example of static area> Next, a specific example of a static region will be described. As described above, a static region refers to a region in a time-series image where pixel values ​​do not change over time. FIG. 4 is a diagram showing a specific example of a static region. In FIG. 4, reference numeral 401 denotes an example of one frame of an image in the time-series image acquired by the image input unit 301. As shown in FIG. 4, a black region 403 is provided around the periphery of a dynamic region 402 in each of the time-series images acquired by the image input unit 301 so that the image does not go outside the display region of the display 150 even when warping processing is performed.

[0047] Also, in FIG. 4, reference numeral 411 denotes an example of an image (image of the next frame) that the image input unit 301 acquires after the image indicated by reference numeral 401, among the images in the time series. As shown in FIG. 4, in the image indicated by reference numeral 411, the dynamic region 402 moves to the dynamic region 412. At this time, the region indicated by reference numeral 400 within the black region 403 is also included in the black region in the image indicated by reference numeral 411. In this way, the image acquired by the image input unit 301 includes a region whose pixel value does not change even as time passes and the image frame changes, and in this embodiment, this region is used as a static region. That is, in the example of FIG. 4, the static region is a black region provided on the periphery of the dynamic region.

[0048] 4, the black area on the periphery of the dynamic area is used as the static area, but an area other than the black area on the periphery of the dynamic area may be used as the static area. For example, if there is an area within the dynamic area whose pixel value does not change over time, that area may be used as the static area.

[0049] 4, a case has been described in which a black region is used as a static region, but the color of the region used as a static region is not limited to black. Regions of other colors may be used as long as the pixel values ​​do not change over time. Furthermore, regions used as static regions are not limited to single-color regions, but may be multicolor regions as long as the pixel values ​​do not change over time.

[0050] <Specific example of processing by the watermark image insertion unit> Next, a specific example of the processing of the watermark image insertion unit 307 will be described. Fig. 5 is a diagram showing a specific example of the processing of the watermark image insertion unit. In Fig. 5, reference numeral 401 denotes an example of one frame of an image in the time series of images acquired by the image input unit 301, and reference numeral 400 denotes a static area. As shown in Fig. 5, the watermark image insertion unit 307 inserts a watermark image 500 into the static area indicated by reference numeral 400 of the image indicated by reference numeral 401. The image 501 with the watermark image 500 inserted into the static area is stored in the storage unit 302.

[0051] <Example of warping process> Next, a specific example of processing (warping processing) by warping unit 303 will be described. Fig. 6 is a diagram showing a specific example of processing by the warping unit. As shown in Fig. 6, warping unit 303 reads image 501, in which watermark image 500 has been inserted in the static area, from storage unit 302, and also reads a warp map according to the type of warp map from memory 221, and executes warping processing.

[0052] In Fig. 6, reference numeral 601 indicates an image after warping processing. As shown in Fig. 6, in the image 501 in which the watermark image 500 is inserted in the static area, the dynamic area 402 is deformed by executing the warping processing. Reference numeral 602 indicates the dynamic area deformed by executing the warping processing. In addition, in the image 501, the watermark image 500 in the static area indicated by reference numeral 400 changes in pixel values ​​by executing the warping processing. Reference numeral 600 indicates the watermark image after the pixel values ​​have changed by executing the warping processing.

[0053] <Specific examples of processing by the inspection unit and removal unit> Next, a specific example of the processing (inspection processing) of the inspection unit 304 and the processing (removal processing) of the removal unit 305 will be described. Fig. 7 is a diagram showing a specific example of the processing of the inspection unit and the removal unit.

[0054] In Fig. 7, reference numeral 601 denotes an image after warping processing. As shown in Fig. 7, the inspection unit 304 performs a CRC calculation on the static region (reference numeral 600) of the image after warping processing, and obtains the result of the CRC calculation ("Code 1" in the example of Fig. 7). The inspection unit 304 also reads out a reference CRC (for inspection) ("Code 1" in the example of Fig. 7) according to the type of warp map, and compares it with the result of the CRC calculation ("Code 1" in the example of Fig. 7).

[0055] 7, the result of the CRC calculation matches the reference CRC (for inspection), so the inspection unit 304 determines that the warping process by the warping engine 203 has been properly performed. As a result, the inspection unit 304 notifies the removal unit 305 of the image (reference numeral 601) after the warping process.

[0056] In Figure 7, symbol 701 indicates the state in which the removal unit 305 has removed the watermark image after warping (symbol 600) from the static area of ​​the image after warping (symbol 601) that contains the watermark image after warping (symbol 600).

[0057] As shown in FIG. 7, the removal unit 305 performs the removal process, and the static area indicated by the reference numeral 400 returns to the state it was in when the watermark image was not inserted.

[0058] As described above, the inspection unit 304 may further read a reference CRC (for removal) from the memory 221 and compare the result of the CRC calculation with the reference CRC (for removal) without operating the removal unit 305, thereby operating the black display function. Here, a code that intentionally does not match the result of the CRC calculation is selected as the reference CRC (for removal) to be read, in order to operate the black conversion function. This allows the inspection unit 304 to convert the static area into which the watermark image has been inserted to black, and to return the static area indicated by reference numeral 400 to the state it would have been in if the watermark image had not been inserted.

[0059] <Specific examples of processing by the inspection department> Next, a specific example of the processing (inspection processing and error processing) of the inspection unit 304 will be described. Fig. 8 is a diagram showing a specific example of the processing of the inspection unit.

[0060] In Fig. 8, reference numeral 601 denotes an image after warping processing. As shown in Fig. 8, inspection unit 304 performs a CRC calculation on a static region (reference numeral 800) of the image after warping processing, and obtains the result of the CRC calculation ("code α" in the example of Fig. 8). In addition, inspection unit 304 reads out a reference CRC (for inspection) according to the type of warp map ("code 1" in the example of Fig. 8), and compares it with the result of the CRC calculation ("code α" in the example of Fig. 8).

[0061] In the example of FIG. 8, the result of the CRC calculation does not match the reference CRC (for inspection), so the inspector 304 determines that the warping process by the warping engine 203 was not performed appropriately.

[0062] In this case, the inspection unit 304 performs error processing. In Fig. 8, reference numeral 801 indicates an image after error processing in which error processing has been performed by the inspection unit 304. As shown in Fig. 8, in the image after error processing, the dynamic area indicated by reference numeral 602 and the static area indicated by reference numeral 400 are converted to black (see reference numerals 400 and 802. Note that the dynamic area indicated by reference numeral 802 is indicated by diagonal lines for convenience). This allows the viewer of the display 150 to recognize that the warping process has not been performed appropriately.

[0063] 8, the entire dynamic region indicated by the reference numeral 602 is converted to black, but this is not limiting. If it is possible to make the viewer of the display 150 recognize that the warping process has not been performed appropriately, at least a part of the dynamic region indicated by the reference numeral 602 may be converted to black.

[0064] <Inspection process flow> Next, the flow of the inspection process in the display system 100 will be described with reference to Fig. 9 and Fig. 10. Fig. 9 and Fig. 10 are examples of first and second flowcharts showing the flow of the inspection process.

[0065] As shown in FIGS. 9 and 10, the inspection process in the display system 100 includes an offline phase and an online phase, and the display system 100 first executes the offline phase (steps S901 to S905).

[0066] In step S901, the generating device 10 extracts a static area from an image to be subjected to warping processing, and inserts a watermark image into the static area to generate an image of the static area into which the watermark image has been inserted.

[0067] In step S902, the generating device 10 acquires one of the warp maps used in the warping process.

[0068] In step S903, the generating device 10 performs warping on the generated static region image using the acquired warp map, and generates a reference CRC by performing a CRC calculation on the warped static region image. At this time, the generating device 10 may generate a reference CRC (for removal) in addition to a reference CRC (for inspection).

[0069] In step S904, the generating device 10 stores the generated reference CRC in the memory 221 of the display controller 140.

[0070] In step S905, the generating device 10 determines whether or not a corresponding reference CRC has been generated for all of the multiple warp maps. If it is determined in step S905 that there is a warp map for which a corresponding reference CRC has not been generated (NO in step S905), the process returns to step S902.

[0071] On the other hand, if it is determined in step S905 that the corresponding reference CRCs have been generated for all of the warp maps (YES in step S905), the process proceeds to FIG. 10, and the process transitions to the online phase (steps S1001 to S1032).

[0072] In step S1001, the display controller 140 receives an instruction to start a display application, which starts the display engine 200 and starts a display application that displays an image on the display 150.

[0073] In step S1002, the warping unit 303 reads out a warp map according to the type of warp map, and the checking unit 304 reads out a reference CRC (for checking) according to the type of warp map.

[0074] In step S1003, the watermark image insertion unit 307 inserts a watermark image into the static area of ​​the image acquired by the image input unit 301. Furthermore, the warping unit 303 performs warping processing on the image in which the watermark image has been inserted into the static area, using a warp map according to the type of warp map.

[0075] In step S1004, the inspection unit 304 performs a CRC calculation on the static region of the warped image, and compares the result of the CRC calculation with a reference CRC (for inspection).

[0076] In step S1005, the check unit 304 determines whether the result of the CRC calculation matches the reference CRC (for check) as a result of the comparison. If it is determined that they match in step S1005 (YES in step S1005), the process proceeds to step S1011.

[0077] In step S1011, the removal unit 305 removes the post-warping watermark image from the static area of ​​the post-warping image, thereby returning the static area of ​​the post-warping image to the state it would have been in if the watermark image had not been inserted.

[0078] In step S1012, the image output unit 306 outputs to the display 150 the post-warping image in which the post-warping watermark image has been removed from the static region of the post-warping image.

[0079] On the other hand, if it is determined in step S1005 that they do not match (NO in step S1005), the process proceeds to step S1021.

[0080] In step S1021, the inspection unit 304 performs error processing. In step S1022, the image output unit 306 outputs the image after the error processing to the display 150.

[0081] In step S1031, display controller 140 determines whether or not a stop instruction for the display application has been acquired. If display controller 140 determines in step S1031 that a stop instruction has not been acquired (NO in step S1031), the process proceeds to step S1032.

[0082] In step S1032, the warping unit 303 and the inspection unit 304 determine whether the type of warp map has been changed. If it is determined in step S1032 that the type of warp map has not been changed (NO in step S1032), the process returns to step S1003.

[0083] On the other hand, if it is determined in step S1032 that the type of warp map has been changed (YES in step S1032), the process returns to step S1002.

[0084] Furthermore, in step S1031, if it is determined that a stop instruction has been acquired (if YES in step S1031), the display engine 200 is stopped and the display application that displays images on the display 150 is terminated. This ends the inspection process.

[0085] <Summary> As is clear from the above description, the display controller 140 according to the first embodiment: In a time-series image, a watermark image is inserted into a static area where pixel values ​​do not change over time. -Warping is performed on an image with a watermark image inserted in the static area. · Determine whether the result of the CRC calculation for the static region of the warped image matches the pre-generated reference CRC.

[0086] In this way, in the first embodiment, by inserting a watermark image into a static area where pixel values ​​do not change over time, the watermark image after warping processing becomes a constant image, and a reference CRC is prepared in advance.

[0087] As a result, according to the first embodiment, it is no longer necessary to inspect the warping process using a plurality of engines, and it is possible to inspect the warping process at low cost.

[0088] [Second embodiment] In the first embodiment, the case has been described where the generating device 10 generates a plurality of reference CRCs in advance according to the type of warp map in the offline phase and stores the generated CRCs in the reference CRC storage unit 308.

[0089] In contrast to this, in the second embodiment, a case will be described in which a reference CRC generation unit is arranged in the display controller 140 and a reference CRC is generated in the online phase. The second embodiment will be described below, focusing on the differences from the first embodiment.

[0090] <Display system configuration> First, the system configuration of a display system according to the second embodiment will be described. Fig. 11 is a second diagram showing an example of the system configuration of a display system. The difference from the display system 100 shown in Fig. 1 is that the display system 1100 shown in Fig. 11 does not include the generating device 10. As described above, in the second embodiment, the reference CRC is generated in the online phase, and therefore the display system 1100 does not include the generating device 10 for generating the reference CRC.

[0091] <Display controller hardware configuration> Next, the hardware configuration of the display controller 140 according to the second embodiment will be described. Fig. 12 is a second diagram showing an example of the hardware configuration of the display controller. The hardware configuration shown in Fig. 2 and the hardware configuration shown in Fig. 12 have the same components and differ only in the flow of data.

[0092] 12, when the processor 222 acquires the type of warp map to be used in the warping process, it reads the acquired type of warp map from the memory 221 and generates a reference CRC corresponding to the acquired type of warp map. The processor 222 also notifies the generated reference CRC to the check circuit 204. Note that other processes by the processor 222 have been described in the first embodiment above, and therefore will not be described here.

[0093] <Display controller functional configuration> Next, the functional configuration of the display controller 140 according to the second embodiment will be described. Fig. 13 is a second diagram showing an example of the functional configuration of the display controller. The difference from the functional configuration described using Fig. 3 is that the display controller 140 shown in Fig. 13 has a reference CRC generation unit 1308 instead of the reference CRC storage unit 308.

[0094] The reference CRC generation unit 1308 is an example of a generation unit. The reference CRC generation unit 1308 is realized by the processor 222, and upon acquiring the type of warp map, reads out the warp map of the acquired type from the memory 221. The reference CRC generation unit 1308 also performs warping processing on a static area image, prepared in advance, into which a watermark image has been inserted, using the read warp map, and performs CRC calculation on the static area image after warping processing. As a result, the reference CRC generation unit 1308 can generate a reference CRC (for inspection) corresponding to the acquired type of warp map and notify the inspection unit 304.

[0095] As in the first embodiment described above, when the black display function is used to return to the state when the watermark image is not inserted, the reference CRC generation unit 1308 may be further configured to generate a reference CRC (for removal).

[0096] <Inspection process flow> Next, the flow of the inspection process in the display system 1100 will be described with reference to Fig. 14. Fig. 14 is an example of a third flowchart showing the flow of the inspection process. As shown in Fig. 14, the inspection process in the display system 1100 includes only an online phase (steps S1401 to S1432).

[0097] In step S1401, the display controller 140 receives an instruction to start a display application, which starts the display engine 200 and starts a display application that displays an image on the display 150.

[0098] In step S1402, the reference CRC generation unit 1308 generates a reference CRC (for inspection) according to the type of warp map, and notifies the inspection unit 304 of the generated CRC.

[0099] In step S1403, the watermark image insertion unit 307 inserts a watermark image into the static area of ​​the image acquired by the image input unit 301. Furthermore, the warping unit 303 performs warping processing on the image in which the watermark image has been inserted into the static area, using a warp map according to the type of warp map.

[0100] In step S1404, the inspection unit 304 performs a CRC calculation on the static region of the warped image, and compares the result of the CRC calculation with the reference CRC (for inspection) generated in step S1402.

[0101] In step S1405, checking unit 304 determines whether the result of the CRC calculation matches the reference CRC (for checking) as a result of the comparison. If it is determined that they match in step S1405 (YES in step S1405), the process proceeds to step S1411.

[0102] In step S1411, the removal unit 305 removes the post-warping watermark image from the static area of ​​the post-warping image, thereby returning the static area of ​​the post-warping image to the state it would have been in if the watermark image had not been inserted.

[0103] In step S1412, the image output unit 306 outputs to the display 150 the post-warping image in which the post-warping watermark image has been removed from the static region of the post-warping image.

[0104] On the other hand, if it is determined in step S1405 that they do not match (NO in step S1405), the process proceeds to step S1421.

[0105] In step S1421, the inspection unit 304 performs error processing. In step S1422, the image output unit 306 outputs the image after the error processing to the display 150.

[0106] In step S1431, display controller 140 determines whether or not a stop instruction for the display application has been acquired. If display controller 140 determines in step S1431 that a stop instruction has not been acquired (NO in step S1431), the process proceeds to step S1432.

[0107] In step S1432, the reference CRC generation unit 1308 determines whether the type of warp map has been changed. If it is determined in step S1432 that the type of warp map has not been changed (NO in step S1432), the process returns to step S1403.

[0108] On the other hand, if it is determined in step S1432 that the type of warp map has been changed (YES in step S1432), the process returns to step S1402.

[0109] Furthermore, if it is determined in step S1431 that a stop instruction has been acquired (YES in step S1431), display engine 200 is stopped and the display application that displays images on display 150 is terminated. This ends the inspection process.

[0110] <Summary> As is clear from the above description, the display controller 140 according to the second embodiment: In a time-series image, a watermark image is inserted into a static area where pixel values ​​do not change over time. When the warp map type is changed, a warping process is performed on the static area image with the watermark image inserted, which has been prepared in advance. Also, a CRC calculation is performed on the static area image after the warping process to generate a reference CRC. · Warping is performed on an image with a watermark image inserted in the static area. · Determine whether the result of the CRC calculation for the static area of ​​the image after warping matches the generated reference CRC.

[0111] As described above, the second embodiment has the same configuration as the first embodiment, and further has a configuration in which a reference CRC is generated online.

[0112] As a result, according to the second embodiment, it is possible to obtain the same effects as those of the first embodiment, and further to eliminate processing in the offline phase.

[0113] [Other embodiments] The present invention is not limited to the configurations described in the above embodiments, but may be combined with other elements, etc. These aspects can be changed without departing from the spirit of the present invention, and can be appropriately determined depending on the application form. [Explanation of symbols]

[0114] 10:Generation device 100: Display system 110: Head unit 120: Serializer 131: Deserializer 140: Display controller 150: Display 200: Display Engine 201: Capture circuit 202: Memory 203: Warping Engine 204: Inspection circuit 205 :Removal circuit 206: Output circuit 221: Memory 222: Processor 301: Image input unit 302: Storage area 303: Warping section 304: Inspection Department 305:Removal section 306: Image output unit 307: Watermark image insertion section 308: Reference CRC storage section 1100: Display system 1308: Reference CRC generator

Claims

1. A display control device that checks whether warping processing is properly performed on an image displayed on a display device, an insertion unit that inserts a determination image into a static region in a time-series image where pixel values ​​do not change over time; a processing unit that executes a warping process on the image into which the determination image has been inserted; a determination unit that determines whether a result of a CRC calculation on the static region of the image after the warping process matches first reference information that is a reference CRC according to a type of warp map used in the warping process, If there is a match, the determination unit determines that the warping process has been properly performed, and if there is a mismatch, the determination unit determines that the warping process has not been properly performed. Display control device.

2. the image regions of the time-series images include dynamic regions in which pixel values ​​change over time and static regions in which pixel values ​​do not change over time; The display control device according to claim 1 , wherein the insertion unit inserts the determination image into the static area, not into the dynamic area, of the image area of ​​the time-series images.

3. The display control device according to claim 2 , wherein the static area is a black area provided on the periphery of the dynamic area.

4. a change unit that, when the determination unit determines that the image matches, returns the static area of ​​the image after the warping process to the state it was in when the determination image was not inserted; an output unit that outputs the warped image that has been restored to the state in which the judgment image was not inserted; The display control device according to claim 2 or 3, further comprising:

5. the modification unit includes a removal unit that removes the determination image after the warping process from the static region of the image after the warping process when the determination unit determines that they match, The output unit outputting the warped image from which the judgment image has been removed; The display control device according to claim 4 .

6. the static area is a black area provided on the periphery of the dynamic area, the change unit includes a black conversion unit that converts a dynamic area of ​​the warped image to black when the determination unit determines that the two images do not match, The determination unit If it is determined that the result of the CRC calculation matches the first reference information, it is determined that the result does not match by comparing the result of the CRC calculation with second reference information, which is reference information different from the first reference information and is a reference CRC corresponding to an arbitrary warp map; The black conversion unit When the determination unit determines that the two images do not match, the dynamic area of ​​the warped image is converted to black; The output unit outputting the warped image in which the dynamic region is converted to black; The display control device according to claim 4 .

7. 4. The display control device according to claim 2, further comprising a black conversion unit that converts the static area of ​​the image after the warping process and at least a part of the dynamic area into black when the determination unit determines that they do not match.

8. a storage unit for storing a plurality of pieces of first reference information corresponding to different types of warp maps, the first reference information being different depending on the types of warp maps; The display control device according to claim 1 , wherein the determination unit makes the determination using the first reference information corresponding to the type of warp map used in the warping process, among the plurality of first reference information stored in the storage unit.

9. a generating unit configured to generate the first reference information in accordance with a type of warp map used in the warping process; The display control device according to claim 1 , wherein the determination unit makes the determination using the first reference information generated by the generation unit.

10. the generating unit generates the first reference information in accordance with the type of warp map used in the warping process when the type of warp map used in the warping process is changed; The display control device according to claim 9 , wherein the determination unit makes the determination using the first reference information that corresponds to the type of the changed warp map generated by the generation unit.

11. a display engine that performs warping and inspection on the time series of images; a processor that controls the warping process and the inspection process; A display control device that checks whether a warping process is properly performed on an image displayed by a display device, comprising: The display engine includes: inserting a determination image into a static region in the time-series image where pixel values ​​do not change over time; performing the warping process on the image into which the determination image has been inserted; As the inspection process, it is determined whether or not a result of a CRC calculation on the static region of the image after the warping process matches first reference information that is a reference CRC according to a type of warp map used in the warping process; If they match, it is determined that the warping process has been properly performed, and if they do not match, it is determined that the warping process has not been properly performed. Display control device.

12. The display control device according to claim 11 , further comprising a memory for storing the first reference information used in the inspection process.

13. A display control device according to any one of claims 1 to 12; a head unit that generates an image to be processed by the display control device; a display device that displays the image after the warping process output from the display control device; and A display system having:

14. A display control method by a display control device that checks whether warping processing has been properly performed on an image displayed on a display device, comprising: an insertion step of inserting a determination image into a static area in a time-series image, the static area having pixel values ​​that do not change over time, by an insertion unit included in the display control device; a processing step of executing a warping process on the image into which the determination image has been inserted by a processing unit included in the display control device; a determination step of determining, by a determination unit included in the display control device, whether or not a result of a CRC calculation on the static region of the image after the warping process matches first reference information that is a reference CRC according to a type of warp map used in the warping process; In the determining step, if the two match, it is determined that the warping process has been properly performed, and if the two do not match, it is determined that the warping process has not been properly performed. Display control method.

Images