Display method, display device, and program

Abstract

To provide a display method, a display device, and a program that increase a degree of freedom of an image to be displayed and improve convenience for a user.SOLUTION: A controller 170 of a projector 100 acquires tag information indicating a content of a content image 200, displays a decoration image 300 disposed along an outline of the content image 200 outside the content image 200 when the tag information meets a first condition, and displays the decoration image 300 having a different color or pattern and disposed along the outline of the content image 200 outside the content image 200 when the tag information meets a second condition different from the first condition.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a display method, a display device, and a program. [Background technology]

[0002] Conventionally, there are known techniques for providing images that match the preferences of a user. For example, Patent Document 1 discloses an image display device that includes an image display unit and a frame unit located around the image display unit, and that is configured so that the width of the frame unit can be variably controlled. The frame unit includes a non-image display area that surrounds the image display unit and a frame unit that surrounds the non-image display area, and the width of the frame unit can be variably controlled by changing the width of the non-image display area. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-109239 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the image display device disclosed in Patent Document 1, the position and shape of the frame cannot be changed due to the structure of the image display device, and therefore the degree of freedom in presentation of the image displayed by the image display unit is not high. [Means for solving the problem]

[0005] One aspect of the present disclosure is a display method that includes obtaining content information indicating a content of a first image, displaying a second image arranged along a contour of the first image outside the first image when the content information meets a first condition, and displaying a third image arranged along a contour of the first image outside the first image and having a different color or pattern than the second image when the content information meets a second condition different from the first condition.

[0006] One aspect of the present disclosure is a display device that includes an optical device and at least one processor, wherein the at least one processor performs the following operations: acquires content information indicating a content of a first image; and, when the content information meets a first condition, controls the optical device to display a second image arranged outside the first image and along a contour of the first image; and, when the content information meets a second condition different from the first condition, controls the optical device to display a third image arranged outside the first image and along the contour of the first image, and having a different color or pattern from the second image, by controlling the optical device.

[0007] One aspect of the present disclosure is a program that causes a computer to obtain content information indicating the contents of a first image, and when the content information meets a first condition, display a second image arranged outside the first image along a contour of the first image, and when the content information meets a second condition different from the first condition, display a third image arranged outside the first image along the contour of the first image and having a different color or pattern than the second image. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram showing the configuration of a projector. [Diagram 2] FIG. 4 is a diagram showing an example of a content image. [Diagram 3] FIG. 11 is a diagram showing an example of a decorative image. [Figure 4] FIG. [Diagram 5] FIG. 13 shows a first UI image. [Figure 6] 5 is a flowchart showing the operation of the projector according to the first embodiment. [Figure 7] FIG. 4 is a diagram showing the configuration of a registration table. [Figure 8] 10 is a flowchart showing the operation of a projector according to a second embodiment. [Figure 9] FIG. 13 shows a second UI image. [Figure 10] FIG. 13 is a diagram showing an example of an OSD image superimposed on a composite image. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0010] [1. Configuration of the projector according to the first embodiment] FIG. 1 is a block diagram showing the configuration of a projector 100. As shown in FIG. The configuration of a projector 100 will be described with reference to FIG. The projector 100 includes an operation unit 110, an operation signal receiving unit 115, a camera 121, an audio processing unit 123, a speaker 125, a microphone 127, a wireless communication interface 130, a frame memory 140, an image processing unit 150, an image projection unit 160, and a control unit 170. In the following, the interface is abbreviated as I / F.

[0011] The operation unit 110 includes a plurality of operation keys. A user operates the operation keys of the operation unit 110 to input various instructions to the projector 100. When a user operates an operation key of the operation unit 110, the operation unit 110 outputs an operation signal corresponding to the operated operation key to the control unit 170. The operation keys included in the operation unit 110 include a power key for switching the power on and off, a menu key for displaying a menu for performing various settings, direction keys for selecting an item on the menu, an enter key for confirming an operation, and the like.

[0012] The operation signal receiving unit 115 is a receiving device for an infrared signal, and includes a light receiving element, a decoder, and the like (not shown). The operation signal receiving unit 115 receives and decodes an infrared signal transmitted from the remote control 105. The operation signal receiving unit 115 decodes the infrared signal, and outputs an operation signal corresponding to an operated operation key or button of the remote control 105 to the control unit 170. The operation signal receiving unit 115 may receive a wireless signal such as Bluetooth from the remote control 105. Bluetooth is a registered trademark. When receiving a wireless signal, the operation signal receiving unit 115 may include an antenna and a receiving circuit. The operation unit 110 and the operation signal receiving unit 115 may also be referred to as an operation input I / F.

[0013] The remote control 105 includes a plurality of operation keys similar to those of the operation unit 110. For example, the remote control 105 includes a menu key for displaying a menu for performing various settings, direction keys for selecting an item in the menu, an enter key for confirming an operation, and the like. The remote control 105 may be a mobile terminal such as a smartphone. In this case, an I / F image of the operation keys is displayed on a touch panel of the mobile terminal by application software installed on the mobile terminal.

[0014] Camera 121 includes an imaging lens and an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary MOS), and generates a captured image in response to an instruction from control unit 170. Camera 121 outputs the generated captured image to control unit 170. Control unit 170 temporarily stores the input captured image of camera 121 in storage unit 180. In this embodiment, a configuration in which projector 100 includes camera 121 will be described, but camera 121 may be configured to be externally connected to projector 100.

[0015] The audio processing unit 123 includes a D / A (Digital to Analog) conversion circuit, converts the digital audio data input from the control unit 170 into analog audio data, and outputs the converted analog audio data to the speaker 125. Moreover, audio processing unit 123 includes an A / D (Analog to Digital) conversion circuit, converts analog audio data input from microphone 127 into digital audio data, and outputs the converted digital audio data to control unit 170. The digital audio data is temporarily stored in storage unit 180.

[0016] The speaker 125 outputs the analog audio data input from the audio processing unit 123 . The microphone 127 collects sound, generates an analog signal, and outputs the generated analog sound data to the sound processor 123 .

[0017] The wireless communication I / F 130 is a wireless communication module for performing wireless communication in compliance with communication standards such as 4G (Generation), 5G, LTE (Long Term Evolution), and Wi-Fi. The wireless communication I / F 130 is connected to the server device 10 via a network 30, and receives packet data supplied from the server device 10. The packet data includes a content image 200 and audio data. The wireless communication I / F 130 extracts the content image 200 and audio data included in the packet data, and outputs the extracted content image 200 and audio data to the control unit 170. Wi-Fi is a registered trademark. The projector 100 may also include an image input I / F (not shown) that includes a connector and an interface circuit, and receive the content image 200 and audio data from the server device 10 or an information processing device via a cable.

[0018] The image processing unit 150 is connected to the frame memory 140. The image processing unit 150 also includes an OSD (On Screen Display) processing unit 155. The image processing unit 150 develops the content image 200 and the decorative image 300 input from the control unit 170 in the frame memory 140 .

[0019] The OSD processing unit 155 superimposes an OSD image on the image expanded in the frame memory 140 under the control of the control unit 170. The OSD processing unit 155 includes an OSD memory (not shown). The OSD memory stores OSD image information representing figures, fonts, and the like for forming an OSD image. When the OSD processing unit 155 is instructed by the control unit 170 to superimpose an OSD image, it reads out the necessary OSD image information from the OSD memory and superimposes it on the image expanded in the frame memory 140.

[0020] The image processing unit 150 performs image processing such as resolution conversion processing, resizing processing, distortion correction, shape correction processing, digital zoom processing, and adjustment of color tone and brightness of the image, on the image expanded in the frame memory 140. The image expanded in the frame memory 140 is an input image or an image in which an OSD image is superimposed on the input image. The image processing unit 150 outputs image information, which is information about the image developed in the frame memory 140 , to a panel driving unit 167 of the image projection unit 160 .

[0021] The frame memory 140 and the image processing unit 150 are configured, for example, by integrated circuits. Examples of integrated circuits include large-scale integrated circuits (LSIs), application-specific integrated circuits (ASICs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), and system-on-a-chips (SoCs). The frame memory 140 and the image processing unit 150 may include an analog circuit as part of the integrated circuit configuration, or may be configured by combining the control unit 170 with an integrated circuit.

[0022] The image projection unit 160 includes a light source 161, three liquid crystal panels 163R, 163G, and 163B as light modulation devices, a projection lens 165 as an optical system unit, a panel drive unit 167, and the like. Hereinafter, the liquid crystal panels 163R, 163G, and 163B are collectively referred to as liquid crystal panels 163. The light source 161, the liquid crystal panels 163R, 163G, and 163B, and the projection lens 165 included in the image projection unit 160 correspond to an optical device.

[0023] The light source 161 includes a solid-state light source such as a light-emitting diode or a semiconductor laser. A discharge-type light source lamp such as an extra-high pressure mercury lamp or a metal halide lamp may be used as the light source 161. The light emitted by the light source 161 in response to an instruction from the control unit 170 is converted into light having a substantially uniform luminance distribution by an integrator optical system (not shown), and is separated into the three primary colors of light, that is, red (R), green (G), and blue (B), by a color separation optical system (not shown). After that, the light separated into the red (R), green (G), and blue (B) color components is incident on the liquid crystal panels 163R, 163G, and 163B, respectively. The light separated into the color components incident on the liquid crystal panels 163R, 163G, and 163B is called color light.

[0024] The liquid crystal panels 163R, 163G, and 163B are each formed of a transmissive liquid crystal panel in which liquid crystal is sealed between a pair of transparent substrates, etc. Each liquid crystal panel 163 has a rectangular image forming area 164R, 164G, and 164B formed of a plurality of pixels arranged in a matrix, and a drive voltage can be applied to each pixel.

[0025] The panel driving section 167 forms an image in the image forming areas 164R, 164G, and 164B of the liquid crystal panels 163R, 163G, and 163B. Specifically, the panel driving section 167 applies a driving voltage corresponding to the image information input from the image processing section 150 to each pixel of the image forming areas 164R, 164G, and 164B according to an instruction from the control section 170, and sets each pixel to a light transmittance corresponding to the image information. The light emitted from the light source 161 is modulated for each pixel by passing through the image forming areas 164R, 164G, and 164B of the liquid crystal panels 163R, 163G, and 163B, and image light corresponding to the image information is formed for each color light. The formed image light of each color is synthesized for each pixel by a color synthesis optical system (not shown) to become image light representing a color image, and is enlarged and projected by the projection lens 165 onto the screen 50, which is a projection surface. In this embodiment, the projection surface is the screen 50, but it is also possible to use an indoor wall or ceiling, an outdoor exterior wall, or the like as the projection surface.

[0026] The control unit 170 includes a memory unit 180 and a processor 190 .

[0027] The storage unit 180 includes a volatile storage device and a non-volatile storage device. The volatile storage device is, for example, a random access memory (RAM), etc. The non-volatile storage device is, for example, a read only memory (ROM), a flash memory, an electrically erasable programmable read-only memory (EEPROM), etc.

[0028] The volatile storage device is used as an operating area for the processor 190 . The non-volatile storage device stores a control program executed by the processor 190, a decorative image 300, arrangement information 183, and setting data 185. The control program includes an application program. The non-volatile storage device of this embodiment stores an application program that realizes the functions of a smart TV as the application program. This application program is referred to as a smart TV APP 181. The decorative image 300, arrangement information 183, and smart TV APP 181 will be described in detail later.

[0029] The setting data 185 is various setting data for operating the projector 100, and in the first embodiment, the setting data 185 includes combination information. The combination information is information that associates information indicating the genre of the content image 200 with identification information that identifies the decorative image 300.

[0030] The processor 190 is an arithmetic processing device including a processor such as a CPU (Central Processing Unit) or an MPU (Micro-Processing Unit). The processor 190 may be configured with a single processor, or may be configured with multiple processors. The processor 190 may be configured with a SoC integrated with a part or all of the storage unit 180 or other circuits. The processor 190 may be configured with a combination of a CPU that executes a program and a DSP (Digital Signal Processor) that executes a predetermined arithmetic processing. Furthermore, the processor 190 may be configured with all of its functions implemented in hardware, or may be configured using a programmable device.

[0031] [2. Operation of the Projector in the First Embodiment] In the following description, the projector 100 projects image light onto the screen 50 to form an image on the screen 50, and this is referred to as "display." Additionally, the image that the projector 100 displays on the screen 50 is referred to as a "projected image."

[0032] The projector 100 has a first mode and a second mode as display modes for displaying an image on the screen 50.

[0033] In the first mode, the projector 100 generates a composite image 400 by combining the decorative image 300 with the content image 200 received from the server device 10. The projector 100 displays image light based on the generated composite image 400 on the screen 50.

[0034] In the second mode, the projector 100 displays the content image 200 on the screen 50. That is, when operating in the second mode, the projector 100 generates image light based on the content image 200 without combining the decorative image 300 with the content image 200, and displays the generated image light on the screen 50.

[0035] By operating the remote control 105 or the operation unit 110, the user can switch the operation mode of the projector 100 between a first mode and a second mode.

[0036] The overall size of the composite image 400 displayed by the projector 100 in the first mode and the size of the content image 200 displayed by the projector 100 in the second mode are the same. In the first mode, the content image 200 is included in the composite image 400. Therefore, the size of the content image 200 displayed in the first mode is smaller than the size of the content image 200 displayed in the second mode.

[0037] FIG. 2 is a diagram showing an example of a content image 200, FIG. 3 is a diagram showing an example of a decorative image 300, and FIG. The content image 200 is an image input from outside or an image stored in advance in the storage unit 180. In this embodiment, a case will be described where the content image 200 is an image distributed by streaming from the server device 10. That is, the content image 200 is distributed by streaming from the server device 10 when the control unit 170 executing the smart TV APP 181 transmits a distribution request to the server device 10. Alternatively, the content image 200 may be an image supplied to the projector 100 by an information processing device. In other words, the content image 200 may be supplied from the information processing device to the projector 100 by connecting the information processing device to the projector 100. For example, a notebook PC (Personal Computer), a desktop PC, a tablet PC, a smartphone, a game device, or the like may be used as the information processing device.

[0038] The decorative image 300 is, for example, an image that is stored in advance in the storage unit 180 of the projector 100, and is an image that can be combined with various content images 200. The decorative image 300 may be stored in the storage unit 180 as a so-called template. The projector 100 may store a plurality of decorative images 300 in the storage unit 180. The projector 100 may also download the decorative image 300 from, for example, the server device 10. The projector 100 may also be configured to read out the decorative image 300 stored in an external storage device, such as a Universal Serial Bus (USB) memory or an SD card, from the storage device and use the same.

[0039] The decorative image 300 is, for example, a rectangular image, and includes a placement portion 310 and a frame portion 330. The placement section 310 is located at the center of the decorative image 300, and the frame section 330 is placed all around the placement section 310 along the contour of the placement section 310. The placement section 310 is an area in which the content image 200 is placed when generating the composite image 400. The image processing section 150 superimposes the content image 200 on the placement section 310 of the decorative image 300 deployed in the frame memory 140. At this time, the frame section 330 is placed outside the content image 200 along the contour of the content image 200.

[0040] The frame section 330 is an area in which a decorative image that decorates the content image 200 arranged in the arrangement section 310 is formed. The image formed in the frame section 330 is different for each of the multiple decorative images 300. In other words, the appearances of the multiple decorative images 300 are different from each other in terms of color, pattern, etc.

[0041] FIG. 3 shows an example of a decorative image 300 in which a frame portion 330 is formed around the entire periphery of the decorative image 300, but the frame portion 330 may be formed on one, two or three of the top, bottom, left or right sides of the rectangular decorative image 300.

[0042] The decorative image 300 includes placement information 183, which is information indicating the position and range in which the content image 200 is placed inside the decorative image 300. The placement information 183 includes start point information, and width and height information.

[0043] For example, a coordinate system is set for the decorative image 300. Fig. 3 shows a coordinate system in which the upper left vertex of the decorative image 300 is the origin, the horizontal coordinate of the decorative image 300 is the M axis, and the vertical coordinate is the N axis. In the following, the coordinate system set for the decorative image 300 will be described as the MN coordinate system.

[0044] The start point information is coordinate information indicating the position of a start point that serves as a reference when arranging the content image 200 in the arrangement unit 310. In this embodiment, the upper left vertex U of the arrangement unit 310 is set as the start point when viewed from the drawing. The coordinates of the vertex U in the MN coordinate system are expressed as (M1, N1). The width information is information that indicates the width W in the M-axis direction from the vertex U that is the starting point. The height information is information that indicates the height H in the N-axis direction from the vertex U that is the starting point.

[0045] In the first embodiment, in the first mode, the decorative image 300 to be composited with the content image 200 is changed according to the genre of the content image 200. The genre of the content image 200 includes movies, game images, music, and the like. In the following description, the genre of the content image 200 is movies as the first genre, and the genre of the content image 200 is game images as the second genre. In addition to the first genre and the second genre, a third genre and a fourth genre may be set.

[0046] When the genre of the input content image 200 is a movie, which is a first genre, the projector 100 determines that the first condition is met. When the genre of the input content image 200 is a game, which is a second genre, the projector 100 determines that the input content image 200 is met with a second condition different from the first genre.

[0047] A different decorative image 300 is associated with the content image 200 when the genre of the content image 200 meets the first condition and when the genre of the content image 200 meets the second condition. The decorative image 300 when the genre of the content image 200 meets the first condition corresponds to the second image. The decorative image 300 when the genre of the content image 200 meets the second condition corresponds to the third image. The decorative image 300 associated with the content image 200 when the genre meets the first condition and when the genre meets the second condition can be changed by the user's operation of the remote control 105 or the operation unit 110. The decorative image 300 to be combined with the content image 200 when the first condition is met and the decorative image 300 to be combined with the content image 200 when the second condition is met are images with different colors, patterns, etc.

[0048] 5 is a diagram showing a first UI (User Interface) image 500 displayed on the screen 50. The first UI image 500 is an operation image for receiving a user's operation, and is an image used for generating combination information for combining the genre of the content image 200 with the decorative image 300.

[0049] Here, a combination of the genre of the content image 200 and the decorative image 300 will be described. The user operates the remote control 105 to display the first UI image 500 shown in Fig. 5 and sets the combination of the genre of the content image 200 and the decorative image 300. The genres shown in the first UI image 500 correspond to a plurality of candidate conditions.

[0050] In the first UI image 500, a genre selection field 510 and an image selection field 530 are displayed. The genre selection field 510 is a field for selecting the genre of the content image 200. In the genre selection field 510, objects corresponding to each genre, such as movies, games, and music, are displayed. FIG. 5 shows an example in which three objects, a first object 511, a second object 512, and a third object 513, are displayed, but the number of objects displayed in the genre selection field 510 is not limited to three and may be four or more. Also, the number of objects displayed in the genre selection field 510 may be two or less.

[0051] The first object 511 is an object that indicates the genre of a movie, the second object 512 is an object that indicates the genre of a game, and the third object 513 is an object that indicates the genre of music.

[0052] A selection frame 520 is displayed in the genre selection field 510. The display position of the selection frame 520 can be moved up and down in the drawing within the genre selection field 510 by the user operating the remote control 105. For example, when the down key of the remote control 105 is pressed in a state in which the selection frame 520 surrounds the periphery of the first object 511 shown in FIG. 5, the selection frame 520 moves down in the drawing, and the selection frame 520 surrounds the periphery of the second object 512.

[0053] In this embodiment, a frame-shaped image surrounding the object is displayed as the selection frame 520, but for example, a check box corresponding to each object may be displayed. The selected object may be given an image of a shape other than a frame, or the selected object itself may be highlighted by being enlarged. The selection frame 520 may also be called a selection cursor, a focus display, or the like. The display position of the selection frame 520 in the first UI image 500 is changed by operating the directional keys provided on the remote control 105.

[0054] The image selection field 530 is a field for selecting the decorative image 300. Thumbnail images of the decorative image 300 are displayed in the image selection field 530. The thumbnail images correspond to candidate images. In FIG. 5, six thumbnail images are shown: a first thumbnail image 531, a second thumbnail image 532, a third thumbnail image 533, a fourth thumbnail image 534, a fifth thumbnail image 535, and a sixth thumbnail image 536. However, the number of thumbnail images displayed in the image selection field 530 is not limited to six, and seven or more thumbnail images, or five or fewer thumbnail images may be displayed.

[0055] A selection frame 540 is displayed in the image selection field 530. The display position of the selection frame 540 can be moved up, down, left, and right in the image selection field 530 by the user operating the remote control 105. For example, when the right key of the remote control 105 is pressed in a state in which the selection frame 540 surrounds the periphery of the first thumbnail image 531 shown in FIG. 5, the selection frame 540 moves in the right direction in the image view, and the selection frame 540 surrounds the periphery of the second thumbnail image 532.

[0056] In this embodiment, a frame-shaped image surrounding the thumbnail image is displayed as the selection frame 540, but for example, a check box corresponding to each thumbnail image may be displayed. The selected thumbnail image may be given an image with a shape other than a frame, or the selected thumbnail image itself may be highlighted by being enlarged. The selection frame 540 may also be referred to as a selection cursor, a focus display, or the like. The display position of the selection frame 540 in the first UI image 500 is changed by operating the directional keys provided on the remote control 105.

[0057] When the user presses the enter button on the remote control 105, the control unit 170 generates combination information that associates an object surrounded by a selection frame 520 in the genre selection field 510 with a thumbnail image surrounded by a selection frame 540 in the image selection field 530. In other words, the control unit 170 generates combination information that associates information indicating the genre corresponding to the object surrounded by the selection frame 540 with identification information that identifies the decorative image 300 corresponding to the thumbnail image surrounded by the selection frame 540. The control unit 170 stores the generated combination information in the storage unit 180 as setting data 185.

[0058] The user then operates the remote control 105 to change the display position of the selection frame 520 for other unselected objects, and sets the unselected objects to a selected state. Furthermore, the user operates the remote control 105 to change the display position of the selection frame 540, and selects a thumbnail image of the decorative image 300 to be composited with the content image 200 when the selected object is in the selected state. In this manner, the user generates combination information in which the identification information of the decorative image 300 is associated with each genre. It is not necessary to generate combination information in which the identification information of the decorative image 300 is associated with each genre using the first UI image 500. If there is a genre for which combination information has not been generated, the control unit 170 may select a default decorative image 300 set in advance for that genre, and generate the composite image 400 by compositely combining the selected decorative image 300 with the content image 200. If there is a genre for which combination information has not been generated, the control unit 170 may not associate the decorative image 300 with that genre. In this case, for a genre to which no decorative image 300 is associated, only the content image 200 is displayed.

[0059] A description will be given of the process executed by the projector 100 in the first mode. When the projector 100 starts projecting an image onto the screen 50, the user first operates the remote control 105 to start the smart TV APP 181.

[0060] The control unit 170 executing the smart TV APP 181 displays a selection screen on the screen 50, on which thumbnails of a plurality of viewable content images 200 are displayed, and waits until the user inputs a selection of the content image 200.

[0061] When the user operates the remote control 105 to select a content image 200, the control unit 170 transmits to the server device 10 a request to distribute the selected content image 200 and a request to obtain tag information indicating the genre of the content image 200. The tag information is information that indicates the details of the content image 200. The tag information corresponds to content information.

[0062] When the control unit 170 receives tag information from the server device 10, it determines the genre of the content image 200 distributed from the server device 10 based on the received tag information, and selects the decorative image 300 associated with the determined genre by referring to the combination information. The control unit 170 reads out the selected decorative image 300 from the storage unit 180, and outputs the read decorative image 300 to the image processing unit 150. The image processing unit 150 loads the decorative image 300 input from the control unit 170 into the frame memory 140.

[0063] When the server device 10 starts streaming distribution of the content image 200 selected by the user, the projector 100 receives the distributed packet data via the wireless communication I / F 130. The wireless communication I / F 130 extracts the content image 200 and audio data contained in the received packet data, and outputs the extracted content image 200 and audio data to the control unit 170.

[0064] The control unit 170 outputs the content image 200 input from the wireless communication I / F 130 to the image processing unit 150 , and outputs the audio data to the audio processing unit 123 .

[0065] When the content image 200 is input from the control unit 170, the image processing unit 150 executes a reduction process for reducing the input decorative image 300.

[0066] As described above, the size of the content image 200 input to the image processing unit 150 is the same as the size of the composite image 400, and is larger than the size of the arrangement unit 310 of the decorative image 300. Therefore, the image processing unit 150 executes a reduction process to reduce the input content image 200 to match the size of the arrangement unit 310.

[0067] First, the image processing unit 150 compares the resolution of the input content image 200 with the width and height information included in the arrangement information 183, and calculates a reduction ratio for reducing the content image 200. As an example, the reduction ratio is the ratio of the resolution corresponding to the width W and height H to the resolution of the content image 200, but the calculation method is not limited to this.

[0068] After calculating the reduction ratio, the image processing unit 150 executes a reduction process to reduce the content image 200 at the determined reduction ratio.

[0069] Next, the image processing unit 150 executes a synthesis process. Fig. 4 shows a composite image 400 expanded in the frame memory 140. The composite image 400 shown in Fig. 4 is an example in which image processing such as shape correction has not been performed by the image processing unit 150.

[0070] For example, a coordinate system is set in the frame memory 140. Fig. 4 shows an orthogonal plane coordinate system in which the upper left vertex O of the frame memory 140 is set as the origin, the horizontal coordinate of the frame memory 140 is set as the S axis, and the vertical coordinate of the frame memory 140 is set as the T axis. In the following explanation, the coordinate system set in the frame memory 140 will be explained as the ST coordinate system.

[0071] The image processing unit 150 generates a composite image 400 in the frame memory 140 by superimposing the content image 200 reduced by the reduction process on the decorative image 300. The image processing unit 150 generates the composite image 400 of a size equal to or smaller than the maximum size of an image that can be developed in the frame memory 140 in order to store the entire composite image 400 in the frame memory 140. The maximum size of an image that can be developed in the frame memory 140 is the same as the maximum size of an image that can be drawn in the image forming area 164 of the liquid crystal panel 163. In other words, the size of the composite image 400 is equal to or smaller than the maximum size of an image that can be developed in the frame memory 140. By making the size of the composite image 400 smaller than the maximum size of an image that can be drawn in the image forming area 164, it becomes possible to change the position and shape of the composite image 400 to be drawn on the liquid crystal panel 163, and to change the size of the composite image 400 to be enlarged or reduced. This increases the degree of freedom of the composite image 400 displayed on the screen 50, thereby improving the convenience for the user.

[0072] 4, assume that the coordinates of the top left vertex V of the decorative image 300 already loaded in the frame memory 140 are (S0, T0). The image processing unit 150 calculates the coordinate value S1 by adding the coordinate value M1 of the M coordinate of the starting point information included in the arrangement information 183 to the S coordinate value S0 of the top left vertex V of the decorative image 300, as the S coordinate value of the vertex U in the ST coordinate system. Similarly, the image processing unit 150 calculates the coordinate value T1 as the T coordinate value of the vertex U in the ST coordinate system by adding the coordinate value N1 of the N coordinate of the starting point information included in the placement information 183 to the T coordinate value T0 of the upper left vertex V of the decorative image 300.

[0073] Next, the image processing unit 150 superimposes the content image 200, which has been reduced by reduction processing, on the placement portion 310 of the decorative image 300 expanded in the frame memory 140 based on the placement information 183 and the coordinate value of the vertex U in the ST coordinate system.

[0074] The image processing unit 150 generates a composite image 400 by superimposing the content image 200 on the arrangement portion 310 of the decorative image 300 expanded in the frame memory 140 so that the upper left vertex of the content image 200 is located at the coordinates in the ST coordinate system of the vertex U. The image in the arrangement portion 310 of the decorative image 300 expanded in the frame memory 140 before the content image 200 is superimposed is rewritten with the content image 200.

[0075] Therefore, the content image 200 is developed in the area of ​​the frame memory 140 where the placement portion 310 of the decorative image 300 was developed, and the image of the frame portion 330 is left as is in the frame memory 140. In this process, the composite image 400 is generated so that the placement portion 310 of the decorative image 300 does not overlap the content image 200, which is the first image.

[0076] After generating the composite image 400, the image processing unit 150 may perform image processing such as resolution conversion processing, resizing processing, distortion correction, shape correction processing, digital zoom processing, and adjustment of image color and brightness on the generated composite image 400. These image processing processes are not essential, and the image processing unit 150 does not have to perform the above image processing. Furthermore, the image processing unit 150 may perform a combination of multiple image processing processes selected from the above image processing processes.

[0077] When the image processing is completed, the image processing unit 150 reads out the image information of the composite image 400 developed in the frame memory 140 , and outputs the read image information to a panel driving unit 167 of the image projection unit 160 .

[0078] When image information is input from the image processing unit 150, the image projection unit 160 applies a driving voltage corresponding to the input image information to each pixel of the image formation areas 164R, 164G, and 164B, and sets each pixel to a light transmittance corresponding to the image information. The light emitted from the light source 161 is separated into R, G, and B color lights by a color separation optical system, and passes through the image formation areas 164R, 164G, and 164B of the liquid crystal panels 163R, 163G, and 163B. As a result, the color lights are modulated for each pixel, and image lights corresponding to the image information are formed for each color light. The formed image lights of each color are synthesized for each pixel by a color synthesis optical system (not shown) to become image lights representing a color image, and are enlarged and projected by the projection lens 165 onto the screen 50, which is the projection surface. At this time, the synthesized image 400 displayed on the screen 50 is displayed on the screen 50 so that the frame portion 330 of the decorative image 300 and the content image 200 do not overlap.

[0079] FIG. 6 is a flowchart showing the operation of the projector 100. The operation of the projector 100 will be described with reference to the flowchart shown in FIG. First, the control unit 170 determines whether or not the smart TV APP 181 has been selected (step S1). Specifically, the control unit 170 determines whether or not an operation to start up the smart TV APP 181 has been accepted by the remote control 105.

[0080] When the smart TV APP 181 is not selected (step S1 / NO), the control unit 170 waits until the smart TV APP 181 is selected. When the smart TV APP 181 is selected (step S1 / YES), the control unit 170 starts the smart TV APP 181 (step S2). Then, the control unit 170 displays a selection screen for the content image 200 provided by the smart TV APP 181 on the screen 50 (step S3).

[0081] Next, the control unit 170 determines whether or not the content image 200 has been selected (step S4). Specifically, the control unit 170 determines whether or not an operation to select the content image 200 has been accepted by the remote control 105.

[0082] If the content image 200 is not selected (step S4 / NO), the control unit 170 waits until the content image 200 is selected. If the content image 200 is selected (step S4 / YES), the control unit 170 transmits an acquisition request for the selected content image 200 and tag information to the server device 10 (step S5).

[0083] Next, the control unit 170 judges whether or not the tag information has been received from the server device 10 (step S6). If the tag information has not been received (step S6 / NO), the control unit 170 waits until the tag information is received.

[0084] When the control unit 170 receives the tag information from the server device 10 (step S6 / YES), it determines whether the operation mode of the projector 100 is the first mode (step S7).

[0085] If the operation mode of the projector 100 is not the first mode (step S7 / NO) but the second mode, the control unit 170 determines whether or not the wireless communication I / F 130 has received packet data distributed from the server device 10 (step S8). If the control unit 170 has not received packet data (step S8 / NO), it waits until the packet data is received.

[0086] When the wireless communication I / F 130 receives the packet data (step S8 / YES), the control unit 170 causes the projection image to be projected on the screen 50 and causes the speaker 125 to output sound. Specifically, the wireless communication I / F 130 extracts the content image 200 and sound data contained in the received packet data, and outputs the extracted content image 200 and sound data to the control unit 170. The control unit 170 outputs the input content image 200 to the image processing unit 150, and outputs the input sound data to the sound processing unit 123.

[0087] The image processing unit 150 expands the input content image 200 in the frame memory 140, and performs image processing such as adjusting the color tone and brightness of the expanded content image 200. The image processing unit 150 reads out image information of the content image 200 after the image processing, and outputs it to the image projection unit 160. The image projection unit 160 generates image light based on the input image information, and projects the generated image light to display a projection image on the screen 50 (step S9).

[0088] The audio processor 123 performs audio processing such as converting input digital audio data into an analog signal (step S10), and outputs the converted analog signal from the speaker 125 (step S11).

[0089] When the operation mode of the projector 100 is the first mode (step S7 / YES), the control unit 170 determines whether the genre indicated by the tag information matches the first condition or the second condition based on the tag information (step S12). For example, the control unit 170 determines whether the genre of the content image 200 selected in step S4 is a movie, which is the first condition, or a game, which is the second condition, based on the tag information.

[0090] If the genre of the content image 200 is movie, the control unit 170 determines that the first condition is selected (step S13 / YES), and outputs the decorative image 300 associated with the first condition to the image processing unit 150 (step S14). If the genre of the content image 200 is game, the control unit 170 determines that the second condition is selected (step S13 / NO), and outputs the decorative image 300 associated with the second condition to the image processing unit 150 (step S15). The image processing unit 150 expands the decorative image 300 input from the control unit 170 in the frame memory 140.

[0091] Next, the control unit 170 determines whether or not the wireless communication I / F 130 has received packet data distributed from the server device 10 (step S16). If the control unit 170 has not received packet data (step S16 / NO), the control unit 170 waits until the packet data is received.

[0092] When the wireless communication I / F 130 receives the packet data (step S16 / YES), the control unit 170 causes the projection image to be projected on the screen 50 and causes the speaker 125 to output sound. Specifically, the wireless communication I / F 130 extracts the content image 200 and sound data contained in the received packet data, and outputs the extracted content image 200 and sound data to the control unit 170. The control unit 170 outputs the input content image 200 to the image processing unit 150, and outputs the input sound data to the sound processing unit 123.

[0093] When the content image 200 is input from the control unit 170, the image processing unit 150 compares the resolution of the input content image 200 with the width and height information included in the decorative image 300, and calculates the reduction ratio for reducing the content image 200. After calculating the reduction ratio, the image processing unit 150 executes a reduction process for reducing the content image 200 at the calculated reduction ratio (step S17).

[0094] Next, the image processing unit 150 executes a synthesis process by superimposing the content image 200 reduced by the reduction process on the arrangement portion 310 of the decorative image 300 developed in the frame memory 140 (step S18). As a result, a synthesis image 400 is generated in the frame memory 140.

[0095] Next, the image processing unit 150 performs image processing such as adjusting the color tone and brightness of the image on the composite image 400 generated in the frame memory 140. The image processing unit 150 reads out image information of the composite image 400 after the image processing and outputs it to the image projection unit 160. The image projection unit 160 generates image light based on the input image information and projects the generated image light to display a projection image on the screen 50 (step S19).

[0096] The audio processor 123 performs audio processing such as converting the digital audio data input from the controller 170 into an analog signal (step S20), and outputs the converted analog signal from the speaker 125 (step S21).

[0097] [3. Operation of the Projector in the Second Embodiment] Next, a second embodiment to which the present disclosure is applied will be described. Since the configuration of the projector 100 of the second embodiment is the same as the configuration of the projector 100 of the first embodiment, the same reference numerals are used, and a detailed description of the configuration of the projector 100 will be omitted.

[0098] In the second embodiment, the control unit 170 determines the first scene and the second scene, which are situations or scenes displayed in the content image 200, which is an image that changes over time, based on the image captured by the camera 121 and the audio data input from the microphone 127.

[0099] For example, if the content image 200 is a game image, the status of the content image 200 includes whether the game is won or lost. Also, if the content image 200 is a game image, the scene of the content image 200 includes locations such as towns and forests displayed by the images included in the content image 200. Furthermore, if the content image 200 is a movie, the scenes of the content image 200 include scenes expressing the emotions of the characters in the movie, such as joy, anger, sorrow, and happiness.

[0100] For example, the control unit 170 performs image analysis on the image captured by the camera 121, and when it detects characters such as "WIN" or "victory" within the range of the captured image in which the content image 200 is captured, it determines that the user has won the game. When the control unit 170 detects characters such as "LOSE", "GAME OVER", or "lose" within the range of the captured image in which the content image 200 is captured, it determines that the user has lost the game.

[0101] The control unit 170 performs image analysis on the image captured by the camera 121, and if it detects a cluster of trees within the range of the captured image in which the content image 200 was captured, it determines that the location displayed by the content image 200 is in a forest. The control unit 170 performs image analysis on the image captured by the camera 121, and if multiple houses and buildings are detected within the range of the captured image in which the content image 200 was captured, it determines that the location displayed by the content image 200 is in town.

[0102] For example, the control unit 170 detects sounds of preset sound patterns such as cheers and applause from the sound data input from the microphone 127, and determines that it is a scene in a movie or game where a character is happy. Furthermore, the control unit 170 detects a preset sound pattern, such as a gunshot, from the input sound data to determine that a scene in a movie or game is a battle scene.

[0103] In addition, the control unit 170 may detect, from the input audio data, changes in the volume and tempo of music played as background music in a movie or game. Furthermore, the control unit 170 may perform a Fourier transform on the audio data to detect the frequency components of the audio contained in the audio data.

[0104] 7 is a diagram showing an example of the configuration of registration table 187. Registration table 187 is a table stored in storage unit 180 in advance. In one record of the registration table 187, information indicating a scene such as joy, combat, win, or lose, identification information of the decorative image 300, and a display pattern are registered in association with each other. The display pattern is information indicating a pattern for changing the display of the decorative image 300. In this embodiment, the display of the decorative image 300 is changed by changing the display color of the decorative image 300 or by making the decorative image 300 partially or entirely blink.

[0105] For example, in the case of a display pattern in which the display color of the decorative image 300 is changed, the display pattern includes information that specifies whether the display color is changed, the color to be displayed, and the time interval for changing the color. The time interval can be rephrased as a period. A pattern in which the display color of the decorative image 300 is changed according to the color to be displayed and the time interval for changing the color included in the display pattern corresponds to a second pattern image in which the color changes in a second period.

[0106] Furthermore, when the display pattern is, for example, a pattern for blinking the decorative image 300, the display pattern includes information indicating whether to blink the entire decorative image 300 or only a part of it, and information on the blinking time interval. When the display pattern is a pattern for blinking only a part of the decorative image 300, the display pattern includes information indicating the part to be blinked, and information indicating the blinking sequence. A pattern in which the decorative image 300 is blinked in a first cycle according to information included in the display pattern indicating whether the decorative image 300 is to be blinked in its entirety or in part and information indicating the blinking time interval corresponds to a first pattern image that blinks in a first cycle. A pattern in which the blinking parts of the decorative image 300 are changed in accordance with information included in the display pattern indicating parts of the decorative image 300 that are to be blinked in part and information indicating the blinking order corresponds to a third pattern in which the lit parts are changed in a third cycle.

[0107] When the control unit 170 detects a first scene by analyzing the captured image or the audio data, the control unit 170 refers to the registration table 187 to acquire the decorative image 300 associated with the detected first scene and information on the display pattern of the decorative image 300. When the control unit 170 detects a second scene different from the first scene by analyzing the captured image or the audio data, the control unit 170 refers to the registration table 187 to acquire the decorative image 300 associated with the detected second scene and information on the display pattern of the decorative image 300. The control unit 170 outputs the acquired decorative image 300 and information on the display pattern to the image processing unit 150.

[0108] When the decorative image 300 and the display pattern information are input, the image processing unit 150 performs image processing on the decorative image 300 so that the decorative image 300 matches the display pattern indicated by the display pattern information. The image processing unit 150 combines the processed decorative image 300 with the content image 200 to generate a composite image 400, and outputs image information of the generated composite image 400 to the image projection unit 160.

[0109] FIG. 8 is a flowchart showing the operation of the projector 100 of the second embodiment. The operation of the projector 100 will be described with reference to the flowchart shown in FIG.

[0110] First, the control unit 170 acquires an image captured by the camera 121 from the storage unit 180 (step S31). Next, the control unit 170 analyzes the acquired captured image and detects preset characters within the range of the captured image in which the screen 50 of the captured image is captured. The control unit 170 detects preset characters such as "WIN", "Victory", "LOSE", "GAME OVER", and "Lose". Then, the control unit 170 determines whether or not the preset characters have been detected (step S32).

[0111] When the control unit 170 detects a preset character (step S32 / YES), the control unit 170 acquires information indicating the decorative image 300 and the display pattern associated with the detected character from the registration table 187 (step S35). The control unit 170 outputs the acquired information indicating the decorative image 300 and the display pattern to the image processing unit 150 (step S36).

[0112] Furthermore, if the control unit 170 does not detect any preset characters from the captured image (step S32 / NO), it acquires audio data from the storage unit 180 (step S33). The control unit 170 analyzes the acquired audio data and determines whether or not preset sounds such as cheers or applause have been detected. The control unit 170 also determines whether or not the volume of music played as background music or the like has changed to or above a preset threshold value.

[0113] When the control unit 170 does not detect a preset sound or a change in volume equal to or greater than a preset threshold value (step S34 / NO), it causes a projection image to be displayed on the screen 50 (step S41). This projection image is the content image 200 without the decorative image 300. Furthermore, when the decorative image 300 to be displayed for each genre is set, the control unit 170 may cause the content image 200 to be displayed as a projection image, which is a composite image 400 composited with the decorative image 300 corresponding to the genre.

[0114] Next, the control unit 170 determines whether the display of the content image 200 has ended (step S42). For example, the control unit 170 determines that the display of the content image 200 has ended when the distribution of packet data from the server device 10 has ended or when the remote control 105 has received an operation to end the display of the content image 200. When the control unit 170 determines that the display of the content image 200 has ended (step S42 / YES), it ends this processing flow. When the control unit 170 determines that the display of the content image 200 has not ended (step S42 / NO), it returns to the processing of step S31.

[0115] Furthermore, when the control unit 170 detects a preset sound or detects a change in volume equal to or greater than a preset threshold value (step S34 / YES), the control unit 170 acquires information indicating a pre-associated decorative image 300 and a display pattern from the registration table 187 (step S35).The control unit 170 outputs the acquired information indicating the decorative image 300 and the display pattern to the image processing unit 150 (step S36).

[0116] When the information indicating the decorative image 300 and the display pattern is input from the control unit 170, the image processing unit 150 develops the input decorative image 300 in the frame memory 140 (step S37).

[0117] Next, the image processing unit 150 executes a reduction process to reduce the content image 200 input from the control unit 170 (step S38). The image processing unit 150 compares the resolution of the content image 200 with the width and height information indicated by the arrangement information 183 included in the decorative image 300, calculates a reduction ratio for reducing the content image 200, and executes a reduction process to reduce the content image 200 at the calculated reduction ratio.

[0118] Next, the image processing unit 150 executes a compositing process to combine the reduced content image 200 and the decorative image 300 (step S39). The image processing unit 150 executes the compositing process by superimposing the content image 200 reduced by the reduction process on the arrangement portion 310 of the decorative image 300 expanded in the frame memory 140. As a result, a composite image 400 is generated in the frame memory 140.

[0119] Next, the image processing unit 150 performs image processing on the decorative image 300 according to the information indicating the display pattern input from the control unit 170 (step S40). For example, the image processing unit 150 executes image processing such as changing the brightness of the decorative image 300 or changing the display color of the decorative image 300 according to the information indicating the display pattern.

[0120] Next, the image projection unit 160 displays the projection image on the screen 50 (step S41). The image processing unit 150 outputs image information of the composite image 400 generated in the frame memory 140 to the image projection unit 160. The image projection unit 160 generates image light based on the input image information, and projects the generated image light to display the projection image on the screen 50 (step S41).

[0121] Next, the control unit 170 determines whether the display of the content image 200 has ended (step S42). For example, the control unit 170 determines that the display of the content image 200 has ended when the distribution of packet data from the server device 10 has ended or when the remote control 105 has received an operation to end the display of the content image 200. When the control unit 170 determines that the display of the content image 200 has ended (step S42 / YES), it ends this processing flow. When the control unit 170 determines that the display of the content image 200 has not ended (step S42 / NO), it returns to the processing of step S31.

[0122] [4. Operation of the Projector in the Third Embodiment] Next, a third embodiment to which the present disclosure is applied will be described. Since the configuration of the projector 100 of the third embodiment is the same as the configuration of the projector 100 of the first embodiment, the same reference numerals are used, and a detailed description of the configuration of the projector 100 will be omitted.

[0123] In the third embodiment, in addition to the decorative image 300, the appearance of the OSD image showing menu information superimposed on the composite image 400 is changed according to the genre of the content image 200. For example, the display mode of the OSD image is changed by changing the shape, color, movement, blinking interval, etc. of the OSD image according to the genre of the content image 200.

[0124] For example, the OSD image includes objects that indicate controls for moving to a home screen, switching sources, settings, etc. The shapes and colors of these objects are changed according to the genre of the content image 200.

[0125] Furthermore, when movements are set for objects indicating controls for transitioning to a home screen, switching sources, settings, and the like, the movements of these objects may be changed according to the genre of the content image 200. Furthermore, the appearance of the notification image that notifies the operation or state of the projector 100 may also be changed according to the genre of the content image 200.

[0126] Also, the font of characters such as "HOME", "SWITCH SOURCE", and "SETTINGS" displayed in the OSD image may be changed according to the genre of the content image 200. Furthermore, the manner in which the OSD image is displayed on the screen 50 may be changed according to the genre of the content image 200. For example, if the genre of the content image 200 is a movie, the OSD image may be slid in onto the screen 50 from the top or bottom of the screen 50. Also, if the genre of the content image 200 is a game, the OSD image may be slid in onto the screen 50 from the left or right of the screen 50.

[0127] Fig. 9 is a diagram showing a second UI image 600 displayed on the screen 50. Fig. 9 shows the second UI image 600 in a case where the shape of the OSD image is changed. The second UI image 600 shown in Fig. 9 includes an OSD image selection field 650 in addition to a genre selection field 610 and an image selection field 630.

[0128] In the OSD image selection field 650, thumbnail images obtained by reducing the size of an OSD image displayed as a menu image are displayed. Although Fig. 9 shows an example in which three thumbnail images, a first thumbnail image 651, a second thumbnail image 652, and a third thumbnail image 653, are displayed, the number of thumbnail images displayed in the OSD image selection field 650 is not limited to three. For example, two thumbnail images may be displayed in the OSD image selection field 650, or four or more thumbnail images may be displayed. Any two of the first thumbnail image 651, the second thumbnail image 652, and the third thumbnail image 653 correspond to a first display object or a second display object.

[0129] In addition, a selection frame 660 is displayed in the OSD image selection field 650 . The user operates the left and right keys provided on the remote control 105 to move the display position of the selection frame 660 within the OSD image selection field 650. For example, in the display state of the OSD image selection field 650 shown in FIG. 9, by pressing the right key on the remote control 105 once, the display position of the selection frame 660 is changed from the display position of the first reduced image 651 to the display position of the second reduced image 652.

[0130] The control unit 170 generates combination information when one of the object selected in the genre selection field 610, the thumbnail image selected in the image selection field 630, and the reduced image selected in the OSD image selection field 650 is selected. The combination information is information that associates information indicating the genre corresponding to the icon image, identification information of the decorative image 300 corresponding to the selected thumbnail image, and identification information of the selected reduced image.

[0131] FIG. 10 is a diagram showing an example of an OSD image superimposed on the composite image 400. As shown in FIG. FIG. 10 shows a projected image in which an OSD image 700 corresponding to the first reduced image 651 selected in the second UI image 600 shown in FIG. 9 is displayed.

[0132] When a button provided on the remote control 105 is operated and display of a menu image is requested, the control unit 170 refers to the combination information and acquires identification information of a reduced image associated with the genre of the content image 200. For example, when movie is selected as the genre of the content image 200, the control unit 170 refers to the combination information and acquires identification information of a reduced image of an OSD image associated with movie. When game is selected as the genre of the content image 200, the control unit 170 refers to the combination information and acquires identification information of a reduced image of an OSD image associated with game, which has a different appearance from the reduced image of the OSD image associated with the movie genre. The control unit 170 outputs information of an OSD image 700 corresponding to the acquired identification information of the reduced image and coordinate information for arranging the OSD image 700 to the image processing unit 150.

[0133] The image processing unit 150 acquires OSD image information representing figures, fonts, and the like from the OSD memory by the OSD processing unit 155 based on the information of the OSD image 700 input from the control unit 170. The OSD processing unit 155 generates the OSD image 700 based on the acquired OSD image information, and superimposes the OSD image 700 at the coordinates of the frame memory 140 indicated by the coordinate information input from the control unit 170. The image processing unit 150 reads out image information of the image in which the OSD image 700 is superimposed on the composite image 400, and outputs the read image information to the image projection unit 160.

[0134] 5. Other embodiments The above-described embodiment is a preferred embodiment, however, the present invention is not limited to the above-described embodiment and various modifications are possible without departing from the spirit and scope of the present invention. For example, in the first embodiment described above, the control unit 170 of the projector 100 determines the genre of the content image 200 and displays the decorative image 300 associated with the determined genre. In the second embodiment, the control unit 170 of the projector 100 determines the situation or scene displayed in the content image 200 and displays the decorative image 300 associated with the determined situation or scene.

[0135] As another example, an information processing device may be connected to the projector 100, and an application program installed in the information processing device may determine the genre of the content image 200 and the situation or scene displayed in the content image 200. The application program may transmit identification information for identifying the decorative image 300 associated with the determined genre of the content image 200 and the situation or scene displayed in the content image 200 to the projector 100. The application program may also transmit the decorative image 300 itself to the projector 100. The information processing device may be, for example, a notebook PC, a desktop PC, a tablet PC, a smartphone, or the like.

[0136] Also, the smart TV APP 181 installed in the projector 100 may be installed in an information processing device. Also, a smart TV device having the same functions as when the processor 190 executes the smart TV APP 181 may be connected to the projector 100.

[0137] The learned model may also be stored in the storage unit 180 of the projector 100. This trained model is a model that is trained by inputting the genre of the content image 200 and the state or scene of the content image 200 as input information, and by outputting the decorative image 300 selected by the user and the display pattern of the decorative image 300 as output information. The trained model is a model trained by machine learning such as Deep Learning. The trained model is configured as a so-called neural network.

[0138] The control unit 170 inputs the genre of the content image 200 determined based on the tag information to this trained model. The control unit 170 also inputs the state and scene of the content image 200 detected from the captured image of the camera 121 and the audio data of the microphone 127 to the trained model. Identification information of the decorative image 300 and information indicating the display pattern of the decorative image 300 are output from the trained model.

[0139] The control unit 170 outputs the decorative image 300 corresponding to the identification information output from the trained model to the image processing unit 150, and causes the decorative image 300 to be combined with the content image 200. The control unit 170 also causes the image processing unit 150 to execute image processing of the decorative image 300 according to information indicating a display pattern output from the trained model.

[0140] The first condition and the second condition described in the above embodiment may be mutually exclusive, or may be mutually satisfied simultaneously. That is, one content image 200 may satisfy both the first condition and the second condition. For example, assume that the first condition indicates that the genre of the content image 200 is a movie, and the second condition indicates that the genre of the content image is an animation. In this case, the content image 200, which is an animation movie, satisfies both the first condition and the second condition. In this way, when the first condition and the second condition are satisfied simultaneously, the first condition and the second condition may be set in advance as priorities. When one content image 200 satisfies both the first condition and the second condition, the control unit 170 combines the decorative image 300 associated with the first condition or the decorative image 300 associated with the second condition with the content image 200 according to the priorities.

[0141] Furthermore, in this embodiment, the content image 200 is a moving image, but the content image 200 may be a still image.

[0142] In this embodiment, the light modulation device includes three transmissive liquid crystal panels 163, but the embodiment to which the present disclosure is applied is not limited to this. The light modulation element may be a reflective liquid crystal panel or a digital micromirror device.

[0143] 1 indicates a functional configuration, and the specific implementation form is not particularly limited. In other words, it is not necessarily necessary to implement hardware corresponding to each functional unit, and it is of course possible to implement a configuration in which one processor executes a program to realize the functions of multiple functional units. Also, some of the functions realized by software in the above embodiment may be realized by hardware, or some of the functions realized by hardware may be realized by software.

[0144] Furthermore, when the display method and the program are realized by using a computer included in the projector 100, the program executed by the computer can be configured in the form of a recording medium or a transmission medium for transmitting the program. The recording medium can be a magnetic or optical recording medium or a semiconductor memory device. Specific examples include portable or fixed recording media such as a flexible disk, a hard disk drive (HDD), a CD-ROM, a DVD, a Blu-ray Disc, a magneto-optical disk, a flash memory, and a card-type recording medium. The recording medium may also be a non-volatile storage device such as a RAM, a ROM, or a HDD, which is an internal storage device included in the server device 10. Blu-ray is a registered trademark.

[0145] 6. Summary of this Disclosure The following is a summary of this disclosure.

[0146] (Appendix 1) A display method comprising: acquiring content information indicating a content of a first image; displaying a second image arranged along a contour of the first image outside the first image when the content information meets a first condition; and displaying a third image arranged along the contour of the first image outside the first image and having a different color or pattern from the second image when the content information meets a second condition different from the first condition.

[0147] As a result, when the content information matches the first condition, the second image arranged along the contour of the first image is displayed outside the first image. Also, when the content information matches the second condition, the third image arranged along the contour of the first image is displayed outside the first image. This increases the degree of freedom of the displayed image, improving user convenience.

[0148] (Appendix 2) The display method described in Appendix 1, wherein the content information indicates a genre of the first image, the first condition is that the genre of the first image is a first genre, and the second condition is that the genre of the first image is a second genre different from the first genre.

[0149] As a result, when the content information matches the first genre, the second image arranged along the contour of the first image is displayed outside the first image. Also, when the content information matches the second genre, the third image arranged along the contour of the first image is displayed outside the first image. Therefore, the image arranged along the contour of the first image outside the first image can be changed according to the genre of the first image.

[0150] (Appendix 3) A display method as described in Appendix 1 or 2, wherein the first image is part of a video that changes over time, the content information indicates a scene of the first image in the video, the first condition is that the scene of the first image is a first scene, and the second condition is that the scene of the first image is a second scene different from the first scene.

[0151] As a result, when the scene indicated by the content information is the first scene, the second image arranged along the contour of the first image is displayed outside the first image. Also, when the scene indicated by the content information is the second scene, the third image arranged along the contour of the first image is displayed outside the first image. Therefore, the image arranged along the contour of the first image outside the first image can be changed to match the scene of the first image.

[0152] (Appendix 4) The display method of any one of Appendix 1 to 3, further including: accepting an input specifying a combination of one candidate condition out of a plurality of candidate conditions that is a candidate for the first condition and one candidate image out of a plurality of candidate images that is a candidate for the second image; and accepting an input specifying a combination of another candidate condition out of the plurality of candidate conditions that is a candidate for the second condition and another candidate image out of the plurality of candidate images that is a candidate for the third image, wherein displaying the second image is displaying the one candidate image as the second image when the content information matches the one candidate condition, and displaying the third image is displaying the other candidate image as the third image when the content information matches the other candidate condition.

[0153] As a result, by specifying a combination of a candidate condition and one candidate image, if the first image meets the specified candidate condition, the specified candidate image is displayed as the second image. Also, by specifying a combination of a candidate condition and one candidate image, if the first image meets the specified candidate condition, the specified candidate image is displayed as the second image. This increases the degree of freedom of the image to be displayed, and improves user convenience.

[0154] (Appendix 5) The display method described in Appendix 4, wherein the plurality of candidate images include at least two of a first pattern image that flashes in a first cycle, a second pattern image that changes color in a second cycle, and a third pattern image that changes lit locations in a third cycle.

[0155] This allows at least one of the first pattern image, the second pattern image, and the third pattern image to be selected as the second image, and therefore at least one of the first pattern image, the second pattern image, and the third pattern image can be selected and displayed as the second image.

[0156] (Appendix 6) The display method according to any one of Supplementary Notes 1 to 5, wherein, when the content information satisfies the first condition, a first display object having a first appearance corresponding to the first condition and indicating menu information is displayed, and when the content information satisfies the second condition, a second display object having a second appearance corresponding to the second condition and different from the first appearance and indicating the menu information is displayed.

[0157] As a result, when the content information matches the first condition, a first display object having at least one of the color, shape, and blinking pattern associated with the first condition is displayed. Also, when the content information matches the second condition, a second display object having at least one of the color, shape, and blinking pattern associated with the second condition is displayed. This increases the degree of freedom of the image to be displayed, and improves user convenience.

[0158] (Appendix 7) A display device including an optical device and at least one processor, wherein the at least one processor executes the following operations: acquiring content information indicating a content of a first image; when the content information meets a first condition, controlling the optical device to display a second image arranged outside the first image and along a contour of the first image; and when the content information meets a second condition different from the first condition, controlling the optical device to display a third image arranged outside the first image and along the contour of the first image, and having a different color or pattern from the second image, by controlling the optical device.

[0159] As a result, when the content information matches the first condition, the second image arranged along the contour of the first image is displayed outside the first image. Also, when the content information matches the second condition, the third image arranged along the contour of the first image is displayed outside the first image. This increases the degree of freedom of the displayed image, improving user convenience.

[0160] (Appendix 8) A program that causes a computer to execute the following steps: acquire content information indicating the content of a first image; if the content information meets a first condition, display a second image arranged outside the first image along a contour of the first image; and if the content information meets a second condition different from the first condition, display a third image arranged outside the first image along the contour of the first image and having a different color or pattern from the second image.

[0161] As a result, when the content information matches the first condition, the second image arranged along the contour of the first image is displayed outside the first image. Also, when the content information matches the second condition, the third image arranged along the contour of the first image is displayed outside the first image. This increases the degree of freedom of the displayed image, improving user convenience. [Explanation of symbols]

[0162] 10...server device, 30...network, 50...screen, 100...projector, 105...remote control, 110...operation unit, 115...operation signal receiving unit, 121...camera, 123...audio processing unit, 125...speaker, 127...microphone, 130...wireless communication I / F, 140...frame memory, 150...image processing unit, 155...OSD processing unit, 160...image projection unit, 161...light source, 163, 163R, 163G, 163B...liquid crystal panel, 164, 164R, 164G, 164B...image forming area, 165...projection lens, 167...panel driving unit, 170...control unit, 180...storage unit, 183...arrangement information, 185...setting data, 187...registration table, 190...processor, 200...content image, 300...decorative image, 310...placement section, 330...frame section, 400...composite image, 500...first UI image, 510...genre selection column, 511...first object, 512...second object, 513...third object, 520...selection frame, 530...image selection column, 531...first thumbnail image, 532...second thumbnail image, 533...third thumbnail image, 534...fourth thumbnail image, 535...fifth thumbnail image, 536...sixth thumbnail image, 540...selection frame, 600...second UI image, 610...genre selection column, 630...image selection column, 650...OSD image selection column, 651...first reduced image, 652...second reduced image, 653...third reduced image, 660...selection frame, 700...OSD image.

Claims

1. obtaining content information indicating a content of a first image; When the content information satisfies a first condition, displaying a second image arranged along a contour of the first image outside the first image; When the content information satisfies a second condition different from the first condition, displaying a third image arranged along a contour of the first image outside the first image and having a color or pattern different from that of the second image; Including, how to display.

2. the content information indicates a genre of the first image, the first condition is that the genre of the first image is a first genre; the second condition is that the genre of the first image is a second genre different from the first genre; The display method according to claim 1.

3. the first image is a portion of a time-varying video; the content information indicates a scene of the first image in the video; the first condition is that the scene of the first image is a first scene; the second condition is that a scene in the first image is a second scene different from the first scene; The display method according to claim 1.

4. receiving an input designating a combination of one candidate condition among a plurality of candidate conditions that are candidates for the first condition and one candidate image among a plurality of candidate images that are candidates for the second image; receiving an input specifying a combination of another candidate condition among the plurality of candidate conditions that is a candidate for the second condition and another candidate image among the plurality of candidate images that is a candidate for the third image; Further comprising: displaying the second image means, when the content information matches the one candidate condition, displaying the one candidate image as the second image; Displaying the third image is to display the other candidate image as the third image when the content information matches the other candidate condition. The display method according to any one of claims 1 to 3.

5. The plurality of candidate images include at least two of a first pattern image that flashes in a first cycle, a second pattern image that changes color in a second cycle, and a third pattern image that changes a lit location in a third cycle. The display method according to claim 4.

6. When the content information matches the first condition, displaying a first display object having a first appearance associated with the first condition and indicating menu information; when the content information satisfies the second condition, displaying a second display object that has a second appearance that is associated with the second condition and that is different from the first appearance and that indicates the menu information; The display method according to any one of claims 1 to 3.

7. An optical device; at least one processor; The at least one processor obtaining content information indicating a content of a first image; displaying a second image arranged along a contour of the first image outside the first image by controlling the optical device when the content information satisfies a first condition; When the content information satisfies a second condition different from the first condition, displaying a third image arranged along a contour of the first image outside the first image and having a color or pattern different from that of the second image by controlling the optical device; A display device that performs the above.

8. On the computer, obtaining content information indicating a content of a first image; When the content information satisfies a first condition, displaying a second image arranged along a contour of the first image outside the first image; When the content information satisfies a second condition different from the first condition, displaying a third image arranged along a contour of the first image outside the first image and having a color or pattern different from that of the second image; A program to execute.

Images