Display control unit, display control method, program, and storage medium

Abstract

To display a picked-up image and an item on a display screen while aligning their directions according to a mode of use of a display unit.SOLUTION: In displaying a picked-up image and a display item on a display screen of a display panel 128, a system control unit 250 of a digital camera 100 acquires the display item and its arrangement mode, the direction of the display screen with respect to an imaging direction, and the attitude of the display panel 128, based on them, determines the presence or absence of the necessity to invert the picked-up image and the display item in a predetermined direction and display them in order to match the directions of the picked-up image and the display item, and performs control of displaying the picked-up image and the display item on the display screen based on a result of determination.SELECTED DRAWING: Figure 8

Description

Technical Field

[0001] The present invention relates to a display control device, a display control method, a program, and a storage medium, and particularly to a technique for controlling the orientation of items displayed on a display screen according to the usage mode of a display device.

Background Art

[0002] Techniques for changing the arrangement of items displayed on a display screen according to whether the display device is in landscape or portrait orientation are known. For example, Patent Document 1 describes a technique for setting a display format of an image and determining the arrangement of setting information to be displayed on a display unit based on the set display format. Also, Patent Document 2 describes a technique for changing the area for displaying items according to whether the display screen is in landscape or portrait orientation.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, the above-mentioned Patent Documents 1 and 2 do not assume a scenario in which the display screen of the display device is facing the subject when taking images, and therefore, they do not describe any display control of captured images and items according to such a scenario. Furthermore, Patent Documents 1 and 2 assume a configuration in which the display screen is facing backward on the back of the imaging device body, and do not describe any display control of captured images and items in a configuration in which the display device is movable relative to the imaging device body and the orientation of the display screen can be changed. Moreover, Patent Document 1 discloses a technique for displaying items in the surplus area formed by arranging a rectangular captured image within a square display screen, but this technique is difficult to apply directly when the entire display screen has a rectangular shape.

[0005] The present invention aims to provide a display control device that can display captured images and items on a display screen with their orientations aligned, depending on how the display device is used. [Means for solving the problem]

[0006] The display control device according to the present invention is characterized by comprising: a first acquisition means for acquiring an image captured for display on the display screen of a first display device; a second acquisition means for acquiring display items to be displayed on the display screen and their arrangement; a first detection means for detecting the orientation of the display screen with respect to the imaging direction of the image; a second detection means for detecting the orientation of the first display device; a determination means for determining whether it is necessary to invert the image captured and the display items in a predetermined direction in order to match the orientation of the image captured and the display items, based on the arrangement of the display items, the orientation of the display screen, and the orientation of the first display device; and a control means for performing control to display the image captured and the display items on the display screen based on the determination result by the determination means. [Effects of the Invention]

[0007] According to the present invention, the orientation of the captured image and the item can be aligned and displayed on the display screen according to the usage mode of the display device. [Brief explanation of the drawing]

[0008] [Figure 1] This is a perspective view of a digital camera according to an embodiment. [Figure 2] This is a block diagram showing the schematic configuration of a digital camera and lens unit. [Figure 3] This is a diagram illustrating how the display panel is used. [Figure 4] This diagram shows the most frequently used camera orientations when taking pictures with a digital camera. [Figure 5] This figure shows an example of items displayed on the display panel. [Figure 6] This figure shows a direction conversion table for controlling the display orientation of captured images and items and displaying them on a display panel. [Figure 7] This is a flowchart of the display control based on whether the mirror display function is enabled or disabled. [Figure 8] Figure 1 shows an example of displaying captured images and display items according to the flowchart in Figure 7. [Figure 9] This diagram illustrates the movement direction of the selected item for each directional key of the directional pad in the second embodiment. [Modes for carrying out the invention]

[0009] Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. Here, an example will be described in which the display control device according to the present invention is applied to a digital camera, which is an example of an imaging device.

[0010] Figures 1(a) and 1(b) are external perspective views of the digital camera 100. Figure 1(a) is a perspective view of the digital camera 100 seen from the front at an angle, and Figure 1(b) is a perspective view of the digital camera 100 seen from the rear at an angle.

[0011] The digital camera 100 includes a display panel 128, an opening / closing hinge 131, a rotating hinge 132, a touch panel 170a, and an external display unit 143.

[0012] The display panel 128 is a display means for displaying images and various information (hereinafter referred to as "display items"). The opening / closing hinge 131 holds the display panel 128 so that it can rotate between a closed position and an open position, about a first axis of rotation parallel to the height direction of the digital camera 100 (see Figure 3(a), which will be explained later). The rotating hinge 132 holds the display panel so that it can rotate, about a second axis of rotation perpendicular to the first axis of rotation of the opening / closing hinge 131. Figure 1(b) shows the display panel 128 in the closed position and the display screen of the display panel 128 facing rearward (outward) (the same state as in Figure 3(c)). Details of the closed position, open position, first axis of rotation, and second axis of rotation will be described later.

[0013] The touch panel 170a is one of the components included in the operation unit 270 (see Figure 2). The touch panel 170a is configured to be planar and have a light transmittance that does not obstruct the display of the display panel 128, and is superimposed on the display screen (operation surface) of the display panel 128. It is an operation means for detecting touch operations on the display screen of the display panel 128.

[0014] The input coordinates for the touch panel 170a are associated with the display coordinates on the display screen of the display panel 128. This makes it possible to provide a GUI (Graphical User Interface) that makes it seem as if images, display items, and icons displayed on the display panel 128 can be directly manipulated. Any type of touch panel can be used for the touch panel 170a, including resistive, capacitive, surface acoustic wave, infrared, electromagnetic induction, image recognition, and optical sensor types. In addition, the touch panel 170a can be used with either a method that detects touch operations by contact with a finger or pen, or by proximity of a finger or pen.

[0015] The external viewfinder display unit 143 is a display means provided on the upper surface of the digital camera 100, and can display various setting values of the digital camera 100 such as shutter speed and aperture.

[0016] The digital camera 100 includes a shutter button 161, a mode switch 160, a main electronic dial 171, a power switch 172, a sub - electronic dial 173, a cross key 174, and a SET button 175. Further, the digital camera 100 includes a movie button 176, an AE lock button 177, a zoom - in button 178, a playback button 179, a menu button 181, and a multi - controller (MC) 165. These buttons, dials, etc. are included in an operation unit 270 (see FIG. 2) that receives the user's operations on the digital camera 100.

[0017] The shutter button 161 is an operation member used for shooting instructions. The mode switch 160 is an operation member mainly used for switching between the still - image shooting mode and the movie - shooting mode. The main electronic dial 171 is an operation member for changing setting values (imaging parameters) such as shutter speed and aperture by a rotation operation. The power switch 172 is an operation member for switching on / off the power of the digital camera 100. The sub - electronic dial 173 is an operation member for moving a selection frame, advancing an image, etc. by a rotation operation. The cross key 174 (4 - direction key) is configured to be able to push in each of the up, down, left, and right parts, and is an operation member that enables execution of operations corresponding to the pushed - in up, down, left, and right parts. The SET button 175 is an operation member mainly for determining a selected item by a push - in operation.

[0018] The video button 176 is an operation member for instructing the start / stop of video shooting (recording). The AE lock button 177 is an operation member for fixing the exposure state in the shooting standby state by a pressing operation. The zoom button 178 is an operation member for switching on / off the zoom mode in the live view display (hereinafter referred to as "LV display") in the shooting mode. By operating the main electronic dial 171 after turning on the zoom mode, for example, the live view image (hereinafter referred to as "LV image") can be enlarged or reduced. Also, when the playback mode is set, by operating the zoom button 178, the playback image can be enlarged while adjusting the magnification ratio.

[0019] The playback button 179 is an operation member for switching between the shooting mode and the playback mode. When the playback button 179 is pressed during the shooting mode, the mode shifts to the playback mode, and the latest image among the images stored in the storage medium 200 (see FIG. 2) can be displayed on the display panel 128. The menu button 181 is an operation member for causing various menu screens to be displayed on the display panel 128. The user can intuitively select and determine items and perform various settings on the menu screen displayed on the display panel 128 using the cross keys 174, the SET button 175, and the MC165. The MC165 can accept direction instructions in eight directions and a pushing operation of the central portion.

[0020] The digital camera 100 includes a communication terminal 110, a lens mount 111, a terminal cover 140, an eyepiece portion 116, an eyepiece cup 117, an eyepiece detection unit 157, a card cover 112, and a grip portion 190.

[0021] The communication terminal 110 is connected to the communication terminal 206 of the lens unit 210 (see Figure 2) when the lens unit 210 is attached to the digital camera 100, enabling communication between the digital camera 100 and the lens unit 210. The lens mount 111 is a part that allows the lens unit 210 (see Figure 2) to be attached to and detached. The terminal cover 140 is a component that protects the connector (not shown) provided on the digital camera 100 for connecting external equipment (not shown) to the digital camera 100.

[0022] The eyepiece section 116 is the part where the user brings their eye close to the eyepiece viewfinder, which is a type of viewfinder that you look into. The user can view the image displayed on the EVF 229 (see Figure 2) located inside the digital camera 100 through the eyepiece section 116. The eyepiece cup 117 is a component that protects the eyepiece section 116.

[0023] The eyepiece detection unit 157 is a sensor that detects the approach (eye-to-eye contact) and departure (eye-away) of an eye (object) from the eyepiece unit 116. For example, an infrared proximity sensor can be used in the eyepiece detection unit 157 to detect the approach of an object to the eyepiece unit 116. When an object approaches the eyepiece unit 116, infrared light emitted from a light-emitting unit (not shown) of the eyepiece detection unit 157 is reflected by the approaching object and received by a light-receiving unit (not shown) of the eyepiece detection unit 157. At that time, the amount of infrared light received by the light-receiving unit can be used to determine the eyepiece distance, that is, how close the approaching object is to the eyepiece unit 116.

[0024] The card cover 112 is a component that protects the slot for storing the storage medium 200 (see Figure 2). The grip portion 190 is the part that the user holds with their hand when holding the digital camera 100, and is shaped to be easy to grip with the right hand. With the digital camera 100 held by gripping the grip portion 190 with the little finger, ring finger, and middle finger of the right hand, the shutter button 161 and the main electronic dial 171 are positioned to be operated with the index finger of the right hand. In the same position, the sub electronic dial 173 is positioned to be operated with the thumb of the right hand.

[0025] Figure 2 is a block diagram showing the schematic configuration of the digital camera 100 and the lens unit 210 attached to the digital camera 100. Note that the components of the digital camera 100 described with reference to Figure 1 are denoted in Figure 2 by the same reference numerals used in Figure 1, and explanations of matters already described with reference to Figure 1 are omitted here.

[0026] The lens unit 210 is a so-called interchangeable lens. The lens unit 210 includes an aperture 201, an aperture drive circuit 202, an AF drive circuit 203, a lens system control unit 204, a lens group 205, and a communication terminal 206.

[0027] The lens group 205 is composed of multiple lenses, but in Figure 2, the multiple lenses are simplified to show as a single lens. The aperture 201 adjusts the amount of light incident on the lens group 205. The aperture drive circuit 202 drives the aperture 201. The AF drive circuit 203 focuses on the subject by moving the focus lens included in the lens group 205 in the optical axis direction. The communication terminal 206 is connected to the communication terminal 110 of the digital camera 100 when the lens unit 210 is mounted on the lens mount 111 of the digital camera 100, enabling communication between the lens system control unit 204 and the system control unit 250 described later. The lens system control unit 204 receives control signals from the system control unit 250 and controls the driving of the aperture drive circuit 202 and the AF drive circuit 203.

[0028] The digital camera 100 includes a shutter 211, an image sensor 222, an A / D converter 223, an image processing unit 224, a system control unit 250, a memory control unit 215, and a memory 232. The digital camera 100 also includes a display panel 128, an EVF 229, an external viewfinder display drive circuit 244, and an external viewfinder display unit 143.

[0029] The shutter 211 is a focal-plane shutter that controls the exposure time of the image sensor 222. The incident light that passes through the lens unit 210 forms an optical image on the imaging surface of the image sensor 222. The image sensor 222 is a photoelectric conversion device (image sensor) such as a CCD or CMOS that converts the optical image formed on the imaging surface into an analog electrical signal. The A / D converter 223 converts the analog signal output from the image sensor 222 into image data consisting of digital signals.

[0030] The image processing unit 224 performs predetermined image processing on image data output from the A / D converter 223 and image data supplied from the memory control unit 215, such as pixel interpolation, resizing (including reduction), and color conversion. The image processing unit 224 also performs predetermined calculations using the image data acquired from the A / D converter 223, and the system control unit 250 performs exposure control and distance measurement control based on the obtained calculation results. Specifically, TTL-type AF (autofocus), AE (auto exposure), and EF (flash pre-flash) processing are performed. The image processing unit 224 further performs predetermined calculations using the image data acquired from the A / D converter 223, and performs TTL-type AWB (auto white balance) processing based on the obtained calculation results.

[0031] The memory control unit 215 controls the transmission and reception of data between the A / D converter 223, the image processing unit 224, and the memory 232. Image data output from the A / D converter 223 is written to the memory 232 via the image processing unit 224 and the memory control unit 215, or via the memory control unit 215. The memory 232 stores various image data, such as image data output from the A / D converter 223, image data after image processing by the image processing unit 224, and image data for display on the display panel 128 and EVF 229, as well as various related information. The memory 232 has sufficient storage capacity to store a predetermined number of still images, a predetermined amount of moving images, and audio data.

[0032] Memory 232 also functions as video memory (image display memory). Display image data written to memory 232 is displayed as an image on the display panel 128 or EVF 229 via the memory control unit 215. The EVF 229 displays information on a display such as an LCD or organic EL display in accordance with the signal from the memory control unit 215. LV display can be performed by sequentially transferring image data output from the A / D converter 223 and stored in memory 232 to the display panel 128 or EVF 229 for display. The viewfinder external display drive circuit 244 displays various information, including shutter speed and aperture settings, on the viewfinder external display unit 143 in response to commands from the system control unit 250.

[0033] The system control unit 250 switches the display state and the EVF 229 between display and hidden states depending on the state detected by the eyepiece detection unit 157. For example, if the digital camera 100 is in shooting standby mode and the display destination setting for the LV image output from the image sensor 222 is set to automatic, the display destination is set to the display panel 128 and the EVF 229 is hidden when the eyepiece is not being used. On the other hand, when the eyepiece is being used, the display destination is set to the EVF 229 and it is displayed, while the display panel 128 is hidden.

[0034] The digital camera 100 includes a non-volatile memory 256, a system memory 252, a system timer 253, a power control unit 280, a power supply unit 230, a storage medium interface 218, a storage medium 200, and a communication unit 254.

[0035] The non-volatile memory 256 is a memory that can be electrically erased and stored, such as flash ROM. The non-volatile memory 256 stores constants for the operation of the system control unit 250 and computer programs for executing each process in the flowchart described later. The system control unit 250 is a control means consisting of at least one processor or circuit, and controls the overall operation of the digital camera 100, including each process in the flowchart described later, by executing the program stored in the non-volatile memory 256.

[0036] System memory 252, for example, uses RAM and stores constants and variables for the operation of the system control unit 250, as well as programs read from non-volatile memory 256. The system control unit 250 also controls the display by controlling memory 232 and the display panel 128, and further detects various known operations on the touch panel 170a.

[0037] The system timer 253 measures the time used for various controls and the time of the built-in clock. The power control unit 280 consists of a battery detection circuit, a DC-DC converter, a switch circuit for switching the power supply block, etc., and detects whether a battery is installed, the type of battery, and the remaining battery level. The power control unit 280 also controls the DC-DC converter based on the detection results and instructions from the system control unit 250, supplying the necessary voltage to each part, including the storage medium 200, for the required period. The power supply unit 230 consists of primary batteries such as alkaline batteries and lithium batteries, secondary batteries such as NiCd batteries, NiMH batteries, and lithium-ion batteries, and an AC adapter, etc.

[0038] The storage medium interface 218 is an interface that enables communication between the storage medium 200 and the system control unit 250. The storage medium 200 is a memory card, semiconductor memory, magnetic disk, etc., and stores image data of captured images. The communication unit 254 is connected to an external device wirelessly or via a wired cable, enabling communication and transmission of video and audio signals to and from the external device. For example, the communication unit 254 can transmit images captured by the image sensor 222 (including LV images) and images stored in the storage medium 200 to an external device, and can also receive images and other various information from an external device. Furthermore, the communication unit 254 enables connection to networks such as wireless LANs and the Internet. In addition, the communication unit 254 enables communication with external devices using Bluetooth® or Bluetooth Low Energy.

[0039] The digital camera 100 includes a housing orientation detection unit 255 and a panel orientation detection unit 265. The panel orientation detection unit 265 includes an open / close detection unit 267 and a rotation detection unit 268.

[0040] The housing is a box that houses various components that make up the digital camera 100, and in this embodiment, it can be considered as substantially the part of the digital camera 100 that does not include the display panel 128.

[0041] The housing orientation detection unit 255 detects the orientation of the housing relative to the direction of gravity. An acceleration sensor or gyroscope can be used in the housing orientation detection unit 255. It is also possible to use an acceleration sensor or gyroscope to detect the movement of the digital camera 100 (pan, tilt, lift, whether it is stationary or not, etc.).

[0042] The system control unit 250 determines, based on the orientation of the housing detected by the housing orientation detection unit 255, whether the image captured by the image sensor 222 was taken with the digital camera 100 held horizontally or vertically. The system control unit 250 can add the housing orientation information detected by the housing orientation detection unit 255 to the image file of the captured image. Furthermore, the system control unit 250 can rotate and store the image according to the housing orientation information detected by the housing orientation detection unit 255.

[0043] The open / close detection unit 267, which constitutes the panel orientation detection unit 265, is provided on the open / close hinge unit 131, and the rotation detection unit 268, which constitutes the panel orientation detection unit 265, is provided on the rotation hinge unit 132. The configuration of the open / close detection unit 267 and the rotation detection unit 268 and the state of the display panel 128 detected by these detection units will be described later with reference to Figure 3.

[0044] The digital camera 100 includes an operation unit 270 for the user to input various operation commands to the system control unit 250. Figure 2 shows only some of the components of the operation unit 270. Specific examples of buttons, switches, dials, etc. that constitute the operation unit 270 have already been explained with reference to Figure 1, so a detailed explanation is omitted here.

[0045] The following additional information is provided regarding the shutter button 161. Specifically, the shutter button 161 has a first shutter switch 262 and a second shutter switch 264. The first shutter switch 262 turns on during the operation of the shutter button 161 (so-called half-press) and generates a first shutter switch signal SW1. The system control unit 250 receives the first shutter switch signal SW1 and starts shooting preparation operations such as AF processing, AE processing, AWB processing, and EF processing. The second shutter switch 264 turns on when the operation of the shutter button 161 is completed (so-called full-press) and generates a second shutter switch signal SW2. The system control unit 250 receives the second shutter switch signal SW2 and executes a series of shooting operations from reading the signal from the image sensor 222 to writing the captured image as an image file to the storage medium 200.

[0046] Figures 3(a) to 3(d) illustrate the usage modes of the display panel 128. In other words, Figure 3 shows typical usage modes of the display panel 128 that can be attached to the housing of the digital camera 100. The system control unit 250 detects whether the housing of the digital camera 100 is oriented horizontally or vertically based on the output signal from the housing orientation detection unit 255. In all modes shown in Figures 3(a) to 3(d), the system control unit 250 detects that the digital camera 100 is oriented horizontally.

[0047] Figure 3(a) shows the state in which the display panel 128 is in the open position relative to the housing of the digital camera 100, and the display screen is facing the rear side of the housing (hereinafter referred to as "first embodiment"). Figure 3(b) shows the state in which the display panel 128 is in the open position relative to the housing of the digital camera 100, and the display screen is facing the front side (subject side) of the housing (hereinafter referred to as "second embodiment"). Figure 3(c) shows the state in which the display panel 128 is in the closed position, and the display screen is facing the rear side of the housing (hereinafter referred to as "third embodiment"). Figure 3(d) shows the state in which the display panel 128 is in the closed position, and the display screen is facing the front side of the housing (hereinafter referred to as "fourth embodiment").

[0048] The first to fourth embodiments described above define the relationship between the position and orientation of the housing and the display panel 128 in the digital camera 100. As will be described later with reference to Figure 4, in each of the first to fourth embodiments, horizontal shooting may be performed by holding the digital camera 100 horizontally to take images, or vertical shooting may be performed by holding the digital camera 100 vertically to take images.

[0049] As described above, the display panel 128 is attached to the housing via an opening / closing hinge 131 and a rotating hinge 132. The first axis of rotation of the opening / closing hinge 131 is parallel to the height direction shown in Figure 3(a), and the display panel 128 is rotatable about the first axis of rotation. In this way, the display panel 128 is movable (rotatable) between a closed position located on the rear side of the housing and an open position located on the outer right side of the housing when viewed from the front side of the digital camera 100.

[0050] The opening / closing detection unit 267 provided on the opening / closing hinge 131 is, for example, a switch that switches on / off when the display panel 128 opens by a certain angle from the closed position to the open position. In this embodiment, the opening / closing detection unit 267 has no configuration restrictions as long as it can distinguish and detect the open position in Figures 3(a) and (b) and the closed position in Figures 3(c) and (d), and may be configured with a magnetic sensor, an optical sensor, or the like.

[0051] The second axis of rotation of the rotating hinge 132 is perpendicular to the first axis of rotation. Therefore, the display panel 128 can rotate about the second axis of rotation, and can rotate between a rearward orientation, where the display screen faces the rear side of the housing of the digital camera 100, and a frontward orientation, where it faces the imaging direction, which is the front side of the housing.

[0052] The rotation detection unit 268 provided on the rotating hinge 132 is, for example, a switch that switches on / off when the display panel 128 rotates by a certain angle from the rear to the front. In this embodiment, the rotation detection unit 268 has no configuration restrictions as long as it can distinguish and detect the rear orientation shown in Figures 3(a) and (c) and the front orientation shown in Figures 3(b) and (d), and may be configured as a magnetic sensor, an optical sensor, or the like.

[0053] When the display panel 128 is in the first configuration, the four corners of the display panel are defined as corner a, corner b, corner c, and corner d, respectively, as shown in Figure 3(a). Depending on the first to fourth configurations, the positions of corners a, b, c, and d change as viewed from the back of the digital camera 100, as shown in Figure 3.

[0054] Figure 4(a) is a rear view of the digital camera 100 in horizontal shooting mode, which is frequently used when taking images with the digital camera 100. Figure 4(b) is a rear view of the digital camera 100 in vertical shooting mode, which is also frequently used when taking images with the digital camera 100. Generally, shooting with the digital camera 100 is done by horizontal shooting as shown in Figure 4(a) or vertical shooting as shown in Figure 4(b). Here, we are focusing on horizontal and vertical shooting in the first mode shown in Figure 3(a), but of course, horizontal and vertical shooting can also be done in any of the second to fourth modes shown in Figures 3(b) to (d).

[0055] As mentioned above, whether the image is being shot horizontally or vertically can be detected by the housing orientation detection unit 255, but it is not limited to this method; it can also be determined from the results of image processing of the captured image, which detects faces, structural edges, backgrounds, etc.

[0056] Figure 5 shows an example of display items shown on the display screen of the display panel 128 when the digital camera 100 is being operated. Figure 5(a) shows an example of various information being displayed as display items in a horizontal arrangement. The display panel 128 and the display screen have a rectangular shape. Horizontal arrangement refers to an arrangement of information so that the user can easily understand the displayed content when viewing the display panel 128 (display screen), which is oriented horizontally with its long sides positioned vertically.

[0057] Figure 5(b) shows an example of displaying various types of information as display items in a vertical arrangement. A vertical arrangement refers to an arrangement of information that allows users to easily understand the displayed content when viewing the display panel 128 (display screen), which is oriented vertically with its short sides positioned vertically. In Figure 5(a) and Figure 5(b), the layout of the display items showing each piece of information is different, but the same information is displayed.

[0058] Figure 5(c) shows an example of the menu screen display. In this embodiment, the menu screen is generated only in a horizontal orientation. This is because operations on the menu screen are often performed with the digital camera 100 (display panel 128) in landscape orientation, and a menu screen with the layout of the various information displayed on the menu screen changed to a vertical orientation is not generated. The display configuration of the menu screen when the digital camera 100 (display panel 128) is in portrait orientation will be described later with reference to Figure 8.

[0059] Figure 6 shows a direction conversion table for controlling the display direction of the captured image and items displayed on the display panel 128, depending on the first to fourth modes and whether the shooting is horizontal or vertical. The system control unit 250 functions as a determination means for determining whether the digital camera 100 is horizontal (shooting state) or vertical (vertical shooting state) based on the output signal from the housing orientation detection unit 255. The system control unit 250 also functions as a determination means for determining which of the first to fourth modes the housing and display panel 128 of the digital camera 100 are in based on the output signals from the opening / closing detection unit 267 and the rotation detection unit 268.

[0060] The orientation conversion table defines values ​​that indicate the display orientation of the captured image and the display items. For convenience, the horizontal and vertical writing of "aiueo" is used for the captured image, and the horizontal and vertical writing of "ABCDE" is used for the display items. The horizontal writing of "aiueo" represents the display direction as a whole and cannot be broken down into five individual characters. Similarly, the vertical writing of "aiueo" also represents the display direction as a whole and cannot be broken down into five individual characters. Furthermore, the horizontal writing of "ABCDE" represents the display direction as a whole and cannot be broken down into five individual characters, and the vertical writing of "ABCDE" also represents the display direction as a whole and cannot be broken down into five individual characters. To clarify this, in Figure 6, for convenience, the font size and character spacing are changed between the horizontal and vertical writing of "aiueo," and also between the horizontal and vertical writing of "ABCDE."

[0061] In the first configuration of the housing and display panel 128, regardless of whether the image is captured horizontally or vertically, the captured image and display items are defined to be displayed in the forward rotation on the display panel 128. The system control unit 250 uses this forward rotation display as a reference and controls the display direction of the captured image and display items in the second and third configurations by inverting them vertically or horizontally so that the user can easily understand the content.

[0062] In the second and third embodiments, whether the forward-rotating image is displayed as is or flipped vertically and horizontally is shown in Figure 6. In the fourth embodiment, the display screen of the display panel 128 faces the housing and the user cannot see the display screen, so the display panel 128 is hidden to save power.

[0063] The determination of whether to display the captured image and display items in the normal orientation or inverted horizontally and vertically is performed as follows. Specifically, the system control unit 250 detects which of the first to third orientations the display panel 128 is in with respect to the housing, and also detects whether the digital camera 100 (its housing) is in a horizontal (landscape) or vertical (portrait) orientation. Based on these detection results, the system control unit 250 determines which of the eight states the display panel 128 is in, depending on whether it is in the closed or open position, facing forward or backward, and in a vertical or landscape orientation.

[0064] The system control unit 250 determines whether it is necessary to invert the captured image and the display item in a predetermined direction so that their respective top edges align with the top edge of the display panel 128. Based on this determination, the system control unit 250 performs forward rotation and inversion in a predetermined direction for the captured image and the display item, as shown in Figure 6. By performing this display control, it is possible to prevent situations where the orientation of the captured image and the display item does not match when they are displayed on the display panel 128 simultaneously.

[0065] Specific examples of the captured image and displayed items are shown in detail in Figure 8, which will be described later. The display modes of the menu screen will also be described later with reference to Figure 8. The values ​​in the orientation conversion table in Figure 6 are examples and can be changed. In the orientation conversion table in Figure 6, predetermined values ​​can be set for cases where the orientation of the display panel 128 is different from the first to third modes, or for orientations other than horizontal or vertical of the housing.

[0066] Next, the display control of captured images and display items when the digital camera 100 has a mirror display function will be described. The mirror display function is a function that displays the captured image as a mirrored image, with the image flipped horizontally as if reflected in a mirror. In this embodiment, the mirror display function can be enabled or disabled by operating the operation unit 270 while the menu screen is displayed on the display panel 128.

[0067] Even when the mirror display function is enabled, it is disabled in the first, third, and fourth embodiments of the display panel 128 and the housing, and is only enabled in the second embodiment. The system control unit 250 checks whether the mirror display function is enabled or disabled when displaying captured images or display items on the display panel 128, and controls the display of captured images, display items, and menu screens in the second embodiment based on the confirmation result.

[0068] Figure 7 is a flowchart of the display control of captured images and display items according to whether the mirror display function is enabled or disabled. The processes (steps) indicated by the number S in Figure 7 are realized by the system control unit 250 loading a predetermined program read from the non-volatile memory 256 into the system memory 252 and comprehensively controlling the operation of each part of the digital camera 100.

[0069] In S701, the system control unit 250 detects the usage mode of the display panel 128 (which of the first to fourth modes it is in). In S702, the system control unit 250 determines whether the usage mode of the display panel 128 detected in S701 is the second mode. If the system control unit 250 determines that it is the second mode (YES in S702), it proceeds to S703.

[0070] In S703, the system control unit 250 detects the orientation of the digital camera 100 (housing). In other words, S703 detects whether the camera is shooting horizontally (landscape orientation) or vertically (portrait orientation). In S704, the system control unit 250 determines whether or not it was detected in S703 that the digital camera 100 is in a landscape orientation. If the system control unit 250 determines that the digital camera 100 is in a landscape orientation (YES in S704), it proceeds to S705. In S705, the system control unit 250 branches the processing depending on whether the display target is an captured image or a display item.

[0071] In S705, the system control unit 250 proceeds to S706 if the display target is an captured image. In S706, the system control unit 250 determines whether the mirror display function is enabled or disabled. If the system control unit 250 determines that the mirror display function is enabled (YES in S706), it proceeds to S707; if it determines that the mirror display function is disabled (NO in S706), it proceeds to S708.

[0072] In S707, the system control unit 250 displays the captured image upside down, and then terminates the process. In S708, the system control unit 250 displays the captured image upside down and leftside down, and then terminates the process.

[0073] In S705, the system control unit 250 proceeds to S709 if the display target is a display item. In S709, regardless of whether the mirror display function is enabled or disabled, the display item is flipped vertically and horizontally, and then the process is terminated.

[0074] In S704, if the system control unit 250 determines that the digital camera 100 is in a vertical orientation (NO in S704), it proceeds to S710. In S710, the system control unit 250 branches the processing depending on whether the display target is an captured image or a display item.

[0075] In S710, the system control unit 250 proceeds to S711 if the display target is an captured image. In S711, the system control unit 250 determines whether the mirror display function is enabled or disabled. If the system control unit 250 determines that the mirror display function is enabled (YES in S711), it proceeds to S712; if it determines that the mirror display function is disabled (NO in S711), it proceeds to S713.

[0076] In S712, the system control unit 250 displays the captured image upside down, and then terminates the process. In S713, the system control unit 250 displays the captured image in the normal orientation, and then terminates the process.

[0077] In S710, if the display target is a display item, the system control unit 250 proceeds to S714. In S714, regardless of whether the mirror display function is enabled or disabled, the display item is displayed in the forward direction, and then the process is terminated.

[0078] In S702, if the system control unit 250 determines that the usage mode of the display panel 128 is not the second mode (but is one of the first, third, or fourth modes) (NO in S702), the process proceeds to S715. In S715, since the mirror display function is disabled, the captured image and display items are displayed on the display panel 128 according to the display direction table shown in Figure 6, and then the process is terminated.

[0079] Furthermore, if the shutter button 161 is pressed while display control is being performed according to the flowchart in Figure 7, the imaging process will start. Specifically, when the first shutter switch 262 is turned on, shooting preparation processes such as AF, AE, and AWB are performed at the displayed position of the AF frame. When the second shutter switch 264 is turned on, a series of shooting processes are performed until the captured image is recorded as an image file on the storage medium 200.

[0080] Figure 8 shows examples of the display of captured images and display items according to the flowchart in Figure 7. Note that Figure 8 shows display examples for each of the first to fourth embodiments, from the perspective of complementing the display direction table in Figure 6 and the display control in S715.

[0081] In Figure 8, the display example of the display item in the first mode and when photographed horizontally shows the same display state as in Figure 5(a) (a scaled-down version of Figure 5(a)). Also in Figure 8, the display example of the display item in the first mode and when photographed vertically shows the same display state as in Figure 5(b) (a scaled-down version of Figure 5(b)).

[0082] As shown in Figure 8, the display control prevents situations where the orientation of the captured image and the displayed item does not match when the captured image and the displayed item are displayed simultaneously on the display panel 128, even when a mirror display function is available.

[0083] Figure 8 shows an example of the menu screen display when the digital camera 100 is held vertically. As mentioned above, the menu screen is only displayed in a horizontal orientation. Therefore, although not shown, when the digital camera 100 is held horizontally, the display control of the menu screen is performed in the same way as the display control of the display items, and a user facing the display panel 128 can always view it in the state shown in Figure 5(c).

[0084] In the first embodiment, suppose the digital camera 100 is rotated 90° vertically from a horizontal position with the menu screen displayed on the display panel 128 as shown in Figure 5(c). In this case, the display state of the menu screen on the display panel 128 does not change. In other words, when the display panel 128 is rotated around an axis perpendicular to the display screen of the display panel 128, the display state of the menu screen is maintained regardless of the rotation angle of the display panel 128. Therefore, a user facing the display panel 128 will see the menu screen as shown in Figure 5(c), rotated in accordance with the rotation direction of the digital camera 100 (display panel 128), and this is the correct rotation display of the menu screen in vertical orientation.

[0085] The system control unit 250 then controls the horizontally oriented menu screen to display inverted vertically and horizontally, regardless of whether the mirror display function is enabled or disabled, in the second state. In other words, even if the mirror display function is enabled, it does not apply to the display control of the menu screen. In the third state as well, the menu screen is controlled to display inverted vertically and horizontally. In other words, in the second and third states, even if the display panel 128 changes from horizontal to vertical orientation, the display state of the menu screen is maintained in the state when the display panel 128 is horizontal. This makes it possible for the user to easily grasp the contents of the menu screen regardless of the orientation of the digital camera 100.

[0086] Furthermore, if the digital camera 100 has a display means other than the display panel 128, and the orientation of the display screen differs between the display panel 128 and the other display means, different inversion processes may be performed for the display panel 128 and the other display means. For example, this can occur if the display panel 128 is in the second mode, but the other display means is in the first mode. This resolves the problem of different display orientations for items in the display panel 128 and the other display means. Examples of other display means include the EVF 229, and external monitors connected via external video outputs such as HDMI® or SDI.

[0087] The usage mode of the EVF229 can be considered to correspond to either the first or third mode of the display panel 128, and which mode it is considered to correspond to can be predetermined in the digital camera 100 by default settings or user settings. Similarly, the usage mode of the external monitor can generally be considered to correspond to either the first or third mode, and which mode it is considered to correspond to can be predetermined in the digital camera 100 by default settings or user settings. The system control unit 250 exclusively controls the display between the display panel 128 and other display means according to the usage mode.

[0088] Next, the relationship between the movement of selected items on the display panel 128 and the four directional control keys of the cross key 174 located on the back of the digital camera 100 will be explained when using the second embodiment. Examples of selected items include items selected on the menu screen and cursors displayed on the OSD.

[0089] When using the digital camera 100 in the second embodiment, it is necessary to prevent the selected item from moving in the opposite direction to the direction specified by the directional pad 174 when moving the selected item by operating the directional pad 174. Therefore, the system control unit 250 controls the relationship between the movement direction of the selected item and each directional key of the directional pad 174 as follows.

[0090] Figure 9 illustrates the movement direction of the selected item for each directional key of the directional pad 174 in the second embodiment. The directional pad 174 has an up directional key 901, a right directional key 902, a down directional key 903, and a left directional key 904. Note that in the first and third embodiments, the operation direction of each directional key of the directional pad 174 coincides with the movement direction of the selected item, so that explanation is omitted.

[0091] First, let's explain the case where the display items are arranged horizontally. When the directional keys 174 are viewed from the back of the digital camera 100, the up-direction key 901 points upward. In the second embodiment, compared to the first embodiment, the top and bottom of the display panel 128 are inverted, and the display items are also inverted in the vertical direction. Therefore, in the first embodiment, the up-direction key 901 moves the selected item from the bottom to the top of the screen, and in the second embodiment, the up-direction key 901 also moves the selected item from the bottom to the top of the screen. The same applies to the down-direction key 903. In other words, with respect to the vertical direction, the directions indicated by the up-direction key 901 and the down-direction key 903 coincide with the movement direction of the selected item displayed on the display panel 128. Therefore, the system control unit 250 controls the operation of the up-direction key 901 to move the selected item upward, and the operation of the down-direction key 903 to move the selected item downward.

[0092] In contrast, the right-direction key 902 points to the right when the directional keys 174 are viewed directly. In the second embodiment, compared to the first embodiment, the display panel 128 is inverted vertically but not horizontally, and the displayed items are inverted horizontally. Therefore, in the first embodiment, the right-direction key 902 moves the selected item from the left to the right of the screen, but in the second embodiment, the right-direction key 902 moves the selected item from the left to the right of the screen. The same applies to the left-direction key 904. In other words, with respect to the left and right directions, the directions indicated by the right-direction key 902 and the left-direction key 904 are reversed from the direction of movement of the selected item displayed on the display panel 128. Therefore, the system control unit 250 controls the operation of the right-direction key 902 to move the selected item to the left, and the operation of the left-direction key 904 to move the selected item to the right.

[0093] Next, we will explain the case where the displayed items are arranged vertically. When switching from horizontal to vertical shooting, the up arrow key 901, right arrow key 902, down arrow key 903, and left arrow key 904 used in horizontal shooting change to the right arrow key 901a, down arrow key 902a, left arrow key 903a, and up arrow key 904a, respectively, in vertical shooting.

[0094] The basic control method when the display items are arranged vertically is the same as when the display items are displayed horizontally. That is, in the left-right direction, the directions indicated by the right-arrow key 901a and the left-arrow key 903a are reversed from the direction of movement of the selected item displayed on the display panel 128. Therefore, the system control unit 250 controls the operation of the right-arrow key 901a to move the selected item to the left, and the operation of the left-arrow key 903a to move the selected item to the right. On the other hand, in the up-down direction, the directions indicated by the up-arrow key 904a and the down-arrow key 902a coincide with the direction of movement of the selected item displayed on the display panel 128. Therefore, the system control unit 250 controls the operation of the up-arrow key 904a to move the selected item upward, and the operation of the down-arrow key 902a to move the selected item downward. By implementing this type of control, it is possible to prevent the selected item from moving in the opposite direction to the direction indicated by each directional key on the 174-directional pad, thereby improving usability (enhancing user experience).

[0095] Although the present invention has been described in detail above based on its preferred embodiments, the present invention is not limited to these specific embodiments, and various forms that do not depart from the spirit of the invention are also included in the present invention. Furthermore, each of the embodiments described above is merely one embodiment of the present invention, and it is possible to combine each embodiment as appropriate.

[0096] For example, in the above embodiment, display control was described as being performed by the system control unit, but various controls may be performed by a single piece of hardware, or display control may be performed by multiple pieces of hardware (for example, multiple processors or circuits) sharing the processing.

[0097] Furthermore, although the above embodiment described the display control device according to the present invention applied to a digital camera, the present invention is not limited to digital cameras and can be applied to the control of electronic devices that frequently change the orientation of their display screens. For example, the present invention can be applied to the control of electronic devices such as smartphones, tablet PCs, mobile phone terminals, PDAs, portable image viewers, digital photo frames, music players, game consoles, and e-book readers.

[0098] The display control device according to the present invention does not necessarily need to be mounted on a device equipped with a display device, and can be applied to a control device capable of controlling image display (item display) on the display device using wired or wireless communication. Examples of such control devices include smartphones, tablet PCs, laptop PCs, and desktop PCs. In this case, the device equipped with a display device can be remotely controlled by notifying the device equipped with a display device of commands to perform various operations and settings based on operations and processing performed by the control device. As an example, the control device acquires an LV image from an imaging means and attitude information from the display device, and transmits image display data to the display device via wired or wireless communication, adjusting the orientation of the LV image to be displayed on the display device according to the acquired attitude information. This makes it possible to match the orientation of the display screen with the orientation of the image or item displayed on it.

[0099] The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions. [Explanation of Symbols]

[0100] 100 Digital Cameras 128 Display Panel 210 Lens Unit 222 Imaging element 250 System Control Unit 255 Housing orientation detection unit 265 Panel orientation detection unit 267 Open / Close Detection Unit 268 Rotation detection unit

Claims

1. a first acquisition means for acquiring a captured image to be displayed on a display screen of a first display device; A second acquisition means for acquiring display items to be displayed on the display screen and their layout patterns; a first detection means for detecting a direction of the display screen relative to an imaging direction of the captured image; A second detection means for detecting an attitude of the first display device; a control means for controlling the display of the captured image and / or the display items in a reversed manner in a predetermined direction on the display screen in order to match the orientation of the captured image and the display items based on the arrangement of the display items, the orientation of the display screen, and the attitude of the first display device.

2. The control means when the first display device is in a first position, the captured image and the display items are displayed in the same inverted manner when the display screen is in a first orientation and when the display screen is in a second orientation; The display control device according to claim 1, characterized in that when the attitude of the first display device is the second attitude, the captured image and the display items are displayed in different inverted manner when the orientation of the display screen is the first orientation and when it is the second orientation.

3. A setting means for setting a mirror image display in which the captured image is displayed as a mirror image on the display screen, When the mirror image display is not set, the control means when the attitude of the first display device is the first attitude, the captured image and the display items are displayed in the same inverted manner when the orientation of the display screen is the first orientation and when the orientation of the display screen is the second orientation; The display control device according to claim 2, characterized in that when the attitude of the first display device is the second attitude, the captured image and the display items are displayed in different inverted states depending on whether the orientation of the display screen is the first orientation or the second orientation.

4. The display control device described in Claim 3, characterized in that when the mirror image display is set and the attitude of the first display device is the second attitude, the control means performs different inversion displays of the captured image and the display items when the orientation of the display screen is the first orientation and when it is the second orientation.

5. The display control device is an imaging device including an imaging unit and the first display device, The captured image is captured by the imaging unit, the second detection means detects whether the orientation of the imaging device is landscape or portrait; the first attitude is a landscape attitude of the imaging device, The display control device according to claim 2 , wherein the second orientation is a portrait orientation of the imaging device.

6. The first display device is rotatable about a first rotation axis with respect to a housing that houses the imaging unit between a closed position on the rear side of the housing and an open position on the outer side of the housing, and is equipped so that the orientation of the display screen can be rotated between the imaging direction of the imaging unit and the opposite direction about a second rotation axis that is perpendicular to the first rotation axis; the first detection means detects a rotation state of the first display device with respect to the housing; The display control device according to claim 5, characterized in that in the first orientation, the first display device is in the open position and faces the imaging direction, and in the second orientation, the first display device is in the closed position and faces the direction opposite to the imaging direction.

7. a setting unit for setting the captured image and the display item to be displayed as mirror images on the display screen, The display control device according to any one of claims 1 to 6, characterized in that the control means enables the setting when the orientation of the display screen is the same as the imaging direction, and even when the setting is enabled, controls the orientation in which the display items are displayed to be the same as the orientation in which the display items are displayed when the setting is disabled.

8. The display control device according to any one of claims 1 to 7, characterized in that when the first display device is rotated around an axis perpendicular to the display screen, the control means maintains the display state of the menu screen regardless of the rotation angle of the first display device.

9. the display items include selection items that are movably displayed on the display screen; The display control device according to any one of claims 1 to 8, characterized in that the control means controls the movement direction of the selected item to match the operation direction of an operating means for moving the selected item based on the orientation of the display screen and the attitude of the first display device.

10. the display screen has a rectangular shape; The display control device according to any one of claims 1 to 9, characterized in that the second acquisition means acquires whether the arrangement of the display items is a horizontal arrangement with the long sides of the display screen facing up and down or a vertical arrangement with the short sides of the display screen facing up and down, and the second detection means detects whether the orientation of the first display device is a horizontal orientation with the long sides of the display screen facing up and down or a vertical orientation with the short sides of the display screen facing up and down.

11. When the captured image and the display item are displayed on the display screen of the second display device in addition to the display screen of the first display device, 11. The display control device according to claim 1, wherein the control means performs display control similar to display control for the first display device exclusively for the first display device.

12. acquiring a captured image to be displayed on a display screen of a display device; acquiring an arrangement of display items to be displayed on the display screen; detecting an orientation of the display screen relative to an imaging direction of the captured image; detecting the attitude of the display device; a step of controlling the display of the captured image and / or the display items on the display screen in a reversed manner in a predetermined direction in order to match the orientation of the captured image and the display items based on the acquired arrangement state of the display items, the detected orientation of the display screen, and the detected attitude of the display device.

13. A program for causing a computer to function as each of the means of the display control device according to any one of claims 1 to 11.

14. A computer-readable storage medium storing a program for causing a computer to function as each of the means of the display control device according to any one of claims 1 to 11.

Images