Information processing apparatus and control method

Abstract

This invention relates to an information processing apparatus and a control method. In a configuration where a camera on the rear side of a display captures light transmitted through the screen area of ​​the display, the display is appropriately controlled. The information processing apparatus includes a display having a screen area with a plurality of pixels arranged thereon, and a camera positioned on the rear side of the display that captures images based on light incident through the display. The display displays a image based on display data by controlling the emission of light from the plurality of pixels of the display based on display data. Furthermore, the information processing apparatus stops the emission of pixels in a first area of ​​the screen area corresponding to the position where the camera is located and controls them to be non-displaying. When the operation position within the screen area is in the first area, a display image based on display data corresponding to the first area is displayed in any area of ​​the screen area.

Description

Technical Field

[0001] This invention relates to an information processing apparatus and a control method. Background Technology

[0002] In recent years, under-display camera (or under-display camera) technology has emerged in smartphones and other devices, where a camera (e.g., a front-facing camera) is positioned on the back (bottom) side of the display. For example, Patent Document 1 discloses a technique where the materials used for the electrodes, etc., of each pixel in an OLED (Organic Light Emitting Diode) are light-transmitting materials, allowing a camera positioned below the display to capture light passing through the screen area of ​​the display. By using this technique of positioning the camera on the back (bottom) side of the display, it is possible to suppress the increase in device size while increasing the screen size of the display.

[0003] Patent Document 1: Japanese Patent Publication No. 2021-529411

[0004] When using a camera on the back of a monitor to capture light passing through the screen area, if some pixels in the screen area corresponding to the camera's viewing angle (hereinafter referred to as the "camera area") emit light, it will affect the captured image. Therefore, to improve image quality, a method is considered to at least stop the pixels in the camera area from emitting light and control it to be non-displayed (display off). However, if the camera area is non-displayed when the user is using the monitor to display various content, there may be undesirable situations. For example, when the camera area is non-displayed, if operation buttons, text boxes, etc., are located in the camera area, some or all of them will not be displayed, which may lead to user operation errors. Summary of the Invention

[0005] The present invention was made in view of the above circumstances, and one of its objects is to provide an information processing apparatus and control method for appropriately controlling the display of a screen in a structure that uses a camera on the rear side of the screen to capture light passing through the screen area of ​​the screen.

[0006] The present invention was made to solve the aforementioned problems. The information processing apparatus according to a first aspect of the present invention includes: a display having a screen area with a plurality of pixels arranged thereon; a camera disposed on the rear side of the display for taking pictures based on light incident through the display; a memory temporarily storing display data for displaying on the display; and a processor that controls the illumination of the plurality of pixels of the display based on the display data stored in the memory, thereby causing the display to display a display image based on the display data. The processor performs display stop processing, operation position detection processing, and display recovery processing. Specifically, the display stop processing stops the illumination of pixels in a first area of ​​the screen area of ​​the display corresponding to the location of the camera and controls them to be non-displaying; the operation position detection processing detects an operation position within the screen area of ​​the display; and the display recovery processing, if the operation position detected by the operation position detection processing is within the first area, displays a display image based on the display data corresponding to the first area in any area of ​​the screen area of ​​the display.

[0007] The information processing apparatus described above can also be configured such that, during the display stop processing, when the camera is functioning, the processor stops the light emission of the pixels in the first region and controls it to be non-displaying.

[0008] In the aforementioned information processing apparatus, if, during the aforementioned display restoration process, the operation position detected by the aforementioned operation position detection process is within the aforementioned first region, the processor controls the emission of pixels in the aforementioned first region to display a display image based on the display data corresponding to the aforementioned first region.

[0009] In the aforementioned information processing device, the processor may also be configured to prevent the execution of the display restoration process based on the operating state of the camera.

[0010] In the aforementioned information processing apparatus, the processor may also be configured such that, when displaying a display image based on display data corresponding to the first region by controlling the light emission of the pixels in the first region through the display restoration process, the processor reduces the light emission of the pixels in the first region according to the operating state of the camera.

[0011] The information processing apparatus described above may also be configured such that the processor allows or disables the execution of the display restoration process according to the user's instructions.

[0012] In the aforementioned information processing apparatus, if, during the aforementioned display restoration process, the operation position detected by the aforementioned operation position detection process is within the aforementioned first area, the processor causes the display image based on the display data corresponding to the aforementioned first area to be displayed in an area outside the aforementioned first area of ​​the display's screen area.

[0013] In the aforementioned information processing apparatus, the processor may also perform magnified display when, during the display restoration process, a display image based on the display data corresponding to the first region is displayed in an area outside the first region of the screen area of ​​the display.

[0014] The information processing apparatus described above may also be configured such that the processor allows or disables the execution of the display restoration process according to the user's instructions.

[0015] The information processing apparatus described above may also be configured such that, during the display restoration process, if the operation position detected by the operation position detection process is within the first region, the processor selectively switches between: a first display restoration process that controls the emission of pixels in the first region to display a display image based on the display data corresponding to the first region, and a second display restoration process that displays a display image based on the display data corresponding to the first region in a region other than the first region of the display's screen area.

[0016] The information processing device described above can also be configured such that the processor switches between the first display recovery process and the second display recovery process based on the operating state of the camera.

[0017] The information processing apparatus described above may also be configured such that the processor switches between the first display recovery process and the second display recovery process according to the user's instructions.

[0018] Furthermore, the control method in the information processing apparatus according to the second aspect of the present invention includes a display having a screen area with a plurality of pixels arranged therein, a camera disposed on the back side of the display and taking pictures based on light incident through the display, a memory temporarily storing display data for displaying the display, and a processor that controls the light emission of a plurality of pixels of the display based on the display data stored in the memory, thereby causing the display to display a display image based on the display data. The control method includes: the processor stopping the light emission of pixels in a first area of ​​the screen area of ​​the display corresponding to the position where the camera is disposed and controlling it to be non-displaying; the processor detecting an operation position in the screen area of ​​the display; and when the detected operation position is in the first area, the processor displaying a display image based on the display data corresponding to the first area in any area of ​​the screen area of ​​the display.

[0019] According to the above-described method of the present invention, the display of the monitor can be appropriately controlled in a structure in which the light passing through the screen area of ​​the monitor is captured by a camera on the back side of the monitor. Attached Figure Description

[0020] Figure 1 This is an exterior view showing an example of the schematic structure of the information processing apparatus according to the first embodiment.

[0021] Figure 2 This is an exterior view of an example of a schematic structure of the information processing apparatus according to the first embodiment when the camera is turned off.

[0022] Figure 3 This diagram illustrates a display example when the camera area according to the first embodiment is not displayed.

[0023] Figure 4 This is an explanatory diagram illustrating an example of the restoration of the display of the camera area according to the first embodiment.

[0024] Figure 5 This is a block diagram illustrating an example of the hardware structure of the information processing apparatus according to the first embodiment.

[0025] Figure 6 This is a block diagram illustrating an example of the functional structure of the information processing apparatus according to the first embodiment.

[0026] Figure 7 This is a flowchart illustrating an example of the camera area display control processing according to the first embodiment.

[0027] Figure 8This is a flowchart illustrating an example of the camera area display restoration process according to the first embodiment.

[0028] Figure 9 This is a flowchart illustrating an example of the camera area display restoration process according to the second embodiment.

[0029] Figure 10 This is a flowchart illustrating an example of the camera area display restoration process according to the third embodiment.

[0030] Figure 11 This is an explanatory diagram illustrating an example of the restoration of the display of the camera area according to the fourth embodiment.

[0031] Figure 12 This is a flowchart illustrating the first example of the camera area display restoration process according to the fourth embodiment.

[0032] Figure 13 This is a flowchart illustrating a second example of the camera area display restoration process according to the fourth embodiment.

[0033] Figure 14 This is a flowchart illustrating the first example of the camera area display restoration process according to the fifth embodiment.

[0034] Figure 15 This is a flowchart illustrating a second example of the camera area display restoration process according to the fifth embodiment.

[0035] Explanation of reference numerals in the attached figures

[0036] 1…Information processing device; 10…System processing unit; 11…Communication unit; 12…Storage unit; 13…USB connector; 14…Display; 15…Camera; 20…EC; 21…Acceleration sensor; 22…Power button; 30…Input device; 31…Keyboard; 32…Touchpad; 40…Power supply unit; 101…CPU; 102…GPU; 103…Memory controller; 104…I / O controller; 105…System memory; 110…Camera area display control unit; 111…Operation position detection unit; 112…Display stop processing unit; 113…Display resume processing unit. Detailed Implementation

[0037] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

[0038] <First Implementation>

[0039] [summary]

[0040] First, an overview of the information processing apparatus according to the first embodiment will be described.

[0041] Figure 1 This is an external view showing an example of the schematic structure of the information processing apparatus according to this embodiment.

[0042] The information processing device 1 shown in the figure is, for example, a notebook (clamshell) PC (Personal Computer). The information processing device 1 comprises a display 14, a camera 15, a keyboard 31, and a touchpad 32. The keyboard 31 and touchpad 32 are input devices that accept user input.

[0043] Display 14 is an organic EL display (Organic Electroluminescence Display) with multiple pixels arranged based on OLED (Organic Light Emitting Diode). Each pixel of display 14 is composed of a light-emitting part (not shown), electrodes such as an anode and a cathode, and a substrate. The light-emitting part is, for example, a red-emitting OLED, a blue-emitting OLED, or a green-emitting OLED. The electrodes are made of ITO (Indium Tin Oxide) or other materials with good light transmittance. The substrate is a glass substrate or a polyimide substrate, etc. Thus, each pixel of display 14 is composed of a light-transmitting material.

[0044] The camera 15 is positioned on the rear side (rear side) of the display 14, facing the direction of the display 14. That is, the camera 15 captures images based on light incident through the display 14 (light from the display surface side of the display 14). For example, the camera 15 is configured to include a lens (not shown) and an image sensor, and captures images at a viewing angle determined by the specifications of the lens and the image sensor.

[0045] Here, when camera 15 is ON (i.e., when camera 15 is functioning), the display on monitor 14 (pixel illumination) has no effect on the image captured by camera 15. Specifically, as shown in the figure... Figure 1 As shown, it is necessary to stop the light emission of pixels in the portion of the screen area DA of the display 14 that corresponds to the viewing angle of the camera 15, and turn off the display (non-display). The camera area CA is set to be the same as or slightly wider than the viewing angle of the camera 15. This suppresses the reflection of the display (pixel emission) of the display 14 onto the captured image of the camera 15, improving the image quality.

[0046] On the other hand, when camera 15 is off (i.e., when the camera 15 is not functioning), there is no need to worry about the impact on the images captured by camera 15. Therefore, as Figure 2As shown, the camera area CA is also displayed, and the image is displayed in the entire screen area DA of the display 14. Figure 2 This is an example of an external view showing a schematic structure of the information processing apparatus according to this embodiment when the camera 15 is turned off.

[0047] Thus, when the camera 15 is ON, the information processing device 1 controls the camera area CA to be non-displayed, and displays the image in the screen area DA of the display 14 other than the camera area CA. On the other hand, when the camera 15 is OFF, the camera area CA is also displayed, and the image is displayed in the entire screen area DA of the display 14.

[0048] Figure 3 This diagram illustrates a display example when the camera area CA according to this embodiment is not displayed. Figure 3 The range indicated by reference numeral DS in the attached drawing of the display 14 of the information processing device 1 (A) is within Figure 3 It is shown enlarged in (B). Figure 3 As shown in (B), the application's window W is displayed on monitor 14. Figure 3 As shown in (C), the area indicated by the reference WS in the attached diagram of window W actually contains the display data of the user's operation objects (operation buttons, etc.), but as... Figure 3 As shown in (B), when displayed on the monitor 14, the camera area CA is not displayed; nothing is shown. That is, no display image based on the display data corresponding to the camera area CA is displayed. Therefore, if the user operates on operation buttons or other objects that are not displayed in the camera area CA, the operation is performed without seeing the object being operated on, which may lead to operational errors.

[0049] Therefore, when the user's operating position is within the camera area CA, the information processing device 1 according to this embodiment displays a display image based on display data corresponding to the camera area CA in any area of ​​the screen area DA of the display 14. For example, when the user's operating position is within the camera area CA, the information processing device 1 restores the display of the camera area CA, which is controlled to be non-displayable. That is, the information processing device 1 displays a display image based on display data corresponding to the camera area CA in the camera area CA in the same way when the camera 15 is turned off.

[0050] Figure 4 This is an explanatory diagram illustrating an example of the restoration of the display of the camera area CA according to this embodiment. Figure 4 (A) indicates that it is related to Figure 3 The same state as (B). For example... Figure 4As shown in (A), the application window W is displayed on monitor 14, but a portion of the camera area CA is not displayed. If the cursor P, representing the user's position, enters the camera area CA, then... Figure 4 As shown in (B), the display of the camera area CA, which was previously controlled to be non-displayable, is restored, and the display image in window W, based on the display data corresponding to the camera area CA, is displayed in the camera area CA. Therefore, even if a portion of the camera area CA is controlled to be non-displayable, if the user moves their operation position into the camera area CA, the display of the camera area CA is restored, allowing the user to observe the object being operated on while performing the operation. The structure and processing of this embodiment will be described in detail below.

[0051] [Hardware Structure of Information Processing Device]

[0052] Figure 5 This is a block diagram illustrating an example of the hardware structure of the information processing apparatus 1 according to this embodiment. Figure 5 In the middle, to and Figure 1 The corresponding structural elements of each part are labeled with the same reference numerals. The information processing device 1 is configured to include: a system processing unit 10, a communication unit 11, a storage unit 12, a USB connector 13, a display 14, a camera 15, an EC (Embedded Controller) 20, an accelerometer 21, a power button 22, an input device 30, and a power supply unit 40.

[0053] The system processing unit 10 is configured to include: a CPU (Central Processing Unit) 101, a GPU (Graphics Processing Unit) 102, a memory controller 103, an I / O (Input-Output) controller 104, and system memory 105. Through OS (Operating System) based system processing, it is able to execute various application programs on the OS. Sometimes, the CPU 101 and GPU 102 are referred to as processors.

[0054] CPU101 performs OS-based processing, as well as processing of programs such as drivers, services, and applications that operate on the OS.

[0055] GPU 102 is connected to display 14. GPU 102 performs image processing and generates display data under the control of CPU 101. GPU 102 outputs the generated display data to display 14, so that display 14 displays a display image based on the display data. In addition, CPU 101 and GPU 102 can be integrated into a single core, or they can be formed as separate cores.

[0056] The memory controller 103 controls the reading and writing of data from the system memory 105, storage unit 12, etc., through the control of the CPU 101 and GPU 102, etc.

[0057] I / O controller 104 controls the input and output of data from communication unit 11, USB connector 13, display 14, camera 15 and EC20.

[0058] The system memory 105 is configured to include RAM (Random Access Memory) and is used as a reading area for executing programs and a writing area for processing data. In addition, the system memory 105 temporarily stores image data of images captured by the camera 15, display data generated by the GPU 102 for display on the display 14, etc.

[0059] In addition, the system processing unit 10 can be a packaged unit as a SOC (System on a chip), or it can be configured with some of its functions as a chipset or other components such as a sensor hub.

[0060] The communication unit 11 can be communicatively connected to other devices via a wireless or wired communication network to transmit and receive various types of data. For example, the communication unit 11 is configured to include a wired LAN interface such as Ethernet (registered trademark) and a wireless LAN interface such as Wi-Fi (registered trademark). In addition, the communication unit 11 is configured to include a short-range wireless communication interface such as Bluetooth (registered trademark).

[0061] The storage unit 12 is configured to include storage media such as HDD (Hard Disk Drive), SDD (Solid State Drive), ROM (Read Only Memory), and flash ROM. The storage unit 12 stores various programs such as the operating system, device drivers, and applications, as well as various data obtained through the actions of these programs.

[0062] USB connector 13 is a connector used to connect to peripheral devices that utilize USB (Universal Serial Bus). For example, USB connector 13 connects to external keyboards, mice, etc. via a USB cable.

[0063] The display 14 displays a display image based on display data generated by system processing performed by the system processing unit 10 and the processing of application programs that operate on the system processing.

[0064] For reference Figure 1As described above, the camera 15 is located on the back (inner) side of the display 14, positioned to capture images of the display 14. The camera 15 captures images based on light incident through the display 14 (light transmitted from the display surface side of the camera area CA of the display 14) and outputs the captured images to the system processing unit 10.

[0065] The EC20 is a microcomputer comprising a CPU, RAM (Random Access Memory), ROM (Read Only Memory), flash memory, multiple channels of A / D input terminals, D / A output terminals, and digital input / output terminals. For example, the EC20's CPU reads a control program (firmware) pre-stored in its own or an external ROM, executes the read control program, and performs its functions. The EC20 is connected to an accelerometer 21, a power button 22, an input device 30, a system processing unit 10, and a power supply unit 40.

[0066] The accelerometer 21 detects the direction of the information processing device 1 relative to the direction of gravity and outputs a detection signal indicating the detection result to the EC20. Alternatively, it may replace the accelerometer 21 or, in addition to the accelerometer 21, include a gyroscope, tilt sensor, geomagnetic sensor, etc.

[0067] The power button 22 is an operating element that accepts operations to turn the power to the information processing device 1 on or off. The power button 22 outputs an operation signal to the EC20 based on the user's operation.

[0068] Input device 30 is an input unit that accepts user input, and is configured to include, for example, a keyboard 31 and a touchpad 32. Input device 30 outputs an operation signal indicating the operation content to EC20 based on the user's operation on the keyboard 31 and touchpad 32.

[0069] EC20 acquires detection signals from accelerometer 21 and detects the direction of information processing device 1 based on the acquired detection signals. Additionally, EC20 acquires operation signals from input device 30, and outputs operation signals required for processing by system processing unit 10 to system processing unit 10. Furthermore, if EC20 receives an operation signal corresponding to the user's operation of power button 22, it instructs system processing unit 10 to start the system. Furthermore, EC20 communicates with power supply unit 40 to acquire battery status information (remaining capacity, etc.) from power supply unit 40, and outputs control signals for controlling the power supply corresponding to the operating state of each part of information processing device 1 to power supply unit 40.

[0070] The power supply unit 40 supplies power to each unit via a power supply system for supplying power to each unit, based on the operating status of each unit of the information processing device 1. For example, the power supply unit 40 is configured to include a DC (Direct Current) / DC converter. The DC / DC converter converts the voltage of the DC power supplied from the AC (Alternate Current) / DC adapter or battery pack to the voltage required by each unit. The power, whose voltage has been converted by the DC / DC converter, is supplied to each unit via each power supply system. For example, the power supply unit 40 supplies power to each unit via each power supply system based on control signals from the EC20.

[0071] [Functional Structure]

[0072] Next, the functional structure of camera area display control processing, which controls the camera area CA to be displayed or not displayed according to the user's operation position, will be explained when the information processing device 1 displays the image on the screen area DA of the display 14.

[0073] Figure 6 This is a block diagram illustrating an example of the functional structure of the information processing apparatus 1 according to this embodiment.

[0074] The information processing device 1 includes a camera area display control unit 110, which is a functional structure implemented by executing a program through a system processing unit 10 (e.g., CPU 101). The camera area display control unit 110 includes an operation position detection unit 111, a display stop processing unit 112, and a display resume processing unit 113.

[0075] The operation position detection unit 111 detects the user's operation position within the screen area DA of the display 14. For example, the operation position detection unit 111 acquires an operation signal corresponding to the user's operation on the touchpad 32 via the EC20, and detects the user's operation position based on the acquired operation signal. Furthermore, when a mouse is connected to the communication unit 11 or the USB connector 13, the operation position detection unit 111 acquires an operation signal corresponding to the user's operation on the mouse via the communication unit 11 or the USB connector 13, and detects the user's operation position based on the acquired operation signal.

[0076] The display stop processing unit 112 performs display stop processing, which stops the light emission of pixels in the screen area DA of the display 14 corresponding to the position where the camera 15 is located, and controls them to be non-displayed. For example, when the camera 15 is on (i.e., when the camera 15 is functioning), the display stop processing unit 112 stops the light emission of pixels in the camera area CA and controls them to be non-displayed (see reference). Figure 1On the other hand, when the camera 15 is off (i.e., when the camera 15 is not functioning), the display stop processing unit 112 does not perform display stop processing. That is, even when the camera 15 is off, the display image is still displayed for the camera area CA (see reference). Figure 2 ).

[0077] If the user's operation position detected by the operation position detection unit 111 is within the camera area CA, the display restoration processing unit 113 performs display restoration processing to display a display image based on display data corresponding to the camera area CA in any area of ​​the screen area DA of the display 14. For example, if the user's operation position detected by the operation position detection unit 111 is within the camera area CA, the display restoration processing unit 113 restores the display of the camera area CA. That is, if the user's operation position detected by the operation position detection unit 111 is within the camera area CA, the display restoration processing unit 113 controls the illumination of the pixels in the camera area CA to display a display image based on display data corresponding to the camera area CA.

[0078] [Camera area displays control processing actions]

[0079] Next, the operation of the camera area display control processing performed by the information processing device 1 (camera area display control unit 110) will be explained.

[0080] Figure 7 This is a flowchart illustrating an example of the camera area display control processing according to this embodiment. Figure 7 The example shown illustrates how the display or non-display of the camera area CA is controlled based on whether camera 15 is turned on.

[0081] (Step S101) The camera area display control unit 110 determines whether the camera 15 is turned on (ON). If the camera area display control unit 110 determines that the camera 15 is turned on (Yes), it proceeds to step S103. On the other hand, if the camera area display control unit 110 determines that the camera 15 is turned off (No), it proceeds to step S105.

[0082] (Step S103) The camera area display control unit 110 controls the camera area CA to be non-displaying (see reference). Figure 1 Furthermore, the display control mode in which the camera area CA is controlled to be non-displaying is referred to as "camera area non-display mode".

[0083] (Step S105) The camera area display control unit 110 controls the camera area CA to be displayed (see reference). Figure 2Furthermore, the display control mode in which the camera area CA is controlled for display will be referred to as the "camera area display mode" below.

[0084] Next, in camera area non-display mode, the camera area display restoration process, which restores the display of camera area CA based on the user's operation position, will be explained.

[0085] Figure 8 This is a flowchart illustrating an example of the camera area display restoration process according to this embodiment. As a prerequisite, the camera area is in a non-display mode, therefore... Figure 1 As shown, the camera area display control unit 110 controls the camera area CA to be non-displayed.

[0086] (Step S201) The camera area display control unit 110 determines whether the user's operation position is within the camera area CA. If the camera area display control unit 110 determines that the user's operation position is within the camera area CA (Yes), it proceeds to step S203. On the other hand, if the camera area display control unit 110 determines that the user's operation position is not within the camera area CA (i.e., outside the camera area CA) (No), it performs step S201 again.

[0087] (Step S203) The camera area display control unit 110 controls the camera area CA to be displayed. That is, the camera area display control unit 110 restores the display of the camera area CA (see reference). Figure 3 Then, proceed to step S205.

[0088] (Step S205) The camera area display control unit 110 determines whether the user's operating position is outside the camera area CA. If the camera area display control unit 110 determines that the user's operating position is outside the camera area CA (Yes), it proceeds to step S207. On the other hand, if the camera area display control unit 110 determines that the user's operating position is not outside the camera area CA (i.e., inside the camera area CA) (No), it performs step S205 again.

[0089] (Step S207) The camera area display control unit 110 controls the camera area CA to be non-displayed and returns to the processing in step S201. That is, the camera area display control unit 110 only controls the camera area CA to be displayed when the user's operating position is within the camera area CA, and when the user's operating position is outside the camera area CA, it controls the camera area CA to be non-displayed.

[0090] [Summary of the First Implementation]

[0091] As described above, the information processing apparatus 1 according to this embodiment includes: a display 14 having a screen area with a plurality of pixels arranged thereon; a camera 15 disposed on the back side of the display 14 and taking pictures based on light incident through the display 14; a system memory 105 (an example of a memory) temporarily storing display data for displaying on the display 14; and a system processing unit 10 (an example of a processor). The system processing unit 10 controls the illumination of the plurality of pixels of the display 14 based on the display data stored in the system memory 105, thereby causing the display 14 to display a display image based on the display data. For example, the system processing unit 10 includes a camera area display control unit 110, which performs display stop processing, operation position detection processing, and display resumption processing. For example, the camera area display control unit 110 stops the illumination of the pixels in the screen area DA of the display 14 corresponding to the position where the camera 15 is disposed and controls them to be non-displayed by display stop processing. In addition, the camera area display control unit 110 detects the operation position of the user in the screen area DA of the display 14 by operation position detection processing. Furthermore, if the operation position detected by the operation position detection processing is within the camera area CA, the camera area display control unit 110 performs display restoration processing to display a display image based on display data corresponding to the camera area CA in any area of ​​the screen area DA of the display 14.

[0092] Therefore, in the structure where the camera 15 on the back side of the display captures light transmitted through the screen area DA of the display 14, the information processing device 1 stops the light emission of the pixels in the camera area CA and controls it to be non-displaying. Furthermore, when the user's operating position is within the camera area CA, a display image based on display data corresponding to the camera area CA is displayed. Thus, the user can observe the object being operated while performing the operation. Therefore, the information processing device 1 can appropriately control the display of the display 14.

[0093] For example, in the display stop processing, when the camera 15 is working (camera 15 is on), the camera area display control unit 110 stops the light emission of the pixels in the camera area CA and controls it to be non-displayed.

[0094] Therefore, when the camera 15 is turned on, the information processing device 1 can ensure that the display on the display 14 does not interfere with the function of the camera 15 and can prevent the quality of the images captured by the camera 15 from being reduced.

[0095] Furthermore, in the display restoration process, when the operation position detected by the operation position detection process is within the camera area CA, the camera area display control unit 110 controls the emission of pixels in the camera area CA to display a display image based on display data corresponding to the camera area CA.

[0096] Therefore, when the user's operating position is within the camera area CA, the information processing device 1 displays the image based on the display data corresponding to the camera area CA in the camera area CA, so that the user can observe the object being operated while performing the operation intuitively.

[0097] Furthermore, the control method in the information processing apparatus 1 according to this embodiment includes: a step whereby the camera area display control unit 110 stops the light emission of pixels in the screen area DA of the display 14 corresponding to the position where the camera 15 is located and controls them to be non-displayed; a step whereby the user's operation position in the screen area DA of the display 14 is detected; and a step whereby, when the detected operation position is in the camera area CA, a display image based on display data corresponding to the camera area CA is displayed in any area of ​​the screen area DA of the display 14.

[0098] Therefore, in the structure where the camera 15 on the back side of the display captures light transmitted through the screen area DA of the display 14, the information processing device 1 stops the light emission of the pixels in the camera area CA and controls it to be non-displaying. Furthermore, when the user's operating position is within the camera area CA, a display image based on display data corresponding to the camera area CA is displayed. Thus, the user can observe the object being operated while performing the operation. Therefore, the information processing device 1 can appropriately control the display of the display 14.

[0099] <Second Implementation>

[0100] Next, the second embodiment of the present invention will be described.

[0101] In the first embodiment, a camera area display restoration process is described, which restores the display of the camera area CA according to the user's operation position in the non-display mode of the camera area. However, it may also be configured to prevent the execution of the camera area display restoration process according to the operation state of the camera 15.

[0102] For example, when camera 15 is capturing a moving image, if camera area CA is changed from non-display to display, the illumination of pixels within camera area CA will affect the captured image. Therefore, when camera 15 is capturing a moving image, camera area display control unit 110 (display restoration processing unit 113) disables the execution of camera area display restoration processing. Furthermore, capturing a moving image refers, for example, capturing data for recording moving images. That is, in this embodiment, the execution of camera area display restoration processing is disabled so as not to affect the data recorded by camera 15.

[0103] Figure 9This is a flowchart illustrating an example of the camera area display restoration process according to this embodiment. As a prerequisite, the camera area is in a non-display mode, therefore... Figure 1 As shown, the camera area display control unit 110 controls the camera area CA to be non-displayed.

[0104] (Step S301) The camera area display control unit 110 determines whether the user's operation position is within the camera area CA. If the camera area display control unit 110 determines that the user's operation position is within the camera area CA (Yes), it proceeds to step S302. On the other hand, if the camera area display control unit 110 determines that the user's operation position is not within the camera area CA (i.e., outside the camera area CA) (No), it performs step S301 again.

[0105] (Step S302) The camera area display control unit 110 determines whether the camera 15 is capturing a moving image. For example, the camera area display control unit 110 obtains information indicating the operation state of the camera 15 from the camera 15 and determines whether the camera 15 is capturing a moving image. If the camera area display control unit 110 determines that the camera 15 is capturing a moving image (yes), it returns to the processing in step S301. That is, even if the user's operation position is within the camera area CA, the camera area display control unit 110 does not restore the display of the camera area CA if the camera 15 is capturing a moving image.

[0106] On the other hand, if the camera area display control unit 110 determines that the camera 15 is not capturing a moving image (No), it proceeds to step S303. The following steps S303, 305, and 307 are processed in accordance with... Figure 8 The processes in steps S203, 205, and 207 are the same. That is, the camera area display control unit 110 controls the camera area CA to be displayed (step S303), and then, if it is determined that the user's operation position is outside the camera area CA (step S305: Yes), it controls the camera area CA to be undisplayed (step S307). Then, it returns to the process in step S301.

[0107] In addition, except when the camera 15 is capturing moving images, the camera area display control unit 110 can also disable the execution of camera area display restoration processing when capturing still image data (e.g., capturing still images based on long exposure).

[0108] [Summary of the Second Implementation]

[0109] As explained above, in the information processing apparatus 1 according to this embodiment, the camera area display control unit 110 prohibits the execution of camera area display restoration processing according to the operating state of the camera 15.

[0110] Therefore, even when the camera 15 is capturing moving images (or capturing still images based on long exposures), the information processing device 1 can keep the camera area CA off-screen even if the user's operating position is within the camera area CA. That is, the information processing device 1 can ensure that the display on the monitor 14 does not interfere with the function of the camera 15 and can prevent a decrease in the quality of the images captured by the camera 15. Thus, the information processing device 1 can appropriately control the display on the monitor 14.

[0111] Furthermore, the camera area display control unit 110 can reduce the light emission of the pixels in the camera area CA for display purposes, instead of disabling the execution of the camera area display restoration process based on the operating state of the camera 15. In other words, when the camera area display control unit 110 controls the light emission of the pixels in the camera area CA through the camera area display restoration process to display a display image based on display data corresponding to the camera area CA, it reduces the light emission of the pixels in the camera area CA for display purposes based on the operating state of the camera 15. For example, in cases where the camera 15 is capturing moving images (or capturing still images based on long exposures), the camera area display control unit 110 converts the display data corresponding to the camera area CA into dark display data and displays a display image based on the converted display data in the camera area CA.

[0112] Therefore, even when the camera 15 is capturing moving images (or capturing still images based on long exposures), if the information processing device 1 wants to display content in the camera area CA in any way, it can suppress the effect of pixel illumination on the camera 15 by displaying it in a darker manner (image projection).

[0113] <Third Implementation Method>

[0114] Next, the third embodiment of the present invention will be described.

[0115] The above embodiment describes a camera area display restoration process that restores the display of the camera area CA according to the user's operation position in the non-display mode of the camera area. However, it can also be configured such that the user can indicate whether to perform the camera area display restoration process.

[0116] For example, the information processing device 1 provides the user with an operation UI (User Interface) that allows the user to select either a display priority setting (performing camera area display restoration processing) or a camera priority setting (not performing camera area display restoration processing), thus enabling the user to choose between display priority and camera priority. When the user selects display priority, the camera area display control unit 110 (display restoration processing unit 113) performs camera area display restoration processing; when the user selects camera priority, camera area display restoration processing is not performed.

[0117] Figure 10 This is a flowchart illustrating an example of the camera area display restoration process according to this embodiment. As a prerequisite, the camera area is in a non-display mode, therefore... Figure 1 As shown, the camera area display control unit 110 controls the camera area CA to be non-displayed.

[0118] (Step S401) The camera area display control unit 110 determines whether the user's operating position is within the camera area CA. If the camera area display control unit 110 determines that the user's operating position is within the camera area CA (Yes), it proceeds to step S402. On the other hand, if the camera area display control unit 110 determines that the user's operating position is not within the camera area CA (i.e., outside the camera area CA) (No), it performs step S401 again.

[0119] (Step S402) The camera area display control unit 110 determines whether the user has selected either display priority or camera priority. If the camera area display control unit 110 determines that the user has selected camera priority, it returns to the process in step S401. That is, even if the user's operating position is within the camera area CA, the camera area display control unit 110 does not restore the display of the camera area CA if the user's instruction is camera priority.

[0120] On the other hand, when the camera area display control unit 110 determines that the user has selected display priority, it proceeds to step S403. The following steps S403, 405, and 407 are processed in accordance with… Figure 8 The processes in steps S203, 205, and 207 are the same. That is, the camera area display control unit 110 controls the camera area CA to be displayed (step S403), and then, if it is determined that the user's operation position is outside the camera area CA (step S405: Yes), it controls the camera area CA to be undisplayed (step S407). Then, it returns to the process in step S401.

[0121] [Summary of the Third Implementation]

[0122] As explained above, in the information processing apparatus 1 according to this embodiment, the camera area display control unit 110 allows or disables the execution of camera display restoration processing according to the user's instructions.

[0123] Therefore, the information processing device 1 can control whether the camera area CA is kept off-screen when the user's operating position is within the camera area CA, according to the user's wishes. Thus, the information processing device 1 can appropriately control the display on the monitor 14.

[0124] <Fourth Implementation>

[0125] Next, the fourth embodiment of the present invention will be described.

[0126] In the first embodiment, an example was described in which the camera area CA was controlled from non-display to display when the user's operation position was within the camera area CA in the non-display mode, thereby restoring the display of the camera area CA. However, it is also possible to keep the camera area CA controlled as non-display and display an image based on the display data corresponding to the camera area CA in an area outside the camera area CA, thereby restoring the display.

[0127] Figure 11 This is an explanatory diagram illustrating an example of the restoration of the display of the camera area CA according to this embodiment. Figure 11 (A) indicates that it is related to Figure 3 (B) and Figure 4 The same state as (A). For example... Figure 11 As shown in (A), the application window W is displayed on monitor 14, but a portion of the camera area CA is not displayed. If the cursor P, representing the user's position, enters the camera area CA, then... Figure 11 As shown in (B), the display image based on the display data corresponding to the camera area CA is displayed as a pop-up screen SW in the screen area DA of the display 14 outside the camera area CA.

[0128] The pop-up screen SW displays an image including the window W corresponding to the camera area CA and the cursor P. Alternatively, the pop-up screen SW can be enlarged to display the image including the window W corresponding to the camera area CA and the cursor P. Additionally, the pop-up screen SW can display an image wider than the camera area CA.

[0129] Figure 12 This is a flowchart illustrating a first example of the camera area display restoration process according to this embodiment. As a prerequisite, the camera area is in a non-display mode, therefore... Figure 1 As shown, the camera area display control unit 110 controls the camera area CA to be non-displayed.

[0130] (Step S501) The camera area display control unit 110 determines whether the user's operating position is within the camera area CA. If the camera area display control unit 110 determines that the user's operating position is within the camera area CA (Yes), it proceeds to step S503. On the other hand, if the camera area display control unit 110 determines that the user's operating position is not within the camera area CA (i.e., outside the camera area CA) (No), it performs step S501 again.

[0131] (Step S503) The camera area display control unit 110 pops up a display image based on display data corresponding to the camera area CA and displays it in an area outside the camera area CA. That is, the camera area display control unit 110 restores the display of the camera area CA by displaying it on the pop-up screen (see reference). Figure 11 Then, proceed to step S505.

[0132] (Step S505) The camera area display control unit 110 determines whether the user's operating position is outside the camera area CA. If the camera area display control unit 110 determines that the user's operating position is outside the camera area CA (Yes), it proceeds to step S507. On the other hand, if the camera area display control unit 110 determines that the user's operating position is not outside the camera area CA (i.e., inside the camera area CA) (No), it performs step S505 again.

[0133] (Step S507) The camera area display control unit 110 ends the display of the pop-up screen shown in step S505 and returns to the processing in step S501. That is, the camera area display control unit 110 only displays the display image of the camera area CA on the pop-up screen when the user's operating position is within the camera area CA, and ends the display of the pop-up screen when the user's operating position is outside the camera area CA.

[0134] Furthermore, the camera area display restoration process in the pop-up screen of the fourth embodiment can also be configured such that the user can indicate whether to perform the camera area display restoration process.

[0135] Figure 13 This is a flowchart illustrating a second example of the camera area display restoration process according to this embodiment. As a prerequisite, the camera area is in a non-display mode, therefore... Figure 1 As shown, the camera area display control unit 110 controls the camera area CA to be non-displayed.

[0136] (Step S601) The camera area display control unit 110 determines whether the user's operating position is within the camera area CA. If the camera area display control unit 110 determines that the user's operating position is within the camera area CA (Yes), it proceeds to step S602. On the other hand, if the camera area display control unit 110 determines that the user's operating position is not within the camera area CA (i.e., outside the camera area CA) (No), it performs step S601 again.

[0137] (Step S602) The camera area display control unit 110 determines whether the user has selected either display priority or camera priority. If the camera area display control unit 110 determines that the user has selected camera priority, it returns to the process in step S601. That is, even if the user's operating position is within the camera area CA, the camera area display control unit 110 will not restore the display of the camera area CA if the user's instruction is camera priority.

[0138] On the other hand, when the camera area display control unit 110 determines that the user has selected display priority, it proceeds to step S603. The following steps S603, 605, and 607 are processed in accordance with... Figure 8 The processes in steps S503, 505, and 507 are the same. That is, the camera area display control unit 110 displays a display image based on display data corresponding to the camera area CA on the pop-up screen (step S603), and then, if it is determined that the user's operation position is outside the camera area CA (step S605: Yes), the display of the pop-up screen ends (step S607). Then, it returns to the process in step S601.

[0139] [Summary of the Fourth Implementation]

[0140] As explained above, in the information processing apparatus 1 according to this embodiment, when the detected user's operation position is within the camera area CA, the camera area display control unit 110 displays (for example, pops up) a display image based on display data corresponding to the camera area CA in the area outside the camera area CA of the screen area DA of the display 14.

[0141] Therefore, when the user's operating position is within the camera area CA, the information processing device 1 displays (e.g., pops up) a display image based on the display data corresponding to the camera area CA in an area outside the camera area CA, so the user can observe the object being operated while performing the operation. Thus, the information processing device 1 can appropriately control the display of the display 14.

[0142] Here, when the camera area display control unit 110 displays a display image based on display data corresponding to the camera area CA in an area other than the camera area CA in the screen area DA of the display 14, it can also perform magnified display.

[0143] Therefore, when the user's operating position is within the camera area CA, the information processing device 1 will enlarge and display the image based on the display data corresponding to the camera area CA in an area outside the camera area CA, so that the user can easily operate while observing the object being operated.

[0144] In addition, the camera area display control unit 110 can also allow or disable the execution of camera area display restoration processing according to the user's instructions.

[0145] Therefore, the information processing device 1 can control, according to the user's wishes, whether to display (e.g., pop-up display) a display image based on display data corresponding to the camera area CA in an area outside the camera area CA when the user's operating position is within the camera area CA. Thus, the information processing device 1 can appropriately control the display of the display 14.

[0146] <Fifth Implementation>

[0147] Next, the fifth embodiment of the present invention will be described.

[0148] In the above embodiments, when restoring the display of the camera area CA in the camera area non-display mode, the reference... Figure 3 The process of switching the camera area CA from non-display control to display (hereinafter referred to as the "first display restoration process") will be explained as described above, and referenced. Figure 11 The process of displaying the image in an area outside the camera area CA (hereinafter referred to as the "second display restoration process") is described. In this embodiment, a structure that allows selective switching between the first and second display restoration processes is described.

[0149] In camera area non-display mode, when the operation position detected by the operation position detection unit 111 is within the camera area CA, the display restoration processing unit 113 selectively switches between: a first display restoration process that controls the illumination of pixels in the camera area CA to display a display image based on display data corresponding to the camera area CA, and a second display restoration process that pops the display image based on display data corresponding to the camera area CA into an area outside the camera area CA in the screen area of ​​the display 14.

[0150] For example, the camera area display control unit 110 (display restoration processing unit 113) switches between the first display restoration process and the second display restoration process based on the operating state of the camera 15. The operating state of the camera 15 includes, for example, whether the camera 15 is capturing a moving image. When the camera 15 is capturing a moving image, if the camera area CA is changed from non-display to display, the illumination of the pixels within the camera area CA will affect the captured image. Therefore, the second display restoration process, which displays the image in an area other than the camera area CA, is preferable. On the other hand, if the camera 15 is not capturing a moving image and there is no need to worry about the impact on the captured image, the first display restoration process is selected to display a display image based on display data corresponding to the camera area CA in the camera area CA, making it easy to understand intuitively.

[0151] Figure 14 This is a flowchart illustrating a first example of the camera area display restoration process according to this embodiment. As a prerequisite, the camera area is in a non-display mode, therefore... Figure 1 As shown, the camera area display control unit 110 controls the camera area CA to be non-displayed.

[0152] (Step S701) The camera area display control unit 110 determines whether the user's operating position is within the camera area CA. If the camera area display control unit 110 determines that the user's operating position is within the camera area CA (Yes), it proceeds to step S702. On the other hand, if the camera area display control unit 110 determines that the user's operating position is not within the camera area CA (i.e., outside the camera area CA) (No), it performs step S701 again.

[0153] (Step S702) The camera area display control unit 110 determines whether the camera 15 is capturing a moving image. For example, the camera area display control unit 110 obtains information indicating the operation state of the camera 15 from the camera 15 and determines whether the camera 15 is capturing a moving image.

[0154] If the camera area display control unit 110 determines in step S702 that the camera 15 is not capturing a moving image (No), it proceeds to step S703 to perform processing corresponding to the first display restoration process. The following steps S703, 705, and 707 are each processed in accordance with... Figure 8 The processes in steps S203, 205, and 207 are the same. That is, the camera area display control unit 110 controls the camera area CA to be displayed (step S703), and then, if it is determined that the user's operation position is outside the camera area CA (step S705: Yes), it controls the camera area CA to be undisplayed (step S707). Then, it returns to the process in step S701.

[0155] On the other hand, if the camera area display control unit 110 determines in step S702 that the camera 15 is capturing a moving image (yes), it proceeds to step S713 to perform processing corresponding to the second display restoration process. The following steps S713, 715, and 717 are each processed in accordance with... Figure 12 The processes in steps S503, 505, and 507 are the same. That is, the camera area display control unit 110 displays a display image based on display data corresponding to the camera area CA on the pop-up screen (step S713), and then, if it is determined that the user's operation position is outside the camera area CA (step S715: Yes), the display of the pop-up screen ends (step S717). Then, it returns to the process in step S701.

[0156] Furthermore, when the camera area display control unit 110 (display restoration processing unit 113) switches between the first display restoration processing and the second display restoration processing according to the operating state of the camera 15, in addition to switching based on whether the camera 15 is capturing moving images, it can also switch based on whether it is capturing still image data (e.g., capturing a still image based on a long exposure).

[0157] Alternatively, the device can be configured such that the user can indicate which of the first and second display recovery processes to select. For example, the information processing device 1 provides the user with an operation UI (User Interface) that allows the user to select either the first or second display recovery process. The camera area display control unit 110 (display recovery processing unit 113) performs the first display recovery process when the user selects the first display recovery process, and performs the second display recovery process when the user selects the second display recovery process.

[0158] Figure 15 This is a flowchart illustrating a second example of the camera area display restoration process according to this embodiment. As a prerequisite, the camera area is in a non-display mode, therefore... Figure 1 As shown, the camera area display control unit 110 controls the camera area CA to be non-displayed.

[0159] (Step S801) The camera area display control unit 110 determines whether the user's operating position is within the camera area CA. If the camera area display control unit 110 determines that the user's operating position is within the camera area CA (Yes), it proceeds to step S802. On the other hand, if the camera area display control unit 110 determines that the user's operating position is not within the camera area CA (i.e., outside the camera area CA) (No), it performs step S801 again.

[0160] (Step S802) The camera area display control unit 110 determines whether the user has selected the first display restoration process or the second display restoration process. If the camera area display control unit 110 determines that the user has selected the first display restoration process, it proceeds to step S803 and performs the processing corresponding to the first display restoration process. The following steps S803, S805, and S807 are each processed in accordance with... Figure 8 The processes in steps S203, 205, and 207 are the same. That is, the camera area display control unit 110 controls the camera area CA to be displayed (step S803), and then, if it is determined that the user's operation position is outside the camera area CA (step S805: Yes), it controls the camera area CA to be undisplayed (step S807). Then, it returns to the process in step S801.

[0161] On the other hand, if the camera area display control unit 110 determines in step S802 that the user has selected the second display restoration process, it proceeds to step S813 to perform the processing corresponding to the second display restoration process. The following steps S813, S815, and S817 are... Figure 12 The processes in steps S503, 505, and 507 are the same. That is, the camera area display control unit 110 displays a display image based on display data corresponding to the camera area CA on the pop-up screen (step S813), and then, if it is determined that the user's operation position is outside the camera area CA (step S815: Yes), the display of the pop-up screen ends (step S817). Then, it returns to the process in step S801.

[0162] [Summary of the Fifth Implementation]

[0163] As explained above, in the information processing apparatus 1 according to this embodiment, when the detected operation position is within the camera area CA, the camera area display control unit 110 selectively switches the control of the emission of pixels in the camera area CA to display a display image based on display data corresponding to the camera area CA, and performs a second display recovery process to display the display image based on display data corresponding to the camera area CA in an area other than the camera area CA in the screen area DA of the display 14.

[0164] Therefore, the information processing device 1 can switch the camera area CA from non-display control to display when the user's operating position is within the camera area CA, or display the image based on the display data corresponding to the camera area CA outside the camera area CA, thus providing good convenience.

[0165] For example, the camera area display control unit 110 switches between the first display recovery process and the second display recovery process according to the operating state of the camera 15.

[0166] Therefore, when the camera 15 is capturing a moving image (or capturing a still image based on a long exposure), and the user's operating position is within the camera area CA, the information processing device 1 displays an image based on display data corresponding to the camera area CA outside the camera area CA. This does not interfere with the function of the camera 15, and the user can operate the device while observing the object being operated. Furthermore, when the camera 15 is not capturing a moving image (or capturing a still image based on a long exposure), and the user's operating position is within the camera area CA, the information processing device 1 switches the camera area CA from non-display to display, allowing the user to operate the device intuitively while observing the object being operated.

[0167] In addition, the camera area display control unit 110 can also switch between the first display recovery process and the second display recovery process according to the user's instructions.

[0168] Therefore, the information processing device 1 can control the camera area CA from non-display to display when the user's operating position is within the camera area CA, or display an image based on display data corresponding to the camera area CA outside the camera area CA, according to the user's wishes. Thus, the information processing device 1 can appropriately control the display of the display 14.

[0169] The various embodiments of the present invention have been described in detail above with reference to the accompanying drawings. However, the specific structure is not limited to the embodiments described above, and also includes designs that do not depart from the spirit of the present invention. For example, the structures described in the above embodiments can be combined arbitrarily.

[0170] Furthermore, the aforementioned information processing apparatus 1 has an internal computer system. Moreover, programs for implementing the functions of each structure of the information processing apparatus 1 can be recorded on a computer-readable recording medium, and the processing in each structure of the information processing apparatus 1 is performed by having the computer system read and execute the program recorded on the recording medium. Here, "having the computer system read and execute the program recorded on the recording medium" includes the computer system installation program. The term "computer system" here includes hardware such as an operating system and peripheral devices. Additionally, the "computer system" may also include multiple computer devices connected via a network including communication lines such as the Internet, WAN, LAN, and dedicated lines. Furthermore, "computer-readable recording medium" refers to portable media such as floppy disks, optical disks, ROMs, and CD-ROMs, and storage devices such as hard disks built into the computer system. Thus, the recording medium containing the program can also be a non-transitory recording medium such as a CD-ROM.

[0171] Furthermore, the recording medium may also include internal or external recording media accessible from a distribution server for distributing the program. Additionally, the program may be divided into multiple parts, each downloaded at different time intervals, and then assembled from various components of the information processing device 1, with each part distributed via a different distribution server. Moreover, the term "computer-readable recording medium" also includes structures that retain the program for a certain period, such as a server in the case of sending the program via a network, or volatile memory (RAM) within a computer system acting as a client. Furthermore, the program described above may also be a structure used to implement the aforementioned functions. Further, it may be a so-called differential file (differential program) that can be implemented by combining the aforementioned functions with a program already recorded in the computer system.

[0172] Alternatively, some or all of the functions of the information processing apparatus 1 in the above embodiments can be implemented as integrated circuits such as LSI (Large Scale Integration). Each function can be processed individually, or some or all can be integrated for processing. Furthermore, the method of integrated circuit implementation is not limited to LSI; it can also be implemented using dedicated circuits or general-purpose processors. Additionally, if advancements in semiconductor technology lead to integrated circuit technologies that replace LSI, integrated circuits based on such technologies can also be used.

[0173] Furthermore, the information processing device 1 is not limited to a laptop PC, but can also be a desktop PC, a tablet terminal device, a smartphone, etc.

Claims

1. An information processing device, comprising: A display screen has a screen area with multiple pixels arranged in a grid. A camera is mounted on the back side of the aforementioned display and takes pictures based on the light incident through the aforementioned display; The memory temporarily stores the display data that causes the aforementioned display to show; and The processor controls the illumination of multiple pixels of the display based on the display data stored in the memory, thereby enabling the display to display an image based on the display data. The aforementioned processor performs display stop processing, operation position detection processing, and display recovery processing, among which, The above-mentioned display stop processing stops the light emission of pixels in the first area of ​​the screen area of ​​the above-mentioned display corresponding to the position where the above-mentioned camera is set, and controls them to be non-displaying; The above-mentioned operation position detection process detects the operation position within the screen area of ​​the above-mentioned display; and When the operation position detected by the operation position detection process is within the first region, the display restoration process displays a display image based on the display data corresponding to the first region in any area of ​​the screen area of ​​the display.

2. The information processing apparatus according to claim 1, wherein, In the above-described display stop process, when the camera is functioning, the processor stops the light emission of the pixels in the first region and controls it to be non-displayable.

3. The information processing apparatus according to claim 1 or 2, wherein, In the above display restoration process, if the operation position detected by the above operation position detection process is within the above first region, the processor controls the light emission of the pixels in the above first region to display a display image based on the display data corresponding to the above first region.

4. The information processing apparatus according to claim 3, wherein, The processor disables the execution of the display recovery process based on the camera's operating state.

5. The information processing apparatus according to claim 3, wherein, When the processor controls the light emission of the pixels in the first region through the display restoration process to display a display image based on the display data corresponding to the first region, it reduces the light emission of the pixels in the first region according to the camera's operating state.

6. The information processing apparatus according to claim 3, wherein, The processor may allow or disable the execution of the display recovery process based on the user's instructions.

7. The information processing apparatus according to claim 1 or 2, wherein, In the above display restoration process, if the operation position detected by the above operation position detection process is within the first area, the processor causes the display image based on the display data corresponding to the first area to be displayed in an area outside the first area of ​​the screen area of ​​the display.

8. The information processing apparatus according to claim 1 or 2, wherein, In the display restoration process, when the processor displays a display image based on the display data corresponding to the first region in an area outside the first region of the display's screen area, it performs a magnified display.

9. The information processing apparatus according to claim 8, wherein, The processor may allow or disable the execution of the display recovery process based on the user's instructions.

10. The information processing apparatus according to claim 1 or 2, wherein, In the above display restoration process, if the operation position detected by the above operation position detection process is within the first region, the processor selectively switches between: a first display restoration process that controls the light emission of pixels in the first region to display a display image based on the display data corresponding to the first region, and a second display restoration process that displays a display image based on the display data corresponding to the first region in a region outside the first region of the display's screen area.

11. The information processing apparatus according to claim 10, wherein, The processor switches between the first display recovery process and the second display recovery process based on the camera's operating state.

12. The information processing apparatus according to claim 10, wherein, The processor switches between the first display recovery process and the second display recovery process according to the user's instructions.

13. A control method that is a control method in an information processing apparatus that includes a display having a screen area in which a plurality of pixels are arranged, a camera disposed on a back side of the display that performs imaging based on light that has passed through the display, and a storage that temporarily stores display data that causes the display to display. The processor controls the illumination of multiple pixels of the display based on the display data stored in the memory, thereby enabling the display to display an image based on the display data. The above control methods include: The processor stops the light emission of pixels in the first area of ​​the display screen corresponding to the location where the camera is located and controls them to be non-displaying. The step of the processor detecting the operation position within the display screen area; as well as When the detected operation location is within the first region, the processor causes a display image based on the display data corresponding to the first region to be displayed in any region of the screen area of ​​the display.

Images