Portable information terminal and image display method used therein

By displaying camera location markers or adjusting image display on the display of a portable information terminal, the problem of users having difficulty judging the camera's location is solved, achieving the effects of reducing line-of-sight deviation and improving ease of use.

CN118985124APending Publication Date: 2024-11-19MAXELL LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202280093358.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2022-03-11
Publication Date
2024-11-19

AI Technical Summary

Technical Problem

In portable information terminals, once the camera is embedded in the display screen, it becomes difficult for users to determine the camera's position, leading to a misalignment of the viewpoint and inconvenience in use.

Method used

By displaying camera location markers on the display or adjusting the image display method, the user's gaze can be guided toward the camera, for example, by using markers, image overlay processing, or adjusting the image position.

Benefits of technology

It reduces the user's line of sight deviation, improves the ease of use of portable information terminals, and ensures that users can accurately aim at the camera to take pictures.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118985124A_ABST
    Figure CN118985124A_ABST
Patent Text Reader

Abstract

The purpose of the present invention is to provide a portable information terminal having a structure in which a camera is embedded in a display unit, said portable information terminal being capable of reducing the line-of-sight deviation of a user and having high usability. In order to achieve the above purpose, the portable information terminal has a display unit, an imaging unit embedded in the display unit, and a control unit, and the control unit is configured so as to display a predetermined image at a position corresponding to the position of the imaging unit on the display unit.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a portable information terminal, and in particular to a portable information terminal capable of reducing a user's visual deviation. Background Art

[0002] As background technology in this technical field, there is Patent Document 1. The technical problem to be solved by Patent Document 1 is to provide a technology for coping with the deviation of the subject's line of sight when taking selfies in an information processing device equipped with a camera, wherein the technology is configured so that the user can confirm the input image through the display while taking the user himself as the subject, and based on the position of the camera relative to the display area of ​​the display, the display position of the image obtained by the camera is closer to the camera than the center of the display area to display the input image. In addition, the information processing device displays the input image in a reduced size at a position close to the camera when the distance is relatively close, depending on the distance of the user. In this way, the user's line of sight can be brought closer to the camera.

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2014-127830 Summary of the invention

[0006] Technical problem to be solved by the invention

[0007] The premise of Patent Document 1 is that an information processing device such as a smartphone or a tablet terminal is configured such that a front camera is arranged around the display (bezel). Here, the structure in which the front camera is arranged in the bezel is adopted when the screen size is small and there is a thick bezel surrounding the screen. However, in portable information terminals such as smartphones that have developed in response to user needs, there is no longer a location for the front camera due to the large screen and narrow bezel brought about by technological innovation.

[0008] Therefore, in recent years, a display-embedded front camera (under-screen camera) has been developed, which uses a special material with high transmittance as the display screen, improves the configuration of the display elements constituting the display screen, and implements software processing, etc., so that the camera is embedded in the back side of the display element. In the case of a structure in which the camera is embedded in the display screen like this, it is difficult for the user to determine the position of the camera, and it is impossible to know where to look at the smartphone when taking a selfie, which is a so-called selfie. There is a problem that it is difficult to take pictures with an appropriate line of sight using the technology of the above-mentioned patent document 1.

[0009] In view of the above problems, the present invention aims to provide a portable information terminal which adopts a structure in which a camera is embedded in a display screen and can also reduce the user's line of sight deviation and has high usability.

[0010] Technical means of solving problems

[0011] An example of the present invention is a portable information terminal including a display unit, a camera unit embedded in the display unit, and a control unit, wherein the control unit is configured to display a predetermined image at a position on the display unit corresponding to the position of the camera unit.

[0012] Effects of the Invention

[0013] According to the present invention, a portable information terminal can be provided, which can reduce the user's line of sight deviation and has high usability in a portable information terminal having a structure in which a camera is embedded in a display screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 This is a functional module structure diagram of the portable information terminal of Example 1.

[0015] Figure 2 This is a structural diagram of the portable information terminal of Example 1.

[0016] Figure 3A This is an example of display when the portable information terminal of Example 1 takes a selfie.

[0017] Figure 3B This is another display example of the portable information terminal of Example 1 when taking a selfie.

[0018] Figure 4A This is a diagram for explaining a display example of the portable information terminal of the second embodiment when taking a selfie.

[0019] Figure 4B This is a diagram for explaining the result of a display example when taking a selfie by the portable information terminal of the second embodiment.

[0020] Figure 5 This is a flowchart of display control when the front camera is selected in the portable information terminal of Examples 1 and 2.

[0021] Fig. 6A This is an example of the display of the portable information terminal of the third embodiment when taking a selfie.

[0022] Figure 6B This is another display example of the portable information terminal of the third embodiment when taking a selfie.

[0023] Figure 7 This is a flowchart of display control when the front camera is selected in the portable information terminal of Example 3.

[0024] Figure 8 This is an example of the display when taking a selfie on the portable information terminal of the fourth embodiment.

[0025] Fig.9A This is an example of displaying a partner's image during communication by the portable information terminal of the fifth embodiment.

[0026] Fig. 9B This is another display example of the other party's image during communication by the portable information terminal of the fifth embodiment.

[0027] Fig.10 This is a control flow chart for displaying the image of the other party during communication in the portable information terminal of the fifth embodiment.

[0028] Fig.11A This is an example of displaying a partner's image during communication by the portable information terminal of the sixth embodiment.

[0029] Fig. 11B This is another display example of the other party's image during communication by the portable information terminal of the sixth embodiment.

[0030] Fig.12 This is a control flow chart for displaying the image of the other party during communication in the portable information terminal of the sixth embodiment.

[0031] Fig.13 This is an example of displaying a partner's image during communication by the portable information terminal of the seventh embodiment.

[0032] Fig.14A This is an example of display of an image of a communication partner and the portable information terminal itself in the eighth embodiment.

[0033] Fig. 14B This is an example of the display of the image of the communication partner and other aspects of the portable information terminal itself in the eighth embodiment.

[0034] Fig.15 It is a structural diagram of a display-embedded front camera of a portable information terminal of Example 9.

[0035] Fig.16A This is an example of the display when taking a selfie on the portable information terminal of Example 9.

[0036] Fig. 16B This is another display example of the portable information terminal of Example 9 when taking a selfie.

[0037] Fig.17 It is a structural diagram of a display-embedded front camera of a portable information terminal of Example 10.

[0038] Fig.18 This is a diagram showing a lock screen of a portable information terminal according to the tenth embodiment.

[0039] Fig.19A This is a display example of the portable information terminal of Example 11.

[0040] Fig.19B This is another display example of the portable information terminal of Example 11.

[0041] Fig. 20 This is an example of display when the camera application of the portable information terminal of Example 12 is activated.

[0042] Fig.21A This is an example of the guidance display in the ID photo mode when taking a selfie with a portable information terminal in Example 13.

[0043] Fig. 21B It is a diagram illustrating the positional relationship between the user and the portable information terminal in the ID photo mode in Example 13.

[0044] Fig. 21C This is a diagram for explaining the state in which the user's face and the portable information terminal are facing each other in the ID photo mode in Example 13.

[0045] Fig.22A This is an example of the guidance display in the eye-up mode when taking a selfie with a portable information terminal in Example 13.

[0046] Fig. 22B This is another display example of the guidance display in the eye-up mode in Example 13.

[0047] Fig. 22C This is another display example of the guidance display in the eye-up mode in Example 13.

[0048] Fig.23 This is an example of the guidance display in the background mode when taking a selfie with a portable information terminal in Example 13.

[0049] Fig.24 This is an example of the guidance display in the non-direct view mode when taking a selfie with a portable information terminal in Example 13.

[0050] Fig.25 This is a flowchart for controlling the display image according to the selfie mode in the portable information terminal of Example 13. DETAILED DESCRIPTION

[0051] Hereinafter, embodiments of the present invention will be described using the drawings.

[0052] Example 1

[0053] Figure 1 1 is a functional module structure diagram of the portable information terminal of this embodiment. The portable information terminal of this embodiment is, for example, a tablet or a smart phone.

[0054] like Figure 1 As shown, the portable information terminal 100 includes a communication interface (communication I / F) 113, a control unit 114, a display unit 117, a button 151, a microphone 161, a speaker 162, a signal separation unit 121, a modulation / demodulation unit 122, a storage unit 125, a mobile communication interface (mobile communication I / F) 131, a memory 132, an acceleration sensor 133, a geomagnetic sensor 134, a GPS receiving unit 135, a gyro sensor 136, a distance sensor 137, a rear camera 140 as a camera unit, a front camera 141, a front camera 142, and a front camera 143 also as a camera unit, a switch input unit 150, and a sound input / output unit 160. In addition, each functional unit other than the button 151, the microphone 161, and the speaker 162 is connected via the bus 101.

[0055] The storage unit 125 stores application programs, and the control unit 114 loads the application programs from the storage unit 125 into the memory 132 and executes the loaded application programs by the control unit 114, so that various functions can be realized. In the following description, for the sake of simplicity, the various functions realized by the control unit 114 executing each application program will be described as being mainly realized by various program function units.

[0056] In addition, the application program may be stored in the storage unit 125 before the portable information terminal 100 is shipped, or may be stored in an optical medium such as a CD (Compact Disk) or a DVD (Digital Versatile Disk) or a semiconductor memory and installed in the portable information terminal 100 via a medium connection unit (not shown).

[0057] Alternatively, the software may be downloaded and installed from an external network (not shown) via the communication I / F 113 and a wireless router (not shown), or downloaded and installed from a distributor via a base station (not shown) via the mobile communication I / F 131.

[0058] Furthermore, the application program can be connected to a personal computer that has acquired the application program via a network via an external device connection interface (not shown), and can be moved or copied from the personal computer to the portable information terminal 100 and installed.

[0059] In addition, the application program can also be realized by hardware as a processing unit having the same function. When realized by hardware, each function is realized mainly by each processing unit.

[0060] The communication I / F 113 is, for example, a short-range wireless communication device or a wireless LAN (Local Area Network) communication device, and is connected to a wireless router (not shown). In addition, the communication I / F 113 can be connected to an external network via a wireless router, and can send and receive information with a server in the external network. In addition, the communication I / F 113 can also be a terminal for wired communication connection, such as a USB terminal.

[0061] The communication I / F 113 may be equipped with chips for executing different communication methods. Alternatively, it may be implemented by a single chip supporting multiple communication methods. In addition, the short-range wireless communication device may use a communication device suitable for wireless LAN communication methods such as Bluetooth (registered trademark), IrDA (Infrared Data Association, registered trademark), Zigbee (registered trademark), HomeRF (Home Radio Frequency, registered trademark), or Wi-Fi (registered trademark).

[0062] The mobile communication I / F 131 uses a mobile communication network such as a fourth generation communication system such as LTE (Long Term Evolution) or a fifth generation communication system to connect to a communication network via a base station and transmit and receive information with a server in the communication network. In addition, the terminals can also share each other's locations.

[0063] Furthermore, it is also possible to prioritize connection to an external network via the communication I / F 113 over connection to a communication network via the mobile communication I / F 131 .

[0064] The control unit 114 receives a user operation request from the button 151 via the switch input unit 150 or from the microphone 161 via the sound input / output unit 160 , and controls the signal separation unit 121 , the display unit 117 , the communication I / F 113 , and various program function units.

[0065] Furthermore, the control unit 114 also has the function of acquiring various information from a server in an external network via the communication I / F 113 and a wireless router or via the mobile communication I / F 131 and a base station, and transmitting it to various program function units. These functions can be used to exchange images and sounds with the communication partner to perform voice chat or video chat, etc.

[0066] The storage unit 125 is controlled by an instruction from the control unit 114 and can store the application program and also stores various information generated by the application program.

[0067] The content such as video and audio streams may be stored based on the signal received from the modulation / demodulation unit 122, the communication I / F 113 or the mobile communication I / F 131. The storage unit 125 may be built in the portable information terminal 100 or may be a removable memory that can be attached to and detached from the portable information terminal 100.

[0068] The memory 132 is controlled by instructions from the control unit 114 . The functional parts of the application program stored in the storage unit 125 are loaded into the memory 132 by the control unit 114 .

[0069] The display unit 117 displays images and / or videos stored in the storage unit 125, broadcast / distributed videos, a UI for performing various operations, and the like. In addition, the displayed images and videos may be images generated by an application, images and videos of content received via the modulation / demodulation unit 122, or images and videos received from a server in an external network via the communication I / F 113. Furthermore, the displayed images and videos may be images captured by the rear camera 140, the front camera 141, the front camera 142, etc., images and videos received from a television receiver via the communication I / F 113, or images and videos distributed from a server in a communication network via the mobile communication I / F 131. The display unit 117 may be integrally formed with, for example, a touch panel described later.

[0070] The display unit 117 includes an image superimposition processing unit 118 , which can set image data pre-programmed in the memory 132 by the control unit 114 and display the image data superimposed on the above-mentioned various images.

[0071] The display unit 117 is formed of a display element such as a liquid crystal panel or an organic EL, and a front camera 141 , a front camera 142 , or a front camera 143 of a structure described later can be arranged on the back side of the display element.

[0072] The button 151 is an input unit that receives an operation of the portable information terminal 100 by the user and inputs control information related to the input operation.

[0073] A drag operation is, for example, an operation of moving an arbitrary object such as an icon on a touch panel while being touched by a finger. A flick operation is an operation of moving a finger on the screen in a flicking manner.

[0074] When a tap operation or a double tap operation is performed, an object such as an icon can be activated or switched to another screen. A tap operation is an operation of tapping an object once with a finger. A double tap operation is an operation of tapping an object twice with a finger. Here, the above-mentioned operations of the touch panel are referred to as drag operations, swipe operations, and tap operations for explanation.

[0075] The modulation / demodulation unit 122 and the signal separation unit 121 perform tuning / demodulation of a television receiver and signal separation, respectively. The acceleration sensor 133 measures the acceleration to which the portable information terminal 100 is subjected.

[0076] The control unit 114 measures the gravitational acceleration using the acceleration sensor 133, for example, and thereby can understand which part of the portable information terminal 100 is located at the top, and displays the top of the screen displayed on the display unit 117 in a manner consistent with the top measured by the acceleration sensor 133. In this way, a screen that matches the way the user holds the portable information terminal 100 can be displayed.

[0077] The geomagnetic sensor 134 measures the geomagnetic field using a plurality of magnetic sensors or the like. The GPS receiving unit 135 receives signals transmitted from a plurality of satellites using the GPS (Global Positioning System). The control unit 114 can calculate the position information of the portable information terminal 100 based on the signal received by the GPS receiving unit 135. In addition, the GPS receiving unit is an example of a receiving unit for obtaining a position through the global satellite navigation system, and there are cases where a receiving unit with a different name is used depending on the region and the country.

[0078] The gyro sensor 136 measures the angular velocity of the portable information terminal 100 generated when the user moves the portable information terminal 100 or the like.

[0079] The distance sensor 137 is a sensor that measures the distance from the portable information terminal 100 to the object. Any sensor that can estimate the position of the object three-dimensionally can be used as the distance sensor 137. Examples of the distance sensor 137 include three-dimensional distance sensors such as LiDAR (Light Detection And Ranging) and TOF (Time of Flight) sensors.

[0080] The rear camera 140 is mainly used to photograph the front scenery and / or people. In addition, the front camera 141 and the front camera 142 are used as front cameras mainly for video calls and photographing oneself, namely, so-called selfies. Furthermore, the front camera 143 can be used as an authentication camera for unlocking the portable information terminal 100 from the lock screen state through fingerprint authentication, etc. The field of view of the front camera 141 and the front camera 142 are different from each other. For example, the front camera 142 is a wider-angle camera than the front camera 141. In addition, Figure 1 The figure shows front camera 141, front camera 142, and front camera 143, but depending on the structure of portable information terminal 100, for example, only front camera 141 may be provided, and the number of front cameras installed and the combination of installed cameras are not limited.

[0081] The front camera 141 , the front camera 142 , and the front camera 143 are embedded in the back side of the display element of the display unit 117 (ie, under-screen cameras) as described later.

[0082] The images captured by the rear camera 140, the front camera 141, the front camera 142, and the front camera 143 are recorded in the storage unit 125. The recording of the images is controlled by the control unit 114 according to the camera control program recorded in the storage unit 125.

[0083] In addition, the control unit 114 controls and sets the images obtained by the rear camera 140, the front camera 141 or the front camera 142 and / or the image data (marks and messages, etc.) stored in the storage unit 125 in addition to the images in the image overlay processing unit 118, and displays them in a superimposed manner on the display unit 117.

[0084] The audio input / output unit 160 receives an audio input signal from a microphone 161 provided in the portable information terminal 100 and outputs an audio output signal to a speaker 162 . The volume of the audio input / output is controlled by the control unit 114 .

[0085] The switch input unit 150 imports switch information according to the operation of the physical button 151, imports it into the control unit 114 through the bus 101, and uses it in controlling various application programs as needed.

[0086] As an example, it is used to adjust the size of the sound output, that is, to increase or decrease the volume, by using two buttons of the button 151. In addition, the number of the button 151 may be one or more.

[0087] Figure 2 The diagrams show the structure of the portable information terminal of the present embodiment, the left side diagram is a plan view, and the right side diagram is a side view.

[0088] Figure 2 In the embodiment, the portable information terminal 100 has a front camera 141, which is embedded in the back side of the display element 117a constituting the display unit 117. With such a structure, the frame 100b (the so-called frame part) of the portable information terminal 100 can be reduced, and a large display screen can be formed. Embedding the front camera 141 in the display unit 117 like this will cause the output image of the front camera 141 to degrade. In response to this degradation, the difference with the surrounding screen can be reduced by adopting a special configuration and circuit configuration of the display element constituting the display unit, image processing based on software, etc.

[0089] Here, compared with the previous case where the front camera 141 is arranged in the frame 100b, in the portable information terminal with a structure in which the front camera is embedded in the display unit, there is a problem that the embedded front camera cannot be seen or is difficult to identify, so the user cannot understand the position of the front camera and cannot know where to look when taking a selfie. In order to solve this problem, the display control in this embodiment is described below.

[0090] Figure 3A , Figure 3B This is an example of the display when taking a selfie on the portable information terminal of this embodiment. Figure 3A It is shown that in the display unit 117, the Figure 1 The image superimposition processing unit 118 described above is in a state where a mark 302 as a predetermined image is superimposed and displayed at the embedding position of the front camera 141 . Figure 3A In the figure, the mark 302 indicates the area on the display unit 117 corresponding to the area including the imaging range of the front camera 141. In this way, since the position of the front camera is displayed by the mark 302, the user 301 who is taking a selfie with the portable information terminal 100 can see the position of the front camera 141 which is embedded and difficult to see, and can easily direct his sight toward the direction of the front camera 141.

[0091] Figure 3B is instead of Figure 3A The mark 302 shown in the figure is replaced by a black mark 303. That is, the black mark 303 is the same image data that fills the area including the camera range of the front camera 141 shown by the mark 302 on the display unit 117 with black. The black mark 303 is expected to have the effect of preventing the light from the display unit 117 from leaking to the camera pixels of the front camera 141. In addition, the front camera introduces light from the gap between the display elements that constitute the display unit, so the black mark 303 does not affect the camera image of the front camera. In addition, the mark 303 may not be black but other colors.

[0092] In addition, Figure 3A, Figure 3B In this case, if the portion other than the mark is displayed as a single high-brightness color (e.g., single white) in the display unit 117 for the purpose of illuminating the user's face, the user's face is illuminated by the light from the display unit 117, and it is expected that the user's face will be clearly photographed by the front camera 141.

[0093] Thus, according to this embodiment, the position of the camera can be displayed on the display unit, and guidance can be given in a manner that makes it easy for the user to direct their gaze in the direction of the camera, thereby providing a portable information terminal that can prevent the user's gaze from being distracted and has good usability for the user.

[0094] Example 2

[0095] Figure 4A , Figure 4B This is an example of the display when taking a selfie on the portable information terminal of this embodiment. Figure 4A The figure shows a situation where the result of photographing the user 301 who is taking a selfie with the portable information terminal 100 through the front camera 141 is displayed on the display unit 117. In addition, the front camera 141 is in a state that is invisible to the user 301. Here, the image superimposition processing unit 118 is further used to superimpose the guidance image 402 on the display unit 117. The guidance image 402 guides the position of the face of the user 301 in such a way that the line of sight is aligned with the position of the front camera 141. Through such display control, the user 301 moves the portable information terminal 100 so that he or she appears at the position of the guidance image 402, and the result is as shown in FIG. Figure 4B As shown, a camera image with the line of sight facing the direction of the front camera 141 can be obtained.

[0096] Figure 5 1 is a flowchart showing the display control when the front camera is selected in the portable information terminal of the first and second embodiments. That is, when the front camera 141 is selected for self-portrait, the display control is performed according to whether the front camera 141 is selected. Figure 3A or Figure 3B The mark display is still set to use Figure 4A The guidance image is displayed to control the control unit 114 accordingly.

[0097] Figure 5 In step 2100, it is determined whether the setting of the display during self-portrait is the image guide 402 ( Figure 4A ), if the setting is to display the guide image 402, then the image superimposition processing unit 118 is set with data for displaying the guide image (step 2102). If the display setting for Selfie in step 2100 is not the setting for the guide image, then the image superimposition processing unit 118 is set with data for displaying the mark 302 ( Figure 3A ) or mark 303 ( Figure 3B) data (step 2101). Whether to use mark 302 or mark 303 can be set when the portable information terminal 100 leaves the factory, or it can be set by the user 301. Then, in step 2103, the image captured by the front camera 141 and the data of the image superposition processing unit 118 are superimposed and displayed. That is, it includes an image processing step, a program image generating step and a superimposed image generating step, wherein the image processing step is used to display the user's camera image, the program image generating step generates a mark and / or a guide image, and the superimposed image generating step superimposes and displays the image generated in the image processing step and the mark and / or guide image generated in the program image generating step at the position of the display unit corresponding to the embedded position of the front camera, wherein the image superimposed with the camera image is selectively displayed according to whether the display setting during Selfie is to display image guidance or mark.

[0098] in addition, Figure 5 This is a flowchart of display control corresponding to both Embodiments 1 and 2, but the flowchart of display control is not limited thereto and may correspond to either Embodiment 1 or Embodiment 2. In this case, processing is performed through step 2101 and step 2103 (only in the case of Embodiment 1) or step 2102 and step 2103 (only in the case of Embodiment 2).

[0099] As described above, according to this embodiment, display control is performed so that the user's line of sight is easily directed in the direction the user wants to go, thereby providing a portable information terminal that can prevent the user's line of sight from being distracted and has good usability for the user.

[0100] Example 3

[0101] Fig. 6A , Figure 6B This is an example of the display when taking a selfie on the portable information terminal of this embodiment. Fig. 6A The state shown is that the eye portion of the camera image obtained by the front camera 141 of the user taking a selfie, i.e., the selfie image 501, is detected through image processing by the control unit 114, and the selfie image 501 is displayed in a reduced size so that the height direction position of the eyes of the selfie image 501 or the middle point of the eyes (hereinafter referred to as the eye position) is located at the position of the front camera 141 embedded in the display unit 117.

[0102] Figure 6B In the state shown, the control unit 114 detects the eye portion of the camera image obtained by the front camera 141 of the user taking a selfie, namely, the selfie image 502, through image processing, and moves the display position of the selfie image 502 for display so that the eye position of the selfie image 502 is located at the position of the front camera 141 embedded in the display unit 117.

[0103] Figure 7 is a flowchart of display control, in which the control unit 114 performs Fig. 6A , Figure 6B Display shown. Figure 7 In the embodiment of the present invention, when the user starts the selfie mode of the camera application, in step 2200, the image processing of the control unit 114 is used to detect the eye position of the selfie image 501 captured by the front camera 141. The method for detecting the eye position is not particularly limited. Then, in step 2201, it is determined whether the mode is set to the reduced display mode or the mobile display mode. The setting of the reduced display mode / mobile display mode is not shown in the figure, and is set by the user in the setting screen separately.

[0104] In the case where the zoomed display mode is set, the self-portrait image 501 captured by the front camera 141 is zoomed out in step 2202, and the eye position of the zoomed out image is adjusted to the position shown in FIG. Fig. 6A The image is displayed in a reduced size in the manner shown at the position of the front camera 141 embedded in the display unit 117 .

[0105] In the case where it is determined in step 2201 that the mobile display mode is set, the eye position of the self-portrait image 501 captured by the front camera 141 is as follows: Figure 6B The display position is moved and displayed in such a manner that the image is located at the position of the front camera 141 embedded in the display unit 117 as shown.

[0106] Thus, according to this embodiment, the display control of the camera image is performed in such a way that the user's eyes are located at a position of the front camera 141 that is actually difficult to see, thereby providing a portable information terminal that can prevent the user's line of sight from being distracted and has good usability for the user.

[0107] In addition, in this embodiment, the user can set the reduced display mode / movable display mode, but the present invention is not limited thereto, and the portable information terminal 100 may be limited to one of the reduced display mode / movable display mode when it is shipped from the factory. In this case, the processing is performed through steps 2200, 2202, and 2203 (only in the case of the reduced display mode) or steps 2200 and 2204 (only in the case of the mobile display mode).

[0108] In addition, the above embodiment shows an example of detecting the eye position of the self-portrait image 501 and positioning it at the position of the front camera 141 embedded in the display unit 117, but it is also possible not to perform the eye position detection process of the self-portrait image 501, and just display it at a predetermined position in a manner of being positioned on the front camera 141. In this case, it is not necessary to perform eye position detection through image processing, so there is an effect of reducing the processing load of the control unit 114.

[0109] Example 4

[0110] Figure 8 This is an example of the display when taking a selfie on the portable information terminal of this embodiment. Figure 8 The example in which the shutter button 601 is displayed near the mark 302 is shown. The shutter button 601 is also displayed superimposed on the image from the front camera 141 by the image superimposition processing unit 118 in the same manner as the mark 302 .

[0111] By performing such display processing, it is easy for the user to operate the shutter button 601 displayed nearby while viewing the mark 302. Even if the user's line of sight is toward the shutter button 601 when the user's hand 602 operates the shutter button 601, it will not deviate significantly from the line of sight looking toward the front camera 141.

[0112] Example 5

[0113] Fig.9A , Fig. 9B This is an example of display of a partner's image during communication by the portable information terminal of this embodiment.

[0114] Fig.9A This is a display example of a communication partner image 701 that is communicating (video chatting, etc.) with a user 702 on the portable information terminal 100. Fig.9A The state shown is that the eye portion of the received communication partner image 701 is detected by image processing of the control unit 114, and is displayed in a reduced size so that the eye position of the image is located at the position of the front camera 141 embedded in the display unit 117. In the figure, the face of the user 702 is depicted as facing sideways for convenience, but in fact, the display unit 117 of the portable information terminal 100 and the user 702 are facing each other.

[0115] Fig. 9B and Fig.9A The display example of the communication partner image 701 is also shown in which the eye portion of the communication partner image 701 is detected by image processing of the control unit 114, and the display is moved so that, for example, the width of the communication partner image 701 is consistent with the lateral width of the display unit 117, and the eye position is located at the position of the front camera 141 embedded in the display unit 117.

[0116] Fig.10 is a flowchart of display control of a communication partner image in the portable information terminal of this embodiment, showing Fig.9A and Fig. 9B The processing flow performed by the control unit 114. Fig.10 In the example of FIG. 23, when the user 702 starts the video chat application, the control unit 114 detects the eye position of the communication partner image 701 through image processing in step 2300. The method for detecting the eye position is not particularly limited. Then, in step 2301, it is determined whether the reduced display mode or the mobile display mode is set. The setting of the reduced display mode / mobile display mode is not shown in the figure, and is set by the user separately in the setting screen.

[0117] When the reduced display mode is set, the image of the communication partner image 701 is reduced in step 2302, and the eye position of the reduced image after the reduction process is adjusted in step 2303. Fig.9A The image is displayed in a reduced size in the manner shown at the position of the front camera 141 embedded in the display unit 117 .

[0118] If it is determined in step 2301 that the mode for moving display is set, the display position is moved in step 2304 so that the eye position of the communication partner image 701 is located at the position of the front camera 141 embedded in the display unit 117.

[0119] As described above, according to this embodiment, since the user 702 will naturally look toward the eye position of the communication partner image 701, the user 702 can easily direct his or her gaze toward the direction of the front camera 141, which has the effect that although it is a video chat, the communication partner can also feel that the user 702's eyes are looking at him or her, and a natural video chat can be carried out.

[0120] In addition, the above embodiment shows an example of detecting the eye position of the communication partner image 701 and positioning it at the position of the front camera 141 embedded in the display unit 117, but it is also possible not to perform the detection process of the eye position of the communication partner image 701, and only display it at a predetermined position in a manner of being positioned on the front camera 141. In this case, it is not necessary to perform eye position detection through image processing, so there is an effect of reducing the processing load of the control unit 114.

[0121] Example 6

[0122] Fig.11A , Fig. 11B This is an example of display of a partner's image during communication by the portable information terminal of this embodiment.

[0123] Fig.11A , Fig. 11B The state shown is that the user 702 (not shown, but with Fig.9A , Fig. 9B Similarly, when the display unit 117 of the portable information terminal 100 is facing each other (video chatting, etc.) and multiple communication partners are communicating, the received communication partner images 801 and 802 are displayed. The image sizes of the received communication partner images 801 and 802 are enlarged or reduced as needed so that both images can be displayed within the range of the display unit 117, or displayed at the original image size. Fig.11A In the embodiment, a communication partner image 801 of a communication partner who is speaking is displayed at the position of the front camera 141 embedded in the display unit 117, and a communication partner image 802 of a communication partner who is not speaking is displayed at a position other than the position. Fig. 11B is with Fig.11A In contrast, communication partner image 802 of a communication partner who is speaking is displayed at the position of front camera 141 embedded in display unit 117, and communication partner image 801 of a communication partner who is not speaking is displayed elsewhere.

[0124] Fig.12 is a flowchart of display control of the communication partner image in the portable information terminal of this embodiment, showing the Fig.11A and Fig. 11B The processing flow of the control unit 114 for display control described in .

[0125] Fig.12 In step 2400, it is determined whether the received communication party image 801 is speaking. If speaking, in step 2401, the communication party image 801 is appropriately transformed so as to be located at the position of the front camera 141 to enlarge or reduce or maintain the original image size, and the display is controlled on the display unit 117.

[0126] In step 2400, if the communication partner image 801 is not speaking, then in step 2402, it is determined whether the communication partner image 802 is speaking. If speaking, in step 2403, the communication partner image 802 is appropriately transformed in such a way that it is located at the position of the front camera 141 to enlarge or reduce or maintain the original image size, and the image is controlled to be displayed on the display unit 117.

[0127] In addition, whether communication partner images 801 and 802 are speaking may be detected using detection results from the video chat server sent via communication, or control unit 114 may detect based on sound data received by portable information terminal 100 .

[0128] If the communicating party image 802 is not speaking in step 2402, the control of the display positions of the communicating party images 801 and 802 is not updated, and the processing is directly terminated.

[0129] In addition, when the communication partner image 801 and the communication partner image 802 of step 2401 and step 2403 are displayed at the embedded position of the front camera 141, it is also possible to detect Fig.10 The eye position of the communication partner image used in step 2300 is displayed and controlled by the processing used in step 2303 or step 2304.

[0130] As described above, according to the present embodiment, the line of sight of the user 301 is always directed toward the communicating party who is speaking, and thus the user 301 can conduct a video chat with a line of sight that is more natural for the communicating party.

[0131] Example 7

[0132] Fig.13 is an example of displaying the other party's image during communication by the portable information terminal of this embodiment, and shows Fig.11A , Fig. 11B An example of display control in the case where there are more communication partners than the case described in .

[0133] Fig.13 In the case shown, for example, the user of the portable information terminal 100 is a lecturer, the communication partners are six listeners, and the front camera 141 is embedded in the center of the display unit 117. Fig.13 As shown, a plurality of communication partner images 901 to 906 are displayed around the position of the front camera 141 .

[0134] Such display control is particularly suitable when the portable information terminal 100 is a personal computer or a tablet computer, and the user of the portable information terminal 100, i.e., the lecturer, can check the images of the other party, i.e., the audience, without greatly changing the line of sight. In addition, since the lecturer's line of sight does not greatly change, the audience can also listen to the lecture with a natural lecture conversation feeling.

[0135] Example 8

[0136] Fig.14A , Fig. 14B This is an example of displaying an image of a communication partner and an image of the portable information terminal of this embodiment, and the situation shown is that, for example, the user of the portable information terminal 100 is a lecturer, and the communication partners are multiple attendees, and the front camera 141 is embedded and configured in the center of the display unit 117. In addition, Fig.14A , Fig. 14BThe state in which a received image 1002 of a lecturer who is the communication partner and a transmitted image 1001 of the lecturer photographed by the front camera 141 are displayed is shown.

[0137] Fig.14A In the example, the received image 1002 and the transmitted image 1001 are displayed via the front camera. By performing display control in this way, the lecturer's line of sight is toward the vicinity of the front camera, so the audience can listen to the lecture with a natural sense of a lecture call.

[0138] Fig. 14B The situation shown is that the receiving image 1002 of the communicating party, that is, the speaking listener, is displayed at the embedded position of the front camera, and the sending image 1001 is displayed at a location other than the embedded position of the front camera (it may not be displayed). By performing display control in this way, the lecturer can naturally see the face of the listener, so the lecturer's line of sight is facing the front camera 141, and the listener can listen to the lecture with a natural lecture conversation feeling.

[0139] In addition, Fig. 14B When the received image 1002 is displayed at the embedded position of the front camera 141, it can also be detected Fig.10 The eye position of the communication partner image used in step 2300 is displayed and controlled by the processing used in step 2303 or step 2304.

[0140] Example 9

[0141] Fig.15 1 is a structural diagram of a display-embedded front camera of a portable information terminal of this embodiment, the left side of the figure is a plan view, and the right side of the figure is a side view.

[0142] like Fig.15 As shown, in this embodiment, the portable information terminal 200 is equipped with two cameras, namely, a front camera 141 and a front camera 142, which are embedded in the display unit 117. For example, the front camera 142 is a camera having a larger viewing angle than the front camera 141.

[0143] Fig.16A , Fig. 16B 1 is a diagram showing a display example of the portable information terminal 200 of the present embodiment when taking a selfie, and shows a situation in which the display position is changed and the display control is performed according to the two front cameras used by the user when taking a selfie.

[0144] Fig.16A In the example, a self-portrait image 1201 when a user is taking a self-portrait with the front camera 141 is displayed at the embedded position of the front camera 141. That is, the self-portrait image 1201 is displayed in a manner such that the position of the front camera 141 is located near the center.

[0145] Fig. 16B In the example, a self-portrait image 1202 when a user is taking a self-portrait with the front camera 142 is displayed at the embedded position of the front camera 142. That is, the self-portrait image 1202 is displayed in a manner such that the position of the front camera 142 is located near the center.

[0146] In addition, Fig.16A , Fig. 16B When the self-portrait image 1201 and the self-portrait image 1202 are displayed at the embedded position of the front camera 141 and the front camera 142, the self-portrait image 1201 and the self-portrait image 1202 can also be displayed by Figure 7 The eye position is detected by the processing used in step 2200, and display control is performed through the processing used in steps 2201 to 2204.

[0147] As described above, according to this embodiment, the user naturally moves the line of sight to the direction of the front camera being used, and thus can obtain a selfie image with a natural line of sight.

[0148] Example 10

[0149] Fig.17 1 is a structural diagram of a display-embedded front camera of a portable information terminal of this embodiment, the left side of the figure is a plan view, and the right side of the figure is a side view.

[0150] like Fig.17 As shown, in this embodiment, the portable information terminal 300 is equipped with three cameras, namely, a front camera 141, a front camera 142, and a front camera 143, and they are embedded in the display unit 117. For example, the front camera 142 is a camera with a larger field of view than the front camera 141, and the front camera 143 is a camera for fingerprint authentication or other biometric authentication.

[0151] Fig.18 3 is a diagram showing a lock screen of the portable information terminal 300 of this embodiment. The lock screen of the lock screen refers to a function that automatically locks the portable information terminal 300 when the screen is turned off so that the portable information terminal 300 cannot be operated by a third party. The locked state can generally be released by entering an authentication code or performing biometric authentication such as fingerprint authentication. Fig.18 In the portable information terminal 300, Fig.17 A. Fig.17 As described in the description of B, a front camera 143 is embedded in the display unit 117 as a camera for biometric authentication. Fig.18 As shown, in this embodiment, a mark 1402 indicating the embedded location of the front camera 143 is displayed on the lock screen.

[0152] As described above, according to the present embodiment, the user of the portable information terminal 100 can easily understand the position where the finger is to be placed for biometric authentication based on the mark 1402 when the lock screen is displayed.

[0153] Embodiment 11

[0154] Fig.19A , Fig.19B FIG. 1 is a diagram showing an example of a screen display of a portable information terminal of this embodiment. Fig.15 The description will be given assuming that the portable information terminal 200 is equipped with two cameras, namely, the front camera 141 and the front camera 142 , and these cameras are embedded in the display unit 117 .

[0155] Fig.19A The example in which a mark 1501 is displayed on the display unit 117 when the camera application is activated and the front camera 141 is set to be used is shown. Fig.19B The example in which a mark 1502 is displayed on the display unit 117 when the camera application is activated and the front camera 142 is set to be used is shown.

[0156] In this way, according to the present embodiment, the user having the portable information terminal 200 can understand the effect of which front camera is being used.

[0157] In addition, if it is preset so that it is possible to separately select whether to use the mark 1501 or the mark 1502 for the front camera to be used through a selection menu (not shown), it is not necessary to perform the front camera selection operation when the camera application is started.

[0158] Example 12

[0159] Fig. 20 1 is a diagram showing an example of a screen display when the camera application of the portable information terminal of this embodiment is started. Fig.15 The description will be given assuming that the portable information terminal 200 is equipped with two cameras, namely, the front camera 141 and the front camera 142 , and these cameras are embedded in the display unit 117 .

[0160] like Fig. 20 As shown, in this embodiment, when the camera application is started, the mark 1501 and the mark 1502 are displayed simultaneously, so that it can be selected whether to use the front camera 141 or the front camera 142 as the front camera for self-portraits.

[0161] As described above, according to the present embodiment, there is the convenience that the user can select the front camera to be used by a tapping motion every time the camera application is started.

[0162] Example 13

[0163] This embodiment describes the guidance display when taking a selfie with a portable information terminal. Figure 2 The portable information terminal 100 shown is provided with a front camera 141 and embedded in the display unit 117, but the number of front cameras is not limited. In addition, a distance sensor 137 is provided on the same side of the portable information terminal as the front camera 141. The distance sensor 137 can measure the shape of the object by measuring the distance to the object at multiple points.

[0164] Fig.21A This is an example of a guide display in the ID photo mode when taking a selfie with a portable information terminal in this embodiment. Here, the ID photo mode is a selfie shooting mode suitable for taking ID photos.

[0165] like Fig.21A As shown, in the guidance display in the ID photo mode of this embodiment, a user image 1701 when taking a selfie, a mark 1702 for understanding the position of the front camera 141 (not shown), and a message 1703 reminding the user to take action are displayed. At this time, assuming that in the ID photo mode, the relationship between the user's face and the portable information terminal is optimal when they are facing each other, then when in Fig. 21B In the case of the positional relationship between the user and the portable information terminal 100 shown in FIG. 1 , although the line of sight is aligned, because the portable information terminal 100 and the user are not facing each other directly, the line of sight is downward, which will give a poor impression as if looking down. Therefore, the posture of the portable information terminal is measured using the acceleration sensor 133, the gyroscope sensor 136, etc., and the positional relationship between the user's face and the portable information terminal is measured using the distance sensor 137, and the portable information terminal 100 displays a message to encourage the user to move the portable information terminal to the optimal position. Then, when the portable information terminal 100 is determined to be in such a position, Fig. 21C When the user's face is directly facing the portable information terminal, a message prompting the user to take a photo is displayed. In this way, the portable information terminal displays a message to guide the portable information terminal to the optimal position, and the user looks toward the front camera 141 in the optimal position relationship with the portable information terminal, so that an image suitable for an ID photo can be taken.

[0166] Fig.22A This is an example of a guide display in the eye-raising mode when taking a selfie with a portable information terminal in this embodiment. Here, the eye-raising mode refers to a shooting mode suitable for taking a selfie with a cute expression - the eye-raising state (the state of looking up without looking up).

[0167] like Fig.22AAs shown, in the guidance display in the eye-raising mode of this embodiment, a user image 1701 when taking a selfie, a mark 1702 for understanding the position of the front camera 141 (not shown), and a message 1803 reminding the user to take action are displayed. The positional relationship between the portable information terminal and the user's face is Fig. 21B By displaying the message in this way, the user can be reminded to look toward the front camera 141 while holding the portable information terminal 100 higher than the face, so that it is possible to achieve shooting suitable for self-portraits with the eyes raised.

[0168] Fig. 22B This is an example in which a guide frame 1804 of the screen is displayed in addition to the message 1805 in the eye-up mode of this embodiment. The user can guide the position of the portable information terminal to the optimal direction by moving the guide frame 1804 to match the screen. Fig. 22C It shows the situation in which the portable information terminal is in the optimal position in the eye-raising mode of this embodiment. Fig. 22C In the example, the guide frame 1807 is roughly consistent with the screen. In this case, a message 1808 is displayed to remind the user to shoot. In addition, the guide frame may not be consistent with the screen, but the target position may be displayed inside the screen to guide the user to approach the target position. Furthermore, up and down arrows may be displayed when the portable information terminal is moved, so that the user can easily know the moving direction.

[0169] Fig.23 This is a display example of the guidance display in the background mode when taking a selfie with a portable information terminal in this embodiment. Here, the background mode refers to a shooting mode for taking a selfie, which is suitable for the case where you want to take a selfie with the background.

[0170] like Fig.23 As shown, in the guidance display in the background mode of this embodiment, the user image 1701 when taking a selfie, a mark 1702 for understanding the position of the front camera 141 (not shown), and a message 1903 reminding the user to take action are displayed. By displaying the message in this way, the user operates in a way that the background when taking a selfie is located above the user, so that the selfie image including the background can be taken. In addition, in order to increase the area for including the background when taking a selfie above the user, for example, Fig.15 The front camera 142 shown is arranged at the lower side of the front camera 141 for shooting.

[0171] Fig.24 This is a display example of the guidance display in the non-direct view mode when taking a selfie with a portable information terminal in this embodiment. Here, the non-direct view mode refers to a shooting mode for taking a selfie, which is suitable for the situation where the user wants to take a selfie in a state where the line of sight is deviated.

[0172] like Fig.24 As shown, in the guidance display in the non-direct view mode of this embodiment, a user image 1701, a shutter button 601 located at a position away from the front camera 141 (not shown), a user's operating hand 602, and a message 2004 prompting the user to take action are displayed. By displaying the message in this way, the user looks in the direction of the shutter button 601 when taking a selfie, so that the user can take a picture with his / her line of sight away from the camera and can operate by looking at the shutter button 601.

[0173] Although not shown in the figure, the above-mentioned "ID photo mode", "eye-raising mode", "background mode" and "non-direct view mode" can be selected by the user in the setting screen of the selfie mode.

[0174] Fig.25 This is a flowchart of the case where the display image is controlled according to the Selfie mode in the portable information terminal of this embodiment, and shows the processing flow when the control unit 114 performs these display controls.

[0175] Fig.25 In step 2500, if it is determined that the selfie mode is the "ID photo mode", the positional relationship is measured in step 2501, and the display data of the mark 1702 and the message 1703 are set in the image superposition processing unit 118. Then, in step 2509, the camera image of the front camera 141 and the data set in the image superposition processing unit 118 are superimposed and displayed.

[0176] In step 2502, if it is determined that the selfie mode is the "eye-raising mode", the positional relationship is measured in step 2503, and the display data of the mark 1702 and the message 1803 are set in the image superposition processing unit 118. Then, in step 2509, the camera image of the front camera 141 and the data set in the image superposition processing unit 118 are superimposed and displayed.

[0177] In step 2504, if it is determined that the self-portrait mode is the "background mode", then in step 2505, the display data of the mark 1702 and the message 1903 are set in the image superposition processing unit 118. Then, in step 2509, the captured image of the front camera 141 and the data set in the image superposition processing unit 118 are superimposed and displayed.

[0178] In step 2506, if it is determined that the Selfie mode is the "non-direct view mode", then in step 2507, the display data of the shutter button 601 and the message 2004 are set in the image superposition processing unit 118. Then, in step 2509, the captured image of the front camera 141 and the data set in the image superposition processing unit 118 are superimposed and displayed.

[0179] When it is determined in step 2506 that it is not the "non-direct view mode", since none of the respective shooting modes, namely, the "ID photo mode", "eye-raising mode", "background mode" and "non-direct view mode" are set, the image overlay processing unit data is set to an empty state (not displayed state), and in step 2509, the camera image of the front camera 141 and the data set in the image overlay processing unit 118 (the state in which the image overlay display is not performed) are superimposed and displayed.

[0180] in addition, Fig.25 The four modes for self-portrait are described in this embodiment, but the present invention is not limited thereto and may be any one of them or a combination of some of them.

[0181] The embodiments are described above, but the present invention is not limited to the above embodiments, and includes various modified examples. For example, the above embodiments describe the case where the number of front cameras of the portable information terminal is 1, 2, and 3, etc., but are not limited to this. In addition, the above embodiments are described in detail in order to explain the present invention in an easy-to-understand manner, and are not limited to all the structures described. In addition, a part of the structure of a certain embodiment can be replaced with the structure of other embodiments, and the structure of other embodiments can be added to the structure of a certain embodiment. In addition, for a part of the structure of each embodiment, other structures can be added, deleted, and replaced. In addition, for each of the above structures, part or all of them can be constructed by hardware, or they can be constructed to be implemented by executing a program by a processor. In addition, the control lines and information lines show the necessary parts for the description, and do not necessarily show all the control lines and information lines on the product.

[0182] Description of Reference Numerals

[0183] 100, 200, 300: portable information terminal, 114: control unit, 115: input unit, 117: display unit, 117a: display element, 118: image superposition processing unit, 140: rear camera, 141~143: front camera, 301, 702: user, 302, 303, 1402, 1501, 1502, 1702: mark, 402: guide image, 501, 502, 1201, 1202: selfie image, 601: shutter button, 701, 801, 802, 901~906: communication partner image, 1001: sent image, 1002: received image, 1701: user image, 1703, 1803, 1805, 1808, 1903, 2004: message, 1804, 1807: guide frame.

Claims

1. A portable information terminal comprising a display unit, a camera unit embedded in the display unit, and a control unit, characterized in that: The control unit displays a predetermined image at a position on the display unit corresponding to a position of the imaging unit.

2. The portable information terminal according to claim 1, characterized in that: The control unit displays the image captured by the imaging unit on the display unit, and displays the predetermined image in a superimposed manner at a position on the display unit corresponding to the position of the imaging unit.

3. The portable information terminal according to claim 2, characterized in that: The predetermined image is obtained by filling a region of the display unit that includes an imaging range of the imaging unit with the same image data.

4. The portable information terminal according to claim 2, characterized in that: The prescribed image is a guide image indicating where the face of the user captured by the imaging unit should be displayed.

5. The portable information terminal according to claim 1, wherein: The predetermined image is a self-portrait image of the user captured by the camera unit, The control unit reduces or moves the self-portrait image and displays it on the display unit in such a manner that the position of the self-portrait image in the height direction of the eyes or the middle point of the two eyes is located at a position on the display unit corresponding to the position of the camera unit.

6. The portable information terminal according to claim 2, characterized in that: The control unit displays an image of a shutter button in a superimposed manner near the predetermined image.

7. The portable information terminal according to claim 1, characterized in that: Has a communications department, The predetermined image is an image of a communication partner of the communication unit, The control unit reduces or moves the image of the communication partner and displays it on the display unit in such a manner that the position of the image of the communication partner in the height direction of the eyes or the middle point of both eyes is located at a position on the display unit corresponding to the position of the camera unit.

8. The portable information terminal according to claim 7, characterized in that: When there are a plurality of communication partners, the control unit reduces or moves an image of a communication partner who is speaking to a position on the display unit corresponding to a position of the imaging unit, and displays the image on the display unit.

9. A portable information terminal comprising a display unit, a camera unit embedded in the display unit, a communication unit, and a control unit, wherein: The camera unit is embedded in the center of the display unit. When there are a plurality of communication partners of the communication unit, the control unit displays images of the plurality of communication partners around a position corresponding to the position of the imaging unit on the display unit.

10. The portable information terminal according to claim 5, characterized in that: There are multiple camera units. The control unit displays a self-portrait image of a user captured by a selected camera unit among the plurality of camera units at a position on the display unit corresponding to an embedded position of the selected camera unit.

11. The portable information terminal according to claim 1, characterized in that: There are multiple camera units. The control unit displays the predetermined image at a position on the display unit corresponding to an embedded position of the selected imaging unit when an application using the imaging unit selected from the plurality of imaging units is activated.

12. The portable information terminal according to claim 11, characterized in that: The control unit displays the predetermined image in a superimposed manner at each position on the display unit corresponding to the embedded positions of the plurality of imaging units when the application is activated.

13. The portable information terminal according to claim 2, characterized in that: The image captured by the camera unit is a self-portrait image of the user. The control unit displays a message prompting a user to take action on the display unit.

14. The portable information terminal according to claim 13, characterized in that: The message is a guidance display when taking a selfie, wherein the selfie mode is any one of an ID photo mode, an eye-raising mode, a background mode, and a non-direct view mode.

15. An image display method in a portable information terminal, wherein the portable information terminal adopts a structure in which a camera unit is embedded in a display unit, characterized in that: include: An image processing step for displaying a camera image of the user or the other party of communication; a program image generation step that generates a mark and / or a message; and A superimposed image generating step is performed to superimpose and display the image generated in the image processing step and the mark and / or message generated in the program image generating step at a position on the display unit corresponding to the embedded position of the camera unit.

Citation Information

Patent Citations

  • Information processing device and program

    JP2014127830A