Information processing apparatus and communication device for telepresence system

JP2025025168APending Publication Date: 2025-02-21NIPPON SEIKI CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023129707
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-08-09
Publication Date
2025-02-21

Smart Images

  • Figure 2025025168000001_ABST
    Figure 2025025168000001_ABST
Patent Text Reader

Abstract

To provide an information processing apparatus capable of preventing confusion of a user regarding display contents, and a telephone call device for a telepresence system equipped with the information processing apparatus.SOLUTION: When a processing unit of an information processing apparatus recognizes that there is an external monitor 10v in addition to a monitor 10, it is possible to execute an inverted display process in which a predetermined screen 2 is rendered on the external monitor 10v and an inverted screen 1 in which the predetermined screen 2 is inverted is rendered on the monitor 10. When the inverted screen 1 is displayed by being reflected by a reflection unit, it is visually recognized by a user in a normal direction. A processing unit restricts the movement of a cursor, which is movable according to the operation of a pointing device by a user from the predetermined screen 2 to the inverted screen 1 during the execution of inversion display processing and controls the cursor not to be displayed in the inverted screen 1.SELECTED DRAWING: Figure 12
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to an information processing device and a communication device for a telepresence system including the information processing device. [Background technology]

[0002] For example, Patent Document 1 describes a video conference system (telepresence system) in which a screen displayed on a monitor is reflected by a half mirror and viewed by a user. This monitor displays an inverted screen that is viewed by the user in the correct orientation when reflected by the half mirror. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 11-122592 Summary of the Invention [Problem to be solved by the invention]

[0004] One method for drawing an inverted screen on a monitor is to insert a dummy plug into a video signal terminal such as an HDMI (registered trademark: High-Definition Multimedia Interface) on a PC (Personal Computer) and have the OS (Operating System) recognize the presence of an external monitor (i.e., a virtual monitor). This allows the OS to perform drawing processing of a specific screen (hereinafter also referred to as a normal screen) on the external monitor, and to perform drawing processing of an inverted screen that is the inverted version of the normal screen on the monitor.

[0005] When this technique is used, display elements such as the cursor and window that were displayed on the normal screen move to the inverted screen in response to the user's operation of the pointing device, causing the display elements to remain in the normal mode and be displayed on the inverted screen, which may confuse the user as to the displayed content.

[0006] The present disclosure has been made in consideration of the above-described circumstances, and aims to provide an information processing device that can prevent a user from becoming confused about display content, and a communication device for a telepresence system that includes the same. [Means for solving the problem]

[0007] In order to achieve the above object, an information processing device according to a first aspect of the present disclosure includes: A monitor and a processing unit capable of performing a drawing process of an inverted screen on the monitor, the inverted screen being viewed by a user in a normal orientation when reflected and displayed on the reflecting unit; The processing unit includes: When it is recognized that there is an external monitor in addition to the monitor, an inversion display process is executed to perform a drawing process of a predetermined screen on the external monitor and a drawing process of an inverted screen obtained by inverting the predetermined screen on the monitor, A cursor that can be moved in response to the user's operation of a pointing device is controlled so that the movement from the specified screen to the inverted screen is restricted while the inverted display process is being executed, and the cursor is not displayed within the inverted screen.

[0008] In order to achieve the above object, a communication device for a telepresence system according to a second aspect of the present disclosure comprises: The information processing device; a transmissive reflective member that reflects a first light representing the inverted screen displayed on the monitor toward the user and transmits a second light representing the user, as the reflective unit; an imaging unit that receives the second light that has passed through the transmissive reflector and images the user; The processing unit outputs an image signal of the user captured by the imaging means. Effect of the Invention

[0009] According to the present disclosure, it is possible to prevent the user from becoming confused about the displayed content. [Brief description of the drawings]

[0010] [Figure 1] FIG. 2 is a front view of the communication device according to the embodiment of the present invention, as viewed from the caller's side. [Diagram 2] FIG. 2 is a perspective view of the communication device according to the embodiment. [Diagram 3] FIG. 2 is a block diagram showing the electrical configuration of the communication device according to the embodiment. [Figure 4] Cross section AA of Figure 1. [Diagram 5] FIG. 2 is a front view of the opaque member according to the embodiment, showing the opaque member as viewed from the side opposite to the caller. [Figure 6] Cross-sectional view of FIG. 1 taken along line B-B. [Figure 7] Cross section taken along CC in Figure 1. [Figure 8] Cross-sectional view of Fig. 1 taken along the line D-D. [Figure 9] An E-E cross section of Figure 2. [Figure 10] FIG. 2 is an external view of the information processing apparatus according to the embodiment. [Figure 11] FIG. 2 is a schematic diagram showing display elements in contrast to a conceptual diagram showing the relationship between the monitor and an external monitor. [Figure 12] 11A and 11B are diagrams for explaining the positional relationship of an external monitor with respect to a monitor in the start-time restriction process according to the embodiment. [Figure 13] 13 is a flowchart of a start-time restriction process according to the embodiment. [Figure 14] 13 is a flowchart of an execution restriction process according to the embodiment. [Figure 15] FIG. 13 is a cross-sectional view showing a transmissive reflective member, an imaging unit, and a non-transmissive member according to a modified example of the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] An embodiment of the present disclosure will be described with reference to the drawings.

[0012] The communication device t1 for the telepresence system T in this embodiment includes an information processing device 100 having a monitor 10 and a processing unit 40, a transmissive reflective member 20 (reflection unit), an imaging means 30, an opaque member 50, an audio processing unit 60, a frame structure 70, and an illumination means 80, as shown in appropriate figures in Figures 1 to 10.

[0013] Here, the telepresence system T is a system realized by connecting a communication device t1 used by a user X (a caller) and a communication device t2 used by a call partner (a call partner of the user X) located at a location distant from the user X via a network. The communication device t1 can be used as a teleprompter by the user X, and the communication device t2 can be used as a teleprompter by the call partner.

[0014] The communication device t1 is a device that displays (projects) an image of the other party using a transparent reflective member 20, acquires image and audio signals of user X and sends them to the other party's communication device t2, and also acquires the other party's image and audio signals sent from the other party's communication device t2 and provides images and audio to user X who uses the communication device t1.

[0015] Similarly, the communication device t2 is a device that displays (projects) an image of user X using a transparent reflective member 20, acquires the image and audio signals of the other party and sends them to the communication device t1 on the user X side, and also acquires the image and audio signals of user X sent from the communication device t1 on the user X side and provides images and audio to the other party using the communication device t2.

[0016] The information processing device 100 of the communication device t1 is a PC (Personal Computer), and in this embodiment, as shown in Fig. 10, is configured as a notebook PC (laptop). The information processing device 100 may be a desktop PC or a tablet PC as long as it has the functions of a monitor 10 and a processing unit 40 described later. The communication device t2 of the other party is also arbitrary as long as it uses a PC.

[0017] The monitor 10 displays an image under the control of the processing unit 40. The monitor 10 can display a call partner image, which is an image (for example, a face image or an upper body image) of the call partner using the communication device t2. The monitor 10 can also display a prompter image for the user X to read out materials, superimposed on the call partner image. As shown in FIG. 2, the monitor 10 is disposed below (directly below) the transmissive reflecting member 20 so as to face a semi-transmissive semi-reflective layer 22, which will be described later, provided on the transmissive reflecting member 20. The information processing device 100 shown in FIG. 10 is configured such that the degree of opening and closing (opening and closing angle) of the monitor 10 relative to the main body 11 can be adjusted by a hinge mechanism that connects the monitor 10 and the main body 11. For example, the user X can adjust the monitor 10 so as to face the transmissive reflecting member 20 by adjusting the monitor 10 in a direction to open it relative to the main body 11.

[0018] The monitor 10 can display an inverted screen that is reflected by the transmissive reflective member 20 (reflecting section) and viewed in the normal direction by the user X, under the control of the processing section 40. This inverted screen includes the aforementioned image of the other party and an image for the prompter.

[0019] 4, the transmissive reflector 20 reflects a first light L1 representing an image (particularly the inverted screen described above) displayed on the monitor 10 toward the user X, and transmits a second light L2 representing the user X. The transmissive reflector 20 is supported by the frame structure 70 in a state inclined with respect to the second light L2.

[0020] The transflective member 20 includes a light-transmitting base 21 that is its base material, and a semi-transmitting semi-reflective layer 22 provided on the front side of the base 21. The base 21 is, for example, a transparent resin substrate having a substantially rectangular shape. The semi-transmitting semi-reflective layer 22 has both a function of transmitting the second light L2 and a function of reflecting the first light L1, and is composed of, for example, an aluminum vapor deposition layer formed on the front side of the base 21.

[0021] The imaging means 30 is configured to receive the second light L2 transmitted through the transmissive reflecting member 20 and image the user X. The imaging means 30 is provided behind the transmissive reflecting member 20 so as to be invisible from the user X who visually recognizes the transmissive reflecting member 20. The imaging means 30 includes an imaging element 31 that receives the second light L2, and an impermeable case member 32 that houses the imaging element 31. The imaging element 31 is connected to the information processing device 100 by, for example, a wiring unit (for example, a USB cable) not shown, and is electrically connected to the processing unit 40. The imaging element 31 is provided at a position that is approximately aligned with the line of sight of the user X. The case member 32 can be, for example, a resin case formed of a black (light-shielding) resin material, and has a frame-shaped peripheral wall portion 32a that surrounds the periphery of the imaging element 31 and a bottom wall portion 32b that covers the rear side of the imaging element 31.

[0022] The processing unit 40 is composed of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a storage device, etc. The storage device includes a ROM (Read Only Memory), a RAM (Random Access Memory), and storage. The processing unit 40 controls the overall operation of the information processing device 100 in accordance with an OS (Operating System) stored in the storage device (e.g., storage) and various application programs executed under the management of the OS. As shown in FIG. 3, the processing unit 40 is electrically connected to each of the monitor 10, the imaging means 30, the audio processing unit 60, and the light source 81, and controls their operations.

[0023] The processing unit 40 has functions such as a drawing processing means for executing drawing processing on the monitor 10, and a signal output means for outputting an image signal of the user X captured by the imaging means 30. Specifically, the signal output means outputs an image signal of the user X captured by the imaging means 30 to the call partner's telephone device t2. The processing unit 40 is connected to an audio processing unit 60 (speaker and microphone), and audio signals are transmitted and received to enable audio communication between the user X and the call partner.

[0024] Here, the processing unit 40 functioning as a drawing processing means performs drawing processing of an inverted screen on the monitor 10 by the method described below.

[0025] First, the user X inserts a dummy plug 12 shown in FIG. 10 into a video signal terminal such as HDMI (registered trademark) or VGA (registered trademark) of the information processing device 100. This causes the processing unit 40 to recognize that there is an external monitor (virtual monitor) in addition to the monitor 10. The processing unit 40, which has recognized the external monitor in this way, executes an inverted display process in response to an input operation by the user X. The input operation is performed, for example, using the pointing device 13 or a keyboard (not shown). Note that, in FIG. 10, an example is shown in which the pointing device 13 is a touch pad mounted on the information processing device 100, but this is not limited thereto. The pointing device 13 may be a mouse, a trackball, or the like mounted on or connected to the information processing device 100.

[0026] 11, in the inverted display process, the processing unit 40 can perform drawing processing of a predetermined screen (normal screen) 2 on the external monitor 10v, and can also perform drawing processing of an inverted screen 1 obtained by inverting the predetermined screen 2 on the monitor 10. However, if no measures are taken, display elements such as the cursor 3 and window 4 displayed on the normal screen 2 will move to the inverted screen 1 in response to the operation of the pointing device 13 by the user X, causing the display elements to remain in the normal mode and be displayed on the inverted screen 1, which may confuse the user X as to the displayed contents.

[0027] Here, the inverted screen 1 is an image displayed across the entire screen of the monitor 10. Similarly, the predetermined screen 2 is an image drawn across the entire screen of the virtual external monitor 10v. For example, the inverted screen 1 and the predetermined screen 2 include a background (wallpaper) image in addition to the above-mentioned call partner image and prompter image. The window 4 is an image drawn within the area of ​​the inverted screen 1 or the predetermined screen 2, which indicates a visual area given to each application software, and is generally rectangular or rounded rectangular in shape. The cursor 3 is generally called a mouse cursor, regardless of whether the pointing device 13 is a mouse or not.

[0028] 11 is a diagram showing display elements in a conceptual diagram showing the relationship between the monitor 10 and the external monitor 10v. When the dummy plug 12 is inserted into the information processing device 100, the normal screen 2 and the display elements in the normal screen 2 that are drawn on the virtual external monitor 10v are not visible to the user X. The user X can grasp a screen showing the positional relationship and settings of the monitor 10 and the external monitor 10v by opening a setting screen such as "Display customization" that corresponds to the type of OS.

[0029] As described above, in order to prevent the user X from becoming confused about the display contents, the processing unit 40 executes a start-time restriction process (S100) shown in FIG. 13 and an in-progress restriction process (S200) shown in FIG. 14 as a process for restricting display elements.

[0030] (Start-up restriction process) The start-time restriction process (S100) shown in Fig. 13 is executed at the start of the inverted display process. First, the processing unit 40, as shown in Fig. 12, places the external monitor 10v obliquely with respect to the monitor 10 in the virtual area under control, draws a predetermined screen (normal screen) 2 on the external monitor 10v, and draws the inverted screen 1 on the monitor 10 (step S101). This prevents display elements such as the cursor 3 and the window 4 from moving to the inverted screen 1 even if the user X performs an unintended operation with the pointing device 13. As described above, since the dummy plug 12 is inserted in the information processing device 100, the user X cannot grasp the external monitor 10v unless a setting screen such as "customize display" is opened, and therefore the normal screen 2 is not visible to the user X.

[0031] Next, processing unit 40 lists existing windows, which are windows 4 displayed on the screen of monitor 10 (i.e., windows 4 that have already been launched) (step S102). If there are multiple existing windows, the multiple existing windows are listed.

[0032] Next, the processing unit 40 determines whether or not there is at least one existing window (step S103). If there is no existing window (step S103; No), the processing unit 40 ends the start-time restriction process. On the other hand, if there is at least one existing window (step S103; Yes), the processing unit 40 determines whether or not an existing window is present in the normal screen 2 (whether or not the existing window is included in the area of ​​the normal screen 2) (step S104). If the existing window is included in the area of ​​the normal screen 2 (step S104; Yes), the processing unit 40 returns to step S102 and executes the process. As a result, if there are multiple existing windows, the determination process of step S104 is executed a number of times according to the number of existing windows.

[0033] In step S104, if at least a part of the one existing window is not within the normal screen 2 (that is, there is a risk that the one existing window will be displayed within the area of ​​the inverted screen 1) (step S104; No), processing unit 40 moves the one existing window to the normal screen 2 (moves the one existing window so that it is included within the display area of ​​the normal screen 2), and performs control so that the one existing window is not displayed within the inverted screen 1 (step S105). This is the start-time restriction process.

[0034] (Current restriction process) 14 is repeatedly executed during the execution of the inverted display process. First, the processing unit 40 restricts the movement of the cursor 3 from the predetermined screen 2 to the inverted screen 1, and controls so that the cursor 3 is not displayed in the inverted screen 1 (step S201). Here, in the process of step S201, the processing unit 40 may clip (stop) the cursor 3 within the predetermined screen 2, or may permit movement within the predetermined screen 2.

[0035] Next, the processing unit 40 attempts to acquire an active window as the window 4 (step S202), and determines whether or not there is an active window to be acquired (step S203). If there is no active window (step S203; No), the processing unit 40 ends the in-progress restriction process (note that, as described above, the in-progress restriction process is repeated at a predetermined interval while the inverted display process is being executed). Here, the active window is the window 4 being worked on or selected, and is the window 4 displayed in the foreground when multiple windows 4 are open at the same time.

[0036] On the other hand, if there is an active window (step S203; Yes), the processing unit 40 determines whether the active window is in the specified screen (normal screen) 2 (whether the active window is in the display area of ​​the normal screen 2) (step S204). If the active window is in the normal screen 2 (step S204; Yes), the processing unit 40 ends the in-progress restriction process. On the other hand, if the active window is not in the normal screen 2 (that is, there is a risk that the active window will be displayed in the area of ​​the inverted screen 1) (step S204; Yes), the processing unit 40 moves the active window to the normal screen 2 (moves the active window so that it is included in the display area of ​​the normal screen 2), and controls so that the active window is not displayed in the inverted screen 1 (step S205). This completes the in-progress restriction process.

[0037] According to the information processing device 100, by executing the above process by the processing unit 40, it is possible to prevent unintended display elements from being displayed in the inverted screen 1 in the normal mode, thereby suppressing confusion of the user X regarding the display contents. Note that in the start-time restriction process and the execution restriction process, the display of all existing windows and all active windows does not have to be restricted, and a specific window determined in advance may be excluded from the start-time restriction process and the execution restriction process. For example, a prompter image displayed in full screen among the active windows 4 may be excluded from the start-time restriction process and the execution restriction process as the specific window.

[0038] The non-transmitting member 50 is a member having light blocking properties, and is provided behind the transmitting reflective member 20. The non-transmitting member 50 is, for example, made of a substantially rectangular black resin substrate. In this case, the external shape of the non-transmitting member 50 is substantially the same as the external shape of the base 21, and the non-transmitting member 50 is provided behind the transmitting reflective member 20 so as to overlap with the transmitting reflective member 20.

[0039] Further, the non-transmitting member 50 is provided with a through-hole 51 at a position corresponding to the imaging means 30. The through-hole 51 is configured as a substantially rectangular through-hole penetrating the front and back (front and back) of the non-transmitting member 50, and is provided slightly above the center of the non-transmitting member 50 when the transmissive reflective member 20 (non-transmitting member 50) is viewed from the user X side (see FIG. 5). Note that the through-hole 51 here has an opening shape that generally matches the outer shape of the peripheral wall portion 32a.

[0040] Furthermore, the imaging means 30 is fixed to the non-transparent member 50 using an appropriate fixing means (e.g., adhesive) with a part of the peripheral wall 32a located on the front side embedded in the through-hole 51. For example, when fixed with the adhesive, the provision of the semi-transmissive semi-reflective layer 22 has the advantage of improving marketability since the adhesive portion is not visible from the user X side. Note that the shapes of the through-hole 51 and the peripheral wall 32a, which are in abutting relationship with each other, are not limited to the shapes described above, and for example, the through-hole 51 may be circular and the peripheral wall 32a may be cylindrical.

[0041] The audio processing unit 60 acquires the voice of the user X on the communication device t1 side by a microphone (not shown) installed at an appropriate location of the frame structure 70 (for example, approximately at the center of a connecting portion described later) and outputs the voice signal to the processing unit 40. The audio processing unit 60 also processes the voice signal from the communication device t2 side input from the processing unit 40 to provide the user X with the voice of the other party. Note that the audio processing unit 60 may have any configuration as long as it is electrically connected to the processing unit 40, and at least a part of the audio processing unit 60 may be provided in the information processing device 100. In other words, the provision of the voice may be performed by a speaker mounted on or connected to the information processing device 100. Furthermore, the acquisition of the voice may be performed by a microphone mounted on or connected to the information processing device 100.

[0042] The frame structure 70 functions as a resin base for the intercom device t1, and includes a U-shaped front frame member 71 provided in front of the transmissive reflective member 20, a rear frame member 72 provided behind the front frame member 71 and having a height dimension lower than the height dimension of the front frame member 71, a pair of first intermediate frame members 73 connected between the upper end side of the front frame member 71 and the upper end side of the rear frame member 72 using a connecting mechanism, and a pair of second intermediate frame members 74 connected between the lower end side of the front frame member 71 and the lower end side of the rear frame member 72.

[0043] The front frame member 71 includes first and second leg portions 71a and 71b erected across a gap S corresponding to the formation width of the transmissive reflector 20, and a connecting portion 71c connecting an upper end side of the first leg portion 71a and an upper end side of the second leg portion 71b, in which the height dimension of the first leg portion 71a is equal to that of the second leg portion 71b. The first leg portion 71a is provided with a groove-shaped recessed portion F1 for burying the lighting means 80 at a portion facing the front, the second leg portion 71b is provided with a groove-shaped recessed portion F2 for burying the lighting means 80 at a portion facing the front, and the connecting portion 71c is provided with a groove-shaped recessed portion F3 for burying the lighting means 80 at a portion facing the front (see FIGS. 6 to 8).

[0044] Further, a guide member 91 is provided in the recessed portion F1 of the first leg 71a, and a guide member 92 is provided in the recessed portion F2 of the second leg 71b. In terms of the positional relationship between the illumination means 80 and the guide members 91 and 92, the illumination means 80 is embedded in the recessed portion F1 on the upper side when the first leg 71a is equally divided vertically, and the guide member 91 is provided in the recessed portion F1 on the lower side when the first leg 71a is equally divided vertically. Similarly, the illumination means 80 is embedded in the recessed portion F2 on the upper side when the second leg 71b is equally divided vertically, and the guide member 92 is provided in the recessed portion F2 on the lower side when the second leg 71b is equally divided vertically.

[0045] The rear frame member 72 has third and fourth leg portions 72a, 72b standing across a gap S. The pair of first intermediate frame members 73 have both end portions located on the front and rear sides thereof connected and fixed to the front frame member 71 and the rear frame member 72 (the third and fourth leg portions 72a, 72b), respectively, using appropriate connecting means.

[0046] In this case, the pair of first intermediate frame members 73 has a function of fixing and holding the overlapping transmissive reflective member 20 and the impermeable member 50. Specifically, as shown in Fig. 9, each first intermediate frame member 73 includes a bottomed frame-shaped base portion 73a and a glazing channel 73b as an elastic interposing material, and the overlapping transmissive reflective member 20 and the impermeable member 50 are fixed and held to the base portion 73a via the glazing channel 73b. The first intermediate frame member 73 and the overlapping transmissive reflective member 20 and the impermeable member 50 may be fixed to each other by adhesion or the like.

[0047] In addition, when fixing the superimposed transmissive reflective member 20 and opaque member 50, for example, the glazing channel 73b has its main part located inside the base portion 73a, and a known configuration (glazing channel structure) is adopted in which an engaging portion G1 provided on the glazing channel 73b engages with an engaged portion G2 of the base portion 73a.

[0048] The pair of second intermediate frame members 74 have front portions located on the front side thereof connected to guide members 91, 92 via movable part M1, and rear portions located on the rear side thereof connected to third and fourth leg portions 72a, 72b via connecting pins M2. The guide members 91, 92 are provided with rail-shaped guide grooves 91a, 92a in which guided portions M11 provided on the movable part M1 are respectively guided.

[0049] For example, although detailed illustration is omitted here, each guided portion M11 is guided from the lower side to the upper side of the guide members 91, 92 in Fig. 2, whereby the rear frame member 72 and the first intermediate frame member 73 are folded compactly toward the front frame member 71. With this configuration, the user X can carry the communication device t1 to any place.

[0050] The illumination means 80 is for illuminating the user X and is provided on the front frame member 71. As shown in Figs. 6 to 8, the illumination means 80 includes a plurality of light sources 81 that emit illumination light toward the user X, a light source board 82 on which the light sources 81 are mounted (disposed), and a light diffusion member 83 that is provided so as to cover the light sources 81. In this embodiment, the illumination means 80 is configured to be individually disposed in a recess C1 provided in the first leg 71a, a recess C2 provided in the second leg 71b, and a recess C3 provided in the connecting portion 71c.

[0051] For example, an RGB light source that emits any color can be used as the light source 81. An operation unit (not shown) for turning on or off the light source 81 may be separately provided, and when the processing unit 40 receives an operation signal indicating that the user X has turned on or off the operation unit, the processing unit 40 may control the emission of the light source 81 so that the light source 81 is turned on or off based on the operation signal.

[0052] Also, a rotary operation unit (not shown) for adjusting the light intensity of the light source 81 may be provided separately, and when the processing unit 40 receives a rotary operation signal indicating that the user X has operated the rotary operation unit to a predetermined position, the processing unit 40 may adjust the light emission luminance of the light source 81 based on the rotary operation signal. Furthermore, a color temperature operation unit (not shown) for adjusting the color temperature of the light source 81 may be provided separately, and when the processing unit 40 receives a color temperature signal indicating that the user X has operated the color temperature operation unit, the processing unit 40 may adjust the color temperature of the light source 81 based on the color temperature signal. As described above, in this embodiment, the user X can freely set the on / off state, light emission luminance, and color temperature of the light source 81, which is advantageous in that convenience is improved. Note that the operation unit and the rotary operation unit not shown may be mounted on or connected to the information processing device 100, and at least a part of the functions may be realized by the pointing device 13 described above.

[0053] The light source board 82 is formed in a substantially rectangular shape and is disposed on the front frame member 71 (i.e., the first leg portion 71a, the second leg portion 71b, and the connecting portion 71c). More specifically, the light source board 82 is placed on the bottom surfaces F11, F21, and F31 of the recesses F1, F2, and F3, respectively.

[0054] In this case, the bottom surface F11 is provided so as to be inclined 30 degrees counterclockwise with respect to a virtual vertical plane Z (a virtual vertical plane Z perpendicular to the front-rear direction) along the longitudinal direction of each leg portion 71a, 71b, the bottom surface F21 is provided so as to be inclined 30 degrees clockwise with respect to the virtual vertical plane Z (a virtual vertical plane Z perpendicular to the front-rear direction), and the bottom surface F31 is provided so as to be inclined 15 degrees forward with respect to the virtual vertical plane Z (a virtual vertical plane Z perpendicular to the front-rear direction). By configuring in this way, the upper body of the user X can be efficiently illuminated by the illumination light from the illumination means 80, and there is an advantage that the quality of the image data of the user X sent to the communication device t2 side is improved.

[0055] The light diffusion member 83 may be, for example, a milky white light diffusion sheet having optical transparency, and is arranged so as to cover (block) the openings F12, F22, and F32 of the recesses F1, F2, and F3. Here, in terms of the positional relationship between the light diffusion member 83 and the light source substrate 82, they are parallel to each other, but the light source substrate 82 may be arranged so as to be parallel to the imaginary vertical plane Z. If necessary, a light reflection sheet may be provided on the inner wall surfaces of the recesses F1, F2, and F3 or on the front surface of the light source substrate 82 facing the light diffusion member 83 in order to efficiently guide the illumination light toward the light diffusion member 83.

[0056] As described above, this embodiment includes a transmissive reflective member 20 that transmits the second light L2 from a user X (subject) who can communicate with the call partner and reflects an image of the call partner displayed on the monitor 10, an imaging means 30 provided behind the transmissive reflective member 20 and receiving the second light L2, a processing unit 40 that sends an image signal of user X imaged by the imaging means 30 to the call partner, and an impermeable member 50 provided behind the transmissive reflective member 20, and a through portion 51 is provided in the impermeable member 50 at a position corresponding to the imaging means 30.

[0057] Therefore, when a fluorescent lamp is installed on the ceiling of a room and the communication device t1 is used in the room, the non-transmissive member 50 is provided on the rear side of the transmissive reflector 20 so as to overlap the transmissive reflector 20, so that the light of the fluorescent lamp is prevented from passing through the transmissive reflector 20 from the opposite side to the user X (i.e., the rear side) via a predetermined optical path in the room. In other words, a part of the light of the fluorescent lamp that tries to pass through the transmissive reflector 20 from the rear side is blocked by the non-transmissive member 50 having a black light-blocking property that is provided on the rear side of the transmissive reflector 20 so as to overlap the transmissive reflector 20, and no light passes through the transmissive reflector 20. Therefore, it is possible to provide a communication device used in a telepresence system that is not affected by the light of the fluorescent lamp and does not deteriorate the visibility of the image of the other party projected on the transmissive reflector 20.

[0058] Furthermore, in this embodiment, the imaging means 30 includes an imaging element 31 that receives the second light L2, and an opaque (black) case member 32 that houses the imaging element 31. The case member 32 is fixed to an opaque member 50 having light-blocking properties with a portion of the member embedded in the through-hole 51. This has the advantage that a portion of the light from the above-mentioned fluorescent lamp is blocked by the black opaque member 50 and the black case member 32 having light-blocking properties, and this more reliably prevents a decrease in visibility of the image of the other party projected onto the transparent reflective member 20 due to the influence of the fluorescent lamp light.

[0059] The present invention is not limited to the above-described embodiment and drawings. Changes (including deletion of components) can be made to the embodiment and drawings as appropriate without departing from the spirit of the present invention.

[0060] In the above embodiment, an example has been shown in which the processing unit 40 recognizes a virtual external monitor 10v by inserting a dummy plug 12 into the information processing device 100, but an actual external monitor may be connected to the information processing device 100. In this case, the predetermined screen 2 is actually displayed on the actual external monitor. In either case, in terms of control, the processing unit 40 still recognizes the external monitor, and therefore the start-time restriction process (S100) and the execution restriction process (S200) can be executed.

[0061] For example, in the above embodiment, the case where the communication device according to the present invention is installed at both positions separated from each other is described, but it is not necessary to install the communication device at both, and one communication device only needs to have a display means for receiving an image signal sent from the other communication device and displaying an image of the person who is the other party to the call, an imaging means for imaging the person looking at the display means, and a signal output means for transmitting the image signal of the person imaged by the imaging means to the other communication device via a network. An example of such a device is a general-purpose smartphone (mobile terminal) with a camera.

[0062] In the above-described embodiment, the imaging means 30 is configured by the imaging element 31 and the case member 32, but as a modified example of this embodiment, for example, an imaging means 30 as shown in Fig. 15 may be adopted. Specifically, the imaging means 30 in this modified example is mainly configured by the imaging element 31, a lens (not shown) provided in front of the imaging element 31, a housing section H made of, for example, a resin part for housing the imaging element 31 and the lens, and a case member 32.

[0063] The storage section H has a generally convex shape and is composed of a front storage section H1 that stores the lens and a rear storage section H2 that stores the image sensor 31. When the width dimensions of the front storage section H1 and the rear storage section H2 along the direction perpendicular to the front-rear direction are considered, the front storage section H1 is narrower than the rear storage section H2. The case member 32 in this modified example is divided into a front case 33 and a rear case 34, and stores the image sensor 31, the storage section H, and a metal part described later. The front case 33 is fixed to the non-transparent member 50 using an appropriate fixing means, and has an opening 33a at a position corresponding to the through-hole 51. The rear case 34 is fixed to the front case 33 using an appropriate fixing means. The shapes of the front case 33 and the rear case 34 are arbitrary as long as the image sensor 31, the lens, and the storage section H are installed inside them, and are not limited to those shown in FIG. 15.

[0064] In this modified example, a substantially ring-shaped metal part 35, for example, is provided in a step part of the housing part H, which is a boundary part between the front housing part H1 and the rear housing part H2, and the transmittance of the semi-transmissive semi-reflective layer 22 is set so that the metal part 35 provided on the imaging means 30 can be faintly seen from the user X side through the semi-transmissive semi-reflective layer 22 when the communication device t1 is not in use and an image of the call partner is not reflected on the transmissive reflective member 20. For example, the transmittance of the semi-transmissive semi-reflective layer 22 is set to 25 to 35 percent.

[0065] The metal part 35 is a highly reflective part formed by plating, deposition, painting, printing, etc., and its outer dimensions are smaller than the opening width of the opening 33a. In front of the metal part 35, the opening 33a, which has a wider opening width than the outer dimensions of the metal part 35, the light-transmitting base 21, and the semi-transmissive semi-reflective layer 22, which has a transmittance set to 25% to 35%, are located, so that the user X can visually recognize the image (annular image) of the metal part 35 faintly reflected on the semi-transmissive semi-reflective layer 22 before using the communication device t1. For example, when the communication device t1 is installed in a room where a fluorescent light is turned on, the light of the fluorescent light passes through the semi-transmissive semi-reflective layer 22 via a predetermined optical path, passes through the through-hole 51 and the opening 33 in sequence, and is reflected by the metal part 35. Then, the reflected light passes through the opening 33 and the through-hole 51 and passes through the semi-transmissive semi-reflective layer 22, so that the user X can visually recognize the annular image. By configuring the communication device t1 in this manner, the user X can roughly grasp the position of the imaging element 31 based on the annular image before using the communication device t1, which has the advantage of improving marketability.

[0066] Furthermore, in this modified example, when the communication device t1 is in a use state (i.e., the image of the call partner is reflected on the transmissive reflective member 20), the image of the call partner is displayed on the transmissive reflective member 20, and the annular image that was faintly projected on the transmissive reflective member 20 (semi-transmissive semi-reflective layer 22) disappears. In other words, under the use state of the communication device t1 in which the image of the call partner is reflected on the transmissive reflective member 20, the metal part 35 (the annular image) changes from a visible state to an invisible state, and thus there is no risk of the image quality of the call partner being degraded.

[0067] In the above embodiment, the through-hole 51 is provided slightly above the center of the non-transparent member 50 when the transmissive reflective member 20 (non-transparent member 50) is viewed from the user X side, but the position of the through-hole 51 (imaging element 31) may be any position that is approximately aligned with the line of sight of the user X, and for example, the through-hole 51 (imaging element 31) may be formed in the approximately center of the non-transparent member 50. In addition, when an image of the call partner is displayed on the transmissive reflective member 20 of the communication device t1, an image other than a person (for example, a text information image) may be displayed on the transmissive reflective member 20 of the communication device t2 side that is provided corresponding to the call partner. In addition, the metal part 35 provided on the step part of the storage unit H may be replaced with a resin part as necessary, and in the case of replacing it with a resin part, it is preferable to form it with a resin other than black. In addition, a metal layer (metal plating, etc.) corresponding to the metal part may be separately formed on the front side of the resin part.

[0068] (Additional Note) (Appendix 1) A monitor and a processing unit capable of performing a drawing process of an inverted screen on the monitor, the inverted screen being viewed by a user in a normal orientation when reflected and displayed on the reflecting unit; The processing unit includes: When it is recognized that there is an external monitor in addition to the monitor, an inversion display process is executed to perform a drawing process of a predetermined screen on the external monitor and a drawing process of an inverted screen obtained by inverting the predetermined screen on the monitor, a control unit that controls a cursor movable in response to an operation of a pointing device by the user to be restricted from moving from the predetermined screen to the inverted screen while the inverted display process is being performed, so that the cursor is not displayed in the inverted screen; Information processing device.

[0069] (Appendix 2) The processing unit includes: When the inverted display process is started in a state where an existing window, which is a window displayed on the screen of the monitor, is present, the existing window is moved to the predetermined screen, and the existing window is controlled so as not to be displayed on the inverted screen; performing control so that an active window is not displayed in the inverted screen while the inverted display process is being performed; 2. An information processing device according to claim 1.

[0070] (Appendix 3) The processing unit includes: When the inverted display process is started, the external monitor is disposed at an angle to the monitor in a virtual area under control. 3. The information processing device according to claim 1 or 2.

[0071] (Appendix 4) An information processing device according to any one of Supplementary Notes 1 to 3; a transmissive reflective member that reflects a first light representing the inverted screen displayed on the monitor toward the user and transmits a second light representing the user, as the reflective unit; an imaging unit that receives the second light that has passed through the transmissive reflector and images the user; The processing unit outputs an image signal of the user captured by the imaging means. Telepresence system communication device.

[0072] In the above description, descriptions of well-known technical matters have been omitted as appropriate in order to facilitate understanding of the present disclosure.

[0073] Various embodiments and modifications of the present invention are possible without departing from the broad spirit and scope of the present invention. The above-described embodiments are for the purpose of explaining the present invention and do not limit the scope of the present invention. That is, the scope of the present invention is indicated by the claims, not the embodiments. Various modifications made within the scope of the claims and the scope of the meaning of the invention equivalent thereto are considered to be within the scope of the present invention. [Explanation of symbols]

[0074] t1 communication device 100 Information processing device 1 Inverted Screen 2 Predetermined screen (forward rotation screen) 3. Cursor 4. Windows 10 Monitor 10v external monitor 11 Main body 12 Dummy plug 13 Pointing Device 20 Transmissive and reflective material 21 Base 22 Semi-transparent semi-reflective layer 30 Imaging means 31 Image sensor 32 Case material 33 Front case 34 Rear case 35 Metal parts 40 Processing section 50 Opaque material 51 Penetration 60 Audio Processing Unit 70 Frame Structure 71 Front frame (frame member) 71a First leg 71b Second leg 71c connection part 72 Rear frame 73 First intermediate frame 74 Second intermediate frame 80 Lighting means 81 Light source 82 Light source board 83 Light Diffusion Materials F1~F3 recessed part H Storage section X-user L1 First Light L2 Second Light

Claims

1. A monitor and a processing unit capable of performing a drawing process of an inverted screen on the monitor, the inverted screen being viewed by a user in a normal orientation when reflected and displayed on the reflecting unit; The processing unit includes: When it is recognized that there is an external monitor in addition to the monitor, an inversion display process is executed to perform a drawing process of a predetermined screen on the external monitor and a drawing process of an inverted screen obtained by inverting the predetermined screen on the monitor, a control unit that controls a cursor movable in response to an operation of a pointing device by the user to be restricted from moving from the predetermined screen to the inverted screen while the inverted display process is being performed, so that the cursor is not displayed in the inverted screen; Information processing device.

2. The processing unit includes: When the inverted display process is started in a state where an existing window, which is a window displayed on the screen of the monitor, is present, the existing window is moved to the predetermined screen, and the existing window is controlled so as not to be displayed on the inverted screen; performing control so that an active window is not displayed in the inverted screen while the inverted display process is being performed; The information processing device according to claim 1 .

3. The processing unit includes: When the inverted display process is started, the external monitor is disposed at an angle to the monitor in a virtual area under control. The information processing device according to claim 2 .

4. An information processing device according to any one of claims 1 to 3; a transmissive reflective member that reflects a first light representing the inverted screen displayed on the monitor toward the user and transmits a second light representing the user, as the reflective unit; an imaging unit that receives the second light that has passed through the transmissive reflector and images the user; The processing unit outputs an image signal of the user captured by the imaging means. Telepresence system communication device.

Citation Information

Patent Citations

  • Video conference system

    JP1999122592A