Information processing device, terminal device, screen display method, information processing system, and program

Abstract

To provide an information processing system that appropriately arranges applications according to the attitude and the like of a display despite the absence of a user's selection.SOLUTION: There is provided an information processing system having: an information processing apparatus having a display, a communication unit that transmits detection information related to at least one of the attitude, inclination, and bending angle of the display to a terminal device that can execute applications, and receives information on the arrangement of the applications and information on screens of the applications transmitted from the terminal device, and a display control unit that displays the screens of the applications on the display based on the arrangement information and the screen information received by the communication unit; and the terminal device having a determination unit that determines arrangement information corresponding to the detection information transmitted from the information processing apparatus based on the detection information.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, a terminal device, a screen display method, an information processing system, and a program.

Background Art

[0002] There is known an information processing apparatus that mounts a touch panel on a display such as a liquid crystal or plasma and displays an image received from a terminal.

[0003] Regarding such technology, a technology has been devised for changing an image displayed by an information processing apparatus according to the posture of the display (see, for example, Patent Document 1). Patent Document 1 discloses a configuration in which status information including the arrangement direction of the display is received from an external device, and the display image is rotated and transmitted to the external device.

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the conventional technology, when the display is rotated 180 degrees, the image is changed so as to be the display before the change in the posture of the display, such as displaying an upside-down image. Therefore, for example, if the image includes an application whose arrangement can be changed within the image, it is displayed in the arrangement before the change even when the posture of the display or the like changes. Therefore, when arranging the application in an arrangement suitable for the posture of the display or the like, the user needs to select the arrangement.

[0005] An object of the present invention is to provide an information processing system in which an application is appropriately arranged according to the posture of a display or the like without user selection in view of the above problems.

Means for Solving the Problems

[0006] In order to solve the above-described problems, the present invention includes a display and the Installation direction, whether or not it is bent, and angleAn information processing device having: a communication unit that transmits detection information relating to an application to a terminal device capable of executing an application, and receives the application's layout information and screen information transmitted from the terminal device; a display control unit that displays the application's screen on the display based on the layout information and screen information received by the communication unit; and a terminal device having a determination unit that determines the layout information corresponding to the detection information transmitted from the information processing device based on the detection information. Furthermore, the aforementioned placement information also includes the application that uses the terminal device as its placement destination. It is characterized by having an information processing system. [Effects of the Invention]

[0007] In view of the above problems, the present invention can provide an information processing system in which applications are appropriately positioned according to the orientation of the display, etc., without the need for user selection. [Brief explanation of the drawing]

[0008] [Figure 1] This figure shows an example of an information processing system configuration according to the first embodiment. [Figure 2] This figure shows an example of the hardware configuration of a terminal device according to the first embodiment. [Figure 3] This figure shows an example of the circuit configuration of an electronic information board according to the first embodiment. [Figure 4] This figure shows an example of the functional configuration of the information processing system according to the first embodiment. [Figure 5] This diagram shows an example of the relationship between the main screen and the sub-screen. [Figure 6] This figure shows examples of different orientations of electronic information boards and the tilt (angle) of the displays. [Figure 7] This figure shows an example of a screen layout table for application deployment. [Figure 8] This figure shows an example of a flowchart for application placement processing based on a screen layout table according to the first embodiment. [Figure 9]This figure shows an example of a screen used when a user executes a screen layout and updates configuration information. [Figure 10] This figure shows an example of a screen related to user-defined automatic screen layout settings. [Modes for carrying out the invention]

[0009] Hereinafter, embodiments of the information processing device, terminal device, screen display method, information processing system, and program according to the present invention will be described in detail with reference to the attached drawings.

[0010] [First Embodiment] In this embodiment, a screen layout table is pre-configured for arranging the application screen according to the orientation, tilt, or bending angle of the display. The terminal device can refer to the screen layout table according to the orientation, tilt, or bending angle of the display and set the screen layout of the display. As a result, the electronic information board can display the application screen in an appropriate size and display mode.

[0011] Furthermore, in this embodiment, the user can easily change the screen layout table.

[0012] <System Configuration> In recent years, information processing devices called electronic information boards, which incorporate touch panels into displays such as LCDs and plasma displays, have become well-known. Taking advantage of the flexible shape of the display, displays in forms such as bendable (curved), rollable (rolled up), and foldable (foldable) are beginning to be introduced.

[0013] In this embodiment, a mechanism is provided that automatically arranges application screens according to various configurations, which is a characteristic of such flexible displays, without confusing the user. Here, screens are displayed for each application, and the display is the device that displays the whole. Note that "application" may be abbreviated as "app" from now on.

[0014] Also, in this embodiment, as an example, a foldable electronic information board is used to explain the method of arranging the application screens when the display is folded.

[0015] FIG. 1 is a diagram showing an example of the system configuration of an information processing system 1 according to the first embodiment. The information processing system 1 includes an information processing device such as a PC (Personal Computer) 5 having a general-purpose wired interface such as USB Type-C or a general-purpose wireless interface such as WiFi, a smartphone 4, a tablet terminal 7, and an electronic information board � connected to them by wire or wirelessly. The PC 5, smartphone, and tablet terminal are collectively referred to as a terminal device 2. The terminal device controls the connected electronic information board 3 and the like.

[0016] The electronic information board 3 may be called a touch display. Hereinafter, the description will be made assuming that the PC 5 and the electronic information board 3 are connected.

[0017] The electronic information board 3 transmits information such as the displayable size, the posture of the display, the inclination, and the bending angle to the terminal device 2. Based on the received information, the terminal device 2 determines the screen layout to be displayed on the terminal device 2 and the electronic information board 3, determines the application to be displayed on the terminal device 2, determines the application to be displayed on the electronic information board 3, and transmits the application screen to the electronic information board 3. Here, the screen layout is information regarding, for example, the arrangement and size when at least one application executed on the terminal device 2 is displayed on the terminal device 2 or the electronic information board 3.

[0018] <Hardware Configuration (Terminal Device)> FIG. 2 is a hardware configuration diagram of a PC 5 which is one form of the terminal device 2. The hardware configuration of the PC 5 will be described using FIG. 2.

[0019] As shown in Figure 2, PC5 is built by a computer and includes a CPU (Central Processing Unit) 501, a GPU (Graphics Processing Unit) 517, a ROM (Read Only Memory) 502, a RAM (Random Access Memory) 503, an HD (Hard Disk) 504, an HDD (Hard Disk Drive) controller 505, a display 506, an external device connection I / F (Interface) 508, one or more network I / Fs 509, a data bus 510, a keyboard 511, a pointing device 512, a DVD-RW (Digital Versatile Disk Rewritable) drive 514, and a media I / F 516. Note that the hardware configuration of PC5 shown in Figure 2 is an example, and PC5 does not need to have all of the above components.

[0020] Of these components, the CPU 501 controls the overall operation of the PC5. The GPU 517 performs image processing or screen control-related processing. The ROM 502 stores programs used to drive the CPU 501, such as the IPL (Initial Program Loader). The RAM 503 is used as the work area for the CPU 501. The HD 504 stores various data, such as programs. The HDD controller 505 controls the reading or writing of various data to the HD 504 according to the control of the CPU 501. The display 506 displays various information such as cursors, menus, windows, characters, or images. The external device connection I / F 508 is an interface for connecting various external devices. In this case, external devices include, for example, USB (Universal Serial Bus) memory and printers. The network I / F 509 is an interface for data communication using the communication network 100. The data bus 510 is an address bus and data bus, etc., for electrically connecting each component, such as the CPU 501 shown in Figure 2.

[0021] The keyboard 511 is a type of input means equipped with multiple keys for inputting characters, numbers, and various instructions. The pointing device 512 is a type of input means for selecting and executing various instructions, selecting processing targets, and moving the cursor. The DVD-RW drive 514 controls the reading or writing of various data to the DVD-RW 513, which is an example of a removable recording medium. Note that it is not limited to DVD-RW, but may also be DVD-R, etc. The media interface 516 controls the reading or writing (storage) of data to the recording medium 515, such as flash memory.

[0022] <Circuit Configuration (Electronic Information Board)> Figure 3 is a diagram illustrating an example of the circuit configuration of the electronic information board 3. The electronic information board 3 consists of a camera unit 10, a touch panel display 11, a microphone unit 12, a speaker unit 13, a CPU 14, a storage device 15, memory 16, a LAN I / F unit 17, and an operation unit 18.

[0023] The camera unit 10 has the function of acquiring surrounding images as video and transmitting them to the CPU 14.

[0024] The touch panel display 11 has the function of displaying video data received from the CPU 14 on the screen, and the function of transmitting the coordinates of when the user touches the touch panel with their finger or pen to the CPU 14 in order to control the device. The touch panel used in the touch panel display 11 may be, for example, a display-integrated capacitive touch panel. The touch panel display 11 is sometimes simply called a display or screen.

[0025] The CPU 14 has a CODEC function that controls the entire electronic information board, controls video conferencing, processes and encodes video and audio data acquired from the camera unit 10 (such as 360°), microphone unit 12, and data drawn using the touch panel display 11, and transmits it to the LAN I / F unit 17, and decodes the video, audio, and drawing data received from the LAN I / F unit 17 and transmits it to the touch panel display 11 and speaker unit 13. Examples of CODECs used by the CPU 14 include H.264 / AVC, H.264 / SVC, and H.265.

[0026] The microphone unit 12 has the function of acquiring the voice of meeting participants and transmitting it to the CPU 14. The microphone is fixed and installed at a specific position on the terminal.

[0027] The speaker unit 13 has the function of outputting audio data received from the CPU 14.

[0028] The storage device 15 stores programs for device control, video conferencing control, and other functions performed by the CPU 14. Examples of storage devices 15 include non-volatile storage media such as flash memory and HDDs.

[0029] Memory 16 is used for expanding programs used by the CPU 14 and for temporarily storing calculation data. A volatile memory such as DDR memory is an example of this.

[0030] The LAN I / F unit 17 connects to other conference terminals via the internet or other means to send and receive images and audio. Examples of LAN I / F units 17 include wired LANs that connect to Ethernet and support 10Base-T, 100Base-TX, and 1000Base-T, and wireless LANs that support 802.11ac / a / b / g / n.

[0031] The control unit 18 has a keyboard, buttons, etc., and allows the user to control the terminal's devices.

[0032] The 6-axis sensor 19 detects the orientation and tilt of the touch panel display 11, or, in the case of a foldable display, the folding angle.

[0033] <About the features> Next, the functional configuration of the information processing system 1 according to the first embodiment will be described with reference to Figure 4. This figure shows an example of the functional configuration of the information processing system 1 according to the first embodiment.

[0034] The electronic information board 3 includes a detection unit 31, a first communication unit 32, a first display control unit 33, a first setting storage unit 34, and a first operation reception unit 35. Each of these functional units is a function or means realized by the CPU 14 executing instructions included in one or more programs or applications installed on the electronic information board 3.

[0035] The detection unit 31 detects information regarding the orientation, tilt, and bending angle of the touch panel display 11 of the electronic information board 3, and transmits the detected information to the first communication unit 32.

[0036] The first communication unit 32 transmits the detection information received from the detection unit 31 to the second communication unit 22 of the terminal device 2.

[0037] Furthermore, the first communication unit 32 obtains information from the first setting storage unit 34 regarding whether or not to perform automatic screen layout, and if it does, it sends an automatic layout request to the second communication unit 22. Alternatively, it may send information regarding whether or not to perform automatic screen layout, and if it does not perform automatic layout, it may not send any requests or information.

[0038] Furthermore, the first communication unit 32 receives screen layout information, which is arrangement information, and screen information to be displayed on the touch panel display 11 from the second communication unit 22, and transmits the received screen layout information and screen information to the first display control unit 33. Here, the screen information is information necessary when displaying an image on the touch panel display 11 based on the application screen, and for example, one pixel is represented by the three primary colors RGB (Red, Green, Blue).

[0039] The first display control unit 33 displays an image on the touch panel display 11 based on the screen layout information and screen information received from the first communication unit 32.

[0040] The first setting storage unit 34 stores information regarding whether or not to automatically execute the screen layout. This information may also be stored in the second setting storage unit 24 of the terminal device 2.

[0041] The first operation reception unit 35 receives user input via a touch panel display 11 or the like. For example, the first operation reception unit 35 receives user input regarding automatic layout display and transmits the input setting information to the first setting storage unit 34 for storage.

[0042] The contact position detection unit 36 ​​detects the coordinates of the position where an input means such as a pen or fingertip makes contact with the touch panel display 11. The drawing data generation unit obtains the coordinates of the contact point from the contact position detection unit. The contact position detection unit generates stroke data by interpolating and connecting this sequence of coordinate points.

[0043] Terminal device 2 includes a determination unit 21, a second communication unit 22, a second display control unit 23, a second setting storage unit 24, and a second operation reception unit 25. Each of these functional units is a function or means realized by the CPU 501 or GPU 517 executing instructions contained in one or more programs or applications installed on terminal device 2. In particular, processing related to images displayed on the screen and screen layout is executed by the GPU 517.

[0044] The determination unit 21 determines the screen layout information based on the orientation, tilt, and bending angle information of the touch panel display 11 of the electronic information board 3 detected by the detection unit 31 of the electronic information board 3, and the screen layout table 40 acquired from the second setting storage unit 24. Alternatively, the determination unit 21 may receive screen layout information entered by the user into the second operation reception unit 25 and determine the received screen layout information as the screen layout information. Furthermore, the determination unit 21 transmits the determined screen layout information to the second display control unit 23.

[0045] The second communication unit 22 receives requests or information regarding the execution of automatic layout, as well as information regarding the orientation, tilt, and bending angle of the touch panel display 11, from the first communication unit 32 of the electronic information board 3, and transmits the received information to the determination unit 21. The second communication unit 22 also transmits screen information received from the second display control unit 23 to the first communication unit 32.

[0046] The second display control unit 23 displays an image on the display 506 based on the screen layout information received from the determination unit 21, and also transmits the screen information to be displayed on the touch panel display 11 of the electronic information board 3 to the second communication unit 22.

[0047] The second setting storage unit 24 stores the information of the screen layout table 40 received from the second operation reception unit 25. The second setting storage unit 24 also transmits the screen layout table 40 to the decision unit 21 or other units as requested.

[0048] The second operation reception unit 25 receives a request to change the screen layout table 40 via the keyboard 511 or pointing device 512 based on user operation, and transmits the changed information to the second setting storage unit 24 for storage. Similarly, the second operation reception unit 25 also receives input of screen layout information and transmits the received screen layout information to the determination unit 21.

[0049] Next, we will explain the relationship between the main screen and the sub-screen using Figure 5. Figure 5(A) shows the case where the user is using only PC5 and the electronic information board 3 is not connected to PC5. Figure 5(B) shows the case where the user has connected the electronic information board 3 to PC5, and the screen of PC5 is called the main screen, and the screen of electronic information board 3 is called the sub-screen. Figure 5(C) shows the state in Figure 5(B) where applications are automatically placed on each screen in a screen layout suitable for the orientation (landscape orientation) of the touch panel display 11 of the electronic information board 3.

[0050] Next, Figure 6 will be used to explain the different orientations of the foldable electronic information board 3 and the tilt of the display. Figures 6(A), (B), (C), and (D) show the electronic information board 3 set in different orientations, which are called flat, horizontal, vertical, and vertical (folded), respectively.

[0051] As shown in Figure 6(A), when placed flat, there is no adjustment of the screen's folding angle, and the screen's folding angle is 0 degrees relative to the horizontal. As shown in Figures 6(B) and (C), when placed horizontally or vertically, the tilt of the display can be adjusted by adjusting the tilt angle of the stand that supports the main unit. In Figures 6(B) and (C), the display angle in horizontal orientation is 30 degrees, and the display angle in vertical orientation is 60 degrees.

[0052] As shown in Figure 6(D), in the vertical (folded) configuration, the electronic information board 3 is placed horizontally, with the lower half remaining horizontal, and the upper half folded in a vertical position. The user adjusts the angle of the fold to set the angle of the upper screen display. In Figure 6(D), the angle of the vertical (folded) display is 90 degrees.

[0053] As an example of the optimal application placement on the foldable electronic information board 3, we will explain assuming it is connected to PC5 in the vertical (folded) position shown in Figure 6(D). In this case, PC5 displays a video conferencing application on its screen, the upper half of the electronic information board 3 displays a presentation application screen, and the lower half displays a whiteboard application screen (an application that allows handwritten notes on the touch display). Now, for example, if the orientation of the foldable electronic information board 3 is changed to a flat position, the electronic information board 3 will place the whiteboard application screen across its entire surface at the command of PC5, and the PC5 screen will be divided into two halves to display the video conferencing application and the presentation application screens.

[0054] The specific orientation and tilt of such a foldable display can be detected by the detection unit 31 using, for example, a 6-axis sensor 19 (a 3-axis gyro sensor and a 3-axis accelerometer). The folding angle can be detected using a sensor installed at the folding point. Alternatively, the folding angle may be detected using a 3-axis gyro sensor. Alternatively, accelerometers may be placed on the upper and lower screens (Figure 6(D)) of the electronic information board 3, and the difference in the angle of each accelerometer relative to the direction of gravity may be used as the folding angle (the upper screen is 90 degrees and the lower screen is 0 degrees, so the folding angle is 90 degrees). Note that the accuracy of the angle detected by the detection unit 31 does not need to be strict, and there may be a range in the angle (e.g., in increments of 5 degrees). Also, as a method of folding, the display may be placed horizontally (folded) instead of vertically (folded) as shown in Figure 6(D).

[0055] The electronic information board 3 transmits the detected result to the PC 5 (or smartphone, tablet device). After receiving the detection result, the PC 5 determines the application placement based on the pre-prepared application placement screen layout table 40. If the corresponding application is not running, the PC 5 may start and display the application.

[0056] Figure 7 shows an example of an application placement screen layout table 40. In this example, the screen layout table 40 is used when connecting a foldable electronic information board 3 to a PC 5. The screen layout table 40 is a table that associates detection information detected by the detection unit 31 with the placement location of applications, and is used to place the screens of each application in different locations on the display. In other words, the screen layout table 40 associates detection information with screen layout information, which is placement information.

[0057] "Posture" refers to the orientation of the touch panel display 11 of the electronic information board 3, as detected by the detection unit 31. Here, "posture" is an example of detected information.

[0058] "Display tilt" refers to the tilt of the touch panel display 11 of the electronic information board 3 detected by the detection unit 31, and is the angle of the touch panel display 11 relative to the horizontal. Note that the angle is not a fixed value, but may be set as a range, for example, from 25 to 35 degrees. Here, "display tilt" is an example of detection information.

[0059] "Application placement" refers to the number of screens on the electronic information board 3 where applications are placed. In the case of one screen, the screen of one application is displayed across the entire touch panel display 11, and in the case of two screens, the entire touch panel display 11 is divided into two sections to display two applications. Here, since the applications are displayed in areas of different sizes in the case of one screen and two screens, "application placement" can also indicate the size.

[0060] The "main screen" is the application displayed on PC5's display 506.

[0061] "Subscreen 1" is the screen of the first application displayed on the touch panel display 11 of the electronic information board 3. Subscreen 1 and Subscreen 2, described below, define the arrangement (position) of the application screen on the touch panel display 11.

[0062] "Sub-screen 2" is the screen of a second application displayed on the touch panel display 11 of the electronic information board 3. "Sub-screen 2" is set only when "Application Layout" is set to two screens. In the case of a foldable display, the folding part may be made to be the boundary between "Sub-screen 1" and "Sub-screen 2". Here, "Sub-screen 1" and "Sub-screen 2" are different layouts (positions) on the display, and can be distinguished, for example, by the coordinates of the diagonal vertices of the display. Therefore, this information can indicate the layout (position), and furthermore, it can also indicate the size.

[0063] The "set name" is the name of the screen layout displayed in the application that accepts the screen layout settings.

[0064] The settings in the screen layout table 40 are managed by an application (referred to as the "screen control application") that resides on the PC 5, allowing the user to check and change the settings at any time. Furthermore, the application deployment may be executed automatically, for example, when the electronic information board 3 is connected to the PC 5, or it may be executed manually by the user.

[0065] <Regarding processing> (Automatic screen layout processing) Next, using Figure 8, we will explain the process of automatically determining the screen layout and deploying applications without user selection when the electronic information board 3 is connected to the PC 5. Figure 8 is a diagram showing an example of a flowchart of the application deployment process based on the screen layout table 40 according to the first embodiment. The processes executed in steps S50 to S54 will be explained below.

[0066] S50: The user connects the electronic information board 3 to the PC5. A screen control application running in the background on the PC5 detects the connection of the electronic information board 3.

[0067] S51: When the electronic information board 3 recognizes that it is connected to PC5, the detection unit 31 detects information regarding the orientation, tilt, and bending angle of the touch panel display 11. The detection unit 31 transmits the detected information and the automatic layout request obtained from the first setting storage unit 34 to the first communication unit 32.

[0068] S52: The first communication unit 32 of the electronic information board 3 transmits the detection information and automatic layout request to the second communication unit 22 of the terminal device 2. The second communication unit 22 transmits the received detection information and automatic layout request to the determination unit 21.

[0069] S53: The determination unit 21 refers to the screen layout table 40 to determine the layout information corresponding to the received detection information and transmits the determined layout information to the second display control unit 23.

[0070] S54: The second display control unit 23 displays the application screen on the PC 5's display 506 based on the received layout information, and further transmits the screen information to be displayed on the electronic information board 3's touch panel display 11 to the second communication unit 22. There are, for example, two methods for transmitting the screen information.

[0071] 1. In a usage configuration where the touch panel display 11 of the electronic information board 3 and the display of the PC 5 are independently controlled: The second display control unit 23 transmits screen information and layout information (coordinates of the diagonal vertices of the touch panel display 11 on which the screen is placed) of each application to be displayed on the touch panel display 11 of the electronic information board 3 to the second communication unit 22. The second communication unit 22 transmits the received screen information and layout information to the first communication unit 32. The first display control unit 33 displays the application screen on the touch panel display 11 based on the received layout information and screen information.

[0072] 2. When the touch panel display 11 of the electronic information board 3 can be considered as an extended display of the PC 5, the second display control unit 23 treats the main screen and sub-screen as a single display area and arranges the application screen based on the arrangement information. The second display control unit 23 outputs a video signal from the display I / F. The electronic information board 3 receives a video signal from the display I / F and outputs it to the touch panel display 11.

[0073] Through the above process, when the electronic information board 3 is connected to the PC 5, the determination unit 21 of the PC 5 determines the screen layout information, which is the arrangement information, based on the screen layout table 40 corresponding to the orientation, tilt, and bending angle of the display. The electronic information board 3 then displays the application screen on the touch panel display 11 based on the received arrangement information. This allows the user to use a video conferencing application at an appropriate camera angle or a memo application at an angle that makes text input easy. (User-initiated manual layout changes and configuration information updates) Next, using Figure 9, we will explain the process of a user manually selecting and executing a screen layout, and the process of a user updating the screen layout table (adding a new set). Figure 9 shows an example of a screen during user-initiated screen layout execution and configuration information update.

[0074] On PC5, an application that manages the screen layout table 40 is always running in the background. When the user clicks the icon 61 displayed at the bottom of PC5's screen 60 with the mouse, the settings screen 62 is displayed. If the user selects "Set 2" 77 here, the screen layout of Set 2 in the screen layout table 40 is applied, and the same process as in S54 in Figure 9 is executed, resulting in the display of the email application 63 on PC5's screen 60 and the document display application 65 and web browser 77 on the screen 64 of the electronic information board 3. In this way, the user can select and execute any screen layout from the settings screen 62.

[0075] Furthermore, if a user wants to add a set to the screen layout table 40, they place the desired screen layout application, then select "Set" 68 on the settings screen 67, a pop-up screen 70 will appear, and they click "Yes" 71. The set name field (72), "Set 5" 73, may be displayed automatically or entered by the user. In the example shown, the email application 69 is placed on the PC5 screen 66, and the video conferencing application 75 is placed on the electronic information board 3 screen 74. As a result, the second setting storage unit 24 adds the current screen layout as "Set 5" to the screen layout table 40.

[0076] Furthermore, screen layout sets can be stored on a per-file basis for each file the app has open. For example, document file A.doc and document file B.doc could each be stored with different layouts. Also, if the app is a web browser, the layout could be stored for each URL displayed, or it could be set up so that URLs are not distinguished.

[0077] Through the above process, users can change the settings related to the screen layout table 40.

[0078] Next, using Figure 10, we will explain the process by which the user can configure whether or not to automatically execute the screen layout when the electronic information board 3 is connected to the PC 5. Figure 10 shows an example of the screen layout detailed settings screen used by the user to configure automatic screen layout settings. This screen can be displayed, for example, by clicking "Settings" 76 in Figure 9.

[0079] The user can check the current set contents, applications, and their arrangement on the screen layout details settings screen 80 displayed on the PC5 screen. Furthermore, by clicking the icon 81 at the bottom of the screen layout details settings screen 80, the user can configure whether or not to automatically execute the screen layout when the electronic information board 3 is connected to the PC5. The configured information is stored in the first setting storage unit 34 of the electronic information board 3. If the user configures the system not to automatically execute the screen layout, the electronic information board 3 will not send a request to the PC5 to execute the automatic layout when connected.

[0080] Furthermore, in the selection field 82 for selecting screen layouts, the user can also set the screen layout to be executed for each orientation when the electronic information board 3 is connected to the PC 5. In addition, the detailed screen layout settings screen 80 may allow the user to rename or delete sets. Also, conditions may be set, for example, that up to 5 sets can be stored, and that the number of applications in one set is a maximum of N or unlimited.

[0081] Furthermore, if, at the time of PC5 startup, a display such as the electronic information board 3 is not connected, or if the resolution of the electronic information board 3 has been changed, and PC5 is unable to arrange applications based on the screen layout information, applications may be arranged based on the top left corner of the PC5 screen (main screen). In this case, the sub-screen will not be used.

[0082] Furthermore, if an application is already running, the application running in the background on PC5 may not launch the same application twice, but instead change the placement of the already running application. Additionally, the above application may collect data on the user's screen layout usage and automatically set the screen layout.

[0083] Through the above process, users can configure whether or not to automatically execute the screen layout.

[0084] Although several embodiments for carrying out the present invention have been described above, the present invention is not limited in any way to these embodiments, and various modifications and substitutions can be made without departing from the spirit of the present invention.

[0085] For example, the configuration example of the functional block diagram in Figure 4 is divided according to the main functions in order to facilitate understanding of the processing performed by the terminal device 2 and the electronic information board 3. The present invention is not limited by the way the processing units are divided or the names of the units. The processing of the terminal device 2 and the electronic information board 3 can be further divided into more processing units depending on the processing content. It is also possible to divide the processing units so that each unit contains even more processing. Furthermore, the PC (Personal Computer) 5 is one form of the terminal device 2 and may be a smartphone or a tablet terminal.

[0086] Furthermore, the display device can be liquid crystal displays (LCDs), plasma displays, electrophoretic displays, organic light-emitting diodes (OLEDs), mini-LEDs, micro-LEDs, etc., but is not limited to these. The touch panel can be applied to various methods, including resistive touch, capacitive touch, ultrasonic, infrared, and electromagnetic induction touch, but is not limited to these.

[0087] Furthermore, each function of the embodiments described above can be realized by one or more processing circuits. Hereinafter, "processing circuit" as used herein includes processors programmed to execute each function by software, such as processors implemented by electronic circuits, as well as devices such as ASICs (Application Specific Integrated Circuits), DSPs (digital signal processors), FPGAs (field programmable gate arrays), and conventional circuit modules designed to execute each of the functions described above.

[0088] Furthermore, the designations "first" and "second" may be omitted for the first communication unit 32, the second communication unit 22, the first display control unit 33, the second display control unit 23, the first setting storage unit 34, the second setting storage unit 24, the first operation receiving unit 35, and the second operation receiving unit 25, as long as the device having each of these functional units can be identified.

[0089] Examples of the present invention are as follows: <1> The display and The detection information relating to at least one of the orientation, tilt, and bending angle of the display is transmitted to a terminal device capable of running the application. A communication unit that receives the application's layout information and the application's screen information transmitted from the terminal device, An information processing device having a display control unit that displays the screen of the application on the display based on the arrangement information and screen information received by the communication unit, A terminal device having a determination unit that determines the arrangement information corresponding to the detection information transmitted from the information processing device based on the detection information, It is an information processing system that has [a certain feature]. <2> If the detection information includes the bending angle, The determination unit determines the arrangement information for arranging different applications on either side of the folding portion. <1> This is the information processing system described in [the relevant document]. <3> The determination unit determines placement information for placing different applications in different locations on the display, based on the tilt of the display. <1> or <2> This is the information processing system described in [the relevant document]. <4> For the same tilt of the display, the arrangement information is associated with the placement of different applications according to the orientation of the display. <3> This is the information processing system described in [the relevant document]. <5> The aforementioned placement information also includes the application that uses the terminal device as its placement destination. <1> from <4> It is an information processing system described in any of the following. <6> The terminal device has a setting storage unit that stores a screen layout table in which the detection information and the arrangement information are associated. The determination unit determines the layout information based on the screen layout table. <1> from <5> It is an information processing system described in any of the following. <7> The terminal device further includes an operation reception unit that accepts user settings changes related to the screen layout table. <6> This is the information processing system described in [the relevant document]. <8> The operation reception unit is characterized by receiving user input regarding whether or not to automatically determine the layout information when the information processing device and the terminal device are connected. <7> This is the information processing system described in [the relevant document]. <9> The display and The detection information relating to at least one of the orientation, tilt, and bending angle of the display is transmitted to a terminal device capable of running the application. A communication unit that receives the application placement information determined based on the detection information and the application screen information transmitted from the terminal device, A display control unit that displays the application screen on the display based on the arrangement information and screen information received by the communication unit, It is an information processing device. <10> The display and A communication unit that transmits detection information relating to at least one of the orientation, tilt, and bending angle of the display to a terminal device capable of running an application, An information processing apparatus having a first display control unit that displays the screen of the application by displaying the video signal output from the terminal device on the display, A determination unit that determines arrangement information corresponding to the detection information transmitted from the information processing device based on the detection information, A terminal device having: a terminal device and a second display control unit which combines the display of the terminal device and the display of the information processing device into a single display area and generates a video signal in which the screens of multiple applications are arranged based on the arrangement information determined by the determination unit; It is an information processing system that has [a certain feature]. <11> A screen display method performed by an information processing device that displays a screen on a display, The steps include transmitting detection information relating to at least one of the orientation, tilt, and bending angle of the display to a terminal device capable of running an application, The steps include receiving placement information corresponding to the detection information of the application transmitted from the terminal device and screen information of the application, The steps include: displaying the screen of the application on the display based on the arrangement information and the screen information; This is a screen display method that has [a specific feature / feature]. <12> In an information processing device that displays a screen on a display, The steps include transmitting detection information relating to at least one of the orientation, tilt, and bending angle of the display to a terminal device capable of running an application, The steps include receiving placement information corresponding to the detection information of the application transmitted from the terminal device and screen information of the application, The steps include: displaying the screen of the application on the display based on the arrangement information and the screen information; This is a program to execute [the command / action]. <13> On a terminal device capable of running the application, The steps include receiving detection information from the information processing device regarding at least one of the orientation, tilt, and bending angle of the display of the information processing device, The steps include determining the placement information of the application corresponding to the detection information transmitted from the information processing device based on the detection information, The steps include transmitting the aforementioned arrangement information and the application screen information to the information processing device, This is a program to execute [the command / action]. <14> A terminal device capable of running applications, A determination unit that determines the placement information of the application corresponding to the detection information received from the information processing device, based on detection information received from the information processing device regarding at least one of the orientation, tilt, and bending angle of the display. A communication unit that transmits the determined layout information and screen information of the application to the information processing device, It is a terminal device that has [a certain feature]. [Explanation of symbols]

[0090] 1. Information Processing System 2 Terminal devices 3. Electronic information board 5 PC (Personal Computer) 11 Touch panel display 14, 501 CPU(Central Processing Unit) 21 Decision Section 22. Second Communications Department 23 Second Display Control Unit 24 2nd setting storage section 25 Second Operation Reception Section 31 Detection unit 32. First Communications Department 33. First Display Control Unit 34 1st setting storage section 35. First Operation Reception Section 36 Contact position detection unit 40 Screen Layout Table 506 displays 517 GPU(Graphic Processing Unit) [Prior art documents] [Patent Documents]

[0091] [Patent Document 1] International public access number WO2015 / 190002

Claims

1. The display and The detection information regarding the installation direction, whether or not the display is bent, and the angle is transmitted to a terminal device capable of running the application. A communication unit that receives the application's layout information and the application's screen information transmitted from the terminal device, An information processing device having a display control unit that displays the screen of the application on the display based on the arrangement information and screen information received by the communication unit, A terminal device having a determination unit that determines the arrangement information corresponding to the detection information transmitted from the information processing device based on the detection information, It has, The aforementioned placement information also includes the application that uses the terminal device as its placement destination. Information processing system.

2. If the detection information includes information that the display is bent, The information processing system according to claim 1, wherein the determination unit determines the arrangement information for arranging different applications on either side of the folding portion.

3. The information processing system according to claim 1 or 2, wherein the determination unit determines the placement information for arranging different applications at different locations on the display with respect to the angle of the display.

4. The information processing system according to claim 3, wherein arrangement information is associated with the same angle of the display, and arrangement information is associated with the placement of different applications depending on the installation direction and whether or not the display is bent.

5. The terminal device has a setting storage unit that stores a screen layout table in which the detection information and the arrangement information are associated. The information processing system according to claim 1, wherein the determination unit determines the arrangement information based on the screen layout table.

6. The information processing system according to claim 5, wherein the terminal device further comprises an operation reception unit that accepts user settings changes related to the screen layout table.

7. The information processing system according to claim 6, characterized in that the operation reception unit receives user input regarding whether or not to automatically determine the arrangement information when the information processing device and the terminal device are connected.

8. The display and The detection information regarding the installation direction, whether or not the display is bent, and the angle is transmitted to a terminal device capable of running the application. A communication unit that receives the application placement information determined based on the detection information and the application screen information transmitted from the terminal device, A display control unit that displays the application screen on the display based on the arrangement information and screen information received by the communication unit, It has, The aforementioned placement information also includes the application that uses the terminal device as its placement destination. Information processing device.

9. The display and A communication unit transmits detection information regarding the installation direction, whether or not the display is bent, and its angle to a terminal device capable of running an application. An information processing apparatus having a first display control unit that displays the screen of the application by displaying the video signal output from the terminal device on the display, A determination unit that determines arrangement information corresponding to the detection information transmitted from the information processing device based on the detection information, A terminal device having: a terminal device and a second display control unit which combines the display of the terminal device and the display of the information processing device into a single display area and generates a video signal in which the screens of multiple applications are arranged based on the arrangement information determined by the determination unit; It has, The aforementioned placement information also includes the application that uses the terminal device as its placement destination. Information processing system.

10. A screen display method performed by an information processing device that displays a screen on a display, The steps include transmitting detection information regarding the installation direction, whether or not the display is bent, and the angle to a terminal device capable of running an application, The steps include receiving placement information corresponding to the detection information of the application transmitted from the terminal device and screen information of the application, The steps include: displaying the screen of the application on the display based on the arrangement information and the screen information; It has, The aforementioned placement information also includes the application that uses the terminal device as its placement destination. Screen display method.

11. A program to be executed by an information processing device that displays a screen on a display, The steps include transmitting detection information regarding the installation direction, whether or not the display is bent, and the angle to a terminal device capable of running an application, The steps include receiving placement information corresponding to the detection information of the application transmitted from the terminal device and screen information of the application, The steps include: displaying the screen of the application on the display based on the arrangement information and the screen information; It has, The aforementioned placement information also includes the application that uses the terminal device as its placement destination. program.

12. A program to be executed on a terminal device capable of running applications, The steps include receiving detection information from the information processing device regarding the installation direction, whether or not it is bent, and angle of the display of the information processing device, The steps include determining the placement information of the application corresponding to the detection information transmitted from the information processing device based on the detection information, The steps include transmitting the aforementioned arrangement information and the application screen information to the information processing device, It has, The aforementioned placement information also includes the application that uses the terminal device as its placement destination. program.

13. A terminal device capable of running applications, A determination unit that determines the placement information of the application corresponding to the detection information received from the information processing device, based on detection information received from the information processing device regarding the installation direction, whether or not the display is bent, and the angle. A communication unit that transmits the determined layout information and screen information of the application to the information processing device, It has, The aforementioned placement information also includes the application that uses the terminal device as its placement destination. Terminal device.

Images