Terminal device, terminal device operation method, and system

The terminal device adjusts image output to match different input/output environments, ensuring seamless image sharing and user convenience by maintaining aspect ratio and orientation, and dynamically updating input/output areas.

JP7673708B2Active Publication Date: 2025-05-09TOYOTA JIDOSHA KK
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2022122926
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-08-01
Publication Date
2025-05-09
Estimated Expiration
2042-08-01

AI Technical Summary

Technical Problem

When the input or output environments of images between different computers are dissimilar, it can lead to inconvenience for users due to hindered image output.

Method used

A terminal device with an input/output screen that accepts touch input and displays images, equipped with a communication unit and a control unit. The control unit adjusts the output image to match the receiving device's input/output area, maintaining the aspect ratio and orientation, and dynamically updates the input/output area to accommodate new image inputs.

Benefits of technology

This solution allows for seamless image sharing between terminal devices with different input/output environments, ensuring user convenience by maintaining image aspect ratio and orientation, and effectively utilizing screen margins.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007673708000001
    Figure 0007673708000001
  • Figure 0007673708000002
    Figure 0007673708000002
  • Figure 0007673708000003
    Figure 0007673708000003
Patent Text Reader

Abstract

To contribute to user convenience by adjusting a difference in environments between computers.SOLUTION: A terminal device comprises: an input-output screen including a rectangular input-output region for receiving a touch input and displaying an image; a communication unit communicating with other terminal devices including input-output regions having different longitudinal directions; and a control unit transmitting an output image corresponding to a first square region where one short side of the input-output region serves as one side and including an image to the other terminal devices and causing the other terminal devices to display the output image in a second square region where one short side of the input-output regions of the other terminal devices serves as one side when the image is input to an own input-output region. The control unit uses regions other than the first square region in the own input-output region as a new input-output region.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a terminal device, a method for operating a terminal device, and a system. [Background technology]

[0002] There is known a technology that allows computers at multiple locations to communicate over a network, and allows users of the computers to have voice calls with each other and exchange information such as images drawn on a touch panel. Patent Document 1 discloses a technology related to control of the update timing of images shared between computers. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-022377 A Summary of the Invention [Problem to be solved by the invention]

[0004] When the input or output environments of the computers for images and the like are different, any problems in outputting the shared images may cause inconvenience to the users.

[0005] In view of the above, a terminal device etc. capable of adjusting to differences in environment and contributing to user convenience is disclosed below. [Means for solving the problem]

[0006] The terminal device of the present disclosure has an input / output screen having a rectangular input / output area that accepts touch input and displays images, a communication unit that communicates with other terminal devices having the input / output area with a different longitudinal direction, and a control unit that, when an image is input into its own input / output area, sends an output image including the image to the other terminal device and causes the other terminal device to display the output image in a second square area having one short side of the input / output area of ​​the other terminal device, and the control unit designates an area other than the first square area in its own input / output area as a new input / output area.

[0007] Another terminal device of the present disclosure has an input / output screen having a rectangular input / output area that accepts touch input and displays images, a communication unit that communicates with other terminal devices having the input / output area with a different longitudinal direction, and a control unit that, when an image is input from the other terminal device to the input / output area of ​​the other terminal device and an output image including the image is sent that corresponds to a first square area having one short side of the input / output area, displays the output image in a second square area having one short side of its own input / output area, and the control unit sets an area other than the second square area in its own input / output area as a new input / output area.

[0008] The system disclosed herein is a system having an input / output screen with a rectangular input / output area that accepts touch input and displays images, and having a pair of terminal devices with different longitudinal directions of the input / output area, where when an image is input into a first terminal device's input / output area, the first terminal device sends an output image including the image to a second terminal device, the second terminal device displays the output image in a square area having one short side of its input / output area as one side, and the first and second terminal devices each use an area other than the square area in their own input / output areas as a new input / output area. Effect of the Invention

[0009] According to the terminal device etc. of the present disclosure, it is possible to adjust for differences in environments between computers, thereby contributing to user convenience. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 illustrates an example of the configuration of a communication system. [Diagram 2] FIG. 11 is a sequence diagram showing an example of the operation of the communication system. [Figure 3A] FIG. 11 is a flowchart illustrating an example of the operation of the terminal device. [Figure 3B] FIG. 11 is a flowchart illustrating an example of the operation of the terminal device. [Figure 4A] FIG. 13 is a diagram illustrating an example of an input / output area. [Figure 4B] FIG. 13 is a diagram illustrating an example of an input / output area. [Figure 4C] FIG. 13 is a diagram illustrating an example of an input / output area. [Figure 4D] FIG. 13 is a diagram illustrating an example of an input / output area. [Figure 4E] FIG. 13 is a diagram illustrating an example of an input / output area. [Figure 5A] FIG. 13 is a diagram illustrating an example of image sharing. [Figure 5B] FIG. 13 is a diagram illustrating an example of image sharing. [Figure 5C] FIG. 13 is a diagram illustrating an example of image sharing. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] The following describes the embodiments.

[0012] 1 is a diagram showing an example of the configuration of a communication system 1 according to an embodiment. The communication system 1 includes a server device 10 and a plurality of terminal devices 12 that are connected to each other so as to be able to communicate with each other via a network 11. The communication system 1 is a system that enables a plurality of users to talk to each other and share images using each of the terminal devices 12.

[0013] The server device 10 is, for example, a server computer that belongs to a cloud computing system or other computing system and functions as a server that implements various functions. The server device 10 may be composed of two or more server computers that are connected to each other so as to be able to communicate information and operate in cooperation with each other. The server device 10 executes relay processing of calls and images.

[0014] The terminal device 12 is an information processing device equipped with a communication function and an input / output function of voice and image, and is used by each user. The terminal device 12 is, for example, an information processing terminal such as a smartphone or a tablet terminal, an information processing device such as a personal computer, or a touch screen device equipped with communication and information processing functions.

[0015] Network 11 may be, for example, the Internet, but may also include an ad-hoc network, a Local Area Network (LAN), a Metropolitan Area Network (MAN), or other network, or any combination thereof.

[0016] In this embodiment, the terminal device 12 has an input unit 125 and an output unit 126 corresponding to an input / output screen having a rectangular input / output area that accepts touch input and displays an image. The terminal device 12 also has a communication unit 121 that communicates with other terminal devices 12 having input / output areas with different longitudinal directions. When an image is input to its own input / output area, the control unit 123 of the terminal device 12 sends an output image that corresponds to a square area with one short side of the input / output area as one side and includes the input information to the other terminal device 12. When the control unit 103 receives an output image based on the input / output area of ​​the other terminal device 12 from the other terminal device 12, it displays the output image in the square area. Then, the control unit 123 performs a process of sending out an image or a process of displaying an image using an area other than the square area in its own input / output area as a new input / output area. According to this embodiment, a pair of terminal devices 12 each having a vertically long input / output area and a horizontally long input / output area share an output image using a square area (hereinafter, referred to as a shared area), so that the output image can be shared while maintaining the aspect ratio and up / down orientation of the output image. Therefore, it is possible to adjust the difference in the environment between the terminal devices 12 and contribute to user convenience.

[0017] The configurations of the server device 10 and the terminal device 12 will now be described in detail.

[0018] The server device 10 includes a communication unit 101, a storage unit 102, a control unit 103, an input unit 105, and an output unit 106. When the server device 10 is configured with two or more server computers, these components are appropriately arranged in the two or more computers.

[0019] The communication unit 101 includes one or more communication interfaces. The communication interface is, for example, a LAN interface. The communication unit 101 receives information used in the operation of the server device 10, and transmits information obtained by the operation of the server device 10. The server device 10 is connected to a network 11 by the communication unit 101, and communicates information with a terminal device 12 via the network 11.

[0020] The storage unit 102 includes, for example, one or more semiconductor memories, one or more magnetic memories, one or more optical memories, or a combination of at least two of them, functioning as a main storage device, an auxiliary storage device, or a cache memory. The semiconductor memory is, for example, a random access memory (RAM) or a read only memory (ROM). The RAM is, for example, a static RAM (SRAM) or a dynamic RAM (DRAM). The ROM is, for example, an electrically erasable programmable ROM (EEPROM). The storage unit 102 stores information used in the operation of the server device 10 and information obtained by the operation of the server device 10.

[0021] The control unit 103 includes one or more processors, one or more dedicated circuits, or a combination of these. The processor is, for example, a general-purpose processor such as a CPU (Central Processing Unit), or a dedicated processor such as a GPU (Graphics Processing Unit) specialized for a specific process. The dedicated circuit is, for example, an FPGA (Field-Programmable Gate Array), an ASIC (Application Specific Integrated Circuit), etc. The control unit 103 executes information processing related to the operation of the server device 10 while controlling each unit of the server device 10.

[0022] The input unit 105 includes one or more input interfaces. The input interface is, for example, a physical key, a capacitive key, a pointing device, a touch screen integrated with a display, or a microphone that accepts voice input. The input unit 105 accepts an operation to input information used in the operation of the server device 10, and sends the input information to the control unit 103.

[0023] The output unit 106 includes one or more output interfaces. The output interface is, for example, a display or a speaker. The display is, for example, an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) display. The output unit 106 outputs information obtained by the operation of the server device 10.

[0024] The functions of the server device 10 are realized by a processor included in the control unit 103 executing a control program. The control program is a program for causing a computer to function as the server device 10. Also, some or all of the functions of the server device 10 may be realized by a dedicated circuit included in the control unit 103. Also, the control program may be stored in a non-transitory recording / storage medium readable by the server device 10, and read by the server device 10 from the medium.

[0025] The terminal device 12 includes a communication unit 121 , a storage unit 122 , a control unit 123 , an input unit 125 , and an output unit 126 .

[0026] The communication unit 121 has a communication module compatible with a wired or wireless LAN standard, a module compatible with a mobile communication standard such as LTE, 4G, 5G, etc. The terminal device 12 is connected to the network 11 by the communication unit 121 via a nearby router device or a mobile communication base station, and performs information communication with the server device 10, etc. via the network 11.

[0027] The memory unit 122 includes one or more semiconductor memories, one or more magnetic memories, one or more optical memories, or a combination of at least two of these. The semiconductor memories are, for example, RAM or ROM. The RAM is, for example, SRAM or DRAM. The ROM is, for example, EEPROM. The memory unit 122 functions as, for example, a main memory device, an auxiliary memory device, or a cache memory. The memory unit 122 stores information used in the operation of the control unit 123 and information obtained by the operation of the control unit 123.

[0028] The control unit 123 has, for example, one or more general-purpose processors such as a CPU, an MPU (Micro Processing Unit), or one or more dedicated processors such as a GPU specialized for a specific process. Alternatively, the control unit 123 may have one or more dedicated circuits such as an FPGA, an ASIC, or the like. The control unit 123 generally controls the operation of the terminal device 12 by operating according to a control / processing program, or operating according to an operating procedure implemented as a circuit. The control unit 123 transmits and receives various information to and from the server device 10, etc. via the communication unit 121, and executes the operation according to this embodiment.

[0029] The input unit 125 includes one or more input interfaces. The input interfaces include, for example, physical keys, capacitive keys, a pointing device, and a touch screen that is integral with a display. The input interfaces also include a microphone that accepts voice input, and a camera that captures captured images. The input interfaces may also include a scanner or camera that scans image codes, and an IC card reader. The input unit 125 accepts an operation to input information used in the operation of the control unit 123, and sends the input information to the control unit 123.

[0030] The output unit 126 includes one or more output interfaces. The output interfaces include, for example, a display and a speaker. The display is, for example, an LCD or an organic EL display. The output unit 126 outputs information obtained by the operation of the control unit 123.

[0031] In this embodiment, the output unit 126 as a display and the input unit 125 as a touch screen integrally provided therewith correspond to an "input / output screen" for receiving input of an image drawn by touch input and displaying the image. The "input / output area" is a part or the whole of the input / output screen where the touch input and the image display are performed.

[0032] The functions of the control unit 123 are realized by a processor included in the control unit 123 executing a control program. The control program is a program for causing the processor to function as the control unit 123. A part or all of the functions of the control unit 123 may be realized by a dedicated circuit included in the control unit 123. The control program may be stored in a non-transitory recording / storage medium readable by the terminal device 12, and may be read by the terminal device 12 from the medium.

[0033] In this embodiment, the control unit 123 collects the speech of the user of the terminal device 12 with the microphone of the input unit 125, and accepts an image input by touch input on the input / output screen. The control unit 123 also generates encoded information by encoding voice information for reproducing the user's voice and an image for output. The control unit 123 may perform any processing (for example, resolution change and trimming) on ​​the image for output when encoding. The control unit 123 transmits the encoded information to the other terminal device 12 via the server device 10 by the communication unit 121. The control unit 123 also receives the encoded information transmitted from the other terminal device 12 via the server device 10 by the communication unit 121. When the control unit 123 decodes the encoded information, the control unit 123 uses the decoded information to output the speech of the user of the other terminal device 12 from the speaker of the output unit 126, or to output the image for output by the input / output screen.

[0034] 2 is a sequence diagram for explaining the operation procedure of the communication system 1. In this sequence diagram, an example of the operation procedure between the server device 10 and a plurality of terminal devices 12 that communicate with each other via the server device 10 is shown as an example of the procedure between the server device 10 and a pair of terminal devices 12A and 12B. In the following, matters common to the terminal devices 12A and 12B are collectively referred to as the terminal devices 12, and when they need to be distinguished from each other, they are distinguished as the terminal devices 12A and 12B. In addition, the users of the terminal devices 12A and 12B are referred to as user A and user B, respectively, for convenience.

[0035] 2 are executed by the respective control units 103 and 123. Moreover, the steps relating to the transmission and reception of various information in the server device 10 and the terminal device 12 are executed by the respective control units 103 and 123 transmitting and receiving information to each other via the communication units 101 and 121, respectively. In the server device 10 and the terminal device 12, the control units 103 and 123 store the information to be transmitted and received in the storage units 102 and 122, respectively, as appropriate. Furthermore, the control unit 123 of the terminal device 12 accepts input of various information through the input unit 125 and outputs various information through the output unit 126.

[0036] In step S201, the server device 10 sends connection information to the terminal device 12A. The connection information includes, for example, information indicating a call partner with which the user A of the terminal device 12A can make a call, for example, the user B of the terminal device 12B. Then, in step S202, the terminal device 12A sends a connection request with the terminal device 12B to the server device 10. For example, when the user A operates the terminal device 12A to input a call request with the user B, in response to this, the terminal device 12A sends a connection request specifying the terminal device 12B to the server device 10. For example, the users A and B register their respective identification information and the information of the terminal devices 12A and 12B in advance on a site for a call service provided by a call service provider through the server device 10. Then, when the user A who wants to make a call accesses the site for the call service using the terminal device 12A, the information of the user B is acquired in a selectable manner. The user A selects the user B and inputs a call request, and a connection request is sent to the server device 10.

[0037] In step S203, the server device 10 sends the connection request from the terminal device 12A to the terminal device 12B. Then, in step S205, the terminal device 12B sends a connection acceptance to the server device 10. For example, the terminal device 12B displays a call request from the user A of the terminal device 12A to the user B, and when the user B inputs an acceptance to the terminal device 12B, in response to this, the terminal device 12B sends information indicating the acceptance to the server device 10.

[0038] In step S206, the server device 10 sends a connection confirmation to the terminal device 12A.

[0039] In step S207, a connection is established between the terminal device 12A and the terminal device 12B, and preparation for communication is completed.

[0040] In step S208, the terminal devices 12A and 12B accept voice input and image input from the users A and B, respectively, and transmit the voice information and output images to the other party via the server device 10. The terminal devices 12A and 12B also output the voice information and output images transmitted from the other party to the users A and B, respectively. In this way, the users A and B communicate and share images using the terminal devices 12A and 12B, respectively.

[0041] A detailed example of the procedure of the operation of the terminal device 12 in step S208 is shown in FIGS. 3A and 3B.

[0042] 3A and 3B are flow charts for explaining the operation procedure of the terminal device 12 related to calling and image sharing. The procedure shown here is common to the terminal devices 12A and 12B, and will be explained without distinguishing between the terminal devices 12A and 12B.

[0043] Fig. 3A relates to an operation procedure of the control unit 123 when each terminal device 12 transmits information based on an input voice and an input image by a user using the terminal device 12. The procedure of Fig. 3A is executed at an arbitrarily set cycle of several milliseconds to several tens of milliseconds, for example.

[0044] In step S302, the control unit 123 receives collected voice of the user's speech and an image input from the input unit 125. The control unit 123 obtains the voice information from the input unit 125 and also obtains the input image.

[0045] In step S303, the control unit 123 determines whether or not an image is to be input within a defined shared area. If a shared area is not defined (No), the control unit 123 proceeds to step S304.

[0046] In step S304, the control unit 123 defines a shared area. In the rectangular input / output area, the control unit 123 defines a square shared area with the shorter side closer to the input image as one side. The control unit 123 also defines a boundary between the shared area and an area other than the shared area in the input / output area. Furthermore, the control unit 123 updates the input / output area so that the area other than the shared area in the input / output area becomes a new input / output area.

[0047] For example, as shown in FIG. 4A, in an input / output area 41 having a horizontally long rectangle with left and right short sides 42L and 42R, when an image 43 close to the left short side 42L is drawn, a square shared area 44 having a short side 42L as one side is defined together with a boundary 45, and the input / output area 41 is updated as a new input / output area 46. Also, as shown in FIG. 4B, when an image 43 close to the right short side 42R is drawn in a horizontally long input / output area 41, a square shared area 44 having a short side 42R as one side is defined together with a boundary 45, and the input / output area 41 is updated as a new input / output area 46. Furthermore, as shown in FIG. 4C, when an image 43 close to the upper short side 42U is drawn in an input / output area 41 having a vertically long rectangle with top and bottom short sides 42U and 42B, a square shared area 44 having a short side 42U as one side is defined together with a boundary 45, and the input / output area 41 is updated as a new input / output area 46. Furthermore, for example, as shown in FIG. 4D, when an image 43 is drawn close to the lower short side 42B in a vertically long input / output area 41, a square shared area 44 with the short side 42B as one side is defined together with a boundary 45, and the input / output area 41 is updated as a new input / output area 46.

[0048] When the control unit 123 determines whether the image 42 is closer to the short side 42L, 42R or the short side 42U, 42B, for example, the control unit 123 obtains the distance between the position where the drawing of the image 42 is started by a touch input and each short side, and compares the distances to determine whether the image 42 is closer to the short side. The control unit 123 also displays the boundary 45 in any manner, such as a solid line or a dotted line. As shown in FIG. 4E, after the control unit 123 defines the shared area 44 in the input / output area 41, when the control unit 123 detects a touch input 48 near the boundary 45, the control unit 123 may display a warning 47 to make the user aware of the boundary 45. The vicinity of the boundary 45 is a range that is arbitrarily determined in advance. This makes it possible to prompt the user to input an image into the shared area 44. The warning 47 may be output by voice.

[0049] Returning to Fig. 3A, in step S306, the control unit 123 generates an output image. The output image is a square image that includes the input image for the shared area and maintains the aspect ratio of the shared area. In addition, information that identifies the defined shared area is added to the output image.

[0050] In step S308, the control unit 123 encodes the output image and audio information to generate encoded information.

[0051] In step S310, the control unit 123 packetizes the encoded information using the communication unit 121, and transmits the packetized information to the server device 10 and other terminal devices 12.

[0052] Fig. 3B relates to an operation procedure of the control unit 123 when the terminal device 12 displays the voice of the other party and an image for output. When the control unit 123 receives, via the server device 10, a packet sent by another terminal device 12 executing the procedure of Fig. 3A, the control unit 123 executes steps S312 to S316.

[0053] In step S312, the control unit 123 decodes the encoded information contained in the packet received from the other terminal device 12 to obtain audio information and an image for output.

[0054] In step S313, the control unit 123 determines whether the image for output is based on a different shared area. The control unit 123 makes this determination using the specific information of the shared area attached to the image for output. If the image for output is based on a new shared area (Yes), the control unit 123 proceeds to step S314.

[0055] In step S314, the control unit 123 defines a shared area for displaying the output image. In an entry / exit area having a rectangular shape, the control unit 123 defines a square shared area having a predetermined short side as one side. For example, in an entry / exit area having a vertically long rectangle, a square shared area having an upper short side as one side is defined. Also, for example, in an entry / exit area having a horizontally long rectangle, a square shared area having a left short side as one side is defined.

[0056] In step S316, the control unit 123 outputs the sound and displays the output image from the output unit 126. The output image is displayed in a shared area defined in the input / output area.

[0057] FIG. 5A shows an example in which an output image 50 is shared between input / output areas 41A and 41B having different longitudinal directions. For example, the terminal device 12A has a horizontally long input / output area 41A, and the terminal device 12B has a vertically long input / output area 41B. In this case, an image 43 is input to the input / output area 41A, and a shared area 44A is defined. An output image 50 corresponding to the shared area 44A is sent from the terminal device 12A to the terminal device 12B. Then, the image 43 is displayed in the shared area 44B defined in the input / output area 41B. Alternatively, the image 43 is input to the input / output area 41B, and a shared area 44B is defined. An output image 50 corresponding to the shared area 44B is sent from the terminal device 12B to the terminal device 12A. Then, the image 43 is displayed in the shared area 44A defined in the input / output area 41A. In either case, the output image 50 is exchanged while maintaining the aspect ratio and the image orientation. Therefore, it becomes possible to share the image 43 between the input / output areas 41A and 41B while maintaining the aspect ratio of the image 43. An image additionally input to the shared area 44A or 44B is shared by the shared areas 44A and 44B as a part of the output image 50. In this case, the determination result in step S303 in FIG. 3A is Yes, step S304 is omitted and step S306 is executed, and the determination result in step S313 in FIG. 3B is No, step S314 is omitted and step S316 is executed. Furthermore, when the shared areas 44A and 44B are defined, the input / output areas 41A and 41B are updated as input / output areas 46A and 46B, respectively.

[0058] When an image is input to the updated I / O area 46A, 46B, the determination result in step S303 in Fig. 3A is No, a new shared area and boundary are defined in the updated I / O area 46A or 46B in step S304, and the I / O area 46A or 46B is further updated to a new I / O area. Also, the determination result in step S313 in Fig. 3B is Yes, a new shared area and boundary are defined in the updated I / O area 46A or 46B in step S314, and the I / O area 46A or 46B is further updated to a new I / O area.

[0059] 5B shows an example of image sharing when an image is input to the updated input / output areas 46A and 46B having different longitudinal directions shown in FIG. 5A. When an image is input to the input / output area 46A and a shared area 52A is defined, an output image 52 corresponding to the shared area 52A is sent from the terminal device 12A to the terminal device 12B, and the output image 52 is displayed in the shared area 52B defined in the input / output area 46B. Alternatively, when an image is input to the input / output area 46B and a shared area 52B is defined, an output image 52 corresponding to the shared area 52B is sent from the terminal device 12B to the terminal device 12A, and the output image 52 is displayed in the shared area 52A defined in the input / output area 46A. In addition, when the shared areas 52A and 52B are defined, the input / output areas 46A and 46B are updated as input / output areas 54A and 54B, respectively.

[0060] Fig. 5C shows an example of image sharing when an image is input to updated input / output areas 54A and 54B having different longitudinal directions shown in Fig. 5B. When an image is input to input / output area 54A and shared area 56A is defined, output image 56 corresponding to shared area 56A is sent from terminal device 12A to terminal device 12B, and output image 56 is displayed in shared area 56B defined in input / output area 54B. Alternatively, when an image is input to input / output area 54B and shared area 56B is defined, output image 56 corresponding to shared area 56B is sent from terminal device 12B to terminal device 12A, and output image 56 is displayed in shared area 56A defined in input / output area 54A.

[0061] The control unit 123 repeatedly executes the procedures of Figs. 3A and 3B, whereby the terminal devices 12A and 12B make a call and share images. Since the output image is shared while maintaining the aspect ratio, it is possible to share the image without distorting the image or changing the orientation of the image. Furthermore, by updating the input / output area, the margins of the input / output screen are effectively used. Therefore, it is possible to adjust for the difference in the environment between the terminal devices and contribute to user convenience.

[0062] In the above, the embodiment has been described based on the drawings and examples, but it should be noted that those skilled in the art can easily make various modifications and corrections based on the present disclosure. Therefore, it should be noted that these modifications and corrections are included in the scope of the present disclosure. For example, the functions included in each means, each step, etc. can be rearranged so as not to be logically inconsistent, and multiple means, steps, etc. can be combined into one or divided into one. [Explanation of symbols]

[0063] 1. Communication Systems 10. Server equipment 11 Network 12 Terminal Equipment 101, 121 Communications Department 102, 122 Storage section 103, 123 Control section 105, 125 Input section 106, 126 Output section

Claims

1. A terminal device, an input / output screen having a rectangular input / output area for receiving touch input and displaying an image; A communication unit that communicates with another terminal device having the input / output area with a different longitudinal direction; a control unit that, when an image is input to its own input / output area, sends an output image corresponding to a first square area having one short side of the input / output area as one side and including the image to the other terminal device, and causes the other terminal device to display the output image in a second square area having one short side of the input / output area of ​​the other terminal device as one side; the control unit sets an area other than the first square area in its own input / output area as a new input / output area, and outputs information indicating a warning when detecting a touch input near a boundary between the first square area and the other area of ​​its own input / output area. Terminal device.

2. In claim 1, The control unit displays the boundary. Terminal device.

3. A terminal device, an input / output screen having a rectangular input / output area for receiving touch input and displaying an image; A communication unit that communicates with another terminal device having the input / output area with a different longitudinal direction; a control unit that, when an image is input from another terminal device to an input / output area of ​​the other terminal device and an output image corresponding to a first square area having one short side of the input / output area as one side and including the image is transmitted, displays the output image in a second square area having one short side of its own input / output area as one side; the control unit sets an area other than the second square area in its own input / output area as a new input / output area, and outputs information indicating a warning when detecting a touch input near a boundary between the second square area and the other area of ​​its own input / output area. Terminal device.

4. A system including a pair of terminal devices each having an input / output screen with a rectangular input / output area for receiving touch input and displaying an image, the input / output areas of which have different longitudinal directions, When an image is input to an input / output area of ​​the first terminal device, the first terminal device transmits an output image including the image, the output image corresponding to a square area having one short side as one side of the input / output area, to the second terminal device; the second terminal device displays the image for output in a square area having one short side of its input / output area; the first and second terminal devices set an area other than the square area in their own input / output areas as a new input / output area, and output information indicating a warning when a touch input is detected near a boundary between the square area and the other area in their own input / output areas. system.

5. In claim 4, The first terminal device displays the boundary. system.

Citation Information

Patent Citations

  • Image outputting apparatus and program

    JP2011010348A

  • Electronic apparatus and display method thereof

    JP2013219578A

  • Image communication program, image communication method, and electronic apparatus

    JP2015022377A

  • Information processor, program, information processing system, and information processing method

    JP2015106222A

  • Information processing device

    JP2018049503A