program
A mobile device with touch and voice control capabilities simplifies television operations, providing intuitive control of settings like volume and brightness, addressing the complexity of traditional remote controls.
Patent Information
- Application Number
- JP2024153554
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2024-09-06
- Publication Date
- 2026-02-10
- Estimated Expiration
- 2036-05-11
AI Technical Summary
Existing television control systems are not user-friendly and require complex operations, especially when using remote controls.
A mobile device, such as a smartphone, is used to control a television through a touch interface and voice commands, allowing intuitive control of television functions like volume, brightness, and color tone adjustments, with integrated sensors and communication capabilities to synchronize with the television.
Enables easy and intuitive control of television settings directly from a mobile device, enhancing user experience and simplifying operations without interfering with the television's primary display.
Smart Images

Figure 0007812610000001 
Figure 0007812610000002 
Figure 0007812610000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to a program and the like. [Background technology]
[0002] A typical television is controlled by a remote control. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-146613 Summary of the Invention [Problem to be solved by the invention]
[0004] To make it possible to control a device more easily. [Means for solving the problem]
[0005] According to one aspect of the present invention, there is provided a program as set forth in the claims. [Brief explanation of the drawings]
[0006] [Figure 1] 1 is a schematic external view of a mobile device 100. FIG. [Figure 2] 1 is a schematic block diagram showing the internal configuration of a mobile device 100 according to a first embodiment. [Figure 3] FIG. 1 is a diagram showing a schematic configuration of a system using a mobile device according to an embodiment of the present invention. [Figure 4] FIG. 2 is a diagram showing a program guide screen displayed on a display. [Figure 5] 10 is an example of a volume adjustment screen that the display screen control unit 14 displays on the display 2a to adjust the volume. [Figure 6] An example of the volume adjustment screen for adjusting the volume of 5.1 channel speakers. [Figure 7]10 shows an example of a brightness adjustment screen that the display screen control unit 14 displays on the display 2a in order to adjust the brightness. [Figure 8] 10 is another example of a brightness adjustment screen that the display screen control unit 14 displays on the display 2a to adjust the brightness. [Figure 9] 10 shows an example of a color tone adjustment screen that the display screen control unit 14 displays on the display 2a in order to perform color tone adjustment. [Figure 10] 10 is another example of a color tone adjustment screen that the display screen control unit 14 displays on the display 2a in order to perform color tone adjustment. [Figure 11] 10 is another example of a color tone adjustment screen that the display screen control unit 14 displays on the display 2a in order to perform color tone adjustment. [Figure 12] FIG. 10 is a diagram illustrating volume adjustment of a 5.1 channel speaker using a sound sensor. DETAILED DESCRIPTION OF THE INVENTION
[0007] (First embodiment) The first embodiment involves controlling a television set using a mobile device. 1 is a schematic external view of a mobile device 100. The mobile device 100 is also a computer, and is typically a smartphone or tablet, but may also be a dedicated terminal. In FIG. 1 and the following description, an example in which the mobile device 100 is a smartphone will be described.
[0008] The mobile device 100 includes an input interface 1 that accepts input from a user and an output interface 2 that outputs information to the user. The input interface 1 preferably includes a touch panel 1a, and the output interface 2 preferably includes a display 2a. The touch panel 1a is disposed on the display 2a so that at least a portion of the touch panel 1a overlaps at least a portion of the display 2a. This allows the user to perform operations (gestures) on the touch panel 1a to operate the screen displayed on the display 2a.
[0009] In this example, the display 2a is rectangular, and for convenience, the long side direction is also called vertical, and the short side direction is also called horizontal.
[0010] The user can perform operations such as tapping, double tapping, long pressing, swiping, flicking, pinching in and out, etc. on the touch panel 1a.
[0011] A tap (single tap) is an operation of touching one or more points on the touch panel 1a for a short time with a finger or a stylus. By tapping, icons, characters, items, etc. displayed on the display 2a can be selected. A double tap is an operation of touching one or more points on the touch panel 1a twice in succession for a short time with a finger or the like. A long press is an operation of touching one or more points on the touch panel 1a for a longer period of time than a tap. A long press can display detailed information about the selected item. In addition to tapping, double tapping, and long press, various operations can be defined by the duration and number of times that the touch panel 1a is touched.
[0012] A swipe (drag) is an operation in which a finger or other object is touched at a point on the touch panel 1a and then slid (moved) across it. The distance slid is also called the swipe amount. Swiping can scroll the screen. A flick is an operation in which a finger or other object is touched at a point on the touch panel 1a and then quickly moved in a light sweeping motion. Flicking can be used to move to the next screen, return to the previous screen, move an item to a different position within the display 2a or outside the display 2a, or enter text.
[0013] Pinch-in (pinch-out) is an operation in which two points on the touch panel 1a are touched with fingers or the like, and then the fingers are moved closer (or farther apart) while still touching the touch panel 1a. The value corresponding to the distance between the two points initially touched and the distance between the two points after they have been moved closer (or farther apart) (for example, the difference or ratio between the two distances) is also called the amount of pinch-in (pinch-out). Pinching in (pinch-out) can reduce (or enlarge) the screen.
[0014] The input interface 1 may also include a microphone. Instead of operating the touch panel 1a, information displayed on the screen, such as selecting an icon, inputting text, scrolling the screen, and zooming in and out, may be controlled by speaking into the microphone (which is also a type of operation on the input interface 1).
[0015] Furthermore, the input interface 1 may include a key 1b (physical key or soft key) such as a menu key. A menu screen or a setting screen may be displayed by pressing or touching the key 1b.
[0016] 1 may also include an input interface 1 and an output interface 2 not shown in the example. For example, a remote control may be used as the input interface 1. Furthermore, if the mobile device 100 is a personal computer, the input interface 1 may include a mouse and a keyboard. The output interface 2 may include a speaker and output the information described below as audio.
[0017] 2 is a schematic block diagram showing the internal configuration of a mobile device 100 according to the first embodiment. In addition to the input interface 1 and output interface 2 described above, the mobile device 100 includes a GPS receiver 3, various sensors 4, a communication unit 5, a broadcast wave processing unit 6, a storage unit 7, a recording medium interface 8, and a control unit 10.
[0018] The GPS receiver 3 receives signals from GPS satellites to determine the approximate location of the mobile device 100. The location of the mobile device 100 can be expressed as latitude and longitude. When a user carries the mobile device 100, the location of the mobile device 100 approximately coincides with the location of the user. Therefore, the location of the mobile device 100 can also be said to be the location of the user.
[0019] The sensor 4 is a light sensor, a color sensor, a sound sensor (microphone), a gyro sensor, an acceleration sensor, a temperature sensor, a gravity sensor, an illuminance sensor, an acceleration sensor, a geomagnetic sensor, a pressure sensor, a proximity sensor, a humidity sensor, a rotation vector sensor, or the like.
[0020] The communication unit 5 is a general term for a functional unit that communicates with other devices. For example, the communication unit 5 transmits and receives data to and from external devices (such as servers and storage devices) via a network such as a home wireless LAN or Wi-Fi (registered trademark). The communication unit 5 may also have a wireless communication function such as Miracast, Google Cast, NFC, Bluetooth (registered trademark), infrared communication, or other wireless communication functions. The communication unit 5 may also have a wired communication function using an HDMI cable, a USB cable, an MHL cable, or the like. The communication by the communication unit 5 may be one-way communication for receiving data from another device, one-way communication for transmitting data to another device, or two-way communication with another device. In the case of two-way communication, the transmission path and the reception path may be different.
[0021] The broadcast wave processing unit 6 includes an antenna, a tuner, a decoder, etc., and receives and processes broadcast waves. The broadcast waves may include television programs (video and audio), a program guide (so-called EPG), data for displaying data broadcasts, etc.
[0022] The memory unit 7 stores television control programs and various information and data (for example, program guide data received by the communication unit 5 from other devices, data received by the broadcast wave processing unit 6, and user information (gender, age, place of residence, etc.)).
[0023] The television control program is for realizing a television control application (remote control application). The television control program may be stored in advance in the storage unit 7 (so-called pre-installed), or may be downloaded by the user and stored in the storage unit 7.
[0024] The program guide data is data indicating the content of each television program (e.g., title, preferably including the cast and a brief description), broadcast time, channel, etc., and includes data necessary for generating a program guide. The program guide data may be included in the broadcast waves, or may be acquired by the communication unit 5 via a network. The entity that generates the program guide data is not particularly limited, and may be a broadcast station, a television control application provider, a television manufacturer, or any of their related parties.
[0025] The user information is, for example, information indicating the user's attributes (age, sex, home or work address, etc.) and favorite television programs (for example, it may be a television program genre such as sports or drama, or it may be a performer such as a particular singer or actor). The user information may be registered by the user himself or may be automatically acquired based on the user's search history or behavior history by the television control app, another app, or a function of the mobile device 100.
[0026] Furthermore, an external recording medium such as an SD card can be inserted into the mobile device 100. The recording medium interface 7 reads and writes data from and to the external recording medium. Note that the data stored in the storage unit 7 may be stored in the external recording medium or in an external storage device connected via a network.
[0027] The control unit 10 has a user operation acquisition unit 11, a position acquisition unit 12, a data acquisition unit 13, a display screen control unit 14, an external device control unit 15, and a communication control unit 16. At least some of these units may be functions realized by a processor (not shown) of the mobile device 100 executing a television control program, or may be functions of the OS. Alternatively, at least some of the processing unit 10 may be implemented in hardware, or may be functions of the OS of the mobile device 100.
[0028] The user operation acquisition unit 11 acquires user operations on the input interface 1. For example, it acquires information such as which part of the touch panel 1a was touched (in other words, what is displayed at the position on the display 2a corresponding to the touched position on the touch panel 1a), how the touch was made, etc.
[0029] The location acquisition unit 12 acquires location information indicating the location of the mobile device 100. The location acquisition unit 12 may acquire the location information from the GPS receiver 3, or may acquire the location information using other methods (such as WiFi positioning or positioning based on a connected base station). The location acquisition unit 12 may also determine the location information by combining multiple methods, or may use the location information with the highest accuracy among the multiple methods. The location may be subject to some error. Hereinafter, the term "location of the mobile device 100" may refer to the actual location of the mobile device 100, or the location acquired by the location acquisition unit 12 (which may include an error).
[0030] The data acquisition unit 13 acquires data stored in the memory unit 7, acquires data stored on an external recording medium via the recording medium interface 8, and acquires data from an external device (such as a server) connected to the network via the communication unit 5.
[0031] The display screen control unit 14 controls the generation and transition of screens to be displayed on the display 2a. As a specific example, the display screen control unit 14 causes the display 2a to display a program guide based on program guide data.
[0032] The external device control unit 15 directly or indirectly controls external devices that can communicate via the communication unit 5. That is, the external device control unit 15 generates control signals for controlling the external devices. In this embodiment, the external device is mainly a television, and an example is shown in which the external device control unit 15 generates control signals for controlling this television.
[0033] The communication control unit 16 controls transmission and reception via the communication unit 5. For example, the communication control unit 16 performs communication control for transmitting a control signal generated by the external device control unit 15 to an external device such as a television. The communication control unit 16 also performs communication control for receiving necessary information from an external device such as a television.
[0034] FIG. 3 is a diagram showing a schematic configuration of a system using a mobile device according to this embodiment. As shown in FIG. 3(a), the mobile device 100 may be capable of communicating with the television 200 and controlling the television 200 by wireless communication and / or wired communication via the communication unit 5 thereof. As shown in Fig. 3(b), the television 200 may be able to control the recording device 300. Alternatively, the television 200 may have a recording function. 3(c), the mobile device 100 may be able to communicate with the television 200 and the recording device 300 by wireless communication and / or wired communication via its communication unit 5, and may be able to control the television 200 and the recording device 300. In this case, the television 200 may be able to control the recording device 300.
[0035] An example of control of the TV 200 by the mobile device 100 will be described below. First, it is desirable to identify the television to be controlled by the mobile device 100. For example, when the user launches the television control app for the first time or in response to an instruction from the user, the external device control unit 15 transmits a control signal to the television 300 to identify the television to be controlled. In response, the television 300 transmits a signal containing information (such as a model number or ID) that identifies itself to the mobile device 100. The external device control unit 15 receives this signal and identifies the television to be controlled. Alternatively, the user may set information (such as model number or ID) that identifies the television to be controlled via the input interface 1.
[0036] When the television control application is started, the display screen control unit 14 may generate a program guide screen based on the program guide data, preferably taking into consideration the broadcasting station broadcasting at the location of the mobile device 100 and the current time, and display the program guide screen on the display. Furthermore, when two-way communication with the television 200 is possible, the external device control unit 15 may acquire the status of the television 200 (whether the power is on or off, which program is being displayed if the power is on, what the settings for picture quality, sound quality, volume, etc. are, etc.).
[0037] Fig. 4 shows a program guide screen displayed on a display. The program guide screen has a time axis set vertically and broadcasting stations set horizontally. Program information indicating the programs broadcast by each broadcasting station at each time is arranged in a matrix. This will be explained in more detail below.
[0038] The program guide screen includes a broadcast station area 31 arranged at the top, and broadcast station information indicating broadcast stations is arranged horizontally in the broadcast station area 31. The arranged broadcast stations are preferably receivable at the location of the mobile device 100. In addition, it is preferable to arrange the broadcast station of the program being displayed on the television 200 in the center.
[0039] The broadcast station information is typically the name of the broadcast station, but does not necessarily have to be the official name; it may be an abbreviation, mark, channel number, or any other identifier that can identify the broadcast station. The broadcast stations may be arranged in ascending or descending order of channel numbers. Alternatively, they may be arranged in an order arbitrarily set by the user in advance. The broadcast stations may also be arranged based on user information or user history (such as the operation history of the app, the search history on the mobile device 100, or the website browsing history). More specifically, broadcast stations that the user is likely to be most interested in may be arranged closer to the left (toward the time area, which will be described later). The broadcast station information may also be arranged arbitrarily by the user. More specifically, the broadcast station information may be rearranged by touching (for example, long pressing) to select it and then moving it left or right.
[0040] If it is difficult to display all broadcasting stations on the screen, only some of the broadcasting stations may be displayed, and other broadcasting stations may be displayed by scrolling the program guide screen left and right.
[0041] The program guide screen also includes a time area 32 on the left side, in which time information indicating, for example, hourly time units is arranged vertically. The current time may be arranged at the top, or a time a predetermined time before the current time may be arranged at the top. Also, the program guide screen may be configured so that earlier times (including past times) are displayed by scrolling upward, and later times are displayed by scrolling downward.
[0042] Furthermore, the program guide screen includes a program area 33, in which a plurality of program columns 34 are arranged in a matrix by time and by broadcasting station. Each program column 34 displays program information that may include the title (or a part thereof or an abbreviation), a brief summary, and performers of the program that will be broadcast at the corresponding time and by the corresponding broadcasting station.
[0043] The display screen control unit 14 may display a specific program listing 34 in a different manner from other program listings 34. A different manner may involve, for example, coloring or highlighting the specific program listing 34. The specific program listing 34 may be a program listing 34 for a program that is attracting attention, a series of programs with high viewership ratings, a program that is trending on the Internet, or a program that matches the user's preferences based on user information and user history (such as operation history in the app, search history on the mobile device 100, and website browsing history). Furthermore, the program information for the specific program listing 34 may be arranged as text information in a location other than the program area 33.
[0044] The user can select a program using this program guide screen. A program can be selected, for example, by the user touching a position on the touch panel 1a that corresponds to the position on the display 2a where the program listing 34 corresponding to the program is displayed (hereinafter simply referred to as "touching the program listing 34"; the same applies to other positions). Alternatively, the user may select the corresponding program by vocally specifying the program title or its abbreviation.
[0045] Similarly, the user can select a broadcast station by, for example, touching the station name (or any program listing broadcast by that station), or by specifying the station name or its abbreviation by voice. Next, a specific example of controlling the television 200 using the program guide displayed on the display 2a will be described.
[0046] As an example, when a user selects a program currently being broadcast from the program guide screen, the external device control unit 15 may generate a control signal to display the selected program on the television 200. More specifically, the external device control unit 15 may generate a control signal to switch to the selected program if the television 200 is currently displaying another program, or to turn on the television if it is off and then display the selected program.
[0047] When a program is switched (when a control signal for switching is generated), the display screen control unit 14 may update the program guide screen accordingly. For example, it is desirable to position the broadcast station of the program that is newly displayed after switching in the center.
[0048] Furthermore, when a certain program is selected, a control signal may be generated to display information about the program (particularly detailed information not displayed in the program guide) on the display 2a or the television 200.
[0049] The external device control unit 15 may generate not only a control signal for displaying the selected program, but also a control signal for making any setting, for example, a control signal for making appropriate image quality settings or sound quality settings depending on the selected program.
[0050] As a more specific example, if the selected program is a movie, the external device control unit 15 may generate a control signal to set the image quality of the television 200 to a "cinema mode" or other image quality suitable for movies. The fact that the selected program is a movie may be included in the program guide data, or the external device control unit 15 may detect it based on the program title or the like. Alternatively, the program guide data may associate a program with an appropriate setting for that program. Regarding audio, a control signal may be generated so that sound quality settings suited to the selected program are performed, such as stereo mode or 5.1ch mode.
[0051] When a program currently being broadcast is selected, the external device control unit 15 may generate the above-mentioned generation signal without waiting for further user operation, or may generate the above-mentioned control signal after confirming the user's intention by displaying a dialog box asking the user whether or not to switch programs.
[0052] In addition, if the television 200 has a recording function or if a recording device 300 is connected to the television 200, when the user selects a program that is currently being broadcast, the external device control unit 15 may generate a control signal to start recording the selected program.
[0053] Similarly, when a program currently being broadcast is selected, the external device control unit 15 may generate the above-mentioned generation signal without waiting for further user operation, or may generate the above-mentioned control signal after confirming the user's intention by presenting a dialog or the like asking the user whether or not to start recording.
[0054] Furthermore, when a program currently being broadcast is selected, a dialog box or the like may be presented to the user asking whether to switch to the selected program or start recording (or both), and a control signal may be generated according to the user's intention after the user's intention has been confirmed. Alternatively, whether to switch to the selected program or start recording (or both) may be set in advance.
[0055] The processing may also be changed depending on the method of selection. For example, the external device control unit 15 may generate a control signal for switching programs when the program column 34 is tapped, or a control signal for starting recording when the column is pressed and held. Alternatively, a control signal for displaying program information may be generated. Furthermore, a dialog box may be presented asking what processing should be performed when a certain program is selected, or the processing to be performed when a program is selected may be preset.
[0056] In each of the above examples, the above control may be performed when a broadcast station is selected instead of when a currently airing program is selected. Also, the above control may be performed when a currently airing program is selected and when a broadcast station is selected.
[0057] As another example, when a program that is not currently being broadcast but will be broadcast in the future is selected, the external device control unit may generate a control signal for reserving the selected program. When a program that will be broadcast in the future is selected, the external device control unit may generate the above-mentioned generation signal without waiting for any further user operation, or may generate the above-mentioned control signal after confirming the user's intention by displaying a dialog box or the like asking the user whether or not to reserve the program. Furthermore, when a program that will be broadcast in the future is selected, the external device control unit may generate a control signal for programming the selected program to be recorded.
[0058] Similarly, when a program to be broadcast in the future is selected, the external device control unit may generate the above-mentioned generation signal without waiting for further user operation, or may generate the above-mentioned control signal after confirming the user's intention by presenting a dialog or the like asking the user whether to make a recording reservation.Furthermore, when a program to be broadcast in the future is selected, the external device control unit may generate the control signal according to the user's intention after confirming the user's intention by presenting a dialog or the like asking the user whether to make a viewing reservation or a recording reservation (or both).
[0059] The external device control unit may generate a control signal for reserving viewing when program information is tapped, or a control signal for reserving recording when it is pressed and held. Alternatively, when a program that will be broadcast in the future is selected, it may be possible to set in advance whether to reserve viewing or recording.
[0060] As yet another example, if a program that has already finished broadcasting is selected, and the selected program has been recorded on a television or recording device (including all program recordings), the external device control unit may generate a control signal to play the selected program. If the selected program has not been recorded, the external device control unit may search for reruns or related programs. If the search results in no results, the external device control unit may indicate this on a display. If the program is found in the search, the external device control unit may display this information, or may schedule a viewing or recording. If the program is found in the search, the external device control unit may generate a control signal to schedule a viewing and / or recording without waiting for further user operation, or may display a dialog box asking the user whether to schedule a viewing or recording (or both) to confirm the user's intention and then generate a control signal according to the user's intention.
[0061] Furthermore, if a program that has already finished broadcasting is selected, and the selected program has been recorded on the television 200 or the recording device 300 (including recording of all programs), the external device control unit may generate a control signal to transfer (dub or move) the selected program to the mobile device 100.
[0062] Preferably, the external device control unit 15 may check with the television 200 or recording device 300 the limit on the number of times the selected program can be dubbed, and the display screen control unit 14 may display the result on the display 1a. For example, it may display the number of times remaining that the program can be dubbed, or a message indicating that the program will be moved if no further dubbing is possible. The user may be able to select whether or not to start dubbing or moving the program by looking at the display.
[0063] Furthermore, when transferring data from the television 200 (or the recording device 300, the same applies hereinafter) to the mobile device 100, it is desirable to connect the two devices with a wired connection to ensure reliable transfer. Therefore, if the television 200 and the mobile device 100 are connected wirelessly, a message may be displayed urging the user to connect with a wired connection. Note that the path for transmitting and receiving control signals and the path for transferring programs may be the same or different.
[0064] In the above, it has been described that the mobile device 100 mainly controls the television 200, but with regard to recording, the mobile device 100 may also control the recording device 300 directly (FIG. 3(c)) or indirectly via the television 200 (FIG. 3(b)).
[0065] As another example, when the program guide screen is scrolled horizontally by swiping or the like, the external device control unit 15 may generate a control signal for switching the displayed programs in order accordingly (so-called "zapping"). For example, when the program guide screen in Fig. 4 is scrolled leftward and the broadcast station displayed in the center changes at a predetermined speed from 102ch to 103ch to 104ch to 105ch, a control signal is generated for switching the displayed programs from 102ch to 103ch to 104ch to 105ch at a time interval and switching speed according to this predetermined speed (or the speed or amount of movement of the finger when swiping or the like).
[0066] The display screen control unit 14 may display both the program guide screen and a screen simulating a remote control on the display 1a. The screen simulating a remote control may include icons corresponding to, for example, a power button, a volume control button, a channel selection button, a menu button, etc. Then, in response to a user operation (such as a tap) on these icons, the external device control unit 15 may transmit a control signal to the television 200.
[0067] At this time, the display screen control unit 14 may update the program guide screen. Preferably, the switching of the programs displayed on the television 200 and the scrolling of the program guide screen may be performed in synchronization, and more preferably, the program guide screen may be updated so that the broadcast station of the program displayed on the television 200 is positioned in the center. Furthermore, the display screen control unit 14 may switch between a program guide screen and a screen simulating a normal remote control and display them on the display 1a in response to an operation from the user.
[0068] Furthermore, if the mobile device is capable of two-way communication, the television or its remote control may be linked to the mobile device, and for example, the television or remote control may have a function to generate a control signal to make the mobile device ring (or vibrate).
[0069] (Second embodiment) The second embodiment described below displays a sound quality adjustment screen (GUI) on the display 2a of the mobile device 100, and adjusts and controls the sound quality (e.g., volume) of an audio device such as a television 200. The following description focuses on volume adjustment. Note that audio devices include not only televisions but also speakers, amplifiers, audio players, audio processing devices, and the like. Furthermore, the functions described in the following embodiments may be separate from those described in the first embodiment.
[0070] FIG. 5 is an example of a volume adjustment screen that the display screen control unit 14 displays on the display 2a to adjust the volume. When a predetermined operation for adjusting the volume is performed by the user, such a screen is displayed. The volume adjustment screen preferably includes a graphic shape that indicates the volume as the volume display, and in the following, the higher the volume, the longer the bar 61 (for example, a solid bar (FIG. 5(a1)) or a thin bar (FIG. 5(a2))) that is included. The volume may also be displayed numerically.
[0071] Here, when the volume adjustment screen is first displayed when it is not currently displayed, it is desirable that the length of bar 61 correspond to the current volume. The current volume may be the result of the most recent adjustment made by the user stored in mobile device 100, but it is more desirable to obtain the current volume that is actually set on television 200 by performing two-way communication with television 200 when displaying this screen. Specifically, external device control unit 15 may transmit a control signal to television 200 to inquire about the current volume, and in response receive a signal indicating the current volume from television 200. In other words, external device control unit 15 may ascertain the current volume based on the signal generated by television 200.
[0072] The user can then perform an operation to adjust the volume using the bar 61 via the input interface 1. In response to such a user operation, the display screen control unit 14 updates the length (size) of the bar 61 to reflect the state (volume) after adjustment, and the external device control unit 15 generates a control signal for adjusting the volume of the television 200 and transmits it to the television 200, thereby adjusting the volume.
[0073] For example, on the touch panel 1a, if a user touches the right end of the bar 61 with their finger and then slides the finger to the right (in the direction of extending (enlarging) the bar 61) while still touching the panel (Figures 5(b1), (b2)), the display screen control unit 14 extends the bar 61 to the right according to the amount of sliding, and generates a control signal to increase the volume of the television 200 according to the length of the bar 61 after it has been extended (in other words, according to the amount of sliding).
[0074] Conversely, when the finger is slid to the left (in the direction of shortening (reducing) the bar 61) (Figures 5(c1), (c2)), the display screen control unit 14 shortens the bar 61 to the left in accordance with the amount of sliding, and generates a control signal to reduce the volume of the television 200 in accordance with the length of the bar 61 after shortening (in other words, in accordance with the amount of sliding).
[0075] In this way, it is possible to synchronize the extension and contraction of bar 61 on the volume adjustment screen (updating the numerical value as necessary; the same applies below) with the volume adjustment of television 200. Note that the length of bar 61 may be extended or contracted by any user operation, not limited to sliding a finger.
[0076] However, if communication between the mobile device 100 and the television 200 is unstable, the control signal for adjusting the volume may not reach the television 200 from the mobile device 100. In this case, the volume may appear to have been adjusted on the mobile device 100 and the length of the bar 61 may be updated, but the volume on the television 200 may not actually be adjusted, resulting in a discrepancy.
[0077] Therefore, if the volume of the television 200 cannot be adjusted even by the control signal, the display screen control unit 14 may return the length of the bar 61 to the length corresponding to the volume before it was extended or shortened (i.e., before the user operation was performed). This prevents only the volume (length of the bar) indicated by the display screen control unit 14 from being updated, even though the volume of the television 200 is not adjusted; in other words, it prevents a mismatch between the actual volume of the television 200 and the volume indicated on the volume adjustment screen. In this case, it may be displayed on the display 2a that the volume of the television 200 cannot be adjusted (that communication with the television 200 cannot be performed), or an alarm may be sounded.
[0078] The display screen control unit 14 may determine whether the volume can be adjusted based on whether a predetermined signal originating from the television 200 can be received. For example, when the television 200 receives a control signal for adjusting the volume from the mobile device 100, it is desirable that the television 200 not only adjusts the volume but also returns a notification (Ack) indicating that the control signal has been received or a notification indicating that the volume adjustment has been completed. If the communication control unit 16 receives such a notification within a predetermined period, it is determined that the volume of the television 200 can be adjusted. On the other hand, if the external device control unit 15 sends a control signal but does not receive the notification from the television 200 for a certain period, the display screen control unit 14 determines that the volume of the television 200 cannot be adjusted.
[0079] Alternatively, when it is known in advance that the volume of the television 200 cannot be adjusted, for example, when communication with the television 200 is not possible due to poor communication conditions or when the television 200 is powered off, the display screen control unit 14 may not update the length of the bar 61 even if a user operation to adjust the volume is performed. In other words, the display screen control unit 14 may be configured to update the volume adjustment screen only when direct or indirect communication with the television 200 is possible.
[0080] Although the above describes an example of adjusting the volume of the television 200, the television 200 may be connected to an amplifier (not shown) and a speaker may be connected to the amplifier. In this case, the external device control unit 15 may adjust the speaker volume by directly controlling the amplifier, or may adjust the speaker volume by indirectly controlling the amplifier via the television 200. In the latter case, a control signal for adjusting the volume is transmitted from the mobile device 100 to the television 200, and a control signal for adjusting the volume is transmitted from the television 200 to the amplifier.
[0081] 6 shows an example of a volume adjustment screen for adjusting the volume of 5.1-channel speakers. On this screen, each speaker 62a-62f is displayed in association with its location, and bars 63a-63f indicating the volume of each speaker are also displayed. The volume of each speaker is adjusted as described above, and may be adjusted individually for each speaker, or the volume of all speakers may be adjusted in common (linked) with each other, or the volume may be switched between individual and common adjustment. There is no limit to the number of speakers; 2.1-channel or 7.1-channel speakers may be used, and the volume indications of multiple speakers may be displayed on the display 2a in association with their locations.
[0082] Note that each of the speakers 62a to 62f may be directly connected to the television 200, or may be connected to a separate audio device. In the latter case, the mobile device 100 may control the audio device directly, or may control the audio device via the television 200.
[0083] In this way, in the second embodiment, a sound quality adjustment screen including a sound quality display is displayed on the display of the mobile device 100. This allows the sound quality to be adjusted simply and intuitively. Furthermore, the sound quality adjustment screen is not displayed on the television 200, so it does not interfere with the video display on the television 200. Note that, although the above description has been given of adjusting the volume as sound quality, sound quality other than volume may also be controlled.
[0084] (Third embodiment) The third embodiment, which will be described next, displays an image quality adjustment screen (GUI) on the display 2a of the mobile device 100, and adjusts and controls the image quality (for example, color tone, brightness, color depth) of a video device such as a television 200. Note that video devices include not only televisions, but also displays and monitors that do not have tuners, video processing devices, and the like.
[0085] As with sound quality (volume) adjustment, an image quality adjustment screen is displayed, and in response to user operations for adjusting image quality using this, the image quality adjustment screen is updated to reflect the state (image quality) after adjustment, and a control signal for adjusting image quality is generated. Furthermore, when the image quality adjustment screen is first displayed when it is not displayed, it is desirable to display a screen corresponding to the current image quality. Furthermore, if adjustment is not possible, it is desirable to return the image quality adjustment screen to the screen before the user operation. These points are the same as in the second embodiment, so details will be omitted, and the following description will focus on points specific to image quality adjustment.
[0086] FIG. 7 shows an example of a brightness adjustment screen that the display screen control unit 14 displays on the display 2a to adjust the brightness. This screen is displayed when the user performs a predetermined operation to adjust the brightness. The brightness adjustment screen preferably includes a graphic that indicates the brightness, and in the following description, the greater the brightness, the longer the bar 71 (for example, a solid bar (FIG. 7(a)) or a thin bar (FIG. 7(b)) is included). The brightness may also be indicated numerically.
[0087] The brightness adjustment using this brightness adjustment screen can be performed by simply replacing "volume" in the second embodiment with "brightness," and therefore a detailed description thereof will be omitted. Specifically, to increase (decrease) the brightness of the television, for example, a brightness signal such as luminance Y can be offset positively (negatively), or R, G, B signals can be offset positively (negatively).
[0088] FIG. 8 is another example of a brightness adjustment screen that the display screen control unit 14 displays on the display 2a to adjust the brightness. This screen is intended to perform gamma value γ correction (gamma correction) as the brightness adjustment. The gamma value γ is a value that indicates the relationship between the value x of the input signal and the brightness y of the image displayed on the television 200, and is, for example, 2.2. The brightness adjustment screen preferably includes a graphic shape that indicates the gamma value γ as a brightness display, and in the following, y=x γ A curve 72 representing the relationship between x and y (x=0 to 1) is shown on the graph. In addition to this graph, the gamma value γ may be shown numerically.
[0089] The user can then perform an operation for adjusting the brightness using this graph via the input interface 1. In response to such a user operation, the display screen control unit 14 changes the shape of the curve 72 to reflect the adjusted brightness (gamma value), and the external device control unit 15 generates a control signal for adjusting the brightness of the television 200 and transmits it to the television 200, thereby adjusting the brightness.
[0090] For example, on touch panel 1a, if a user touches part of curve 72 on the graph with their finger and then slides their finger downward while still touching (FIG. 8(b)), external device control unit 15 sets a new gamma value γ that is larger than the current gamma value in accordance with the amount of sliding. Conversely, if the user slides their finger upward (FIG. 8(c)), external device control unit 15 sets a new gamma value γ that is smaller than the current gamma value in accordance with the amount of sliding.
[0091] As a specific example of setting the new gamma value γ, it can be set based on the point where the finger is released, for example. More specifically, when the finger is released at point (x0, y0) on the graph, γ=log x0 Alternatively, the gamma value γ may be set to y0. Furthermore, an upper limit and a lower limit may be set in advance, and if the gamma value γ calculated by the above formula exceeds the upper limit (lower limit), it may be limited to the upper limit (lower limit).
[0092] Then, the display screen control unit 14 calculates y=x for the updated gamma value γ. γ and a control signal for adjusting (correcting) the gamma characteristic of the television 200 is generated according to the updated gamma value γ (in other words, according to the slide amount and slide direction).
[0093] To adjust the gamma characteristics, for example, a lookup table for converting a signal x into a signal y may be stored inside the television 200, and the table values may be rewritten according to the gamma value γ.
[0094] In this way, it is possible to synchronize the transformation of curve 72 on the brightness adjustment screen (updating the numerical values as necessary; the same applies below) with the brightness adjustment of television 200. Note that the shape of the graph is not limited to being transformed by sliding a finger, but may be transformed by any user operation, such as selecting from multiple gamma values using a pull-down menu.
[0095] FIG. 9 shows an example of a color adjustment screen displayed on the display 2a by the display screen control unit 14 for color adjustment. This screen assumes that color adjustment is performed along six axes based on primary colors (RGB in this example) and intermediate colors (YCM in this example). The color adjustment screen preferably includes a graphic for adjusting hue as a color adjustment display. In this example, the screen includes six bars 81-86, each with one primary color and one intermediate color at each end, and position indicators 91-96 (triangular icons in the figure) indicating specific positions on each of the bars 81-86, with the positions indicating the hue (FIG. 9(a)). It is preferable that each bar 81-86 reflects the colors at both ends. For example, the first bar 81 has a color that changes from red to yellow from the left end to the right end. The reference colors are not limited to RGB and YCM, and may be applied to a four-primary color display, etc.
[0096] The user can then perform operations for adjusting the color tone using the bars 81 to 86 and the position indicators 91 to 96 via the input interface 1. In response to such user operations, the display screen control unit 14 moves the position of the position indicator to reflect the adjusted color tone, and the external device control unit 15 generates a control signal for adjusting the color tone of the television 200 and transmits it to the television 200, thereby adjusting the color tone.
[0097] For example, on the touch panel 1a, if a user touches the position display 91 of the first bar 81 with a finger and then slides the finger to the right (towards Y) while still touching the panel, the display screen control unit 14 moves the position of the position display 91 according to the amount of sliding (Figure 9(b)), and generates a control signal to adjust the color tone of the television 200 (for example, to move the entire screen or a color between red and yellow closer to yellow overall) according to the position of the position display after the movement (in other words, according to the amount of sliding).
[0098] In this way, movement of the position display on the color adjustment screen (updating the numerical value as necessary, the same applies below) can be synchronized with color adjustment of the television 200. Note that the position display may be moved by any user operation, not limited to sliding a finger.
[0099] FIG. 10 shows another example of a color tone adjustment screen that the display screen control unit 14 displays on the display 2a to perform color tone adjustment. This screen assumes that the color tone adjustment is white balance adjustment, i.e., adjustment of the reference white (especially adjustment of color temperature). The color tone adjustment screen preferably includes a display representing white. In this example, there is a color temperature curve on a color space (in this example, an xy chromaticity diagram), and the position of a circle on this curve represents the color temperature of white. In addition to this circle, the color temperature may also be indicated numerically. When this color tone adjustment screen is first displayed, there is a circle in a position corresponding to the current color temperature of the television 200.
[0100] The user can then perform an operation to adjust the color temperature using this display via the input interface 1. In response to such a user operation, the display screen control unit 14 moves the position of the circle on the xy chromaticity diagram, and the external device control unit 15 generates a control signal for adjusting the color temperature of the television 200 and transmits it to the television 200, thereby adjusting the color temperature.
[0101] For example, on touch panel 1a, if a user touches a circle with their finger and, while still touching the circle, slides the finger to the right to move the circle rightward (FIG. 10(b)), external device control unit 15 sets a new color temperature lower than the current color temperature according to the amount of sliding. Conversely, if the user slides the finger to the left to move the circle leftward (FIG. 10(c)), external device control unit 15 sets a new color temperature higher than the current color temperature according to the amount of sliding.
[0102] Since it is desirable for white to be a color on the color temperature curve (i.e., the deviation duv is 0), the circle may be configured to move only along the curve, for example, the circle may move only according to the x-coordinate of the touch. Of course, it may also be configured to move outside the color temperature curve. For example, a new color temperature may be set based on the point where the finger is released.
[0103] For the convenience of the user, several representative color temperatures (for example, 4,200K, 5,000K (D50), 6,500K (D65), 9,500K, etc.) may be shown on the color temperature curve as a guide. The circle may be designed to move discretely between only these guide color temperatures.
[0104] Then, the display screen control unit 14 moves the circle to the newly set color temperature, and generates a control signal for adjusting the color temperature of the television in accordance with the set color temperature.
[0105] To increase the color temperature, for example, the R signal and the G signal in the television 200 may be multiplied by a gain less than 1. To decrease the color temperature, for example, the B signal in the television 200 may be multiplied by a gain less than 1. Therefore, the control signal may indicate the gain.
[0106] In this way, the movement of the circle on the color adjustment screen (updating the numerical value as necessary, the same applies below) can be synchronized with the color adjustment of the television 200. Note that the circle can be updated by any user operation, such as selecting from multiple color temperatures using a pull-down menu, rather than by sliding a finger.
[0107] 11 shows another example of a color adjustment screen that the display screen control unit 14 displays on the display 2a for adjusting color. This screen assumes that color adjustment involves adjusting the color gamut, i.e., the range of colors to be displayed. The color adjustment screen preferably includes a display showing the color gamut. In this example, the xy chromaticity diagram is used as the basis, but other color spaces such as the u'v' chromaticity diagram may also be used.
[0108] A triangle displayed on the xy chromaticity diagram indicates the color gamut of the set television 200. A triangle (shown in bold) indicating the color gamut that can be displayed by television 200 may also be displayed.
[0109] The user can then perform operations for adjusting the color gamut using this display via the input interface 1. In response to such user operations, the display screen control unit 14 changes the shape of the triangle on the xy chromaticity diagram, and the external device control unit 15 generates a control signal for adjusting the color gamut of the television 200 and transmits it to the television 200, thereby adjusting the color gamut.
[0110] For example, on the touch panel 1a, a user can touch one vertex of a triangle with a finger and, while still touching, slide the finger to change the shape of the triangle. This sets a new color gamut. Then, a control signal is generated to display an image in colors within this color gamut. Specifically, the color gamut of the television 200 itself is converted to colors within the set color gamut (so-called gamut mapping).
[0111] If the set color gamut is narrower than the color gamut that television 200 can display, in other words, if the former triangle is contained within the latter triangle, all colors within the set color gamut can be displayed. However, if the set color gamut is wider than the color gamut that television 200 can display, in other words, if part of the former triangle extends beyond the latter triangle, the colors that extend beyond the former triangle cannot actually be displayed on television 200.
[0112] The user may be able to change the shape of the triangle as desired, or may be able to change it to a shape other than a triangle. The user may also be able to select from preset color gamuts (e.g., BT.709 for HD, BT.601 for NTSC, sRGB or AdobeRGB for PCs, etc., as defined by the standard). Therefore, the preset color gamut may also be displayed on the xy chromaticity diagram as a guide.
[0113] The color gamut has a shape that corresponds to the number of primary colors. For a three-primary color (RGB) display, the color gamut will be triangular, but for a four-primary color display that adds yellow, for example, the color gamut may be displayed as a rectangle.
[0114] (Fourth embodiment) The fourth embodiment described next uses a sensor 4 included in the mobile device 100 to adjust the image quality (for example, color tone, brightness, and color depth) of a video device such as a television 200.
[0115] First, it is assumed that the sensor 4 includes a light sensor (e.g., a photodiode) capable of measuring the illuminance of external light. In this case, the external device control unit 15 may generate a control signal for adjusting the brightness of the television 200 in accordance with the measurement result of the light sensor, and the communication control unit 16 may transmit this control signal to the television 200.
[0116] More specifically, if the measurement result of the optical sensor indicates low illuminance, it means that the environment in which the television 200 is placed (particularly the surroundings of the mobile device 100) is dark. In this case, the image displayed by the television 200 may be dark. Therefore, a control signal for lowering the brightness of the television 200 may be generated.
[0117] Conversely, if the measurement result of the optical sensor indicates high illuminance, it means that the environment in which the television 200 is placed (particularly the area around the mobile device 100) is bright. In this case, it is desirable that the image displayed by the television 200 is bright. Therefore, a control signal for increasing the brightness of the television 200 may be generated.
[0118] That is, a control signal may be generated to increase the brightness of television 200 as the illuminance measured by the optical sensor increases. Such a control signal may indicate the brightness of television 200 or may be a measurement result (illuminance). In the latter case, it is possible to recognize how the brightness of television 200 should be adjusted.
[0119] Next, it is assumed that the sensor 4 includes a color sensor (for example, an RGB photodiode) capable of measuring the color of external light. In this case, the external device control unit 15 may generate a control signal for adjusting the color tone (particularly, white balance adjustment) of the television 200 according to the measurement result of the color sensor, and the communication control unit 16 may transmit this control signal to the television 200.
[0120] More specifically, if the measurement result of the color sensor indicates a bluish color (high color temperature), this means that the lighting in the environment where television 200 is placed (particularly the area around mobile device 100) is bluish (fluorescent lighting, etc.). In this case, the sensitivity to blue decreases due to the eye's adaptation effect, so the image appears yellowish. Therefore, a control signal may be generated to make television 200 bluish overall (to increase the color temperature).
[0121] Conversely, if the measurement result of the color sensor indicates a yellowish color (low color temperature), this means that the lighting in the environment where television 200 is placed (particularly around mobile device 100) is yellowish (from a light bulb, etc.). In this case, the eye's sensitivity to yellow decreases due to the adaptation effect, so the image appears bluish. Therefore, a control signal may be generated to make television 200 yellowish overall (to lower the color temperature).
[0122] That is, the higher the color temperature measured by the color sensor, the higher a control signal may be generated to increase the color temperature of television 200. Such a control signal may indicate the color temperature of television 200, or may be the measurement result (color temperature). In the latter case, it is possible to recognize how the color temperature (hue) of television 200 should be adjusted. Specific examples of adjusting the color temperature are as described above.
[0123] Note that the types of light sources are limited, and the color temperatures to be measured are also limited. Therefore, the accuracy of the color sensor does not need to be very high; it is sufficient to be able to identify one of several predetermined color temperatures (for example, four: 2800K, 4200K, 5500K, and 6500K). In this case, gains to be multiplied by the R, G, and B signals may be set in advance according to the identified color temperature.
[0124] The brightness and color tone (color temperature) adjustments described above may be performed automatically without user operation. In this case, the sensor measurement results may be acquired at regular intervals, and a control signal for adjusting the television 200 may be generated each time. Alternatively, the control signal may be generated only when the measurement results have changed significantly from the previous measurement results (for example, when the specified color temperature has changed). Alternatively, the adjustments may be performed at any timing in response to user operation. Furthermore, it may be possible to set whether the adjustments are automatic or by user operation.
[0125] In this way, in the fourth embodiment, the image quality of the television 200 can be automatically adjusted appropriately according to the surrounding environment (especially the brightness and color of the lighting). Furthermore, since the sensor of the mobile device 100 is used, the television 200 does not need to have a sensor.
[0126] (Fifth embodiment) The fifth embodiment, which will be described next, uses the sensor 4 included in the mobile device 100 to adjust the sound quality (for example, the volume) of an audio device such as a television 200.
[0127] Assume that the sensor 4 includes a sound sensor that picks up ambient sounds. The sound sensor may be, for example, a microphone, which may also serve as an input interface. In this case, the external device control unit 15 may generate a control signal for adjusting the volume of the television 200 in accordance with the measurement result of the sound sensor, and the communication control unit 16 may transmit this signal to the television 200.
[0128] For example, if the measurement result of the sound sensor indicates a loud volume, it is understood that the surroundings of the mobile device 100 are noisy. Therefore, a control signal for increasing the volume of the television 200 may be generated.
[0129] Furthermore, the sound detected by the sound sensor may be distinguished between sound from the television 200 to be adjusted and other sounds, and more advanced adjustment may be performed. For example, a control signal may be generated to adjust the volume of television 200 so that the sound from television 200 approaches a certain target value. It is desirable to increase the volume of television 200 the farther away television 200 is from the viewing position, but such volume adjustment can be performed automatically.
[0130] Alternatively, a control signal may be generated by grasping both the volume from the television 200 and the volume of other sources, and the louder the latter, the louder the volume of the television 200. The louder the surroundings, the louder the volume of the television 200.
[0131] Whether or not the sound detected by the sound sensor is from the television 200 can be determined, for example, if the external device control unit 15 knows in advance the sound from the television 200. For example, audio data for each program can be acquired and stored in the storage unit 7, and the stored audio data can be compared with the sound detected by the sound sensor.
[0132] 12 is a diagram illustrating volume adjustment of 5.1-channel speakers using a sound sensor. Speakers 62a to 62f are arranged as shown in the figure. Mobile device 100 is placed in a position where the user normally sits when listening to sounds from these speakers 62a to 62f. Depending on the environment (room shape, curtain and wall materials, furniture arrangement, etc.), the sounds from each speaker do not necessarily reach mobile device 100 uniformly.
[0133] Therefore, the volume of each speaker is individually and appropriately adjusted using the sound sensor of the mobile device 100. An example of this method will be described below. The external device control unit 15 generates a control signal so that only the speaker 62b emits sound. Then, the sound sensor detects sound from the speaker 62b. The external device control unit 15 adjusts the volume of the speaker 62b so that the volume becomes a first predetermined value. When the volume detected by the sound sensor becomes the first predetermined value (or a predetermined first allowable range including the first predetermined value), the sound from the speaker 62b is stopped. The external device control unit 15 stores the volume setting at this time in the memory unit 7.
[0134] Furthermore, the external device control unit 15 generates a control signal so that only the speaker 62c emits sound. Then, the sound sensor detects sound from the speaker 62c. The external device control unit 15 adjusts the volume of the speaker 62c so that the volume becomes a second predetermined value. When the volume detected by the sound sensor becomes the second predetermined value (or a second predetermined allowable range including the second predetermined value), the sound from the speaker 62c is stopped. The external device control unit 15 stores the volume setting at this time in the memory unit 7.
[0135] Note that because speaker 62b is the front left and speaker 62c is the front right, it is desirable that the first predetermined value and the second predetermined value (or the first allowable range and the second allowable range) are equal, but they may be different. If the first predetermined value and the second predetermined value are equal, for example, if there is something that absorbs sound near speaker 62b, the volume of speaker 62b will be set high, and as a result, the sound from speaker 62b and the sound from speaker 62c will reach the position of mobile device 100 at the same volume.
[0136] Furthermore, the external device control unit 15 generates a control signal so that only the speaker 62d emits sound. Then, the sound sensor detects sound from the speaker 62d. The external device control unit 15 adjusts the volume of the speaker 62d so that the volume becomes a third predetermined value. When the volume detected by the sound sensor becomes the third predetermined value (or a third predetermined allowable range including the third predetermined value), the sound from the speaker 62d is stopped. The external device control unit 15 stores the volume setting at this time in the memory unit 7.
[0137] Furthermore, the external device control unit 15 generates a control signal so that only the speaker 62e emits sound. Then, the sound sensor detects sound from the speaker 62e. The external device control unit 15 adjusts the volume of the speaker 62e so that the volume becomes a fourth predetermined value. When the volume detected by the sound sensor becomes the fourth predetermined value (or a fourth predetermined allowable range including the fourth predetermined value), the sound from the speaker 62e is stopped. The external device control unit 15 stores the volume setting at this time in the memory unit 7.
[0138] Since speaker 62d is the rear left and speaker 62e is the rear right, it is desirable that the third predetermined value and the fourth predetermined value (or the third allowable range and the fourth allowable range) are equal, but they may be different. Also, the first and second predetermined values and the third and fourth predetermined values (or the first and second allowable ranges and the third and fourth allowable ranges) may be equal or different.
[0139] Similarly, the external device control unit 15 generates a control signal so that only the speaker 62a emits sound. Then, the sound sensor detects sound from the speaker 62a. The external device control unit 15 adjusts the volume of the speaker 62a so that the volume becomes a fifth predetermined value. When the volume detected by the sound sensor becomes the fifth predetermined value (or a fifth predetermined allowable range), the external device control unit 15 stops the sound from the speaker 62a. The external device control unit 15 stores the volume setting at this time in the memory unit 7.
[0140] Furthermore, the external device control unit 15 generates a control signal so that only the speaker 62f emits sound. Then, the sound sensor detects sound from the speaker 62f. The external device control unit 15 adjusts the volume of the speaker 62f so that the volume reaches a sixth predetermined value. When the volume detected by the sound sensor reaches a fifth predetermined value (or a fifth predetermined allowable range), the external device control unit 15 stops the sound from the speaker 62f. The external device control unit 15 stores the volume setting at this time in the memory unit 7.
[0141] In this way, appropriate volume settings for each speaker that take into account the influence of the environment are saved. For example, in response to a predetermined user operation, the external device control unit 15 may generate a control signal for collectively setting the volume of each speaker based on the volume settings.
[0142] Also, appropriate volume settings may be obtained for multiple positions (for example, the position of the sofa and the position of the dining table), and the user may select one of the volume settings depending on the position from which the sound from the speaker is actually heard, to achieve an appropriate volume. Furthermore, instead of using the volume settings stored in the mobile device 100, the volume of each speaker may be adjusted each time. The above-described embodiments may be combined in any desired manner.
[0143] From the above, the following invention can be conceived, for example.
[0144] [Appendix A1] On your mobile device, Displaying a program guide on a display of the mobile device; In response to a user operation of selecting a specific program using the program guide, the program displays the selected program on a device other than the mobile device, and generates a control signal for setting the image quality or sound quality according to the program.
[0145] [Appendix A2] A program that causes a mobile device to display on the display of the mobile device a program guide in which programs identified based on the usage history or user information of the mobile device are displayed in a manner different from other programs.
[0146] [Appendix A3] On your mobile device, Displaying a program guide on a display of the mobile device; A program that generates a control signal for switching programs displayed on a device other than the mobile device in sequence in response to a predetermined user operation on the touch panel of the mobile device.
[0147] [Appendix A4] The program according to Appendix A3, wherein the user operation is an operation of touching and moving a position on the touch panel corresponding to a position where the program guide is displayed.
[0148] [Appendix A5] The program according to appendix A4, which switches the program displayed on the device depending on the amount or speed of the movement.
[0149] [Appendix A5] The program according to Appendix A3, wherein the user operation is an operation for scrolling a program guide displayed on the display.
[0150] [Appendix A6] The program according to any one of appendices A3 to A5, which cycles through the programs displayed on the device and updates (scrolls) the program guide displayed on the display.
[0151] [Appendix A7] The program according to Appendix A6, wherein switching of the programs displayed on the device and updating (scrolling) of the program guide displayed on the display are performed in synchronization.
[0152] [Appendix A8] On your mobile device, Displaying a program guide on a display of the mobile device; A program that executes the process of generating a control signal for performing different processing when a program included in the program guide is selected by a first user operation and when the program is selected by a second user operation different from the first user operation.
[0153] [Appendix A9] The process when selected by the first user operation is a first process for displaying the selected program on a device different from the mobile device; a second process for recording the selected program; a third process for displaying information about the selected program on the display or the device; and a fourth process of presenting which of the first to third processes should be performed; Either The program according to appended note A8, wherein the process selected by the second user operation is any one of the first to fourth processes.
[0154] [Appendix A10] On your mobile device, Displaying a program guide on a display of the mobile device; In response to a program included in the program guide being selected by a user operation, a program is executed to turn on a device other than the mobile device and generate a control signal for displaying the selected program on the device.
[0155] [Appendix A11] The program according to appendix A9 or A10, which generates a control signal for displaying the selected program and updates the program guide.
[0156] [Appendix A12] The program according to Appendix A11, further comprising: generating a control signal for displaying the selected program; and updating the display of the program guide so that the broadcast station of the selected program is positioned in the center.
[0157] [Appendix A13] On your mobile device, Displaying a program guide on a display of the mobile device, in which a time axis is set in a first direction and a plurality of broadcasting stations is set in a second direction; and changing the order of the broadcasting stations in response to a predetermined user operation.
[0158] [Appendix A14] The program described in Appendix A13, wherein the specified user operation is an operation of touching a position on a touch panel corresponding to a position on a display where one broadcast station is displayed, and moving the touch panel in the second direction while keeping the touch.
[0159] [Appendix B1] On your mobile device, displaying a sound quality adjustment screen for adjusting the sound quality of an acoustic device different from the mobile device on a display of the mobile device; A program that executes the following: updating the sound quality adjustment screen in accordance with the adjusted sound quality in response to a user operation for adjusting the sound quality of the acoustic device using the sound quality adjustment screen; and generating a control signal for adjusting the sound quality of the acoustic device.
[0160] [Appendix B2] the sound quality adjustment screen includes a volume indicator that indicates a volume; The program described in Appendix B1 updates the volume display according to the adjusted volume in response to a user operation for adjusting the volume of the audio device using the volume display, and generates a control signal for adjusting the volume of the audio device.
[0161] [Appendix B3] The program according to Appendix B2, wherein if the volume of the audio device cannot be adjusted, the volume display is returned to the volume display before the user operation.
[0162] [Appendix B4] The program according to appendix B3, which determines whether or not to adjust the volume of the audio device depending on whether or not a predetermined signal originating from the audio device can be received.
[0163] [Appendix B5] The program according to any one of appendices B2 to B4, wherein the sound quality adjustment screen includes a volume display for each of a plurality of speakers displayed in association with their placement positions.
[0164] [Appendix B6] the sound quality adjustment screen includes a graphic shape indicating a volume; generating a control signal for enlarging the graphic and increasing the volume of the audio device in response to a user operation for enlarging the graphic via a touch panel of the mobile device; A program described in any one of Appendices B1 to B5, which generates a control signal to reduce the size of the figure and the volume of the audio equipment in response to a user operation to reduce the size of the figure via a touch panel of the mobile device.
[0165] [Appendix B7] A program described in any one of Appendices B1 to B6, which, when the sound quality adjustment screen is displayed from a state in which the sound quality adjustment screen is not displayed, displays the sound quality adjustment screen according to the current sound quality of the audio device.
[0166] [Appendix B8] The program according to Appendix B7, which grasps the current sound quality of the audio device based on a predetermined signal originating from the audio device.
[0167] [Appendix C1] On your mobile device, displaying an image quality adjustment screen for adjusting image quality of a video device different from the mobile device on a display of the mobile device; A program that executes the following: updating the image quality adjustment screen according to the adjusted image quality in response to a user operation for adjusting the image quality of the video device using the image quality adjustment screen; and generating a control signal for adjusting the image quality of the video device.
[0168] [Appendix C2] the image quality adjustment screen includes a color tone adjustment display for adjusting color tone, The program described in Appendix C1, wherein, in response to a user operation for adjusting the color of the video device using the color adjustment display, the color adjustment display is updated according to a color tone after adjustment, and a control signal for adjusting the color of the video device is generated.
[0169] [Appendix C3] The color adjustment display is A display showing the hue based on primary and intermediate colors; a representation of the color temperature in a given color space, or a representation showing the color gamut in a given color space; 1. The program of claim 1, further comprising:
[0170] [Appendix C4] The program according to appendix C2 or C3, wherein if the hue of the video device cannot be adjusted, the display returns to the hue adjustment display before the user operation.
[0171] [Appendix C5] the image quality adjustment screen includes a brightness adjustment display for adjusting brightness, The program described in any one of appendices C1 to C4, wherein, in response to a user operation for adjusting the brightness of the video device using the brightness adjustment display, the brightness adjustment display is updated according to the adjusted brightness, and a control signal for adjusting the brightness of the video device is generated.
[0172] [Appendix C6] the brightness adjustment display includes a brightness display indicating a gamma value, The program described in Appendix C5 updates the brightness display according to the adjusted gamma value in response to a user operation for adjusting (correcting) the gamma value of the video device using the brightness display, and generates a control signal for adjusting (correcting) the gamma value of the video device.
[0173] [Appendix C7] The program according to Appendix C6, wherein the brightness display is a graph showing the relationship between an input signal and brightness.
[0174] [Appendix C8] The program according to any one of appendices C5 to C7, wherein if the brightness of the video device cannot be adjusted, the display returns to the brightness adjustment display before the user operation.
[0175] [Appendix C9] the image quality adjustment screen includes a graphic shape indicating brightness, generating a control signal for enlarging the graphic and increasing the brightness of the video device in response to a user operation for enlarging the graphic via a touch panel of the mobile device; The program according to any one of claims C1 to C8, wherein in response to a user operation to make the graphic smaller via a touch panel of the mobile device, a control signal is generated to make the graphic smaller and to reduce the brightness of the video device.
[0176] [Appendix C10] The program according to appendix C4 or C8, which determines whether or not sound quality adjustment of the video device is possible depending on whether a predetermined signal originating from the video device can be received.
[0177] [Appendix C11] A program described in any of Appendices C1 to C10, which, when the image quality adjustment screen is displayed from a state in which the image quality adjustment screen is not displayed, displays the image quality adjustment screen according to the current image quality of the video device.
[0178] [Appendix C12] The program according to appendix C11, which grasps the current image quality of the video device based on a predetermined signal originating from the video device.
[0179] [Appendix D1] A program that causes a mobile device to adjust the sound quality of an acoustic device different from the mobile device according to a measurement result by a sensor of the mobile device.
[0180] [Appendix D2] The program according to Appendix D1, wherein the sensor is a sound sensor (that picks up ambient sounds), and generates a control signal for adjusting the volume of the audio device according to the measurement result of the sound sensor.
[0181] [Appendix D3] (If it's noisy around you, turn up the volume on the TV.) The program according to appendix D2, wherein the program generates a control signal for increasing the volume of the audio device as the volume measured by the sound sensor increases.
[0182] [Appendix D4] (Ensure that the TV volume remains constant at the mobile device's position when it is quiet.) The program according to appendix D2, which generates a control signal for adjusting the volume of the acoustic device so that the volume from the acoustic device, as determined based on the measurement results of the sound sensor, approaches a target value.
[0183] [Appendix D5] The program described in Appendix D2 generates a control signal for adjusting the volume of the audio device in accordance with the volume from the audio device and other volumes determined based on the measurement results of the sound sensor.
[0184] [Appendix D6] the audio device is a television; The program according to appendix D4 or D5, which compares information indicating the sound of a television program with the measurement results of the sound sensor to determine the volume from the audio device.
[0185] [Appendix D7] On your mobile device, generating a control signal for adjusting a volume of a first speaker different from the mobile device so that a volume measured by a sound sensor of the mobile device becomes a first predetermined value; and generating a control signal for adjusting the volume of a second speaker, different from the mobile device, so that the volume measured by the sound sensor becomes a second predetermined value.
[0186] [Appendix D8] storing a volume setting for the first speaker when the volume measured by the sound sensor is within the first predetermined value or a first tolerance range; and saving a volume setting for the second speaker when the volume measured by the sound sensor is the second predetermined value or a second acceptable range.
[0187] [Appendix D9] The program of Appendix D8, comprising generating a control signal for adjusting the volume of the first speaker and the second speaker based on a saved volume setting.
[0188] [Appendix D10] The program according to any one of Appendices D7 to D9, wherein the first predetermined value and the second predetermined value are equal.
[0189] [Appendix E1] A program that causes a mobile device to adjust the image quality of a video device different from the mobile device according to a measurement result by a sensor of the mobile device.
[0190] [Appendix E2] The program according to Appendix E1, wherein the sensor is an optical sensor (measuring ambient illuminance), and the higher the illuminance measured by the optical sensor, the brighter the video device is made.
[0191] [Appendix E3] The program according to appendix E1 or E2, wherein the sensor is a color sensor (measuring the color of ambient lighting), and the color tone of the video device is adjusted according to the color of light measured by the color sensor.
[0192] [Appendix E4] The program according to Appendix E3, wherein the color temperature of the video device is lowered as the color temperature of the light measured by the color sensor decreases.
Claims
1. a processor of a computer having a touch panel display; a first means for acquiring image quality of a display to be controlled that is different from the computer from the display to be controlled; a second means for displaying a status indication indicating the acquired image quality on the touch panel display in a display mode corresponding to the acquired image quality; a third means for generating a control signal to adjust the image quality of the display to be controlled in response to a touch operation for adjusting the image quality of the display to be controlled, the touch operation updating the display mode of a status display that is displayed in a display mode corresponding to the acquired image quality, so that the updated display mode of the status display corresponds to the image quality of the display to be controlled.
2. The program described in claim 1 (excluding, however, one in which "a screen corresponding to the screen displayed on the control target display is displayed on the touch panel display, and the image quality of the corresponding screen is adjusted when the display mode of the status display is updated").
3. A computer having a touch panel display, a first means for acquiring image quality of a display to be controlled that is different from the computer from the display to be controlled; a second means for displaying a status indication indicating the acquired image quality on the touch panel display in a display mode corresponding to the acquired image quality; a third means for generating a control signal for adjusting the image quality of the display to be controlled in response to a touch operation for adjusting the image quality of the display to be controlled, the touch operation updating the display mode of a status display that is displayed in a display mode corresponding to the acquired image quality, so that the updated display mode of the status display corresponds to the image quality of the display to be controlled.
4. A computer having the program according to claim 1 or 2 installed therein, or a display to be controlled by the computer according to claim 3, means for transmitting the image quality of the display to the computer; and means for adjusting an image quality of the display based on the control signal.
Citation Information
Patent Citations
Equipment control method and equipment controller
JP2002016984A
Digital camera and television
JP2007158409A
Remote apparatus, remote control method, program, and display control device
JP2010016734A
Information processing terminal
JP2013243704A
Video display device and its control method
JP2015038537A