Output control device

Abstract

This output control device comprises: an acquisition unit which acquires content that indicates an image and sound; an estimation unit which, on the basis of the content and user information that pertains to a user wearing a transparent display device, estimates the user's degree of concentration with respect to the content; a display control unit which displays, on the transparent display device, the image indicated by the content; and a volume control unit which, on the basis of the degree of concentration, controls the volume of the sound indicated by the content.

Description

Technical Field

[0001] The present invention relates to an output control device.

Background Art

[0002] As a device for realizing Augmented Reality (AR) that superimposes information such as images on the real world, AR glasses are known. AR glasses are also referred to as transmissive Head Mounted Displays (HMDs). Patent Document 1 discloses a technique for controlling the display mode of information displayed by a transmissive HMD so that a user wearing the transmissive HMD does not gaze too much at the information displayed on the transmissive HMD.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a situation where the AR glasses display an image shown by the content and also emit a sound shown by the content, the user of the AR glasses can recognize the content by the image and the sound. In such a case, if the user of the AR glasses focuses too much on the sound shown by the content, the user's perception of the real world performed by the user of the AR glasses will be neglected.

[0005] An object of the present invention is to provide an output control device capable of suppressing a user from focusing too much on the content.

Means for Solving the Problems

[0006] An output control device according to an aspect of the present invention includes an acquisition unit that acquires content indicating an image and sound, an estimation unit that estimates the degree of concentration of the user on the content based on the content and user information regarding a user wearing a transmissive display device, a display control unit that causes the transmissive display device to display the image indicated by the content, and a volume control unit that controls the volume of the sound indicated by the content based on the degree of concentration.

Advantages of the Invention

[0007] According to an aspect of the present invention, it is possible to prevent a user from concentrating too much on content.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Best Mode for Carrying Out the Invention

[0009] A: First Embodiment A1: Mobile Device 1 and AR Glasses 2 FIG. 1 is a diagram for explaining the mobile device 1 and the AR glasses 2. The mobile device 1 is, for example, a smartphone. The mobile device 1 is not limited to a smartphone and may be, for example, a tablet or a notebook personal computer. The mobile device 1 is also referred to as a terminal device.

[0010] The mobile device 1 acquires content A indicating a content image and content sound. The mobile device 1 acquires content A from a content distribution device 3 such as a server via a communication line NW. The mobile device 1 may acquire content A not from the content distribution device 3 but from a device different from the content distribution device 3 (for example, a portable memory).

[0011] Content A is information indicating a content image and content sound, for example, digital information indicating a content image and content sound. Content A includes image information indicating a content image and sound information indicating content sound. Content A may include meta information regarding content A. The meta information indicates, for example, the title of content A, the format of the content image, and the content shown in the content image. The format of the content image is, for example, a video or a still image. The format of the content image is not limited to a video or a still image and may be, for example, a 3D model or a 2D image.

[0012] The mobile device 1 is connected to the AR glasses 2 by wire. The mobile device 1 may be connected to the AR glasses 2 wirelessly. The mobile device 1 controls the AR glasses 2 based on content A.

[0013] The AR glasses 2 are a glasses-type display device. The AR glasses 2 are an example of a transmissive HMD that transmits light and displays images. Also, the AR glasses 2 are an example of a transmissive display device. The transmissive display device is not limited to the AR glasses 2, and for example, it may be a goggle-shaped transmissive HMD having the same functions as those of the AR glasses 2.

[0014] The AR glasses 2 include temples 91 and 92, a bridge 93, body parts 94 and 95, and lenses 2aL and 2aR.

[0015] In the body part 94, a display panel for the left eye and an optical member for the left eye are provided. The display panel is, for example, a liquid crystal panel or an organic EL (Electro Luminescence) panel. The display panel for the left eye displays a content image indicated by the image information of content A, for example, based on the control from the portable device 1. The optical member for the left eye is an optical member that guides the light emitted from the display panel for the left eye to the lens 2aL.

[0016] In the body part 95, a display panel for the right eye and an optical member for the right eye are provided. The display panel for the right eye displays a content image indicated by the image information of content A, for example, based on the control from the portable device 1. The optical member for the right eye is an optical member that guides the light emitted from the display panel for the right eye to the lens 2aR.

[0017] Each of the lenses 2aL and 2aR has a half mirror. The half mirror of the lens 2aL guides the light representing the real world to the left eye B1L of the user B by transmitting the light representing the real world. Also, the half mirror of the lens 2aL reflects the light guided by the optical member for the left eye to the left eye B1L of the user B. The half mirror of the lens 2aR guides the light representing the real world to the right eye B1R of the user B by transmitting the light representing the real world. Also, the half mirror of the lens 2aR reflects the light guided by the optical member for the right eye to the right eye B1R of the user B.

[0018] As will be described later with reference to FIG. 8 and the like, the display unit 2a includes a lens 2aL, a display panel for the left eye, an optical member for the left eye, a lens 2aR, a display panel for the right eye, and an optical member for the right eye. The display unit 2a is a transmissive display unit that transmits light.

[0019] The light representing the real world passes through the display unit 2a. The display unit 2a displays a content image indicated by the image information of content A based on the control from the mobile device 1. When the user B wears the AR glasses 2, the display unit 2a is positioned in front of the left eye B1L and the right eye B1R of the user B. The user B wearing the AR glasses 2 can visually recognize the real world represented by the light transmitted through the display unit 2a and the content image displayed on the display unit 2a. For example, the user B can visually recognize the content image superimposed on the real world.

[0020] In addition to the display unit 2a, the AR glasses 2 include a sound-emitting unit 2b. As shown in FIG. 1, the sound-emitting unit 2b is positioned on each of the body portions 94 and 95. The sound-emitting unit 2b may be positioned, for example, on one of the body portions 94 and 95, at least one of the temples 91 and 92, or the bridge 93, instead of being positioned on each of the body portions 94 and 95. At least one of the temples 91 and 92 means, for example, "temple 91", "temple 92", or "temples 91 and 92". The sound-emitting unit 2b is, for example, a speaker. The sound-emitting unit 2b may be separate from the AR glasses 2 instead of being included in the AR glasses 2. The sound-emitting unit 2b separate from the AR glasses 2 is not limited to a speaker and may be, for example, earphones or headphones. The sound-emitting unit 2b separate from the AR glasses 2 is connected to the mobile device 1 or the AR glasses 2 wirelessly, for example. The sound-emitting unit 2b separate from the AR glasses 2 may be connected to the mobile device 1 or the AR glasses 2 by wire. The sound-emitting unit 2b is controlled directly by the mobile device 1 or via the AR glasses 2. The sound-emitting unit 2b outputs a content sound indicated by the sound information of content A based on the control from the mobile device 1.

[0021] User B wearing the AR glasses 2 can listen to content sounds while viewing the real world and the content images. Therefore, user B wearing the AR glasses 2 can recognize content A by the content images and content sounds while perceiving the real world.

[0022] A2: Portable device 1 Figure 2 is a diagram showing an example of the portable device 1. The portable device 1 includes an input device 11, an output device 12, communication devices 13 and 14, a storage device 15, a processing device 16, and a bus 17. The input device 11, the output device 12, the communication devices 13 and 14, and the storage device 15 and the processing device 16 are interconnected by a bus 17 for communicating information. The bus 17 may be configured using a single bus or may be configured using different buses for each device.

[0023] The input device 11 includes a touch panel. The input device 11 may include a plurality of operation keys in addition to the touch panel. The input device 11 may include a plurality of operation keys without including the touch panel. The input device 11 receives operations performed by user B.

[0024] The output device 12 includes a display. The touch panel of the input device 11 is laminated on the display of the output device 12. The output device 12 displays various information.

[0025] The communication device 13 communicates with the content distribution device 3 via the communication line NW. The communication device 13 may communicate with the content distribution device 3 without going through the communication line NW. The communication device 13 receives content A from the content distribution device 3.

[0026] The communication device 14 communicates with the AR glasses 2 by wire. The communication device 14 may communicate with the AR glasses 2 wirelessly.

[0027] The storage device 15 is a recording medium readable by the processing device 16. The storage device 15 includes, for example, a non-volatile memory and a volatile memory. The non-volatile memory is, for example, a ROM (Read Only Memory), an EPROM (Erasable Programmable Read Only Memory), and an EEPROM (Electrically Erasable Programmable Read Only Memory). The volatile memory is, for example, a RAM (Random Access Memory). The storage device 15 stores the program PG1 and the user information Ba.

[0028] The user information Ba is information regarding the user B. The user information Ba includes preference information Bc. The preference information Bc is information indicating the preferences of the user B. The preference information Bc is generated, for example, based on the history of the content viewed by the user B using the portable device 1. The preference information Bc may be generated based on the history of the content viewed by the user B using the AR glasses 2. The preference information Bc may be generated by the processing device 16 or may be generated by a server (not shown) that communicates with the portable device 1. Since the generation method of the preference information Bc is a known technique, a detailed description thereof is omitted.

[0029] The processing device 16 includes one or more CPUs (Central Processing Unit). The one or more CPUs are an example of one or more processors. Each of the processor and the CPU is an example of a computer.

[0030] The processing device 16 is an example of an output control device. The processing device 16 reads the program PG1 from the storage device 15. By executing the program PG1, the processing device 16 functions as an acquisition unit 161, an estimation unit 162, a volume control unit 163, and a display control unit 164. The acquisition unit 161 may be constituted by circuits such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array). At least one of the estimation unit 162, the volume control unit 163, and the display control unit 164 may be constituted by circuits such as a DSP, an ASIC, a PLD, and an FPGA. At least one of the estimation unit 162, the volume control unit 163, and the display control unit 164 means, for example, "estimation unit 162", "volume control unit 163", "display control unit 164", "estimation unit 162 and volume control unit 163", "estimation unit 162 and display control unit 164", "volume control unit 163 and display control unit 164", or "estimation unit 162, volume control unit 163, and display control unit 164".

[0031] The acquisition unit 161 acquires the content A from the content distribution device 3 via the communication device 13. The acquisition unit 161 may acquire the content A from a personal information processing device such as a personal computer or a portable recording medium such as a USB (Universal Serial Bus) memory instead of from the content distribution device 3.

[0032] The estimation unit 162 estimates the concentration degree C of the user B with respect to the content A based on the content A and the user information Ba. The estimation unit 162 indicates the concentration degree C of the user B with respect to the content A by a numerical value. The numerical value indicating the concentration degree C increases as the concentration degree C increases. The numerical value indicating the concentration degree C decreases as the concentration degree C decreases.

[0033] The estimation unit 162 estimates the concentration degree C based on, for example, the format of the content image and the preference information Bc.

[0034] First, the estimation unit 162 identifies image information indicating a content image from Content A. Subsequently, the estimation unit 162 identifies the format of the content image by analyzing the image information indicating the content image. If Content A includes meta information indicating the format of the content image, the estimation unit 162 may identify the format of the content image based on the meta information.

[0035] In a situation where the preference information Bc indicates that User B prefers videos over still images, if the format of the content image is a video, the estimation unit 162 estimates a concentration degree H1 that is greater than the first level Lv1 as the concentration degree C.

[0036] In a situation where the preference information Bc indicates that User B prefers videos over still images, if the format of the content image is a still image, the estimation unit 162 estimates a concentration degree L1 that is smaller than the first level Lv1 as the concentration degree C.

[0037] In this way, the estimation unit 162 sets the concentration degree C (concentration degree H1) estimated when Content A matches User B's preference to a concentration degree greater than the concentration degree C (concentration degree L1) estimated when Content A does not match User B's preference. Also, the estimation unit 162 changes the concentration degree C according to the format of the content image.

[0038] The preference information Bc is not limited to information indicating that User B prefers videos over still images. For example, the preference information Bc may be information indicating that User B prefers 3D models over 2D images.

[0039] In a situation where the preference information Bc indicates that User B prefers 3D models over 2D images, if the format of the content image is a 3D model, the estimation unit 162 estimates a concentration degree H2 that is greater than the first level Lv1 as the concentration degree C. The concentration degree H2 may be the same value as the concentration degree H1 or a different value.

[0040] In a situation where the preference information Bc indicates that user B prefers a 3D model over a 2D image, when the format of the content image is a 2D image, the estimation unit 162 estimates a concentration level L2 that is smaller than the first level Lv1 as the concentration C. The concentration level L2 may be the same value as the concentration level L1 or a different value.

[0041] The preference information Bc may be information indicating that user B prefers an image consisting only of a character string (for example, an image consisting only of the character string of an e-mail).

[0042] In a situation where the preference information Bc indicates that user B prefers an image consisting only of a character string, when the format of the content image is a format consisting only of a character string, the estimation unit 162 estimates a concentration level H3 that is larger than the first level Lv1 as the concentration C. The concentration level H3 may be the same value as at least one of the concentration levels H1 and H2, or a value different from both of the concentration levels H1 and H2. At least one of the concentration levels H1 and H2 means, for example, "concentration level H1", "concentration level H2", or "both concentration levels H1 and H2".

[0043] In a situation where the preference information Bc indicates that user B prefers an image consisting only of a character string, when the format of the content image is a format including a character string and a figure, the estimation unit 162 estimates a concentration level L3 that is smaller than the first level Lv1 as the concentration C. The concentration level L3 may be the same value as at least one of the concentration levels L1 and L2, or a value different from both of the concentration levels L1 and L2. At least one of the concentration levels L1 and L2 means, for example, "concentration level L1", "concentration level L2", or "both concentration levels L1 and L2".

[0044] The estimation unit 162 may estimate the concentration based on the content shown in the content image and the preference information Bc.

[0045] The estimation unit 162 first identifies image information indicating the content image from the content A. Subsequently, the estimation unit 162 identifies the content shown in the content image by analyzing the image information indicating the content image. When the content A includes meta information indicating the content shown in the content image, the estimation unit 162 may identify the content shown in the content image based on the meta information.

[0046] For example, in a situation where the preference information Bc indicates that the user B prefers animals, when the content image shows an animal, the estimation unit 162 estimates, as the concentration C, a concentration H4 greater than the first level Lv1. The concentration H4 may be the same value as at least one of the concentrations H1, H2, and H3, or may be a value different from any of the concentrations H1, H2, and H3. At least one of the concentrations H1, H2, and H3 means, for example, "concentration H1", "concentration H2", "concentration H3", "concentrations H1 and H2", "concentrations H1 and H3", "concentrations H2 and H3", or "concentrations H1, H2, and H3".

[0047] In a situation where the preference information Bc indicates that the user B prefers animals, when the content image does not show an animal, the estimation unit 162 estimates, as the concentration C, a concentration L4 smaller than the first level Lv1. The concentration L4 may be the same value as at least one of the concentrations L1, L2, and L3, or may be a value different from any of the concentrations L1, L2, and L3. At least one of the concentrations L1, L2, and L3 means, for example, "concentration L1", "concentration L2", "concentration L3", "concentrations L1 and L2", "concentrations L1 and L3", "concentrations L2 and L3", or "concentrations L1, L2, and L3".

[0048] In this way, the estimation unit 162 changes the concentration C according to the content shown in the content image (for example, whether the content image shows an animal or not).

[0049] The content shown in the content image used for estimating the concentration C is not limited to the content related to animals.

[0050] For example, in a situation where the preference information Bc indicates that the user B prefers mazes, when the content image shows a maze which is an example of a complex object (object), the estimation unit 162 estimates a concentration H5 that is greater than the first level Lv1 as the concentration C. The concentration H5 may be the same value as at least one of the concentrations H1, H2, H3, and H4, or may be a value different from any of the concentrations H1, H2, H3, and H4. At least one of the concentrations H1, H2, H3, and H4 means, for example, "concentration H1", "concentration H2", "concentration H3", "concentration H4", "concentrations H1 and H2", "concentrations H1 and H3", "concentrations H1 and H4", "concentrations H2 and H3", "concentrations H2 and H4", "concentrations H3 and H4", "concentrations H1, H2, and H3", "concentrations H1, H2, and H4", "concentrations H1, H3, and H4", "concentrations H2, H3, and H4", or "concentrations H1, H2, H3, and H4".

[0051] In a situation where the preference information Bc indicates that user B has a preference for mazes and the content image does not show a maze, the estimation unit 162 estimates a concentration level L5 that is smaller than the first level Lv1 as the concentration level C. The concentration level L5 may be the same value as at least one of the concentration levels L1, L2, L3, and L4, or may be a value different from any of the concentration levels L1, L2, L3, and L4. At least one of the concentration levels L1, L2, L3, and L4 means, for example, "concentration level L1", "concentration level L2", "concentration level L3", "concentration level L4", "concentration levels L1 and L2", "concentration levels L1 and L3", "concentration levels L1 and L4", "concentration levels L2 and L3", "concentration levels L2 and L4", "concentration levels L3 and L4", "concentration levels L1, L2, and L3", "concentration levels L1, L2, and L4", "concentration levels L1, L3, and L4", "concentration levels L2, L3, and L4", or "concentration levels L1, L2, L3, and L4".

[0052] In a situation where the preference information Bc includes the preference information that user B likes a character string, when the content image shows a predetermined number (for example, 300) or more characters, the estimation unit 162 estimates the concentration H6 as the concentration C. The concentration H6 may be the same value as at least one of the concentrations H1, H2, H3, H4, and H5, or may be a value different from any of the concentrations H1, H2, H3, H4, and H5. The predetermined number is not limited to 300, and may be more than 300 or less than 300. At least one of the concentrations H1, H2, H3, H4, and H5 means, for example, "concentration H1", "concentration H2", "concentration H3", "concentration H4", "concentration H5", "concentration H1 and concentration H2", "concentration H1 and concentration H3", "concentration H1 and concentration H4", "concentration H1 and concentration H5", "concentration H2 and concentration H3", "concentration H2 and concentration H4", "concentration H2 and concentration H5", "concentration H3 and concentration H4", "concentration H3 and concentration H5", "concentration H4 and concentration H5", "concentration H1, concentration H2, and concentration H3", "concentration H1, concentration H2, and concentration H4", "concentration H1, concentration H2, and concentration H5", "concentration H1, concentration H3, and concentration H4", "concentration H1, concentration H3, and concentration H5", "concentration H1, concentration H4, and concentration H5", "concentration H2, concentration H3, and concentration H4", "concentration H2, concentration H3, and concentration H5", "concentration H2, concentration H4, and concentration H5", "concentration H3, concentration H4, and concentration H5", "concentration H1, concentration H2, concentration H3, and concentration H4", "concentration H1, concentration H2, concentration H3, and concentration H5", "concentration H1, concentration H2, concentration H4, and concentration H5", "concentration H1, concentration H3, concentration H4, and concentration H5", "concentration H2, concentration H3, concentration H4, and concentration H5", or "concentration H1, concentration H2, concentration H3, concentration H4, and concentration H5".

[0053] In a situation where the preference information Bc includes the preference information that user B likes a character string, when the content image does not show a predetermined number (for example, 300) or more characters, the estimation unit 162 estimates concentration L6 as the concentration C. The concentration L6 may be the same value as at least one of the concentrations L1, L2, L3, L4, and L5, or may be a value different from any of the concentrations L1, L2, L3, L4, and L5. At least one of the concentrations L1, L2, L3, L4, and L5 means, for example, "concentration L1", "concentration L2", "concentration L3", "concentration L4", "concentration L5", "concentration L1 and concentration L2", "concentration L1 and concentration L3", "concentration L1 and concentration L4", "concentration L1 and concentration L5", "concentration L2 and concentration L3", "concentration L2 and concentration L4", "concentration L2 and concentration L5", "concentration L3 and concentration L4", "concentration L3 and concentration L5", "concentration L4 and concentration L5", "concentration L1, concentration L2 and concentration L3", "concentration L1, concentration L2 and concentration L4", "concentration L1, concentration L2 and concentration L5", "concentration L1, concentration L3 and concentration L4", "concentration L1, concentration L3 and concentration L5", "concentration L1, concentration L4 and concentration L5", "concentration L2, concentration L3 and concentration L4", "concentration L2, concentration L3 and concentration L5", "concentration L2, concentration L4 and concentration L5", "concentration L3, concentration L4 and concentration L5", "concentration L1, concentration L2, concentration L3 and concentration L4", "concentration L1, concentration L2, concentration L3 and concentration L5", "concentration L1, concentration L2, concentration L4 and concentration L5", "concentration L1, concentration L3, concentration L4 and concentration L5", "concentration L2, concentration L3, concentration L4 and concentration L5", or "concentration L1, concentration L2, concentration L3, concentration L4 and concentration L5".

[0054] The concentrations H1, H2, H3, H4, H5, H6, L1, L2, L3, L4, L5, and L6 may each be a fixed value or a value changeable by user B or the like.

[0055] The volume control unit 163 causes the content sound indicated by the sound information included in the content A to be emitted from the sound emitting unit 2b of the AR glasses 2.

[0056] The volume control unit 163 controls the volume of the content sound based on the concentration C estimated by the estimation unit 162. For example, as shown in FIG. 3, when the concentration C is equal to or higher than the first level Lv1, the volume control unit 163 sets the volume of the content sound to be smaller than the volume of the content sound when the concentration C is less than the first level Lv1.

[0057] The volume control unit 163 may decrease the volume of the content sound in response to an increase in the concentration C. For example, as shown in FIG. 4 or FIG. 5, the volume control unit 163 may decrease the volume of the content sound in response to an increase in the concentration C and increase the volume of the content sound in response to a decrease in the concentration C. In the example shown in FIG. 4, the relationship between the concentration C and the volume of the content sound is a linear relationship. In the example shown in FIG. 5, the relationship between the concentration C and the volume of the content sound is a non-linear relationship.

[0058] Also in the example shown in FIG. 4 and the example shown in FIG. 5, when the concentration C is equal to or higher than the first level Lv1, the volume control unit 163 sets the volume of the content sound to be smaller than the volume of the content sound when the concentration C is less than the first level Lv1.

[0059] In the example where the volume of the content sound when the concentration C is equal to or higher than the first level Lv1 is set to be smaller than the volume of the content sound when the concentration C is less than the first level Lv1, the relationship between the concentration C and the volume of the content sound is not limited to the relationships shown in FIG. 3, FIG. 4, or FIG. 5. For example, as the relationship between the concentration C and the volume of the content sound, the relationship shown in FIG. 6 may be used.

[0060] The method of controlling the volume of the content sound based on the concentration C is not limited to the above-described method and can be appropriately changed. For example, as the relationship between the concentration C and the volume of the content sound, the relationship shown in FIG. 7 may be used.

[0061] By controlling the volume of the content sound based on the concentration C, it becomes possible to control the volume of the content sound so that user B does not overly concentrate on content A. Therefore, it is possible to suppress the neglect of user B's perception of the real world.

[0062] The volume control unit 163 generates a sound signal indicating the content sound based on the sound information of content A included in content A. The volume control unit 163 determines the amplification factor of the sound signal based on the concentration C. An increase in the amplification factor of the sound signal causes an increase in the volume of the content sound. A decrease in the amplification factor of the sound signal causes a decrease in the volume of the content sound.

[0063] For example, when the concentration C is less than the first level Lv1, the volume control unit 163 determines the first amplification factor as the amplification factor of the sound signal. When the concentration C is equal to or greater than the first level Lv1, the volume control unit 163 determines a second amplification factor smaller than the first amplification factor as the amplification factor of the sound signal. The volume control unit 163 may decrease the amplification factor of the sound signal in response to an increase in the concentration C. The volume control unit 163 may decrease the amplification factor of the sound signal in response to an increase in the concentration C and increase the amplification factor of the sound signal in response to a decrease in the concentration C. The volume control unit 163 generates the content sound signal A1 by amplifying the sound signal at the amplification factor determined based on the concentration C. The volume control unit 163 controls the volume of the content sound by providing the content sound signal A1 to the AR glasses 2 via the communication device 14.

[0064] The display control unit 164 causes the content image to be displayed on the display unit 2a of the AR glasses 2 based on the image information of content A included in content A. The display control unit 164 controls the display mode of the content image based on the concentration C.

[0065] For example, the display control unit 164 increases the size of the content image in response to an increase in the concentration C. The display control unit 164 may increase the size of the content image in response to an increase in the concentration C and decrease the size of the content image in response to a decrease in the concentration C. The size of the content image based on the concentration C is an example of the display mode of the content image based on the concentration C. When the size of the content image increases in response to an increase in the concentration C, the visibility of the content image improves. Therefore, in response to an increase in the concentration C, the time required for user B to view the content image can be shortened. Thus, it is possible to prevent user B from concentrating too much on the content image (content A).

[0066] The display control unit 164 may increase the resolution of the content image in response to an increase in the concentration C. The display control unit 164 may increase the resolution of the content image in response to an increase in the concentration C and decrease the resolution of the content image in response to a decrease in the concentration C. The resolution of the content image based on the concentration C is an example of the display mode of the content image based on the concentration C. When the resolution of the content image increases in response to an increase in the concentration C, the image quality of the content image improves. As the resolution of the content image increases, that is, as the image quality of the content image improves, the visibility of the content image improves. Therefore, in response to an increase in the concentration C, the time required for user B to view the content image can be shortened. Thus, it is possible to prevent user B from concentrating too much on the content image (content A).

[0067] The display control unit 164 may move the display position of the content image closer to the edge of the display unit 2a in response to an increase in the concentration C. The display control unit 164 may move the display position of the content image closer to the edge of the display unit 2a in response to an increase in the concentration C, and may move the display position of the content image closer to the center of the display unit 2a in response to a decrease in the concentration C. The display position of the content image based on the concentration C is an example of the display mode of the content image based on the concentration C. The closer the display position of the content image is to the edge of the display unit 2a, the easier it is to view the real world. Therefore, the visibility of the real world improves in response to an increase in the concentration C. Thus, it is possible to prevent user B from concentrating too much on the content image (content A) and neglecting the perception of the real world.

[0068] The display control unit 164 may increase the transmittance of the content image in response to an increase in the concentration C. The display control unit 164 may increase the transmittance of the content image in response to an increase in the concentration C, and may decrease the transmittance of the content image in response to a decrease in the concentration C. The transmittance of the content image based on the concentration C is an example of the display mode of the content image based on the concentration C. When the transmittance of the content image increases in response to an increase in the concentration C, the real world becomes easier to view. Therefore, the visibility of the real world improves in response to an increase in the concentration C. Thus, it is possible to prevent user B from concentrating too much on the content image (content A) and neglecting the perception of the real world.

[0069] The display control unit 164 may decrease the display time of the content image in response to an increase in the concentration C. The display control unit 164 may decrease the display time of the content image in response to an increase in the concentration C, and may increase the display time of the content image in response to a decrease in the concentration C. The display time of the content image according to the concentration C is an example of the display mode of the content image based on the concentration C. In this case, it is possible to prevent user B from being immersed in the content image (content A).

[0070] When the concentration C is equal to or higher than the second level Lv2, the display control unit 164 may hide the content image. Hiding the content image means setting the display time of the content image to "0". The second level Lv2 may be the same as or different from the first level Lv1. Also in this case, it is possible to prevent user B from being immersed in the content image (Content A).

[0071] The display control unit 164 generates a content image signal A2 by performing image processing based on the concentration C on the image information of Content A included in Content A. The content image signal A2 indicates a content image in a display mode based on the concentration C.

[0072] The image processing based on the concentration C is, for example, a first image processing in which the size of the content image increases as the concentration C increases and the size of the content image decreases as the concentration C decreases.

[0073] The image processing based on the concentration C may be a second image processing in which the resolution of the content image increases as the concentration C increases and the resolution of the content image decreases as the concentration C decreases.

[0074] The image processing based on the concentration C may be a third image processing in which the display position of the content image approaches the edge of the display unit 2a as the concentration C increases and the display position of the content image approaches the center of the display unit 2a as the concentration C decreases.

[0075] The image processing based on the concentration C may be a fourth image processing in which the transmittance of the content image increases as the concentration C increases and the transmittance of the content image decreases as the concentration C decreases.

[0076] The image processing based on the concentration C may be a fifth image processing in which the display time of the content image decreases as the concentration C increases and the display time of the content image increases as the concentration C decreases.

[0077] Image processing based on the concentration C may include at least two of the first to fifth image processes. At least two of the first to fifth image processes are, for example, "the first image process and the second image process", "the first image process and the third image process", "the first image process and the fourth image process", "the first image process and the fifth image process", "the second image process and the third image process", "the second image process and the fourth image process", "the second image process and the fifth image process", "the third image process and the fourth image process", "the third image process and the fifth image process", "the fourth image process and the fifth image process", "the first image process, the second image process and the third image process", "the first image process, the second image process and the fourth image process", "the first image process, the second image process and the fifth image process", "the first image process, the third image process and the fourth image process", "the first image process, the third image process and the fifth image process", "the first image process, the fourth image process and the fifth image process", "the second image process, the third image process and the fourth image process", "the second image process, the third image process and the fifth image process", "the second image process, the fourth image process and the fifth image process", "the third image process, the fourth image process and the fifth image process", "the first image process, the second image process, the third image process and the fourth image process", "the first image process, the second image process, the third image process and the fifth image process", "the first image process, the second image process, the fourth image process and the fifth image process", "the first image process, the third image process, the fourth image process and the fifth image process", "the second image process, the third image process, the fourth image process and the fifth image process", or "the first image process, the second image process, the third image process, the fourth image process and the fifth image process".

[0078] When the display control unit 164 generates the content image signal A2 by performing image processing based on the concentration C on the image information of the content A, the display control unit 164 provides the content image signal A2 to the AR glass 2 via the communication device 14. The display control unit 164 controls the display mode of the content image by providing the content image signal A2 to the AR glass 2.

[0079] A3: AR glass 2 FIG. 8 is a diagram showing an example of the AR glass 2. The AR glass 2 includes a communication device 2c, a storage device 2d, a processing device 2e, and a bus 2f, in addition to a display unit 2a and a sound output unit 2b. The display unit 2a, the sound output unit 2b, the communication device 2c, the storage device 2d, and the processing device 2e are interconnected by a bus 2f for communicating information. The bus 2f may be configured using a single bus, or may be configured using different buses for each element such as a device.

[0080] The communication device 2c communicates with the portable device 1 by wire. The communication device 2c may communicate with the portable device 1 wirelessly.

[0081] The storage device 2d is a recording medium readable by the processing device 2e. The storage device 2d includes, for example, a non-volatile memory and a volatile memory. The storage device 2d stores a program PG2.

[0082] The processing device 2e includes one or more CPUs. The processing device 2e reads the program PG2 from the storage device 2d. The processing device 2e functions as an operation control unit 2e1 by executing the program PG2. The operation control unit 2e1 may be configured by circuits such as a DSP, an ASIC, a PLD, and an FPGA.

[0083] The operation control unit 2e1 controls the operation of the AR glass 2. For example, the operation control unit 2e1 provides the content sound signal A1 received by the communication device 2c from the portable device 1 to the sound output unit 2b. The sound output unit 2b outputs the content sound indicated by the content sound signal A1. The operation control unit 2e1 provides the content image signal A2 received by the communication device 2c from the portable device 1 to the display unit 2a. The display unit 2a displays the content image indicated by the content image signal A2.

[0084] A4: Description of Operation FIG. 9 is a diagram for explaining an example of the operation of the portable device 1.

[0085] In step S101, the acquisition unit 161 acquires content A from the content distribution device 3 via the communication device 13.

[0086] Subsequently, in step S102, the estimation unit 162 estimates the concentration degree C based on the content A and the user information Ba. For example, the estimation unit 162 estimates the concentration degree C based on the content A and the preference information Bc. The estimation unit 162 sets the concentration degree C estimated when the content A matches the preference of the user B to be higher than the concentration degree C estimated when the content A does not match the preference of the user B.

[0087] Subsequently, in step S103, the volume control unit 163 controls the volume of the content sound based on the concentration degree C, and the display control unit 164 controls the display mode of the content image based on the concentration degree C.

[0088] In step S103, the volume control unit 163 generates a sound signal indicating the content sound based on the sound information included in the content A. Subsequently, when the concentration degree C is less than the first level Lv1, the volume control unit 163 determines the first amplification factor as the amplification factor of the sound signal. When the concentration degree C is greater than or equal to the first level Lv1, the volume control unit 163 determines a second amplification factor lower than the first amplification factor as the amplification factor of the sound signal. The volume control unit 163 amplifies the sound signal with the amplification factor based on the concentration degree C to generate a content sound signal A1. The volume control unit 163 provides the content sound signal A1 to the AR glasses 2 via the communication device 14. The operation control unit 2e1 of the AR glasses 2 provides the content sound signal A1 provided from the volume control unit 163 of the portable device 1 to the sound emitting unit 2b. The sound emitting unit 2b emits the content sound indicated by the content sound signal A1.

[0089] Also, in step S103, the display control unit 164 generates a content image signal A2 indicating a content image in a display mode based on the concentration C by performing image processing based on the concentration C on the image information of content A. The display control unit 164 provides the content image signal A2 to the AR glass 2. The operation control unit 2e1 of the AR glass 2 provides the content image signal A2 provided from the display control unit 164 of the mobile device 1 to the display unit 2a. The display unit 2a displays the content image indicated by the content image signal A2.

[0090] A5: Summary of the First Embodiment According to the first embodiment, the volume control unit 163 controls the volume of the content sound based on the concentration C estimated by the estimation unit 162. Therefore, compared with a configuration that does not perform volume control based on the concentration C, the volume of the content sound can be controlled so that user B does not concentrate too much on content A. In addition, it is possible to prevent user B from concentrating too much on content A and neglecting the perception of the real world.

[0091] When the concentration C is equal to or higher than the first level Lv1, the volume control unit 163 sets the volume of the content sound to a volume smaller than the volume of the content sound when the concentration C is less than the first level Lv1. Therefore, compared with a configuration that does not control the volume, it is possible to make it difficult for user B to immerse in content A. In addition, the volume of the content sound can be controlled according to a simple comparison of the magnitude relationship between the first level Lv1 and the concentration C.

[0092] When the volume control unit 163 decreases the volume of the content sound in response to an increase in the concentration C, compared with a configuration that does not decrease the volume of the content sound in response to an increase in the concentration C, it is possible to make it difficult for user B to immerse in content A. In addition, the volume of the content sound can be finely controlled in response to an increase in the concentration C.

[0093] The presentation control unit 164 controls the presentation mode of the content image based on the concentration degree C. Therefore, based on the concentration degree C, both the presentation mode of the content image and the volume of the content sound are controlled. Thus, the change in the volume of the content sound can be matched to the change in the presentation mode of the content image.

[0094] The user information Ba includes preference information Bc indicating the user's preferences. Therefore, the estimation unit 162 can estimate the concentration degree C based on the content A and the preference information Bc. In this case, based on the preferences of user B, the concentration degree C can be estimated.

[0095] B: Modification example The modification modes in the above-described embodiment are shown below. Two or more modes arbitrarily selected from the following modification modes may be appropriately combined within a range where they do not conflict with each other.

[0096] B1: First modification example In the first embodiment, the user information Ba may include attribute information indicating the user's attributes. The user's attributes are, for example, the gender of user B. The user's attributes are not limited to the gender of user B, and may be, for example, the age of user B.

[0097] When the user information Ba includes attribute information, the estimation unit 162 may estimate the concentration degree C based on the content A and the attribute information in step S102 of FIG. 9. Hereinafter, the first modification example will be described using an example in which the content A has meta information.

[0098] For example, in a situation where the meta information of the content A indicates that the content A is a video introducing women's clothing, when the attribute information indicates a woman, the estimation unit 162 estimates a concentration degree Ha greater than the first level Lv1 as the concentration degree C.

[0099] In a situation where the meta information of the content A indicates that the content A is a video introducing women's clothing, when the attribute information indicates a man, the estimation unit 162 estimates a concentration degree La smaller than the first level Lv1 as the concentration degree C.

[0100] In a situation where the meta information of content A indicates that content A is a video introducing services for people aged 70 or older, when the attribute information indicates an age of 70 or older, the estimation unit 162 estimates a concentration degree Hb that is larger than the first level Lv1 as the concentration degree C. The concentration degree Hb may be the same value as the concentration degree Ha or a different value.

[0101] In a situation where the meta information of content A indicates that content A is a video introducing services for people aged 70 or older, when the attribute information indicates an age of less than 70 years old, the estimation unit 162 estimates a concentration degree Lb that is smaller than the first level Lv1 as the concentration degree C. The concentration degree Lb may be the same value as the concentration degree La or a different value.

[0102] According to the first modification example, the estimation unit 162 can estimate the concentration degree C using the attributes of user B.

[0103] B2: Second modification example In the first embodiment and the first modification example, the user information Ba may include operation information regarding the operation of user B. The operation of user B is, for example, the walking operation of user B. The operation information regarding the operation of user B is, for example, information indicating the walking speed of user B. The walking speed of a person such as user B tends to decrease as the concentration degree of the person increases and increase as the concentration degree of the person decreases.

[0104] In the second modification example, as shown in FIG. 10, the AR glasses 2 have an acceleration sensor 2g. The operation control unit 2e1 generates operation information indicating the walking speed of user B based on the output of the acceleration sensor 2g. The operation control unit 2e1 provides the operation information indicating the walking speed of user B to the portable device 1 via the communication device 2c. The processing device 16 of the portable device 1 stores the operation information provided from the AR glasses 2 in the storage device 15 as user information Ba.

[0105] When the AR glass 2 does not have the acceleration sensor 2g and the mobile device 1 has the acceleration sensor 18 as shown in FIG. 11, the processing device 16 generates operation information indicating the walking speed of the user B based on the output of the acceleration sensor 18. The processing device 16 stores the operation information indicating the walking speed of the user B in the storage device 15 as user information Ba.

[0106] The estimation unit 162 may estimate the concentration degree C based on one of the preference information Bc and the attribute information, the content A, and the operation information.

[0107] For example, the estimation unit 162 first estimates a provisional concentration degree based on one of the preference information Bc and the attribute information and the content A. The method for estimating the provisional concentration degree is the same as the method for estimating the concentration degree C based on one of the preference information Bc and the attribute information and the content A. Subsequently, the estimation unit 162 estimates the concentration degree C by adjusting the provisional concentration degree based on the operation information.

[0108] For example, when the walking speed of the user B indicated by the operation information is less than the first threshold value, the estimation unit 162 uses, as the concentration degree C, a value obtained by adding a first adjustment value, which is a positive value, to the provisional concentration degree. Therefore, when the walking speed of the user B is less than the first threshold value, the concentration degree C becomes larger than the provisional concentration degree.

[0109] When the walking speed of the user B indicated by the operation information is greater than or equal to the first threshold value, the estimation unit 162 uses, as the concentration degree C, a value obtained by subtracting a second adjustment value, which is a value greater than or equal to 0, from the provisional concentration degree. When the walking speed of the user B indicated by the operation information is greater than or equal to the first threshold value, the estimation unit 162 may estimate the provisional concentration degree as the concentration degree C. When the walking speed of the user B is greater than or equal to the first threshold value, the concentration degree C becomes less than or equal to the provisional concentration degree.

[0110] The method of generating the concentration degree C by adjusting the temporary concentration degree can be changed as appropriate. For example, first, the estimation unit 162 determines a third adjustment value that decreases in response to an increase in the walking speed of user B and increases in response to a decrease in the walking speed of user B, based on the walking speed of user B indicated by the motion information. Subsequently, the estimation unit 162 uses, as the concentration degree C, a value obtained by adding the third adjustment value to the temporary concentration degree. In this case, the concentration degree C decreases in response to an increase in the walking speed of user B, and the concentration degree C increases in response to a decrease in the walking speed of user B.

[0111] According to the second modification example, the estimation accuracy of the concentration degree C can be improved as compared with the configuration in which the concentration degree C is estimated by one of the preference information Bc and the attribute information and the content A without using the walking speed of user B.

[0112] B3: Third modification example In the second modification example, the motion of user B is not limited to the walking motion of user B. The motion of user B may be, for example, the motion of user B looking at the content image. When the motion of user B is the motion of user B looking at the content image, the motion information regarding the motion of user B is, for example, information indicating the time that user B is looking at the content image. Hereinafter, the time that user B is looking at the content image is also referred to as the "visual recognition time". The time (visual recognition time) that a human such as user B is looking at the content image has a tendency to increase in response to an increase in the concentration degree of the human and decrease in response to a decrease in the concentration degree of the human.

[0113] In the third modification example, as shown in FIG. 12, the AR glasses 2 have a camera 2h that images the eye B1 of user B. The camera 2h is located, for example, on the bridge 93 of the AR glasses 2. In the third modification example, the following operations are performed following step S103 in FIG. 9.

[0114] The motion control unit 2e1 measures the visual recognition time based on the captured image data generated by the camera 2h. The captured image data shows the eye B1 of user B.

[0115] For example, first, based on the captured image data, the operation control unit 2e1 detects a reference point (e.g., the inner corner of the eye) of user B's eye B1 and a specific point (such as the pupil) of user B's eye B1. Subsequently, based on the positional relationship between the reference point and the specific point, the operation control unit 2e1 estimates the direction of user B's line of sight. For example, the operation control unit 2e1 estimates the direction of user B's line of sight by using a table indicating the correspondence between the positional relationship between the reference point and the specific point and the direction of user B's line of sight. Subsequently, the operation control unit 2e1 estimates the position of the content image on the display unit 2a by analyzing the content image signal A2 provided from the portable device 1. Subsequently, the operation control unit 2e1 measures, as the viewing time, the time during which the content image is located in the direction of user B's line of sight.

[0116] Subsequently, the operation control unit 2e1 generates operation information indicating the viewing time. The operation control unit 2e1 provides the operation information indicating the viewing time to the portable device 1 via the communication device 2c. The processing device 16 of the portable device 1 stores the operation information provided from the operation control unit 2e1 of the AR glasses 2 in the storage device 15 as user information Ba.

[0117] When the viewing time indicated by the operation information is less than the second threshold value, the estimation unit 162 maintains the value of the concentration C. When the viewing time indicated by the operation information is greater than or equal to the second threshold value, the estimation unit 162 changes the value of the concentration C to a value obtained by adding a fourth adjustment value, which is a positive value, to the current value of the concentration C. For this reason, when the viewing time becomes greater than or equal to the second threshold value, the concentration C increases. When the concentration C is changed, the volume control unit 163 controls the volume of the content sound as described above based on the changed concentration C. When the concentration C is changed, the display control unit 164 controls the display mode of the content image as described above based on the changed concentration C.

[0118] The fourth adjustment value may be a fixed value or a value that increases as the viewing time increases and decreases as the viewing time decreases. When the fourth adjustment value is a value that increases as the viewing time increases and decreases as the viewing time decreases, for example, the estimation unit 162 determines the fourth adjustment value based on the viewing time.

[0119] According to the third modification example, the estimation accuracy of the concentration C can be improved as compared with the configuration in which the concentration C is estimated by one of the preference information Bc and the attribute information and the content A without using the visual recognition time.

[0120] B4: Fourth modification example In the second modification example, the operation of user B may be the blinking operation of user B. When the operation of user B is the blinking operation of user B, the operation information regarding the operation of user B is, for example, information indicating the number of blinks of user B per unit time. The unit time is, for example, 10 seconds. The unit time is not limited to 10 seconds, and may be a time shorter than 10 seconds (for example, 5 seconds) or a time longer than 10 seconds (for example, 1 minute). Hereinafter, the number of blinks of user B per unit time is also referred to as the "blink count". The blink count of a human such as user B tends to decrease as the concentration of the human increases and increase as the concentration of the human decreases.

[0121] In the fourth modification example, as shown in FIG. 12, the AR glasses 2 have a camera 2h that images the eye B1 of user B. In the fourth modification example, the following operations are executed following step S103 in FIG. 9.

[0122] The operation control unit 2e1 measures the blink count based on the captured image data generated by the camera 2h. The operation control unit 2e1 generates operation information indicating the blink count. The operation control unit 2e1 provides the operation information indicating the blink count to the portable device 1 via the communication device 2c. The processing device 16 of the portable device 1 stores the operation information provided from the operation control unit 2e1 of the AR glasses 2 in the storage device 15 as user information Ba.

[0123] When the number of blinks indicated by the motion information is less than the third threshold value, the estimation unit 162 changes the value of the concentration degree C to a value obtained by adding a fifth adjustment value, which is a positive value, to the current value of the concentration degree C. Therefore, when the number of blinks is less than the third threshold value, the concentration degree C increases. When the concentration degree C is changed, the volume control unit 163 controls the volume of the content sound as described above based on the changed concentration degree C. When the concentration degree C is changed, the display control unit 164 controls the display mode of the content image as described above based on the changed concentration degree C. When the number of blinks indicated by the motion information is greater than or equal to the third threshold value, the estimation unit 162 maintains the value of the concentration degree C.

[0124] The fifth adjustment value may be a fixed value or a value that decreases as the number of blinks increases and increases as the number of blinks decreases. When the fifth adjustment value is a value that decreases as the number of blinks increases and increases as the number of blinks decreases, for example, the estimation unit 162 determines the fifth adjustment value based on the number of blinks.

[0125] According to the fourth modification example, compared with the configuration in which the concentration degree C is estimated by using one of the preference information Bc and the attribute information and the content A without using the number of blinks, the estimation accuracy of the concentration degree C can be improved.

[0126] B5: Fifth Modification Example In the first embodiment and the first to fourth modified examples, the acquisition unit 161, the estimation unit 162, the volume control unit 163, the display control unit 164, and the user information Ba may be included in the AR glasses 2 instead of being included in the mobile device 1. Further, at least one of the acquisition unit 161, the estimation unit 162, the volume control unit 163, and the display control unit 164 may be included in the mobile device 1, and the rest may be included in the AR glasses 2. At least one of the acquisition unit 161, the estimation unit 162, the volume control unit 163, and the display control unit 164 means, for example, "acquisition unit 161", "estimation unit 162", "volume control unit 163", "display control unit 164", "acquisition unit 161 and estimation unit 162", "acquisition unit 161 and volume control unit 163", "acquisition unit 161 and display control unit 164", "estimation unit 162 and volume control unit 163", "estimation unit 162 and display control unit 164", "volume control unit 163 and display control unit 164", "acquisition unit 161, estimation unit 162 and volume control unit 163", "acquisition unit 161, estimation unit 162 and display control unit 164", "acquisition unit 161, volume control unit 163 and display control unit 164", "estimation unit 162, volume control unit 163 and display control unit 164", or "acquisition unit 161, estimation unit 162, volume control unit 163 and display control unit 164".

[0127] According to the fifth modified example, for example, without using the mobile device 1, the volume of the content sound can be controlled so that the user B does not concentrate too much on the content A.

[0128] B6: Sixth Modified Example In the first embodiment and the first to fifth modified examples, the display control unit 164 may not control the display mode of the content image based on the concentration degree C.

[0129] According to the sixth modified example, the load on the display control unit 164 can be reduced as compared with the configuration in which the display control unit 164 controls the display mode of the content image based on the concentration degree C.

[0130] C: Others (1) Each function exemplified in FIG. 2, FIG. 6, FIG. 8, FIG. 9, or FIG. 10 is realized by any combination of hardware and software. The method of realizing each function is not particularly limited. Each function may be realized using one physically or logically combined device, or may be realized using a device configured by directly or indirectly (e.g., using wired, wireless, etc.) connecting two or more physically or logically separated devices. Each function may be realized by combining software with the above one device or the above plurality of devices.

[0131] (2) In this specification, the term "device" may be read as other terms such as a circuit, a device, or a unit.

[0132] (3) In each of the first embodiment and the first to sixth modification examples, the storage device 15 and the storage device 2d may be constituted by at least one of an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray (registered trademark) disk), a smart card, a flash memory (e.g., a card, a stick, a key drive), a floppy (registered trademark) disk, a magnetic strip, etc. Further, the program may be transmitted from a network via a telecommunication line.

[0133] (4) Each of the first embodiment, the first to sixth modification examples may be applied to at least one of systems using LTE (Long Term Evolution), LTE-A (LTE-Advanced), SUPER 3G, IMT-Advanced, 4G (4th generation mobile communication system), 5G (5th generation mobile communication system), 6th generation mobile communication system (6G), xth generation mobile communication system (xG) (x is, for example, an integer or a decimal), FRA (Future Radio Access), NR (new Radio), New radio access (NX), Future generation radio access (FX), W-CDMA (registered trademark), GSM (registered trademark), CDMA2000, UMB (Ultra Mobile Broadband), IEEE 802.11 (Wi-Fi (registered trademark)), IEEE 802.16 (WiMAX (registered trademark)), IEEE 802.20, UWB (Ultra-WideBand), Bluetooth (registered trademark), and other appropriate systems, and next-generation systems extended, modified, created, or defined based on these. Also, a plurality of systems may be combined (for example, a combination of at least one of LTE and LTE-A and 5G, etc.) and applied.

[0134] (5) The processing procedures, sequences, flowcharts, etc. exemplified in each of the first embodiment, the first to sixth modification examples may be reordered as long as there is no contradiction. For example, regarding the methods described in this specification, the elements of various steps are presented in an exemplary order and are not limited to the presented specific order.

[0135] (6) In each of the first embodiment and the first to sixth modification examples, the input / output information etc. may be stored in a specific location (e.g., memory), or may be managed using a management table. The input / output information etc. can be overwritten, updated, or appended. The output information etc. may be deleted. The input information etc. may be transmitted to other devices.

[0136] (7) In each of the first embodiment and the first to sixth modification examples, the determination may be made based on a value represented by 1 bit (0 or 1), or may be made based on a boolean value (true or false), or may be made based on a numerical comparison (e.g., comparison with a predetermined value).

[0137] (8) The program exemplified in each of the first embodiment and the first to sixth modification examples should be broadly interpreted to mean instructions, instruction sets, codes, code segments, program codes, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, or functions, etc., regardless of whether it is called software, firmware, middleware, microcode, a hardware description language, or by another name. Also, software, or instructions, etc. may be transmitted and received via a transmission medium. For example, when software is transmitted from a website, server, or other remote source using at least one of wired technologies (such as coaxial cables, optical fiber cables, twisted pairs, and digital subscriber lines (DSL)) and wireless technologies (such as infrared rays, microwaves), at least one of these wired and wireless technologies is included within the definition of the transmission medium.

[0138] (9) The information etc. described in each of the first embodiment and the first to sixth modification examples may be represented using any of various different technologies. For example, data, information, etc. that may be referred to throughout the above description may be represented by voltage, current, electromagnetic wave, magnetic field, magnetic particles, optical field, photons, or any combination thereof. Note that the terms described in this specification and the terms necessary for understanding this specification may be replaced with terms having the same or similar meanings.

[0139] (10) In each of the first embodiment and the first to sixth modification examples, the terms "system" and "network" are used interchangeably.

[0140] (11) In each of the first embodiment and the first to sixth modification examples, the mobile device 1 may be a mobile station. A mobile station may be referred to by those skilled in the art using terms such as subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or some other suitable terms.

[0141] (12) The mobile station may also be referred to as a transmitting device, a receiving device, a communication device, etc. The mobile station may be a device mounted on a moving body, or the moving body itself. The moving body means a movable object. The moving speed of the moving body is arbitrary. The moving body can be stopped. The moving body includes, for example, vehicles, transport vehicles, automobiles, motorcycles, bicycles, connected cars, excavators, bulldozers, wheel loaders, dump trucks, forklifts, trains, buses, limousines, rickshaws, ships (ship and other watercraft), airplanes, rockets, artificial satellites, drones (registered trademark), multicopters, quadcopters, balloons, and things mounted on these, and is not limited thereto. The moving body may be a moving body that autonomously travels based on an operation command. The moving body may be a vehicle (e.g., a car, an airplane, etc.), a moving body that moves without a driver (e.g., a drone, a self-driving car, etc.), or a robot (humanoid or non-humanoid). The mobile station also includes devices that do not necessarily move during communication operations. For example, the mobile station may be an IoT (Internet of Things) device such as a sensor.

[0142] (13) In each of the first embodiment and the first to sixth modification examples, the term "determining" may encompass a wide variety of operations. "Determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up / searching / inquiring (e.g., looking up in a table, database, or another data structure), and considering something ascertained as "determined". Also, "determining" may include considering something received (e.g., receiving information), transmitted (e.g., transmitting information), input, output, accessed (e.g., accessing data in a memory) as "judged" or "determined". Further, "determining" may include considering something resolved, selected, chosen, established, compared, etc. as "determined". That is, "determining" may include considering that some operation has been "determined". Also, "determining" may be read as "assuming", "expecting", "considering", etc.

[0143] (14) In each of the first embodiment, the first to sixth modification examples, the term "connected" or any variation thereof means any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, "connected" may be read as "accessed". As used in this disclosure, two elements can be considered to be "connected" or "coupled" to each other using at least one of one or more wires, cables, and printed electrical connections, and, as some non-limiting and non-exhaustive examples, electromagnetic energy having wavelengths in the radio frequency region, microwave region, and optical (both visible and invisible) region.

[0144] (15) In each of the first embodiment, the first to sixth modification examples, the description "based on" does not mean "only based on" unless otherwise specified. In other words, the description "based on" means both "only based on" and "at least based on".

[0145] (16) Any reference to an element using designations such as "first" and "second" used in this specification does not generally limit the quantity or order of those elements. These designations can be used in this specification as a convenient way to distinguish between two or more elements. Thus, a reference to a first and a second element does not mean that only two elements can be employed or that the first element must precede the second element in any form.

[0146] (17) In each of the first embodiment, the first to sixth modification examples, when terms such as "include", "including" and their variants are used in this specification or the claims, these terms are intended to be inclusive, similar to the term "comprising". Further, the term "or" used in this specification or the claims is not intended to be an exclusive disjunction.

[0147] (18) Throughout this application, when articles are added by translation, such as a, an, and the in English, the present disclosure may include that the nouns following these articles are in the plural form.

[0148] (19) It is obvious to those skilled in the art that the present invention is not limited to the embodiments described in this specification. The present invention can be implemented in modified and changed forms without departing from the spirit and scope of the present invention determined based on the description in the claims. Therefore, the description in this specification is for illustrative purposes only and has no restrictive meaning for the present invention. Also, a plurality of aspects selected from the aspects exemplified in this specification may be combined.

[0149] D: Aspects grasped from the above-described embodiments or modification examples The following aspects are grasped from at least one of the above-described embodiments or modification examples.

[0150] D1: First aspect The output control device according to the first aspect includes an acquisition unit, an estimation unit, a display control unit, and a volume control unit. The acquisition unit acquires content indicating an image and sound. The estimation unit estimates the concentration of the user on the content based on the content and user information regarding the user wearing the transmissive display device. The display control unit causes the transmissive display device to display the image indicated by the content. The volume control unit controls the volume of the sound indicated by the content based on the concentration.

[0151] According to this aspect, based on the estimated concentration of the user, the volume of the sound indicated by the content is controlled. Therefore, compared with a configuration that does not perform volume control based on concentration, it is possible to control the volume so that the user does not concentrate too much on the content.

[0152] D2: Second aspect In the example of the first aspect (second aspect), when the concentration level is equal to or higher than the first level, the volume control unit sets the volume of the sound to be smaller than the volume of the sound when the concentration level is less than the first level. According to this aspect, the volume control unit reduces the volume when the estimated concentration level is equal to or higher than the first level. Therefore, compared with a configuration that does not reduce the volume, it is possible to make it difficult for the user to immerse in the content. In addition, the volume can be controlled based on a simple determination result of the magnitude relationship between the first level and the concentration.

[0153] D3: Third aspect In the example of the first aspect (third aspect), the volume control unit decreases the volume of the sound in response to an increase in the concentration. According to this aspect, the volume control unit decreases the volume in response to an increase in the estimated concentration. Therefore, compared with a configuration that does not decrease the volume in response to an increase in the estimated concentration, it is possible to make it difficult for the user to immerse in the content. In addition, the volume can be precisely controlled in response to an increase in the concentration.

[0154] D4: Fourth aspect In the example of any one of the first aspect to the third aspect (fourth aspect), the display control unit controls the display mode of the image indicated by the content based on the concentration. According to this aspect, based on the concentration, both the display mode of the image and the volume can be controlled. Therefore, the change in the volume can be matched with the change in the display mode.

[0155] D5: Fifth aspect In an example (the fifth aspect) of any one of the first to fourth aspects, the user information includes attribute information indicating the attributes of the user or preference information indicating the preferences of the user. According to this aspect, based on the attributes of the user or the preferences of the user, the degree of concentration of the user on the content can be estimated. Therefore, based on the attributes of the user or the preferences of the user, it is possible to control the volume so that the user does not concentrate too much on the content.

[0156] D6: The sixth aspect In an example (the sixth aspect) of any one of the first to fifth aspects, the user information includes motion information regarding the motion of the user. According to this aspect, based on the motion of the user, the degree of concentration of the user on the content can be estimated. Therefore, based on the motion of the user, it is possible to control the volume so that the user does not concentrate too much on the content.

Description of reference numerals

[0157] 1... Portable device, 2... AR glasses, 2a... Display unit, 2b... Sound output unit, 2c... Communication device, 2d... Storage device, 2e... Processing device, 2e1... Motion control unit, 2f... Bus, 2g... Acceleration sensor, 2h... Camera, 3... Content distribution device, 11... Input device, 12... Output device, 13... Communication device, 14... Communication device, 15... Storage device, 16... Processing device, 17... Bus, 18... Acceleration sensor, 161... Acquisition unit, 162... Estimation unit, 163... Volume control unit, 164... Display control unit.

Claims

1. An acquisition unit that acquires content indicating an image and sound; An estimation unit that estimates the degree of concentration of the user on the content based on the content and user information regarding a user wearing a transmissive display device; A display control unit that causes the transmissive display device to display the image indicated by the content; A volume control unit that controls the volume of the sound indicated by the content based on the degree of concentration of the user on the content estimated based on the content and the user information; Including; The user information includes preference information indicating the preferences of the user; The estimation unit sets the degree of concentration estimated when the content matches the preferences of the user indicated by the preference information to be greater than the degree of concentration estimated when the content does not match the preferences of the user indicated by the preference information; An output control device.

2. When the degree of concentration is equal to or higher than a first level, the volume control unit sets the volume of the sound to be lower than the volume of the sound when the degree of concentration is less than the first level; The output control device according to Claim 1.

3. The volume control unit decreases the volume of the sound in response to an increase in the degree of concentration; The output control device according to Claim 1.

4. The display control unit controls the display mode of the image indicated by the content based on the degree of concentration; The output control device according to any one of Claims 1 to 3.

5. The user information includes attribute information indicating the attributes of the user; The output control device according to any one of Claims 1 to 4.

6. The user information includes motion information regarding the motion of the user; The output control device according to any one of Claims 1 to 5.

Images