Control device, content viewing control system, mobile device, control method and program

Abstract

SOLUTION: There is provided a control device for a display device installed on the moving object. The display device includes: a first display mode in which contents are displayed without dividing a display region; and a second display mode in which the display region is divided into a first display region for a first seat installed in the moving object and a second display region for a second seat within the moving object for displaying. The control device includes an obtaining module which obtains information indicating a display mode of the display device; and a control module which performs zoning of a space within the moving object to output audio. Therein the control module differentiates the zoning depending on whether the display mode of the display device is the first display mode or the second display mode.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to a control device, a content viewing control system, a moving body, a control method, and a program.

Background Art

[0002] Patent Document 1 and Patent Document 2 describe dividing a screen to display a plurality of videos and controlling audio output according to the display position of the video. [Prior Art Documents] [Patent Documents] Patent Document 1 Japanese Unexamined Patent Application Publication No. 2013 - 187841 Patent Document 2 Japanese Unexamined Patent Application Publication No. 2005 - 110103

Summary of the Invention

Problems to be Solved by the Invention

[0003] By the way, for the passengers in the moving body, it is a problem to easily perform an operation for viewing content on the display device of the moving body. The present application aims to improve the operability related to audio in order to solve the above problems. And, by extension, it contributes to the development of a sustainable transportation system by further improving traffic safety.

Means for Solving the Problems

[0004] In a first aspect of the present invention, a control device is provided. The control device is a control device for a display device installed in a moving body. The display device has a first display mode for displaying content without dividing the display area, and a second display mode for dividing the display area and displaying it in a first display area for a first seat installed in the moving body and a second display area for a second seat in the moving body. The control device includes an acquisition unit that acquires information indicating the display mode of the display device. The control device includes a control unit that zones the space inside the moving body to output audio. The control unit varies the zoning depending on whether the display mode of the display device is the first display mode or the second display mode.

[0005] In the control device described above, the control unit may zone the space inside the mobile body into one zone when the display mode of the display device is the first display mode, and may zone the space inside the mobile body into a first zone corresponding to the location where the first seat is installed and a second zone corresponding to the location where the second seat is installed when the display mode of the display device is the second display mode.

[0006] In any of the above-described control devices, the control unit may, when the display mode of the display device is the second display mode, output audio so that the audio of the first content displayed in the first display area can be heard by occupants located in the first zone, and output audio so that the audio of the second content displayed in the second display area can be heard by occupants located in the second zone.

[0007] Any of the above control devices may include a gaze detection unit for detecting the gaze of the occupant of the moving body. When the display mode of the display device is the second display mode, the control unit may output the audio of the content displayed in the area of ​​the first display region and the area of ​​the second display region located within the first zone that is in the line of sight of the first occupant to the first zone. When the display mode of the display device is the second display mode, the control unit may output the audio of the content displayed in the area of ​​the first display region and the area of ​​the second display region located within the second zone that is in the line of sight of the second occupant to the second zone.

[0008] In any of the above-described control devices, if the display mode of the display device is the second display mode, the second display area is located in the line of sight of the first occupant, and the first seat is the seat in which the driver of the mobile vehicle sits, the control unit may determine, depending on the driving state of the mobile vehicle, whether or not to output the audio of the second content displayed in the second display area to the first zone.

[0009] In any of the above-described control devices, if the first seat is a seat in which the driver of the mobile vehicle sits, the display mode of the display device is the second display mode, and the second display area is located in the line of sight of the first occupant, then it may be determined to output the audio of the second content to the first zone, provided that the mobile vehicle is stationary or in autonomous driving mode.

[0010] In any of the above-described control devices, if the display mode of the display device is the second display mode, the second display area is located in the line of sight of the first occupant, and the first seat is the seat where the driver of the mobile vehicle sits, then when the first occupant is driving the mobile vehicle, it may be determined not to output the audio of the second content to the first zone.

[0011] Any of the above control devices may include a crew information detection unit that detects at least one of the state and attributes of the crew members of the mobile body. The control unit may further identify crew members for whom audio output is not required based on at least one of the state and attributes of the crew members detected by the crew information detection unit, and suppress the audio output to the zone where the identified crew members are located.

[0012] In any of the above-described control devices, the moving body may be a vehicle.

[0013] In a second embodiment of the present invention, a content viewing control system is provided. The content viewing control system comprises any of the above-described control devices and the display device.

[0014] In a third embodiment of the present invention, a mobile body is provided. The mobile body comprises any of the control devices described above.

[0015] A fourth aspect of the present invention provides a control method. The control method is performed by a control device for a display device installed on a mobile body. The display device has a first display mode in which content is displayed without dividing the display area, and a second display mode in which the display area is divided into a first display area for a first seat installed on the mobile body and a second display area for a second seat inside the mobile body for display. The control method includes a step of acquiring information indicating the display mode of the display device. The control method includes a step of zoning the space inside the mobile body and outputting audio. In the step of zoning the space inside the mobile body and outputting audio, the zoning is made different depending on whether the display mode of the display device is the first display mode or the second display mode.

[0016] In a fifth embodiment of the present invention, a program is provided, which causes a computer to function as one of the control devices described above.

[0017] The above summary of the invention does not enumerate all of its features. Furthermore, subcombinations of these features may also constitute an invention. [Brief explanation of the drawing]

[0018] [Figure 1] The configuration of the mobile body 10 in one embodiment is conceptually shown. [Figure 2] An example of the configuration of the content viewing control system 200 provided by the mobile device 10 is shown. [Figure 3] The display area of ​​the display device 22 is schematically shown. [Figure 4] A schematic representation of Zone 400 when the display mode of the display device 22 is the first display mode is shown. [Figure 5] The first zone 510 and the second zone 520 are schematically shown when the display mode of the display device 22 is switched to the second display mode. [Figure 6]As another aspect, FIG. 600 schematically shows zone 600 when the display modes of display device 22 and display device 24 are in the first display mode. [Figure 7] FIGS. 510, 520, 710, and 720 schematically show the first zone 510, the second zone 520, the first zone 710, and the second zone 720 when the display modes of display device 22 and display device 24 are switched to the second display mode. [Figure 8] FIG. shows a flowchart of a control method executed by control unit 220. [Figure 9] FIG. shows an example of computer 2000.

Embodiments for Carrying Out the Invention

[0019] Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the invention according to the claims. Also, not all combinations of features described in the embodiments are essential for the solution means of the invention.

[0020] FIG. 1 conceptually shows the configuration of the moving body 10 in one embodiment. In the present embodiment, the moving body 10 is a vehicle.

[0021] The moving body 10 includes a control device 20, an audio generation device 26, display devices 22 and 24, speakers 50a, 50b, 50c, 50d, 50e, and 50f, speakers 60a, 60b, 60c, and 60d, speakers 70a, 70b, 70c, 70d, 70e, and 70f, speakers 80a, 80b, 80c, and 80d, first seats 11, 12, 13 and second seats 14, and an imaging device 28.

[0022] The first seat 11 and the second seat 12 are rear seats of the mobile body 10. The first seat 11 is located on the left side in the forward direction of the mobile body 10. The second seat 12 is located on the right side in the forward direction of the mobile body 10. The first seat 13 and the second seat 14 are front seats of the mobile body 10. The first seat 13 is located on the left side in the forward direction of the mobile body 10. The second seat 14 is located on the right side in the forward direction of the mobile body 10.

[0023] In this embodiment, speakers 50a, 50b, 50c, 50d, 50e, and 50f may be collectively referred to as "speaker 50," and speakers 60a, 60b, 60c, and 60d may be collectively referred to as "speaker 60." Similarly, speakers 70a, 70b, 70c, 70d, 70e, and 70f may be collectively referred to as "speaker 70," and speakers 80a, 80b, 80c, and 80d may be collectively referred to as "speaker 80."

[0024] Speakers 50 and 70 constitute a multi-channel speaker system, such as a 5.1ch or 7.1ch system. Speaker 50 is primarily for providing audio content to occupants seated in the first seat 11 and the second seat 12. Speaker 70 is primarily for providing audio content to occupants seated in the first seat 13 and the second seat 14. Speakers 60a and 60b are installed on the headrest of the first seat 11. Speakers 60a and 60b are primarily for providing audio content to occupants seated in the first seat 11. Speakers 60c and 60d are installed on the headrest of the second seat 12. Speakers 60c and 60d are primarily for providing audio content to occupants seated in the second seat 12. Speakers 80a and 80b are installed on the headrest of the first seat 13. Speakers 80a and 80b are primarily for providing audio content to the occupant sitting in the first seat 13. Speakers 80c and 80d are installed on the headrest of the second seat 14. Speakers 80c and 80d are primarily for providing audio content to the occupant sitting in the second seat 14.

[0025] Here, we will describe the case where passengers sitting in the rear seats view content using the display device 22, speaker 50, and speaker 60. The display device 22 displays content. For example, the display device 22 displays video content or still image content. Speakers 50 and 60 output audio of audio content associated with the content displayed by the display device 22. Specifically, the audio generation device 26 generates audio signals to be output to speakers 50 and 60 based on audio data associated with the content displayed by the display device 22. Speakers 50 and 60 output audio based on the audio signals output from the audio generation device 26. Passengers sitting in the first seat 11 and passengers sitting in the second seat 12 can view the content displayed by the display device 22 and hear the audio output from speakers 50 and 60.

[0026] The control device 20 controls the content displayed by the display device 22. The display device 22 has multiple display modes, including a first display mode in which the entire display area is displayed as a single piece of content, and a second display mode in which the entire display area is divided into multiple display areas for display. For example, the display device 22 can display the first content in the first display area 23a on the left side in the direction of travel of the mobile body 10, and the second content in the second display area 23b on the second side in the direction of travel of the mobile body 10. When the display mode of the display device 22 is the first display mode, the control device 20 zones the rear seat space inside the mobile body 10 into a single zone and outputs audio content to it. Specifically, the control device 20 outputs audio content from the speaker 50.

[0027] On the other hand, when the display mode of the display device 22 is the second display mode, the rear seat space within the mobile body 10 is zoned into a first zone corresponding to the position of the first seat 11 and a second zone corresponding to the position of the second seat 12, and the first audio content associated with the first content is output to the first zone, and the second audio content associated with the second content is output to the second zone. Specifically, the control device 20 outputs the first audio content from speakers 60a and 60b, and the second audio content from speakers 60c and 60d. At this time, in addition to the sound waves of the first audio content, the control device 20 outputs sound waves from speakers 60a and 60b that are approximately in opposite phase to the sound waves of the second audio content output from speakers 60c and 60d. As a result, the occupant sitting in the first seat 11 can hear only the first audio content. Similarly, the control device 20 causes speakers 60c and 60d to output sound waves from the second audio content that are approximately in opposite phase to the sound waves of the first audio content output from speakers 60a and 60b, in addition to the sound waves of the second audio content. As a result, the occupant sitting in the second seat 12 can hear virtually only the second audio content.

[0028] When occupants sitting in the front seats view content using the display device 24, speaker 70, and speaker 80, they operate in the same way as when viewing content using the display device 22, speaker 50, and speaker 60, as described above. In other words, the display device 24, like the display device 22, has multiple display modes, including a first display mode and a second display mode. When the display mode of the display device 24 is the first display mode, the control device 20 sets the front seat space within the mobile body 10 as a single zone and outputs audio content according to the set zone. Specifically, the control device 20 outputs audio content from speaker 70.

[0029] On the other hand, when the display mode of the display device 24 is the second display mode, the display device 24 displays the first content in the first display area 25a and the second content in the second display area 25b. At this time, the control device 20 sets up a first zone corresponding to the position of the first seat 13 and a second zone corresponding to the position of the second seat 14 in the front seat space of the mobile body 10, and causes the first audio content associated with the first content to be output to the first zone and the second audio content associated with the second content to be output to the second zone. Specifically, the control device 20 causes the first audio content to be output from speakers 80a and 80b, and the second audio content to be output from speakers 80c and 60d. At this time, in addition to the sound waves of the first audio content, the control device 20 causes speakers 80a and 80b to output sound waves that are approximately in opposite phase to the sound waves of the second audio content output from speakers 80c and 80d. As a result, the occupant seated in the first seat 11 can effectively hear only the first audio content. Similarly, the control device 20 causes speakers 80c and 80d to output sound waves from speakers 80a and 80b that are approximately in opposite phase to the sound waves of the first audio content output from speakers 80a and 80b, in addition to the sound waves of the second audio content. As a result, the occupant seated in the second seat 12 can effectively hear only the second audio content.

[0030] According to the control device 20 described above, for example, if multiple passengers sitting in the left and right seats want to view the same content, the display mode of the display device can be set to the first display mode, the same zone can be set for at least the entire left and right seat area, and the same content can be provided to the entire left and right seat area. On the other hand, if the passengers in the left and right seats want to view different content, the display mode of the display device can be set to the second display mode, and two zones corresponding to the left and right seats can be set, so that the passenger in one seat is provided with one audio content and the passenger in the other seat is provided with the other audio content. This makes it easy for passengers of the mobile vehicle 10 to view different content.

[0031] Figure 2 shows an example of the configuration of the content viewing control system 200 provided by the mobile device 10. The content viewing control system 200 comprises a control device 20, display devices 22 and 24, an audio generation device 26, a speaker system 90, an imaging device 28, a storage device 280, and a communication device 290.

[0032] The speaker system 90 includes speakers 50, 60, 70, and 80. The storage device 280 stores content. The control device 20 causes the content stored in the storage device 280 to be output from the display devices 22, 24, and speaker system 90. The storage device 280 is configured to include a non-volatile storage medium. The non-volatile storage medium may be a semiconductor memory such as flash memory, or a disk-type storage device such as a DVD (digital multipurpose). The communication device 290 receives content wirelessly from outside the mobile device 10. The control device 20 causes the content received by the communication device 290 to be output from the display devices 22, 24, and speaker system 90.

[0033] The imaging device 28 is positioned to capture images of the occupants seated in the first seat 11, the second seat 12, the first seat 13, and the second seat 14. The imaging device 28 may include one or more imaging devices.

[0034] The control device 10 controls the audio for the display device 22 installed on the mobile body 10. The control device 20 comprises an acquisition unit 210, a control unit 220, a gaze detection unit 230, and a crew information detection unit 240.

[0035] The display device 22 has a first display mode in which content is displayed without dividing the display area, and a second display mode in which the display area is divided into a first display area 23a for the first seat 11 installed in the mobile body 10 and a second display area 23b for the second seat 12 inside the mobile body 10. The acquisition unit 210 acquires information indicating the display mode of the display device 22. The control unit 220 zones the space inside the mobile body 10 and outputs audio. The control unit 220 makes the zoning different depending on whether the display mode of the display device 22 is the first display mode or the second display mode.

[0036] The control unit 220 zones the space inside the mobile body 10 into one zone when the display mode of the display device 22 is in the first display mode, and zones the space inside the mobile body 10 into a first zone corresponding to the location where the first seat 11 is installed and a second zone corresponding to the location where the second seat 12 is installed when the display mode of the display device 22 is in the second display mode.

[0037] When the display mode of the display device 22 is in the second display mode, the control unit 220 outputs audio so that the audio of the first content displayed in the first display area 23a can be heard by occupants located in the first zone, and outputs audio so that the audio of the second content displayed in the second display area 23b can be heard by occupants located in the second zone.

[0038] The gaze detection unit 230 detects the gaze of the occupants of the mobile vehicle 10. For example, the gaze detection unit 230 detects the gaze of the occupants of the mobile vehicle 10 based on the image of the occupants' faces captured by the imaging device 280. When the display mode of the display device 22 is the second display mode, the control unit 220 may output the audio of the content displayed in the area located in the first zone of the first display area 23a and the second display area 23b that is in the line of sight of the first occupant. The control unit 220 may output the audio of the content displayed in the area located in the second zone of the second occupant that is in the line of sight of the second occupant.

[0039] The occupant information detection unit 240 detects at least one of the occupant status and attributes of the occupants of the mobile unit 10. The occupant status of the mobile unit 10 may include a status indicating whether or not the occupants are asleep. The occupant attributes of the mobile unit 10 may be, for example, the age group of the mobile unit 10. The control unit 220 further identifies occupants for whom audio output is unnecessary based on at least one of the occupant status and attributes detected by the occupant information detection unit, and suppresses the audio output to the zone where the identified occupants are located.

[0040] In the above description, we have focused on the case where the control device 20 controls the audio of content displayed on the rear-seat display device 22, but similar control can also be applied to the case where the control device controls the audio of content displayed on the front-seat display device 24. Here, we will describe a configuration specific to the front seats, specifically control based on the driver's line of sight. In this embodiment, the first seat 13 is assumed to be the seat where the driver of the mobile vehicle 10 sits. The first occupant is assumed to be the occupant seated in the first seat 13.

[0041] If the display mode of the display device 24 is the second display mode, the second display area 25b is located in the line of sight of the first occupant, and the first seat 13 is the seat where the driver of the mobile vehicle 10 sits, the control unit 220 determines whether or not to output the audio of the second content displayed in the second display area 25b to the first zone, depending on the driving state of the mobile vehicle 10.

[0042] If the first seat 13 is the seat where the driver of the mobile vehicle 10 sits, the display mode of the display device 24 is the second display mode, and the second display area 25b is located in the line of sight of the first occupant, then it is determined that the audio of the second content should be output to the first zone, provided that the mobile vehicle 10 is stationary or in automatic driving mode. On the other hand, if the first seat 11 is the seat where the driver of the mobile vehicle 10 sits, the display mode of the display device 24 is the second display mode, and the second display area 25b is located in the line of sight of the first occupant, then it is determined that the audio of the second content should not be output to the first zone when the occupant seated in the first seat 13 is driving the mobile vehicle 10.

[0043] Figure 3 schematically shows the display area of ​​the display device 22. The total display area 300 of the display device 22 includes a first display area 23a and a second display area 23b. The first display area 23a is the display area on the left side in the direction of travel of the moving body 10, and the second display area 23b is the display area on the right side in the direction of travel of the moving body 10. When the display mode of the display device 22 is the first display mode, the display device 22 displays one piece of content across the entire display area 300. When the display mode of the display device 22 is the second display mode, the display device 22 displays the first piece of content in the first display area 23a while displaying a second piece of content different from the first piece of content in the second display area 23b.

[0044] Similar to the display device 22, the overall display area of ​​the display device 24 includes a first display area 25a on the left side in the direction of travel and a second display area 25b on the right side in the direction of travel. The arrangement of the first display area 25a and the second display area 25b of the display device 24 is the same as the arrangement of the first display area 23a and the second display area 23b in the display device 22, so it is not shown in the illustration. When the display mode of the display device 24 is the first display mode, the display device 24 displays one piece of content across the entire display area of ​​the display device 24. When the display mode of the display device 24 is the second display mode, the display device 24 displays the first content in the first display area 25a on the left side in the direction of travel, while displaying a second piece of content different from the first content in the second display area 25b on the right side in the direction of travel.

[0045] Figure 4 schematically shows Zone 400 when the display mode of the display device 22 is set to the first display mode. Zone 400 is configured to include at least the rear seat area, which includes the first seat 11 and the second seat 12. When the display mode of the display device 22 is set to the first display mode, the control unit 220 causes the audio generator 26 to generate an audio signal to be output to the speaker 50 based on the audio content data of the content displayed in the display area of ​​the display device 22. As a result, the audio content of the content displayed in the display area of ​​the display device 22 is provided to Zone 400 through the speaker 50. Therefore, the occupant sitting in the first seat 11 and the occupant sitting in the second seat 12 can view the content displayed in the display area of ​​the display device 22.

[0046] Figure 5 schematically shows the first zone 510 and the second zone 520 when the display mode of the display device 22 is switched to the second display mode. The first zone 510 is set to include at least the vicinity of the headrest of the first seat 11, and the second zone 520 is set to include at least the vicinity of the headrest of the second seat 12.

[0047] When the display mode of the display device 22 is in the second display mode, the control unit 220 causes the audio generator 26 to generate audio signals to be output to speakers 60a and 60b based on the first audio content data of the first content displayed in the display area 23a of the display device 22, and also causes the audio generator 26 to generate audio signals to be output to speakers 60c and 60d based on the second audio content data of the second content displayed in the display area 23b of the display device 22. The control unit 220 controls the audio generator 26 so that, in addition to the sound waves based on the first audio content data, sound waves with the opposite phase to the sound waves based on the second audio content data output from speakers 60c and 60d are output from speakers 60a and 60b. As a result, in the first zone 510, only the audio content of the first content displayed in the display area 23a of the display device 22 is substantially provided through speakers 60a and 60b, and the audio content of the second content is substantially not provided. Conversely, in the second zone 520, only the audio content of the second content displayed in the display area 23b of the display device 22 is substantially provided through speakers 60c and 60d, while the audio content of the first content is substantially not provided. Thus, the occupant sitting in the first seat 11 and the occupant sitting in the second seat 12 can view different content from each other.

[0048] The gaze detection unit 230 detects the gaze of an occupant sitting in the first seat 11 from an image of the occupant's face captured by the imaging device 28. For example, the gaze detection unit 230 may identify the orientation of the occupant's face and the position of their pupils from the occupant's face image, and detect the occupant's gaze based on the identified orientation of the occupant's face and the position of their pupils. The control unit 220 determines whether the occupant sitting in the first seat 11 is looking towards the first display area 23a or the second display area 23b. If the control unit 220 determines that the occupant sitting in the first seat 11 is looking towards the second display area 23b, it may cause the audio generation device 26 to generate an audio signal to be output to speakers 60a and 60b based on the second audio content data of the second content displayed in the second display area 23b. As a result, the occupant sitting in the first seat 11 can listen to the audio of the second content when they look towards the second display area 23b. Similarly, if the control unit 220 determines that the gaze of the occupant sitting in the second seat 12 is directed toward the first display area 23a, it may cause the audio generation device 26 to generate audio signals to be output to speakers 60c and 60d based on the first audio content data of the first content displayed in the first display area 23a.

[0049] The occupant information detection unit 240 detects the status and attributes of the occupants of the mobile unit 10. For example, the occupant information detection unit 240 detects the status and attributes of the occupants of the mobile unit 10 based on the occupants' faces, postures, etc., captured by the imaging device 28. The occupant information detection unit 240 may detect, as an occupant status, whether the occupant is sleeping or not, whether the occupant is looking at the display device 22 or not, etc. The occupant information detection unit 240 may detect, as an occupant attribute, the age group to which the occupant belongs. The control unit 220 identifies occupants who do not require audio output based on at least one of the occupant status and attributes detected by the occupant information detection unit 240. For example, the control unit 220 identifies occupants who are sleeping or occupants who have not looked at the display device 22 for a predetermined period of time or longer as occupants who do not require audio output. The control unit 220 identifies occupants whose detected age group is below a predetermined first age group as occupants who do not require audio output. The first age group may be the age group corresponding to infants. The control unit 220 identifies occupants whose detected age group is the second age group or higher, which is predetermined, as occupants for whom audio output is not required. The second age group may be the age group corresponding to the elderly. The control unit 220 controls the audio generation device 26 so that audio is not output to the zone including the location of the identified occupants. For example, if the control unit 220 determines that audio output is not required for an occupant sitting in the second seat 12, it prohibits the audio generation device 26 from generating audio signals to be output to speakers 60c and 60d.

[0050] Figure 6 schematically shows Zone 600 as another embodiment, when the display mode of the display devices 22 and 24 is the first display mode. Zone 600 is set when the display devices 22 and 24 display the same content. Zone 600 is set substantially over the entire space within the mobile body 10. In this case, the control unit 220 may cause the audio generator 26 to generate audio signals output from speakers 50 and 70 based on the audio content data of the content displayed on the display devices 22 and 24. Alternatively, the control unit 220 may output the audio content of the content displayed on the display devices 22 and 24 without using speakers 70e and 70f. Specifically, the control unit 220 may cause the audio generator 26 to generate audio signals output from speakers 70a, 70b, 70c, 70d, 50e and 50f based on the audio content data of the content displayed on the display devices 22 and 24.

[0051] Figure 7 schematically shows the first zone 510, second zone 520, first zone 710, and second zone 720 when the display modes of the display devices 22 and 24 are switched to the second display mode. The first zone 510 and second zone 520 have been explained in relation to Figure 5, so their explanation is omitted here. Similarly, the operation of the control unit 220 when the display mode of the display device 22 is the second display mode has also been explained in relation to Figure 5, so their explanation is omitted here.

[0052] The first zone 710 is configured to include at least the vicinity of the headrest of the first seat 13, and the second zone 720 is configured to include at least the vicinity of the headrest of the second seat 14. When the display mode of the display device 24 is the second display mode, the control unit 220 causes the audio generator 26 to generate audio signals to be output to speakers 80a and 80b based on the first audio content data of the first content displayed in the display area 25a of the display device 24, and also causes the audio generator 26 to generate audio signals to be output to speakers 80c and 80d based on the second audio content data of the second content displayed in the display area 25b of the display device 24. The control unit 220 controls the audio generator 26 so that, in addition to the sound waves based on the first audio content data, sound waves with the opposite phase to the sound waves based on the second audio content data output from speakers 80c and 80d are output from speakers 80a and 80b. As a result, in the first zone 710, only the audio content of the first content displayed in the display area 25a of the display device 24 is substantially provided through speakers 80a and 80b, while the audio content of the second content is substantially not provided. Conversely, in the second zone 720, only the audio content of the second content displayed in the display area 25b of the display device 24 is substantially provided through speakers 80c and 80d, while the audio content of the first content is substantially not provided. Therefore, the occupant seated in the first seat 11 and the occupant seated in the second seat 12 can view different content from each other.

[0053] In this embodiment, the first seat 13 is the driver's seat of the mobile vehicle 10. The gaze detection unit 230 detects the gaze of the occupant sitting in the first seat 13 from the image of the occupant's face captured by the imaging device 28. The control unit 220 determines whether the gaze of the occupant sitting in the first seat 13 is directed toward the first display area 25a or the second display area 25b. If the control unit 220 determines that the gaze of the occupant sitting in the first seat 13 is directed toward the second display area 25b, and provided that the mobile vehicle 10 is stopped or driving in automatic driving mode, the control unit 220 may cause the audio generation device 26 to generate audio signals to be output to speakers 80a and 80b based on the second audio content data of the second content displayed in the second display area 25b. As a result, when the mobile vehicle 10 is stationary or driving in automatic driving mode, an occupant sitting in the first seat 11 can listen to the audio of the second content by looking at the second display area 25b. Similarly, if the control unit 220 determines that an occupant sitting in the second seat 14 is looking at the first display area 25a, it may cause the audio generator 26 to generate audio signals to be output to speakers 80c and 80d based on the first audio content data of the first content displayed in the first display area 25a.

[0054] Figure 8 shows a flowchart relating to the control method executed by the control unit 220. The control unit 220 may repeatedly execute the processes shown in this flowchart.

[0055] In S802, the acquisition unit 210 acquires the display modes of the display devices 22 and 24. The acquisition unit 210 may acquire the display modes of the display devices 22 and 24 based on the crew's instructions. The acquisition unit 210 may acquire the display modes of the display devices 22 and 24 by acquiring information indicating the current display mode from the display devices 22 and 24.

[0056] In S804, the occupant information detection unit 240 detects the status and attributes of the occupants in the mobile unit 10. For example, the occupant information detection unit 240 detects (i) whether the occupants are sleeping, (ii) whether the occupants are looking at the display device 22, and (iii) the age group to which the occupants belong. In S806, the control unit 220 sets the zones to output audio based on the display modes of the display devices 22 and 24 and the information detected by the occupant information detection unit 240. For example, the zones are set as described in relation to Figures 4, 5, 6, and 7.

[0057] In S808, the gaze detection unit 230 detects the gaze of the occupant inside the mobile body 10. In S810, the control unit 220 determines the audio to be output to one or more zones based on the gaze of the occupant inside the mobile body 10 and the display modes of the display devices 22 and 24. In S812, the control unit 220 causes the audio determined in S810 to be output to one or more zones. For example, the control unit 220 causes the audio generation device 26 to generate audio signals to be output to speakers 50, 60, 70 and 80 so that the audio determined in S810 is output to one or more zones.

[0058] In the embodiments described above, the mobile body 10 was assumed to be a vehicle. However, any mobile body other than a vehicle can be used as the mobile body 10.

[0059] According to the content viewing control system 200 of the embodiment described above, if multiple occupants sitting in the left and right seats want to view the same content, the display mode of the display device can be set to the first display mode, the same zone can be set for at least the entire left and right seat area, and the same content can be provided to the entire left and right seat area. On the other hand, if the occupants in the left and right seats want to view different content, the display mode of the display device can be set to the second display mode, and two zones corresponding to the left and right seats can be set, so that one audio content can be provided to the occupant sitting in one seat and the other audio content can be provided to the occupant sitting in the other seat. This makes it easy for occupants of the mobile vehicle 10 to view different content.

[0060] Figure 9 shows an example of a computer 2000 in which multiple embodiments of the present invention may be embodied in whole or in part. A program installed on the computer 2000 can cause the computer 2000 to function as a content viewing control system 200 or a part of the content viewing control system 200 according to the embodiment, or as a device such as a control device 20 or a part of said device, to perform operations associated with said system or a part of said system or a part of said device, and / or to perform a process or a stage of said process according to the embodiment. Such a program may be executed by the CPU 2012 to cause the computer 2000 to perform specific operations associated with some or all of the processing procedures and blocks of the block diagram described herein.

[0061] The computer 2000 according to this embodiment includes a CPU 2012 and RAM 2014, which are interconnected by a host controller 2010. The computer 2000 also includes a ROM 2026, flash memory 2024, communication interface 2022, and input / output chip 2040. The ROM 2026, flash memory 2024, communication interface 2022, and input / output chip 2040 are connected to the host controller 2010 via an input / output controller 2020.

[0062] CPU2012 operates according to the programs stored in ROM2026 and RAM2014, thereby controlling each unit.

[0063] The communication interface 2022 communicates with other electronic devices via a network. The flash memory 2024 stores programs and data used by the CPU 2012 in the computer 2000. The ROM 2026 stores boot programs and / or hardware-dependent programs of the computer 2000, such as those executed by the computer 2000 upon activation. The input / output chip 2040 may also connect various input / output units, such as keyboards, mice, and monitors, to the input / output controller 2020 via input / output ports such as serial ports, parallel ports, keyboard ports, mouse ports, monitor ports, USB ports, and HDMI® ports.

[0064] The program is provided via a computer-readable storage medium such as a CD-ROM, DVD-ROM, or memory card, or via a network. RAM2014, ROM2026, or flash memory 2024 are examples of computer-readable storage media. The program is installed in flash memory 2024, RAM2014, or ROM2026 and executed by CPU2012. The information processing described within these programs is read by computer 2000, resulting in coordination between the program and the various types of hardware resources described above. The apparatus or method may be configured to realize the operation or processing of information in accordance with the use of computer 2000.

[0065] For example, when communication is performed between computer 2000 and an external device, CPU 2012 may execute a communication program loaded into RAM 2014 and, based on the processing described in the communication program, instruct the communication interface 2022 to perform communication processing. Under the control of CPU 2012, the communication interface 2022 reads the transmission data stored in the transmit buffer processing area provided in the recording medium such as RAM 2014 and flash memory 2024, sends the read transmission data to the network, and writes the received data received from the network to the receive buffer processing area provided on the recording medium.

[0066] Furthermore, CPU2012 may read all or necessary parts of a file or database stored on a recording medium such as flash memory 2024 into RAM2014, and perform various types of processing on the data in RAM2014. CPU2012 then writes the processed data back to the recording medium.

[0067] Various types of information, such as various types of programs, data, tables, and databases, may be stored on the recording medium and subjected to information processing. The CPU2012 may perform various types of processing on the data read from RAM2014, including various types of operations, information processing, conditional judgments, conditional branching, unconditional branching, information retrieval / replacement, etc., as described herein and specified by the program's instruction sequence, and write the results back to RAM2014. The CPU2012 may also retrieve information in files, databases, etc., within the recording medium. For example, if multiple entries are stored in the recording medium, each having an attribute value of a first attribute associated with an attribute value of a second attribute, the CPU2012 may search among the multiple entries for an entry that matches the condition where the attribute value of the first attribute is specified, read the attribute value of the second attribute stored in that entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies the predetermined condition.

[0068] The programs or software modules described above may be stored on or near computer-readable storage media on computer 2000. Recording media such as hard disks or RAM provided within a server system connected to a dedicated communication network or the Internet can be used as computer-readable storage media. Programs stored on computer-readable storage media may be provided to computer 2000 via the network.

[0069] A program installed on computer 2000, which causes computer 2000 to function as control unit 20, may interact with CPU 2012, etc., to cause computer 2000 to function as various parts of control unit 20. The information processing described in these programs is read by computer 2000 and functions as various parts of control unit 20, which are concrete means of cooperation between software and the various hardware resources described above. Then, by realizing the calculation or processing of information according to the purpose of use of computer 2000 in this embodiment, a control unit 20 specific to the purpose of use is constructed.

[0070] Various embodiments have been described with reference to block diagrams, etc. In a block diagram, each block may represent (1) a stage in a process in which an operation is performed, or (2) a part of a device that has the role of performing an operation. A particular stage and part may be implemented by a dedicated circuit, a programmable circuit supplied with computer-readable instructions stored on a computer-readable storage medium, and / or a processor supplied with computer-readable instructions stored on a computer-readable storage medium. The dedicated circuit may include digital and / or analog hardware circuits, and may include integrated circuits (ICs) and / or discrete circuits. The programmable circuit may include reconfigurable hardware circuits, including logic AND, logic OR, logic XOR, logic NAND, logic NOR, and other logic operations, flip-flops, registers, memory elements such as field-programmable gate arrays (FPGAs), programmable logic arrays (PLAs), etc.

[0071] A computer-readable storage medium may include any tangible device capable of storing instructions that are executed by a suitable device, and as a result, a computer-readable storage medium having instructions stored therein constitutes at least part of a product containing instructions that can be executed to provide a means for performing an operation specified in a processing procedure or block diagram. Examples of computer-readable storage media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, etc. More specific examples of computer-readable storage media may include floppy disks, diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), electrically erasable programmable read-only memory (EEPROM), static random access memory (SRAM), compact disk read-only memory (CD-ROM), digital multipurpose disc (DVD), Blu-ray (RTM) disc, memory stick, integrated circuit card, etc.

[0072] Computer-readable instructions may include assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk®, Java®, C++, and traditional procedural programming languages ​​such as the C programming language or similar programming languages.

[0073] Computer-readable instructions may be provided locally or via a wide area network (WAN), such as a local area network (LAN) or the internet, to a processor or programmable circuit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, and may be executed to provide a means for performing the described processing procedure or the operation specified in the block diagram. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, and the like.

[0074] Although the present invention has been described above using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various modifications or improvements can be made to the above embodiments. It will be clear from the claims that such modified or improved forms may also be included in the technical scope of the present invention.

[0075] It should be noted that the execution order of operations, procedures, steps, and stages in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not explicitly stated as "before," "prior to," etc., and can be implemented in any order unless the output of a previous process is used in a later process. Even if the operation flow in the claims, specifications, and drawings is described using phrases such as "first," "next," etc. for convenience, it does not mean that it is essential to perform the operations in that order. [Explanation of Symbols]

[0076] 10 Mobile Units 11. First seat 12. Seat 2 13. Seat 1 14. Seat 2 20 Control device 22 Display device 23a 1st display area 23b 2nd display area 24 Display device 25a 1st display area 25b 2nd display area 26 Audio Generator 28 Imaging device 50 speakers 60 speakers 70 speakers 80 speakers 90 Speaker System 200 Content Viewing Control System 210 Acquisition Department 220 Control Unit 230 Eye-line detection unit 240 Crew Information Detection Unit 280 Storage device 290 Communication equipment 300 display area 400 zones 510 Zone 1 520 Zone 2 600 zones 710 Zone 1 720 Zone 2 2000 Computer 2010 Host Controller 2012 CPU 2014 RAM 2020 Input / Output Controller 2022 Communication Interface 2024 Flash Memory 2026 ROM 2040 Input / Output Chip

Claims

1. A control device for a display device installed on a mobile device, The display device has a first display mode in which content is displayed without dividing the display area, and a second display mode in which the display area is divided into a first display area for a first seat installed on the mobile body and a second display area for a second seat inside the mobile body. The control device is An acquisition unit that acquires information indicating the display mode of the aforementioned display device, A control unit that zones the space within the mobile body and outputs audio, Equipped with, The control unit causes the zoning to differ depending on whether the display mode of the display device is the first display mode or the second display mode. Control device.

2. The control unit, When the display mode of the display device is the first display mode, the space within the mobile body is zoned into one zone, When the display mode of the display device is the second display mode, the space within the mobile body is zoned into a first zone corresponding to the location where the first seat is installed and a second zone corresponding to the location where the second seat is installed. The control device according to claim 1.

3. The control unit, when the display mode of the display device is the second display mode, The audio of the first content displayed in the first display area is output so that it can be heard by occupants located within the first zone. The audio of the second content displayed in the second display area is output so that it can be heard by the occupants located within the second zone. The control device according to claim 2.

4. Eye-line detection unit for detecting the gaze of the occupant of the moving vehicle Furthermore, The control unit, when the display mode of the display device is the second display mode, The audio of the content displayed in the area of ​​the first display area and the second display area located within the first zone and in the line of sight of the first occupant is output to the first zone, and / or The audio of the content displayed in the area of ​​the second zone that is located within the line of sight of the second occupant, which is part of the first and second display areas, is output to the second zone. The control device according to claim 2.

5. If the display mode of the display device is the second display mode, the second display area is located in the line of sight of the first occupant, and the first seat is the seat where the driver of the mobile vehicle sits, the control unit determines whether or not to output the audio of the second content displayed in the second display area to the first zone, depending on the driving state of the mobile vehicle. The control device according to claim 4.

6. The first seat is the seat in which the driver of the mobile vehicle sits, the display mode of the display device is the second display mode, and the second display area is located in the line of sight of the first occupant. The system then determines to output the audio of the second content to the first zone, provided that the mobile vehicle is stationary or in autonomous driving mode. The control device according to claim 5.

7. When the first seat is the seat in which the driver of the mobile vehicle sits, the display mode of the display device is the second display mode, and the second display area is located in the line of sight of the first occupant, it is determined that the audio of the second content should not be output to the first zone when the first occupant is driving the mobile vehicle. The control device according to claim 5 or 6.

8. Crew information detection unit that detects at least one of the state and attributes of the occupants of the mobile vehicle Furthermore, The control unit further identifies occupants for whom audio output is unnecessary, based on at least one of the occupant's status and attributes detected by the occupant information detection unit, and suppresses the output of audio to the zone where the identified occupants are located. The control device according to any one of claims 1 to 6.

9. The aforementioned moving object is a vehicle. The control device according to any one of claims 1 to 6.

10. A control device according to any one of claims 1 to 6, The display device and A content viewing control system equipped with the following features.

11. A mobile body comprising the control device according to any one of claims 1 to 6.

12. A control method performed by a control device for a display device installed on a mobile device, The display device has a first display mode in which content is displayed without dividing the display area, and a second display mode in which the display area is divided into a first display area for a first seat installed on the mobile body and a second display area for a second seat inside the mobile body. The control method described above is A step of acquiring information indicating the display mode of the aforementioned display device, The steps include zoning the space within the mobile unit and outputting audio, and Equipped with, The step of zoning the space within the mobile body and outputting audio involves different zoning depending on whether the display mode of the display device is the first display mode or the second display mode. Control method.

13. A program for causing a computer to function as a control device according to any one of claims 1 to 6.

Images