vehicle-mounted unit

Abstract

This technology provides the ability to operate overlay controls without having to constantly look at the monitor, even while the vehicle is in motion. [Solution] When the vehicle is not in motion, if the reception unit 114 receives a touch operation from the user on the video, the control unit 120 displays overlay control buttons on the video to receive instructions for the video. When the vehicle is in motion, the control unit 120 acquires information about the overlay control buttons that may be displayed when the vehicle is not in motion, and places operation buttons on the restricted screen based on the information about the overlay control buttons.

Description

Technical Field

[0001] The present disclosure relates to an in-vehicle device, and particularly to an in-vehicle device that displays images.

Background Art

[0002] Through an in-vehicle device mounted on a vehicle, more content including videos, images, voices, characters, etc. is provided to the passengers of the vehicle. In order not to interfere with the safety of the passengers of the vehicle, the in-vehicle device is equipped with a so-called driving restriction function that restricts the operation and display of the in-vehicle device during driving. For example, in the video part, a message indicating that the video cannot be played because the vehicle is in motion is displayed (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When displaying an image, an overlay control is used as an interface for receiving an instruction for the image such as fast-forwarding. In the overlay control, when the user touches the displayed image, buttons are displayed on the image, and when the user touches the buttons, an instruction for the image is received. However, since a touch operation cannot be performed in a state where a message indicating that the video cannot be played because the vehicle is in motion is displayed, the overlay control cannot be operated. On the other hand, even during driving, it is required that the user (driver) can operate the overlay control without looking at the monitor.

[0005] The present disclosure has been made in view of such a situation, and its object is to provide a technique for operating an overlay control without looking at a monitor even during the driving of a vehicle. [Means for solving the problem]

[0006] To solve the above problems, an in-vehicle device according to one embodiment of the present disclosure is an in-vehicle device that can be mounted in a vehicle and comprises: a playback unit that plays video; a control unit that, when the vehicle is not moving, displays the video played by the playback unit on a touch-enabled monitor, and when the vehicle is moving, displays a restriction screen on the touch-enabled monitor to restrict viewing of the video instead of the video played by the playback unit; and a reception unit that receives touch operations from the user on the video when the video is displayed on the touch-enabled monitor. When the reception unit receives a touch operation from the user on the video, the control unit displays overlay control buttons on the video to receive instructions on the video, and when the vehicle is moving, the control unit acquires information about the overlay control buttons that may be displayed when the vehicle is not moving, and places operation buttons on the restriction screen based on the information about the overlay control buttons.

[0007] Furthermore, any combination of the above components, as well as conversions of the expressions of this disclosure between methods, apparatus, systems, recording media, computer programs, etc., are also valid as aspects of this disclosure. [Effects of the Invention]

[0008] According to this disclosure, the overlay controls can be operated without having to look at the monitor while the vehicle is in motion. [Brief explanation of the drawing]

[0009] [Figure 1] This is a diagram showing the configuration of a vehicle according to the embodiment. [Figure 2] This diagram shows the configuration of the in-vehicle unit shown in Figure 1. [Figure 3] This diagram shows the driving operation restriction screens for comparison. [Figure 4] Figures 4(a)-(d) show an overview of the process by which the control unit in Figure 2 generates the restriction screen. [Figure 5] Figures 5(a) and 5(b) show the screens displayed on the touch-enabled monitor shown in Figure 1. [Figure 6] This figure shows the data structure of the correspondence table generated by the control unit in Figure 2. [Figure 7] Figures 7(a)-(b) show alternative screens displayed on the touch-enabled monitor shown in Figure 1. [Figure 8] Figures 8(a)-(e) show an overview of the operation process of the restriction screen by the control unit in Figure 2. [Figure 9] Figure 2 is a flowchart showing the procedure for generating the restriction screen using the in-vehicle device. [Figure 10] Figure 2 is a flowchart showing the operation procedure for the restriction screen on the in-vehicle device. [Modes for carrying out the invention]

[0010] Before describing this disclosure in detail, an overview will be provided. The embodiment of this disclosure relates to an in-vehicle device installed in a vehicle that displays video distributed by a video distribution service. To perform media control operations such as "previous," "next," and "pause," and screen control operations such as switching to full-screen display, the user touches the overlay control buttons (hereinafter referred to as "overlay control buttons") displayed on the monitor. However, while the vehicle is in motion, a driving operation restriction screen is displayed instead of the video to prevent the user (driver) from staring at the monitor. When the driving operation restriction screen is displayed, the overlay control buttons are not displayed, making it impossible to perform touch operations on the video. The purpose of this embodiment is to enable touch operations on the video even while the vehicle is in motion.

[0011] Figure 1 shows the configuration of vehicle 1000. Vehicle 1000 is equipped with an in-vehicle unit 100, a speed sensor 200, a touch-enabled monitor 210, and a rear-seat monitor 220. The in-vehicle unit 100 can communicate with a video distribution server 10, a content information server 20, and an analysis server 30 via wireless communication. The content information server 20 and the analysis server 30 will be explained in the modified examples section, so their explanations are omitted here.

[0012] The in-vehicle unit 100 is capable of wireless communication and communicates wirelessly with the video distribution server 10 to receive content (video) data from the video distribution server 10. The in-vehicle unit 100 plays the video by decoding the received content data. The in-vehicle unit 100 displays the video on the touch-enabled monitor 210 and the rear-seat monitor 220.

[0013] The touch-enabled monitor 210 is installed in the center cluster of the vehicle 1000. The installation location of the touch-enabled monitor 210 is not limited to the center cluster; it can be anywhere within reach of the user (driver). The touch-enabled monitor 210 includes a monitor for displaying the played video and a touch panel that allows the user to operate it by touch. The rear-seat monitor 220 is installed in the rear seats of the vehicle 1000. The rear-seat monitor 220 includes a monitor for displaying the played video but does not include a touch panel.

[0014] The speed sensor 200 measures the travel speed of the vehicle 1000. Known techniques are used to measure the travel speed in the speed sensor 200. The speed sensor 200 periodically outputs the measured travel speed information to the in-vehicle unit 100.

[0015] The in-vehicle device 100 receives information on the traveling speed from the speed sensor 200. When the traveling speed is greater than the threshold value, the in-vehicle device 100 determines that the vehicle is in motion. When the traveling speed is less than or equal to the threshold value, the in-vehicle device 100 determines that the vehicle is stopped (not in motion). When the in-vehicle device 100 determines that the vehicle is stopped, it causes the reproduced video to be displayed on the touch monitor 210 and the rear seat monitor 220. On the other hand, when the in-vehicle device 100 determines that the vehicle is in motion, it does not cause the reproduced video to be displayed on the touch monitor 210, but causes the reproduced video to be displayed on the rear seat monitor 220.

[0016] Figure 2 shows the configuration of the in-vehicle device 100. The in-vehicle device 100 includes a communication unit 110, a reproduction unit 112, a reception unit 114, an instruction unit 116, and a control unit 120. The control unit 120 includes an overlay control recognition unit 130, a restricted screen generation unit 140, a touch event generation unit 150, and a touch event execution unit 152. The overlay control recognition unit 130 includes a screen shot acquisition unit 132 and an object detection unit 134.

[0017] The communication unit 110 performs wireless communication using a mobile phone communication system such as 4G or 5G, or a wireless LAN (Local Area Network). The communication unit 110 can communicate with the video distribution server 10, the content information server 20, and the analysis server 30 by wireless communication. By performing wireless communication with the video distribution server 10, the communication unit 110 receives video data from the video distribution server 10. The communication unit 110 outputs the received video data to the reproduction unit 112.

[0018] In addition, the communication unit 110 performs wired communication using CAN (Controller Area Network). The communication unit 110 can communicate with the speed sensor 200 by wired communication. By performing wired communication with the speed sensor 200, the communication unit 110 receives information on the traveling speed from the speed sensor 200. The communication unit 110 outputs the received information on the traveling speed to the control unit 120.

[0019] The playback unit 112 receives video data from the communication unit 110. The playback unit 112 plays back the video by decoding the video data using known technology. The playback unit 112 outputs the played-back video to the control unit 120.

[0020] The control unit 120 receives video from the playback unit 112 and also receives information on the driving speed from the speed sensor 200. The control unit 120 stores a threshold value in advance and compares the threshold value with the driving speed. The threshold value is, for example, "0 km / h". The control unit 120 determines that the vehicle is driving if the driving speed is greater than the threshold value, and determines that the vehicle is stopped if the driving speed is less than or equal to the threshold value. The threshold value is not limited to "0 km / h" and can be set according to, for example, the definition of stopping in the Road Traffic Act. The following describes the processing in the in-vehicle unit 100 in the following order: (1) operation while stopped, (2) display of the restriction screen while driving, and (3) operation while driving.

[0021] (1) Operation while stopped When the vehicle 1000 is not in motion, the control unit 120 displays the video played back by the playback unit 112 on the touch-enabled monitor 210. At the same time, the control unit 120 also displays the background, windows, pop-ups, and other images drawn by the OS (Operating System) or application program on the touch-enabled monitor 210. In addition, the control unit 120 displays the video played back by the playback unit 112 on the rear-seat monitor 220.

[0022] As mentioned above, the touch-enabled monitor 210 has a touch panel, and when an image is displayed on the touch-enabled monitor 210, the reception unit 114 accepts touch operations from the user on the image. This touch operation is an operation to instruct the display of the overlay control and is also called the "first touch operation". When the reception unit 114 accepts the first touch operation, the instruction unit 116 causes the communication unit 110 to send an event corresponding to the first touch operation (hereinafter referred to as the "first touch event") to the video distribution server 10.

[0023] Subsequently, the communication unit 110 receives overlay control information corresponding to the first touch event from the video distribution server 10 and outputs the overlay control information to the control unit 120. When the control unit 120 receives the overlay control information from the communication unit 110, it overlays and displays overlay control buttons based on the overlay control information onto the video. Here, the overlay control buttons are displayed on the touch-enabled monitor 210 but not on the rear-seat monitor 220. In other words, when the reception unit 114 receives a touch operation from the user on the video, the control unit 120 overlays and displays overlay control buttons on the video to receive instructions on the video. The overlay control buttons are buttons that enable media control operations such as "previous," "next," and "pause," as well as screen control operations such as full-screen display switching.

[0024] When an overlay control button is displayed on the touch-enabled monitor 210, the reception unit 114 accepts a user touch operation on the overlay control button. This touch operation is an operation to instruct the system to perform a process corresponding to the overlay control button, and is also called a "second touch operation". When the reception unit 114 accepts a second touch operation, the instruction unit 116 causes the communication unit 110 to send an event corresponding to the second touch operation (hereinafter referred to as a "second touch event") to the video distribution server 10.

[0025] Subsequently, the communication unit 110 receives video data corresponding to the second touch event from the video distribution server 10 and outputs the video data to the playback unit 112. The playback unit 112 plays the video using the same processing as before and outputs the played video to the control unit 120. The control unit 120 displays the video received from the playback unit 112 on the touch-enabled monitor 210 and the rear-seat monitor 220. This is the video that has been modified by the second touch operation.

[0026] (2) Display of restriction screen while driving When vehicle 1000 is in motion, the conventional in-vehicle system displays a driving operation restriction screen on the touch-enabled monitor 210 instead of video. Figure 3 shows a driving operation restriction screen for comparison. As shown in the figure, only the message "You cannot view video while the vehicle is in motion." is displayed. Since the overlay control buttons are not displayed in this way, the user cannot perform media control operations or screen control operations. Return to Figure 2.

[0027] In this embodiment, the control unit 120 displays a restriction screen on the touch-enabled monitor 210 to restrict viewing of the video instead of the video played back by the playback unit 112 when the vehicle 1000 is in motion. To explain the process for displaying the restriction screen, Figures 4(a)-(d) are also used here. Figures 4(a)-(d) show an overview of the process by which the control unit 120 generates the restriction screen 304. In Figure 4(a), when the vehicle 1000 is not in motion, the control unit 120 displays the video 300 on the touch-enabled monitor 210. In this state, the vehicle 1000 starts moving.

[0028] When the vehicle 1000 is in motion, the control unit 120 emulates a first touch operation, causing the instruction unit 116 to send a first touch event to the video distribution server 10, and receives information on the overlay control corresponding to the first touch event. As shown in Figure 4(b), the control unit 120 displays the overlay control 302 superimposed on the video 300. Figures 5(a)-(b) show the screen displayed on the touch-enabled monitor 210. Figure 5(a) shows the overlay control 302 superimposed on the video 300. The overlay control 302 includes the first overlay control button 310a to the fifth overlay control button 310e, collectively referred to as the overlay control button 310. The number of overlay control buttons 310 included in the overlay control 302 is not limited to "5".

[0029] The first overlay control button 310a is for the "unmute" media control operation, and the second overlay control button 310b is for the "previous" media control operation. The third overlay control button 310c is for the "pause" media control operation, and the fourth overlay control button 310d is for the "next" media control operation. The fifth overlay control button 310e is for the screen control operation of switching to full-screen display. This touch operation on the overlay control buttons 310 corresponds to the second touch operation mentioned above. Figure 5(b) will be described later, and we will return to Figure 2.

[0030] When the control unit 120 displays the overlay control button 310, it lowers the brightness of the touch-enabled monitor 210. This is to discourage the user from staring at the screen of the touch-enabled monitor 210. The control unit 120 may also display another image (such as a black screen) on a layer higher than the video 300 and the overlay control 302. The screenshot acquisition unit 132 acquires a screenshot of the screen shown in Figure 5(a). The screenshot acquisition unit 132 outputs the screenshot to the object detection unit 134.

[0031] The object detection unit 134 detects the overlay control button 310 as an object on the screenshot screen, thereby acquiring information about the overlay control button 310 that may be displayed when the vehicle 1000 is not in motion. Object detection algorithms such as YOLO (You Only Look Once) and SSD (Single Shot MultiBox Detector) are used. The information about the overlay control button 310 includes the type and coordinates of the overlay control button 310. The object detection unit 134 outputs the information about the overlay control button 310 to the restriction screen generation unit 140.

[0032] The restriction screen generation unit 140 generates operation buttons corresponding to each overlay control button 310 based on information about the overlay control buttons 310. The restriction screen generation unit 140 also generates a restriction screen on which the operation buttons are placed. Figure 5(b) shows the restriction screen 304. The restriction screen 304 has operation buttons collectively referred to as operation buttons 320, from the first operation button 320a to the fifth operation button 320e, and a message 322. The first operation button 320a corresponds to the first overlay control button 310a, the second operation button 320b corresponds to the second overlay control button 310b, the third operation button 320c corresponds to the third overlay control button 310c, the fourth operation button 320d corresponds to the fourth overlay control button 310d, and the fifth operation button 320e corresponds to the fifth overlay control button 310e.

[0033] The control unit 120 generates and stores a table showing the correspondence between the overlay control buttons 310 detected by the object detection unit 134 and the operation buttons 320 generated by the restriction screen generation unit 140. Figure 6 shows the data structure of the correspondence table generated by the control unit 120. The overlay control buttons 310 and the operation buttons 320 are associated one-to-one, and their coordinates are also shown. Return to Figure 2.

[0034] As shown in Figure 4(c), the control unit 120 overlays and displays the restriction screen 304 on top of the video 300 and the overlay control 302. As a result, while the vehicle 1000 is in motion, the video 300 and the overlay control 302 are not displayed on the touch-enabled monitor 210, and the restriction screen 304 is displayed instead, thus suppressing the user's (driver's) attention to the screen. After a certain period of time has elapsed since displaying the overlay control 302, the control unit 120 turns off the overlay control 302 as shown in Figure 4(d). As a result, the restriction screen 304 is displayed overlaid on the video 300.

[0035] On the other hand, the control unit 120 displays the video received from the playback unit 112 on the rear seat monitor 220 while the vehicle 1000 is in motion. Therefore, the restriction screen 304 is not displayed on the rear seat monitor 220.

[0036] Up until now, the explanation has focused on the case where the video 300 is not displayed in full screen, as shown in Figure 5(a). The video 300 may be displayed in full screen. Figures 7(a)-(b) show another screen displayed on the touch-enabled monitor 210. Figure 7(a) shows the overlay control 302 that is superimposed on the video 300. Here, the video 300 is displayed in full screen. The overlay control 302 includes the first overlay control button 310a to the fourth overlay control button 310d. The first overlay control button 310a is a button for the "unmute" media control operation, and the second overlay control button 310b is a button for the "previous" media control operation. The third overlay control button 310c is a button for the "pause" media control operation, and the fourth overlay control button 310d is a button for the "next" media control operation.

[0037] Figure 7(b) shows the restriction screen 304 corresponding to the overlay control 302 in Figure 7(a). The restriction screen 304 has the first operation button 320a to the fourth operation button 320d and a message 322. The first operation button 320a corresponds to the first overlay control button 310a, the second operation button 320b corresponds to the second overlay control button 310b, the third operation button 320c corresponds to the third overlay control button 310c, and the fourth operation button 320d corresponds to the fourth overlay control button 310d.

[0038] (3) Operation while driving Figures 8(a)-8(e) show an overview of the operation process of the restriction screen 304 by the control unit 120. Figure 8(a) shows the screen displayed on the touch-enabled monitor 210 when the vehicle 1000 is in motion. The control unit 120 overlays the restriction screen 304 on the video 300, similar to Figure 4(d). The restriction screen 304 is the same as in Figure 5(b). In such a situation, the user (driver) touches one of the operation buttons 320 on the restriction screen 304 displayed on the touch-enabled monitor 210. The reception unit 114 receives the user's touch operation to the operation button 320 located on the restriction screen 304. At that time, the reception unit 114 identifies the coordinates of the position touched by the user on the restriction screen 304. The reception unit 114 outputs the coordinate information of the touched position to the control unit 120.

[0039] The control unit 120 receives coordinate information of the touch location from the reception unit 114. The control unit 120 refers to a correspondence table (Figure 6) to identify the operation button 320 corresponding to the received coordinate information and identifies the operation type for that operation button 320. The operation type indicates the operation instructed by the operation button 320, for example, the media control operation "unmute" for the first operation button 320a. The same applies to the other operation buttons 320. The control unit 120 outputs the identified operation type to the touch event generation unit 150.

[0040] When the touch event generation unit 150 receives an operation type from the control unit 120, it switches the restriction screen 304 to the video 300 by erasing the restriction screen 304 as shown in Figure 8(b). Receiving an operation type from the control unit 120 corresponds to receiving a touch operation from the user on the operation button 320.

[0041] When the video 300 is displayed on the touch-enabled monitor 210, the touch event generation unit 150 emulates a first touch operation, causing the instruction unit 116 to send a first touch event to the video distribution server 10, and receives information about the overlay control corresponding to the first touch event. The touch event generation unit 150 displays the overlay control 302 superimposed on the video 300, as shown in Figure 8(c). This is the same as in Figure 4(b), and the overlay control 302 is displayed as shown in Figure 5(a). In other words, the control unit 120 displays the overlay control button 310 superimposed on the video 300 by emulating a touch operation on the video 300. When the touch event generation unit 150 displays the overlay control button 310, it may lower the brightness of the touch-enabled monitor 210 compared to before.

[0042] Next, the screenshot acquisition unit 132 acquires a screenshot of the screen shown in Figure 5(a) and outputs the screenshot to the object detection unit 134. The object detection unit 134 acquires information about the overlay control button 310 by detecting it as an object on the screenshot. The object detection unit 134 outputs the information about the overlay control button 310 to the touch event generation unit 150.

[0043] The touch event generation unit 150 receives information about the overlay control button 310 from the object detection unit 134. The touch event generation unit 150 identifies the overlay control button 310 corresponding to the operation type received from the control unit 120. The touch event generation unit 150 also identifies the coordinates of the identified overlay control button 310 based on the information about the overlay control button 310. The touch event generation unit 150 outputs the coordinates of the overlay control button 310 to the touch event execution unit 152. On the other hand, if the identified overlay control button 310 is not included in the information about the overlay control button 310, the touch event generation unit 150 may display on the touch-enabled monitor 210 that the user cannot touch the operation button 320.

[0044] The touch event execution unit 152 receives the coordinates of the overlay control button 310 from the touch event generation unit 150. When the touch event execution unit 152 receives the coordinates of the overlay control button 310 from the touch event generation unit 150, it emulates a second touch operation, causing the communication unit 110 to send a second touch event to the video distribution server 10. In other words, when the overlay control button 310 displayed superimposed on the video 300 corresponds to an operation button 320 that has been touched by the user, the touch event execution unit 152 emulates a touch operation on the overlay control button 310 corresponding to the operation button 320.

[0045] Subsequently, the communication unit 110 receives video data corresponding to the second touch event from the video distribution server 10 and outputs the video data to the playback unit 112. The playback unit 112 plays the video using the same processing as before and outputs the played video 300 to the control unit 120, as shown in Figure 8(d). In other words, when the control unit 120 receives a touch operation from the user on the operation button 320, it emulates a touch operation on the overlay control button 310 corresponding to the operation button 320, and then executes processing corresponding to the touch operation on the overlay control button 310. Such an operation in the touch event execution unit 152 is equivalent to operating the overlay control on behalf of the user.

[0046] After displaying the video 300, the control unit 120, if the vehicle 1000 is in motion, executes the aforementioned process to overlay the restriction screen 304 on the video 300, as shown in Figure 8(e). If the brightness of the monitor 210 was set low, the brightness is then restored to its original level.

[0047] (modified version) The following examples of variations are explained in order from (4) to (7). (4) Up until now, the object detection unit 134 has obtained information about the overlay control button 310 by detecting the overlay control button 310 as an object on the screenshot screen.

[0048] In the modified configuration, the control unit 120 transmits information about the video 300 from the communication unit 110 to an external server, the content information server 20 (Figure 1), in order to obtain information about the overlay control button 310. The information about the video 300 includes, for example, information about the type of video distribution service, screen transition state, screen size, etc.

[0049] The content information server 20 calculates the type and coordinates of the overlay control button 310 based on the information about the video 300, and transmits the result to the in-vehicle unit 100 as information about the overlay control button 310. The type and coordinates of the overlay control button 310 may be stored as a table in the content information server 20.

[0050] The communication unit 110 of the in-vehicle unit 100 receives information regarding the overlay control button 310 from the content information server 20. The subsequent processing in the control unit 120 is the same as before.

[0051] (5) As described above, until now, the object detection unit 134 has obtained information about the overlay control button 310 by detecting the overlay control button 310 as an object on the screenshot screen.

[0052] In the modified version, the control unit 120 transmits the video 300 from the communication unit 110 to an external server, the analysis server 30, in order to obtain information about the overlay control button 310. The analysis server 30 detects the overlay control button 310 as an object by executing the processing of the screenshot acquisition unit 132 and the object detection unit 134 described above. The analysis server 30 transmits information about the detected overlay control button 310 to the in-vehicle device 100.

[0053] The communication unit 110 of the in-vehicle unit 100 receives information regarding the overlay control button 310 from the analysis server 30. The subsequent processing in the control unit 120 is the same as before.

[0054] (6) Previously, the operation button 320 was displayed on the screen of the touch-enabled monitor 210, and the user performed a touch operation on the operation button 320. Here, the touch-enabled monitor 210 may have multiple hard keys, and there may be a one-to-one correspondence between the hard keys and the operation button 320. In this case, the control unit 120 stores the correspondence between the hard keys and the operation button 320, as in Figure 6. When the control unit 120 receives a press operation from the user on a hard key, it identifies the user's touch operation on the operation button 320 based on the correspondence. The subsequent processing is the same as before.

[0055] (7) Previously, the operation button 320 was displayed on the screen of the touch-enabled monitor 210, and the user performed a touch operation on the operation button 320. Here, the touch-enabled monitor 210 may have a microphone and a voice recognition function, and the result of voice recognition of the voice to be input to the microphone may be associated one-to-one with the operation button 320. In this case, the control unit 120 stores the correspondence between the voice recognition result and the operation button 320, as in Figure 6. The microphone (not shown) of the in-vehicle unit 100 receives voice from the user, and the recognition unit (not shown) performs voice recognition processing on the voice. When the control unit 120 receives the voice recognition result, it identifies the user's touch operation on the operation button 320 based on the correspondence. The subsequent processing is the same as before.

[0056] This configuration can be implemented hardware-wise using the CPU (Central Processing Unit), memory, and other LSIs (Large Scale Integrations) of any computer, and software-wise using programs loaded into memory. However, this description focuses on the functional blocks realized through the coordination of these components. Therefore, it will be understood by those skilled in the art that these functional blocks can be implemented in various ways, either solely through hardware or through a combination of hardware and software.

[0057] The operation of the in-vehicle device 100 with the above configuration will now be explained. Figure 9 is a flowchart showing the procedure for generating the restriction screen 304 by the in-vehicle device 100. The control unit 120 generates a touch event (S10). The screenshot acquisition unit 132 acquires a screenshot (S12), and the object detection unit 134 performs object detection on the overlay control button 310. If the vehicle 1000 is in motion (Y in S14), the control unit 120 displays the restriction screen 304 (S16). If the vehicle 1000 is not in motion (N in S14), the restriction screen 304 is not displayed.

[0058] Figure 10 is a flowchart showing the operation procedure of the restriction screen 304 by the in-vehicle device 100. The control unit 120 displays the restriction screen 304 (S50). The reception unit 114 accepts a touch operation by the user to the operation button 320 (S52). The control unit 120 clears the restriction screen 304, lowers the brightness of the touch-enabled monitor 210, then sends a first touch event (S54), and then sends a second touch event (S56). If the vehicle 1000 is in motion (Y in S58), the control unit 120 displays the restriction screen 304 (S60). If the vehicle 1000 is not in motion (N in S58), the restriction screen 304 is not displayed. Finally, the brightness of the touch-enabled monitor 210 is restored to its original level (S62).

[0059] According to this embodiment, when the vehicle 1000 is in motion, an operation button 320 based on information about the overlay control button 310 is placed on the restriction screen 304, so that the overlay control can be operated without looking at the monitor even while the vehicle 1000 is in motion. In addition, since the overlay control button 310 is displayed and then detected as an object, information about the overlay control button 310 can be obtained. Furthermore, when the overlay control button 310 is displayed, the brightness of the touch-enabled monitor 210 is lowered compared to before, so that the user does not look at the touch-enabled monitor 210.

[0060] Furthermore, by transmitting information about the video 300 to the content information server 20 and receiving information about the overlay control button 310 from the content information server 20, it is possible to acquire information about the overlay control button 310 while suppressing an increase in the processing load on the in-vehicle unit 100. Additionally, by transmitting the video 300 to the analysis server 30 and receiving information about the overlay control button 310 from the analysis server 30, it is possible to acquire information about the overlay control button 310 while suppressing an increase in the processing load on the in-vehicle unit 100.

[0061] Furthermore, when a touch operation is received on the operation button 320, the system emulates a touch operation on the overlay control button 310 corresponding to the operation button 320, so that a touch operation on the overlay control button 310 can be performed while the restriction screen 304 is displayed. Also, when a touch operation is received on the operation button 320, the system switches the restriction screen 304 to the video 300, then emulates a touch operation on the video 300, and also emulates a touch operation on the overlay control button 310, so that a touch operation on the overlay control button 310 can be performed while the restriction screen 304 is displayed. In addition, the system stores the correspondence between the hard keys and the operation button 320, so that the hard keys can be used instead of the operation button 320. Also, the system stores the correspondence between the results of voice recognition and the operation button 320, so that voice recognition can be used instead of the operation button 320.

[0062] An overview of one aspect of this disclosure is as follows: (Item 1) An in-vehicle device that can be mounted on a vehicle, A playback unit that plays back video, A control unit that, when the vehicle is not in motion, displays the video played back by the playback unit on a touch-enabled monitor, and when the vehicle is in motion, displays a restriction screen on the touch-enabled monitor to restrict viewing of the video instead of the video played back by the playback unit, The system includes a reception unit that accepts user touch operations on the video when the video is displayed on the touch-enabled monitor, When the reception unit receives a touch operation from a user on the video, the control unit displays an overlay control button on the video for receiving instructions on the video. The control unit acquires information regarding the overlay control buttons that may be displayed when the vehicle is not in motion, when the vehicle is in motion, and places operation buttons on the restriction screen based on the information regarding the overlay control buttons.

[0063] According to this embodiment, when the vehicle is in motion, operation buttons based on information about the overlay control buttons are placed on the restricted screen, so that the overlay controls can be operated without having to look at the monitor even while the vehicle is in motion.

[0064] (Item 2) The in-vehicle device according to item 1, wherein the control unit displays the overlay control button in order to obtain information about the overlay control button, and then detects the overlay control button as an object. In this case, the overlay control buttons are displayed first, and then object detection is performed on the overlay control buttons, allowing information about the overlay control buttons to be obtained.

[0065] (Item 3) The in-vehicle device according to item 2, wherein the control unit lowers the brightness of the touch-enabled monitor when displaying the overlay control button. In this case, when displaying the overlay control buttons, the brightness of the touch-enabled monitor is reduced compared to before, thus discouraging users from focusing their attention on the touch-enabled monitor.

[0066] (Item 4) The in-vehicle device according to item 1, wherein the control unit transmits information about the video to an external server in order to obtain information about the overlay control button, and receives information about the overlay control button from the external server. In this case, video information is sent to an external server, and information regarding the overlay control buttons is received from the external server, allowing information about the overlay control buttons to be acquired while suppressing an increase in processing load on the in-vehicle device.

[0067] (Item 5) The in-vehicle device according to item 1, wherein the control unit transmits the video to an external server in order to obtain information about the overlay control button, and causes the external server to perform object detection on the overlay control button. In this case, the video is sent to an external server, and information about the overlay control buttons is received from the external server. This allows information about the overlay control buttons to be obtained while suppressing an increase in processing load on the in-vehicle device.

[0068] (Item 6) The reception unit receives touch operations from the user on the operation buttons located on the restriction screen. The in-vehicle device according to item 1, wherein when the control unit receives a touch operation from a user on the operation button, it emulates a touch operation on the overlay control button corresponding to the operation button, thereby executing processing in accordance with the touch operation on the overlay control button. In this case, when a touch operation is received on an operation button, it emulates a touch operation on the overlay control button corresponding to the operation button, so that a touch operation on the overlay control button can be performed even when the restriction screen is displayed.

[0069] (Item 7) When the control unit receives a touch operation from the user on the operation button, it switches the restriction screen to the video, and then displays the overlay control button superimposed on the video by emulating a touch operation on the video. The in-vehicle device according to item 6, wherein the control unit emulates a touch operation to the overlay control button corresponding to the operation button when the overlay control button displayed superimposed on the image corresponds to the operation button that has been touched by the user. In this case, when a touch operation is received on an operation button, the system switches the restriction screen to a video, then emulates touch operations on the video, and also emulates touch operations on the overlay control buttons corresponding to the operation buttons. Therefore, touch operations on the overlay control buttons can be performed while the restriction screen is displayed.

[0070] (Item 8) The aforementioned touch-enabled monitor is equipped with hard keys, The control unit stores the correspondence between the hard keys and the operation buttons. The in-vehicle device described in item 6, which, when the control unit receives a user press operation on the hard key, identifies a user touch operation on the operation button based on the correspondence relationship. In this case, the correspondence between the hardware keys and the control buttons is memorized, so the hardware keys can be used instead of the control buttons.

[0071] (Item 9) It further includes a recognition unit that performs speech recognition, The control unit stores the correspondence between the voice recognition result by the recognition unit and the operation button. The in-vehicle device according to item 6, wherein the control unit identifies a user's touch operation to the operation button based on the correspondence when the recognition unit performs voice recognition. In this case, the system stores the correspondence between the voice recognition results and the corresponding operation buttons, allowing voice recognition to be used instead of the operation buttons.

[0072] The present disclosure has been described above based on examples. These examples are illustrative, and it will be understood by those skilled in the art that various modifications are possible for each component or combination of processing steps, and that such modifications are also within the scope of the present disclosure. [Explanation of Symbols]

[0073] 10 Video distribution server, 20 Content information server, 30 Analysis server, 100 In-vehicle unit, 110 Communication unit, 112 Playback unit, 114 Reception unit, 116 Instruction unit, 120 Control unit, 130 Overlay control recognition unit, 132 Screenshot acquisition unit, 134 Object detection unit, 140 Restriction screen generation unit, 150 Touch event generation unit, 152 Touch event execution unit, 200 Speed ​​sensor, 210 Monitor with touch function, 220 Rear seat monitor, 300 Video, 302 Overlay control, 304 Restriction screen, 310 Overlay control button, 320 Operation button, 322 Message, 1000 Vehicle.

Claims

1. An in-vehicle device that can be mounted on a vehicle, A playback unit that plays back video, A control unit that, when the vehicle is not in motion, displays the video played back by the playback unit on a touch-enabled monitor, and when the vehicle is in motion, displays a restriction screen on the touch-enabled monitor to restrict viewing of the video instead of the video played back by the playback unit, The system includes a reception unit that accepts user touch operations on the video when the video is displayed on the touch-enabled monitor, When the reception unit receives a touch operation from a user on the video, the control unit displays an overlay control button on the video for receiving instructions on the video. The control unit acquires information regarding the overlay control buttons that may be displayed when the vehicle is not in motion, when the vehicle is in motion, and places operation buttons on the restriction screen based on the information regarding the overlay control buttons.

2. The in-vehicle device according to claim 1, wherein the control unit displays the overlay control button and then detects the overlay control button as an object in order to obtain information about the overlay control button.

3. The in-vehicle device according to claim 2, wherein the control unit lowers the brightness of the touch-enabled monitor when displaying the overlay control button.

4. The in-vehicle device according to claim 1, wherein the control unit transmits information about the video to an external server and receives information about the overlay control button from the external server in order to obtain information about the overlay control button.

5. The in-vehicle device according to claim 1, wherein the control unit transmits the video to an external server in order to obtain information about the overlay control button, and causes the external server to perform object detection on the overlay control button.

6. The reception unit receives touch operations from the user on the operation buttons located on the restriction screen. The in-vehicle device according to claim 1, wherein when the control unit receives a touch operation from a user on the operation button, it performs processing corresponding to the touch operation on the overlay control button by emulating a touch operation on the overlay control button corresponding to the operation button.

7. When the control unit receives a touch operation from the user on the operation button, it switches the restriction screen to the video, and then displays the overlay control button superimposed on the video by emulating a touch operation on the video. The in-vehicle device according to claim 6, wherein the control unit emulates a touch operation to the overlay control button corresponding to the operation button when the overlay control button displayed superimposed on the image corresponds to the operation button that has been touched by the user.

8. The aforementioned touch-enabled monitor is equipped with hard keys, The control unit stores the correspondence between the hard keys and the operation buttons. The in-vehicle device according to claim 6, wherein when the control unit receives a user press operation on the hard key, it identifies a user touch operation on the operation button based on the correspondence relationship.

9. It further includes a recognition unit that performs speech recognition, The control unit stores the correspondence between the voice recognition result by the recognition unit and the operation button. The in-vehicle device according to claim 6, wherein the control unit identifies a user's touch operation to the operation button based on the correspondence relationship when the recognition unit performs voice recognition.

Images