Information processing device

Abstract

To provide an information processing device in which operation by a driver is properly limited in a vehicle, etc.SOLUTION: In a mobile device 10, an operation limitation section 52 is provided, and the operation limitation section 52 determines from a picked-up image of a back camera 42B a seat of the vehicle 12 where operation is performed. When it is determined that the picked-up image is picked up on a driver seat, the operation limitation section 52 limits operation of a processing execution section 50. Thus, in the mobile device 10, it is properly limited to perform operation on the driver seat in a vehicle, etc., and the operation can be prevented from being performed on the driver seat.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing device. [Background technology]

[0002] Patent Document 1 discloses a system for preventing terminal operation while driving. In this communication terminal control system serving as a terminal device prevention system, account information including identification information and a password is assigned in association with a user's communication terminal. A vehicle control unit receives information identifying the communication terminal of the vehicle's driver, and when the vehicle enters a non-autonomous driving state, a control signal is sent to the driver's communication terminal so that operation input is not reflected. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-044602 Summary of the Invention [Problem to be solved by the invention]

[0004] However, if the information for identifying the driver's communication terminal is not properly accepted, the driver's communication terminal cannot be accurately identified, and there is room for improvement in restricting the operation of communication terminals by occupants sitting in the driver's seat.

[0005] The present invention has been made in view of the above circumstances, and has an object to provide an information processing device in which operations by a driver of a vehicle or the like are appropriately restricted. [Means for solving the problem]

[0006] To achieve the above objectives According to the first aspect The information processing device Miscellaneous Accepts the operator's operations on the work part , among the executable applications Depending on the operation received The application is then executed based on the received operation. execution and the application execution result a processing execution unit that displays an image corresponding to the image on a display medium; box an imaging unit disposed on the body of the operator for capturing an image of the periphery of the housing; and when it is determined from an image captured by the imaging unit that the operator is seated in the driver's seat of the vehicle, the operation of the processing execution unit is restricted. Perform operation restriction processing an operation restriction unit; Among the plurality of types of operation restriction processes, the operation restriction process to be performed by the operation restriction unit is set in advance for each executable application, and the operation restriction unit performs the operation restriction process corresponding to the application being executed by the process execution unit.

[0007] According to the first aspect In the information processing device, Processing execution The department, Miscellaneous Accepts the operator's operations on the work part , among the executable applications Depending on the operation received The application is then executed based on the received operation. execution and the application execution result The image capturing unit is disposed in the housing together with the operation unit and the display medium, and captures an image of the periphery of the housing. The operation limiting unit limits the operation of the processing executing unit when it is determined from the image captured by the image capturing unit that the operator is seated in the driver's seat of the vehicle. Perform operation restriction processing .

[0008] This means: In the first mode, when the operator is seated in the driver's seat, By capturing an image seen from the driver's seat, it is possible to properly determine from the captured image whether the driver is seated in the driver's seat and operating the device, and therefore, the device is properly restricted from being operated by a driver seated in the driver's seat. In addition, in the first aspect, the operation restriction process to be performed by the operation restriction unit among the multiple types of operation restriction processes is set in advance for each executable application, and the operation restriction unit performs the operation restriction process corresponding to the application being executed by the process execution unit, thereby allowing the operation restriction unit to perform the operation restriction process suitable for the application being executed by the process execution unit.

[0009] Second Aspect teeth, First Aspect In the present invention, one surface of the housing serves as an operation surface of the operation unit and a display surface of the display medium, and the imaging unit captures an image in a direction opposite to the one surface side of the housing.

[0010] Third Aspect teeth, First Aspect or Second Aspect In The plurality of types of operation restriction processes include: The operation of the processing execution unit is restricted by restricting the display of the display medium. The first operation restriction process is included. .

[0011] Fourth Aspect teeth, First Aspect from Third Aspect Either crabLeave, The plurality of types of operation restriction processes include: The operation of the processing execution unit is restricted by stopping the operation of the operation unit. A second operation restriction process is included.

[0012] Fifth Aspect teeth, First Aspect from Fourth Aspect Either crab wherein the display medium transmits light from a backlight in accordance with a display image to display an image; The plurality of types of operation restriction processes include: The operation of the processing execution unit is restricted by turning off the backlight of the display medium. The third operation restriction process is included. .

[0013] Sixth Aspect teeth, First Aspect from Fifth Aspect Either crab a movement acquisition unit that acquires a movement amount per unit time, and the operation restriction unit is configured to restrict the operation of the processing execution unit when the movement amount per unit time acquired by the movement acquisition unit is less than a preset threshold value. The operation of It is in an unrestricted state.

[0014] Seventh aspect teeth, First Aspect from Sixth Aspect Either crab In this system, the vehicle is capable of autonomous driving, whereby driving is controlled without the involvement of driving operations by the occupants, and the operation restriction unit obtains from the vehicle whether or not the vehicle is in autonomous driving, and if the vehicle is in autonomous driving, puts the operation of the processing execution unit into an unrestricted state.

[0015] Eighth aspect teeth, First Aspect from Seventh aspect Either crab In the present invention, the operation restriction unit determines the seat in which the operator is seated by machine learning of the captured image. do.

[0016] The present invention can include the following aspects. A ninth aspect is an information processing method in which a processing execution unit receives an operation from an operator on an operation unit, executes an application corresponding to the received operation from among executable applications based on the received operation, displays an image corresponding to the execution result of the application on a display medium, an imaging unit arranged in a housing captures an image of the surroundings of the housing, and an operation restriction unit performs an operation restriction process that restricts the operation of the processing execution unit if it is determined from the image captured by the imaging unit that the operator is sitting in the driver's seat of a vehicle, wherein the operation restriction process performed by the operation restriction unit among multiple types of the operation restriction process is set in advance for each executable application, and the operation restriction unit performs the operation restriction process corresponding to the application being executed by the processing execution unit.

[0017] Also, 10 The embodiment ofA program for a computer in which a processing execution unit receives an operation from an operator on an operation unit, executes an application from among executable applications corresponding to the received operation based on the received operation, displays an image corresponding to the execution result of the application on a display medium, an imaging unit arranged in a housing captures an image of the area around the housing, and an operation restriction unit performs an operation restriction process that restricts the operation of the processing execution unit when it is determined from the image captured by the imaging unit that the operator is sitting in the driver's seat of a vehicle, wherein the operation restriction process to be performed by the operation restriction unit out of multiple types of the operation restriction process is pre-set for each executable application, and the operation restriction unit performs the operation restriction process corresponding to the application being executed by the processing execution unit. [Effects of the Invention]

[0018] As described above, according to the present invention, the information processing device has the effect of restricting the operation of the processing execution unit when it is determined that the device is being operated while seated in the driver's seat, thereby appropriately restricting operation while seated in the driver's seat. [Brief explanation of the drawings]

[0019] [Figure 1] 1 is a schematic configuration diagram showing a mobile device according to a first embodiment. [Figure 2] FIG. 1 is a schematic configuration diagram showing the appearance of a mobile device. [Figure 3] FIG. 1 is a plan view showing a schematic configuration of a vehicle. [Figure 4] 4 is a flowchart showing an outline of an operation restriction process according to the first embodiment. [Figure 5] 10A to 10E are schematic diagrams showing examples of captured images for each seat in a vehicle. [Figure 6] FIG. 10 is a schematic configuration diagram showing a mobile device according to a second embodiment. [Figure 7] 10 is a flowchart showing an outline of an operation restriction process according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0020] An embodiment of the present invention will now be described in detail with reference to the accompanying drawings. [First embodiment] Fig. 1 shows in a block diagram the schematic configuration of a mobile device 10 as an information processing device according to a first embodiment of the present invention, and Fig. 2 shows in a schematic diagram the exterior of the mobile device 10. Fig. 3 shows in a plan view an outline of a vehicle 12 according to the first embodiment. In the drawing, the front side of the vehicle 12 is indicated by an arrow FR, and the right side in the vehicle width direction is indicated by an arrow HR.

[0021] As shown in Fig. 3, the vehicle 12 is an automobile such as a passenger car, and is driven by the driving force of a driving source. The vehicle 12 may be a reciprocating engine vehicle equipped with an engine as a driving source, a hybrid vehicle (HEV) equipped with an engine and an electric motor (electric motor), a plug-in hybrid vehicle (PHEV), or an electric vehicle (BEV) equipped with an electric motor instead of an engine. The vehicle 12 may also be a fuel cell electric vehicle (FCEV).

[0022] The vehicle 12 has a plurality of seats arranged in a passenger compartment 12A for passengers to ride in. A driver's seat 14 and a passenger seat 16 are arranged in the passenger compartment 12A at the front of the vehicle, and the vehicle 12 has a so-called right-hand drive, with the driver's seat 14 on the right side in the vehicle width direction and the passenger seat 16 on the left side in the vehicle width direction.

[0023] The passenger compartment 12A has rear seats 18 arranged at the rear of the vehicle, with the rear seats 18 being a so-called three-seater, with a left rear seat 18L on the left side in the vehicle width direction, a right rear seat 18R on the right side in the vehicle width direction, and a middle rear seat 18C between the left rear seat 18L and the right rear seat 18R. Note that the vehicle 12 is not limited to a five-seater, and may be a four-seater with two people seated in the rear seats 18. Furthermore, the vehicle 12 only needs to be provided with a driver's seat 14 in which a driver who operates the vehicle is seated, and the vehicle 12 may be a two- or three-seater such as a freight vehicle, or may be a so-called wagon or bus with multiple rows of rear seats 18 arranged front to back and capable of seating six or more people.

[0024] The vehicle 12 has a dashboard 20 installed at the front of the passenger compartment 12A, and the surface of the dashboard 20 facing the passenger compartment 12A (the surface on the rear side of the vehicle) is an instrument panel (instrument panel) 20A. The vehicle 12 also has a steering wheel (steering wheel) 22 installed as a steering unit at the front of the driver's seat 14, and the vehicle 12 is driven by an occupant (driver) seated in the driver's seat 14, who operates the steering wheel 22. The vehicle 12 may also have an automatic driving function that controls driving without the intervention of a driving operation by the occupant seated in the driver's seat 14.

[0025] On the other hand, a portable information processing device such as a smartphone or a PDA (Personal Digital Assistant) is applied to the mobile device 10. The mobile device 10 may also be a notebook computer. This allows a passenger to carry the mobile device 10 while in the vehicle 12 and operate it within the passenger compartment 12A.

[0026] 2, the mobile device 10 has a motherboard 32 disposed in a rectangular, thin-box-shaped housing (casing) 30. A CPU 34A, a memory 34B, and a non-volatile storage (external storage) 34C are mounted on the motherboard 32 and are electrically connected to one another. The memory 34B uses ROM, RAM, and non-volatile storage (internal storage), and the storage 34C uses, for example, a microSD card.

[0027] In the mobile device 10, a microcomputer is configured on the motherboard 32 by a CPU 34A, a memory 34B, a storage 34C, etc., and the mobile device 10 is started by the CPU 34A reading and executing an OS stored in the memory 34B. Also, in the mobile device 10, the CPU 34A executes a program (application software) stored in the memory 34B or the storage 34C, thereby realizing various functions according to the application.

[0028] The mobile device 10 includes a communication module 36 as a wireless communication unit and a plurality of sensors 38 as detection units, and the communication module 36 and the plurality of sensors 38 are each mounted on the motherboard 32. The sensors 38 include a GPS sensor 38A for detecting position information and an acceleration sensor (G sensor) 38B for detecting acceleration. Note that various types of sensors such as a magnetic sensor or a gyroscope can be used as the sensor 38, and information detected by the sensors 38 is used by an app in the mobile device 10.

[0029] The mobile device 10 also includes a touch panel display 40 as a display medium and an operation unit, two camera modules 42 as an imaging unit, a microphone, and a speaker (the microphone and speaker are not shown). The display 40, the camera module 42, the microphone, and the speaker are each electrically connected to the motherboard 32.

[0030] The display 40 is attached to one surface (hereinafter referred to as the front surface) of the housing 30. The display 40 uses a liquid crystal panel, a backlight, and a touch sensor; when the backlight is turned on, light emitted from the backlight is transmitted through the liquid crystal panel to display an image. When the surface of the display 40 is touched, the touch sensor detects the contact position. This allows the operator (passenger) of the mobile device 10 to view the image displayed on the display 40 and perform operations (touch operations) in accordance with the displayed image by turning the front surface (display 40) toward themselves.

[0031] One side of the camera module 42 constitutes a front camera 42A with a lens arranged on the surface of the housing 30, and the other side constitutes a back camera 42B with a lens arranged on the back surface, which is the surface opposite to the surface of the housing 30. By facing the front surface toward themselves, the operator (passenger) of the mobile device 10 can capture an image of themselves with the front camera 42A and an image of the area in front of them with the back camera 42B.

[0032] The mobile device 10 connects to a telephone network (line network) or the like wirelessly by applying a required communication standard such as the 4G standard or the 5G standard to the communication module 36. When a communication program is activated in the mobile device 10, telephone functions such as voice calls using a microphone and speaker, and video calls using the display 40, the camera module 42 (front camera 42A), microphone, and speaker are realized.

[0033] In addition, in the mobile device 10, the communication module 36 is capable of connecting to various servers (not shown) via a network such as the Internet to acquire various data from the servers and perform various processes using the servers. Furthermore, the communication module 36 is capable of wireless communication (short-range communication) using standards such as the Wi-Fi standard, the Bluetooth (registered trademark) standard, and the BLE (Bluetooth Low Energy: registered trademark) standard.

[0034] 1, in mobile device 10, CPU 34A executes an application, thereby forming a process execution unit 50 corresponding to the application being executed. Process execution unit 50 controls the display on display 40 according to the process to be executed, and also receives various operations performed on display 40 and executes a process corresponding to the received operation.

[0035] Such a processing execution unit 50 (application) may be one that executes a telephone function. Furthermore, a general configuration in which an image is displayed on the display 40 and the displayed image changes in response to a touch operation on the display 40 can be applied to the processing execution unit 50. The processing execution unit 50 can be configured to use navigation software, a game application that progresses in response to the amount of movement or speed of the mobile device 10, or a configuration in which the content displayed on the display 40 or the content emitted from a speaker or the like changes in response to the amount of movement or speed of the mobile device 10.

[0036] When the navigation software is executed, the process execution unit 50 acquires information detected by the GPS sensor 38A and executes processing according to the acquired information. As a result, the process execution unit 50 acquires the location information of the vehicle from the information detected by the GPS sensor 38A and reflects the location information of the vehicle on the map image displayed on the display 40.

[0037] On the other hand, in the mobile device 10, an operation restriction program is stored in the memory 34B and the storage 34C, and the operation restriction program is executed by executing the app in the mobile device 10. As a result, an operation restriction unit 52 serving as a restriction device is formed in the mobile device 10.

[0038] When it is determined that an occupant seated in the driver's seat 14 of the vehicle 12 in motion is operating the mobile device 10, the operation restriction unit 52 restricts the processing in the processing execution unit 50 to restrict the mobile device 10 from being operated by the driver as an occupant seated in the driver's seat 14 of the vehicle 12.

[0039] The operation restriction unit 52 includes an image acquisition unit 54, an image determination unit 56, a speed acquisition unit 58, a speed determination unit 60, and a restriction unit 62. The image acquisition unit 54 captures images at predetermined time intervals using the camera module 42 (back camera 42B). The image determination unit 56 determines, from the captured images acquired by the image acquisition unit 54, whether the operator is sitting in the driver's seat 14, the passenger seat 16, or a rear seat 18 (left rear seat 18L, right rear seat 18R, or center rear seat 18C) when the operator is riding in the vehicle 12.

[0040] The speed acquisition unit 58 acquires the moving speed of the mobile device 10 from the detection information detected by the sensor 38. For example, when using the detection information (position information) from the GPS sensor 38A, the moving speed is acquired from a change in the position information and the time required for that change. When using the detection information (acceleration information) from the acceleration sensor 38B, the moving speed is acquired using the acceleration and the change in acceleration over time.

[0041] The speed determination unit 60 determines whether the mobile device 10 is in a state where it can be considered that it has stopped moving, based on the moving speed acquired by the speed acquisition unit 58. At this time, a set speed (for example, whether it is less than 10 km / h) is set in advance in the speed determination unit 60 as a threshold value for the moving speed, and the speed determination unit 60 determines whether the moving speed is equal to or less than the set speed. degreeIf it is determined that the operator is seated in the driver's seat 14 of the vehicle 12 (is the driver) and the moving speed is equal to or greater than the set speed, the limiting unit 62 determines that it is necessary to limit the execution of the process in the process executing unit 50, and limits the process in the process executing unit 50.

[0042] The restrictions imposed on the process execution unit 50 may include turning off the backlight of the display 40 or stopping the reading of the detection signal of the touch sensor, and may be set in advance for each application being executed by the process execution unit 50. For example, when navigation software is being executed, the acceptance of operations on the display 40 may be stopped (interrupted). Furthermore, when game software or the like is being executed, the backlight may be turned off.

[0043] Next, the operation of the first embodiment will be described. The mobile device 10 is portable, and can be moved to any location by the operator and operated at the location. As a result, the operator can carry the mobile device 10 while riding in the vehicle 12 and can operate it within the vehicle compartment 12A.

[0044] Here, the mobile device 10 is configured with an operation limiting unit 52. The operation limiting unit 52 does not limit the operation of the mobile device 10 if the operator is seated in a seat other than the driver's seat 14 (if the operator is a passenger other than the driver), but is capable of limiting the operation of the mobile device 10 when it is determined that the operator is seated in the driver's seat 14 (is the driver). Fig. 4 shows an outline of the operation limiting process executed by the operation limiting unit 52 in a flow chart. Figs. 5(A) to (E) show schematic diagrams of captured images in the vehicle interior 12A.

[0045] The flowchart of FIG. 4 is executed repeatedly in the background at predetermined time intervals while the processing execution unit 50 is operating, when a preset app is launched in the mobile device 10 and the processing execution unit 50 is operated.

[0046] In the operation restriction unit 52 of the mobile device 10, in the first step 100 of this flowchart, the image acquisition unit 54 captures an image of the interior of the vehicle compartment 12A using the backup camera 42B. In the next step 102, the image determination unit 56 of the operation restriction unit 52 determines from the captured image whether the image was captured in a seat other than the driver's seat 14 (the passenger seat 16 or the rear seat 18) (image determination).

[0047] In the passenger compartment 12A of the vehicle 12, the surrounding scenery differs from seat to seat, resulting in different images captured by the backup camera 42B. Fig. 5(C) shows an image captured at the passenger seat 16, Fig. 5(D) shows an image captured at the left rear seat 18L, and Fig. 5(E) shows an image captured at the right rear seat 18R. Each of Figs. 5(A) to (E) assumes that the image captured by the backup camera 42B is displayed on the display 40.

[0048] As shown in Figure 5(C), when the operator is sitting in the passenger seat 16, the captured image often includes the dashboard 20 at the front of the vehicle from the passenger seat 16, the front windshield glass, the underside of the dashboard, etc.

[0049] Furthermore, when the operator is seated in the rear seat 18, the captured image often includes the rear of the driver's seat 14 and passenger seat 16 (the rear side of the seat back), the dashboard 20 that can be seen through the driver's seat 14 and passenger seat 16, etc. For this reason, as shown in FIG. 5(D), when the operator is seated in the left rear seat 18L, the captured image often includes the back of the seat back of the driver's seat 14, the back of the seat back of the passenger seat 16, the center console, etc. Furthermore, when the operator is seated in the left rear seat 18L, the captured image includes the center console, dashboard 20, instrument panel 20A, steering wheel 22, driver, etc. between the driver's seat 14 and passenger seat 16.

[0050] 5(E), when the operator is seated in the right rear seat 18R, the captured image often includes the back of the seat back of the driver's seat 14, the back of the seat back of the passenger seat 16, the center console, etc. When the operator is seated in the right rear seat 18R, the captured image also includes the center console between the driver's seat 14 and the passenger seat 16, the dashboard 20 in front of the passenger seat 16, the instrument panel 20A in front of the passenger seat 16, etc.

[0051] On the other hand, when the operator is seated in the driver's seat 14, the captured image includes the scenery in front of the vehicle as seen from the driver's seat 14. Therefore, as shown in Figures 5(A) and 5(B), when the operator is seated in the driver's seat 14, the captured image includes the steering wheel 22, the dashboard 20, the instrument panel 20A including the meter panel, etc., the underside of the steering wheel 22 (the operator's feet), the front windshield glass, etc.

[0052] In this way, the images captured by the rear camera 42B of the mobile device 10 include different parts and the like in the vehicle interior 12A for each seat. Furthermore, the images captured for different seats have different positions and orientations of the parts and the like in the vehicle interior 12A. This makes it easy to determine from the image captured by the rear camera 42B of the mobile device 10 which seat in the vehicle interior 12A the image was captured from.

[0053] In addition, the seat in which the operator of the mobile device 10 is seated is determined from the captured image using AI (human engineering Artificial Intelligence (AI) technology can be used. For example, multiple captured images of the surrounding area for each seat are used, and machine learning is performed to create a trained model using features such as each part in the vehicle interior 12A shown in the captured images, the position of each part in the captured images, and the orientation of each part in the captured images. By using this trained model, it is possible to easily and accurately determine the seat in which the operator of the mobile device 10 is seated from the captured images.

[0054] Such a trained model is preferably provided on a server (external server) connected to the mobile device 10 via a network, which allows it to be used among multiple mobile devices 10 and reduces the processing load on each individual mobile device 10.

[0055] 4, if it is determined that the image was captured in a seat other than the driver's seat 14, the operation restriction unit 52 makes a positive determination in step 102 and proceeds to step 104. In step 104, the restriction unit 62 of the operation restriction unit 52 puts the process execution unit 50 in an unrestricted state. This allows the operation of the process execution unit 50 in the mobile device 10 to continue, allowing the operator to enjoy apps such as games.

[0056] Furthermore, if it is determined that the image was captured in the driver's seat 14, the operation restriction unit 52 makes a negative determination in step 102 and proceeds to step 106. In step 106, the operation restriction unit 52 causes the speed acquisition unit 58 to acquire detection information from the sensor 38, and acquires the moving speed of the mobile device 10 based on the acquired detection information.

[0057] In the next step 108, the operation limiting unit 52 determines whether the speed determining unit 60 determines whether the moving speed is equal to or greater than a set speed (moving speed determination). The moving speed of the mobile device 10 carried by the occupant is the same as the traveling speed of the vehicle 12. The set speed is a speed at which the vehicle 12 can be considered to be stopped, and the speed at which the vehicle 12 can be considered to be stopped includes the speed of the vehicle 12 just before it stops. but From this, the set speed can be a speed of 10 km / h or less, such as 10 km / h (10 km per hour).

[0058] If the movement speed is less than the set speed (0≦movement speed<set speed), the speed determination unit 60 in the operation restriction unit 52 makes a negative determination in step 108 and the process proceeds to step 104. As a result, the restriction unit 62 in the operation restriction unit 52 puts the process execution unit 50 in the non-restricted state.

[0059] On the other hand, if the movement speed is equal to or greater than the set speed (movement speed ≧ set speed), the speed determination unit 60 makes an affirmative determination in step 108 and proceeds to step 110. In step 110, the operation restriction unit 52 restricts the operation of the process execution unit 50.

[0060] The restriction on the process execution unit 50 may be set in advance for each app being executed by the process execution unit 50, and the restriction may be turning off the backlight of the display 40 or stopping the reading of the detection signal of the touch sensor of the display 40. The restriction may also be temporarily halting the operation of the process execution unit 50, or a combination of these. In this way, the operation of the process execution unit 50 of the mobile device 10 is restricted, and it is possible to restrict operation by a passenger sitting in the driver's seat 14.

[0061] In this way, in the mobile device 10, when it is determined from the image captured by the backup camera 42B that the operator is seated in the driver's seat 14 of the vehicle 12, the operation limiting unit 52 that can limit the operation of the processing execution unit 50 is provided, thereby appropriately restricting operations by the operator seated in the driver's seat 14. In addition, the operation limiting unit 52 can be easily configured by including the image acquisition unit 54 and the image determination unit 56.

[0062] Furthermore, the mobile device 10 is provided with a rear camera 42B that captures an image in the direction opposite to the surface of the housing 30 on which the display 40 is disposed, and this rear camera 42B can obtain an image that allows the operator to easily determine the seat in which he or she is seated. to By applying AI technology to seat determination using photographed images, more accurate determinations can be made.

[0063] Furthermore, the operation restriction unit 52 can include a speed acquisition unit 58 and a speed determination unit 60. The operation restriction unit 52 acquires the movement speed as the amount of movement per unit time using detection information from the GPS sensor 38A and the acceleration sensor 38B mounted on the mobile device 10, and if the acquired movement speed is less than a preset speed, it puts the process execution unit 50 into an unrestricted state. This makes it possible to prevent unnecessary restrictions on the operation of the mobile device 10.

[0064] In the first embodiment, an image captured by the rear camera 42B is used to determine the seat. However, an image captured by the front camera 42A may also be used to determine the seat. In addition, in the first embodiment, the operation restriction process is configured to run in the background, but this is not limiting. The captured image may be displayed in a corner of the display 40 to clearly indicate that the operation restriction process is being executed.

[0065] Second Embodiment Next, a second embodiment will be described. The basic configuration of the second embodiment is the same as that of the first embodiment, and functional parts in the second embodiment that are the same as those in the first embodiment are assigned the same reference numerals as those in the first embodiment, and descriptions thereof will be omitted.

[0066] FIG. 6 is a block diagram showing a schematic configuration of a mobile device 10A as an information processing device according to the second embodiment, and FIG. 7 is a flowchart showing an outline of operation restriction processing in the mobile device 10A.

[0067] 6, the mobile device 10A is provided with an operation limiting unit 70 instead of the operation limiting unit 52, and the operation limiting unit 70 differs from the operation limiting unit 52 in that it includes a driving determination unit 72 as an acquisition unit. In addition, in the second embodiment, a vehicle 74 is applied instead of the vehicle 12, and the vehicle 74 differs from the vehicle 12 in that it has an automatic driving function.

[0068] The vehicle 74 is provided with a control system 76 for performing various controls such as driving control. The control system 76 includes a plurality of ECUs (Electronics Control Units), a plurality of vehicle state detection units for detecting the driving state and driving environment of the vehicle 74, and an in-vehicle network for connecting the plurality of ECUs to each of the plurality of vehicle state detection units (all of which are not shown). The ECUs are also electrically connected to various actuators (not shown) that are to be controlled. In the control system 76, the plurality of ECUs work together in accordance with information detected by the vehicle state detection units to operate the various actuators and perform driving control of the vehicle 74.

[0069] The control system 76 is also configured with an ADAS (Advanced Driver Assistance Systems) 78 that functions as an automatic driving unit that controls the driving of the vehicle 74 without the intervention of the driver. This enables the control system 76 to control the driving of the vehicle 74 through level 3 or level 4 automatic driving.

[0070] The control system 76 includes a communication ECU 80 as a communication unit. The communication ECU 80 is capable of communicating with the communication module 36 of the mobile device 10A using the Wi-Fi standard, the Bluetooth (registered trademark) standard, the BLE (Bluetooth Low Energy: registered trademark) standard, or the like.

[0071] The operation restriction unit 70 of the mobile device 10A communicates with the communication ECU 80 of the vehicle 74 via the communication module 36, and the driving determination unit 72 thereby acquires the driving state of the vehicle 74. The driving state of the vehicle 74 acquired by the driving determination unit 72 includes whether the vehicle 74 is being manually driven by an occupant (driver) seated in the driver's seat 14, and if not being manually driven, whether the vehicle is being driven autonomously at level 3 or higher. In the following description, level 3 or higher is referred to as autonomous driving, and driving levels lower than level 3 are referred to as manual driving (non-autonomous driving).

[0072] The driving determination unit 72 determines, from the acquired driving state, whether the driving state of the vehicle 74 is in autonomous driving at level 3 or higher. When the driving determination unit 72 determines that the vehicle 74 is in autonomous driving at level 3 or higher, the restriction unit 62 sets the processing execution unit 50 to the non-restricted state.

[0073] Next, the operation restriction process in the second embodiment will be described with reference to FIG. 7 is executed in the mobile device 10A in place of the flowchart of FIG. 4, and in a first step 120, the driving determination unit 72 in the operation restriction unit 70 acquires the driving state of the vehicle 74 from the control system 76 of the vehicle 74. In the next step 122, the driving determination unit 72 in the operation restriction unit 70 determines whether the vehicle 74 is being manually driven (non-automatically driven) from the driving state acquired from the control system 76.

[0074] Here, if the vehicle 74 is being controlled by autonomous driving of level 3 or higher, the driving determination unit 72 in the operation restriction unit 70 makes a negative determination in step 122 and the process proceeds to step 104. As a result, in the mobile device 10A, even if the operator is seated in the driver's seat 14, the operation of the processing execution unit 50 continues, and the operator can enjoy apps such as games.

[0075] On the other hand, if the vehicle 74 is in a driving state below level 3, which includes manual driving (level 1), the driving determination unit 72 in the operation limiting unit 70 makes an affirmative determination in step 122. As a result, the operation limiting unit 70 performs the same process as the operation limiting unit 52 (the operation limiting process shown in FIG. 4). Therefore, the mobile device 10A can achieve the same effects as the mobile device 10.

[0076] In this way, with mobile device 10A, when the operator gets into vehicle 74 equipped with an autonomous driving function of level 3 or higher, the operator can enjoy apps such as games while vehicle 74 is traveling in autonomous driving. This prevents unnecessary restrictions on operations of mobile device 10A in vehicle 74. [Explanation of symbols]

[0077] 10, 10A Mobile devices (information processing devices) 12, 74 vehicles 14 Driver's seat 16 Passenger seat 18 rear seats 30 Case 38 Sensors 40 Display (operation unit, display media) 42 Camera module (imaging unit) 50 Processing execution unit 52, 70 Operation restriction section 54 Image acquisition unit 56 Image judgment unit 58 Speed ​​acquisition section 60 Speed ​​judgment section 62 Restricted Section 72 Driving judgment unit

Claims

1. A processing execution unit that receives an operation by an operator on an operation unit, executes an application corresponding to the received operation from among executable applications based on the received operation, and displays an image corresponding to the execution result of the application on a display medium; an imaging unit disposed in the housing and capturing an image of the surroundings of the housing; an operation restriction unit that performs an operation restriction process to restrict an operation of the processing execution unit when it is determined from the image captured by the imaging unit that an operator is seated in the driver's seat of the vehicle; Including, an operation restriction process to be performed by the operation restriction unit among the plurality of types of operation restriction processes is set in advance for each of the executable applications; The operation restriction unit performs an operation restriction process corresponding to an application executed by the process execution unit.

2. one surface of the housing serves as an operation surface of the operation unit and a display surface of the display medium, The information processing apparatus according to claim 1 , wherein the imaging unit captures an image in a direction opposite to the one surface side of the housing.

3. An information processing device as described in Claim 1, wherein the multiple types of operation restriction processes include a first operation restriction process that restricts the operation of the processing execution unit by restricting the display of the display medium.

4. An information processing device as described in Claim 1, wherein the multiple types of operation restriction processes include a second operation restriction process that restricts the operation of the processing execution unit by stopping the operation unit from accepting operations.

5. the display medium transmits light from a backlight in accordance with a display image to display an image; The information processing apparatus according to claim 1 , wherein the plurality of types of operation restriction processes include a third operation restriction process that restricts the operation of the process execution unit by turning off the backlight of the display medium.

6. a movement acquisition unit that acquires a movement amount per unit time; The information processing apparatus according to claim 1 , wherein the operation restriction unit puts the operation of the process execution unit into an unrestricted state when the amount of movement per unit time acquired by the movement acquisition unit is less than a preset threshold value.

7. The vehicle is capable of automatic driving, in which driving is controlled without the involvement of a driver's operation, The information processing device according to claim 1 , wherein the operation restriction unit acquires from the vehicle whether or not the vehicle is in autonomous driving, and when the vehicle is in autonomous driving, puts the operation of the process execution unit into an unrestricted state.

8. The information processing device according to claim 1 , wherein the operation restriction unit determines the seat in which the operator is seated by machine learning of the captured image.

Images