Information processing device
The information processing device in vehicle display systems addresses the hygiene safety concern by changing the position of operational icons based on touch position history and user authentication, thereby improving safety without compromising convenience.
Patent Information
- Application Number
- JP2021136274
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-08-24
- Publication Date
- 2025-04-11
- Estimated Expiration
- 2041-08-24
AI Technical Summary
Existing touch panel technologies in vehicle display devices do not adequately address the need for improved hygiene safety when multiple users interact with the same panel.
An information processing device equipped with an authentication result acquisition unit, a display unit, a touch input detection unit, a touch position history recording unit, a screen generation unit, and an icon position changing unit, which changes the position of operational icons based on touch position history and user authentication results.
This solution enhances hygiene safety by minimizing the risk of re-touching previously touched areas, while maintaining the convenience of icon operation.
Smart Images

Figure 0007660463000001 
Figure 0007660463000002 
Figure 0007660463000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a technique for an information processing device. [Background technology]
[0002] Patent Document 1 describes a technology relating to a display device for a vehicle, in which "when a user brings a finger close to the display panel, a finger position detection means 16 detects the approach of the user's finger and the approach position on the display panel, and a display control means in the control device 2 sets an icon approach display mode in which a second arrangement mode is displayed in which a plurality of operation icons are brought close to the approach position of the finger on the display panel 14." [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2013-96736 A Summary of the Invention [Problem to be solved by the invention]
[0004] The above technology allows users to selectively operate icons at positions closer to their seats. However, when touch panels are used by an unspecified number of users, there is a growing demand for improved hygiene and safety.
[0005] An object of the present invention is to provide a technique for improving safety from a hygienic standpoint while minimizing the decrease in convenience of icon operation. [Means for solving the problem]
[0006] The present invention includes a plurality of means for solving at least a part of the above problems, examples of which are as follows: In order to solve the above problems, an information processing device according to the present invention is characterized in that it comprises an authentication result acquisition unit that acquires an authentication result of a user who operates the information processing device, a display unit that displays one or more operation icons operated by the user, a touch input detection unit that detects a touch operation on the operation icon displayed on the display unit, a touch position history recording unit that detects a touch position in the touch operation and records it as a history in a predetermined storage unit, a screen generation unit that generates a screen to be displayed on the display unit, and an icon position change unit that changes the on-screen position of the operation icon included in the screen based on the history of the touch position when there is a change in the user identified by the authentication result acquired by the authentication result acquisition unit. Effect of the Invention
[0007] According to the present invention, it is possible to improve safety in terms of hygiene while minimizing the decrease in convenience of icon operation. Problems, configurations, and effects other than those described above will become apparent from the following description of the embodiments. [Brief description of the drawings]
[0008] [Figure 1] FIG. 1 illustrates an example of the configuration of an information processing device. [Diagram 2] FIG. 4 is a diagram illustrating an example of a data structure of user history information. [Diagram 3] 10 is a diagram illustrating an example of a data structure of touch position history information. [Figure 4] FIG. 4 is a diagram illustrating an example of a data structure of layout information. [Diagram 5] FIG. 4 is a diagram illustrating an example of a data structure of user registration information. [Figure 6] FIG. 2 is a diagram illustrating an example of a hardware configuration of an information processing device. [Figure 7] FIG. 11 is a diagram illustrating an example of a processing flow of a display change process. [Figure 8] FIG. 13 is a diagram illustrating an example of a process flow of a user change determination process. [Figure 9] FIG. 13 is a diagram showing an example of a layout change screen. [Figure 10] FIG. 13 is a diagram showing another example of a layout change screen. [Figure 11] 13A and 13B are diagrams illustrating an example of changing the position of an operation icon. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] An information processing device according to an embodiment to which the present invention is applied will be described below with reference to the drawings. Note that Figs. 1 to 11 do not show the entire configuration of the information processing device, and for ease of understanding, some of the configuration is omitted as appropriate. In the following embodiments, when necessary for convenience, they are divided into a plurality of sections or embodiments for explanation, but unless otherwise specified, they are not unrelated to each other, and one is related to the other as a partial or full modification, details, supplementary explanation, etc.
[0010] In addition, in the following embodiments, when referring to the number of elements (including the number, numerical values, amounts, ranges, etc.), unless specifically stated or clearly limited to a specific number in principle, the number is not limited to that specific number and may be more than or less than the specific number.
[0011] Furthermore, it goes without saying that in the following embodiments, the components (including element steps, etc.) are not necessarily essential unless specifically stated otherwise or unless they are clearly considered essential in principle.
[0012] Similarly, in the following embodiments, when referring to the shapes, positional relationships, etc. of components, etc., unless otherwise specified or considered to be obviously different in principle, it includes those that are substantially similar or similar to the shapes, etc. The same applies to numerical values and ranges.
[0013] In addition, in all the drawings for explaining the embodiments, the same components are generally given the same reference numerals, and the repeated explanations may be omitted. In addition, in the following embodiments, when it is said that "consists of A", "is made of A", "has A", or "includes A", it goes without saying that it does not exclude other elements, except in cases where it is specifically stated that only the element is included.
[0014] Similarly, in the following embodiments, when referring to the shape, positional relationship, etc. of components, etc., it is intended to include things that are substantially similar or approximate to those shapes, etc., unless otherwise specified or considered to be clearly different in principle.
[0015] In the following description, a "communication unit" may be one or more interface devices. The one or more interface devices may be one or more homogeneous communication interface devices (e.g., one or more NICs (Network Interface Cards)) or two or more heterogeneous communication interface devices (e.g., a NIC and an HBA (Host Bus Adapter)).
[0016] In the following description, a "memory" refers to one or more memory devices, which are an example of one or more storage devices, and may typically be a primary storage device. At least one memory device in the memory may be a volatile memory device or a non-volatile memory device.
[0017] In the following description, a "storage device" may be one or more persistent storage devices, which are an example of one or more storage devices. A persistent storage device may typically be a non-volatile storage device (e.g., an auxiliary storage device), and more specifically, may be, for example, a hard disk drive (HDD), a solid state drive (SSD), a non-volatile memory express (NVME) drive, or a storage class memory (SCM).
[0018] In the following description, the "storage unit" may be either a memory or a storage device, or both a memory and a storage device.
[0019] Also, in the following description, a "processing unit" or a "processor" may be one or more processor devices. The at least one processor device may typically be a microprocessor device such as a CPU (Central Processing Unit), but may also be other types of processor devices such as a GPU (Graphics Processing Unit). The at least one processor device may be a single-core or multi-core. The at least one processor device may be a processor core. The at least one processor device may also be a broader processor device such as a circuit that is a collection of gate arrays written in a hardware description language that performs part or all of the processing (e.g., an FPGA (Field-Programmable Gate Array), a CPLD (Complex Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit)).
[0020] In the following description, functions may be described using the expression "yyy unit", but the functions may be realized by one or more computer programs being executed by a processor, or by one or more hardware circuits (e.g., FPGA or ASIC), or by a combination thereof. When a function is realized by a program being executed by a processor, the function may be at least a part of the processor, since the specified processing is performed using a storage device and / or an interface device, etc., as appropriate. Processing described with a function as the subject may be processing performed by a processor or a device having the processor. A program may be installed from a program source. The program source may be, for example, a program distribution computer or a computer-readable recording medium (e.g., a non-transitory recording medium). The description of each function is an example, and multiple functions may be combined into one function, or one function may be divided into multiple functions.
[0021] In the following description, when a process is described using a "program" or a "processing unit" as the subject, the process described using a program or a processing unit as the subject may be a process performed by a processor or a device having the processor. Two or more programs may be realized as one program, and one program may be realized as two or more programs.
[0022] In the following description, information that provides an output for an input may be described using expressions such as "xxx table," but the information may be a table of any structure, or may be a neural network that generates an output for an input, or a learning model such as a genetic algorithm or random forest. Therefore, the "xxx table" may be called "xxx information" or "xxx data." In the following description, the structure of each table is an example, and one table may be divided into two or more tables, or all or part of two or more tables may be one table.
[0023] Furthermore, in the following description, an "information processing device" and an "authentication device" may be a system configured with one or more physical computers (e.g., an on-board device such as a car navigation device, a vehicle control device, a server device, a data center), or may be a system (e.g., a cloud computing system) realized on a group of physical computing resources (e.g., a cloud infrastructure). An information processing device "outputting" information on a display screen, etc. may mean displaying the information on a display screen, etc. on any display device (display, etc.) communicatively connected to the information processing device.
[0024] In this embodiment, an example of the information processing device 100 connected to the authentication device 500 and mounted on a vehicle is shown. However, the information processing device 100 is not limited to vehicles, and can be applied to any moving object such as a train, electric train, boat, ferry, etc. The information processing device 100 can also be applied in an environment shared by users in a call center, training facility, etc.
[0025] FIG. 1 is a diagram showing a configuration example of an information processing device. The information processing device 100 is a so-called vehicle-mounted device. Alternatively, the information processing device 100 may be a smartphone, a mobile phone, or a tablet terminal. An authentication device 500 is connected to the information processing device 100 via a wired or wireless communication path 80. As described later, the information processing device 100 and the authentication device 500 are connected by a cable conforming to a standard such as USB (Universal Serial Bus) in the case of a wired connection. The information processing device 100 and the authentication device 500 are connected by an antenna and a communication procedure conforming to a communication standard such as Bluetooth (registered trademark) or Wi-Fi (registered trademark) in the case of a wireless connection.
[0026] However, the present invention is not limited to this embodiment, and the information processing device 100 may be connected to more communication devices, and the communication devices may be devices that serve as access points for wireless LANs (Local Area Networks) or the like. Alternatively, the information processing device 100 may be integrated with the communication devices. Furthermore, the processing unit 120 of the information processing device 100 may be realized as a cloud service that a smartphone connects to when using the information processing device 100.
[0027] The communication path 80 is various networks including in-vehicle networks such as in-vehicle Ethernet, CAN FD (CAN with Flexible Data-Rate), CXPI (Clock Extension Peripheral Interface), wired connections such as USB, Bluetooth, Wi-Fi, the Internet, an intranet, etc. The communication path 80 is not limited to these, and may further be a wide area network (WAN), a mobile phone network, or a combination of these. In addition, the communication path 80 may be a virtual private network (VPN) on a wireless communication network such as a mobile phone network, or the like, or may be the same network.
[0028] The information processing device 100 includes a storage unit 110, a processing unit 120, an input unit 130, a display unit 140, and a communication unit 150. The storage unit 110 includes user history information 111, touch position history information 112, and layout information 113. The processing unit 120 includes an authentication result acquisition unit 121, a touch input detection unit 122, a touch position history recording unit 123, a screen generation unit 124, and an icon position change unit 125.
[0029] 2 is a diagram showing an example of a data structure of user history information. Authentication date and time 111a and user 111b are stored in association with each other in user history information 111. The most recent date and time when the user was identified by authentication is stored in authentication date and time 111a, and information for identifying the user, such as a user ID, is stored in user 111b.
[0030] 3 is a diagram showing an example of a data structure of touch position history information. In touch position history information 112, detection date and time 112a, detection position 112b, and user 112c are stored in association with each other. Detection date and time 112a stores the date and time at which a touch was detected in a touch operation on an operation icon shown on display unit 140. Detection position 112b stores the position on the screen at which a touch was detected in a touch operation on an operation icon shown on display unit 140. User 112c stores information identifying the user who touched the operation icon shown on display unit 140 in a touch operation.
[0031] 4 is a diagram showing an example of the data structure of the layout information. In the layout information 113, a layout identifier 113a, layout information 113b, and an adoption order 113c are stored in association with each other. The layout identifier 113a stores information for identifying a layout including arrangement information of display components of the screen shown on the display unit 140. The layout information 113b stores setting information of a specific layout including arrangement coordinates of the display components of the screen shown on the display unit 140. The adoption order 113c stores the adoption order of the layouts identified by the layout identifier 113a, that is, the order to be assigned for each change of the user.
[0032] The authentication result acquisition unit 121 requests the authentication result from the authentication device 500 and acquires the authentication result including user information. Specifically, when the information processing device 100 is started up, the authentication result acquisition unit 121 requests the authentication result from the authentication device 500 via the communication path 80 and acquires the authentication result including user information obtained as a result of authentication by the authentication device 500.
[0033] The touch input detection unit 122 detects an input mode such as a tap, a long tap, a double tap, or a flick for an operation item displayed on the display unit 140. Specifically, the touch input detection unit 122 identifies an operation element such as an operation icon or a button at the touch position, and constantly detects the input mode. For example, when a "set destination" icon is displayed at the tapped position, the touch input detection unit 122 detects a tap input on the "set destination" icon. More specifically, in this embodiment, the touch input detection unit 122 detects whether or not an operation icon has been touched, and, if there has been a touch, identifies the touch position on the screen and the touched operation icon.
[0034] The touch position history recording unit 123 constantly detects the touch position in the touch operation detected by the touch input detection unit 122, and records it as a history in the touch position history information 112 of the storage unit 110 as needed.
[0035] The screen generating unit 124 generates a screen to be displayed on the display unit 140. The screen includes one or more operation icons. The screen generating unit 124 may display the screen in any of the limited areas of the display unit 140.
[0036] When there is a change in the user identified by the user information included in the authentication result obtained by the authentication result acquisition unit 121, the icon position change unit 125 changes the on-screen position of the operation icon included in the screen based on the touch position history. For example, the icon position change unit 125 reads out the next layout from the layout information 113 and applies it to the screen, or the icon position change unit 125 changes the display position of a predetermined operation icon to a position moved in a direction closer to the driver's seat. At that time, the icon position change unit 125 changes the display position of the operation icon by avoiding positions with touch history based on the touch position history recorded as history in the touch position history information 112 of the storage unit 110. Note that since it is expected that the touch position history will become enormous due to long-term use, the icon position change unit 125 may change the display position of the operation icon by ignoring history that has passed a certain period of time that can be considered to be safe from a hygienic standpoint. Specifically, the icon position change unit 125 may exclude from the history any touch operation whose touch time does not fall within a predetermined period from the current time, and change the position of the operation icon on the screen.
[0037] Alternatively, the icon position change unit 125 may change the display position of the screen itself, avoiding the area already displayed. Also, the icon position change unit 125 may change the on-screen position of the operation icon included in the screen, based on the touch position history, even in a screen displayed by screen transition, that is, a screen (child screen or next screen) that is a screen proceeding from a certain screen. Also, the icon position change unit 125 may preferentially change the on-screen position of the operation icon that is frequently touched by the user to an area that is not touched in the touch position history. Alternatively, the icon position change unit 125 may randomly change the display position of the operation icon. For example, either or both of the movement direction and the movement amount of the operation icon may be random, or the display position of the operation icon may be randomly replaced.
[0038] The display unit 140 receives and draws graphic information (including screen information) from the screen generation unit 124. For example, the display unit 140 displays a pop-up message or the like by overlaying a layer on the graphic information, or divides the display area and displays graphic information in each area. In this embodiment, the display unit 140 may use existing technology. The input unit 130 detects the part touched by the operator as coordinate information on the screen, and passes it to the touch input detection unit 122. In this embodiment, the input unit 130 and the display unit 140 may use existing technology.
[0039] The communication unit 150 connects to other devices, particularly the authentication device 500, via a communication path 80. The type of communication may be either wired or wireless. In this embodiment, the communication path 80 may use existing technology.
[0040] The authentication device 500 is a so-called vehicle-mounted device. Alternatively, the authentication device 500 may be a smartphone, a mobile phone, or a tablet terminal. The information processing device 100 is connected to the authentication device 500 via a wired or wireless communication path 80. However, the authentication device 500 does not have to be an independent device, and may be the same device as the information processing device 100, or a peripheral device that operates according to instructions from the information processing device 100.
[0041] However, the present invention is not limited to this embodiment, and authentication device 500 may be connected to more communication devices, and the communication devices may be devices that serve as access points for wireless LANs or the like. Alternatively, authentication device 500 may be integrated with the communication devices. Furthermore, processing unit 520 of authentication device 500 may be realized as a cloud service that a smartphone connects to when it is used.
[0042] The authentication device 500 includes a storage unit 510, a processing unit 520, a user information detection unit 540, and a communication unit 550. The storage unit 510 includes user registration information 511. The processing unit 520 includes an authentication reception unit 521, an authentication processing unit 522, and a result transmission unit 523.
[0043] 5 is a diagram showing an example of a data structure of user registration information. In user registration information 511, user 511a and user specific information 511b are stored in association with each other. Information for identifying a user, such as a user ID, is stored in user 511a. Information for identifying a user, which is used for authentication, is stored in user specific information 511b. The information for identifying a user includes information specific to the user, which is preset as information used by authentication device 500 for authentication, such as a password or biometric information, such as fingerprint information or vein information.
[0044] The authentication reception unit 521 receives a request for user authentication. For example, when the authentication reception unit 521 receives a request for authentication from the information processing device 100, the authentication reception unit 521 causes the authentication processing unit 522 to start a user change determination process, which will be described later.
[0045] The authentication processing unit 522 controls the execution of a user change determination process, which will be described later.
[0046] The result sending unit 523 sends the authentication result including the user identifier and the different person flag in the user change determination process to the device that has requested the user authentication (the information processing device 100 in this embodiment).
[0047] The user information detection unit 540 accepts input of unique information from the user in the user change determination process. The communication unit 550 connects to other devices, particularly the information processing device 100, by communication via the communication path 80. The type of communication may be either wired or wireless. For the communication path 80, an existing technology may be used in this embodiment.
[0048] 6 is a diagram showing an example of a hardware configuration of an information processing device. The information processing device 100 can be realized by a general information processing device including a processor 101, a memory 102, a storage device 103, a communication device 104, a touch detection display 105, and a bus connecting these to each other. The communication device 104 serves as an interface for connecting an external device to the information processing device 100. An authentication device 500 and a wide area communication device 200 are connected to the communication device 104.
[0049] The processor 101 is, for example, a central processing unit (CPU) or a graphics processing unit (GPU). The memory 102 is, for example, a random access memory (RAM), etc. The storage device 103 is, for example, a hard disk drive (HDD) or a solid state drive (SSD). The communication device 104 is a device that connects to external devices such as the authentication device 500 and the wide area communication device 200. The touch detection display 105 receives graphic information from the screen generation unit 124 and draws it. The touch detection display 105 detects a part touched by an operator as coordinate information on the screen and transfers it to the touch input detection unit 122. For the touch detection display 105 in this embodiment, an existing technology may be used.
[0050] The wide area communication device 200 is a so-called mobile router or a mobile phone (smartphone), and establishes a path for voice calls with a counterpart communication device via a network and manages the connection. Note that the connection between the wide area communication device 200 and the information processing device 100 is managed by the communication device 104.
[0051] The above-mentioned functional units of the processing unit 120, i.e., the authentication result acquisition unit 121, the touch input detection unit 122, the touch position history recording unit 123, the screen generation unit 124, and the icon position change unit 125, are constructed by the processor 101 reading and executing a predetermined program. Therefore, the memory 102 or the storage device 103 stores a program for realizing the processing of each functional unit. Then, the program is loaded into the memory 102 at the time of execution, and causes the processor 101 to perform the processing.
[0052] The user history information 111, the touch position history information 112, and the layout information 113 are realized by the memory 102 or the storage device 103. The input unit and display unit 140 is realized by the touch detection display 105, and the communication unit 150 is realized by the communication device 104.
[0053] 7 is a diagram showing an example of a process flow of the display change process. The display change process starts when the information processing device 100 is booted.
[0054] First, the authentication result acquisition unit 121 performs a user change determination process (step S001), which will be described later.
[0055] Then, the icon position change unit 125 determines whether the touch detection display 105 has been disinfected (step S002). Specifically, the icon position change unit 125 determines whether the touch detection display 105 has been disinfected based on whether a disinfection button (not shown) that is pressed when the touch detection display 105 has been disinfected has been pressed. If the touch detection display 105 has been disinfected ("Yes" in step S002), the icon position change unit 125 advances the control to step S008.
[0056] If the information processing device 100 has not been disinfected ("No" in step S002), the icon position change unit 125 determines whether a predetermined time has passed since the information processing device 100 was last used (step S003). Specifically, the icon position change unit 125 identifies the time when the information processing device 100 was last used, and determines whether the time that has passed until the current time is equal to or longer than a predetermined time (for example, 4 hours or more). If the time has passed ("Yes" in step S003), the icon position change unit 125 advances control to step S008.
[0057] If the time has not passed ("No" in step S003), the icon position change unit 125 determines whether the current user is the same as the previous (authenticated) user (step S004). Specifically, the icon position change unit 125 obtains user information from the authentication result obtained from the authentication device 500. If the user information does not include a different person flag, the icon position change unit 125 determines that the current user is the same as the previous user, and if the different person flag is included, the icon position change unit 125 determines that the current user is not the same as the previous user. If the current user is the same as the previous user ("Yes" in step S004), the icon position change unit 125 advances the control to step S008.
[0058] If the user is not the same as the previous user (if "No" in step S004), the icon position change unit 125 judges whether the display change is possible (step S005). Specifically, if the icon position change unit 125 cannot read out the next layout from the layout information 113, that is, if all the layouts have been used up, it judges that the display change is impossible. Alternatively, if there is no room to change the display position of a predetermined operation icon to a position closer to the driver's seat, the icon position change unit 125 judges that the display change is impossible. Alternatively, if there is no room to change the display position of the screen itself by avoiding the area already displayed, the icon position change unit 125 judges that the display change is impossible.
[0059] If the display can be changed (if "Yes" in step S005), the icon position change unit 125 changes the display and generates a screen (step S006). Specifically, the icon position change unit 125 reads out the next layout from the layout information 113 and passes it to the screen generation unit 124, and the screen generation unit 124 applies the passed layout to generate a screen. Alternatively, the icon position change unit 125 generates information for changing the display position of a predetermined operation icon to a position moved in a direction closer to the driver's seat and passes it to the screen generation unit 124, and the screen generation unit 124 applies the passed information to generate a screen. Alternatively, the icon position change unit 125 generates information for changing the display position of the screen itself, avoiding an area that has already been displayed, and passes it to the screen generation unit 124, and the screen generation unit 124 applies the passed information to generate a screen.
[0060] If the display cannot be changed (step S005: No), the screen generation unit 124 notifies the user that the display cannot be changed (step S007). Specifically, the screen generation unit 124 notifies the user by displaying a message such as "It is not possible to move the icon to avoid the position touched by the previous user. Wipe the screen before using the screen." in a pop-up or by reading it out loud.
[0061] Then, if a screen was generated in step S006, the screen generation unit 124 displays that screen, and if a screen was generated in step S006, the screen generation unit 124 generates and displays a screen in the initial display position (the initial position is the display position of the operation icon) (step S008).
[0062] The above is the flow of the display change process. According to the display change process, when the user changes and a certain condition is satisfied, the position of the operation icon can be displayed in a different position, so that the position touched by the user can be dispersed. In other words, the risk of re-touching a position touched by the previous user can be avoided, the risk of infection from infectious diseases that spread through droplet contact, including influenza, COVID-19, SARS, etc., can be minimized, and safety from a hygienic perspective can be improved.
[0063] 8 is a diagram showing an example of a process flow of the user change determination process. The user change determination process starts in step S001 of the display change process.
[0064] First, the authentication processing unit 522 detects user-specific information (step S101). Specifically, the authentication processing unit 522 accepts input of predetermined user-specific information required for authentication by the user information detection unit 540. The user-specific information includes, for example, a password, or biometric information such as fingerprint information or vein information, or a combination thereof.
[0065] Then, the authentication processing unit 522 compares the user unique information with the registration information to authenticate the user (step S102). Specifically, the authentication processing unit 522 compares the user unique information detected in step S101 with the user unique information 511b of the user registration information 511, and identifies and authenticates the user if there is a match or a predetermined degree of correlation.
[0066] Then, the authentication processing unit 522 compares the previous person who was successfully authenticated with the user (step S103). Specifically, the authentication processing unit 522 compares the previous person who was successfully authenticated related to the information processing device 100 with the current user.
[0067] Then, the authentication processing unit 522 compares the user with the person who was successfully authenticated last time and determines whether the user is the same (step S104). If they are not the same ("No" in step S104), the authentication processing unit 522 sets a different person flag (step S105). If they are the same ("Yes" in step S104), the authentication processing unit 522 advances control to step S106, which will be described later.
[0068] Then, the result transmitting unit 523 transmits the authentication result including the user identifier and the different person flag to the information processing device 100 (step S106). Specifically, the result transmitting unit 523 transmits the user identifier as the authentication result to the information processing device 100. At that time, if the different person flag is set in step S105, the result transmitting unit 523 sets the authentication result including the different person flag.
[0069] Then, the authentication result acquisition unit 121 of the information processing device 100 registers the authenticated user in the user history (step S107). Specifically, the authentication result acquisition unit 121 stores a user identifier in user 111b of the user history information 111, and stores the date and time of authentication or the date and time of receiving the authentication result in association with authentication date and time 111a.
[0070] The above is the flow of the user change determination process. According to the user change determination process, the user is authenticated, and the authentication result including the different person flag indicating whether or not the person who was previously authenticated by the information processing device 100 and the person who was currently authenticated are different people (different users) can be provided to the information processing device 100.
[0071] Fig. 9 is a diagram showing an example of a layout change screen. In a screen 600 to which the first layout is applied, a display area 601 of operation icons is displayed on the driver's seat side of the entire screen (the right side in Fig. 9, which is an example of a right-hand drive vehicle. In the case of a left-hand drive vehicle, the left side). In the display area 601 of operation icons, from the top, operation icons "Route", "Destination", and "Settings" of the "Navigation" category, operation icons "Phone", "Screen Off", and "Settings" of the "Tool" category, operation icons "Source", "Music", and "Settings" of the "Audio" category, and operation icons "Weather", "News", and "VR" of the "App" category are displayed.
[0072] A screen 610 to which the second layout is applied is an example of a screen displayed after a change from a user who displayed the screen 600 to which the first layout is applied to another user. In the screen 610 to which the second layout is applied, a display area 611 of operation icons is displayed on the driver's seat side of the entire screen and toward the upper side of the screen. In the display area 611 of operation icons, operation icons "Source", "Music", and "Settings" of the "Audio" category are displayed in the upper left, operation icons "Route", "Destination", and "Settings" of the "Navigation" category are displayed in the upper right, operation icons "Weather", "News", and "VR" of the "App" category are displayed in the lower left, and operation icons "Phone", "Screen Off", and "Settings" of the "Tool" category are displayed in the lower right.
[0073] A screen 620 to which the third layout is applied is an example of a screen displayed after a change from the user who displayed the screen 610 to which the second layout is applied to another user. In the screen 620 to which the third layout is applied, a display area 621 of operation icons is displayed on the driver's seat side of the entire screen and toward the bottom of the screen. In the display area 621 of operation icons, operation icons "Source", "Music", and "Settings" of the "Audio" category are displayed in the upper left, operation icons "Route", "Destination", and "Settings" of the "Navigation" category are displayed in the upper right, operation icons "Weather", "News", and "VR" of the "App" category are displayed in the lower left, and operation icons "Phone", "Screen Off", and "Settings" of the "Tool" category are displayed in the lower right.
[0074] In this way, FIG. 9 shows an example in which the icon position change unit 125 changes the display position of the screen itself, avoiding the area where the icon has already been displayed.
[0075] 10 is a diagram showing another example of a layout change screen. In a screen 700 to which a fourth layout for changing the arrangement position of icons is applied, a display area 701 for operation icons "Route", "Destination", and "Settings" of the "Navigation" category is shown in the upper left, a display area 702 for operation icons "Phone", "Screen Off", and "Settings" of the "Tool" category is shown in the lower left, a display area 703 for operation icons "Source", "Music", and "Settings" of the "Audio" category is shown in the upper right, and a display area 704 for operation icons "Weather", "News", and "VR" of the "App" category is shown in the lower right.
[0076] In addition, in screen 700 to which a fourth layout that changes the arrangement position of icons is applied, it is assumed that the user touches the "Root" operation icon at touch position 701T in display area 701. Similarly, it is assumed that the "Settings" operation icon is touched at touch position 702T in display area 702, the "Source" operation icon is touched at touch position 703T in display area 703, and the "VR" operation icon and the "News" operation icon are touched at touch positions 704S and 704T, respectively, in display area 704.
[0077] A screen 710 to which the fifth layout is applied is an example of a screen shown after a change from a user who showed the screen 700 to which the fourth layout is applied to another user. In the screen 710 to which the fifth layout, which changes the arrangement position of the icons is applied, a display area 704 of operation icons "Weather", "News", and "VR" of the "App" category is shown in the upper left, a display area 702 of operation icons "Phone", "Screen Off", and "Settings" of the "Tool" category is shown in the lower left, a display area 701 of operation icons "Route", "Destination", and "Settings" of the "Navigation" category is shown in the upper right, and a display area 703 of operation icons "Source", "Music", and "Settings" of the "Audio" category is shown in the lower right.
[0078] In addition, in screen 710 to which a fifth layout that changes the arrangement position of icons is applied, it is assumed that the user touches the "VR" operation icon and the "weather" operation icon at touch positions 711S and 711T, respectively, in display area 704. Similarly, it is assumed that the "phone" operation icon is touched at touch position 712T in display area 702, the "route" operation icon and the "destination" operation icon are touched at touch positions 713S and 713T in display area 701, and the "settings" operation icon is touched at touch position 714T in display area 703.
[0079] Here, it can be seen that each of the touch positions on screen 710, which employs the fifth layout that changes the icon placement position, does not overlap with any of the positions touched by the previous user on screen 700, which employs the fourth layout that changes the icon placement position.
[0080] A screen 720 to which the sixth layout is applied is an example of a screen displayed after a change from a user who displayed the screen 710 to which the fifth layout is applied to another user. In the screen 720 to which the sixth layout, which changes the arrangement position of icons, is applied, an example of a display area 705 is shown in which, from the left, the operation icons "Settings", "Destination", and "Route" of the "Navigation" category are displayed in this order from the top to the center of the screen, the operation icons "Source", "Settings", and "Audio" of the "Audio" category are displayed in this order, and the operation icons "News", "VR", and "Weather" of the "App" category are displayed in this order. In addition, a display area 702' of the operation icons "Phone", "Screen Off", and "Settings" of the "Tool" category is shown at the bottom of the screen.
[0081] In addition, in screen 720 to which a sixth layout that changes the arrangement position of icons is applied, the user touches the "destination" operation icon, the "route" operation icon, the "audio" operation icon, the "source" operation icon, and the "VR" operation icon at touch positions 725P, 725Q, 725R, 725S, and 725T, respectively, in display area 705. Similarly, in display area 702', the user touches the "phone" operation icon and the "screen off" operation icon at touch positions 722S and 722T, respectively.
[0082] Here, it can be seen that each of the touch positions on screen 720 to which the sixth layout which changes the icon placement position has been applied does not overlap with the positions touched by the previous user on screen 700 to which the fourth layout which changes the icon placement position has been applied, and the positions touched by the previous user on screen 710 to which the fifth layout which changes the icon placement position has been applied.
[0083] In this way, FIG. 10 shows an example in which indirect contact between users can be avoided by switching the layout according to the order for each user.
[0084] 11 is a diagram showing an example of changing the position of an operation icon. In this example of changing the position of an operation icon, an example of processing is shown in which the position of an operation icon included on the screen is changed based on the touch position history when there is a change in the user. In STEP 1, first, the icon position change unit 125 sets an avoidance area 802 with a predetermined radius (for example, a radius of about 1 cm) centered on a position 801 touched by the previous user within a predetermined time.
[0085] In STEP 2, the icon position change unit 125 detects that if the operation icon 810, whose input acceptance range is an area that overlaps with the avoided area 802, is set, interference will occur.
[0086] Then, in STEP 3, the icon position change unit 125 changes the display position of the operation icon 810 to a position 810' that is moved a predetermined distance d (e.g., 1 cm) from the edge of the avoidance area 802 in a direction closer to the driver's seat while avoiding the avoidance area 802.
[0087] The above is an example of changing the position of the operation icon. In the above example of changing the position of the operation icon, the display position of the operation icon can be changed in a manner that avoids the history of the touch position. Therefore, it is possible to improve safety in terms of hygiene while minimizing the decrease in the convenience of icon operation.
[0088] The above is the information processing device according to the embodiment. According to the information processing device 100 according to the embodiment, it is possible to improve safety in terms of hygiene while minimizing the decrease in convenience of icon operations.
[0089] However, the present invention is not limited to the above embodiment. The above embodiment can be modified in various ways within the scope of the technical idea of the present invention. For example, in the above embodiment, the position of the operation icon is changed, but the screen generation unit 124 may display the generated screen in step S008 for displaying the screen for the display change process, and may also display or output a message recommending operation by voice input. Specifically, a message such as "We recommend using voice input to reduce touching the screen as much as possible" may be output by voice guidance.
[0090] Also, for example, in the above embodiment, no distinction is made between the passenger in the front passenger seat and the passenger in the driver seat when operating the device, but the passenger's sanitary safety may be taken into consideration. In the example of the layout change screen shown in FIG. 9, the display area of the operation icons is displayed closer to the driver's seat side (right side) of the entire screen. When the passenger's gestures and hand movements are analyzed to detect the approach of the passenger's hand to the screen, the display area of the operation icons may be displayed closer to the passenger's seat side (left side) of the entire screen. In this way, it is possible to avoid overlapping with the contact area of the driver's seat passenger, and to improve the passenger's sanitary safety.
[0091] Also, for example, in the above embodiment, the information processing device 100 is connected to the authentication device 500, but this is not limited thereto. The authentication device 500 may be integrated with the information processing device 100, or the authentication device 500 may be provided as a service (e.g., a cloud service) via the Internet, and the information processing device 100 may use this service. Alternatively, more simply, an imaging device may be provided in the information processing device 100, and a change in the user may be detected by performing face authentication of the passenger.
[0092] In addition, the above-mentioned configurations, functions, processing units, processing means, etc. may be realized in part or in whole by hardware, for example, by designing them as integrated circuits. In addition, the above-mentioned configurations, functions, etc. may be realized in software by a processor interpreting and executing a program that realizes each function. Information such as the program, table, file, etc. that realizes each function can be stored in a memory, a recording device such as a hard disk or SSD, or a recording medium such as an IC card, SD card, or DVD.
[0093] In addition, the control lines and information lines shown are those that are considered necessary for the explanation, and not all control lines and information lines in the product are necessarily shown. In reality, it can be considered that almost all components are connected to each other. [Explanation of symbols]
[0094] 80: communication path, 100: information processing device, 110: memory unit, 111: user history information, 112: touch position history information, 113: layout information, 120: processing unit, 121: authentication result acquisition unit, 122: touch input detection unit, 123: touch position history recording unit, 124: screen generation unit, 125: icon position change unit, 130: input unit, 140: display unit, 150: communication unit, 500: authentication device, 510: memory unit, 511: user registration information, 520: processing unit, 521: authentication reception unit, 522: authentication processing unit, 523: result transmission unit, 540: user information detection unit, 550: communication unit.
Claims
1. an authentication result acquisition unit that acquires an authentication result of a user who operates the information processing device; a display unit that displays one or more operation icons to be operated by the user; a touch input detection unit that detects a touch operation on the operation icon displayed on the display unit; a touch position history recording unit that detects a touch position in the touch operation and records the detected touch position as a history in a predetermined storage unit; a screen generating unit that generates a screen to be displayed on the display unit; an icon position change unit that changes a position on the screen of the operation icon included on the screen based on the history of the touch position when there is a change in the user identified by the authentication result obtained by the authentication result acquisition unit; An information processing device comprising:
2. 2. The information processing device according to claim 1, the icon position changing unit changes the position of the operation icon to a position that is a predetermined distance away from the touch position included in the history of the touch positions.
23. An information processing apparatus comprising:
3. 3. The information processing device according to claim 1, the touch position history recording unit detects the touch position in the touch operation together with a time of the touch operation and records the detected touch position as a history in the predetermined storage unit; the icon position changing unit excludes the touch operation whose time does not fall within a predetermined period from the history and changes the position of the operation icon on the screen.
23. An information processing apparatus comprising:
4. The information processing device according to any one of claims 1 to 3, The icon position changing unit is if it becomes impossible to change the position of the operation icon on the screen, displaying a predetermined message and not changing the position of the operation icon on the screen; 23. An information processing apparatus comprising:
5. The information processing device according to any one of claims 1 to 4, The icon position changing unit is changing the position of the operation icon on the screen to a position closer to the driver's seat; 23. An information processing apparatus comprising:
6. The information processing device according to any one of claims 1 to 5, The screen generating unit displays the screen in any one of the limited areas of the display unit, the icon position changing unit changes the display position of the screen while avoiding the area already displayed.
23. An information processing apparatus comprising:
7. The information processing device according to any one of claims 1 to 4, The icon position changing unit is and changing a position on the screen of the operation icon included on the screen based on the history of the touch position even in a screen that is displayed after the screen transition.
23. An information processing apparatus comprising:
8. The information processing device according to any one of claims 1 to 4, The icon position changing unit is changing a position on the screen of the operation icon that is frequently touched by the user to an area that has not been touched in the history of the touch positions; 23. An information processing apparatus comprising:
Citation Information
Patent Citations
Information processing device
CN105027062A
Vehicular display device
JP2013096736A
Manipulation device, program, and contamination monitoring system
JP2018084975A
Display device, display control method, and program
JP2019211979A
Information processing device
WO2015001875A1