Output device, output method and output program
The output device selectively outputs electronic messages in voice only when they can be answered, addressing the issue of driver distraction by minimizing unnecessary voice readings.
Patent Information
- Application Number
- JP2024150489
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-09-02
- Publication Date
- 2024-11-08
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Document reading devices that read out electronic messages to drivers while driving can be bothersome, disrupting their focus on the road.
An output device that determines whether an electronic message can be answered by voice and only outputs it in voice if possible, avoiding unnecessary interruptions.
Prevents user distraction by only reading messages that can be responded to vocally, reducing bothersome interruptions for drivers.
Smart Images

Figure 2024159966000001_ABST
Abstract
Description
[Technical field]
[0001] The present application relates to the technical field of an output device that outputs an electronic message addressed to a user by voice. [Background technology]
[0002] Patent document 1 and other documents disclose a document reading device that reads the contents of text information using voice synthesis. Such document reading devices are useful for people who find it difficult to read text, such as drivers of automobiles. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2003-108171 A Summary of the Invention [Problem to be solved by the invention]
[0004] On the other hand, if the document reading-out device were to read out an electronic message such as an e-mail every time the driver received the electronic message while driving the car, the driver might feel annoyed.
[0005] Therefore, in consideration of one example of such a problem, the present invention has an objective of providing an output device or the like that outputs an electronic message by voice without having to read out the electronic message each time an electronic message addressed to the user is received, thereby reducing the inconvenience to the user. [Means for solving the problem]
[0006] The invention described in claim 1 is characterized in that it comprises an acquisition means for acquiring an electronic message addressed to a user, a determination means for determining whether the electronic message is an electronic message to which a voice response can be made, and an output means for outputting the electronic message by voice if the electronic message can be responded to by voice.
[0007] The invention described in claim 8 is an output method by an output device, characterized in that it includes an acquisition step of acquiring an electronic message addressed to a user, a determination step of determining whether the electronic message is an electronic message to which a voice response can be made, and an output step of outputting the electronic message by voice if the electronic message can be responded to by voice.
[0008] The invention described in claim 9 is characterized in that a computer functions as an acquisition means for acquiring an electronic message addressed to a user, a determination means for determining whether the electronic message is an electronic message to which a voice response can be made, and an output means for outputting the electronic message by voice if the electronic message can be responded to by voice. [Brief description of the drawings]
[0009] [Figure 1] 1 is a block diagram showing an example of the configuration of an output device 100 according to an embodiment. [Diagram 2] 1 is a block diagram showing an example of the configuration of an electronic mail read-out device 200 according to an embodiment of the present invention. [Diagram 3] 10 is a flowchart showing an example of an email read-out process by the email read-out device 200 in this embodiment. [Figure 4] 10 is a flowchart showing an example of a voice response availability determination process performed by the email read-out device 200 in the present embodiment. [Diagram 5] 13 is a flowchart showing an example of an e-mail read-out process by the e-mail read-out device 200 in the modified example. [Figure 6]13 is a flowchart showing an example of a process performed by the email read-out device 200 in the modified example when a voice response is possible. [Figure 7] 13 is a flowchart showing an example of a process performed by the email read-out device 200 in the modified example when a voice response is not possible. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] An embodiment of the present invention will be described with reference to FIG.
[0011] As shown in FIG. 1, the output device 100 includes an acquisition unit 101 , a determination unit 102 , and an output unit 103 .
[0012] The obtaining means 101 obtains an electronic message addressed to a user.
[0013] The determining means 102 determines whether or not the electronic message is an electronic message to which a voice response can be made.
[0014] The output means 103 outputs the electronic message by voice if the electronic message can be answered by voice.
[0015] According to the output device 100, when an electronic message addressed to a user can be answered by voice, the electronic message is output by voice, so that the electronic message is not output by voice every time an electronic message addressed to the user is received, thereby preventing the user from being annoyed. EXAMPLES
[0016] Next, an example corresponding to the above-mentioned embodiment will be described. Note that the example described below is an example in which the present invention is applied to an email read-out device 200 mounted on an automobile.
[0017] [1. Configuration of the email reading device 200] The configuration of the email read-out device 200 in this embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing an example of the configuration of the email read-out device 200.
[0018] As shown in FIG. 2, the email reading device 200 is configured to include a control unit 211, a memory unit 212 consisting of a HDD (Hard Disk Drive) or SSD (Solid State Drive) or the like, a communication unit 213, a display unit 214, a touch panel 215, an in-vehicle microphone 216, an in-vehicle camera 217, and a speaker 218.
[0019] The control unit 211 is composed of a CPU 211a that controls the entire control unit 211, a ROM 211b in which a control program for controlling the control unit 211 and the like are stored in advance, and a RAM 211c that temporarily stores various data. The CPU 211a functions as an "acquisition unit," a "determination unit," and an "output unit" by reading and executing various programs stored in the ROM 211b and the storage unit 212. The control unit 211 or the CPU 211a corresponds to a "computer."
[0020] The storage unit 212 stores various programs such as an OS (Operating System) and application programs, as well as data and information used in the various programs. The storage unit 212 also stores an output program that acquires an e-mail addressed to a user, determines whether the acquired e-mail can be answered by voice, and if the e-mail can be answered by voice, outputs the e-mail by voice, and an e-mail program that can send and receive e-mail via an e-mail server. The various programs may be acquired, for example, from a server device or the like via a network, or may be read from a recording medium such as a USB memory.
[0021] The communication unit 213 has a wireless communication device or the like, and communicates with an external server or terminal to transmit and receive data to and from each other.
[0022] The display unit 214 is configured to include a graphics controller 214a and a buffer memory 214b consisting of a memory such as a VRAM (Video RAM). In this configuration, the graphics controller 214a controls the display unit 214 and the touch panel 215 based on control information sent from the control unit 211. The buffer memory 214b also temporarily stores image data that can be instantly displayed on each of the touch panels 215. Then, an image is displayed on the touch panel 215 based on the image data output from the graphics controller 214a.
[0023] The touch panel 215 displays an image based on the image data received from the display unit 214. The touch panel 215 also detects a touch operation by the operator, and transmits touch operation data indicating the touched position and the like to the control unit 211. The control unit 211 determines which operation has been performed based on the touch operation data, and performs processing according to the content of the operation.
[0024] An in-car microphone 216 is provided inside the automobile, and converts the voices of the driver and passengers inside the vehicle into electrical signals and outputs them to the control unit 211 .
[0025] The in-vehicle camera 217 is provided inside the automobile and outputs images of the driver and passengers to the control unit 211. The control unit 211 can identify the person who has spoken based on at least one of the image taken by the in-vehicle camera 217 and the voice input to the in-vehicle microphone 216.
[0026] The speaker 218 is provided in the vehicle and outputs sound under the control of the control unit 211 .
[0027] The control unit 211 receives and transmits e-mails via an e-mail server. When the control unit 211 receives an e-mail addressed to the user (to the user's e-mail address), it determines whether the e-mail can be answered by voice, and if so, outputs (reads) the e-mail by voice.
[0028] The control unit 211 may determine that a received e-mail cannot be answered by voice if an attachment data is attached, and determine that a received e-mail can be answered by voice if an attachment data is not attached.
[0029] In addition, the control unit 211 may determine that the e-mail cannot be answered by voice if the received e-mail contains link information indicating a location where data that cannot be attached (for example, data with a large data size) is stored, and may determine that the e-mail can be answered by voice if the link information is not contained.
[0030] Furthermore, the control unit 211 may determine that an e-mail cannot be answered by voice if the e-mail contains text requesting that the user check the attached data attached to the received e-mail or the data stored at the location indicated by the link information contained in the received e-mail (e.g., "Please check the attached data and give your answer" or "Please download the data from the link and check it").
[0031] Furthermore, the control unit 211 may be configured not to output the email as audio when the received email requests that the data be confirmed by someone other than the user (for example, when the user's email address is set in the CC (Carbon Copy) or BCC (Blind Carbon Copy) field). Note that this process may be made selectable as an option, and the control unit 211 may execute this process only when the user selects the option.
[0032] Furthermore, when the control unit 211 determines that the received e-mail can be answered by voice and outputs the e-mail by voice, if the user inputs a reply (reply) content to the e-mail by voice, it creates a reply e-mail based on the voice and sends it to the sender of the received e-mail. For example, the control unit 211 converts the user's voice into text, creates and sends an e-mail with the converted text as the body and addressed to the sender of the received e-mail.
[0033] The control unit 211 may further convert the text generated based on the user's voice into a format according to the sender of the received e-mail, and create a reply e-mail with the text converted into the format as the body of the e-mail. One example of converting into a format according to the sender is converting into a language appropriate to the sender. For example, when the sender is a customer or other party who should use honorific language, the control unit 211 creates an e-mail with the text converted into honorific language as the body of the e-mail.
[0034] [2. Email reading processing] Next, the e-mail read-out process performed by the e-mail read-out device 200 will be described with reference to FIG.
[0035] First, the control unit 211 acquires an e-mail addressed to the user's e-mail address from the e-mail server (step S101).
[0036] Next, the control unit 211 judges whether or not the user's email address is set in the CC (or BCC) field for the email acquired in the process of step S101 (step S102). As described above, the process of step S102 may be made optional, and the control unit 211 may execute the process only when the user selects the option. If the control unit 211 judges that the user's email address is set in the CC (or BCC) field (step S102: YES), the control unit 211 ends the email read-out process. On the other hand, if the control unit 211 judges that the user's email address is not set in the CC (or BCC) field (step S102: NO), the control unit 211 proceeds to a voice response availability determination process (step S103) described later with reference to FIG. 4.
[0037] Following the voice response availability determination process (step S103), control unit 211 determines whether or not the voice response availability flag is set to ON (step S104). If control unit 211 determines that the voice response availability flag is not set to ON (voice response not possible) (step S104: NO), it ends the e-mail reading process. On the other hand, if control unit 211 determines that the voice response availability flag is set to ON (voice response possible) (step S104: YES), it reads out the e-mail acquired in the process of step S101 (step S105). It may be only the body of the e-mail that is read out, or it may be the destination and the body.
[0038] Next, control unit 211 creates a reply e-mail based on the user's voice input to in-vehicle microphone 216, which corresponds to the body of the reply e-mail (step S106). For example, control unit 211 outputs a message (e.g., "Please input a reply message by voice") from speaker 220 to prompt the user to input a voice corresponding to the body of the reply e-mail, and converts the user's voice input to in-vehicle microphone 216 within a predetermined time into text to be used as the body of the reply e-mail. At this time, as described above, the wording may be converted according to the sender of the e-mail obtained in the process of step S101. The destination of the reply e-mail is the sender of the e-mail obtained in the process of step S101.
[0039] Next, control unit 211 transmits the reply e-mail created in the process of step S106 (step S107), and ends the e-mail read-out process. [3. Voice response availability determination process] Next, a voice response possibility determination process by email read-out device 200 will be described with reference to Fig. 4. The voice response possibility determination process corresponds to step S103 in the email read-out process described above.
[0040] First, the control unit 211 sets the voice response availability flag to OFF (step S131).
[0041] Next, the control unit 211 judges whether data is attached to the e-mail acquired in the process of step S101 (step S132). If the control unit 211 judges that data is attached to the e-mail (step S132: YES), it ends the voice response availability judgment process. On the other hand, if the control unit 211 judges that data is not attached to the e-mail (step S132: NO), it proceeds to the process of step S133. Note that in the process of step 132, the control unit 211 may judge "YES" if data is attached to the e-mail and the e-mail contains text requesting the user to confirm the data, and may judge "NO" if data is attached to the e-mail and the e-mail does not contain text requesting the user to confirm the data.
[0042] Next, the control unit 211 judges whether or not the e-mail acquired in the process of step S101 contains link information indicating the location of the data (step S133). If the control unit 211 judges that the e-mail contains link information (step S133: YES), it ends the voice response availability judgment process. On the other hand, if the control unit 211 judges that the e-mail does not contain link information (step S133: NO), it proceeds to the process of step S134. Note that in the process of step 133, the control unit 211 may judge "YES" if the e-mail contains link information and contains text that requests the user to check the data, and may judge "NO" if the e-mail contains link information and does not contain text that requests the user to check the data.
[0043] Next, the control unit 211 sets the voice response availability flag to ON (step S134), and ends the voice response availability determination process.
[0044] As described above, in the email reading device 200 of this embodiment, the control unit 211 (an example of an "acquisition means," "determination means," or "output means") acquires an email addressed to the user (an example of an "electronic message"), determines whether or not the email is one that can be responded to by voice, and if the email is one that can be responded to by voice, reads the email aloud (an example of "outputting by voice").
[0045] Therefore, according to the email reading device 200 of this embodiment, an email addressed to the user is read out if the email can be answered by voice, so that an email addressed to the user is not read out every time the email is received, thereby preventing the user from being annoyed.
[0046] Furthermore, in the case where data is attached to an e-mail, control unit 211 of e-mail read-out device 200 in this embodiment determines that the e-mail is not one to which a reply can be made by voice. Furthermore, in the case where link information (an example of "location information") indicating the location of the data is included in an e-mail, control unit 211 of e-mail read-out device 200 in this embodiment determines that the e-mail is not one to which a reply can be made by voice. As a result, e-mails that are likely to require the user to check data (e-mails that cannot be easily replied to) are not read out, preventing the user from feeling annoyed.
[0047] Furthermore, in the electronic mail read-out device 200 of this embodiment, the control unit 211 may determine that an electronic message is not one to which a voice response can be made when the electronic mail contains text requesting confirmation of data. This prevents an electronic mail that requests the user to confirm data (an electronic mail that cannot be easily replied to) from being read out, thereby preventing the user from feeling annoyed.
[0048] Furthermore, in the electronic mail read-out device 200 of this embodiment, the control unit 211 does not read out an electronic mail if the electronic mail is an electronic mail that requests that the data be checked by someone other than the user. For example, the control unit 211 does not read out an electronic mail that is not addressed to the user. This prevents electronic mail that the user does not need to reply to from being read out, thereby preventing the user from feeling annoyed.
[0049] Furthermore, in the electronic mail read-out device 200 of this embodiment, when a reply to an electronic mail is input by the user's voice, the control unit 211 (an example of a "creation means" and a "transmission means") creates a reply electronic mail based on the voice and transmits the created reply electronic mail to the sender of the obtained electronic mail. This allows the user to create and send a reply electronic mail by voice even when it is difficult to create a reply email by operating the terminal with his / her fingers, such as while driving a car.
[0050] Furthermore, in the electronic mail read-out device 200 of this embodiment, the control unit 211 can create a reply electronic mail based on the text obtained by converting the text corresponding to the user's voice into a wording (an example of a "format") appropriate for the sender. This allows the user to easily create and send a reply electronic mail without worrying about the wording even when the user does not have time to think about the wording when creating a reply electronic mail, such as while driving a car.
[0051] In this embodiment, the control unit 211 executes the processes from steps S101 to S107 and the processes from steps S131 to S134, but the e-mail reading device 200 and an external server may cooperate to share the responsibilities of these processes.
[0052] In addition, in the present embodiment, an example of an electronic message has been described in the case of an email, but the present invention can also be applied to electronic messages in a messaging application such as LINE (registered trademark).
[0053] [4. Modification of email reading process] Next, a modified example of the e-mail read-out process by the e-mail read-out device 200 will be described with reference to FIG.
[0054] First, control unit 211 acquires an email addressed to the user's email address from an email server (step S201).
[0055] Next, the control unit 211 executes the voice response availability determination process (step S202) described above with reference to FIG.
[0056] Following the voice response availability determination process (step S202), control unit 211 determines whether or not the voice response availability flag is set to ON (step S203). If control unit 211 determines that the voice response availability flag is not set to ON (voice response unavailable) (step S203: NO), it executes voice response unavailable processing (step S205) and ends the e-mail read-out processing. On the other hand, if control unit 211 determines that the voice response availability flag is set to ON (voice response available) (step S203: YES), it executes voice response available processing (step S204) and ends the e-mail read-out processing.
[0057] In addition, for the modified example of the e-mail reading process, the process of step S102 in Fig. 3 may be added as appropriate. For example, the process of step S102 in Fig. 3 may be added between steps S201 and S202, and control unit 211 may end the e-mail reading process when it judges "YES", and proceed to the process of step S202 when it judges "NO".
[0058] [5. Processing when voice response is possible] Next, a process when a voice response is possible by the email read-out device 200 will be described with reference to Fig. 6. The process when a voice response is possible corresponds to step S204 in the modified example of the email read-out process described above.
[0059] First, the control unit 211 confirms with the user whether or not reading out is necessary (step S231). For example, the control unit 211 outputs a message such as "I have received an e-mail from Mr. A that can be responded to by voice. Would you like the text to be read out?" from the speaker 220. The control unit 211 then receives an answer from the user as to whether or not reading out is necessary. For example, when the control unit 211 detects a user voice saying "Read out loud," it determines that "reading out is necessary," and when the control unit 211 detects a user voice saying "no need to read out loud," it determines that "reading out is not necessary."
[0060] Next, if control unit 211 determines that reading out is not necessary (step S232: NO), it ends the voice response possible process. On the other hand, if control unit 211 determines that reading out is necessary (step S232: YES), it reads out the body of the e-mail acquired in the process of step S201 (step S233).
[0061] Next, the control unit 211 confirms with the user whether or not a reply is required (step S234). For example, the control unit 211 outputs a message such as "Would you like to create a message and reply?" from the speaker 220. Then, the control unit 211 receives an answer from the user as to whether or not a reply is required. For example, when the control unit 211 detects a user's voice saying "I will reply," it determines that "a reply is required," and when the control unit 211 detects a user's voice saying "I will not reply," it determines that "a reply is not required."
[0062] Next, when the control unit 211 determines that a reply is not required (step S235: NO), it creates an e-mail indicating that confirmation has been completed, sends it to the sender automatically (step S237), and ends the voice response possible process. Note that the process of step S237 may be configured to be selectable by the user, and the control unit 211 may execute the process of step S237 only when the user selects the option.
[0063] On the other hand, when the control unit 211 determines that a response is necessary (step S235: YES), it then checks the response time (step S236). For example, the control unit 211 outputs a message such as "Would you like to respond immediately or after getting off the train?" from the speaker 220. Then, the control unit 211 accepts an answer from the user regarding the response time. For example, when the control unit 211 detects a user voice saying "I will respond immediately," it determines the answer as an "immediate response," and when the control unit 211 detects a user voice saying "I will respond after getting off the train," it determines the answer as an "after getting off response."
[0064] Next, when control unit 211 determines that the reply time is an immediate reply (step S235: immediate), it creates a reply e-mail based on the user's voice input to in-vehicle microphone 216, which corresponds to the body of the reply e-mail (step S239), sends the created reply e-mail (step S240), and ends the e-mail reading process. Note that the processes of steps S239 and S240 are the same as the processes of steps S106 and S107 in FIG. 3.
[0065] On the other hand, when the control unit 211 determines that the reply time is a reply after getting off the train (step S235: after getting off the train), it executes a reply process after getting off the train (step S241) and ends the e-mail reading process. In the reply process after getting off the train, the control unit 211 creates an e-mail indicating that the data has been confirmed and that the user will be contacted back after getting off the train, and automatically replies to the sender. Note that an option for this automatic reply process may be made selectable, and the control unit 211 may execute the automatic reply process only if the user selects that option. Furthermore, the control unit 211 may notify the user that a reply should be made when getting off the train. An option for this notification may be made selectable, and the notification may be sent only if the user selects that option.
[0066] [6. Processing when voice response is not possible] Next, the process performed by the email read-out device 200 when a voice response is not possible will be described with reference to Fig. 7. The process performed when a voice response is not possible corresponds to step S205 in the modified example of the email read-out process described above.
[0067] First, the control unit 211 checks whether confirmation is necessary (step S251). For example, the control unit 211 outputs a message such as "I received an email with data attached from Mr. A. Would you like to confirm it?" from the speaker 220. Then, the control unit 211 receives an answer from the user as to whether confirmation is necessary. For example, when the control unit 211 detects a user's voice saying "I'll confirm it," it determines that "confirmation is necessary," and when the control unit 211 detects a user's voice saying "You don't need to confirm it," it determines that "confirmation is not necessary."
[0068] Next, when the control unit 211 determines that confirmation is not necessary (step S252: NO), it ends the process when voice response is not possible.
[0069] On the other hand, when the control unit 211 determines that confirmation is necessary (step S252: YES), it then confirms the confirmation time (step S253). For example, the control unit 211 outputs a message such as "Do you want to check immediately or after getting off the train?" from the speaker 220. Then, the control unit 211 accepts an answer from the user regarding the confirmation time. For example, when the control unit 211 detects a user voice saying "I will check immediately," it determines that it is "immediate confirmation," and when the control unit 211 detects a user voice saying "I will check after getting off the train," it determines that it is "check after getting off."
[0070] Next, when the control unit 211 determines that the confirmation time is immediate confirmation (step S254: immediate), it executes immediate confirmation processing (step S255) and ends the processing when voice response is not possible. In the immediate confirmation processing, the control unit 211 creates an e-mail indicating that the user is driving and will confirm and reply after parking, and sends the e-mail automatically to the sender. Note that this automatic reply processing may be made an option selectable, and the control unit 211 executes the automatic reply processing only when the user selects the option. Next, the control unit 211 presents parking locations (stores, parking lots, areas where on-street parking is possible, etc.) close to the current location, and provides guidance on the route to the location selected by the user.
[0071] On the other hand, when the control unit 211 determines that the confirmation time is confirmation after getting off the vehicle (step S254: after getting off the vehicle), it executes the after getting off confirmation process (step S256) and ends the process when voice response is not possible. In the after getting off confirmation process, the control unit 211 creates an e-mail indicating that the user will check after getting off the vehicle and reply back because the user is driving, and sends an automatic reply to the sender. Note that an option for this automatic reply process may be selected, and the control unit 211 may execute the automatic reply process only if the user selects the option. Furthermore, the control unit 211 may notify the user that a call should be made back when getting off the vehicle. An option for this notification may be selected, and the notification may be sent only if the user selects the option. [Explanation of symbols]
[0072] 100: Email reader 101: Acquisition method 102:Discrimination means 103: Output means 200: Email reader 211: Control unit 211a: CPU 211b :ROM 211c:RAM 212: Storage section 213: Communications Department 214: Display unit 214a: Graphics controller 214b: Buffer memory 215: Touch panel 216: Car microphone 217: Car interior camera 218: Speaker
Claims
[Claim 1] a receiving means for receiving an electronic message for the user; a determination means for determining whether the electronic message is an electronic message to which a voice response can be made; an output means for outputting the electronic message by voice when the determination means determines that the electronic message can be answered by voice; An output device comprising:
Citation Information
Patent Citations
Device, method and system for processing information
JP1999161567A
Mail receiving device
JP2001005633A
Voice reproduction device and voice reproduction method for electronic mail and recording medium recording voice reproduction program
JP2001109487A
Data processing system and method to acknowledge mail information
JP2002297507A
Communication terminal and program storage medium
JP2003030113A
