Message processing device and message processing method

Abstract

To provide a message processing device and a message processing method for enabling a load on a user as a listener to be reduced in a case where there is a large amount of messages targeted for reading.SOLUTION: A plurality of messages is received, and based on at least one of the number of the plurality of messages having been received, a total number of characters, and a total reproduction time, a load on a user to be caused by continuous reproduction of the plurality of messages is estimated as a reproduction load. In a case where the reproduction load is more than or equal to a load threshold value, a delimiting position that delimits the plurality of messages into a plurality of message groups is set between predetermined messages, and a control command for reproducing the plurality of messages such that a first time interval between the predetermined messages between which the delimiting position has been set is longer than a second time interval between messages between which the delimiting position has not been set is generated.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a message processing device and a message processing method. [Background technology]

[0002] A technology is known for a message processing device that reads out aloud multiple types of messages sent from outside, grouping messages according to their type, such as by sender, and changing the sound quality for each group (Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 11-102198 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technology of Patent Document 1 does not group messages according to the amount of messages to be read aloud continuously, so even if the amount of messages to be read aloud is large, the messages will continue to be read aloud continuously, which places a burden on the listener.

[0005] The problem to be solved by the present invention is to provide a message processing device and a message processing method that can reduce the burden on a listener when the volume of messages to be read out is large. [Means for solving the problem]

[0006] The present invention solves the above problem by receiving a plurality of messages, estimating the load on the user caused by continuous playback of the plurality of messages as a playback load based on at least one of the number of the received plurality of messages, the total number of characters, and the total playback time, and if the playback load is equal to or greater than a load threshold, setting separator positions between predetermined messages to divide the plurality of messages into multiple message groups, and generating a control command to play back the plurality of messages so that a first time interval between predetermined messages for which separator positions have been set is longer than a second time interval between messages for which separator positions have not been set. [Effects of the Invention]

[0007] According to the present invention, when the volume of messages to be read out is large, the burden on the listener can be reduced. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a configuration diagram illustrating an example of a message processing device according to an embodiment of the present invention. [Figure 2] FIG. 10 is a diagram showing an example of a message playback list according to the present embodiment. [Figure 3] 10 is a diagram illustrating an example of a relationship between a driving load and a determination threshold value for each determination value according to the present embodiment. FIG. [Figure 4] FIG. 10 is a flowchart illustrating a control procedure for executing a message processing method according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] A message processing device according to an embodiment of the present invention will be described below with reference to the drawings.

[0010] The configuration of a message processing device according to this embodiment will be described using FIG. 1. FIG. 1 is a block diagram showing an example of a message processing system including a message processing device according to this embodiment. The message processing system 100 according to this embodiment is a system that executes message processing for playing back a message to a user by voice. The message processing system 100 includes a message server 2, an in-vehicle sensor 3, an outside-vehicle sensor 4, a steering angle sensor 5, an accelerator pedal sensor 6, a brake pedal sensor 7, a playback device 8, a network 9, and a message processing device 10. The message processing device 10 and the playback device 8 are connected via a CAN or other in-vehicle LAN and can exchange information with each other. The message processing device 10 and the message server 2 exchange messages with each other via the network 9. The user is, for example, a passenger of the vehicle 1, particularly the driver.

[0011] In this embodiment, the message processing device 10 includes a processor 11. The processor 11 includes a computer having hardware and software, and this computer includes a ROM storing a program, a CPU that executes the program stored in the ROM, and a RAM that functions as an accessible storage device. Note that, instead of or in addition to the CPU, an MPU, DSP, ASIC, FPGA, or the like can be used as the operating circuit. In this embodiment, the message processing device 10 is a device mounted on the vehicle 1, but is not limited to this and may also be a device located outside the vehicle 1.

[0012] The processor 11 is a device that sequentially plays back multiple messages received from an external device. The processor 11 includes functional blocks, such as a receiving unit 12, an operating status acquiring unit 13, a load estimating unit 14, a delimiter position setting unit 15, a control command generating unit 16, and a transmitting unit 17, and executes each function through cooperation between software and hardware for realizing each function or executing each process. In this embodiment, the functions of the processor 11 are divided into six blocks, and the functions of each functional block are explained, but the functions of the processor 11 do not necessarily have to be divided into six blocks.

[0013] The receiving unit 12 receives messages from the outside. The received messages are messages sent from other users' terminal devices via applications such as email or messaging apps (LINE (registered trademark), Facebook (registered trademark) Messenger). The receiving unit 12 receives multiple messages from an external message server 2. The receiving unit 12 may also determine whether or not the received messages include unread messages. The receiving unit 12 also acquires, for each received message, reception time information indicating the reception time at which the message was received and sender information indicating the sender who sent the message.

[0014] The driving situation acquisition unit 13 acquires driving situation information indicating the driving situation of the user who drives the vehicle. The driving situation includes, for example, the situation of the user's driving operation, the user's physical condition, and the driving situation. The situation of the user's driving operation is, for example, the user's steering operation and pedal operation. The driving situation acquisition unit 13 acquires information on the user's steering operation amount and pedal operation amount from the steering angle sensor 5, the accelerator pedal sensor 6, and the brake pedal sensor 7. The user's physical condition is, for example, the user's blood pressure and heart rate status, and the user's posture status. The driving situation acquisition unit 13 acquires information on the user's blood pressure and heart rate and information on the user's posture from the in-vehicle sensor 3. The driving situation is, for example, the traffic situation in which the vehicle is traveling. The driving situation acquisition unit 13 acquires information on the driving situation around the vehicle from the outside-vehicle sensor 4.

[0015] The load estimation unit 14 estimates the load on the user due to continuous playback of multiple messages as a playback load based on at least one of the number of received messages, the total number of characters, and the total playback time. For example, the load estimation unit 14 estimates a higher playback load as the number of multiple messages increases. The load estimation unit 14 also adds up the number of characters in each message, and estimates a higher playback load as the total number of characters increases. The load estimation unit 14 also estimates the playback time required to play back each message and adds up the playback times of each message. The load estimation unit 14 estimates a higher playback load as the total playback time increases.

[0016] Furthermore, the load estimation unit 14 estimates the driving load of the user based on the driving situation of the user. The driving load is the load that the user bears when driving a vehicle. The greater the driving load, the greater the user's concentration on driving is required to drive. The load estimation unit 14 estimates the driving load based on the situation of the user's driving operation. For example, the load estimation unit 14 estimates a higher driving load as the steering operation amount or the accelerator pedal or brake pedal operation amount increases.

[0017] The load estimation unit 14 also estimates the driving load based on the user's physical condition. For example, the higher the user's blood pressure or heart rate, the greater the estimated driving load. The load estimation unit 14 may also estimate the driving load based on the user's posture. The load estimation unit 14 estimates the user's line of sight, and the greater the user's line of sight, the greater the estimated driving load.

[0018] Furthermore, the load estimation unit 14 estimates the driving load based on the driving situation. When the driving situation of the vehicle 1 is a specific situation, the load estimation unit 14 estimates the driving load to be higher than when the driving situation is other than the specific situation. For example, when the vehicle 1 is driving, the load estimation unit 14 estimates the driving load to be higher than when the vehicle 1 is stopped. Furthermore, specific situations include when the vehicle 1 is driving on a highway, when the vehicle 1 is turning right or left, and when an obstacle such as another vehicle is close to the vehicle 1.

[0019] When the playback load is equal to or greater than the load threshold, the delimiter position setting unit 15 sets delimiter positions between predetermined intervals of messages arranged in chronological order. The intervals between messages are between each of the messages arranged in chronological order. The predetermined intervals between messages are specified by the conditions described below.

[0020] A delimiter position is a position that separates multiple messages arranged in chronological order into multiple message groups. Between predetermined messages for which a delimiter position is set, the time interval between messages is set to a first time interval when multiple messages are played back. The time interval between messages is the time interval when the messages are played back, and is the time from the end of playback of the previous message to the start of playback of the next message. The first time interval is, for example, 5 to 10 seconds. Furthermore, the time interval between messages for which no delimiter position is set is set to a second time interval. The second time interval is, for example, 1 to 2 seconds. In other words, the first time interval is longer than the second time interval.

[0021] That is, in this embodiment, when playing back multiple messages included in a message group, processor 11 plays back the messages consecutively with the time interval between messages set as the second time interval. After playing back the last message included in a message group, processor 11 waits the first time interval before playing back the first message included in the next message group.

[0022] First, as shown in FIG. 2, the delimiter position setting unit 15 stores multiple messages in a playlist by linking them with the time of reception and the sender. At this time, the delimiter position setting unit 15 arranges the multiple messages in the order in which they were received and stores them in the playlist. In the playlist, multiple messages are stored in a list format, one line per message. Furthermore, multiple messages may be stored in the playlist by linking the number of characters and the playtime of each message. Furthermore, the messages listed in the playlist are messages that the receiving unit 12 has determined to be unread messages.

[0023] Next, the delimiter position setting unit 15 identifies a predetermined interval between messages and sets a delimiter position between the predetermined messages. A method for identifying a predetermined interval between messages and setting a delimiter position will be described below. For example, the delimiter position setting unit 15 uses at least one of the number of messages included in a message group, the total number of characters, and the total playback time as a judgment value and sets a delimiter position so that the judgment value of each message group is equal to or less than a judgment threshold.

[0024] The delimiter position setting unit 15 sets a judgment threshold based on the driving load estimated by the load estimation unit 14. The judgment threshold is a value set in advance according to the driving load, and is set smaller as the driving load increases. The driving load is divided into a plurality of stages. For example, the driving load is divided into four stages: "high," "medium," "low," and "none." The judgment threshold is set for each driving load stage, as shown in FIG. 3. As an example, if the judgment value is the number of messages, when the driving load is "medium," the judgment threshold is set to three. The number of messages, the total number of characters, and the total playback time may be used as any one index, or all of the indexes may be used.

[0025] After setting the judgment threshold, the delimiter position setting unit 15 sets the delimiter position based on the judgment threshold. For example, in the example of FIG. 2, the judgment value is the number of messages. When the driving load is "low," the delimiter position setting unit 15 sets the delimiter position so that the number of messages included in the message group is seven or less. In other words, the delimiter position setting unit 15 sets the delimiter position between the seventh message 107 and the eighth message 108.

[0026] Alternatively, the delimiter position setting unit 15 may set a delimiter position based on the reception time of a message. The delimiter position setting unit 15 first calculates the time difference between the reception times of two messages that are in chronological order, and determines for each calculated time difference whether the time difference is equal to or greater than a time difference threshold. Next, the delimiter position setting unit 15 identifies the interval between two messages whose time difference is determined to be equal to or greater than the time difference threshold as a predetermined interval between messages, and sets a delimiter position between the identified predetermined interval between messages.

[0027] In the example of FIG. 2, the reception times of messages 101 to 103 are 12:00, 12:02, and 12:03, respectively, and the time difference between the reception times is within a few minutes. On the other hand, the reception time of message 104 is 15:04, and the time difference between the reception times of messages 103 and 104 is one hour or more. When there is a difference in the reception times of messages, it is considered that after a series of conversations has ended, the next conversation began after a certain time. Therefore, in this embodiment, the delimiter position setting unit 15 sets a delimiter position between messages whose reception time difference is equal to or greater than the time difference threshold.

[0028] Furthermore, the delimiter position setting unit 15 may set the delimiter positions based on the sender information so that the frequency of messages from a specific sender in the message group is equal to or greater than a first frequency threshold. In a conversation group in which multiple people exchange messages, a specific sender may become the central person in the conversation. In this embodiment, a sender who sends messages frequently in a predetermined section is considered to be the central person in the conversation in that section, and multiple messages are divided into message groups when the central sender in the conversation changes.

[0029] The delimiter position setting unit 15 first calculates the frequency of messages from a specific sender in a predetermined section in chronological order, with a predetermined number of messages as the predetermined section. For example, the delimiter position setting unit 15 calculates the number of messages in a predetermined section as the message frequency for each sender. Next, the delimiter position setting unit 15 determines whether the message frequency for each sender is equal to or greater than a first frequency threshold. If the delimiter position setting unit 15 determines that the message frequency for any sender is equal to or greater than the first frequency threshold, it sets the delimiter position so that the messages in the predetermined section form a message group.

[0030] 2, the predetermined section is set to six messages, and the first frequency threshold is set to three messages (half the number of messages in the section). In this case, since there are three messages from sender B in the section from messages 101 to 106, delimiter position setting unit 15 sets the delimiter position so that the messages in the section from messages 101 to 106 form a message group. In other words, the delimiter position is set between message 106 and message 107.

[0031] Furthermore, when a delimiter position is set, the delimiter position setting unit 15 sets a predetermined section starting from the message immediately after the delimiter position, and similarly performs a determination based on the frequency of the messages. In the example of FIG. 2, since there are three messages by sender A in the section from messages 107 to 112, the delimiter position setting unit 15 sets the delimiter position so that the messages in the section from messages 107 to 112 form a message group. That is, the delimiter position is set between message 112 and message 113. Furthermore, when the delimiter position setting unit 15 determines that the frequency of messages from a specific sender in the predetermined section is not equal to or greater than the first frequency threshold, the delimiter position setting unit 15 does not set a delimiter position, and repeatedly performs a determination based on the frequency of the messages while shifting the section by one message in chronological order.

[0032] Furthermore, in this embodiment, the determination may be made based on the frequency of messages between specific senders. For example, the delimiter position setting unit 15 determines, for each of two messages in a sequential relationship based on the sender information, to which of a set of two or more senders the two messages belong, and sets the delimiter position so that the frequency of the two messages belonging to the set of specific senders in the message group is equal to or greater than the second frequency threshold. In a conversation group in which multiple people exchange messages, messages may be exchanged between two or more specific senders. Therefore, in this embodiment, a section in which messages frequently exchanged between specific senders is treated as one message group, and multiple messages are delimited.

[0033] The example in FIG. 2 shows message exchanges in a conversation group with three senders, with three pairs of senders: senders A and B, senders A and C, and senders B and C. First, the delimiter position setting unit 15 determines, in chronological order, which pair of senders each of two messages belongs to, with a predetermined number of messages as a predetermined section. The delimiter position setting unit 15 then calculates the frequency of two messages belonging to a specific pair of senders in the predetermined section. Next, for each pair of senders, the delimiter position setting unit 15 determines whether the frequency of two messages belonging to the specific pair of senders is equal to or greater than a second frequency threshold. If the delimiter position setting unit 15 determines that the frequency of two messages belonging to a specific pair of senders is equal to or greater than the second frequency threshold, the delimiter position setting unit 15 sets the delimiter position so that the messages in the predetermined section form a message group. The second frequency threshold may be a value different from or equal to the first frequency threshold.

[0034] 2, the predetermined interval is set to six messages, and the second frequency threshold is set to three messages (half the number of messages in the interval). In this case, the delimiter position setting unit 15 determines to which pair of senders two messages that are in a chronological order belong. For example, message 101 and message 102 belong to a pair of senders A and B, and message 102 and message 103 belong to a pair of senders B and C.

[0035] Delimiter position setting unit 15 sets the section from messages 101 to 106 as a predetermined section, and since there are three pairs of two messages belonging to the pair of senders B and C in this section, delimiter position setting unit 15 sets the delimiter position so that the messages in the section from messages 101 to 106 form a message group. That is, a delimiter position is set between message 106 and message 107. Furthermore, since there are three pairs of two messages belonging to the pair of senders A and B in the section from messages 107 to 112, delimiter position setting unit 15 sets the delimiter position so that the messages in the section from messages 107 to 112 form a message group. That is, a delimiter position is set between message 112 and message 113.

[0036] Furthermore, for example, when a predetermined number of consecutive messages are sent between two or more specific senders, the delimiter position setting unit 15 may set a delimiter position so as to separate consecutive messages sent between the specific senders into a message group. For example, in the example of Fig. 2, the predetermined number is five. Since there are five consecutive messages sent between senders B and C, messages 102 to 106, the delimiter position setting unit 15 sets delimiters between messages 101 and 102 and between messages 106 and 107, with messages 102 to 106 being treated as a message group.

[0037] The delimiter position setting unit 15 may also set delimiters based on the relevance of keywords included in each message. For example, if there is a message about food and the subsequent message is also about food, it is considered that the users are conversing about the same topic. On the other hand, if the subsequent message is about tourist spots, it is considered that the topic of food has shifted to another topic. In such cases, in this embodiment, multiple messages may be separated by a change in topic during the conversation.

[0038] The delimiter position setting unit 15 first performs topic analysis, a common technique used in natural language processing, for each message to extract keywords contained in the message. Then, for each of two messages that are related to each other in chronological order, the delimiter position setting unit 15 estimates the relevance between the keywords contained in the previous message and the keywords contained in the subsequent message. The relevance is an index indicating the semantic relevance of each keyword. Next, the delimiter position setting unit 15 determines whether the relevance is less than a relevance threshold. The delimiter position setting unit 15 then identifies the interval between two messages for which the relevance is determined to be less than the relevance threshold as a predetermined interval between messages, and sets a delimiter position between the identified predetermined interval between messages. That is, if the relevance between two messages that are related to each other is low, it is considered that the conversation has shifted to a different topic, and therefore a delimiter position is set between the two messages. The method for calculating the relevance between keywords is not particularly limited, and any known method can be used. For example, the keyword distance between keywords may be calculated.

[0039] The delimiter position setting unit 15 may also set the delimiter position depending on whether a keyword included in a subsequent message is related to a keyword included in a previous message. For example, keywords are classified into predetermined types in advance. When a subsequent message contains a keyword belonging to the same type as a keyword included in a previous message, the delimiter position setting unit 15 determines that the keyword included in the subsequent message is related to the keyword included in the previous message. In this embodiment, when the delimiter position setting unit 15 determines that the keyword included in the subsequent message is not related to the keyword included in the previous message, it sets the delimiter position between the previous and subsequent messages. Furthermore, when a subsequent message contains a keyword indicating affirmation / negation, the delimiter position setting unit 15 may also determine that the keyword included in the subsequent message is related to the keyword included in the previous message.

[0040] The control command generation unit 16 generates a control command to play back multiple messages. In this embodiment, the generated control command is a control command to play back multiple messages with a predetermined time interval between them when playing back multiple messages. For example, the control command generation unit 16 generates a control command to play back multiple messages so that a first time interval between predetermined messages with a delimiter set is longer than a second time interval between messages without a delimiter set. That is, the control command generation unit 16 generates a control command to play back messages continuously, with the time interval between each message included in a message group set as the second time interval, and after playing the last message of the message group, play the first message of the next message group after the first time interval. Note that, when no delimiter set is set, the control command generation unit 16 generates a control command to play back all messages continuously, with the time interval between all messages set as the second time interval.

[0041] The transmitting unit 17 transmits the control command generated by the control command generating unit 16 to the playback device 8 .

[0042] The message server 2 is a server that transmits and receives messages between multiple message processing devices 10. In response to a request from the message processing device 10, the message server 2 transmits messages received from terminal devices of other users to the message processing device 10. Note that the message server 2 may be any device that transmits messages received from terminal devices of other users to the message processing device 10, and may be, for example, a terminal device such as a user's smartphone.

[0043] The in-vehicle sensor 3 detects physical information of the user inside the vehicle. The in-vehicle sensor 3 detects information about the user's blood pressure and heart rate using a pulse wave sensor and a heart rate sensor worn by the user. The in-vehicle sensor 3 may also be a camera installed inside the vehicle. The in-vehicle sensor 3 is, for example, a camera equipped with an imaging element such as a CCD or CMOS, and acquires an image of the user inside the vehicle. The outside-vehicle sensor 4 detects vehicle surrounding information about the area around the vehicle. The vehicle surrounding information is, for example, information about obstacles such as other vehicles around the vehicle. The outside-vehicle sensor 4 may also be, for example, a camera installed outside the vehicle and equipped with an imaging element such as a CCD or CMOS. The outside-vehicle sensor 4 acquires an image of the area around the vehicle.

[0044] The steering angle sensor 5 detects the amount of change in steering angle due to the user's steering wheel operation as the steering operation amount. The accelerator pedal sensor 6 detects the accelerator opening caused by the user depressing an accelerator pedal (not shown) provided on the vehicle 1 as the accelerator pedal operation amount. In addition, the brake pedal sensor 7 detects the amount of depression of a brake pedal (not shown) provided on the vehicle 1 by the user as the brake pedal operation amount. Information detected by these sensors is sent to the message processing device 10.

[0045] The playback device 8 is a device that outputs audio information, such as a speaker. In this embodiment, the playback device 8 outputs a message as audio information to a user who is a vehicle occupant. For example, when a control command to play back a message is input from the message processing device 10, the playback device 8 plays back the message as audio information in response to the control command.

[0046] In this embodiment, when a control command is sent from the message processing device 10 to the playback device 8, the playback device 8 plays back the message, but this is not limited to this, and the message processing device 10 may have a message playback function and play back the message in response to the control command.

[0047] The network 9 refers to a telecommunications network such as the Internet or a LAN, and is not particularly limited as long as it can exchange information between the message processing device 10 and the message server 2, and any known network can be used.

[0048] Next, an example of a flowchart of a message processing method executed by the message processing device 10 according to this embodiment will be described with reference to Fig. 4. In this embodiment, when the message processing device 10 is started up or when a message reception instruction is input by the user, the processor 11 executes the control flow from step S1.

[0049] In step S1, the processor 11 receives multiple messages from the message server 2. In step S2, the processor 11 determines whether or not there are any unread messages among the multiple received messages. If it is determined that there are unread messages, the processor 11 proceeds to step S3. If it is determined that there are no unread messages, the processor 11 returns to step S1 and repeats the subsequent flow. In step S3, the processor 11 estimates the playback load on the user due to continuous playback of the multiple received messages. In step S4, the processor 11 estimates the user's driving load based on the user's driving status. In step S5, the processor 11 sets a load threshold based on the driving load estimated in step S4.

[0050] In step S6, processor 11 determines whether the playback load estimated in step S3 is equal to or greater than the load threshold set in step S5. If it is determined that the playback load is equal to or greater than the load threshold, processor 11 proceeds to step S7. If it is determined that the playback load is not equal to or greater than the load threshold, processor 11 proceeds to step S8.

[0051] In step S7, processor 11 sets delimiter positions between predetermined messages to divide the chronologically arranged messages into multiple message groups. Processor 11 sets the delimiter positions so as to reduce the number of messages to be continuously played back. For example, processor 11 sets the delimiter positions so that the number of messages included in a message group is equal to or less than a determination threshold.

[0052] In this embodiment, the processor 11 may set the division points based on the time difference between the reception times of each message, the change between the senders who are the focus of the conversation, or the change in the topic of the conversation. By setting such division points, information that is easy for the user to listen to can be played back as a single block. For example, the processor 11 divides multiple messages into multiple message groups based on the time difference between the reception times of each message, the change between the senders who are the focus of the conversation, or the change in the topic of the conversation. The processor 11 then determines whether the quantity of messages contained in each message group is equal to or less than a threshold, and sets a division point for each message group whose quantity of messages is greater than the threshold. In this embodiment, the division points may be set using all of the conditions of the message quantity, the time difference between the reception times of each message, the change between the senders who are the focus of the conversation, and the change in the topic of the conversation, or by using any one of these conditions or a combination of these conditions.

[0053] In step S8, processor 11 generates a control command to play back the received multiple messages. For example, processor 11 generates a control command to play back the multiple messages so that a first time interval between predetermined messages for which delimiters have been set in step S7 is longer than a second time interval between messages for which delimiters have not been set. Furthermore, if processor 11 determines in step S6 that the playback load is not equal to or greater than the load threshold, in step S8, processor 11 generates a control command to play back the multiple messages so that the time interval between each message is the second time interval.

[0054] In step S9, the processor 11 outputs the control command generated in step S8 to the playback device 8. In step S10, the playback device 8 starts playing back the unread messages in accordance with the control command.

[0055] In step S11, the processor 11 estimates the driving load of the user while the message is being played back. In step S12, the processor 11 determines whether the driving load has increased. The processor 11 compares the driving load estimated last time with the driving load estimated this time, and if the driving load estimated this time is greater than the driving load estimated last time, the processor 11 determines that the driving load has increased. For example, if the driving load estimated in step S11 is greater than the driving load estimated in step S4, the processor 11 determines that the driving load has increased. Even while the message is being played back, the user's driving load changes depending on changes in the user's situation. Therefore, the user may become unable to tolerate the load while the message is being played back. In this embodiment, the playback load on the user is reduced in such cases.

[0056] If it is determined that the driving load has increased, the processor 11 proceeds to step S13. If it is determined that the driving load has not increased, the processor 11 proceeds to step S18. In step S13, the processor 11 estimates the playback load. For example, the processor 11 estimates the playback load when the currently played message is played back. Alternatively, the processor 11 may estimate the playback load when the next message after the currently played message is played back. In step S14, the processor 11 sets a load threshold based on the latest driving load.

[0057] In step S15, processor 11 determines whether the playback load estimated in step S13 is equal to or greater than the load threshold set in step S14. If it is determined that the playback load is equal to or greater than the load threshold, processor 11 proceeds to step S16. If it is determined that the playback load is not equal to or greater than the load threshold, processor 11 proceeds to step S18.

[0058] In step S16, processor 11 stops message playback after the message currently being played back. In step S17, processor 11 determines the elapsed time since message playback was stopped. After a predetermined time has elapsed, processor 11 returns to step S1 and repeats the subsequent flow. That is, in this embodiment, after starting message playback, processor 11 periodically determines whether the playback load is equal to or greater than the load threshold after the driving load increases, and if it is determined that the playback load is equal to or greater than the load threshold, it stops message playback and again executes the process of setting a separator position for unread messages.

[0059] After message playback is stopped in step S16, before returning to step S1, the processor 11 may again confirm with the user whether or not to execute the message processing method according to this embodiment. For example, when the user inputs an operation command to execute the method, the processor 11 starts the control flow from step S1. As described above, when the playback load caused by playing back unread messages is high, the playback of unread messages can be resumed at a timing desired by the user, thereby limiting the number of messages the user listens to at one time and reducing the load on the user.

[0060] In step S18, processor 11 determines whether or not any unread messages remain. If it is determined that any unread messages remain, processor 11 continues playing the messages, returns to step S11, and repeats the subsequent flow. That is, in this embodiment, while playing messages, it is repeatedly determined whether or not the playback load becomes equal to or exceeds the load threshold, and if the playback load does not become equal to or exceeds the load threshold, messages are played according to the delimiter positions set before playing messages until all unread messages have been played.

[0061] As described above, in this embodiment, a message processing method executed by a processor for sequentially playing back multiple messages received from an external source is provided, in which the processor receives the multiple messages, estimates the load on the user due to the continuous playback of the multiple messages as a playback load based on at least one of the number of the received multiple messages, the total number of characters, and the total playback time, and, if the playback load is equal to or greater than a load threshold, sets delimiters between predetermined messages that separate the multiple messages arranged in chronological order into multiple message groups, and generates a control command to play back the multiple messages so that a first time interval between the predetermined messages for which delimiters have been set is longer than a second time interval between messages for which delimiters have not been set. This reduces the load on the listener when there are a large number of messages to be read aloud.

[0062] In this embodiment, the processor uses at least one of the number of messages included in a message group, the total number of characters, and the total playback time as a judgment value, and sets the delimiter positions so that the judgment value for each message group is equal to or less than a judgment threshold, thereby reducing the amount of messages the user hears at one time.

[0063] In this embodiment, the processor acquires the driving status of the user who drives the vehicle, estimates the driving load of the user based on the driving status, and sets a smaller determination threshold as the driving load increases. As a result, when the driving load of the user is high, the amount of messages the user hears at one time can be reduced.

[0064] In this embodiment, the processor acquires the reception time of each received message, calculates the time difference between the reception times of two preceding and succeeding messages in chronological order, determines whether the time difference is equal to or greater than a time difference threshold, identifies the interval between two messages determined to have a time difference equal to or greater than the time difference threshold as a predetermined interval between messages, and sets a separator position between the identified predetermined interval between messages. This allows the playback of messages to be separated according to the actual time interval between the received messages.

[0065] In this embodiment, the processor acquires sender information indicating the sender of each received message, and sets break points based on the sender information so that the frequency of messages from a specific sender in the message group is equal to or greater than a first frequency threshold. This allows breaks to be set in the playback of messages in response to changes in the central person in the conversation.

[0066] Furthermore, in this embodiment, the processor acquires sender information indicating the sender of each received message, and for each pair of preceding and following messages, determines, based on the sender information, to which pair of senders, among two or more senders, the two messages belong, and sets the division position so that the frequency of two messages belonging to a specific pair of senders in the message group is equal to or greater than a second frequency threshold. This makes it possible to set divisions in message playback depending on which senders the conversation is centered around.

[0067] In this embodiment, the processor extracts keywords from each received message, estimates the relevance between the keywords in the previous message and the keywords in the subsequent message for each of two messages in chronological order, determines whether the relevance is below a relevance threshold, identifies the interval between two messages for which the relevance is determined to be below the relevance threshold as a predetermined interval, and sets a break point between the identified predetermined intervals. This allows breaks to be set in the playback of messages based on semantic changes in the content of the conversation, i.e., changes in topic.

[0068] It should be noted that the above-described embodiments have been described to facilitate understanding of the present invention, and are not intended to limit the present invention. Therefore, each element disclosed in the above-described embodiments is intended to include all design modifications and equivalents that fall within the technical scope of the present invention. [Explanation of symbols]

[0069] 100...Message Processing System 1...Vehicle 10...Message processing device 11...Processor 12...Receiver 13...Driving status acquisition unit 14...Load estimation section 15...Delimiter position setting section 16...Control command generation unit 17...Transmitter

Claims

1. A message processing device having a processor that sequentially plays back a plurality of messages received from an external device, The processor: a message receiving unit that receives the plurality of messages; a load estimation unit that estimates a load on a user caused by continuous playback of the plurality of messages as a playback load based on at least one of the number of the plurality of received messages, the total number of characters, and the total playback time; a delimiter position setting unit that sets delimiter positions between predetermined messages to separate the plurality of messages arranged in chronological order into a plurality of message groups when the playback load is equal to or greater than a load threshold; a control command generation unit that generates a control command to play back the plurality of messages so that a first time interval between the predetermined messages for which the delimiter position is set is longer than a second time interval between messages for which the delimiter position is not set.

2. 2. The message processing device according to claim 1, wherein the delimiter position setting unit sets the delimiter position so that the judgment value of each message group is equal to or less than a judgment threshold value, using at least one of the number of messages included in the message group, the total number of characters, and the total playback time as a judgment value.

3. The processor further includes a driving situation acquisition unit that acquires driving situation information indicating a driving situation of the user who drives a vehicle, The delimiter position setting unit Estimating a driving load of the user based on the driving situation; The message processing device according to claim 2 , wherein the determination threshold is set to be smaller as the driving load increases.

4. the message receiving unit acquires reception time information indicating a reception time for each of the received messages; The delimiter position setting unit calculating the time difference between the reception times of two messages that are related in chronological order; determining whether the time difference is equal to or greater than a time difference threshold; Identifying the two messages between which the time difference is determined to be equal to or greater than the time difference threshold as the predetermined message interval; 4. The message processing device according to claim 1, wherein the delimiter position is set between the identified predetermined messages.

5. the message receiving unit acquires sender information indicating a sender of the message for each received message; A message processing device according to any one of claims 1 to 4, wherein the delimiter position setting unit sets the delimiter position based on the sender information so that the frequency of messages from a specific sender in the message group is equal to or greater than a first frequency threshold.

6. the message receiving unit acquires sender information indicating a sender of the message for each received message; The delimiter position setting unit determining, for each of two messages that are in a chronological order and are in a sequential relationship based on the sender information, to which of two or more sender groups the two messages belong; The message processing device according to any one of claims 1 to 5, wherein the delimiter position is set so that the frequency of the two messages belonging to a specific pair of senders in the message group is equal to or greater than a second frequency threshold.

7. The delimiter position setting unit extracting keywords contained in each of the received messages; For each of two messages that are in a chronological order, estimate the degree of relevance between the keyword included in the previous message and the keyword included in the subsequent message; determining whether the relevance is less than a relevance threshold; Identifying the relationship between the two messages, the relationship between which is determined to be less than the relationship threshold, as the predetermined relationship between the two messages; 7. The message processing device according to claim 1, wherein the delimiter position is set between the identified predetermined messages.

8. A message processing method executed by a processor for sequentially reproducing a plurality of messages received from an external device, comprising: The processor: receiving the plurality of messages; estimating a playback load, which is a load imposed on the user due to continuous playback of the plurality of messages, based on at least one of the number of the plurality of received messages, the total number of characters, and the total playback time; If the playback load is equal to or greater than a load threshold, setting a delimiter position between predetermined messages to separate the plurality of messages arranged in chronological order into a plurality of message groups; A message processing method that generates a control command to play back the plurality of messages so that a first time interval between the predetermined messages for which the delimiter position is set is longer than a second time interval between messages for which the delimiter position is not set.

Images