Mobile devices and programs

Abstract

To allow a user to easily identify a transmission message on a specific type and a reception message received accordingly from a plurality of types of messages displayed on the same timeline screen.SOLUTION: A portable terminal comprises communication means and display control means. The communication means transmits and receives messages to and from a plurality of communication destinations. The display control means displays a timeline screen on which balloons representing each of transmission and reception messages exchanged with the communication destination are arranged in time series. The display control means assigns common flags to balloons of transmission and reception messages sharing the transmission source which is the communication destination and the transmission source among the transmission and reception messages.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to a mobile terminal capable of receiving notifications from systems such as a monitoring system for monitoring intrusion into a property, a monitoring system for monitoring the position and status of a user, and a monitoring system for monitoring theft of objects such as vehicles and luggage and displaying them on a timeline, and a program for the mobile terminal.

Background Art

[0002] Conventionally, there has been a technology for operating a security system or household electrical appliances on a timeline screen displayed on a user's mobile terminal.

[0003] For example, in Patent Document 1 below, in response to a remote switching operation of a security mode by a user's mobile terminal, a mode operation message is displayed on the timeline screen of the mobile terminal, and when the switching result of the security mode is received, a mode switching message is displayed on the timeline screen.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the technology of Patent Document 1 above, when there are a plurality of operation targets, it is difficult to immediately grasp which operation target the displayed operation result message is for.

[0006] In view of the above circumstances, the object of the present invention is to provide a monitoring system, a mobile terminal, and a program that enable a user to easily identify transmitted messages of a specific type and corresponding received messages from among multiple types of messages displayed on the same timeline screen. [Means for solving the problem]

[0007] To achieve the above objective, a portable terminal according to one embodiment of the present invention comprises communication means and display control means. The communication means sends and receives messages with a plurality of communication destinations. The display control means displays a timeline screen in which speech bubbles representing the transmitted messages and received messages exchanged with the communication destinations are arranged in chronological order. The display control means attaches a common indicator to the speech bubbles of transmitted messages and received messages that have the same sender and destination as the communication destinations.

[0008] This configuration allows users to easily distinguish between outgoing messages sent to a specific recipient and corresponding received messages from among multiple messages exchanged with recipients displayed on the same timeline screen. These indicators can include anything from colors and specific shaped marks to speech bubble borders.

[0009] The display control means may display the transmitted message on one side of the timeline screen, display the received message on the other side of the timeline screen, and attach the mark to the other end of the transmitted message bubble and the one end of the received message bubble.

[0010] This improves readability and overall clarity because the markers on sent and received messages are located closer together.

[0011] The display control means may also attach the labels to each of the transmitted and received messages such that the labels on each of the speech bubbles are aligned in a straight line in the time-series direction.

[0012] This improves the readability and visibility of the signs.

[0013] The above-mentioned display control means may display the local area of ​​each of the above-mentioned speech bubbles with a different pattern or color for each of the above-mentioned communication destinations as the indicator.

[0014] This allows users to instantly identify sent and received messages exchanged with a specific recipient by recognizing common patterns or colors.

[0015] The above-described display control means may also attach the above-described marker to a vertical strip-shaped area having a predetermined width located at the end of each of the above-described outlets, which is designated as the local area.

[0016] This improves visibility and makes it easier to see the information at a glance by using vertical stripe patterns or color coding.

[0017] When the display control means attaches the mark to the received message from the first communication destination, if there is a pair of sent messages to which the message is a reply, the first mark may be attached to the respective bubbles of the sent message and received message that constitute the pair. If there is no sent message to which the pair does not exist, a second mark, which is of the same type as the first mark, may be attached to the bubble of the received message.

[0018] This allows users to easily distinguish between two-way messages relating to their interactions and other one-way messages. The first indicator described above may be a highlighted version of the second indicator described above. Highlighting means, for example, increasing the thickness of the line indicating the indicator, increasing the size of the indicator, or increasing the hue or brightness of the color attached to the indicator, but is not limited to these.

[0019] The display control means may assign a first color as the first indicator to each of the paired sending message and receiving message bubbles, and may assign a second color, which is in the same color family as the first color but differs in density or brightness, as the second indicator to the receiving message bubble for which there is no paired sending message.

[0020] This allows users to easily distinguish between one-way and one-way messages, even though the recipient is the same, by using similar colors.

[0021] When the display control means attaches the mark to the received message from the first communication destination, if there is a pair of transmitted messages to which the received message is a reply, the first mark may be attached to each of the first pair of transmitted and received messages, and a second mark, which is of the same type as the first mark, may be attached to each of the first pair of transmitted and received messages.

[0022] A mobile terminal according to another embodiment of the present invention comprises communication means and display control means. The communication means sends and receives messages relating to multiple different services. The display control means displays a timeline screen in which speech bubbles representing transmitted and received messages relating to the services are arranged in chronological order. The display control means affixes a common indicator to the speech bubbles of transmitted and received messages that are common to the services relating to those messages.

[0023] This configuration allows users to easily distinguish between outgoing messages and corresponding received messages related to a specific service from among messages about multiple services displayed on the same timeline screen.

[0024] A program according to another embodiment of the present invention is installed on a mobile terminal. Steps for sending and receiving messages with multiple recipients, A step of displaying a timeline screen in which speech bubbles representing the transmitted messages and received messages exchanged with the communication destination are arranged in chronological order; Among the above transmitted messages and received messages, a step of attaching a common identifier to the speech bubbles of the transmitted messages and received messages in which the transmission destination and the transmission source, which are the communication destinations, are common, is executed.

[0025] A program according to another form of the present invention causes a mobile terminal to A step of transmitting and receiving messages related to a plurality of different services; A step of displaying a timeline screen in which speech bubbles representing the transmitted messages and received messages related to the service are arranged in chronological order; Among the above transmitted messages and received messages, a step of attaching a common identifier to the speech bubbles of the transmitted messages and received messages in which the service related to the message is common is executed.

Advantages of the Invention

[0026] As described above, according to the present invention, it is possible to easily identify for the user a transmitted message related to a specific type and a received message received accordingly from a plurality of types of messages displayed on the same timeline screen. However, this effect does not limit the present invention.

Brief Description of the Drawings

[0027] [Figure 1] It is a diagram showing the configuration of a monitoring system according to the first embodiment of the present invention. [Figure 2] It is a diagram showing the hardware configuration of a user terminal of a monitoring system according to the first embodiment of the present invention. [Figure 3] It is a diagram showing an example of a timeline screen displayed on a user terminal according to the first embodiment of the present invention. [Figure 4] It is a diagram showing another example of a timeline screen displayed on a user terminal according to the first embodiment of the present invention. [Figure 5]This is a flowchart illustrating the flow of the timeline display process during user operation by a user terminal according to the first embodiment of the present invention. [Figure 6] This is a flowchart showing the flow of the timeline display process when a user terminal receives a message according to the first embodiment of the present invention. [Figure 7] This figure shows an example of a timeline screen displayed on a user terminal according to a second embodiment of the present invention. [Figure 8] This is a flowchart illustrating the flow of the timeline display process during user operation by a user terminal according to the second embodiment of the present invention. [Figure 9] This is a flowchart showing the flow of the timeline display process when a user terminal receives a message according to the second embodiment of the present invention. [Figure 10] This figure shows an example of a timeline screen displayed on a user terminal according to a modified version of the present invention. [Figure 11] This figure shows an example of a timeline screen displayed on a user terminal according to a modified version of the present invention. [Figure 12] This figure shows an example of a timeline screen displayed on a user terminal according to a modified version of the present invention. [Modes for carrying out the invention]

[0028] <First Embodiment> Embodiments of the present invention will be described below with reference to the drawings. First, a first embodiment of the present invention will be described.

[0029] [System Configuration] Figure 1 is a diagram showing the configuration of the monitoring system according to this embodiment.

[0030] As shown in the figure, this monitoring system includes a security device 100, a location information terminal 110, a vehicle monitoring terminal 120, a user terminal 200, and a monitoring center server 300. This monitoring system is capable of simultaneously providing the user with multiple different systems (services), including a security system (service) that monitors intrusion into a monitoring area (property), a vehicle theft monitoring system (service) that monitors vehicle theft, and a location confirmation system (service) that confirms the location of a person (person being monitored).

[0031] The security device 100 is installed in a monitoring area (security target) such as a residence or business premises, and monitors for abnormalities in the monitoring area, reporting any detected abnormalities to the security center. The security device 100 provides security for the monitoring area using multiple security modes (for example, away mode, home mode, partial set mode, home mode, etc.).

[0032] The location information terminal 110 is a device carried by the person being monitored (for example, the parent or child of the user of the user terminal 200). In response to a location information confirmation request from the user terminal 200, it acquires location information using GPS (Global Positioning System) or radio waves received from a smartphone (mobile phone) base station and sends it back. The location information terminal 110 also has a button to notify the monitoring center in case of emergency, a security buzzer function, and a function to communicate with an operator at the monitoring center.

[0033] Furthermore, as another service using the location information terminal 110, the location information terminal 110 can also detect when the person being monitored enters or leaves a pre-set area, such as their home, a frequently visited park, or a shop, based on the location information of the location information terminal 110, and notify the user terminal 200 (area entry / exit notification service).

[0034] The vehicle monitoring terminal 120 is a terminal that can be attached to a user's car, motorcycle, or other vehicle. Similar to the location information terminal 110, it can acquire location information and can detect vehicle movement using a built-in acceleration sensor, etc. When movement is detected, it notifies the monitoring center and the user terminal 200. The vehicle monitoring terminal 120 may also perform movement monitoring to detect whether or not objects other than vehicles (such as bags or valuables) are moving.

[0035] The user terminal 200 is a mobile device such as a smartphone owned by a resident of a residence in the above-mentioned monitored area, and is capable of connecting to a mobile network such as LTE (Long Term Evolution), 4G, or Wi-Fi. If multiple users reside or occupy the building being monitored, there may be multiple user terminals 200 for each monitored property.

[0036] The user terminal 200 can switch the security mode by communicating with the security device 100. As shown in the figure, the user terminal 200 may be located inside a house within the monitoring area, or it may be located outside the monitoring area, for example, inside an office where the user works.

[0037] When the user terminal 200 is located within the monitoring area, it can communicate with the security device 100 not only via the mobile network mentioned above, but also via short-range wireless communication such as BLE (Bluetooth Low Energy) or Wi-Fi. The operation to switch between security modes is entered on an application (hereinafter referred to as the "monitoring application") installed on the user terminal 200 that provides security mode information and other monitoring information.

[0038] Furthermore, the user terminal 200 can communicate with the location information terminal 110 via the monitoring application and search for and confirm the location information of the location information terminal 110 (the person being monitored). Communication between the user terminal 200 and the location information terminal 110 is performed without going through the monitoring center's server 300, but it may also be performed via the server 300.

[0039] Furthermore, the user terminal 200 can receive information about the movement (theft) of the vehicle being monitored for theft (the vehicle monitoring terminal 120 installed on it) from the server 300 via the monitoring application described above.

[0040] Server 300 is a server installed in the monitoring center and can communicate with the security device 100 and the user terminal 200 via the internet. A control officer is stationed at the monitoring center, and upon receiving an abnormality report from the security device 100, necessary measures such as dispatching security guards to the area protected by the security device 100 are taken.

[0041] The server 300 also stores information such as the location of buildings in the monitoring area and information about users of security contracts who reside or occupy those buildings. For example, the server 300 pairs the user terminals 200 of each user residing or occupying a building in the monitoring area with the security device 100, and stores information grouping these devices by monitoring area for authentication purposes.

[0042] The server 300 can also communicate with the vehicle monitoring terminal 120, which is installed in the vehicle being monitored for theft, via the internet. If the vehicle monitoring terminal 120 detects movement due to theft or other reasons while the vehicle is in theft (movement) monitoring mode, it automatically sends an abnormality signal and location information to the server 300. Upon receiving the abnormality signal, the server 300 sends a notification of receipt of the abnormality signal and the vehicle's location information to the user terminal 200.

[0043] Although the diagram shows server 300 as a single server, there may be separate servers for monitoring the surveillance area via communication with the security device 100 and for monitoring vehicles via communication with the vehicle monitoring terminal 120.

[0044] Switching security modes in the above security system is performed in the following sequence as shown in (1) to (8) in the diagram. Specifically, (1) based on a security mode switching operation by the user terminal 200, a request for a security mode switch is sent to the server 300 via the mobile network, (2) the server 300 authenticates the user terminal 200 (or the group to which it belongs), and if the authentication is successful, forwards the security mode switch request to the security device 100, (3) requesting a security mode switch to the security device 100. Then, (4) the security device 100 receives the security mode switch request and switches the security mode, and (5) notifies the server 300 that the security mode switch has been completed.

[0045] Then, (6) the server 300 receives the notification and requests an API for push notifications on the internet (for example, Apple Push Notification Service (APNS) or Firebase Cloud Messaging (FCM)) to send a push notification that the mode switch is complete. (7) Upon receiving the request, the API sends a push notification to the user terminal 200 indicating that the mode switch is complete, and (8) the user terminal 200 receives the push notification and displays the message on the timeline screen (described later) of the monitoring application.

[0046] Switching the theft monitoring mode in the above vehicle theft monitoring system is performed in the following sequence as shown in (1) to (8) in the figure. Specifically, (1) when the user terminal 200 requests vehicle theft monitoring from the server 300 via the mobile network based on the theft monitoring request operation, (2) the server 300 identifies the destination vehicle monitoring terminal 120 and forwards the theft monitoring start request to the identified vehicle monitoring terminal 120, (3) requesting the vehicle monitoring terminal 120 to switch to the theft monitoring mode. Then, (4) the vehicle monitoring terminal 120, upon receiving the request to switch to the theft monitoring mode, starts the theft monitoring process, and (5) notifies the server 300 of the start of the theft monitoring.

[0047] (6) Upon receiving the notification, the server 300 requests the API to send a push notification indicating the start of theft monitoring. (7) Upon receiving the request, the API sends a push notification to the user terminal 200 indicating the start of theft monitoring, and (8) the user terminal 200 receives the push notification and displays the message on the monitoring application's timeline screen (described later). The user terminal 200 may communicate directly with the theft monitoring terminal 120 without going through the server 300.

[0048] The theft monitoring start notification sent from the vehicle monitoring terminal 120 includes the device ID that identifies the vehicle monitoring terminal 120, the service ID that identifies the type of monitoring performed (service: vehicle theft monitoring), and the start time. This theft monitoring notification is sent to all user terminals 200 that have registered the device ID of the vehicle monitoring terminal 120.

[0049] As explained above, in the security mode switching process and the theft monitoring start process, the server 300 only mediates (and authenticates) the communication between the security device 100 and the vehicle monitoring terminal 120 and the user terminal 200. Therefore, in this embodiment, even though the communication is actually mediated by the server 300, the mediation process may be omitted and the communication may be described as communication between the security device 100 and the vehicle monitoring terminal 120 and the user terminal 200.

[0050] The location information confirmation process in the above location confirmation system is executed in the flow shown in (1), (4), (5), (7), and (8) in the figure. Specifically, (1) when the user terminal 200 requests location information confirmation from the location information terminal 110 via the mobile network based on the location information confirmation request operation, (4) the location information terminal 110 obtains its own location information by communicating with GPS or a base station, and (5) requests the API to push notification that the location information confirmation has been completed. (7) Upon receiving the request, the API pushes a message to the user terminal 200 indicating that the location information confirmation has been completed, and (8) the user terminal 200 receives the push notification and displays the message on the monitoring application's timeline screen (described later). The user terminal 200 may also communicate with the location information terminal 110 via the server 300, as in the theft monitoring request operation.

[0051] The location information notification sent from the location information terminal 110 includes the device ID that identifies the location information terminal 110, the service ID that identifies the type of monitoring (service: location information confirmation) performed, the time the location information was acquired, and the acquired location information (latitude and longitude information). This theft monitoring notification is sent to all user terminals 200 that have registered the device ID of the vehicle monitoring terminal 120. The acquired location information itself is displayed on the monitoring application on a screen (map screen) separate from the push notification display screen.

[0052] Furthermore, if the person being monitored presses the emergency button on the location information terminal 110, a notification will be sent to the monitoring center as described above, and emergency response personnel will be dispatched as necessary. In this case as well, a push notification may be sent to the user terminal 200 indicating that an emergency has been reported.

[0053] In this embodiment, the user terminal 200 receives various push notifications related to different services from multiple different communication destinations (security device 100, location information terminal 110, vehicle monitoring terminal 120) and displays them on the timeline screen. However, when multiple messages with different content are displayed on the same timeline screen, it becomes difficult for the user to understand which communication destination the message was received from and what kind of event occurred. Therefore, in this embodiment, the user terminal 200 has a function to color the area of ​​the speech bubble representing a message received from multiple communication destinations that does not overlap with the text indicating the message, with a color corresponding to the communication destination of that message. Details of this function will be described later.

[0054] [User terminal configuration] Figure 2 shows the configuration of the user terminal 200. As shown in the figure, the user terminal 200 includes a CPU (Central Processing Unit) 21, ROM (Read Only Memory) 22, RAM (Random Access Memory) 23, an input / output interface 25, and a bus 24 that connects these components to each other.

[0055] The CPU 21 accesses RAM 23 and other memory as needed, performing various calculations and comprehensively controlling all blocks of the user terminal 200. ROM 22 is a non-volatile memory that permanently stores the operating system, programs, and firmware such as various parameters to be executed by the CPU 21. RAM 23 is used as a working area for the CPU 21 and temporarily holds the operating system, various running applications, and various data being processed.

[0056] The input / output interface 25 is connected to a display unit 26, an operation reception unit 27, a storage unit 28, a communication unit 29, and the like.

[0057] The display unit 26 is a display device (built-in display) that uses, for example, an LCD (Liquid Crystal Display), an OLED (Organic ElectroLuminescence Display), or a CRT (Cathode Ray Tube).

[0058] The operation reception unit 27 is, for example, a touch panel, buttons, keys, or other input device. If the operation reception unit 27 is a touch panel, the touch panel may be integrated with the display unit 26.

[0059] The storage unit 28 is, for example, a non-volatile memory such as a flash memory (SSD; Solid State Drive), other solid memory, or an HDD (Hard Disk Drive). The OS, various applications, and various data are stored in this storage unit 28.

[0060] In this embodiment in particular, the storage unit 28 stores the monitoring application and other programs that can display messages received from each of the above communication destinations on the timeline. The monitoring application also stores information about the security mode currently set on the security device 100, as well as data (text information and image information) necessary for displaying the timeline screen and other screens.

[0061] The communication unit 29 is, for example, one of the various modules for wireless communication such as LTE and Wi-Fi, and is responsible for communication processing between the security device 100, location information terminal 110, vehicle monitoring terminal 120 and server 300 via mobile networks, short-range wireless communication networks, and the internet.

[0062] [Operation of the monitoring system] Next, the operation of the monitoring system configured as described above will be explained. This operation is performed through the cooperation of the hardware of the user terminal 200, such as the CPU 21 and communication unit 29, and the software (monitoring application) stored in the storage unit 28. For convenience, in the following explanation, the monitoring application or CPU 21 of the user terminal 200 will be considered the main operator.

[0063] Figures 3 and 4 show examples of timeline screens displayed on the display unit 26 of the user terminal 200 according to this embodiment. Figure 3 is the timeline screen of a user terminal 200 belonging to a user (mother) in a user group (family, etc.) that uses the monitoring system, and Figure 4 is the timeline screen of a user terminal 200 belonging to another user (child) in the same user group.

[0064] This timeline screen integrates the timelines for different services, such as area entry / exit notifications, vehicle theft monitoring, location tracking, and security mode switching, and displays them on a single timeline screen.

[0065] On the timeline screen, messages indicating user operations regarding the communication destination in the monitoring system (sent messages 41) are displayed on one side (e.g., the right side), and messages indicating notifications received from the communication destination (received messages 42) are displayed on the other side (e.g., the left side), in a conversational format and in chronological order. Sent messages 41 are displayed as speech bubbles extending from the right edge of the display area of ​​the timeline screen toward the center of the screen, and received messages 42 are displayed as speech bubbles extending from the left side of the display area toward the center of the screen. Note that when the timeline screen is displayed on a device with a large screen, such as a tablet, and other screens are displayed simultaneously, the display area refers to the screen area on which the timeline screen is displayed among those multiple screens.

[0066] Each sent message 41 and each received message 42 are displayed as a speech bubble containing the message (text), and the reception time (operation time) information for each message is displayed in an adjacent position (for example, to the left of sent message 41 and to the right of received message 42).

[0067] The timeline screen has a time axis that runs from top to bottom, with older messages (received earlier) appearing at the top and newer messages (received later) appearing at the bottom. The most recent message is always added to the bottom, and older messages that do not fit within the display area of ​​the timeline screen can be viewed by the user scrolling down the timeline screen, for example, by flicking or swiping up or down.

[0068] Although not shown in the illustration, it is also possible for users in a group (such as family) to exchange regular messages on the timeline screen. When a user double-tap the timeline screen, a text input box and keyboard will appear at the bottom, for example, allowing the user to compose a message and enter text.

[0069] In addition, notification messages from each communication destination, unrelated to user operations regarding the above communication destinations, may also be displayed on the timeline screen. Examples of notification messages include abnormality messages sent from the security device 100 when some abnormality occurs in the building or security area in alert mode, emergency notification messages sent when the emergency button on the location information terminal 110 is pressed, abnormality messages sent when movement (theft) of the vehicle monitoring terminal 120 is detected, and various other notification messages.

[0070] For example, at the bottom of the timeline screen, there is an operation button 31 that displays an operation screen for inputting operations for each of the above-mentioned destinations (security device 100, location information terminal 110, vehicle monitoring terminal 120), and a settings button 32 that displays a settings screen for making various settings related to each destination.

[0071] As can be seen by comparing Figure 3 and Figure 4, even for messages relating to the same operation, the sent message 41 and the received message 42 are displayed differently on the timeline screen of each user's user terminal 200, depending on who is performing the operation.

[0072] For example, if the mother sets the security mode to the away-from-home mode, as shown in Figure 3, a sent message 41a indicating the setting operation will be displayed on the timeline screen of the mother's user terminal 200. Subsequently, when the security device 100 switches the security mode in response to the setting operation and this is notified, a received message 42a notifying the completion of the mode switch will be displayed. On the other hand, as shown in Figure 4, at this time, the timeline screen of the child's user terminal 200 will display a received message 42d indicating that the mother performed the setting operation, since the child did not perform the operation.

[0073] Furthermore, when the mother performs a location check operation for her child, as shown in Figure 3, a sent message 41b indicating this is displayed on the timeline screen of the mother's user terminal 200. However, as shown in Figure 4, at this time, only a received message 42e indicating that the mother performed a location check operation is displayed on the timeline screen of the child's user terminal 200.

[0074] Furthermore, when the mother initiates a request to start vehicle theft monitoring, as shown in Figure 3, a sent message 41c indicating the request to start monitoring is displayed on the timeline screen of the mother's user terminal 200. Subsequently, when monitoring is started on the vehicle monitoring terminal 120 in response to the request and this is notified, a received message 42c notifying the start of vehicle theft monitoring is displayed. On the other hand, as shown in Figure 4, at this time, a received message 42f indicating that the mother initiated a request to start vehicle theft monitoring is displayed on the timeline screen of the child's user terminal 200.

[0075] As shown in Figures 3 and 4, in this embodiment, the user terminal 200 applies processing to local areas on each of the speech bubbles of the transmitted message 41 and received message 42 according to the communication destination, forming an identification area that allows the user to visually identify the communication destination of the message. Specifically, the left and right ends of each speech bubble that are opposite to the left and right edges of the display area of ​​the display unit 26 (the edges of the display area where the timeline screen is displayed) (the left end of the transmitted message 41 and the right end of the received message 42) are colored with a color corresponding to the communication destination of the message, forming a colored area 43 (local area of ​​the transmitted message 41) and a colored area 44 (local area of ​​the received message 42) as identification areas. Furthermore, the colored areas 43 and 44 are areas of a certain width from one end of each speech bubble and are formed as vertical band-shaped areas extending from the upper end to the lower end of each speech bubble. Note that the processing of the local areas only needs to be performed in a manner that corresponds to the communication destination (sender or sender) of the message, and is not limited to coloring with a color corresponding to the communication destination. For example, as shown in Figures 3 and 4, the process may involve creating patterns (such as diagonal lines, polka dots, or other patterns and textures) or varying shades of the same color, or a combination of these. In the following section, localized coloring will be described as an example of the processing method.

[0076] In the examples shown in both figures, different colors are set for the colored sections 43 and 44 for each different communication destination: the security device 100, the child's location information terminal 110, the mother's location information terminal 110, the grandfather's location information terminal 110, and the vehicle monitoring terminal 120.

[0077] The memory unit 28 stores a table indicating the device ID of the communication destination and the corresponding colors of the colored sections 43 and 44. The CPU 21 refers to this table to color the colored sections 43 and 44 of the transmitted message 41 and the received message 42.

[0078] This allows multiple sent messages 41 and received messages 42 with different destinations, displayed on the same timeline screen, to be easily identified for each destination. Furthermore, by providing a colored area 43 at the left edge of the sent message 41 displayed on the right side of the timeline screen, and a colored area 44 at the right edge of the received message 42 displayed on the left side of the timeline screen, the colored areas 43 and 44 are concentrated in close proximity towards the center of the timeline screen, improving overview and visibility, and allowing users to quickly identify which destination a message is from.

[0079] Furthermore, the horizontal length of each message bubble in both the transmitted message 41 and the received message 42 is the same. This allows the transmitted message 41 and the received message 42 to be vertically aligned, further improving readability and visibility.

[0080] Furthermore, the user terminal 200 will use a common color (colored section 43, 44) for the speech bubble of the sent message 41, which is displayed when operating the security mode described above or when requesting the start of vehicle theft monitoring, and the speech bubble of the received message 42, which is displayed as a result of said operation, as both the destination of the sent message 41 and the source of the received message 42 are the same. This makes it easy for the user to distinguish between a message sent to a specific communication destination and the corresponding received message from among the messages exchanged with multiple communication destinations displayed on the same timeline screen.

[0081] Furthermore, a filtering box 33 is provided at the top of the timeline screen to narrow down the sent messages 41 and received messages 42 by their respective destinations. In the example shown in the figure, "All" is selected in the filtering box 33, and sent messages 41 and received messages 42 for all destinations are displayed. However, by selecting one of the above destinations (security device 100, child's location information terminal 110, mother's location information terminal 110, grandfather's location information terminal 110, vehicle monitoring terminal 120) in the filtering box 33, only sent messages 41 and received messages 42 for the selected destination can be displayed on the timeline screen.

[0082] Furthermore, if the above filtering results in only the sent message 41 and received message 42 of any of the communication destinations being displayed, the colored sections 43 and 44 used to distinguish the communication destinations become unnecessary, and therefore, these colored sections 43 and 44 may be deleted. However, even in this case, the color of the colored section 43 and 44 corresponding to the communication destination may be added to, for example, the filtering box 33 or other area, so that the user can see which communication destination has been filtered.

[0083] Alternatively, instead of filtering using the filtering box 33, a timeline screen showing all communication destinations and a separate timeline screen (individual timeline) for each communication destination may be provided, allowing the user to select and display them individually as appropriate.

[0084] Figure 5 is a flowchart showing the flow of the timeline display process when a user operates (sends a message) using the user terminal 200 according to this embodiment.

[0085] As shown in the figure, the CPU 21 of the user terminal 200 first determines whether or not the user has entered an operation instruction to one of the above communication destinations (step 51).

[0086] If it is determined that an operation instruction has been input to any communication destination (Yes in step 51), the CPU 21 identifies the destination device to which the operation is to be performed (step 52). Specifically, the destination device is identified by referring to the device ID that identifies the target device, which is included in the request signal (security mode switching request signal or vehicle theft monitoring start request signal) transmitted by the operation instruction to any communication destination. When a security mode switching request operation is input, the security mode switching request signal also includes mode identification information indicating the security mode after the switch, and the CPU 21 also identifies the message content of the transmitted message 41 based on this mode identification information.

[0087] Next, the CPU 21 identifies the color corresponding to the destination device identified above by referring to the table above (step 53).

[0088] The CPU 21 then adds and displays a speech bubble of a predetermined width representing the transmitted message 41, which has a colored portion 43 with the left edge colored with the specified color, as the latest message on the timeline screen (step 54).

[0089] Figure 6 is a flowchart showing the timeline display process when a message is received by the user terminal 200.

[0090] As shown in the figure, the CPU 21 of the user terminal 200 first determines whether or not it has received a message from any of the communication destinations (step 61).

[0091] If the CPU determines that it has received a message from any of the communication destinations (Yes in step 61), the CPU 21 identifies the source device of the message (step 62). Specifically, it identifies the destination device by referring to the device ID that identifies the target device, which is included in the notification signal sent from any of the communication destinations (security mode switching notification signal or vehicle theft monitoring start notification signal). When the security mode is switched, the security mode switching notification signal also includes mode identification information indicating the security mode after the switch, and the CPU 21 also identifies the message content of the received message 42 based on this mode identification information.

[0092] Next, the CPU 21 identifies the color corresponding to the identified source device by referring to the table above (step 63).

[0093] The CPU 21 then adds and displays a speech bubble of a predetermined width representing the received message 42, which has a colored portion 44 with the right edge colored in the specified color, as the latest message on the timeline screen (step 64).

[0094] As described above, according to this embodiment, the user terminal 200 can easily view multiple messages from different communication destinations displayed on the same timeline screen, for each respective communication destination.

[0095] <Second Embodiment> Next, a second embodiment of the present invention will be described. In the following description, parts similar to those in the first embodiment will be denoted by the same reference numerals, and their descriptions will be omitted or simplified.

[0096] Figure 7 shows an example of a timeline screen displayed on the user terminal 200 in this embodiment. In the first embodiment described above, the user terminal 200 colored the colored portions 43 and 44 of the speech bubbles of each sent message 41 and received message 42 with colors corresponding to the communication destination of each message (the destination of the sent message 41 and the source of the received message 42). In this embodiment, instead of coloring the communication destination of each message, the colors correspond to the service to which each message is associated.

[0097] In the example shown in the figure, different colors are set for the colored sections 43 and 44 for each of the different services related to each transmitted message 41 and received message 42, such as area entry / exit notification using the location information terminal 110, vehicle theft monitoring, location confirmation, and security mode switching (area monitoring).

[0098] The storage unit 28 stores a table indicating a service ID that identifies the service and the corresponding colors for the coloring units 43 and 44. The CPU 21 refers to this table to color the coloring units 43 and 44 of the transmitted message 41 and the received message 42.

[0099] Figure 8 is a flowchart showing the flow of the timeline display process when a user operates (sends a message) using the user terminal 200 according to this embodiment.

[0100] As shown in the figure, the CPU 21 of the user terminal 200 first determines whether or not the user has entered an operation instruction related to any of the above services (step 81).

[0101] If it is determined that an operation instruction for any service has been entered (Yes in step 81), the CPU 21 identifies the service related to that operation (step 82). Specifically, the CPU 21 identifies the service by referring to the service ID that identifies the service, which is included in the request signal transmitted by the operation instruction for any service (such as a security mode switching request signal or a vehicle theft monitoring start request signal).

[0102] Next, CPU21 identifies the color corresponding to the service identified above by referring to the table above (step 83).

[0103] The CPU 21 then adds and displays a speech bubble of a predetermined width representing the transmitted message 41, which has a colored portion 43 with the left edge colored with the specified color, as the latest message on the timeline screen (step 54).

[0104] Figure 9 is a flowchart showing the timeline display process when a message is received by the user terminal 200.

[0105] As shown in the figure, the CPU 21 of the user terminal 200 first determines whether or not it has received a message related to any of the services (step 91).

[0106] If the CPU determines that it has received a message relating to any service (Yes in step 91), the CPU 21 identifies the service associated with the message (step 92). Specifically, it identifies the service by referring to the service ID that identifies the service, which is included in the notification signal sent for any of the services (such as a security mode switching notification signal or a vehicle theft monitoring start notification signal).

[0107] Next, CPU21 identifies the color corresponding to the service identified above by referring to the table above (step 93).

[0108] The CPU 21 then adds and displays a speech bubble of a predetermined width representing the received message 42, which has a colored portion 44 with its right edge colored in the specified color, as the latest message on the timeline screen (step 94).

[0109] Thus, according to this embodiment, multiple messages related to different services, displayed on the same timeline screen, can be easily viewed for each respective service.

[0110] <Variation> The present invention is not limited to the embodiments described above, and can be modified in various ways without departing from the spirit of the invention.

[0111] In each of the embodiments described above, the user terminal 200 provides colored sections 43 and 44 at the left and right ends of each speech bubble that are opposite to the ends of the display area of ​​the display unit 26 (the left end of the transmitted message 41 and the right end of the received message 42). However, the local area where the colored sections 43 and 44 are provided does not have to be at the very end of the speech bubble, but may be slightly shifted inward from the very end. The user terminal 200 may also shift the position of the colored sections 43 and 44 within a predetermined range at the end of the speech bubble according to the communication destination or related service.

[0112] Figure 10 shows an example of the timeline screen in this case. As shown in the figure, the colored sections 43 and 44 are provided at different positions on the ends of the speech bubbles for each different communication destination: the security device 100, the child's location information terminal 110, the mother's location information terminal 110, the grandfather's location information terminal 110, and the vehicle monitoring terminal 120.

[0113] Specifically, in the transmission message 41 and reception message 42 of the security device 100, colored sections 43 and 44 are provided at the outermost ends of the speech bubbles. When the communication destinations are the child's location information terminal 110, the mother's location information terminal 110, the grandfather's location information terminal 110, and the vehicle monitoring terminal 120, the colored sections 43 and 44 are provided in that order, gradually shifted from the outermost end of the speech bubble towards the center. As a result, the colored areas of each speech bubble are vertically aligned for each communication destination, improving the readability and visibility of each message for each communication destination.

[0114] Even when each message bubble is colored according to the associated service, as in the second embodiment described above, the colored parts 43 and 44 can similarly be provided offset within a predetermined range at the end for each service.

[0115] In the embodiments described above, the user terminal 200 provided a colored section 43 at the left end of the transmitted message 41 and a colored section 44 at the right end of the received message 42, and unified the width of each bubble to the same length, so that on the timeline screen, the colored sections 43 of each transmitted message 41 and the colored sections 44 of each received message 42 were arranged in a vertical line (the colored sections 43 and 44 were close together but not in the same position in the width direction). Alternatively, as shown in Figure 11, the user terminal 200 may provide the colored sections 43 of the transmitted message 41 and the colored sections 44 of the received message 42 in the same position in the width direction and align linearly in the timeline direction. In the example shown in the figure, the colored sections 43 and 44 are positioned slightly towards the center from the left or right end of the bubble. This further improves the ability to see and read the messages at a glance.

[0116] Furthermore, in the above-described embodiment, the width of the speech bubbles for the transmitted message 41 and the received message 42 was set to be the same, but the width of the speech bubbles may be changed according to the number of characters in the message. In this case as well, the user terminal 200 may change the position of the colored parts 43 and 44 in each speech bubble so that the colored parts 43 and / or colored parts 44 are aligned in a straight line in the timeline direction.

[0117] Furthermore, if the width of each speech bubble differs depending on the number of characters, the user terminal 200 may change the width or area of ​​the colored sections 43 and 44 according to the width of the speech bubble. For example, the wider the speech bubble, the larger the width or area of ​​the colored sections 43 and 44 may be.

[0118] In the first embodiment described above, the colored parts 43 and 44 are colored according to the communication destination, and in the second embodiment described above, the colored parts 43 and 44 are colored according to the related service. The user terminal 200 may combine these two methods to color the colored parts 43 and 44 according to the communication destination, and also distinguish between color systems (hues) according to the related service.

[0119] For example, the colored sections 43 and 44 of the transmitted message 41 and received message 42 related to location information confirmation may be colored in a red-based color scheme (child: red, mother: crimson, grandfather: vermilion, etc.) or a blue-based color scheme (child: blue, mother: navy blue, grandfather: ultramarine, etc.) depending on the communication destination (location information terminal 110). This ensures that the hue of the colored sections 43 and 44 corresponding to the communication destination is consistent for each service, allowing for simultaneous identification of the communication destination and the service.

[0120] In the embodiment described above, the user terminal 200 had the ends of each message bubble (the left and right ends of each bubble that are opposite to the ends of the display area of ​​the display unit 26) as colored areas 43 and 44. However, the position of the colored areas 43 and 44 is not limited to these ends, but may be at the top, bottom, left, or right ends of the bubble, or even anywhere other than the ends. In this case, it is preferable that the colored areas 43 and 44 be provided in an area that does not overlap with the characters representing the message.

[0121] In the above-described embodiment, the colored portions 43 and 44 were in the shape of vertical strips (long, narrow rectangles), but the shape of the colored portions 43 and 44 is not limited to this, and any other shape is acceptable, such as rectangles, circles, ellipses, triangles, other polygons, stars, etc.

[0122] In the first and second embodiments described above, the storage unit 28 stores a table indicating the device ID for identifying the communication destination device or the service ID for identifying the service, and the corresponding colors of the coloring units 43 and 44. The CPU 21 referred to this table to color the coloring units 43 and 44 of the transmitted message 41 and the received message 42. Alternatively, with respect to the received message 42, the notification signal received in response to the received message 42 contains data indicating the color of the coloring unit 44, and the CPU 21 may color the coloring unit 44 by referring to this data.

[0123] In the embodiments described above, several different monitoring systems (services) were shown, including a security system, a vehicle theft monitoring system, and a location tracking system. However, the monitoring system (service) is not limited to these, and the present invention may also be applied to transmitted messages 41 and received messages 42 that communicate with a home appliance control system (service) that controls household electrical appliances such as air conditioners, robot vacuum cleaners, and water heaters. In this case, the colored parts 43 and 44 may be colored according to the home appliance control system (service), or the colored parts 43 and 44 may be colored according to the communication destination, such as an air conditioner or robot vacuum cleaner controlled by the home appliance control system (service).

[0124] In the above embodiment, the speech bubble of the outgoing message 41, which has a common destination / service, and the speech bubble of the received message 42, which has a common sender / service, were given a common color (colored parts 43, 44). However, the common mark to be attached to the speech bubble is not limited to color. For example, the user terminal 200 may attach a common mark to the speech bubble of the outgoing message 41, which has a common destination / service, and the speech bubble of the received message 42, which has a common sender / service.

[0125] For example, as shown in Figure 12, if the communication destination is a security device 100, a ■ may be used; if it is the mother's location information terminal 110, a ● may be used; if it is the child's location information terminal 110, a ★ may be used; if it is the grandfather's location information terminal 110, a ▲ may be used; and if it is the vehicle monitoring terminal 120, a ◆ may be used. In this way, common marks 53 and 54 may be attached to the transmitted message 41 and received message 42 that share a common communication destination. Furthermore, the positions where these marks 53 and 54 are attached are not limited to the ends shown in the figure.

[0126] In the above-described embodiment, the user terminal 200 applies the same color to the colored parts 43 and 44 whether the transmitted message 41 and the received message 42 are a pair (for example, a transmitted message 41 corresponding to a security mode switching request and a received message 42 corresponding to a security mode switching completion notification transmitted in response to the switching request), or whether the transmitted message 41 or the received message 42 is transmitted or received alone (for example, a transmitted message 41 corresponding to location information confirmation, or a received message 42 notifying of operations by another user (such as a security mode switching request or a vehicle theft monitoring start request)). Alternatively, the user terminal 200 may apply a first mark to each of the bubbles of the transmitted message 41 and the received message 42 that constitute a pair when a transmitted message 41 and the received message 42 that is replied to exist, and may apply a second mark (colored part, mark, etc.) different from the first mark (colored part, mark, etc.) to each of the bubbles of the received message 42 that does not have a pair of transmitted message 41 and transmitted message 41 that does not have a pair of transmitted message 42.

[0127] This allows users to easily distinguish between two-way messages related to their interactions with the system and other one-way messages. Here, the first indicator may be a highlighted version of the second indicator. Highlighting may include, for example, increasing the thickness of the line indicating the indicator, increasing the size of the indicator, making the line indicating the indicator a double or dashed line, not filling in the indicator, or increasing the hue or brightness of the color attached to the indicator, but is not limited to these, as long as a similar type of indicator is attached.

[0128] More specifically, the user terminal 200 may assign a first color (e.g., red, blue) to each bubble of a pair of sent messages 41 and received messages 42, and assign a second color (e.g., pink, light blue) of the same type but with a different density or brightness from the first color to each bubble of a received message 42 that does not have a pair of sent messages 41, and to each bubble of a sent message 41 that does not have a pair of received messages 42.

[0129] Furthermore, even within a pair of messages, the destination may be the same, but the indicators attached to the messages may be different depending on the service they represent (a first indicator for the first pair, and a second indicator of the same type as the first indicator for the second pair). For example, among the pair of messages relating to the security device 100, each bubble in the pair of messages relating to the security mode switching operation may be marked with a first color (for example, blue), and each bubble in the pair of messages relating to other operations (such as checking the current security mode or changing the time for automatic alarm mode setting) may be marked with a second color of the same type but with a different density or brightness from the first color (navy blue). This allows the user to quickly identify messages indicating different services within a pair of messages from the same destination.

[0130] In the embodiment described above, all messages were marked, but this is not limited to that. For example, only the sent and received messages that have been determined to be paired may be marked. In this case, it is sufficient to indicate that the messages have been determined to be paired, so it is not necessary to mark each communication destination with a predetermined mark, and the mark may be changed each time. [Explanation of symbols]

[0131] 21…CPU 26…Display section 28...Storage section 29... Communications Department 41…Sent message 42... Received message 43, 44...Colored section 53, 54... Mark 100... Security device 110...Location information terminal 120... Vehicle monitoring terminal 200... User terminal 300... Server

Claims

1. A communication method for sending and receiving messages with multiple recipients, The system includes a display control means that displays a timeline screen in which speech bubbles representing the transmitted and received messages exchanged with the aforementioned communication partner are arranged in chronological order. The display control means attaches a common indicator to the speech bubbles of the transmitted message and the received message that have the same destination and source as the communication destination. A mobile device characterized by the following features.

2. A mobile terminal according to claim 1, The display control means displays the transmitted message on one side of the timeline screen, displays the received message on the other side of the timeline screen, and attaches the mark to the other end of the bubble for the transmitted message and the one end of the bubble for the received message. Mobile device.

3. A portable terminal according to claim 1 or 2, The display control means attaches the labels to each of the transmitted message and the received message such that the labels on each of the speech bubbles are aligned in a straight line in the time-series direction. Mobile device.

4. A mobile terminal according to any one of claims 1 to 3, The display control means displays the local area of ​​each of the speech bubbles with a different pattern or color for each communication destination as the indicator. Mobile device.

5. A mobile terminal according to claim 4, The display control means attaches the marker to a vertical strip-shaped area having a predetermined width located at the end of each of the blowers, which is designated as the local area. Mobile device.

6. A mobile terminal according to any one of claims 1 to 5, When the display control means attaches the mark to the received message from the first communication destination, if there is a pair of transmitted messages to which the received message is a reply, it attaches the first mark to the respective bubbles of the transmitted message and the received message that constitute the pair, and attaches a second mark, which is of the same type as the first mark, to the bubble of the received message for which there is no pair of transmitted messages. Mobile device.

7. A mobile terminal according to claim 6, The display control means assigns a first color as a first indicator to each of the paired transmission message and reception message bubbles, and assigns a second color as a second indicator to reception message bubbles for which there is no paired transmission message, which is of the same color family as the first color but differs in density or brightness. Mobile device.

8. A mobile terminal according to any one of claims 1 to 5, When the display control means attaches the mark to the received message from the first communication destination, if there is a pair of transmitted messages to which the received message is a reply, it attaches the first mark to each of the first pair of transmitted and received messages, and attaches the second mark, which is of the same type as the first mark, to each of the second pair of transmitted and received messages. Mobile device.

9. A means of communication for sending and receiving messages about multiple different services, The system includes a display control means that displays a timeline screen in which speech bubbles representing sent messages and received messages related to the aforementioned service are arranged in chronological order. The display control means attaches a common indicator to the speech bubbles of the transmitted message and the received message that share the same service related to the message. A mobile device characterized by the following features.

10. On your mobile device, Steps for sending and receiving messages with multiple recipients, The steps include: displaying a timeline screen in which speech bubbles representing the sent and received messages exchanged with the aforementioned communication partner are arranged in chronological order; The steps include: attaching a common indicator to the speech bubbles of the transmitted and received messages that share the same sender and destination, respectively; A program that executes the command.

11. On your mobile device, Steps to send and receive messages about multiple different services, The steps include: displaying a timeline screen in which speech bubbles representing sent messages and received messages related to the aforementioned service are arranged in chronological order; The steps include: attaching a common indicator to the speech bubbles of the sent messages and received messages that are common to the service relating to the message; A program that executes the command.

Images