Electronic apparatus and program

Abstract

To facilitate appropriate selection of a cellular communication network to be connected in a situation where a public cellular communication network and a local cellular communication network are mixed.SOLUTION: An electronic apparatus includes a display unit and at least one processor. The at least one processor acquires, via a communication interface, an identifier assigned to each of a plurality of slices from a communication network that is logically divided into the plurality of slices according to service types. The at least one processor causes the display unit to display an image showing predetermined information related to the communication network, on the basis of the acquired identifier.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present disclosure relates to an electronic device, a program, and a display method. [Background technology]

[0002] In recent years, cellular communication systems that comply with the fifth generation (5G) cellular communication standard have been attracting attention. In such cellular communication systems, it is expected that not only public cellular communication networks operated by telecommunications carriers but also local cellular communication networks operated by general companies, organizations, and individuals will be constructed. Note that local cellular communication networks are sometimes called private cellular communication networks or non-public cellular communication networks.

[0003] Local cellular communication networks can be flexibly constructed and used by various entities according to the needs of the region and the individual needs of the industry. In addition, local cellular communication networks are less congested and have a better propagation environment than public cellular communication networks, and are therefore expected to provide better services to electronic devices.

[0004] In a situation where public and local cellular networks coexist, electronic devices have the option of selecting a connection destination from these two types of cellular networks. In general, electronic devices preferentially select a home network, which is a cellular network with which the device has a contract, or select a cellular network that provides the highest reception power to the device. [Prior art documents] [Non-patent literature]

[0005] [Non-Patent Document 1] 3GPP(R) Technical Report “3GPP TR 23.734 V16.2.0:Study on enhancement of 5G System(5GS) for vertical and Local Area Network(LAN) services (Release 16)”, June 2019 Summary of the Invention

[0006] The electronic device of the present disclosure includes a display unit and at least one processor. The at least one processor acquires, via a communication interface, an identifier assigned to each of a plurality of slices from a communication network that is logically divided into a plurality of slices according to a service type. The at least one processor causes the display unit to display an image showing predetermined information related to the communication network based on the acquired identifier.

[0007] The program of the present disclosure causes a computer provided in an electronic device having a display unit to execute a process of acquiring, via a communication interface, an identifier assigned to each of a plurality of slices from a communication network that is theoretically divided into a plurality of slices according to service types, and causes the computer to execute a process of displaying, on the display unit, an image showing predetermined information related to the communication network based on the acquired identifier.

[0008] A display method according to the present disclosure is a display method for an electronic device having a display unit. In the display method, from a communication network that is logically divided into a plurality of slices according to service types, identifiers assigned to each of the plurality of slices are obtained via a communication interface. In the display method, an image showing predetermined information related to the communication network is displayed on the display unit based on the obtained identifiers. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating a configuration of a communication system according to an embodiment. [Diagram 2] FIG. 1 is a diagram illustrating a configuration of an electronic device according to an embodiment. [Diagram 3] 13 is a flowchart showing a control procedure for a network-related image display process. [Figure 4] FIG. 11 is a diagram illustrating a specified operation of a type of service provided according to an embodiment. [Diagram 5] FIG. 13 is a diagram showing an example of a network-related image displayed on a display. [Figure 6] FIG. 13 is a diagram showing an example of a network-related image displayed on a display. [Figure 7] FIG. 13 is a diagram showing an example of a network-related image displayed on a display. [Figure 8] FIG. 13 is a diagram showing an example of a network-related image displayed on a display. [Figure 9] FIG. 13 is a diagram showing an example of a network-related image displayed on a display. [Figure 10] FIG. 13 is a diagram showing an example of a network-related image displayed on a display. [Figure 11] FIG. 13 is a diagram showing an example of a network-related image displayed on a display. [Figure 12] FIG. 13 is a diagram showing an example of a network-related image displayed on a display. [Figure 13] FIG. 1 is a diagram showing a user's movement from Area 1 to Area 2. [Figure 14] FIG. 13 is a diagram showing an example of a network-related image displayed on a display. [Figure 15] FIG. 13 is a diagram showing an example of a network-related image displayed on a display. [Figure 16] FIG. 13 is a diagram showing an example of a network-related image displayed on a display. [Figure 17] FIG. 13 is a diagram showing an example of a network-related image displayed on a display. [Figure 18] FIG. 13 is a diagram showing an example of a network-related image displayed on a display. [Figure 19] FIG. 13 is a diagram showing an example of a network-related image displayed on a display. [Figure 20] FIG. 13 is a diagram showing an example of a network-related image displayed on a display. [Figure 21] FIG. 13 is a diagram showing an example of a network-related image displayed on a display. [Figure 22] FIG. 13 is a diagram showing an example of a network-related image displayed on a display. [Figure 23]FIG. 13 is a diagram showing an example of a network-related image displayed on a display. [Figure 24] FIG. 13 is a diagram showing an example of a network-related image displayed on a display. [Diagram 25] FIG. 11 is a diagram showing an example of a guide image displayed on a display. [Figure 26] FIG. 11 is a diagram showing an example of a guide image displayed on a display. [Figure 27] FIG. 2 is a diagram showing an example of a map image displayed on a display. [Figure 28] FIG. 11 is a schematic perspective view showing a configuration of an electronic device according to a first modified example. [Figure 29] 13A and 13B are diagrams showing examples of a visual recognition area and a virtual image visually recognized by a user wearing an electronic device of Modification 1. [Diagram 30] FIG. 1 is a diagram illustrating a visual recognition area in space. [Diagram 31] FIG. 13 is a diagram showing a configuration of an electronic device according to a first modified example. [Diagram 32] 13 is a flowchart showing a control procedure for a network-related image display process. [Diagram 33] FIG. 13 is a diagram showing an example of a network-related image displayed on a display. [Diagram 34] FIG. 13 is a diagram showing an example of a network-related image displayed on a display. [Diagram 35] FIG. 11 is a schematic diagram showing a configuration of a display system according to Modification 2. [Diagram 36] 1 is a block diagram showing a main functional configuration of an information processing device; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] When a local cellular communication network is constructed for the purpose of providing a specific service, the types of services provided by the local cellular communication network may be limited. On the other hand, a public cellular communication network may provide general-purpose services but may not provide specialized services that meet the needs of a region or an individual industry.

[0011] Therefore, in a situation where public cellular communication networks and local cellular communication networks are mixed, if a general connection destination selection method such as that described above is applied, a situation may arise in which the service that the user of the electronic device wants to use is not provided in the destination cellular communication network.

[0012] Therefore, an object of the present disclosure is to facilitate appropriate selection of a cellular communication network to connect to in a situation where a public cellular communication network and a local cellular communication network are mixed.

[0013] Hereinafter, an embodiment will be described with reference to the drawings. In the description of the drawings, the same or similar parts are denoted by the same or similar reference numerals.

[0014] [Configuration of communication system] First, a configuration of a communication system according to an embodiment will be described. Fig. 1 is a diagram showing a configuration of a communication system according to an embodiment. The communication system according to an embodiment is a cellular communication system that complies with the 3GPP standard for the fifth generation (5G).

[0015] As shown in FIG. 1, the communication system according to one embodiment includes an electronic device 100, a public cellular communication network 210, a local cellular communication network 220, and a server 300.

[0016] The electronic device 100 is a device having a function of performing cellular communication with a cellular communication network. The electronic device 100 may be any device that has a function of performing cellular communication and has a UI (User Interface). For example, the electronic device 100 is a smartphone, a tablet terminal, a notebook PC (Personal Computer), a wearable terminal device, or a mobile router. In the 3GPP standard, the electronic device 100 is called UE (User Equipment).

[0017] The public cellular communication network 210 is a cellular communication network operated by a telecommunications carrier. The public cellular communication network 210 may be called public 5G. A license is issued nationwide to the telecommunications carrier that operates the public cellular communication network 210.

[0018] The local cellular communication network 220 is a cellular communication network that can be flexibly constructed and used by various entities according to local needs and individual needs of industrial fields. The local cellular communication network 220 is sometimes called local 5G. For example, a general company, organization, or individual can receive frequency allocation and operate the local cellular communication network 220 by themselves. The local cellular communication network 220 is licensed only for a local area such as within the facilities of a general company.

[0019] The public cellular communication network 210 and the local cellular communication network 220 are compliant with the 5G 3GPP standard. The public cellular communication network 210 has a base station 211, and the public cellular communication network 210 has a base station 221. In FIG. 1, each cellular communication network includes only one base station, but in reality, each cellular communication network may include multiple base stations. In the 5G 3GPP standard, the base station is called a gNB. The base station constitutes an NG-RAN (Next Generation Radio Access Network), which is a 5G radio access network.

[0020] Each of the public cellular communication network 210 and the local cellular communication network 220 further includes a 5G core network (5GC). 5G is premised on the premise that various electronic devices are connected to the cellular communication network, and it is necessary to support various services with different requirements, such as high speed, large capacity, high reliability, and low delay. For this reason, 5GC is theoretically divided into multiple slices according to different services (service requirements).

[0021] Here, each slice is assigned an identifier called S-NSSAI (Single-Network Slice Selection Assistance Information). Each slice is associated with one service type (SST). The service types specified in the standard are eMBB (high speed, large capacity), mIoT (multiple connections, low power consumption, low cost), and URLLC (low latency, high reliability), but service types not specified in the standard can also be used.

[0022] When the local cellular communication network 220 is constructed for the purpose of providing a specific service, the type of service (SST) provided by the local cellular communication network 220 may be limited. On the other hand, the public cellular communication network 210 may provide general-purpose services but may not provide special services that meet the needs of a region or individual needs of an industry. The "services provided by the cellular communication network" may also be considered as "functions supported by the cellular communication network."

[0023] The server 300 communicates with the electronic device 100 via the public cellular communication network 210 or the local cellular communication network 220. The server 300 may be a server for managing the local cellular communication network 220.

[0024] At least one electronic device 500 may be connected to the electronic device 100 in a wired or wireless manner. The electronic device 500 establishes, for example, a WLAN (Wireless Local Area Network) connection with the electronic device 100, and communicates with the cellular communication network to which the electronic device 100 is connected via the electronic device 100. This allows the electronic device 500 to communicate with the cellular communication network via the electronic device 100 even if the electronic device 500 does not have a cellular communication function.

[0025] The extension device 400 may be connected to the electronic device 100 in a wired or wireless manner. The extension device 400 establishes, for example, a Universal Serial Bus (USB) connection with the electronic device 100. The extension device 400 may have a function of supplying power to the electronic device 100. The extension device 400 may be a cradle.

[0026] At least one electronic device 600 may be connected to the extension device 400 in a wired or wireless manner. The electronic device 600 establishes, for example, a WLAN connection with the extension device 400, and communicates with the cellular communication network to which the electronic device 100 is connected via the extension device 400 and the electronic device 100. This allows the electronic device 600 to communicate with the cellular communication network via the extension device 400 and the electronic device 100 even if the electronic device 600 does not have a cellular communication function.

[0027] [Configuration of Electronic Device] Next, a configuration of the electronic device 100 according to an embodiment will be described. As shown in Fig. 1, the electronic device 100 has a touch panel display 110, at least one physical button 113, a microphone 121a, and a speaker 122a. However, the configuration shown by the dashed lines in Fig. 1 and Fig. 2 is not essential.

[0028] Touch panel display 110 is provided with its display surface exposed from housing 101 of electronic device 100. Touch panel display 110 has a touch panel 111 and a display 112.

[0029] The touch panel 111 accepts an operation input (touch input) to the electronic device 100. Methods for detecting a touch include, for example, a resistive film method or a capacitive method, but any method may be used. The display 112 outputs video.

[0030] Display 112 displays objects such as characters (including symbols), images, and figures on a screen. Display 112 is, for example, a liquid crystal display or an organic EL (Electro Luminescence) display. In touch panel display 110, display 112 is provided so as to overlap touch panel 111, and the display area of ​​display 112 overlaps with touch panel 111.

[0031] The physical button 113 accepts an operation input (press) to the electronic device 100. The physical button 113 is, for example, a home button, a power button, a volume adjustment button, or the like.

[0032] The microphone 121a receives audio input to the electronic device 100. The microphone 121a also collects surrounding sounds.

[0033] The speaker 122a outputs audio, such as telephone calls and information about various programs.

[0034] FIG. 2 is a diagram showing a configuration of the electronic device 100 according to an embodiment.

[0035] As shown in FIG. 2, the electronic device 100 has a touch panel 111, a display 112, a physical button 113, an audio input unit 121, an audio output unit 122, a sensor 130, a storage 140, a communication interface 150, a SIM (Subscriber Identity Module) interface 160, a connection interface 170, a battery 180, and a controller 190.

[0036] Touch panel 111 inputs a signal corresponding to a touch operation to controller 190. Display 112 displays objects such as characters, images, and figures on the screen based on the signal input from controller 190.

[0037] The audio input unit 121 inputs a signal corresponding to the received audio to the controller 190. The audio input unit 121 may be the microphone 121a shown in Fig. 1, or may be an input interface to which an external microphone can be connected. The external microphone may be provided in the extension device 400.

[0038] The audio output unit 122 outputs audio based on a signal input from the controller 190. The audio output unit 122 may be the speaker 122a shown in Fig. 1, or may be an output interface to which an external speaker can be connected. The external speaker may be provided in the extension device 400.

[0039] The sensor 130 detects various physical quantities and data, and outputs the detection results to the controller 190. For example, the sensor 130 includes a position sensor, an acceleration sensor, and a temperature sensor. The position sensor detects the position of the device itself and outputs the position data to the controller 190. The position sensor may include a Global Navigation Satellite System (GNSS) receiver. The GNSS receiver performs positioning based on GNSS satellite signals, and outputs GNSS position data indicating the geographical position (latitude and longitude) of the device itself to the controller 190. The acceleration sensor detects acceleration applied to the device itself and outputs the acceleration data to the controller 190. The acceleration sensor may be a multi-axis acceleration sensor including multiple acceleration sensors. The temperature sensor detects temperature and outputs the temperature data to the controller 190. At least one of these sensors may be provided in an external device (for example, the extension device 400).

[0040] The storage 140 includes at least one memory that stores programs and data. The storage 140 is also used as a working area that temporarily stores the processing results of the controller 190. The storage 140 may include any non-transitory storage medium, such as a semiconductor storage medium and a magnetic storage medium. The storage 140 may include multiple types of storage media. The storage 140 may include a combination of a portable storage medium, such as a memory card, an optical disk, or a magneto-optical disk, and a storage medium reader. The storage 140 may include a storage device, such as a RAM (Random Access Memory), that is used as a temporary storage area.

[0041] The communication interface 150 communicates wirelessly. The communication interface 150 includes a cellular interface 151 and a WLAN interface 152. The cellular interface 151 is configured to comply with, for example, the 5G cellular communication standard. The WLAN interface 152 is configured to comply with, for example, the IEEE 802.11 standard.

[0042] A SIM (or UIM (User Identity Module)) is attached to the SIM interface 160. The SIM interface 160 may be capable of taking in and removing a SIM. When the SIM interface 160 receives a command to read or write information from the controller 190, it reads information recorded in the SIM and writes the information to the SIM. The SIM may be an embedded eSIM (Embedded SIM). The SIM may be provided by a telecommunications carrier or may be obtained by other means.

[0043] In one embodiment, a SIM for the public cellular communication network 210 and a SIM for the local cellular communication network 220 may be prepared separately. When using a SIM for the public cellular communication network 210, the controller 190 uses the public cellular communication network 210 as a home network and the local cellular communication network 220 as a roaming network. On the other hand, when using a SIM for the local cellular communication network 220, the controller 190 uses the local cellular communication network 220 as a home network and the public cellular communication network 210 as a roaming network. Alternatively, the SIM interface 160 may be capable of receiving both a SIM for the public cellular communication network 210 and a SIM for the local cellular communication network 220.

[0044] The connection interface 170 is an interface that is electrically connected to the extension device 400. The connection interface 170 may be any interface that can be electrically connected to the extension device 400, and is, for example, a USB interface.

[0045] Battery 180 stores power for driving the device itself. Battery 180 may be any type of battery as long as it is a secondary battery, and is, for example, a lithium ion battery.

[0046] The controller 190 is an arithmetic processing device. The arithmetic processing device includes, but is not limited to, a central processing unit (CPU), a system-on-chip (SoC), a micro control unit (MCU), a field-programmable gate array (FPGA), and a coprocessor. The controller 190 also includes a graphics processing unit (GPU), a video RAM (VRAM), and the like, and draws various images on the display 112. The controller 190 may be composed of multiple arithmetic processing devices, and may execute various controls by cooperation of the multiple arithmetic processing devices.

[0047] The controller 190 realizes various functions by comprehensively controlling the operation of the electronic device 100. The controller 190 executes various controls based on an operation input detected by the touch panel 111 and / or the physical button 113. The controller 190 may perform output according to the input operation signal through the audio output unit 122, the display 112, etc.

[0048] [Operation of electronic devices] Next, a description will be given of the operation of the electronic device 100 according to an embodiment of the present disclosure.

[0049] When the network-related image display process shown in FIG. 3 is started, the controller 190 controls the cellular interface 151 to perform a network search (step S101). The network search refers to an operation of detecting a connectable cellular communication network. For example, the cellular interface 151 attempts to receive a wireless signal (e.g., a synchronization signal or a reference signal) transmitted by a base station of each cellular communication network (i.e., the public cellular communication network 210, the local cellular communication network 220). The controller 190 measures the received power of the wireless signal, and when the received power exceeds a threshold, determines that the cellular communication network corresponding to the received power is connectable. In the following, the cellular communication network detected by the network search is referred to as a "detected cellular communication network."

[0050] There are three patterns of detected cellular communication networks: (1) only the public cellular communication network 210, (2) only the local cellular communication network 220, or (3) both the public cellular communication network 210 and the local cellular communication network 220. In the following, a pattern in which the detected cellular communication network is only the public cellular communication network 210 or only the local cellular communication network 220 will be mainly described, but the detected cellular communication network may be both the public cellular communication network 210 and the local cellular communication network 220.

[0051] Next, the controller 190 acquires network-related information from the detected cellular communication network via the cellular interface 151 (step S102). The network-related information includes, for example, the following information (a) to (c).

[0052] (a) Network Identifier The network identifier is an identifier that identifies the detected cellular communication network.

[0053] (b) Information indicating the type of service provided The provided service type is the type of service provided by the detected cellular communication network to the electronic device 100. As described above, each of the public cellular communication network 210 and the local cellular communication network 220 is logically divided into a plurality of slices corresponding to different service types (see FIG. 4). An identifier called S-NSSAI is assigned to each slice. The controller 190 acquires the S-NSSAI of each slice of the detected cellular communication network as information indicating the type of service provided by the detected cellular communication network. The controller 190 may also acquire information other than the S-NSSAI as information indicating the type of service provided.

[0054] (c) Information indicating the network type The network type is whether the detected cellular communication network is the public cellular communication network 210 or the local cellular communication network 220.

[0055] Furthermore, the controller 190 may obtain the received power measured during the network search in step S101 as the network-related information.

[0056] Next, controller 190 causes display 112 to display a network-related image showing predetermined information related to the detected cellular communication network based on the network-related information acquired in step S102 (step S103).

[0057] Next, the controller 190 determines whether or not an instruction to end the display operation by the electronic device 100 has been given (step S104).

[0058] In step S104, when it is determined that an instruction to end the display operation by the electronic device 100 has not been given (step S104; NO), the controller 190 returns the process to step S101 and repeats the subsequent processes.

[0059] Furthermore, in step S104, if it is determined that an instruction to end the display operation by electronic device 100 has been given (step S104; YES), controller 190 ends the network-related image display process.

[0060] A specific display mode when the display control of the net-related image is performed in step S103 will be described below.

[0061] As one display mode, for example, as shown in FIG. 5, the controller 190 displays an image (e.g., an image of a circled number) I1 indicating the number of slices (e.g., 4) of the detected cellular communication network as a network-related image in the upper portion 112A (so-called pictogram area) of the display 112.

[0062] 6, the controller 190 may display an image I1 indicating the number of slices of the detected cellular communication network together with an image I2 indicating the communication quality with the detected cellular communication network. In this case, for example, when a predetermined operation is performed to switch the communication mode to either 4G communication or 5G communication, the network-related image is switched to either a network-related image I3 corresponding to 4G (slice-incompatible communication network) or network-related images I1 and I2 corresponding to 5G (slice-compatible communication network) and displayed as shown in FIG. In addition, the controller 190 may display image I1 so as to be superimposed on image I2 (for example, FIG. 6), or may display images I1 and I2 so as to be spaced apart, or may display image I2 so as to be superimposed on image I1.

[0063] 8, the controller 190 may normally display only an image I2 indicating the communication quality with the detected cellular communication network, and when a predetermined operation is performed via the touch panel 111, may display an image I1 indicating the number of slices of the detected cellular communication network together with the image I2. Note that the above-mentioned predetermined operation is not limited to a predetermined operation via the touch panel 111, and may be a predetermined operation via the physical button 113 or the voice input unit 121.

[0064] Also, as shown in FIG. 9, the controller 190 may normally display only an image I2 indicating the communication quality with the detected cellular communication network, and when a predetermined operation corresponding to the image I2 is performed, an image I1 indicating the number of slices of the detected cellular communication network may be displayed. Here, the predetermined operation corresponding to the image I2 may be, for example, a touch operation on the image I2 via the touch panel 111, a cursor designation operation on the image I2 via the physical button 113, or a predetermined voice operation via the voice input unit 121. Note that after displaying the image I1 indicating the number of slices of the detected cellular communication network, the image I2 may be returned to being displayed when a predetermined time has elapsed (or a predetermined operation has been performed). Note that the image normally displayed is not limited to the image I2 indicating the communication quality with the detected cellular communication network, and may be, for example, an app icon that uses slices according to the type of service provided by the detected cellular communication network.

[0065] Also, as shown in FIG. 10, the controller 190 may display an image I4 indicating the number of slices (e.g., 2 / 4) that satisfies a predetermined condition among the number of slices (e.g., 4) of the detected cellular communication network as a network-related image. The number of slices that satisfies the predetermined condition is, for example, the number of slices that have been used by the electronic device 100 (number of slices). The number of slices that satisfies the predetermined condition may also be, for example, the number of slices that satisfies a predetermined communication volume or communication frequency or the number of slices that satisfies a predetermined communication quality. The image indicating the number of slices that satisfies the predetermined condition among the number of slices of the detected cellular communication network is not limited to the image I4 shown in FIG. 10, and as shown in FIG. 11, an image I5 in which the number of slices that satisfies the predetermined condition (e.g., 2) is underlined in order to distinguish it from the number of slices of the detected cellular communication network.

[0066] Also, as shown in FIG. 12, the controller 190 may display an image I1 indicating the number of slices (e.g., 4) of the detected cellular communication network as a network-related image, and may display an image I6 indicating the type of service that the detected cellular communication network provides to the electronic device 100 around the image I1. The image I6 indicating the type of service is configured to display a number corresponding to the service type (see FIG. 4). Based on a predetermined operation corresponding to the image I6, the use of communication via a slice corresponding to the corresponding service type can be controlled to be on or off. The display content of the image I6 indicating the service type may be any content that can identify the service type, and may be, for example, an identifier (S-NSSAI) of the corresponding slice, an icon set for the corresponding service type, or the like.

[0067] Here, when the image I6 indicating the type of service provided to the electronic device 100 by the detected cellular communication network is displayed around the image I1 as described above, the controller 190 specifies the type of service provided from among the following candidates of service types No. 1 to No. 8 based on the information indicating the type of service provided acquired in step S102 of the network-related image display process (see FIG. 3) as shown in Fig. 4. Note that when there are multiple detected cellular communication networks, the controller 190 specifies the type of service provided for each detected cellular communication network.

[0068] No.1: Data communication (Internet communication) The controller 190 determines whether communication with a specific device or server is possible through the detected cellular communication network, or whether a certain number of UL / DL packets are transmitted / received through the detected cellular communication network per unit time. If it is determined that communication with a specific device or server is possible through the detected cellular communication network, the controller 190 identifies data communication as one of the types of services provided by the detected cellular communication network. Alternatively, if it is determined that a certain number of uplink / downlink packets are transmitted / received through the detected cellular communication network per unit time, the controller 190 identifies data communication as one of the types of services provided by the detected cellular communication network.

[0069] No.2: Voice communication The controller 190 determines whether communication with the SIP server is possible through the detected cellular communication network or the line (CS) status of the detected cellular communication network. If it is determined that communication with the SIP server is possible through the detected cellular communication network, the controller 190 specifies voice communication as one of the types of services provided by the detected cellular communication network. Alternatively, if it is determined that the line (CS) of the detected cellular communication network is available, the controller 190 specifies voice communication as one of the types of services provided by the detected cellular communication network.

[0070] No.3: Low Power Consumption The controller 190 determines whether or not a power saving function has been set in the electronic device 100 from the detected cellular communication network. The power saving function is set in the electronic device 100 by, for example, an RRC Reconfiguration message, which is a type of RRC message. When it is determined that the power saving function has been set in the electronic device 100 from the detected cellular communication network, the controller 190 identifies the power saving function as one of the service types provided by the detected cellular communication network.

[0071] No.4: Temperature abnormality suppression function (overheating assistance) The controller 190 determines whether or not a temperature abnormality suppression function has been set in the electronic device 100 from the detected cellular communication network. The temperature abnormality suppression function is set in the electronic device 100 by, for example, an RRC Reconfiguration message, which is a type of RRC message. When it is determined that the temperature abnormality suppression function has been set in the electronic device 100 from the detected cellular communication network, the controller 190 identifies the temperature abnormality suppression function as one of the service types provided by the detected cellular communication network.

[0072] No.5: High speed and large capacity (eMBB) The controller 190 determines whether or not the S-NSSAI (slice / service type) SST acquired from the detected cellular communication network includes the value "1" assigned to eMBB by the standard. The S-NSSAI is notified to the electronic device 100 by, for example, a Registration Accept message, which is a type of NAS (Non-Access Stratum) message. If the SST of the SNSSAI acquired from the detected cellular communication network includes the value "1" assigned to eMBB by the standard, the controller 190 identifies eMBB as one of the service types provided by the detected cellular communication network.

[0073] No.6: High reliability, low latency (URLLC) The controller 190 determines whether the SST of the S-NSSAI acquired from the detected cellular communication network includes the value "2" assigned to URLLC in the standard. If the SST of the S-NSSAI acquired from the detected cellular communication network includes the value "2" assigned to URLLC in the standard, the controller 190 identifies URLLC as one of the service types provided by the detected cellular communication network.

[0074] No.7: Multi-connection (mIoT) The controller 190 determines whether the SST of the S-NSSAI acquired from the detected cellular communication network includes the value "2" assigned to mIoT in the standard. If the SST of the S-NSSAI acquired from the detected cellular communication network includes the value "2" assigned to mIoT in the standard, the controller 190 identifies mIoT as one of the service types provided by the detected cellular communication network.

[0075] No.8:Other services The controller 190 judges whether the SST of the S-NSSAI acquired from the detected cellular communication network includes a value assigned to each service by the unique specification. For example, SST "x" is assigned to Business, SST "y" is assigned to Factory, SST "z" is assigned to Transport, SST "xx" is assigned to Airport, SST "yy" is assigned to Drone, and SST "zz" is assigned to Train. If the SST of the S-NSSAI acquired from the detected cellular communication network includes a value assigned by the unique specification, the controller 190 identifies the service type corresponding to this value as the service type provided by the detected cellular communication network.

[0076] Furthermore, the controller 190 may normally display an image I2 indicating the communication quality with the detected cellular communication network together with an image I1 indicating the number of slices (e.g., 4) of the detected cellular communication network as shown in Fig. 6, and when a predetermined operation corresponding to the image I1 is performed, an image I6 indicating the type of service that the detected cellular communication network provides to the electronic device 100 may be displayed around the image I1 with the image I1 at the center as shown in Fig. 12. Here, the predetermined operation corresponding to the image I1 may be, for example, a touch operation on the image I1 via the touch panel 111, a cursor designation operation on the image I1 via the physical button 113, a predetermined voice operation via the voice input unit 121, or the like.

[0077] Also, as shown in Fig. 13, when the user moves from Area 1 to Area 2, the controller 190 may determine whether or not there is a change in the number of slices of the detected cellular communication network based on the network-related information acquired in step S102 of the network-related image display process (see Fig. 3), and may notify the user of the change in the number of slices. Specifically, as shown in Fig. 14, for example, when the number of slices of the detected cellular communication network increases from 4 to 5 as the user moves from Area 1 to Area 2, the controller 190 displays an image I7 indicating that the number of slices of the detected cellular communication network has increased (for example, an image showing the characters "add" in a circle). On the other hand, when the number of slices of the detected cellular communication network decreases from 4 to, for example, 3 as the user moves from Area 1 to Area 2, the controller 190 displays an image I8 indicating that the number of slices of the detected cellular communication network has decreased (for example, an image showing the characters "remove" in a circle).

[0078] In addition, when the number of slices of the detected cellular communication network increases, the controller 190 may notify that the number of slices of the detected cellular communication network has increased by changing the display color of the image I2 indicating the communication quality with the detected cellular communication network to a preset display color (e.g., red) or a preset display mode (e.g., fast blinking display). On the other hand, when the number of slices of the detected cellular communication network decreases, the controller 190 may notify that the number of slices of the detected cellular communication network has decreased by changing the display color of the image I2 indicating the communication quality with the detected cellular communication network to a preset display color (e.g., blue) or a preset display mode (e.g., slow blinking display). In addition, the notification method regarding the increase or decrease in the number of slices of the detected cellular communication network is not limited to the above-mentioned method. For example, a sound or the like notifying that the number of slices of the detected cellular communication network has increased or decreased may be output from the audio output unit 122. In addition, the notification that the number of slices of the detected cellular communication network has increased or decreased may be notified by emitting light from a light-emitting unit (not shown) provided in the electronic device 100. Also, a vibration function provided in the electronic device 100 may be activated to notify the user that the number of slices in the detected cellular communication network has increased or decreased.

[0079] Furthermore, when a predetermined operation corresponding to an image I7 (see FIG. 14) indicating that the number of slices of the detected cellular communication network has increased is performed, the controller 190 may display an image I6 indicating the type of service provided to the electronic device 100 by the detected cellular communication network, centered around the image I1 indicating the number of slices of the detected cellular communication network (for example, from 4 to 5), as shown in FIG. 15. At this time, the character "New" is displayed on the image I6 indicating the service type corresponding to the newly available slice (for example, the service type of No. 5). Here, the image I6 is displayed so that the user can easily notice which service type corresponds to the newly available slice. The controller 190 may, for example, change the display mode of the image indicating the service type corresponding to the newly available slice to make it easier for the user to notice (changing the display mode means, for example, blinking the image indicating the service type corresponding to the newly available slice at a predetermined first speed, changing the color of the image to a predetermined first color, or moving the display position of the image to a predetermined first position, etc.). On the other hand, when a predetermined operation is performed corresponding to an image I8 (see FIG. 14) indicating that the number of slices of the detected cellular communication network has decreased, the controller 190 may display an image I6 indicating the type of service that the detected cellular communication network provides to the electronic device 100 around the image I1 indicating the number of slices of the detected cellular communication network (e.g., from 4 to 3), as shown in FIG. 16. At this time, a pattern indicating that the service type is unavailable is displayed on the image I6 indicating the service type corresponding to the unavailable slice (e.g., service type No. 4). Here, the image I6 is displayed so that the user can easily notice which service type corresponds to the unavailable slice.The controller 190 may, for example, make it easier for the user to notice by changing the display mode of the image indicating the service type corresponding to the unavailable slice (changing the display mode may, for example, blink the image indicating the service type corresponding to the unavailable slice at a predetermined second speed, change the color of the image to a predetermined second color, or move the display position of the image to a predetermined second position, etc.).

[0080] The controller 190 may also determine whether or not a predetermined service type is included in the detected cellular communication network based on the network-related information acquired in step S102 of the network-related image display process (see FIG. 3), and notify the detected cellular communication network if the predetermined service type is included in the detected cellular communication network. Specifically, the controller 190 may determine whether or not a service type (e.g., voice communication (No. 2) and high reliability, low delay (No. 6); see FIG. 4) that is uniquely recommended for the electronic device 100 is included in the detected cellular communication network based on the network-related information, and if the service type is included, may notify the detected cellular communication network of the service type uniquely recommended for the electronic device 100 by changing the display color of the meter part of the image I2 indicating the communication quality with the detected cellular communication network to a preset display color (e.g., purple) as shown in FIG. 17. Here, it is assumed that the service type uniquely recommended for the electronic device 100 is preset and the recommended service type is stored in the storage 140. As shown in FIG. 18, the display color of image I1 indicating the number of slices of the detected cellular communication network may be changed to a preset display color (e.g., yellow) to notify electronic device 100 that the detected cellular communication network includes a service type that is uniquely recommended.

[0081] Furthermore, the controller 190 may determine whether or not a service type (e.g., voice communication (No. 2); see FIG. 4) uniquely recommended for an application (e.g., a calling application) executed in the electronic device 100 is included in the detected cellular communication network based on the network-related information, and if the service type is included, when the application is being executed or an operation for designating an icon related to the application is performed, as shown in FIG. 19, by displaying an image I1 indicating the number of slices of the detected cellular communication network together with an image I9 indicating the application on the display 112, thereby notifying the user that the service type uniquely recommended for the application is included in the detected cellular communication network. Here, it is assumed that the service type uniquely recommended for the application executed in the electronic device 100 is preset and stored in the storage 140.

[0082] The notification method for notifying that the service type uniquely recommended for the electronic device 100 is included in the detected cellular communication network and the notification method for notifying that the service type uniquely recommended for the application executed in the electronic device 100 is included in the detected cellular communication network are not limited to the above-mentioned method. For example, a voice indicating that the service type uniquely recommended for the electronic device 100 is included in the detected cellular communication network or a voice indicating that the service type uniquely recommended for the application executed in the electronic device 100 is included in the detected cellular communication network may be output from the audio output unit 122. Also, a light-emitting unit (not shown) provided in the electronic device 100 may be illuminated or a vibration function provided in the electronic device 100 may be activated to notify that the service type uniquely recommended for the electronic device 100 is included in the detected cellular communication network or that the service type uniquely recommended for the application executed in the electronic device 100 is included in the detected cellular communication network.

[0083] Also, as shown in Figs. 20 to 22, the controller 190 may display images I10 to I12 indicating the characteristics of the detected cellular communication network as the network-related image. Specifically, as shown in Fig. 20, when the service type included in the detected cellular communication network is only multi-connection (mIoT) (No. 7) (or when many service types specialized in multi-connection are included), the controller 190 displays an image I2 indicating the communication quality with the detected cellular communication network and an image (image showing the character "multi" in a circle) I10 indicating that the service type of the detected cellular communication network includes multi-connection (mIoT). Also, as shown in Fig. 21, when the service type included in the detected cellular communication network is only Drone (No. 8) (or when many service types specialized in Drone are included), the controller 190 displays an image I2 indicating the communication quality with the detected cellular communication network and an image I11 indicating that the service type of the detected cellular communication network includes Drone (image showing the character "D" in a circle). Also, as shown in FIG. 22, when the service type included in the detected cellular communication network is only high reliability, low latency (URLLC) (No. 6), which is optimal for autonomous driving communication, etc. (or when many service types specialized in high reliability and low latency are included), the controller 190 displays an image I12 (an image showing the word Auto in a circle) indicating that the service types of the detected cellular communication network include high reliability and low latency, along with an image I2 indicating the communication quality with the detected cellular communication network.

[0084] The controller 190 may indicate the characteristics of the detected cellular communication network by, for example, changing the display color or display mode of the image I2. For example, the controller 190 may indicate that the detected cellular communication network includes more service types specialized in high reliability and low delay as the blinking speed of the image I2 increases.

[0085] Furthermore, among the service types No.1 to No.8 shown in FIG. 4, for example, when service types No.1 and No.2 are classified as the first class and service types No.3 to No.8 are classified as the second class (feature set), and the service types included in the detected cellular communication network are only service types belonging to the second class, as shown in FIG. 23, the controller 190 may display an image I13 (an image showing the character 'SPECIAL' in a circle) indicating that the service type of the detected cellular communication network corresponds to the second class (feature set), together with an image I2 indicating the communication quality with the detected cellular communication network.

[0086] Also, as shown in FIG. 24, when the detected cellular communication network is the local cellular communication network 220, the controller 190 may acquire, via the cellular interface 151, owner information indicating the owner of the license corresponding to the local cellular communication network 220 (e.g., ABC Co., Ltd.) and communication area information indicating the communication area of ​​the local cellular communication network 220 (e.g., Area 1), and based on the acquired owner information and communication area information, display an image I14 indicating the owner and an image I15 indicating the communication area together with an image I1 indicating the number of slices of the detected cellular communication network and an image I2 indicating the communication quality with the detected cellular communication network.

[0087] Furthermore, when a predetermined operation (for example, a touch operation) is performed on the image I14 indicating the owner, the controller 190 may cause the display 112 to display a guide image I16 indicating the telephone number and email address of the owner, ABC Corporation, as shown in Fig. 25. Instead of the guide image I16, the controller 190 may cause the display 112 to display a guide image I17 provided with, for example, a Tel button B1 for calling the telephone number of ABC Corporation, a Mail button B2 for creating an email addressed to the email address of ABC Corporation, and a LINK button B3 for accessing the homepage of ABC Corporation, as shown in Fig. 26.

[0088] Furthermore, when a predetermined operation (for example, a touch operation) is performed on the image I15 showing the communication area, the controller 190 may cause a map image I18 showing Area1, which is the communication area, to be displayed on the display 112, as shown in Fig. 27. Furthermore, the controller 190 may cause the user's current position P to be displayed when displaying the map image I18.

[0089] [Variation 1] Next, an electronic device 100A according to Modification 1 will be described. This electronic device 100A differs from the above embodiment in that it is intended for a wearable terminal device. Below, differences from the above embodiment will be described, and commonalities will be omitted.

[0090] As shown in FIG. 28, the electronic device 100A includes a main body 10a, a visor 114 (display member) attached to the main body 10a, and the like.

[0091] The main body 10a is an annular member whose circumference is adjustable. Various devices such as a depth sensor 133 and a camera 134 are built in the main body 10a. When the main body 10a is worn on the head, the user's field of vision is covered by a visor 114.

[0092] The visor 114 is optically transparent. The user can view the real space through the visor 114. An image such as a virtual image is projected and displayed on a display surface of the visor 114 facing the user's eyes from a laser scanner 115 (see FIG. 31) built into the main body 10a. The user views the virtual image by the light reflected from the display surface. At this time, the user also views the real space through the visor 114, so a visual effect is obtained as if the virtual image exists in the real space.

[0093] As shown in FIG. 29, in a state where the virtual image 30 is displayed, the user visually recognizes the virtual image 30 facing a predetermined direction at a predetermined position in the space 40. In this modification, the space 40 is a real space visually recognized by the user through the visor 114. Since the virtual image 30 is projected onto the visor 114 having optical transparency, it is visually recognized as a semi-transparent image overlapping the real space. In FIG. 29, a planar window screen is illustrated as the virtual image 30, but the present invention is not limited thereto, and the virtual image 30 may be, for example, various kinds of three-dimensional images. When the virtual image 30 is a window screen, the virtual image 30 has a front surface and a back surface, and necessary information is displayed on the front surface, and usually, no information is displayed on the back surface.

[0094] The electronic device 100A detects the visual recognition area 41 of the user based on the position and orientation of the user in the space 40 (in other words, the position and orientation of the electronic device 100A). As shown in FIG. 30, the visual recognition area 41 is an area in the space 40 located in front of the user U wearing the electronic device 100A. For example, the visual recognition area 41 is an area within a predetermined angle range in the left-right direction and the up-down direction from the front of the user U. In this case, the shape of the cut edge when a solid corresponding to the shape of the visual recognition area 41 is cut by a plane perpendicular to the front direction of the user U is rectangular. Note that the shape of the visual recognition area 41 may be determined so that the shape of the cut edge is other than rectangular (for example, circular or elliptical). The shape of the visual recognition area 41 (for example, the angle range in the left-right direction and the up-down direction from the front) can be specified by, for example, the following method.

[0095] In electronic device 100A, adjustment of the field of view (hereinafter, referred to as calibration) is performed in a predetermined procedure at a predetermined timing such as the initial startup. This calibration specifies the range that can be viewed by the user, and thereafter, virtual image 30 is displayed within this range. The shape of the viewable range specified by this calibration can be the shape of visible area 41.

[0096] Furthermore, the calibration is not limited to being performed according to the above-mentioned predetermined procedure, and may be performed automatically during normal operation of electronic device 100A. For example, if the user does not react to a display that should be reacted to, the range in which the display is being performed may be considered to be outside the range of the user's field of view, and the field of view (and the shape of visual recognition area 41) may be adjusted. Also, a trial display may be performed at a position that is determined to be outside the range of the field of view, and if the user reacts to the display, the range in which the display is being performed may be considered to be within the range of the user's field of view, and the field of view (and the shape of visual recognition area 41) may be adjusted.

[0097] The shape of the visible region 41 may be determined and fixed in advance, not based on the result of adjusting the field of view, at the time of shipment, etc. For example, the shape of the visible region 41 may be determined to be the maximum displayable range in terms of the optical design of the display unit 110A.

[0098] Virtual image 30 is generated in a state where a display position and orientation in space 40 are determined in response to a predetermined operation by the user. Electronic device 100A projects and displays, on visor 114, virtual image 30 whose display position is determined to be within visible region 41, among the generated virtual images 30. In FIG. 29, visible region 41 is indicated by a dashed line.

[0099] The display position and orientation of the virtual image 30 on the visor 114 are updated in real time according to the change in the user's viewing area 41. That is, the display position and orientation of the virtual image 30 change according to the change in the viewing area 41 so that the user recognizes that "the virtual image 30 is located in the space 40 at the set position and orientation." For example, when the user moves from the front side of the virtual image 30 to the back side, the shape (angle) of the virtual image 30 displayed according to this movement gradually changes. Also, when the user turns toward the direction of the virtual image 30 after going around to the back side of the virtual image 30, the back side of the virtual image 30 is displayed so that the back side of the virtual image 30 is visible. Also, according to the change in the viewing area 41, the virtual image 30 whose display position is out of the viewing area 41 is no longer displayed, and if there is a virtual image 30 whose display position is in the viewing area 41, the virtual image 30 is newly displayed.

[0100] 29, when a user holds out his / her hand (or finger) in front, the direction in which the hand is extended is detected by electronic device 100A, and virtual line 51 extending in that direction and pointer 52 are displayed on the display surface of visor 114 and visually recognized by the user. Pointer 52 is displayed at the intersection of virtual line 51 and virtual image 30. If virtual line 51 does not intersect with virtual image 30, pointer 52 may be displayed at the intersection of virtual line 51 and a wall surface or the like of space 40. If the distance between the user's hand and virtual image 30 is within a predetermined reference distance, display of virtual line 51 may be omitted, and pointer 52 may be directly displayed at a position according to the position of the user's fingertip.

[0101] By changing the direction in which the user extends his / her hand, the direction of the virtual line 51 and the position of the pointer 52 can be adjusted. By performing a predetermined gesture in a state in which the pointer 52 is adjusted so as to be positioned on a predetermined operation target (for example, the function bar 31, the window shape change button 32, the close button 33, etc.) included in the virtual image 30, the gesture is detected by the electronic device 100A, and a predetermined operation can be performed on the operation target. For example, by performing a gesture of selecting the operation target (for example, a gesture of pinching the fingertips) in a state in which the pointer 52 is aligned with the close button 33, the virtual image 30 can be closed (deleted). Also, by performing a gesture of selecting the operation target in a state in which the pointer 52 is aligned with the function bar 31, and performing a gesture of moving the hand back and forth and left and right while in the selected state, the virtual image 30 can be moved in the depth direction and left and right directions. The operations on the virtual image 30 are not limited to these.

[0102] In this manner, electronic device 100A of the present modification realizes a visual effect as if virtual image 30 exists in real space, and can accept a user's operation on virtual image 30 and reflect it in the display of virtual image 30. That is, electronic device 100A of the present modification provides MR (mixed reality).

[0103] Next, the functional configuration of the electronic device 100A will be described with reference to Fig. 31. The electronic device 100A has a display unit 110A, a sensor unit 130A, a storage 140, a communication interface 150, a SIM interface 160, a connection interface 170, a battery 180, and a controller 190. Each unit of the components shown in Fig. 31 except for the visor 114 of the display unit 110A is built into the main body unit 10a and operates with power supplied from a battery 180 also built into the main body unit 10a.

[0104] The controller 190 performs various control operations by reading and executing the program 141 stored in the storage 140. The controller 190 executes, for example, a visual recognition area detection process and a display control process by executing the program 141. Among these, the visual recognition area detection process is a process for detecting the visual recognition area 41 of the user in the space 40. Moreover, the display control process is a process for displaying, on the display unit 110A, the virtual images 30 whose positions in the space 40 are determined and whose positions are determined within the visual recognition area 41.

[0105] The storage 140 stores a program 141 executed by the controller 190, various setting data, etc. The program 141 is stored in the storage 140 in the form of a computer-readable program code.

[0106] The data stored in the storage 140 includes virtual image data 142 related to the virtual image 30. The virtual image data 142 includes data related to the display content of the virtual image 30 (e.g., image data), data on the display position, and data on the orientation.

[0107] The display unit 110A has a visor 114, a laser scanner 115, and an optical system that guides light output from the laser scanner 115 to the display surface of the visor 114. The laser scanner 115 irradiates the optical system with pulsed laser light, which is controlled to be turned on / off for each pixel, while scanning in a predetermined direction according to a control signal from the controller 190. The laser light incident on the optical system forms a display screen consisting of a two-dimensional pixel matrix on the display surface of the visor 114. The method of the laser scanner 115 is not particularly limited, but for example, a method of scanning the laser light by operating a mirror using MEMS (Micro Electro Mechanical Systems) can be used. The laser scanner 115 has three light-emitting units that emit laser light of, for example, RGB colors. The display unit 110A can perform color display by projecting light from these light-emitting units onto the visor 114.

[0108] The sensor unit 130A includes an acceleration sensor 131, an angular velocity sensor 132, a depth sensor 133, a camera 134, and an eye tracker 135. The sensor unit 130A may further include a sensor not shown in FIG.

[0109] The acceleration sensor 131 detects acceleration and outputs the detection result to the controller 190. From the detection result by the acceleration sensor 131, it is possible to detect translational motion of the electronic device 100A in three orthogonal axial directions.

[0110] Angular velocity sensor 132 (gyro sensor) detects angular velocity and outputs the detection result to controller 190. From the detection result by angular velocity sensor 132, the rotational motion of electronic device 100A can be detected.

[0111] The depth sensor 133 is an infrared camera that detects the distance to a subject by a ToF (Time of Flight) method, and outputs the distance detection result to the controller 190. The depth sensor 133 is provided on the front surface of the main body 10a so as to be able to capture an image of the visible area 41. By repeatedly performing measurements by the depth sensor 133 each time the position and orientation of the user change in the space 40 and synthesizing the results, it is possible to perform three-dimensional mapping of the entire space 40 (i.e., to obtain a three-dimensional structure).

[0112] Camera 134 captures an image of space 40 with a group of RGB imaging elements, obtains color image data as the captured image, and outputs the color image data to controller 190. Camera 134 is provided on the front surface of main body 10a so as to capture an image of visible area 41. The image output from camera 134 is used to detect the position and orientation of electronic device 100A, and is also used to transmit the image to an external device from communication interface 150 and display visible area 41 of the user of electronic device 100A on the external device.

[0113] The eye tracker 135 detects the user's line of sight and outputs the detection result to the controller 190. The method of detecting the line of sight is not particularly limited, but for example, a method can be used in which the reflection point of near-infrared light on the user's eye is photographed by an eye tracking camera, and the photographed result and the image photographed by the camera 134 are analyzed to identify the object that the user is viewing. A part of the configuration of the eye tracker 135 may be provided on the periphery of the visor 114, etc.

[0114] In the electronic device 100A having such a configuration, the controller 190 performs the following control operation.

[0115] The controller 190 performs three-dimensional mapping of the space 40 based on the distance data to the subject input from the depth sensor 133. The controller 190 repeats this three-dimensional mapping every time the position and orientation of the user changes, and updates the result each time. The controller 190 also performs three-dimensional mapping for each continuous space 40. Therefore, when the user moves between multiple rooms separated by walls or the like, the controller 190 recognizes each room as one space 40 and performs three-dimensional mapping for each room separately.

[0116] The controller 190 detects the visual recognition area 41 of the user in the space 40. In detail, the controller 190 specifies the position and orientation of the user (electronic device 100A) in the space 40 based on the detection results by the acceleration sensor 131, the angular velocity sensor 132, the depth sensor 133, the camera 134, and the eye tracker 135, and the accumulated results of the three-dimensional mapping. Then, the controller 190 detects (specifies) the visual recognition area 41 based on the specified position and orientation and the predetermined shape of the visual recognition area 41. The controller 190 also continuously detects the position and orientation of the user in real time, and updates the visual recognition area 41 in conjunction with changes in the position and orientation of the user. The detection of the visual recognition area 41 may be performed using some of the detection results by the acceleration sensor 131, the angular velocity sensor 132, the depth sensor 133, the camera 134, and the eye tracker 135.

[0117] The controller 190 generates virtual image data 142 related to the virtual image 30 in response to a user's operation. That is, when the controller 190 detects a predetermined operation (gesture) instructing the generation of the virtual image 30, the controller 190 specifies the display content (e.g., image data), display position, and orientation of the virtual image, and generates virtual image data 142 including data representing the results of these specifications.

[0118] The controller 190 causes the display unit 110A to display the virtual image 30, the display position of which is determined within the visual recognition area 41. The controller 190 specifies the virtual image 30, the display position of which is determined within the visual recognition area 41, based on the information on the display position included in the virtual image data 142, and generates image data of the display screen to be displayed on the display unit 110A, based on the positional relationship between the visual recognition area 41 at that time and the display position of the specified virtual image 30. The controller 190 causes the laser scanner 115 to perform a scanning operation based on this image data, and causes the display surface of the visor 114 to form a display screen including the specified virtual image 30. That is, the controller 190 causes the virtual image 30 to be displayed on the display surface of the visor 114 so that the virtual image 30 is visually recognized in the space 40 visually recognized through the visor 114. The controller 190 continuously performs this display control process, thereby updating the display content by the display unit 110A in real time in accordance with the user's movement (change in the visual recognition area 41). If the electronic device 100A is set to retain the virtual image data 142 even when the electronic device 100A is turned off, the next time the electronic device 100A is started up, the existing virtual image data 142 is loaded, and if there is a virtual image 30 located within the visible area 41, it is displayed on the display unit 110A.

[0119] In addition, the virtual image data 142 may be generated based on instruction data acquired from an external device via the communication interface 150, and the virtual image 30 may be displayed based on the virtual image data 142. Alternatively, the virtual image data 142 itself may be acquired from an external device via the communication interface 150, and the virtual image 30 may be displayed based on the virtual image data 142. For example, an image of the camera 134 of the electronic device 100A may be displayed on an external device operated by a remote instructor, and an instruction to display the virtual image 30 may be received from the external device, and the instructed virtual image 30 may be displayed on the display unit 110A of the electronic device 100A. This allows, for example, an operation in which the virtual image 30 showing the work content is displayed near a work target, and the remote instructor can instruct the user of the electronic device 100A to perform the work.

[0120] Controller 190 detects the position and orientation of the user's hand (and / or finger) based on the images captured by depth sensor 133 and camera 134, and displays virtual line 51 extending in the detected direction and pointer 52 on display unit 110A. Controller 190 also detects a gesture of the user's hand (and / or finger) based on the images captured by depth sensor 133 and camera 134, and executes processing according to the content of the detected gesture and the position of pointer 52 at that time.

[0121] Next, a description will be given of the operation of electronic device 100A. Fig. 32 is a flowchart showing a control procedure for network-related image display processing by electronic device 100A.

[0122] When the network-related image display process shown in FIG. 32 is started, the controller 190 controls the cellular interface 151 to perform a network search (step S201).

[0123] Next, the controller 190 obtains network-related information from the detected cellular communication network via the cellular interface 151 (step S202).

[0124] Next, controller 190 causes display 112 to display a network-related image showing predetermined information related to the detected cellular communication network based on the network-related information acquired in step S202 (step S203).

[0125] Next, the controller 190 detects the visual recognition area 41 based on the user's position and orientation (step S204).

[0126] Next, the controller 190 determines whether or not there is a virtual image 30 whose display position is determined within the detected visible region 41 (step S205).

[0127] In step S205, if it is determined that there is no virtual image 30 whose display position is determined within the detected visible region 41 (step S205; NO), the controller 190 advances the process to step S207.

[0128] Furthermore, in step S205, if it is determined that there is a virtual image 30 whose display position is determined within the detected visible area 41 (step S205; YES), the controller 190 causes the virtual image 30 to be displayed on the display unit 110A (step S206).

[0129] Next, the controller 190 determines whether or not an instruction to end the display operation by the electronic device 100A has been given (step S207).

[0130] In step S207, if it is determined that an instruction to end the display operation by electronic device 100A has not been issued (step S207; NO), controller 190 returns the process to step S201 and repeats the subsequent processes.

[0131] Furthermore, in step S207, if it is determined that an instruction to end the display operation by electronic device 100A has been given (step S207; YES), controller 190 ends the network-related image display process.

[0132] In the following, a specific display mode when the display control of the net-related image is performed in step S203 and the display control of the virtual image 30 is performed in step S206 will be described.

[0133] As one display mode, for example, as shown in Fig. 33, controller 190 causes display unit 110A to display virtual image 30, and also causes image I1 indicating the number of slices of the detected cellular communication network to be displayed as a network-related image in the upper left corner of display unit 110A. Specifically, controller 190 causes image I1 to be displayed in a fixed state in the upper left corner of display unit 110A so that the user and image I1 always face each other. In other words, even if the user goes around to the back side of virtual image 30 displayed on display unit 110A, image I1 is displayed in the upper left corner of display unit 110A.

[0134] Furthermore, similar to the electronic device 100 described above, the controller 190 may display an image I1 indicating the number of slices of the detected cellular communication network together with an image I2 indicating the communication quality with the detected cellular communication network (see FIG. 6).

[0135] The controller 190 may display an object displaying an image I1 indicating the number of slices of the detected cellular communication network, like the virtual image 30, in a state in which the display position and orientation in the space 40 are determined in response to a predetermined operation by the user, for example. In this case, the controller 190 displays an image I2 indicating the communication quality with the detected cellular communication network on a surface (second surface) opposite to a surface (first surface) on which the image I1 of the object is displayed. The image displayed on the second surface is not limited to the image I2 indicating the communication quality with the detected cellular communication network, and may be, for example, an application icon that uses a slice according to the type of service provided by the detected cellular communication network, or an image I19 indicating the type of service (slice) that can be provided by the detected cellular communication network, as shown in FIG. 34. Furthermore, the controller 190 may be configured to be able to switch between a first setting in which the object is displayed in a fixed state on the display unit 110A so that the first or second surface always faces the user, and a second setting in which the object is displayed in a position corresponding to the angle at which the user views it, depending on a predetermined user operation (e.g., a gesture operation, an operation of the physical button 113, a voice operation using the voice input unit 121, etc.).

[0136] [Modification 2] Next, a configuration of the display system 1 according to Modification 2 will be described. Modification 2 differs from Modification 1 in that an external information processing device 20 executes part of the processing executed by the controller 190 of the electronic device 100A in Modification 1. Below, the differences from Modification 1 will be described, and a description of the commonalities will be omitted.

[0137] 35, the display system 1 includes an electronic device 100A and an information processing device 20 (server) communicatively connected to the electronic device 100A. At least a part of the communication path between the electronic device 100A and the information processing device 20 may be wireless communication. The hardware configuration of the electronic device 100A may be the same as that of the first modification, but a processor for performing the same processing as that performed by the information processing device 20 may be omitted.

[0138] As shown in FIG. 36, the information processing device 20 includes a CPU 21, a RAM 22, a storage unit 23, an operation display unit 24, a communication unit 25, and the like, and these units are connected to each other via a bus .

[0139] The CPU 21 is a processor that performs various types of arithmetic processing and generally controls the operations of each unit of the information processing device 20. The CPU 21 reads and executes a program 231 stored in the storage unit 23 to perform various control operations.

[0140] The RAM 22 provides a working memory space for the CPU 21 and stores temporary data.

[0141] The storage unit 23 is a non-transitory recording medium readable by the CPU 21 as a computer. The storage unit 23 stores a program 231 executed by the CPU 21, various setting data, and the like. The program 231 is stored in the storage unit 23 in the form of a computer-readable program code. As the storage unit 23, for example, a non-volatile storage device such as an SSD equipped with a flash memory or an HDD (Hard Disk Drive) is used.

[0142] The operation display unit 24 includes a display device such as a liquid crystal display, and an input device such as a mouse and a keyboard. The operation display unit 24 displays various information such as the operation status and processing results of the display system 1 on the display device. Here, the operation status of the display system 1 may include real-time images captured by the camera 134 of the electronic device 100A. The operation display unit 24 also converts the user's input operation on the input device into an operation signal and outputs the operation signal to the CPU 21.

[0143] The communication unit 25 communicates with the electronic device 100A to transmit and receive data. For example, the communication unit 25 receives data including a part or all of the detection results by the sensor unit 130A of the electronic device 100A, and information related to a user's operation (gesture) detected by the electronic device 100A. The communication unit 25 may also be capable of communicating with devices other than the electronic device 100A.

[0144] In the display system 1 configured as above, the CPU 21 of the information processing device 20 executes at least a part of the processing executed by the controller 190 of the electronic device 100A in the first modification. For example, the CPU 21 may perform three-dimensional mapping of the space 40 based on the detection result by the depth sensor 133. The CPU 21 may also detect the user's visual recognition area 41 in the space 40 based on the detection result by each unit of the sensor unit 130A. The CPU 21 may also generate virtual image data 142 related to the virtual image 30 in response to the operation of the user of the electronic device 100A. The CPU 21 may also detect the position and orientation of the user's hand (and / or fingers) based on the image captured by the depth sensor 133 and the camera 134.

[0145] The above processing results by the CPU 21 are transmitted to the electronic device 100A via the communication unit 25. The controller 190 of the electronic device 100A operates each unit (e.g., the display unit 110A) of the electronic device 100A based on the received processing results. The CPU 21 may also transmit a control signal to the electronic device 100A to perform display control of the display unit 110A of the electronic device 100A.

[0146] In this way, by executing at least a part of the processing in the information processing device 20, the device configuration of the electronic device 100A can be simplified and the manufacturing cost can be reduced. In addition, by using a higher performance information processing device 20, various processes related to MR can be performed at high speed and with high accuracy. Therefore, it is possible to improve the accuracy of 3D mapping of the space 40, improve the display quality of the display unit 110A, and increase the response speed of the display unit 110A to the user's actions.

[0147] 〔others〕 The above embodiment is merely an example, and various modifications are possible. For example, in the above modification 1, the visor 114 having optical transparency is used to allow the user to view the real space, but the present invention is not limited to this. For example, the visor 114 having light blocking properties may be used to allow the user to view the image of the space 40 captured by the camera 134. That is, the controller 190 may display the image of the space 40 captured by the camera 134 and the virtual image 30 superimposed on the image of the space 40 on the display unit 110A. With such a configuration, MR in which the virtual image 30 is blended with the real space can also be realized.

[0148] Moreover, by using a pre-generated image of a virtual space instead of an image of a real space captured by the camera 134, a VR can be realized that allows the user to experience being in the virtual space. In this VR as well, the user's visual recognition area 41 is specified, and a virtual image 30 whose display position is determined to be within the visual recognition area 41 in the virtual space is displayed.

[0149] The electronic device 100A is not limited to the one having the ring-shaped main body 10a illustrated in Fig. 28, and may have any structure as long as it has a display unit that is visible to the user when worn. For example, it may have a structure that covers the entire head like a helmet. Also, it may have a frame that is hung on the ears like glasses, and various devices may be built into the frame.

[0150] Although an example in which a user's gesture is detected and accepted as an input operation has been described, the present invention is not limited to this. For example, an input operation may be accepted by a controller that the user holds in his / her hand or wears on his / her body.

[0151] In addition, in the above variant example 1, the explanation has been mainly given of network-related images specialized for the wearable terminal device that is the target of electronic device 100A, but various network-related images that can be displayed by electronic device 100 may also be displayed in electronic device 100A.

[0152] In addition, the specific details of the configurations and controls shown in the above embodiments can be appropriately changed without departing from the spirit of the present disclosure. Also, the configurations and controls shown in the above embodiments can be appropriately combined without departing from the spirit of the present disclosure. [Industrial Applicability]

[0153] The present disclosure can be used in electronic devices, programs, and display methods.

[0154] 1 Display System 100,100A electronic equipment 110 Touch panel display 110A display section 111 Touch Panel 112 Display 113 Physical Buttons 114 Visor 115 Laser Scanner 121 Audio input section 122 Audio output section 130 Sensors 130A Sensor section 131 Accelerometer 132 Angular velocity sensor 133 Depth Sensor 134 Camera 135 Eye Tracker 140 Storage 141 Programs 142 Virtual Image Data 150 Communication Interface 151 Cellular Interface 152 WLAN Interfaces 160 SIM interface 170 Connection Interface 180 Battery 190 Controller 20 Information processing device 21 CPU 22 RAM 23 Memory section 231 Programs 24 Operation display section 25 Communications Department 26 Bus 30 Virtual Images 31 Feature Bar 32 Window shape change button 33 Close button 40 space 41 Visibility Zone 51 Virtual Line 52 Pointer 210 Public Cellular Network 220 Local Cellular Network 300 Servers 400 Expansion Equipment 500 Electronic equipment 600 Electronic equipment U User

Claims

1. A display unit; At least one processor; Equipped with The at least one processor: acquiring, via a communication interface, an identifier assigned to each of a plurality of slices from a communication network logically divided into a plurality of slices according to a service type; The electronic device causes the display unit to display a first image showing predetermined information regarding the communication network based on the acquired identifier.

2. The electronic device according to claim 1 , wherein the first image is an image indicating a number of slices corresponding to the communication network.

3. The electronic device according to claim 1 , wherein the first image is an image showing a characteristic of the communication network.

4. The display unit includes a light-transmitting display member, The electronic device according to any one of claims 1 to 3, wherein the at least one processor causes the first image to be displayed on a display surface of the display member so that the first image is viewed in a space viewed through the display member.

5. Equipped with a camera to capture the space, The electronic device according to any one of claims 1 to 3, wherein the at least one processor causes the display unit to display an image of the space captured by the camera and the first image superimposed on the image of the space.

6. The at least one processor: displaying a second image, different from the first image and positioned in the space, on the display unit; displaying the first image in a fixed state at a predetermined position on the display unit so that the user and the first image are always facing each other; displaying the second image in a position corresponding to an angle at which the user views the second image; 6. The electronic device according to claim 4 or 5.

7. The at least one processor: displaying an object image on the display unit, the object image having a first surface and a second surface located in the space; displaying the first image on the first surface; displaying a third image different from the first image on the second surface; 6. The electronic device according to claim 4 or 5.

8. 8. The electronic device of claim 7, wherein the at least one processor switches, based on a predetermined operation, between a first setting in which the object image is displayed in a fixed state on the display unit so that the first surface or the second surface always faces the user, and a second setting in which the object image is displayed in a posture corresponding to the angle at which the user views it.

9. The electronic device according to claim 1 , wherein the at least one processor causes the display unit to display the first image together with a fourth image indicating a communication quality with the communication network.

10. The electronic device according to claim 1 , wherein the at least one processor causes the first image to be displayed based on a predetermined operation.

11. The at least one processor: displaying a third image different from the first image on the display unit; displaying the first image based on a predetermined operation related to the third image displayed on the display unit; The electronic device according to claim 10.

12. The electronic device according to claim 2 , wherein the number of slices satisfies a predetermined condition.

13. The electronic device according to claim 12 , wherein the number of slices that satisfies the predetermined condition is a number of slices that have been used by the electronic device itself.

14. The electronic device according to claim 12 , wherein the number of slices that satisfies the predetermined condition is the number of slices that satisfies a predetermined communication volume or communication frequency.

15. The electronic device according to claim 12 , wherein the number of slices that satisfies the predetermined condition is a number of slices that satisfies a predetermined communication quality.

16. The electronic device according to claim 1 , wherein the at least one processor causes the display unit to display a fifth image indicating the service type.

17. The electronic device of claim 16 , wherein the at least one processor causes the fifth image to be displayed based on a predetermined operation related to the first image displayed on the display unit.

18. The at least one processor: displaying an object image on the display unit, the object image having a first surface and a second surface located in the space; displaying the first image on the first surface; displaying a fifth image indicating the service type on the second surface; 6. The electronic device according to claim 4 or 5.

19. The electronic device described in claim 16 or 17, wherein the at least one processor controls on / off the use of communication via a slice corresponding to one of the service types shown in the fifth image based on a user operation of selecting the one of the service types.

20. A notification section is provided, The at least one processor: determining whether or not there is a change in the number of slices corresponding to the communication network based on the identifier acquired via the communication interface; When there is a change in the number of slices corresponding to the communication network, the change is notified via the notifying unit. The electronic device according to any one of claims 1 to 19.

21. A notification section is provided, The at least one processor: determining whether a predetermined service type is included in the communication network based on the identifier acquired via the communication interface; If the communication network includes a predetermined service type, notifying the same via the notification unit. The electronic device according to any one of claims 1 to 20.

22. The electronic device according to claim 21 , wherein the predetermined service type is a service type that is uniquely recommended for the electronic device itself.

23. The electronic device according to claim 21 , wherein the predetermined service type is a service type that is uniquely recommended for at least one application executed on the electronic device.

24. The at least one processor: When the communication network is a local cellular communication network, acquiring owner information indicating an owner of a license corresponding to the local cellular communication network via the communication interface; displaying a sixth image indicating the owner on the display unit based on the owner information; The electronic device according to any one of claims 1 to 23.

25. The electronic device of claim 24, wherein the at least one processor causes a guide image enabling access to the owner to be displayed on the display based on a predetermined operation related to the sixth image displayed on the display.

26. The at least one processor: When the communication network is a local cellular communication network, communication area information indicating a communication area of ​​the local cellular communication network is acquired via the communication interface; displaying a seventh image showing the communication area on the display unit based on the communication area information; The electronic device according to any one of claims 1 to 25.

27. 27. The electronic device of claim 26, wherein the at least one processor causes the display unit to display a map image showing the communication area based on a predetermined operation related to the seventh image displayed on the display unit.

28. A computer provided in an electronic device having a display unit, A process of acquiring, via a communication interface, an identifier assigned to each of a plurality of slices from a communication network logically divided into a plurality of slices according to a service type; A process of displaying, on the display unit, an image showing predetermined information related to the communication network based on the acquired identifier; A program that executes the following.

29. A display method for an electronic device having a display unit, comprising: acquiring, via a communication interface, an identifier assigned to each of a plurality of slices from a communication network logically divided into a plurality of slices according to a service type; A display method, comprising: displaying, on the display unit, an image showing predetermined information regarding the communication network based on the acquired identifier.

Images