Electronic device and program

Abstract

An electronic device according to the present invention comprises a display unit and at least one processor. The at least one processor acquires, via a communication interface from a communication network that is theoretically divided into a plurality of slices according to service types, respective identifiers that are assigned to the plurality of slices. The at least one processor displays on the display unit an image that indicates predetermined information pertaining to the communication network, on the basis of the identifiers which have been acquired.

Description

Technical Field

[0001] The present disclosure relates to electronic devices and program to the virus .

Background Art

[0002] In recent years, cellular communication systems compliant with the fifth-generation (5G) cellular communication standard have attracted attention. In such a cellular communication system, it is assumed that not only a public cellular communication network operated by a communications carrier but also a local cellular communication network operated by a general enterprise, organization, or individual will be constructed. Note that the local cellular communication network may be referred to as a private cellular communication network or a non-public cellular communication network.

[0003] The local cellular communication network can be flexibly constructed and used by various entities according to regional needs and individual needs of industrial fields. In addition, the local cellular communication network is considered to have a lower congestion level and a better propagation environment than the public cellular communication network, and can provide good services to electronic devices.

[0004] In a situation where a public cellular communication network and a local cellular communication network coexist, an electronic device will have an option to select a connection destination from these two types of cellular communication networks. As a general method, an electronic device preferentially selects a home network, which is a cellular communication network with which the device has a contract, or selects a cellular communication network that provides the highest received power in the device.

Prior Art Documents

Non-Patent Documents

[0005]

Non-Patent Document 1

Summary of the Invention

[0006] An electronic device according to one aspect of the present disclosure includes a display unit including a display member having light transmissibility, and at least one processor. The at least one processor acquires, via a communication interface, identifiers assigned to each of a plurality of slices that are theoretically divided from a communication network according to service types. Based on the acquired identifiers, the at least one processor causes a first image indicating predetermined information about the communication network to be visually recognized in a space visually recognized through the display member, and causes the first image to be displayed on a display surface of the display member. The at least one processor causes a second image located in the space, which is different from the first image, to be displayed on the display surface of the display member. The at least one processor causes the first image to be displayed in a state of being fixed at a predetermined position on the display surface of the display member so that the user and the first image always face each other. The at least one processor causes the second image to be displayed in a posture according to an angle when the user visually recognizes it 。

[0007] Also, a program according to one aspect of the present disclosure causes a computer provided in an electronic device including a display unit having a light-transmissive display member to acquire, via a communication interface, identifiers assigned to each of a plurality of slices that are theoretically divided from a communication network according to service types. The program causes the computer to display, on a display surface of the display member, a first image indicating predetermined information regarding the communication network in a space visible through the display member based on the acquired identifiers. The program causes the computer to display, on the display surface of the display member, a second image located in the space that is different from the first image. The program causes the computer to display the first image in a state fixed at a predetermined position on the display surface of the display member such that the user and the first image always face each other. The program causes the computer to display the second image in a posture corresponding to an angle at which the user views it 。

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

Figure 27

Figure 28

Figure 29

Figure 30

Figure 31

Figure 32

Figure 33

Figure 34

Figure 35

Figure 36

Mode for Carrying Out the Invention

[0010] When a local cellular communication network is constructed for the purpose of providing a specific service, the type of service provided by the local cellular communication network may be limited. On the other hand, although a public cellular communication network provides general-purpose services, it may not provide special services corresponding to regional needs or individual needs of industrial fields.

[0011] Therefore, in a situation where a public cellular communication network and a local cellular communication network coexist, if the general connection destination selection method as described above is applied, a situation may occur where the service that the user of the electronic device wants to use is not provided in the connection destination cellular communication network.

[0012] Therefore, an object of the present disclosure is to make it easier to appropriately select a connection destination cellular communication network in a situation where a public cellular communication network and a local cellular communication network coexist.

[0013] Hereinafter, embodiments will be described with reference to the drawings. In the description of the drawings, the same or similar parts are denoted by the same or similar reference numerals.

[0014] 〔Configuration of Communication System〕 First, the configuration of a communication system according to an embodiment will be described. FIG. 1 is a diagram showing the configuration of a communication system according to an embodiment. The communication system according to an embodiment is a cellular communication system compliant with the 3GPP standard of the fifth generation (5G).

[0015] As shown in FIG. 1, the communication system according to an embodiment includes an electronic device 100, a public cellular communication network 210, a local cellular communication network 220, and a server 300.

[0016] The electronic device 100 is a device having a function of performing cellular communication with a cellular communication network. The electronic device 100 may be any device having a function of performing cellular communication and having a UI (User Interface). For example, the electronic device 100 is a smartphone, a tablet terminal, a notebook PC (Personal Computer), a wearable terminal device, or a mobile router. In the 3GPP standard, the electronic device 100 is called a UE (User Equipment).

[0017] The public cellular communication network 210 is a cellular communication network operated by a communication carrier. The public cellular communication network 210 may be called public 5G. A license is issued to the communication carrier operating the public cellular communication network 210 on a national scale.

[0018] The local cellular communication network 220 is a cellular communication network that can be flexibly constructed and utilized by various entities according to local needs and individual needs in industrial fields. The local cellular communication network 220 may be called local 5G. For example, general enterprises, organizations, or individuals can operate the local cellular communication network 220 by receiving frequency allocation. The license for the local cellular communication network 220 is issued only for local areas such as within the facilities of general enterprises.

[0019] The public cellular communication network 210 and the local cellular communication network 220 comply with the 5G 3GPP standard. The public cellular communication network 210 has a base station 211, and the local cellular communication network 220 has a base station 221. In FIG. 1, there is only one base station included in each cellular communication network, but actually, each cellular communication network may include a plurality of base stations. In the 5G 3GPP standard, the base station is called a gNB. The base station constitutes an NG-RAN (Next Generation Radio Access Network), which is a 5G radio access network.

[0020] Each of the public cellular communication network 210 and the local cellular communication network 220 further has a 5GC (5G Core Network), which is a 5G core network. In 5G, it is assumed that various electronic devices are connected to the cellular communication network, and it is necessary to support various services with different requirement conditions such as high speed, large capacity, high reliability, and low latency. For this reason, the 5GC is theoretically divided into a plurality of slices according to different services (service requirement conditions).

[0021] Here, an identifier called S-NSSAI (Single-Network Slice Selection Assistance Information) is assigned to each slice. Each slice is associated with one service type (SST). As service types, eMBB (high speed, large capacity), mIoT (massive connection, power saving, low cost), and URLLC (low latency, high reliability) are defined in the standard, but service types not defined in the standard can also be used.

[0022] When the local cellular communication network 220 is constructed for the purpose of providing a specific service, the type of service (SST) provided by the local cellular communication network 220 may be limited. On the other hand, although the public cellular communication network 210 provides general-purpose services, it may not provide special services according to regional needs or individual needs of industrial fields. Note that "the service provided by the cellular communication network" can also be considered as "the function supported by the cellular communication network".

[0023] The server 300 communicates with the electronic device 100 via the public cellular communication network 210 or the local cellular communication network 220. The server 300 may be a server for managing the local cellular communication network 220.

[0024] Note that at least one electronic device 500 may be connected to the electronic device 100 by wire or wirelessly. The electronic device 500 establishes, for example, a WLAN (Wireless Local Area Network) connection with the electronic device 100 and communicates with the cellular communication network to which the electronic device 100 is connected via the electronic device 100. Thereby, even when the electronic device 500 does not have a cellular communication function, the electronic device 500 can communicate with the cellular communication network via the electronic device 100.

[0025] An expansion device 400 may be connected to the electronic device 100 by wire or wirelessly. The expansion device 400 establishes, for example, a USB (Universal Serial Bus) connection with the electronic device 100. The expansion device 400 may have a function of supplying power to the electronic device 100. The expansion device 400 may be a cradle.

[0026] At least one electronic device 600 may be connected to the expansion device 400 either wired or wirelessly. The electronic device 600 establishes, for example, a WLAN connection with the expansion device 400 and communicates with the cellular communication network to which the electronic device 100 is connected via the expansion device 400 and the electronic device 100. Thereby, even when the electronic device 600 does not have a cellular communication function, the electronic device 600 can communicate with the cellular communication network via the expansion device 400 and the electronic device 100.

[0027] 〔Configuration of Electronic Device〕 Next, the configuration of the electronic device 100 according to an embodiment will be described. As shown in FIG. 1, the electronic device 100 includes a touch panel display 110, at least one physical button 113, a microphone 121a, and a speaker 122a. However, in FIGS. 1 and 2, the configurations shown by the dashed lines are not essential.

[0028] The touch panel display 110 is provided such that its display surface is exposed from the housing 101 of the electronic device 100. The touch panel display 110 includes a touch panel 111 and a display 112.

[0029] The touch panel 111 receives operation inputs (touch inputs) to the electronic device 100. Examples of methods for detecting touches include the resistive film method and the capacitance method, but any method may be used. The display 112 outputs video.

[0030] The display 112 displays objects such as characters (including symbols), images, and graphics on the screen. The display 112 is, for example, a liquid crystal display or an organic EL (Electro Luminescence) display. In the touch panel display 110, the display 112 is provided so as to overlap the touch panel 111, and the display area of the display 112 overlaps the touch panel 111.

[0031] The physical button 113 receives an operation input (press) to the electronic device 100. The physical button 113 is, for example, a home button, a power button, a voice adjustment button, or the like.

[0032] The microphone 121a receives a voice input to the electronic device 100. Also, the microphone 121a collects ambient voice.

[0033] The speaker 122a performs voice output. Also, the speaker 122a outputs voice such as telephone voice and information of various programs by voice.

[0034] FIG. 2 is a diagram showing the configuration of the electronic device 100 according to an embodiment.

[0035] As shown in FIG. 2, the electronic device 100 includes a touch panel 111, a display 112, a physical button 113, a voice input unit 121, a voice output unit 122, a sensor 130, a storage 140, a communication interface 150, a SIM (Subscriber Identity Module) interface 160, a connection interface 170, a battery 180, and a controller 190.

[0036] The touch panel 111 inputs a signal corresponding to a touch operation to the controller 190. The display 112 displays objects such as characters, images, and figures on the screen based on the signal input from the controller 190.

[0037] The voice input unit 121 inputs a signal corresponding to the received voice to the controller 190. The voice input unit 121 may be the microphone 121a shown in FIG. 1, or may be an input interface to which an external microphone can be connected. The external microphone may be provided in the extension device 400.

[0038] The voice output unit 122 outputs voice based on the signal input from the controller 190. The voice output unit 122 may be the speaker 122a shown in FIG. 1, or may be an output interface to which an external speaker can be connected. The external speaker may be provided in the expansion device 400.

[0039] The sensor 130 detects various physical quantities and data, and outputs the detection results to the controller 190. For example, the sensor 130 includes a position sensor, an acceleration sensor, and a temperature sensor. The position sensor detects the position of the own device and outputs position data to the controller 190. The position sensor may include a GNSS (Global Navigation Satellite System) receiver. The GNSS receiver performs positioning based on the GNSS satellite signal and outputs GNSS position data indicating the geographical position (latitude / longitude) of the own device to the controller 190. The acceleration sensor detects the acceleration applied to the own device and outputs acceleration data to the controller 190. The acceleration sensor may be a multi-axis acceleration sensor including a plurality of acceleration sensors. The temperature sensor detects the temperature and outputs temperature data to the controller 190. At least one of these sensors may be provided in an external device (for example, the expansion device 400).

[0040] The storage 140 includes at least one memory for storing programs and data. The storage 140 is also used as a work area for temporarily storing the processing results of the controller 190. The storage 140 may include any non-transitory storage medium such as a semiconductor storage medium and a magnetic storage medium. The storage 140 may include a plurality of types of storage media. The storage 140 may include a combination of a portable storage medium such as a memory card, an optical disk, or a magneto-optical disk, and a reading device for the storage medium. The storage 140 may include a storage device used as a temporary storage area such as a RAM (Random Access Memory).

[0041] The communication interface 150 communicates wirelessly. The communication interface 150 includes a cellular interface 151 and a WLAN interface 152. The cellular interface 151 is configured, for example, in accordance with the 5G cellular communication standard. The WLAN interface 152 is configured, for example, in accordance with the IEEE802.11 standard.

[0042] A SIM interface 160 has a SIM (or UIM (User Identity Module)) attached thereto. The SIM interface 160 may be able to take in and remove the SIM. When the SIM interface 160 receives a read or write of information from the controller 190, it reads the information recorded on the SIM and writes to the SIM. The SIM may be an embedded eSIM (Embedded SIM). The SIM may be provided by a communication carrier or obtained by other means.

[0043] In one embodiment, a SIM for the public cellular communication network 210 and a SIM for the local cellular communication network 220 may be prepared separately. When using the SIM for the public cellular communication network 210, the controller 190 uses the public cellular communication network 210 as the home network and the local cellular communication network 220 as the roaming network. On the other hand, when using the SIM for the local cellular communication network 220, the controller 190 uses the local cellular communication network 220 as the home network and the public cellular communication network 210 as the roaming network. Alternatively, both the SIM for the public cellular communication network 210 and the SIM for the local cellular communication network 220 may be attachable to the SIM interface 160.

[0044] The connection interface 170 is an interface that is electrically connected to the expansion device 400. The connection interface 170 may be any interface as long as it is electrically connected to the expansion device 400, and is, for example, a USB interface.

[0045] The battery 180 stores electric power for driving the own device. The battery 180 may be any type of battery as long as it is a secondary battery, for example, a lithium-ion battery.

[0046] The controller 190 is an arithmetic processing unit. The arithmetic processing unit includes, for example, a CPU (Central Processing Unit), an SoC (System-on-Chip), an MCU (Micro Control Unit), an FPGA (Field-Programmable Gate Array), and a coprocessor, but is not limited thereto. Further, the controller 190 includes a GPU (Graphics Processing Unit), a VRAM (Video RAM), etc., and draws various images on the display 112. The controller 190 may be composed of a plurality of arithmetic processing units, and various controls may be executed by the cooperation of the plurality of arithmetic processing units.

[0047] The controller 190 comprehensively controls the operation of the electronic device 100 to realize various functions. The controller 190 executes various controls based on operation inputs detected by the touch panel 111 and / or the physical buttons 113. The controller 190 may perform an output corresponding to the input operation signal by the voice output unit 122, the display 112, or the like.

[0048] 〔Operation of the electronic device〕 Next, the operation of the electronic device 100 according to one embodiment will be described. FIG. 3 is a flowchart showing a control procedure by the controller 190 for gateway-related image display processing according to one aspect of the present disclosure.

[0049] When the gateway-related image display process shown in FIG. 3 is started, the controller 190 controls the cellular interface 151 to perform a network search (step S101). The network search refers to an operation of detecting a connectable cellular communication network. For example, the cellular interface 151 attempts to receive wireless signals (e.g., synchronization signals and reference signals) transmitted by base stations of each cellular communication network (i.e., the public cellular communication network 210 and the local cellular communication network 220). The controller 190 measures the reception power of the wireless signal, and when the reception power exceeds a threshold value, it determines that it is possible to connect to the cellular communication network corresponding to this reception power. Hereinafter, the cellular communication network detected by the network search is referred to as the "detected cellular communication network".

[0050] As the detected cellular communication network, there are three patterns: (1) only the public cellular communication network 210, (2) only the local cellular communication network 220, or (3) both the public cellular communication network 210 and the local cellular communication network 220. Hereinafter, the pattern in which the detected cellular communication network is only the public cellular communication network 210 or only the local cellular communication network 220 will be mainly described, but the detected cellular communication network may be both the public cellular communication network 210 and the local cellular communication network 220.

[0051] Next, the controller 190 acquires gateway-related information from the detected cellular communication network via the cellular interface 151 (step S102). The gateway-related information includes, for example, the following information (a) to (c).

[0052] (a) Network identifier The network identifier is an identifier that identifies the detected cellular communication network.

[0053] (b) Information indicating the type of service provided The provided service type is the type of service provided by the detected cellular communication network to the electronic device 100. As described above, each of the public cellular communication network 210 and the local cellular communication network 220 is theoretically divided into a plurality of slices according to different service types (see FIG. 4). An identifier called S-NSSAI is assigned to each slice. The controller 190 acquires the S-NSSAI of each slice of the detected cellular communication network as information indicating the provided service type of this detected cellular communication network. The controller 190 may also acquire information other than the S-NSSAI as information indicating the provided service type.

[0054] (c) Information indicating the network type The network type is the type indicating whether the detected cellular communication network is the public cellular communication network 210 or the local cellular communication network 220.

[0055] Also, the controller 190 may acquire the received power measured during the network search in step S101 as network-related information.

[0056] Next, the controller 190 causes the display 112 to display a network-related image indicating predetermined information regarding the detected cellular communication network based on the network-related information acquired in step S102 (step S103).

[0057] Next, the controller 190 determines whether an instruction to end the display operation by the electronic device 100 has been given (step S104).

[0058] In step S104, if it is determined that an instruction to end the display operation by the electronic device 100 has not been given (step S104; NO), the controller 190 returns the process to step S101 and repeats the subsequent processes.

[0059] Also, in step S104, if it is determined that an instruction to end the display operation by the electronic device 100 has been given (step S104; YES), the controller 190 ends the network-related image display process.

[0060] Hereinafter, a specific display mode when the display control of the network-related image in step S103 is performed will be described.

[0061] As one display mode, for example, as shown in FIG. 5, the controller 190 causes an image I1 (for example, an image of a circled number) indicating the number of slices (for example, 4) of the detected cellular communication network to be displayed in the upper part 112A (so-called pictorial area) of the display 112 as a network-related image.

[0062] Also, as shown in FIG. 6, the controller 190 may display the image I1 indicating the number of slices of the detected cellular communication network together with the image I2 indicating the communication quality with the detected cellular communication network. At this time, for example, when a predetermined operation for switching the communication mode to either a communication mode using 4G or a communication mode using 5G is performed, as shown in FIG. 7, the network-related image is switched to and displayed as either a network-related image I3 corresponding to 4G (slice-incompatible communication network) or network-related images I1 and I2 corresponding to 5G (slice-compatible communication network). Note that the controller 190 may display the image I1 so as to be superimposed on the image I2 (for example, FIG. 6), may display the image I1 and the image I2 so as to be separated from each other, or may display the image I2 so as to be superimposed on the image I1.

[0063] Also, as shown in FIG. 8, the controller 190 usually displays only the image I2 indicating the communication quality with the detected cellular communication network, and when a predetermined operation via the touch panel 111 is performed, the image I1 indicating the number of slices of the detected cellular communication network may be displayed together with the image I2. Note that the above-mentioned predetermined operation is not limited to a predetermined operation via the touch panel 111, and may be a predetermined operation via the physical button 113 or the voice input unit 121.

[0064] Also, as shown in FIG. 9, the controller 190 may normally display only the image I2 indicating the communication quality with the detection cellular communication network, and when a predetermined operation corresponding to the image I2 is performed, display the image I1 indicating the number of slices of the detection cellular communication network. Here, the predetermined operation corresponding to the image I2 is, for example, a touch operation on the image I2 via the touch panel 111, a cursor designation operation on the image I2 via the physical button 113, a predetermined voice operation via the voice input unit 121, and the like. Note that after the display of the image I1 indicating the number of slices of the detection cellular communication network, the display may return to the image I2 when a predetermined time has elapsed (or a predetermined operation has been performed). Note that the normally displayed image is not limited to the image I2 indicating the communication quality with the detection cellular communication network, and may be, for example, an application icon or the like that uses a slice corresponding to the type of service provided by the detection cellular communication network.

[0065] Also, as shown in FIG. 10, the controller 190 may display an image I4 indicating the number of slices (for example, 4) of the detection cellular communication network that satisfy a predetermined condition (for example, 2 / 4) as a network-related image. The number of slices that satisfy the predetermined condition is, for example, the number of slices (number of slices) with usage records by the electronic device 100. Note that the number of slices that satisfy the predetermined condition may also be, for example, the number of slices that satisfy a predetermined communication volume or communication frequency, or the number of slices that satisfy a predetermined communication quality. The image indicating the number of slices that satisfy the predetermined condition among the number of slices of the detection cellular communication network is not limited to the image I4 shown in FIG. 10, and as shown in FIG. 11, an image I5 with an underline applied to the number of slices (for example, 2) that satisfy the predetermined condition for the purpose of distinguishing from the number of slices of the detection cellular communication network may be displayed.

[0066] Further, as shown in FIG. 12, the controller 190 may display an image I1 indicating the number of slices (e.g., 4) of the detected cellular communication network as a network-related image, and may display an image I6 indicating the service type provided by the detected cellular communication network to the electronic device 100 around the image I1. A number corresponding to the service type (see FIG. 4) is displayed on the image I6 indicating the service type. Based on a predetermined operation corresponding to the image I6, it is possible to turn on and off the use of communication via the slice corresponding to the corresponding service type. Note that the display content of the image I6 indicating the service type may be any content that can identify the service type, for example, an identifier (S-NSSAI) of the corresponding slice, an icon set for the corresponding service type, or the like.

[0067] Here, when the image I6 indicating the service type provided by the detected cellular communication network to the electronic device 100 is displayed around the image I1 as described above, the controller 190, as shown in FIG. 4, based on the information indicating the provided service type obtained in step S102 of the network-related image display process (see FIG. 3), it is assumed that the provided service type is specified from among the following candidates for service types No. 1 to No. 8. When there are a plurality of detected cellular communication networks, the controller 190 specifies the provided service type for each detected cellular communication network.

[0068] No.1: Data communication (Internet communication) The controller 190 determines whether it is possible to communicate with a specific device or server via the detected cellular communication network, or whether a certain number of UL / DL packets are being transmitted and received via the detected cellular communication network per unit time. When it is determined that communication with a specific device or server is possible via the detected cellular communication network, the controller 190 specifies data communication as one of the service types provided by the detected cellular communication network. Alternatively, when it is determined that a certain number of uplink / downlink packets are being transmitted and received via the detected cellular communication network per unit time, the controller 190 specifies data communication as one of the service types provided by the detected cellular communication network.

[0069] No.2: Voice communication The controller 190 determines whether it can communicate with the SIP server via the detected cellular communication network or determines the line (CS) state of the detected cellular communication network. When it is determined that communication with the SIP server via the detected cellular communication network is possible, the controller 190 identifies voice communication as one of the service types provided by the detected cellular communication network. Alternatively, when it is determined that the line (CS) of the detected cellular communication network is available, the controller 190 identifies voice communication as one of the service types provided by the detected cellular communication network.

[0070] No.3: Low Power Consumption The controller 190 determines whether a low power consumption function has been set for the electronic device 100 from the detected cellular communication network. The low power consumption function is set for the electronic device 100 by, for example, an RRC Reconfiguration message, which is a type of RRC message. When it is determined that the low power consumption function has been set for the electronic device 100 from the detected cellular communication network, the controller 190 identifies the low power consumption function as one of the service types provided by the detected cellular communication network.

[0071] No.4: Overheating Assistance The controller 190 determines whether an overheating assistance function has been set for the electronic device 100 from the detected cellular communication network. The overheating assistance function is set for the electronic device 100 by, for example, an RRC Reconfiguration message, which is a type of RRC message. When it is determined that the overheating assistance function has been set for the electronic device 100 from the detected cellular communication network, the controller 190 identifies the overheating assistance function as one of the service types provided by the detected cellular communication network.

[0072] No.5: Enhanced Mobile Broadband (eMBB) The controller 190 determines whether the SST (slice / service type) of the S-NSSAI obtained from the detected cellular communication network includes the value "1" assigned to eMBB in the standard. The S-NSSAI is notified to the electronic device 100, for example, by a Registration Accept message which is a type of NAS (Non-Access Stratum) message. When the SST of the SNSSAI obtained by the controller 190 from the detected cellular communication network includes the value "1" assigned to eMBB in the standard, the controller 190 identifies eMBB as one of the service types provided by the detected cellular communication network.

[0073] No.6: High reliability, low latency (URLLC) The controller 190 determines whether the SST of the S-NSSAI obtained from the detected cellular communication network includes the value "2" assigned to URLLC in the standard. When the SST of the S-NSSAI obtained by the controller 190 from the detected cellular communication network includes the value "2" assigned to URLLC in the standard, the controller 190 identifies URLLC as one of the service types provided by the detected cellular communication network.

[0074] No.7: Multi-connection (mIoT) The controller 190 determines whether the SST of the S-NSSAI obtained from the detected cellular communication network includes the value "2" assigned to mIoT in the standard. When the SST of the S-NSSAI obtained by the controller 190 from the detected cellular communication network includes the value "2" assigned to mIoT in the standard, the controller 190 identifies mIoT as one of the service types provided by the detected cellular communication network.

[0075] No.8: Other services The controller 190 determines whether the SST of the S-NSSAI obtained from the detected cellular communication network includes a value assigned to each service according to its own specification. For example, SST "x" is assigned to Business, SST "y" is assigned to Factory, SST "z" is assigned to Transport, SST "xx" is assigned to Airport, SST "yy" is assigned to Drone, and SST "zz" is assigned to Train. When the SST of the S-NSSAI obtained from the detected cellular communication network includes a value assigned according to its own specification, the controller 190 identifies the service type corresponding to this value as the service type provided by the detected cellular communication network.

[0076] Also, as shown in FIG. 6, the controller 190 usually displays an image I2 indicating the communication quality with the detected cellular communication network together with an image I1 indicating the number of slices (e.g., 4) of the detected cellular communication network. When a predetermined operation corresponding to the image I1 is performed, as shown in FIG. 12, an image I6 indicating the service type provided by the detected cellular communication network to the electronic device 100 centered around the image I1 may be displayed around the image I1. Here, the predetermined operation corresponding to the image I1 is, for example, a touch operation on the image I1 via the touch panel 111, a cursor designation operation on the image I1 via the physical button 113, a predetermined voice operation via the voice input unit 121, and the like.

[0077] Also, as shown in FIG. 13, when the user moves from Area1 to Area2, the controller 190 may determine whether there is a change in the number of slices of the detected cellular communication network based on the gateway-related information obtained in step S102 of the gateway-related image display process (see FIG. 3), and if there is a change in the number of slices, notify the fact. Specifically, as shown in FIG. 14, for example, when the number of slices of the detected cellular communication network increases from 4 to 5 as the user moves from Area1 to Area2, the controller 190 may display an image I7 indicating that the number of slices of the detected cellular communication network has increased (for example, an image in which the characters "add" are circled). On the other hand, when the number of slices of the detected cellular communication network decreases from 4 to, for example, 3 as the user moves from Area1 to Area2, the controller 190 may display an image I8 indicating that the number of slices of the detected cellular communication network has decreased (for example, an image in which the characters "remove" are circled).

[0078] In addition, when the number of slices of the detected cellular communication network increases, the controller 190 may change the display color of the image I2 indicating the communication quality with the detected cellular communication network to a preset display color (for example, red), or change it to a preset display mode (for example, fast blinking display) to notify that the number of slices of the detected cellular communication network has increased. On the other hand, when the number of slices of the detected cellular communication network decreases, the controller 190 may change the display color of the image I2 indicating the communication quality with the detected cellular communication network to a preset display color (for example, blue), or change it to a preset display mode (for example, slow blinking display) to notify that the number of slices of the detected cellular communication network has decreased. Further, the notification method regarding the increase or decrease in the number of slices of the detected cellular communication network is not limited to the above method. For example, voice or the like indicating that there has been an increase or decrease in the number of slices of the detected cellular communication network may be output from the voice output unit 122. Also, it may be configured to notify that there has been an increase or decrease in the number of slices of the detected cellular communication network by causing a light emitting unit (not shown) provided in the electronic device 100 to emit light. Further, it may be configured to notify that there has been an increase or decrease in the number of slices of the detected cellular communication network by activating the vibration function provided in the electronic device 100.

[0079] Also, when a predetermined operation corresponding to an image I7 (see FIG. 14) indicating that the number of slices of the detected cellular communication network has increased is performed, as shown in FIG. 15, an image I6 indicating the service type provided by the detected cellular communication network to the electronic device 100 may be displayed around the image I1 indicating the number of slices of the detected cellular communication network (for example, 4 ⇒ 5). At this time, the character "New" may be displayed on the image I6 indicating the service type corresponding to the newly available slice (for example, the service type of No. 5). Here, the image I6 is displayed to make it easy for the user to notice what the service type corresponding to the newly available slice is. The controller 190 may, for example, make it easier for the user to notice by changing the display mode of the image indicating the service type corresponding to the newly available slice (changing the display mode means, for example, blinking the image indicating the service type corresponding to the newly available slice at a predetermined first speed, changing the color of the image to a predetermined first color, or moving the display position of the image to a predetermined first position, etc.). On the other hand, when a predetermined operation corresponding to an image I8 (see FIG. 14) indicating that the number of slices of the detected cellular communication network has decreased is performed, as shown in FIG. 16, an image I6 indicating the service type provided by the detected cellular communication network to the electronic device 100 may be displayed around the image I1 indicating the number of slices of the detected cellular communication network (for example, 4 ⇒ 3). At this time, a symbol indicating that it is unavailable may be displayed on the image I6 indicating the service type corresponding to the slice that has become unavailable (for example, the service type of No. 4). Here, the image I6 is displayed to make it easy for the user to notice what the service type corresponding to the unavailable slice is.The controller 190 may make it easier for the user to notice by, for example, changing the display mode of an image indicating the service type corresponding to a slice that has been made unusable (changing the display mode means, for example, blinking an image indicating the service type corresponding to a slice that has been made unusable at a predetermined second speed, changing the color of the image to a predetermined second color, or moving the display position of the image to a predetermined second position, etc.).

[0080] Also, based on the gateway-related information acquired in step S102 of the gateway-related image display process (see FIG. 3), the controller 190 determines whether a predetermined service type is included in the detected cellular communication network, and if the predetermined service type is included in the detected cellular communication network, it may notify the fact. Specifically, based on the above gateway-related information, the controller 190 determines whether a service type specifically recommended for the electronic device 100 (for example, voice communication (No. 2) and high reliability, low latency (No. 6); see FIG. 4) is included in the detected cellular communication network. If the service type is included, as shown in FIG. 17, by changing the display color of the meter portion of the image I2 indicating the communication quality with the detected cellular communication network to a preset display color (for example, purple), it may notify that the service type specifically recommended for the electronic device 100 is included in the detected cellular communication network. Here, the service type specifically recommended for the electronic device 100 is preset and stored in the storage 140. As shown in FIG. 18, by changing the display color of the image I1 indicating the number of slices of the detected cellular communication network to a preset display color (for example, yellow), it may also notify that the service type specifically recommended for the electronic device 100 is included in the detected cellular communication network.

[0081] Further, based on the above gateway-related information, the controller 190 determines whether a service type (for example, voice communication (No. 2); see FIG. 4) specifically recommended for an application (for example, a call application) executed in the electronic device 100 is included in the detected cellular communication network. When the service type is included, as shown in FIG. 19, when the application is being executed or an operation of designating an icon related to the application is performed, an image I1 indicating the number of slices of the detected cellular communication network is displayed on the display 112 together with an image I9 indicating the application, thereby notifying that the service type specifically recommended for the application is included in the detected cellular communication network. Here, the service type specifically recommended for the application executed in the electronic device 100 is assumed to be preset and stored in the storage 140.

[0082] Note that the notification method when notifying that the service type specifically recommended for the electronic device 100 is included in the detected cellular communication network, and the notification method when notifying that the service type specifically recommended for the application executed in the electronic device 100 is included in the detected cellular communication network are not limited to the above methods. For example, a voice indicating that the service type specifically recommended for the electronic device 100 is included in the detected cellular communication network or a voice indicating that the service type specifically recommended for the application executed in the electronic device 100 is included in the detected cellular communication network may be output from the voice output unit 122. Further, by causing a light emitting unit (not shown) provided in the electronic device 100 to emit light or activating a vibration function provided in the electronic device 100, it may be notified that the service type specifically recommended for the electronic device 100 is included in the detected cellular communication network or that the service type specifically recommended for the application executed in the electronic device 100 is included in the detected cellular communication network.

[0083] Also, as shown in FIGS. 20 to 22, the controller 190 may cause images I10 to I12 showing the characteristics of the detected cellular communication network to be displayed as gateway-related images. Specifically, as shown in FIG. 20, when the service type included in the detected cellular communication network is only multi-connection (mIoT) (No. 7) (or when many service types specialized for multi-connection are included), the controller 190, together with the image I2 showing the communication quality with the detected cellular communication network, causes an image (an image representing the character "many" in a circled form) I10 showing that multi-connection (mIoT) is included in the service type of the detected cellular communication network to be displayed. Also, as shown in FIG. 21, when the service type included in the detected cellular communication network is only Drone (No. 8) (or when many service types specialized for Drone are included), the controller 190, together with the image I2 showing the communication quality with the detected cellular communication network, causes an image (an image representing the character "D" in a circled form) I11 showing that Drone is included in the service type of the detected cellular communication network to be displayed. Also, as shown in FIG. 22, when the service type included in the detected cellular communication network is only high-reliability, low-latency (URLLC) (No. 6) optimal for autonomous driving communication etc. (or when many service types specialized for high-reliability, low-latency are included), the controller 190, together with the image I2 showing the communication quality with the detected cellular communication network, causes an image (an image representing the character "Auto" in a circled form) I12 showing that high-reliability, low-latency is included in the service type of the detected cellular communication network to be displayed.

[0084] Note that the controller 190 may, for example, change the display color of the above image I2 or change the display mode to represent the characteristics of the detected cellular communication network. For example, the controller 190 may increase the blinking speed of the above image I2 to indicate that more service types specialized for high-reliability, low-latency are included in the detected cellular communication network.

[0085] Also, among the service types N0.1 to N0.8 shown in FIG. 4, for example, when the service types No.1 and No.2 are classified as the first category and the service types No.3 to No.8 are classified as the second category (feature set), when the service type included in the detected cellular communication network belongs only to the second category, as shown in FIG. 23, the controller 190 may display, together with the image I2 indicating the communication quality with the detected cellular communication network, an image I13 (an image representing a special character with a circular enclosure) indicating that the service type of the detected cellular communication network corresponds to the second category (feature set).

[0086] Also, as shown in FIG. 24, when the detected cellular communication network is the local cellular communication network 220, the controller 190 acquires, via the cellular interface 151, the owner information indicating the owner of the license corresponding to this local cellular communication network 220 (for example, ABC Co., Ltd.) and the communication area information indicating the communication area of this local cellular communication network 220 (for example, Area1), and based on the acquired owner information and communication area information, may display an image I14 indicating the owner and an image I15 indicating the communication area, together with an image I1 indicating the number of slices of the detected cellular communication network and an image I2 indicating the communication quality with the detected cellular communication network.

[0087] Also, when a predetermined operation (for example, a touch operation) is performed on the image I14 indicating the above owner, as shown in FIG. 25, the controller 190 may display a guidance image I16 indicating the telephone number and email address of ABC Co., Ltd., which is the owner, on the display 112. Also, instead of the above guidance image I16, as shown in FIG. 26, the controller 190 may display a guidance image I17 provided with, for example, a Tel button B1 for making a call to the telephone number of ABC Co., Ltd., a Mail button B2 for creating an email to the email address of ABC Co., Ltd., and a LINK button B3 for accessing the homepage of ABC Co., Ltd., on the display 112.

[0088] Further, when a predetermined operation (for example, a touch operation) is performed on the image I15 indicating the communication area described above, the controller 190 may cause the display 112 to display a map image I18 indicating Area1, which is the communication area, as shown in FIG. 27. Further, when displaying the map image I18, the controller 190 may also display the current position P of the user.

[0089] 〔Modification Example 1〕 Next, the electronic device 100A of Modification Example 1 will be described. This electronic device 100A is different from the above-described embodiment in that it is targeted at a wearable terminal device. Hereinafter, the differences from the above-described embodiment will be described, and the common points will be omitted from the description.

[0090] As shown in FIG. 28, the electronic device 100A includes a main body portion 10a and a visor 114 (display member) attached to the main body portion 10a.

[0091] The main body portion 10a is an annular member whose circumference can be adjusted. Various devices such as a depth sensor 133 and a camera 134 are built into the main body portion 10a. When the main body portion 10a is worn on the head, the user's field of view is covered by the visor 114.

[0092] The visor 114 has light transmissibility. The user can visually recognize the real space through the visor 114. On the display surface of the visor 114 facing the user's eyes, an image such as a virtual image is projected and displayed from a laser scanner 115 (see FIG. 31) built into the main body portion 10a. The user visually recognizes the virtual image by the reflected light from the display surface. At this time, since the user also visually recognizes the real space through the visor 114, a visual effect as if the virtual image exists in the real space can be obtained.

[0093] As shown in FIG. 29, in a state where the virtual image 30 is displayed, the user visually recognizes the virtual image 30 facing a predetermined direction at a predetermined position in the space 40. In this modified example, the space 40 is the real space that the user visually recognizes through the visor 114. Since the virtual image 30 is projected onto the light-transmissive visor 114, it is visually recognized as a semi-transparent image overlapping the real space. In FIG. 29, a planar window screen is illustrated as the virtual image 30, but it is not limited thereto, and the virtual image 30 may be, for example, various three-dimensional images. When the virtual image 30 is a window screen, the virtual image 30 has a front surface and a back surface, and necessary information is displayed on the front surface thereof, and usually no information is displayed on the back surface.

[0094] The electronic device 100A detects the user's visual recognition area 41 based on the position and orientation of the user in the space 40 (in other words, the position and orientation of the electronic device 100A). As shown in FIG. 30, the visual recognition area 41 is an area located in front of the user U wearing the electronic device 100A in the space 40. For example, the visual recognition area 41 is an area within a predetermined angular range in the left-right direction and the up-down direction from the front of the user U. In this case, the shape of the cross-section when the solid corresponding to the shape of the visual recognition area 41 is cut by a plane perpendicular to the front direction of the user U is rectangular. Note that the shape of the visual recognition area 41 may be determined such that the shape of the cross-section is other than rectangular (for example, circular or elliptical, etc.). The shape of the visual recognition area 41 (for example, the angular range in the left-right direction and the up-down direction from the front) can be specified by, for example, the following method.

[0095] In the electronic device 100A, at a predetermined timing such as at the first startup, the visual field is adjusted (hereinafter referred to as calibration) in a predetermined procedure. By this calibration, the range that the user can visually recognize is specified, and thereafter, the virtual image 30 is displayed within the range. The shape of the visually recognizable range specified by this calibration can be set as the shape of the visual recognition area 41.

[0096] Further, the calibration is not limited to being performed according to the above-described predetermined procedure, and calibration may be automatically performed while the electronic device 100A is performing normal operations. For example, when no reaction is made to a display for which a reaction should be made by the user, the range in which the display is made may be regarded as outside the user's field of view, and the field of view (and the shape of the visual recognition area 41) may be adjusted. Further, a test display may be made at a position determined to be outside the field of view, and when there is a reaction from the user to the display, the range in which the display is made may be regarded as within the user's field of view, and the field of view (and the shape of the visual recognition area 41) may be adjusted.

[0097] Note that the shape of the visual recognition area 41 may be determined and fixed in advance without being based on the result of adjusting the field of view, such as at the time of shipment. For example, the shape of the visual recognition area 41 may be determined to be the maximum displayable range in terms of the optical design of the display unit 110A.

[0098] The virtual image 30 is generated in a state where the display position and orientation in the space 40 are determined in response to a predetermined operation by the user. The electronic device 100A projects and displays, on the visor 114, the virtual image 30 among the generated virtual images 30, for which the display position is determined to be inside the visual recognition area 41. In FIG. 29, the visual recognition area 41 is indicated by a dashed line.

[0099] The display position and orientation of the virtual image 30 in the visor 114 are updated in real time according to the change of the user's visual recognition area 41. That is, the display position and orientation of the virtual image 30 change according to the change of the visual recognition area 41 so that the user recognizes that "the virtual image 30 is located in the space 40 at the set position and orientation". For example, when the user moves from the front side to the back side of the virtual image 30, the shape (angle) of the virtual image 30 displayed accordingly gradually changes. Also, when the user turns to face the virtual image 30 after getting around to the back side of the virtual image 30, the back surface of the virtual image 30 is displayed so that the back surface can be visually recognized. Further, according to the change of the visual recognition area 41, the virtual image 30 whose display position has moved out of the visual recognition area 41 is no longer displayed, and if there is a virtual image 30 whose display position has entered the visual recognition area 41, the virtual image 30 is newly displayed.

[0100] As shown in FIG. 29, when the user holds a hand (or finger) forward, the direction in which the hand is extended is detected by the electronic device 100A, and a virtual line 51 extending in the direction and a pointer 52 are displayed on the display surface of the visor 114 and visually recognized by the user. The pointer 52 is displayed at the intersection of the virtual line 51 and the virtual image 30. When the virtual line 51 does not intersect the virtual image 30, the pointer 52 may be displayed at the intersection of the virtual line 51 and the wall surface of the space 40 or the like. When the distance between the user's hand and the virtual image 30 is within a predetermined reference distance, the display of the virtual line 51 may be omitted, and the pointer 52 may be directly displayed at a position corresponding to the position of the user's fingertip.

[0101] By changing the direction in which the user extends their hand, the direction of the virtual line 51 and the position of the pointer 52 can be adjusted. When a predetermined gesture is performed in a state where the pointer 52 is positioned on a predetermined operation target (for example, the function bar 31, the window shape change button 32, the close button 33, etc.) included in the virtual image 30, the gesture is detected by the electronic device 100A, and a predetermined operation on the operation target can be performed. For example, with the pointer 52 aligned with the close button 33, by performing a gesture for selecting the operation target (for example, a gesture of pinching the fingertips), the virtual image 30 can be closed (deleted). Also, with the pointer 52 aligned with the function bar 31, by performing a selection gesture and then a gesture of moving the hand forward, backward, left, or right while in the selected state, the virtual image 30 can be moved in the depth direction and the left - right direction. The operations on the virtual image 30 are not limited to these.

[0102] In this way, the electronic device 100A of this modified example realizes a visual effect as if the virtual image 30 exists in the real space, and can receive the user's operation on the virtual image 30 and reflect it in the display of the virtual image 30. That is, the electronic device 100A of this modified example provides MR (Mixed Reality).

[0103] Next, the functional configuration of the electronic device 100A will be described with reference to FIG. 31. The electronic device 100A includes a display unit 110A, a sensor unit 130A, a storage 140, a communication interface 150, a SIM interface 160, a connection interface 170, a battery 180, and a controller 190. Among the components shown in FIG. 31, each component except the visor 114 of the display unit 110A is built into the main body 10a and operates with power supplied from the battery 180 also built into the main body 10a.

[0104] The controller 190 performs various control operations by reading and executing the program 141 stored in the storage 140. By executing the program 141, the controller 190 executes, for example, a visual region detection process and a display control process. Among these, the visual region detection process is a process of detecting the user's visual region 41 within the space 40. The display control process is a process of causing the display unit 110A to display the virtual image 30 whose position is determined in the space 40 and which is located inside the visual region 41.

[0105] The storage 140 stores the program 141 executed by the controller 190 and various setting data. The program 141 is stored in the storage 140 in the form of computer-readable program code.

[0106] Data stored in the storage 140 includes virtual image data 142 related to the virtual image 30. The virtual image data 142 includes data related to the display content of the virtual image 30 (for example, image data), data on the display position, and data on the orientation.

[0107] The display unit 110A includes a visor 114, a laser scanner 115, and an optical system that guides the light output from the laser scanner 115 to the display surface of the visor 114. The laser scanner 115 irradiates the optical system while scanning pulsed laser light whose on / off is controlled for each pixel in a predetermined direction according to a control signal from the controller 190. The laser light incident on the optical system forms a display screen composed of a two-dimensional pixel matrix on the display surface of the visor 114. The method of the laser scanner 115 is not particularly limited, but for example, a method of operating a mirror by MEMS (Micro Electro Mechanical Systems) to scan the laser light can be used. The laser scanner 115 has, for example, three light emitting parts that emit laser light of RGB colors. The display unit 110A can perform color display by projecting the light from these light emitting parts onto the visor 114.

[0108] The sensor unit 130A includes an acceleration sensor 131, an angular velocity sensor 132, a depth sensor 133, a camera 134, an eye tracker 135, and the like. Note that the sensor unit 130A may further include sensors not shown in FIG. 31.

[0109] The acceleration sensor 131 detects acceleration and outputs the detection result to the controller 190. From the detection result by the acceleration sensor 131, the translational motion of the electronic device 100A in the three orthogonal axis directions can be detected.

[0110] The angular velocity sensor 132 (gyro sensor) detects angular velocity and outputs the detection result to the controller 190. From the detection result by the angular velocity sensor 132, the rotational motion of the electronic device 100A can be detected.

[0111] The depth sensor 133 is an infrared camera that detects the distance to a subject by the ToF (Time of Flight) method, and outputs the detection result of the distance to the controller 190. The depth sensor 133 is provided on the front surface of the main body 10a so as to be able to photograph the visual recognition area 41. By repeatedly performing the measurement by the depth sensor 133 and synthesizing the results each time the position and orientation of the user change in the space 40, the entire three-dimensional mapping (that is, obtaining a three-dimensional structure) of the space 40 can be performed.

[0112] The camera 134 photographs the space 40 with an RGB imaging element group, obtains color image data as a photographing result, and outputs it to the controller 190. The camera 134 is provided on the front surface of the main body 10a so as to be able to photograph the visual recognition area 41. The output image from the camera 134 is used for detecting the position and orientation of the electronic device 100A, and is also transmitted from the communication interface 150 to an external device and used to display the visual recognition area 41 of the user of the electronic device 100A on the external device.

[0113] The eye tracker 135 detects the user's line of sight and outputs the detection result to the controller 190. The method of detecting the line of sight is not particularly limited. For example, a method can be used in which the reflection point of near-infrared light in the user's eyes is photographed by an eye-tracking camera, and the object being viewed by the user is identified by analyzing the photographed result and the photographed image by the camera 134. A part of the configuration of the eye tracker 135 may be provided at the peripheral part of the visor 114 or the like.

[0114] In the electronic device 100A having such a configuration, the controller 190 performs the following control operations.

[0115] The controller 190 performs three-dimensional mapping of the space 40 based on the distance data to the subject input from the depth sensor 133. The controller 190 repeats this three-dimensional mapping every time the position and orientation of the user change, and updates the result each time. Also, the controller 190 performs three-dimensional mapping in units of a single continuous space 40. Therefore, when the user moves between a plurality of rooms partitioned by walls or the like, the controller 190 recognizes each room as one space 40 and performs three-dimensional mapping separately for each room.

[0116] The controller 190 detects the user's visual recognition area 41 within the space 40. Specifically, the controller 190 identifies the position and orientation of the user (electronic device 100A) in the space 40 based on the detection results from the acceleration sensor 131, angular velocity sensor 132, depth sensor 133, camera 134, and eye tracker 135, and the accumulated 3D mapping results. Then, the visual recognition area 41 is detected (identified) based on the identified position and orientation and the predefined shape of the visual recognition area 41. Also, the controller 190 continuously performs real-time detection of the user's position and orientation, and updates the visual recognition area 41 in conjunction with changes in the user's position and orientation. Note that the detection of the visual recognition area 41 may be performed using the detection results from some of the acceleration sensor 131, angular velocity sensor 132, depth sensor 133, camera 134, and eye tracker 135.

[0117] The controller 190 generates virtual image data 142 related to the virtual image 30 in response to the user's operation. That is, when the controller 190 detects a predetermined operation (gesture) that instructs the generation of the virtual image 30, it identifies the display content (e.g., image data), display position, and orientation of the virtual image, and generates virtual image data 142 that includes data representing these identification results.

[0118] The controller 190 causes the display unit 110A to display the virtual image 30 whose display position is determined inside the visual recognition area 41. The controller 190 identifies the virtual image 30 whose display position is determined inside the visual recognition area 41 based on the information of the display position included in the virtual image data 142, and generates the image data of the display screen to be displayed on the display unit 110A based on the positional relationship between the visual recognition area 41 at that time and the display position of the identified virtual image 30. The controller 190 causes the laser scanner 115 to perform a scanning operation based on this image data, and forms a display screen including the identified virtual image 30 on the display surface of the visor 114. That is, the controller 190 causes the virtual image 30 to be displayed on the display surface of the visor 114 so that the virtual image 30 is visually recognized in the space 40 visually recognized through the visor 114. By continuously performing this display control process, the controller 190 updates the display content by the display unit 110A in real time according to the movement of the user (change in the visual recognition area 41). When the virtual image data 142 is set to be retained even when the electronic device 100A is in the power-off state, when the electronic device 100A is started up next time, the existing virtual image data 142 is read, and if there is a virtual image 30 located inside the visual recognition area 41, it is displayed on the display unit 110A.

[0119] Note that the virtual image data 142 may be generated based on the instruction data acquired from an external device via the communication interface 150, and the virtual image 30 may be displayed based on the virtual image data 142. Alternatively, the virtual image data 142 itself may be acquired from an external device via the communication interface 150, and the virtual image 30 may be displayed based on the virtual image data 142. For example, an external device operated by a remote instructor may display the video of the camera 134 of the electronic device 100A, receive an instruction to display the virtual image 30 from the external device, and cause the virtual image 30 instructed to be displayed on the display unit 110A of the electronic device 100A. Thereby, for example, an operation such as displaying a virtual image 30 indicating the work content near the work object and instructing the user of the electronic device 100A from the remote instructor becomes possible.

[0120] The controller 190 detects the position and orientation of the user's hand (and / or finger) based on the captured images by the depth sensor 133 and the camera 134, and causes the display unit 110A to display a virtual line 51 extending in the detected direction and a pointer 52. Further, the controller 190 detects the gesture of the user's hand (and / or finger) based on the captured images by the depth sensor 133 and the camera 134, and executes processing according to the content of the detected gesture and the position of the pointer 52 at that time.

[0121] Next, the operation of the electronic device 100A will be described. FIG. 32 is a flowchart showing the control procedure of the gateway-related image display process by the electronic device 100A.

[0122] When the gateway-related image display process shown in FIG. 32 is started, the controller 190 controls the cellular interface 151 to perform a network search (step S201).

[0123] Next, the controller 190 acquires gateway-related information from the detected cellular communication network via the cellular interface 151 (step S202).

[0124] Next, the controller 190 causes the display 112 to display a gateway-related image indicating predetermined information regarding the detected cellular communication network based on the gateway-related information acquired in step S202 (step S203).

[0125] Next, the controller 190 detects the visual recognition area 41 based on the position and orientation of the user (step S204).

[0126] Next, the controller 190 determines whether there is a virtual image 30 whose display position is determined inside the detected visual recognition area 41 (step S205).

[0127] In step S205, when it is determined that there is no virtual image 30 whose display position is determined inside the detected visual recognition area 41 (step S205; NO), the controller 190 proceeds with the process to step S207.

[0128] Also, in step S205, when it is determined that there is a virtual image 30 whose display position is determined inside the detected visual recognition area 41 (step S205; YES), the controller 190 causes the virtual image 30 to be displayed on the display unit 110A (step S206).

[0129] Next, the controller 190 determines whether an instruction to end the display operation by the electronic device 100A has been given (step S207).

[0130] In step S207, when it is determined that an instruction to end the display operation by the electronic device 100A has not been given (step S207; NO), the controller 190 returns the process to step S201 and repeats the subsequent processes.

[0131] Also, in step S207, when it is determined that an instruction to end the display operation by the electronic device 100A has been given (step S207; YES), the controller 190 ends the gateway-related image display process.

[0132] Hereinafter, the specific display modes when the display control of the gateway-related image in step S203 and the display control of the virtual image 30 in step S206 are performed will be described.

[0133] As one display mode, for example, as shown in FIG. 33, the controller 190 causes the display unit 110A to display the virtual image 30, and also displays an image I1 indicating the number of slices of the detected cellular communication network as a gateway-related image at the upper left portion of the display unit 110A. Specifically, the controller 190 displays the image I1 in a state fixed to the upper left portion of the display unit 110A so that the user and the image I1 are always facing each other. That is, even when the user moves around to the back side of the virtual image 30 displayed on the display unit 110A, the image I1 is displayed at the upper left portion of the display unit 110A.

[0134] Further, the controller 190 may display the image I1 indicating the number of slices of the detected cellular communication network together with the image I2 indicating the communication quality with the detected cellular communication network, in the same manner as the above-described electronic device 100 (see FIG. 6).

[0135] Note that the controller 190 may display an object that displays an image I1 indicating the number of slices of the detected cellular communication network, such as the virtual image 30, in a state where the display position and orientation in the space 40 are determined according to a predetermined operation of the user, for example. In such a case, the controller 190 displays an image I2 indicating the communication quality with the detected cellular communication network on the surface (second surface) opposite to the surface (first surface) on which the image I1 of the object is displayed. Note that the image displayed on the second surface is not limited to the image I2 indicating the communication quality with the detected cellular communication network, and may be, for example, an app icon that uses a slice corresponding to the type of service provided by the detected cellular communication network, or an image I19 indicating the type of service (slice) that can be provided by the detected cellular communication network, as shown in FIG. 34. Further, the controller 190 can switch between a first setting in which the object is displayed in a state fixed to the display unit 110A so that the first surface or the second surface always faces the user in response to a predetermined operation of the user (for example, an operation by a gesture, an operation of the physical button 113, a voice operation using the voice input unit 121, etc.), and a second setting in which the object is displayed in a posture according to the angle when the user views it.

[0136] [Modification Example 2] Next, the configuration of the display system 1 according to Modification Example 2 will be described. Modification Example 2 is different from Modification Example 1 in that a part of the processing that the controller 190 of the electronic device 100A executed in Modification Example 1 is executed by an external information processing device 20. Below, the differences from Modification Example 1 will be described, and the common points will be omitted from the description.

[0137] As shown in FIG. 35, the display system 1 includes an electronic device 100A and an information processing device 20 (server) communicatively connected to the electronic device 100A. At least a part of the communication path between the electronic device 100A and the information processing device 20 may be by wireless communication. The hardware configuration of the electronic device 100A can be the same as that of Modification Example 1, but the processor for performing the same processing as the processing executed by the information processing device 20 may be omitted.

[0138] As shown in FIG. 36, the information processing device 20 includes a CPU 21, a RAM 22, a storage unit 23, an operation display unit 24, a communication unit 25, etc., and these units are connected by a bus 26.

[0139] The CPU 21 is a processor that performs various arithmetic processes and comprehensively controls the operations of each unit of the information processing device 20. The CPU 21 performs various control operations by reading and executing the program 231 stored in the storage unit 23.

[0140] The RAM 22 provides a working memory space for the CPU 21 and stores temporary data.

[0141] The storage unit 23 is a non-temporary recording medium readable by the CPU 21 as a computer. The storage unit 23 stores a program 231 executed by the CPU 21 and various setting data. The program 231 is stored in the storage unit 23 in the form of computer-readable program code. As the storage unit 23, for example, a non-volatile storage device such as an SSD equipped with a flash memory or an HDD (Hard Disk Drive) is used.

[0142] The operation display unit 24 includes a display device such as a liquid crystal display and input devices such as a mouse and a keyboard. The operation display unit 24 performs various displays such as the operation status and processing results of the display system 1 on the display device. Here, the operation status of the display system 1 may include a real-time captured image by the camera 134 of the electronic device 100A. Further, the operation display unit 24 converts a user's input operation on the input device into an operation signal and outputs it to the CPU 21.

[0143] The communication unit 25 communicates with the electronic device 100A to transmit and receive data. For example, the communication unit 25 receives data including part or all of the detection results by the sensor unit 130A of the electronic device 100A and information related to the user's operation (gesture) detected by the electronic device 100A. Further, the communication unit 25 may be able to communicate with other devices other than the electronic device 100A.

[0144] In the display system 1 configured as described above, the CPU 21 of the information processing apparatus 20 executes at least a part of the processing that the controller 190 of the electronic device 100A executed in the first modification. For example, the CPU 21 may perform three-dimensional mapping of the space 40 based on the detection result by the depth sensor 133. Further, the CPU 21 may detect the visual recognition area 41 of the user in the space 40 based on the detection results by the respective parts of the sensor unit 130A. Further, the CPU 21 may generate virtual image data 142 related to the virtual image 30 according to the operation of the user of the electronic device 100A. Further, the CPU 21 may detect the position and orientation of the user's hand (and / or finger) based on the captured image by the depth sensor 133 and the camera 134.

[0145] The above processing result by the CPU 21 is transmitted to the electronic device 100A via the communication unit 25. The controller 190 of the electronic device 100A operates each part of the electronic device 100A (for example, the display unit 110A) based on the received processing result. Further, the CPU 21 may transmit a control signal to the electronic device 100A to perform display control of the display unit 110A of the electronic device 100A.

[0146] In this way, by executing at least a part of the processing in the information processing apparatus 20, the device configuration of the electronic device 100A can be simplified and the manufacturing cost can be reduced. Further, by using a more high-performance information processing apparatus 20, various processes related to MR can be speeded up and made more accurate. Therefore, it is possible to improve the accuracy of the 3D mapping of the space 40, improve the display quality by the display unit 110A, or improve the reaction speed of the display unit 110A to the operation of the user.

[0147] 〔Others〕 Note that the above embodiment is an example and various modifications are possible. For example, in the above-described Modification 1, a visor 114 having light transmissivity was used to allow the user to visually recognize the real space, but the present invention is not limited to this. For example, a visor 114 having light-shielding properties may be used, and the user may be allowed to visually recognize an image of the space 40 captured by the camera 134. That is, the controller 190 may cause the display unit 110A to display an image of the space 40 captured by the camera 134 and a virtual image 30 superimposed on the image of the space 40. Even with such a configuration, MR that fuses the virtual image 30 with the real space can be realized.

[0148] Further, by using an image of a virtual space generated in advance instead of the captured image of the real space by the camera 134, VR that gives the user a feeling of being in the virtual space can be realized. Also in this VR, the visual recognition area 41 of the user is specified, and the virtual image 30 whose display position is determined inside the visual recognition area 41 in the virtual space is displayed.

[0149] The electronic device 100A is not limited to having the annular main body 10a illustrated in FIG. 28, and may have any structure as long as it has a display unit that can be visually recognized by the user when worn. For example, it may have a configuration that covers the entire head like a helmet. Also, like glasses, it may have a frame that is worn on the ears and various devices may be built into the frame.

[0150] Although an example in which the user's gesture is detected and accepted as an input operation has been described, the present invention is not limited to this. For example, an input operation may be accepted by a controller that the user holds in their hand or wears on their body.

[0151] Further, in the above-described Modification 1, mainly a gateway-related image specialized for the wearable terminal device that is the target of the electronic device 100A has been described, but various gateway-related images that can be displayed by the electronic device 100 may also be displayed on the electronic device 100A.

[0152] In addition, the specific details of the configurations and controls shown in the above embodiments can be appropriately changed without departing from the spirit of the present disclosure. Also, within the scope not departing from the spirit of the present disclosure, the configurations and controls shown in the above embodiments can be appropriately combined.

Industrial Applicability

[0153] The present disclosure can be used in electronic devices, programs, and display methods.

Explanation of Signs

[0154] 1 Display system 100, 100A Electronic device 110 Touch panel display 110A Display unit 111 Touch panel 112 Display 113 Physical button 114 Visor 115 Laser scanner 121 Voice input unit 122 Voice output unit 130 Sensor 130A Sensor unit 131 Acceleration sensor 132 Angular velocity sensor 133 Depth sensor 134 Camera 135 Eye tracker 140 Storage 141 Program 142 Virtual image data 150 Communication interface 151 Cellular interface 152 WLAN interface 160 SIM interface 170 Connection interface 180 Battery 190 Controller 20 Information processing device 21 CPU 22 RAM 23 Memory unit 231 Program 24 Operation display unit 25 Communication unit 26 Bus 30 Virtual image 31 Function bar 32 Window shape change button 33 Close button 40 Space 41 Visual recognition area 51 Virtual line 52 Pointer 210 Public cellular communication network 220 Local cellular communication network 300 Server 400 Expansion device 500 Electronic device 600 Electronic device U User

Claims

1. A display unit including a display member having light transmissibility, at least one processor, and comprising: The at least one processor acquires, via a communication interface, identifiers assigned to each of the plurality of slices from a communication network theoretically divided into a plurality of slices according to service types, and based on the acquired identifiers, causes a first image indicating predetermined information regarding the communication network to be visually recognized in a space visually recognized through the display member, to be displayed on a display surface of the display member, causes a second image located in the space, different from the first image, to be displayed on the display surface of the display member, displays the first image in a state fixed at a predetermined position on the display surface of the display member such that the user and the first image always face each other, and causes the second image to be displayed in a posture corresponding to an angle when the user visually recognizes it, an electronic device.

2. The electronic device according to claim 1, wherein the first image is an image indicating the number of slices corresponding to the communication network.

3. The electronic device according to claim 1 or claim 2, wherein the first image is an image indicating a feature of the communication network.

4. The electronic device according to any one of claims 1 to 3, wherein the at least one processor causes the first image to be displayed on the display unit together with a fourth image indicating communication quality with the communication network.

5. The electronic device according to any one of claims 1 to 4, wherein the at least one processor causes the first image to be displayed based on a predetermined operation.

6. The at least one processor causes a third image different from the first image to be displayed on the display unit, and based on a predetermined operation of selecting the third image displayed on the display unit, causes the first image to be displayed, The electronic device according to claim 5.

7. The electronic device according to claim 2, wherein the number of slices is the number of slices satisfying a predetermined condition.

8. The electronic device according to claim 7, wherein the number of slices satisfying the predetermined condition is the number of slices having a usage record by the own electronic device.

9. The electronic device according to claim 7, wherein the number of slices satisfying the predetermined condition is the number of slices satisfying a predetermined communication volume or communication frequency.

10. The electronic device according to claim 7, wherein the number of slices satisfying the predetermined condition is the number of slices satisfying a predetermined communication quality.

11. The electronic device according to any one of claims 1 to 10, wherein the at least one processor causes the display unit to display a fifth image indicating the service type.

12. The electronic device according to claim 11, wherein the at least one processor causes the fifth image to be displayed based on a predetermined operation related to the first image displayed on the display unit.

13. The electronic device according to claim 11 or claim 12, wherein the at least one processor controls, based on a user operation of selecting one of the service types shown in the fifth image, turning on and off the use of communication via a slice corresponding to the service type.

14. Comprising a notification unit, The at least one processor, determines whether there is a change in the number of slices corresponding to the communication network based on the identifier acquired via the communication interface, and when there is a change in the number of slices corresponding to the communication network, notifies, via the notification unit, that there is a change in the number of slices corresponding to the communication network. The electronic device according to any one of claims 1 to 13.

15. Comprising a notification unit, The at least one processor, determines whether a predetermined service type is included in the communication network based on the identifier acquired via the communication interface, and when a predetermined service type is included in the communication network, notifies, via the notification unit, that the predetermined service type is included in the communication network. The electronic device according to any one of claims 1 to 14.

16. The electronic device according to claim 15, wherein the predetermined service type is a service type preset as a service type specifically recommended for the own electronic device.

17. The electronic device according to claim 15, wherein the predetermined service type is a service type preset as a service type specifically recommended for at least one application executed in the own electronic device.

18. The at least one processor, when the communication network is a local cellular communication network, acquires, via the communication interface, owner information indicating the owner of the license corresponding to the local cellular communication network, and causes the display unit to display a sixth image indicating the owner based on the owner information. The electronic device according to any one of claims 1 to 17.

19. The electronic device according to claim 18, wherein the at least one processor causes the display unit to display a guidance image that enables access to the owner based on a predetermined operation related to the sixth image displayed on the display unit.

20. The at least one processor when the communication network is a local cellular communication network, acquires communication area information indicating the communication area of the local cellular communication network via the communication interface, and causes the display unit to display a seventh image indicating the communication area based on the communication area information. The electronic device according to any one of claims 1 to 19.

21. The electronic device according to claim 20, wherein the at least one processor causes the display unit to display a map image indicating the communication area based on a predetermined operation related to the seventh image displayed on the display unit.

22. In a computer provided in an electronic device including a display unit including a display member having light transmissibility, a process of acquiring, via a communication interface, identifiers assigned to each of a plurality of slices into which a communication network is theoretically divided according to service types, a process of causing the display surface of the display member to display a first image indicating predetermined information about the communication network in a space visible through the display member based on the acquired identifiers, a process of causing the display surface of the display member to display a second image located in the space and different from the first image, a process of causing the first image to be displayed in a state fixed at a predetermined position on the display surface of the display member so that the user and the first image always face each other, a process of causing the second image to be displayed in a posture corresponding to the angle when the user views it, A program for executing the above.

Images