Server device and electronic device
By generating and displaying server and electronic devices that combine virtual environments, the problem of inaccurate availability information for colleagues in remote work is solved, improving interaction efficiency and communication effectiveness.
Patent Information
- Application Number
- CN202210252345.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2021-03-31
- Filing Date
- 2022-03-15
- Publication Date
- 2026-02-24
- Estimated Expiration
- 2042-03-15
AI Technical Summary
In remote work setups, existing technologies struggle to provide accurate information on colleague availability and a nuanced view, leading to inefficient interaction and communication.
The server equipment generates a combined virtual environment, and the processor circuitry determines and associates parameters and environmental data from different locations, providing combined environmental data to reflect the location and activities of people, and supporting electronic devices to display updated avatar parameters.
It improves the efficiency of interaction in remote work settings, allows for more accurate colleague availability information, and facilitates more timely communication and discussion.
Smart Images

Figure CN115145388B_ABST
Abstract
Description
Technical Field
[0001] This disclosure generally relates to the field of virtual environments, and more specifically to the generation of composite virtual environments. This disclosure relates to server equipment, electronic equipment, and related methods. Background Technology
[0002] Finding the best way to communicate and / or interact with colleagues between meetings can be challenging in remote (such as online or hybrid) work settings. In a typical office setting, interaction and / or communication occur in different social areas of the office, such as the coffee machine, cafeteria, or break area. This is not possible in online and hybrid work settings.
[0003] Furthermore, for quick questions or discussions in an office setting, one can look for someone at their desk or elsewhere and further observe whether that person appears busy or available. Currently, for online and hybrid work settings, the only indicator of availability is virtual status, such as available / busy / away status in public chat and / or meeting applications and / or calendars. Summary of the Invention
[0004] There is a need for a way to interact with colleagues between meetings in a remote work setup. Furthermore, there is a need for a more informed and / or nuanced view of colleague availability.
[0005] Therefore, there is a need for devices and related methods that can mitigate, reduce or resolve existing shortcomings and provide improved systems for interacting with colleagues in remote work settings and / or receiving informed and / or nuanced views.
[0006] A server device is disclosed. The server device can be configured to provide a combined environment. The server device includes memory circuitry. The server device includes interface circuitry. The server device includes processor circuitry. The processor circuitry is configured to determine a first parameter indicating a first location based on first data. The processor circuitry is configured to generate first environmental data indicating the first location based on the first parameter. The processor circuitry can be configured to determine a second parameter indicating a second location based on second data. The processor circuitry is configured to associate the second parameter with the first environmental data to provide combined environmental data. The processor circuitry is configured to output the combined environmental data.
[0007] A method is also disclosed. This method can be performed by a server device configured to provide a combined environment. The method may include determining a first parameter indicating a first location based on first data. The method may include generating first environmental data indicating the first location based on the first parameter. The method may include determining a second parameter indicating a second location based on second data. The method includes associating the second parameter with the first environmental data to provide combined environmental data. The method includes outputting the combined environmental data.
[0008] One advantage of this disclosure is the ability to generate composite environments from two or more different locations. A composite environment can be a virtual environment accessible to multiple users. The composite environment can reflect the location and / or activities representing a person's avatar within the composite environment with improved accuracy. This can allow for improved interaction in potentially more timely remote work settings. Furthermore, this can allow for more extensive discussions, as employees may have more accurate information about the context and availability of their colleagues.
[0009] An electronic device is also disclosed. The electronic device includes memory circuitry, interface circuitry, display circuitry, and processor circuitry. The electronic device is configured to acquire combined environmental data. The combined environmental data indicates a combination of a first location and a second location. The combined environmental data may include avatar parameters indicating a person in the second location. The electronic device can be configured to determine activity parameters associated with the avatar parameters. The electronic device can be configured to acquire updated avatar parameters indicating a person in the second location based on the activity parameters. The electronic device is configured to display a second user interface object representing the combined environmental data and, optionally, a first user interface object representing the updated avatar parameters.
[0010] A method is also disclosed. This method can be performed by an electronic device. The method includes obtaining combined environmental data, wherein the combined environmental data indicates a combination of a first location and a second location. The combined environmental data may include avatar parameters indicating a person in the second location. The method may include determining activity parameters associated with the avatar parameters. The method may include obtaining updated avatar parameters indicating a person in the second location based on the activity parameters. The method includes displaying a first user interface object representing the updated avatar parameters and a second user interface object representing the combined environmental data.
[0011] One advantage of this disclosure is that it allows for the display of combined environments to represent virtual combinations of two or more distinct locations for virtual interaction between people. The combined environment can be a virtual environment accessible to multiple users. The combined environment can display locations and / or activities representing avatars of people within it with improved accuracy. This can allow for improved interaction in potentially more timely remote work settings. The disclosed electronic devices can be viewed as more effectively supporting users in performing technical tasks that initiate communication and / or interaction. Furthermore, this disclosure allows for more extensive discussion because workers may have more accurate information about the context and availability of their colleagues. Attached Figure Description
[0012] The above and other features and advantages of this disclosure will become apparent to those skilled in the art from the following detailed description of examples thereof with reference to the accompanying drawings, wherein:
[0013] Figure 1 This is a block diagram illustrating an example server device according to this disclosure.
[0014] Figures 2A to 2C This is a flowchart illustrating an example method for providing a composite environment executed in a server device according to the present disclosure.
[0015] Figure 3 This is a block diagram illustrating an example electronic device according to the present disclosure.
[0016] Figure 4 This is a flowchart illustrating an example method performed in an electronic device according to this disclosure.
[0017] Figure 5 This is a schematic diagram of an example scenario including the example server device disclosed herein, and
[0018] Figure 6 This is a schematic diagram of an example user interface based on this disclosure. Detailed Implementation
[0019] Various examples and details are described below with reference to the accompanying drawings. It should be noted that the drawings may or may not be drawn to scale, and elements with similar structures or functions are indicated by similar reference numerals in all the drawings. It should also be noted that the drawings are intended only to facilitate the description of examples. They are not intended as an exhaustive description of this disclosure or as a limitation on the scope of this disclosure. Furthermore, the examples shown need not possess all the aspects or advantages shown. Aspects or advantages described in connection with a particular example are not necessarily limited to that example and can be practiced in any other example, even if not so stated or explicitly described.
[0020] This document discloses devices, systems, components, and / or methods for providing and / or using a combined environment from at least a first location and a second location. The combined environment can be a virtual combined environment. A combined environment can allow a user to view the location and activities of other people (such as colleagues, employees, managers, bosses, and visitors) within a virtual environment.
[0021] An environment, such as a virtual environment, can be viewed as a digital representation of a place, such as a digital representation of spaces and / or areas within a place. An environment may include data that indicates a place, such as data that indicates spaces and / or areas within a place.
[0022] Virtual composite environments are particularly useful for remote work setups. Multiple locations can be associated with a virtual composite environment to improve collaboration and communication.
[0023] The devices and methods disclosed herein can be configured to provide a more informed and / or nuanced view of personnel availability, even in different locations. The devices and methods disclosed herein may relate to virtual meeting systems. The devices and methods disclosed herein may relate to merged home office virtual environments.
[0024] This disclosure provides devices and / or methods for providing combined environments, such as combined virtual or physical environments, which in some examples may represent an office. Individuals such as colleagues, employees, and employers can associate and / or synchronize and / or merge and / or map their own workspaces in their homes and other parts of their homes to the combined environment data. For example, these individuals can mirror locations within a virtual office environment in their homes. Individuals can then be registered using location and activity sensors present in these spaces, such as via avatars and / or avatar parameters. User devices can display avatars within the combined environment data.
[0025] The server equipment disclosed here can be a physical server. The server equipment disclosed here can be a virtual server. The server equipment disclosed here can be a cloud server.
[0026] The electronic device disclosed herein can be one of many types of electronic devices. An electronic device can be a user device. An electronic device can be a computer. An electronic device can be a tablet computer. An electronic device can be an application. An electronic device can be a mobile phone, such as a smartphone. An electronic device can be a device running a program. For example, an electronic device can be a phone running an application.
[0027] Electronic devices and / or server devices may be part of a system and / or device component. Electronic devices and / or server devices may be one or more server devices and / or one or more electronic devices. Electronic devices and / or server devices may be configured to connect to one or more other electronic devices and / or other server devices. Electronic devices may be configured to connect to a server. Electronic devices and / or server devices may be configured to connect to an image sensor. Electronic devices and / or server devices may be configured to connect to a user device. The connection may be a wired connection and / or a wireless connection.
[0028] Electronic devices and / or server devices can be configured to provide and / or generate and / or display virtual environments. Electronic devices and / or server devices can be configured to acquire and / or receive presence, location, and activity sensing.
[0029] Figure 1 A block diagram of an example server device 300 according to this disclosure is shown. The server device 300 can be configured to generate composite environments, such as composite environment data. The server device 300 can also be configured to generate virtual composite environments, such as virtual composite environment data.
[0030] Server device 300 includes memory circuitry 301. Server device 300 includes processor circuitry 302. Server device 300 includes interface circuitry 303.
[0031] In one or more example server devices, server device 300 is configured to provide a combined environment. In one or more example server devices, server device 300 includes memory circuitry 301. In one or more example server devices, server device 300 includes interface circuitry 303. In one or more example server devices, server device 300 includes processor circuitry 302. In one or more example server devices, processor circuitry 302 may be configured to determine a first parameter. In one or more example server devices, the first parameter may indicate a first location. In one or more example server devices, processor circuitry 302 may be configured to determine a first parameter indicating a first location based on first data. In one or more example server devices, processor circuitry 302 may be configured to generate first environment data. In one or more example server devices, the first environment data may indicate a first location. In one or more example server devices, processor circuitry 302 may be configured to generate first environment data indicating a first location based on the first parameter. In one or more example server devices, processor circuitry 302 may be configured to determine a second parameter. In one or more example server devices, the second parameter may indicate a second location. In one or more example server devices, processor circuitry 302 may be configured to determine a second parameter indicating a second location based on second data. In one or more example server devices, processor circuitry 302 may be configured to associate the second parameter with first environmental data. In one or more example server devices, processor circuitry 302 is configured to associate the second parameter with the first environmental data to provide combined environmental data. Processor circuitry 302 is configured to output the combined environmental data.
[0032] For example, server device 300 can be configured to provide data representing a combination of two or more locations, such as a first location and a second location. Server device 300 can be configured to provide a data representation of one of the locations (such as a first location) as combined environment data, and then associate and / or map and / or synchronize other locations (such as a second location) to the combined environment data. The combined environment data can indicate and / or represent a combined environment. The combined environment data can indicate a combination of a first location and a second location.
[0033] In one or more example server devices, processor circuitry 302 may be configured to determine a first parameter indicating a first location based on first data. The first parameter may be a location parameter. The first parameter may be a geometric parameter. The first parameter may be a sensor parameter.
[0034] In one or more example server devices, processor circuitry 302 may be configured to determine one or more first parameters indicating a first location based on first data.
[0035] The first place can be a space, such as an area, venue, indoor space, outdoor space, office, building, factory, facility, hospital, home, apartment, or house. There are no restrictions on the type of first place.
[0036] The first data can be based on a first location. The first data can be sensor data. The first data can be image data. The first data can be input data. The first data can be user data. The first data can represent a part of the first location. The first data can represent the entire first location. The first data can represent the layout of the first location. The first data can represent a part of the layout of the first location. The first data can represent the complete layout of the first location.
[0037] In one or more examples, the first data may include one or more of the following: sensor data, image data, input data, and user data.
[0038] The first data can be stored in a database. The first data can be provided to a server device. For example, the first data can be provided through an interface circuit. The first data can also be stored in the server device. For example, the first data can be stored in a memory circuit.
[0039] The first parameter may indicate a first location. The first parameter may be considered a parameter indicating the location and / or geometry and / or layout associated with the first location. The first parameter may indicate one or more areas of the first location. The first parameter may indicate one or more spaces of the first location. The first parameter may indicate the layout of the first location. The first parameter may indicate a portion of the layout of the first location. The first parameter may indicate a portion of the overall layout of the first location. The first parameter may indicate one or more spaces and / or one or more areas of the first location.
[0040] The first parameter may indicate one or more of the following: one or more areas of the first site, one or more spaces of the first site, the layout of the first site, and the overall layout of the first site.
[0041] In one or more example server devices, processor circuitry 302 can be configured to generate first environmental data indicating a first location based on first parameters.
[0042] First environmental data can indicate part or all of the layout of a first location, such as spaces and / or areas within the first location. For example, first environmental data can indicate different rooms within a first location. If the first location is an office, the first environmental data can indicate one or more of the following: offices, cafeteria, coffee area, bathrooms, rest area, social area, meeting room, conference room, and elevator.
[0043] The first parameter and / or the first environmental data may be a true representation of the first location. The first parameter and / or the first environmental data may not be a true representation of the first location. For example, the first parameter and / or the first environmental data may specify certain spaces and / or areas with organizations, sizes, and locations different from the first location.
[0044] In one or more example server devices, processor circuitry 302 may be configured to determine a second parameter indicating a second location based on second data. The second parameter may be a location parameter. The second parameter may be a geometric parameter. The second parameter may be a sensor parameter.
[0045] In one or more example server devices, processor circuitry 302 may be configured to determine one or more second parameters indicating a second location based on second data.
[0046] The second place can be a space, such as an area, venue, indoor space, outdoor space, office, building, factory, facility, hospital, home, apartment, or house. There are no restrictions on the type of second place.
[0047] The second location may be different from the first location. The second location may be physically separate from the first location. The first location may be independent of the second location.
[0048] The second data can be based on a second location. The second data can be sensor data. The second data can be image data. The second data can be input data. The second data can be user data. The second data can represent a portion of the second location. The second data can represent the entire second location. The second data can represent the layout of the second location. The second data can represent a portion of the layout of the second location. The second data can represent the complete layout of the second location.
[0049] In one or more examples, the second data may include one or more of the following: sensor data, image data, input data, and user data.
[0050] The second data can be stored in a database. The second data can be provided to a server device. For example, the second data can be provided through an interface circuit. The second data can also be stored within the server device. For example, the second data can be stored in a memory circuit.
[0051] The second parameter may indicate a second location. The second parameter may be considered a parameter indicating the location and / or geometry and / or layout associated with the second location. The second parameter may indicate one or more areas of the second location. The second parameter may indicate one or more spaces of the second location. The second parameter may indicate the layout of the second location. The second parameter may indicate a portion of the layout of the second location. The second parameter may indicate the overall layout of the second location. The second parameter may indicate one or more spaces and / or one or more areas of the second location. The second parameter may indicate a portion or all of the layout of the second location, such as spaces and / or areas within the second location. For example, the second parameter may indicate different rooms within the second location. If the first location is a home and / or apartment, the second parameter may indicate one or more of the following: work area, kitchen, bathroom, bedroom, and living room.
[0052] Processor circuitry 302 can be configured to associate a second parameter with first environmental data to provide combined environmental data. One or more second parameters can be associated with the first environmental data. Processor circuitry 302 can be configured to map the second parameters to the first environmental data to provide combined environmental data. Processor circuitry 302 can be configured to merge the second parameters into the first environmental data to provide combined environmental data. Processor circuitry 302 can be configured to synchronize the second parameters to the first environmental data to provide combined environmental data.
[0053] Processor circuitry 302 can be configured to associate a second parameter with first environmental data based on user (e.g., human) input. For example, server device 300 can be configured to receive user input, such as user selection and / or user data, that selects a room in the second location to associate with a specific area, parameter, or data in the first environmental data. As an example, server device 300 can receive user input that a kitchen in the second location should be associated with a coffee lounge in the first environmental data. Server device 300 can then be configured to associate a second parameter indicating the kitchen with the first environmental data indicating the coffee lounge.
[0054] In one or more example server devices, the combined environmental data includes one or more first regions indicating the area of a first location. One or more first regions can be one or more of a first space, a first area, and a first room. One or more first regions can be specified by the user. Machine learning schemes or artificial intelligence can be used to determine one or more first regions. Machine learning schemes can be used to detect one or more first regions, such as by applying clustering algorithms (such as density-based spatial clustering (DBSCAN) with noise) to the first location.
[0055] In one or more example server devices, the second parameter includes one or more second regions. A second region may indicate a region of a second location. In one or more example server devices, processor circuitry 302 is configured to associate each of the one or more second regions with one of the one or more first regions.
[0056] One or more second regions can be one or more of a second space, a second area, and a second room. One or more second regions can be specified by the user. One or more second regions can be determined using machine learning schemes or artificial intelligence. Machine learning schemes can be used to detect one or more second regions, such as by applying clustering algorithms (such as density-based spatial clustering (DBSCAN) with noise) to the second location.
[0057] In one or more example server devices, the first location can be an office and the second location can be a home.
[0058] First environmental data can indicate different spaces within an office. For example, first environmental data and / or first parameters and / or one or more first areas can represent a first office, a second office, and a lounge.
[0059] As an example, the second parameter and / or one or more second areas can indicate different spaces in the home, such as a home office. The second parameter and / or one or more second areas can then be associated with the first environmental data. For example, processor circuitry 302 can be configured to associate a second parameter indicating a workspace in the home and / or one of one or more second areas with the first office in the first environmental data. Processor circuitry 302 can be configured to associate a second parameter and / or one of one or more second areas indicating a kitchen with the lounge area in the first environmental data.
[0060] Association can be performed automatically. Association can also be performed manually. For example, a user can provide server device 300 with information indicating which rooms and / or areas are associated with the first environment data from the second location.
[0061] Combined environmental data can represent a combination of a first location and a second location. Combined environmental data can also represent the location of a second location mapped to a location of the first location.
[0062] Processor circuitry 302 is configured to output composite environmental data. Processor circuitry 302 can be configured to output composite environmental data to an external electronic device, such as wirelessly or via a wired link. Processor circuitry 302 can be configured to output composite environmental data to another server device or an electronic device that can act as a user device. Processor circuitry 302 can be configured to output composite environmental data to a user device. Processor circuitry 302 can be configured to output composite environmental data to a database.
[0063] In one or more example server devices, processor circuitry 302 can be configured to determine a third parameter indicating a third location. In one or more example server devices, processor circuitry 302 can be configured to determine the third parameter indicating a third location based on third data. Processor circuitry 302 can be configured to associate the third parameter with combined environmental data. The third parameter can be a location parameter. The third parameter can be a geometric parameter. The third parameter can be a sensor parameter.
[0064] A third place can be a space, such as an area, venue, indoor space, outdoor space, office, building, factory, facility, hospital, home, apartment, or house. There are no restrictions on the type of third place.
[0065] The third location may be different from the first and / or second location. The third location may be physically separate from the first and / or second location. The third location may be independent of the second and / or first location.
[0066] Third data can be based on a third location. Third data can be sensor data. Third data can be image data. Third data can be input data. Third data can be user data. Third data can represent a portion of a third location. Third data can represent the entire third location. Third data can represent and / or indicate the layout of a third location. Third data can represent a portion of the layout of a third location. Third data can represent the complete layout of a third location.
[0067] In one or more examples, third data may include one or more of the following: sensor data, image data, input data, and user data. Third data may represent one or more of the following: a portion of a third location, the entirety of a third location, the layout of a third location, a portion of the layout of a third location, and the complete layout of a third location.
[0068] Third-party data can be stored in a database. Third-party data can be provided to server devices. For example, third-party data can be provided via interface circuitry. Third-party data can be stored within server devices. For example, third-party data can be stored in memory circuitry.
[0069] The third parameter can indicate a third location. The third parameter can indicate one or more areas of a third location. The third parameter can indicate one or more spaces of a third location. The third parameter can indicate the layout of a third location. The third parameter can indicate a portion of the layout of a third location. The third parameter can indicate a portion of the overall layout of a third location. The third parameter can indicate one or more spaces and / or one or more areas of a third location.
[0070] The third parameter can indicate part or all of the layout of the third place, such as spaces and / or areas within the third place. For example, the third parameter can indicate different rooms within the third place. If the third place is a home and / or apartment, the third parameter can indicate one or more of the following: work area, kitchen, bathroom, bedroom, and living room.
[0071] In one or more example server devices, the third parameter includes one or more third regions. A third region may indicate a region of a third location. In one or more example server devices, processor circuitry 302 is configured to associate each of the one or more third regions with a first region among one or more first regions.
[0072] One or more third zones can be one or more of a third space, a third area, and a third room. One or more third zones can be specified by the user. One or more third zones can be specified by artificial intelligence.
[0073] In one or more example server devices, the first location can be an office, the second location can be a home, and the third location can be an apartment. In one or more example server devices, the first location can be a first office location, the second location can be a second office location, and the third location can be a third office location.
[0074] First environmental data and / or combined environmental data can indicate a first location. First environmental data and / or combined environmental data can indicate different spaces within an office. For example, first environmental data and / or combined environmental data and / or first parameters and / or one or more first areas can represent a first office, a second office, and a lounge.
[0075] As an example, the second parameter and / or one or more second areas can indicate different spaces in the home, such as a home office. The second parameter and / or one or more second areas can then be associated with the first environmental data. For example, processor circuitry 302 can be configured to associate a second parameter indicating a workspace in the home and / or one of one or more second areas with the first office in the first environmental data. Processor circuitry 302 can be configured to associate a second parameter and / or one of one or more second areas indicating a kitchen with the lounge area in the first environmental data.
[0076] As an example, a third parameter and / or one or more third zones may indicate different spaces in an apartment, such as those used for remote offices. The third parameter and / or one or more third zones may then be associated with first environmental data and / or combined environmental data. For example, processor circuitry 302 may be configured to associate a third parameter indicating a workspace in an apartment and / or one of one or more third zones with a second office room based on the first environmental data and / or combined environmental data. Processor circuitry 302 may be configured to associate a third parameter and / or one of one or more third zones indicating a kitchen with a lounge area based on the first environmental data and / or combined environmental data.
[0077] Areas and / or parameters from multiple locations can be associated with the same areas in the first environmental data and / or combined environmental data. The kitchens in the second and third locations can both be associated with the lounge areas in the first environmental data and / or combined environmental data.
[0078] Associations can be performed automatically. Associations can also be performed manually. For example, a user can enter information about which rooms are associated with the first location from the second location.
[0079] Combined environmental data can represent a combination of a first location and a second location. Combined environmental data can represent the location and / or area and / or space of a second location mapped to a location of the first location. Combined environmental data can represent one or more of the following: the location, area, and space of a second location mapped to a location of the first location. Combined environmental data can represent a combination of a first location, a second location, and a third location. Combined environmental data can represent the location and / or area and / or space of a second location mapped to a location and / or area and / or space of the first location, and the location of a third location mapped to a location and / or area and / or space of the first location.
[0080] Further parameters indicating further locations can also be determined based on further data. For example, a fourth parameter indicating a fourth location can be determined based on fourth data. The specific number is not limited, and server device 300 can use fifth, sixth, seventh, or more data, parameters, and locations.
[0081] In one or more example server devices, server device 300 is configured to obtain first data. In one or more example server devices, server device 300 is configured to obtain second data. In one or more example server devices, server device 300 is configured to obtain both first and / or second data. In one or more example server devices, server device 300 is configured to obtain third data. In one or more example server devices, server device 300 is configured to obtain both first and / or second and / or third data.
[0082] In one or more example server devices, server device 300 may be configured to acquire first data, second data, and / or third data upon initialization. In one or more example server devices, server device 300 may be configured to acquire first data, second data, and / or third data based on configurations or settings associated with a first location, a second location, and / or a third location. In one or more example server devices, server device 300 may be configured to acquire first data, second data, and / or third data based on user input instructing the configuration. In one or more example server devices, server device 300 may be configured to acquire first data, second data, and / or third data based on detection sensors. In one or more example server devices, server device 300 may be configured to acquire first data, second data, and / or third data based on calibration. In one or more example server devices, server device 300 may acquire first data, second data, and / or third data through artificial intelligence. In one or more example server devices, server device 300 may acquire first data, second data, and / or third data through machine learning. In one or more example server devices, server device 300 can be configured to obtain first data, second data, and / or third data based on clustering, such as identifying the most occupied and / or active areas.
[0083] In one or more example server devices, server device 300 may be configured to acquire first data, second data, and / or third data during one or more of initialization, configuration or setup, user input, sensor detection, calibration, artificial intelligence, machine learning, and clustering associated with a first location, a second location, and / or a third location.
[0084] Server device 300 can be configured to acquire first data, second data, and / or third data via a wired connection. Server device 300 can be configured to acquire first data, second data, and / or third data wirelessly. Server device 300 can be configured to acquire first data, second data, and third data in the same manner. Server device 300 can be configured to acquire first data, second data, and third data in different manners. Server device 300 can be configured to acquire first data, second data, and / or third data via one or more wired and wireless connections.
[0085] Server device 300 can be configured to obtain one or more of first data, second data, and third data from a database. Server device 300 can be configured to obtain one or more of first data, second data, and third data from a user device. Server device 300 can be configured to obtain one or more of first data, second data, and third data from a sensor. Server device 300 can be configured to obtain one or more of first data, second data, and third data from an image sensor. Server device 300 can be configured to obtain one or more of first data, second data, and third data from a server. Server device 300 can be configured to obtain one or more of first data, second data, and third data from a user.
[0086] Server device 300 can be configured to obtain one or more of first data, second data, and third data from one or more of a database, user device, sensor, image sensor, server, and user.
[0087] Server device 300 can be configured to manually obtain one or more of the first data, second data, and third data. Server device 300 can also automatically obtain one or more of the first data, second data, and third data.
[0088] In one or more example server devices, processor circuitry 302 is configured to generate avatar parameters indicating a person in a second or first location based on sensor data. In one or more example server devices, processor circuitry 302 is configured to generate avatar parameters. This generation may be based on sensor data. Avatar parameters may indicate a person in a second location. Avatar parameters may indicate a person in a first location. In one or more example server devices, processor circuitry 302 is configured to associate avatar parameters with composite environmental data. The composite environmental data can be updated using the avatar parameters. The composite environmental data can be modified using the avatar parameters. For example, avatar parameters may be considered as parameters indicating a person, allowing an avatar user interface object to be displayed on an electronic device based on the avatar parameters.
[0089] An avatar parameter can indicate a person. An avatar parameter can represent a person. An avatar parameter can indicate a person's state. An avatar parameter can indicate a person's location. An avatar parameter can indicate a person's position. An avatar parameter can indicate a person's position within a first or second location. An avatar parameter can indicate an avatar.
[0090] In one or more example server devices, the sensor data includes position sensor data and / or image sensor data and / or activity sensor data. In one or more example server devices, the sensor data includes position sensor data. In one or more example server devices, the sensor data includes image sensor data. The sensor data may include pose or posture data. In one or more example server devices, the sensor data includes activity sensor data. In one or more example server devices, the avatar parameters include activity parameters based on the sensor data.
[0091] In one or more example server devices, server device 300 can be configured to determine activity parameters. Activity parameters can indicate a person's activity. For example, an activity can include one or more of the following: movement, location, actions (such as drinking, talking, discussing, typing, sleeping, resting, and / or engaging in telephone conversations and / or conference calls). Activity parameters can indicate a person's location. Activity parameters can indicate a person's place. Activity parameters can indicate a person's movement. Server device 300 can be configured to provide notifications based on activity parameters.
[0092] Processor circuit 302 can be configured to compare a user's activity parameters with the activity parameters of another user. Processor circuit 302 can be configured to generate a notification based on a determination that the user's activity parameters are the same as the activity parameters of another user. Processor circuit 302 can be configured not to generate a notification based on a determination that the user's activity parameters are different from the activity parameters of another user.
[0093] Assessing the availability of another person (such as a colleague) through situational and / or contextual evaluation can be advantageous. For example, when a colleague is engaged in a discussion or focused on a task, one might choose to approach that colleague later. In virtual or remote work environments, these social cues can be lost, and it can be difficult to assess when a colleague is available. While applications such as social network messengers provide availability status by displaying "available" or "busy," this status is less accurate and less granular, and offers no hints about when a colleague might respond. Furthermore, the status is not always up-to-date and therefore does not reflect current availability. For example, if a meeting ends early, a colleague might forget to update their status to "available."
[0094] In one or more example server devices, the server device may be configured to determine and / or provide information on human availability and response time. Furthermore, the server device may be configured to determine and / or provide expected context parameters indicating availability and / or availability context and / or when a response is expected. Additionally, the server device may be configured to determine and / or provide status parameters indicating confidential matters. In one or more examples, activity parameters may include or may be based on context parameters.
[0095] In one or more example server devices, server device 300 can be configured to determine availability parameters. Availability parameters can provide a context-based availability state. Availability parameters can be considered parameters indicating human availability, such as those based on contextual data. Availability parameters can indicate human engagement, such as the degree of human participation in an activity, like talking on a phone. In one or more examples, contextual parameters may include or be based on availability parameters. In one or more example server devices, contextual parameters can be independent of activity parameters and / or availability parameters.
[0096] In one or more sample server devices, availability parameters may be independent of activity parameters. In one or more sample server devices, activity parameters may include and / or include and / or be based on availability parameters.
[0097] Usability parameters can indicate a person's availability. For example, availability parameters can indicate a person's availability based on one or more of the following: not in a meeting, not on a call, not in a video conference, not looking at the screen, and not actively working.
[0098] Availability parameters can indicate a person's unavailability. For example, availability parameters can indicate a person's unavailability based on one or more of the following: in a meeting, on a call, in a video conference, looking at a screen, and actively working.
[0099] In one or more example electronic devices, processor circuitry 302 may be configured to determine a person's gaze time and / or gaze direction, for example, based on acquired sensor data. In one or more example electronic devices, processor circuitry 302 may be configured to determine a person's gaze time and / or gaze direction based on one or more frames of video sensor data and / or image sensor data. In one or more example electronic devices, processor circuitry 302 may be configured to determine whether a person's gaze time and / or gaze direction is on a screen associated with a task.
[0100] Processor circuit 302 can be configured to determine availability parameters indicating the availability of the person based on whether the person is looking at the screen based on the gaze direction during the gaze duration. Processor circuit 302 can also be configured to determine availability parameters indicating the unavailability of the person based on the person looking at the screen based on the gaze direction during the gaze duration.
[0101] The gaze duration can be set by the user. The gaze duration can be predetermined. The gaze duration can be 1 minute, 2 minutes, 3 minutes, 4 minutes, 5 minutes, or 10 minutes. The processor circuitry 302 can be configured to allow the user to shift their gaze away from the screen for a period of time during the gaze duration. The gaze shift time can be 10 seconds, 20 seconds, 30 seconds, 40 seconds, 50 seconds, or 60 seconds. The gaze shift time can be 1 minute, 2 minutes, 3 minutes, or 4 minutes.
[0102] For example, a person might be working and looking at a screen, and the viewing time could be set to 10 minutes. The person might shift their gaze multiple times within a duration below a threshold, such as up to 30 seconds. For example, once the 10 minutes have been reached, processor circuitry 302 can determine an availability parameter indicating the person's unavailability.
[0103] In the example, processor circuitry 302 can be configured to determine an availability parameter indicating the person's unavailability based on whether the person is on a call. In another example, processor circuitry 302 can be configured to determine an availability parameter indicating the person's availability based on whether the person is not on a call.
[0104] In one or more example server devices, processor circuitry 302 can be configured to receive input from a person and can be configured to determine availability parameters indicating the person's availability or inavailability. For example, a person can set a status to busy, and processor circuitry 302 can be configured to determine availability parameters indicating the person's inavailability based on the determination that the status has been set to busy. A person can also set a status to available, and processor circuitry 302 can be configured to determine availability parameters indicating the person's availability based on the determination that the status has been set to available.
[0105] As an example, a person in the second location might be using a video conferencing application. Processor circuitry 302 can be configured to determine that the person is in a meeting. While the person is in a meeting, processor circuitry 302 can determine availability parameters indicating the person's unavailability. Processor circuitry 302 can determine availability parameters indicating the person's availability based on the end of the meeting, such as the calendar meeting ending or the video conferencing application closing.
[0106] As an example, a person in the second location might be typing on an email application. Processor circuitry 302 can determine availability parameters indicating the person's unavailability based on the typing activity. Processor circuitry 302 can also determine availability parameters indicating the person's availability based on the person stopping typing, such as for pause time. Pause time can be the period of time during which the person is not typing, such as 10 seconds, 20 seconds, 30 seconds, 40 seconds, 50 seconds, or 60 seconds.
[0107] As an example, a person in the second location might be reading an article. Processor circuitry 302 can determine an availability parameter indicating the person's unavailability based on the determination that the gaze direction is at a screen associated with the work environment during the gaze duration. Processor circuitry 302 can also determine an availability parameter indicating the person's availability based on the determination that the gaze direction is not at a screen associated with the work environment during the gaze duration.
[0108] Processor circuit 302 can be configured to determine availability parameters based on models such as regression models. Processor circuit 302 can be configured to predict and / or anticipate availability parameters.
[0109] The availability parameter indicating a person's unavailability can be associated with a response parameter. The response parameter can indicate the time period during which a person will respond when the processor circuit 302 determines the availability parameter indicating the person's unavailability. The processor circuit 302 can be configured to receive user input to set the response parameter. The response parameter can be predetermined. The processor circuit 302 can be configured to output the response parameter.
[0110] The processor circuit 302 can be configured to determine response parameters based on a model such as a regression model. The processor circuit 302 can be configured to predict and / or anticipate response parameters.
[0111] Processor circuitry 302 can be configured to determine a privacy state or confidentiality state associated with availability parameters. A privacy state could indicate that the person is in a room with other people. A privacy state could also indicate that the person is in a room with other people not found in the database. The database could be set up with many people authorized to access confidential information.
[0112] For example, processor circuitry 302 can be configured to determine a privacy state associated with an availability parameter related to the unavailability of the person indicating the unavailability.
[0113] As an example, a person in the second location might be in a busy area. Processor circuitry 302 can determine an availability parameter indicating the person's unavailability based on determining that the person is speaking and / or another person in the second location is speaking (e.g., sensor data via a microphone). Processor circuitry 302 can also determine an availability parameter indicating the person's availability based on determining that neither the person nor another person is speaking. Based on determining that the other person is not in the database, processor circuitry 302 can be configured to generate a privacy state associated with the availability parameter indicating the person's unavailability.
[0114] In one or more example server devices, processor circuitry 302 may be configured to block communication with a person, such as chat messages and / or calls, based on the determination of an availability parameter indicating the person's unavailability. In one or more example server devices, processor circuitry 302 may be configured to allow communication with a person based on the determination of an availability parameter indicating the person's availability.
[0115] In one or more example server devices, processor circuitry 302 may be configured to output request-type notifications, such as requests for text messages, audio calls, or video calls, indicating that a request be made to that person based on the determination of availability parameters indicating that person's unavailability. Processor circuitry 302 may be configured to receive input from the person regarding whether to continue the request. Processor circuitry 302 may be configured to compute and / or store and / or output response parameters based on the input received from the person. Processor circuitry 302 may be configured to update and / or train a model (such as a regression machine learning model) based on the input received from the person. For example, the model may predict a response to a request based on availability parameters (such as those indicating user engagement) and / or request type. Processor circuitry 302 may be configured to use the updated model for the following operations. In one or more exemplary server devices, the input to the model and the prediction from the model may be response time, such as response parameters. If a classification model is used, other types of time indicators may also work, such as text notifications: "in one second," "soon," "later," "never."
[0116] For example, a person may be participating in a video conference. Processor circuit 302 can determine availability parameters indicating that person's unavailability. Another person may attempt to call that person in the video conference. Processor circuit 302 can output a request-type notification of an ongoing call to the person in the video conference. That person can provide input to processor circuit 302 to ignore the call. Processor circuit 302 can output response parameters to the person making the call.
[0117] Sensor data can be obtained from one or more sensors that can be placed in a first location and / or a second location and / or a third location. Sensor data can be obtained from an image sensor. Sensor data can come from an optical sensor. Sensor data can come from a position sensor. Sensor data can come from an activity sensor. Sensor data can come from a Bluetooth Low Energy sensor. Sensor data can come from an ultra-wideband sensor. Sensor data can come from a vision sensor. Sensor data can come from a light detection and ranging (LIDAR) sensor. Sensor data can come from a posture detection sensor. Sensor data can be obtained from one or more of the following: a human mobile phone, a human computer, a human tablet, and a human laptop. For example, sensor data can be obtained from a microphone and / or camera on a human mobile phone. Sensor data can be obtained from a microphone and / or camera in the first location and / or the second location.
[0118] In one or more examples, one or more sensors may be one or more of the following: image sensor, optical sensor, position sensor, activity sensor, presence sensor, motion sensor, microphone, Bluetooth Low Energy sensor, ultra-wideband sensor, vision sensor, LIDAR sensor, and attitude detection sensor.
[0119] Sensor data may include audio data. Sensor data may include video data. Sensor data may be location data, such as positioning data. Sensor data may include one or more of the following: audio data, location data, and video data. Sensor data may be received from one or more of the following: mobile phones, laptops, cameras, and telephones. Sensor data may be received by mobile phones. Sensor data may be received by laptops. Sensor data may be received by cameras. Sensor data may be received via telephone. Specific sensors are not limited. Server device 300 may be configured to generate sensor data.
[0120] Sensor data can be acquired continuously. Sensor data can be acquired in real time. Sensor data can be acquired intermittently and / or at intervals. Sensor data can be acquired when a person is using a specific electronic device and / or application.
[0121] In one or more examples, sensor data may be obtained only in certain areas of the first and / or second locations. The sensor data may only cover the area requested by the user. One or more sensors may be installed in certain areas of the first and / or second locations.
[0122] In one or more examples, sensor data may only be available at certain times of the day. For example, sensor data may only be available during working hours.
[0123] One or more sensors can acquire sensor data indicating a person within a first location and / or a second location. Processor circuitry 302 can be configured to generate avatar parameters based on the sensor data. Processor circuitry 302 can be configured to associate the avatar parameters with combined environmental data. For example, the avatar parameters can be associated with a specific location within the combined environmental data.
[0124] As an example, combined environmental data can represent a home associated with an office, such as including one or more of the following: a first office, a second office, and a lounge, with a person residing at home. Combined environmental data can represent a first office. Combined environmental data can represent a second office. Combined environmental data can represent a lounge. Combined environmental data can represent a person residing at home.
[0125] A home may include a workplace associated with a primary office and a kitchen associated with a lounge. Sensors can acquire sensor data indicating a person's location within the home. If the person is in the workplace, processor circuitry 302 can be configured to associate avatar parameters with the primary office, which incorporates environmental data. If the person moves to the kitchen, processor circuitry 302 can be configured to associate avatar parameters with the lounge, which incorporates environmental data.
[0126] In one or more example server devices, processor circuitry 302 is configured to generate a second avatar parameter indicating a second person in a third location based on second sensor data. In one or more example server devices, processor circuitry 302 is configured to generate the second avatar parameter. This generation may be based on the second sensor data. The second avatar parameter may indicate a second person in a second location. The second avatar parameter may indicate a person in a first location. The second avatar parameter may indicate a person in a third location. In one or more example server devices, processor circuitry 302 is configured to associate the second avatar parameter with composite environment data. The composite environment can be updated using the second avatar parameter.
[0127] The second avatar parameter can indicate a second person. The second avatar parameter can represent a second person. The second avatar parameter can indicate the location of the second person. The second avatar parameter can indicate the location of the second person within a first location, a second location, or a third location.
[0128] In one or more example server devices, the second sensor data includes position sensor data and / or image sensor data and / or activity sensor data. In one or more example server devices, the second sensor data includes position sensor data. In one or more example server devices, the second sensor data includes image sensor data. In one or more example server devices, the second sensor data includes activity sensor data.
[0129] Second sensor data can be acquired by one or more sensors. Second sensor data can come from an image sensor. Second sensor data can come from an optical sensor. Second sensor data can come from a position sensor. Second sensor data can come from an motion sensor. Second sensor data can be acquired through one or more of the following: image sensor, optical sensor, position sensor, and motion sensor. Specific sensors are not limited. Second sensor data can be acquired continuously. Second sensor data can be acquired in real time.
[0130] Processor circuit 302 can be configured to generate as many avatar parameters as needed. For example, processor circuit 302 can be configured to generate 1, 2, 3, 4, 5, 6, 7, 8, 9, or 10 avatar parameters. Processor circuit 302 can be configured to generate more than 1, 2, 3, 4, 5, 6, 7, 8, 9, or 10 avatar parameters. Each avatar parameter can indicate a specific person at a specific location. Some locations (e.g., a first location) may include multiple avatar parameters. The number of avatar parameters for each location is not limited.
[0131] In one or more example server devices, a first location may refer to an office. Parameters indicating a second, third, fourth, and fifth location may be associated with first environmental data indicating the first location (office) and / or combined environmental data used to provide and / or update combined environmental data. Therefore, avatars from all locations may be associated with combined environmental data, such as location data for each avatar. The combined environmental data may indicate where each avatar will be located within the first location.
[0132] Processor circuitry 302 can be configured, for example, to output combined environmental data, including all associated avatar parameters, to a user device, such as the electronic devices disclosed herein. The user device can display the basic layout of the office, as well as representative locations of the avatars within the office, even if they are located in different places. Therefore, the user can see whether the avatars are in their office and understand that they are working. The user can see one or more avatars in the break room and feel comfortable interacting with them without feeling that they are interrupting their work.
[0133] In one or more example server devices, processor circuitry 302 is configured to determine a distance parameter. The distance parameter may indicate the distance between an avatar parameter and a second avatar parameter in the combined environment data.
[0134] The distance parameter can indicate the location of the avatar parameter and the second avatar parameter, and / or the distance between the location of a person and the second person. Processor circuitry 302 can be configured to compare the distance parameter with a threshold. This distance can be a physical distance. This distance can be a virtual distance. Processor circuitry 302 can be configured to determine whether the distance parameter is below a threshold. Processor circuitry 302 can be configured to determine whether the distance parameter is not below a threshold. In one or more example server devices, the threshold can be based on an activity parameter. In one or more example server devices, the threshold can be modified based on an activity parameter.
[0135] Processor circuitry 302 can be configured to generate a proximity indicator if the distance parameter is below a threshold. Processor circuitry 302 can also be configured not to generate a proximity indicator if the distance parameter is not below a threshold. The indicator can be a prompt or notification. The proximity indicator can indicate the proximity and / or location of the avatar parameter and the second avatar parameter. In one or more example server devices, the distance parameter can be based on an activity parameter. In one or more example server devices, the distance parameter can be modified based on the activity parameter.
[0136] The threshold can be a region of the combined environment data. For example, if the avatar parameter and the second avatar parameter are in the same region of the combined environment data, the distance between the locations of the avatar parameter and the second avatar parameter may be below the threshold. A proximity indicator indicating the proximity of the avatar parameter and the second avatar parameter within the same region of the combined environment data can be generated. A proximity indicator indicating the proximity of the avatar parameter and the second avatar parameter within the same region of the combined environment data can be generated based on the distance parameter being below the threshold. If the avatar parameter and the second avatar parameter are in different regions of the combined environment, a proximity indicator may not be generated. A proximity indicator indicating the proximity of the avatar parameter and the second avatar parameter within different regions of the combined environment data may not be generated based on the distance parameter not being below the threshold. A proximity indicator can be output. The proximity indicator can be a part of the combined environment data.
[0137] As an example, if the avatar parameter is in the coffee lounge of the combined environment data, the person associated with the avatar parameter can receive a proximity indicator when the second avatar parameter also changes (such as moving from such as server device 300 to the coffee lounge of the combined environment data).
[0138] Processor circuit 302 is configured to generate communication parameters. These communication parameters can indicate communication between the avatar parameter and the second avatar parameter. The communication parameters can also indicate prompts. The communication parameters can be configured to cause the user equipment to display prompts.
[0139] For example, if the person represented by the avatar parameter and the person represented by the second avatar parameter are communicating (such as via telephone call, video chat, etc.), a communication parameter can be generated. Therefore, a third party may see the communication parameter and know not to attempt to communicate with that person or the second person. Server device 300 can be configured to prevent other users from communicating with the person possessing that communication parameter if it is detected.
[0140] Processor circuitry 302 can be configured to generate a movement indicator and / or prompt and / or notification whenever the avatar parameter moves within a region of the combined environment data. The movement indicator can represent a change in the region of the avatar parameter.
[0141] As an example, server device 300 can be configured to generate a combined environment of physical office spaces. A physical office space, such as a first location, may be equipped with one or more presence and / or activity sensors. Server device 100 can be configured to associate and / or map physical office spaces to virtual office spaces. Each employee's (e.g., each person) physical home environment (e.g., a second location) may have appropriate areas equipped with one or more presence and / or activity sensors. Appropriate home areas can be associated and / or mapped to appropriate virtual office areas, such as virtual office areas that combine environmental data.
[0142] One or more sensors in a physical home environment, such as a second location, and an office environment, such as a first location, can record the presence and / or activity of one or more individuals. Associated and / or mapped areas in the combined environment can be populated with specific person avatars, such as using one or more avatar parameters. If a person's activity is registered, the avatar can perform that activity. All users can access the combined environment to see where others are and what they are doing.
[0143] Server device 300 is optionally configured to perform Figures 2A to 2C Any operation disclosed in the above (such as any one or more of S102, S104, S106, S108, S110, S112, S114, S116, S118, S120, S122, S126, S128, S130, S132, S134, S136). In other words, server device 300 can be configured to provide a combined environment. The operation of server device 300 can be embodied in executable logic routines (e.g., lines of code, software programs, etc.) stored on a non-transient computer-readable medium (e.g., memory circuitry 301) and executed by processor circuitry 302.
[0144] Furthermore, the operation of server device 300 can be considered as a method configured to be performed by server device 300. Additionally, while the described functions and operations can be implemented in software, such functions can also be implemented via dedicated hardware or firmware, or some combination of hardware, firmware, and / or software.
[0145] The memory circuit 301 may be one or more of a buffer, flash memory, hard disk drive, removable media, volatile memory, non-volatile memory, random access memory (RAM), or other suitable devices. In a typical arrangement, the memory circuit 301 may include non-volatile memory for long-term data storage and volatile memory used as system memory for the processor circuit 302. The memory circuit 301 may exchange data with the processor circuit 302 via a data bus. Control lines and an address bus may also exist between the memory circuit 301 and the processor circuit 302. Figure 1 (Not shown in the image). Memory circuit 301 is considered a non-transient computer-readable medium.
[0146] The memory circuit 301 can be configured to store information such as one or more of the following in a portion of the memory: first data, second data, third data, position sensor data, image sensor data, activity sensor data, first parameter, second parameter, third parameter, first environmental data, combined environmental data, avatar parameter, second avatar parameter, activity parameter, availability parameter, response parameter, privacy status, distance parameter, proximity indicator, threshold, and communication parameter.
[0147] Figures 2A to 2C A flowchart is shown of an example method 100 for providing a combined environment, executed by a server device of this disclosure. For example, Figure 1 The server device 300 or any other server device disclosed herein may perform method 100.
[0148] In one or more example methods, method 100 may be performed by a server device configured to provide a combined environment. In one or more example methods, method 100 may include determining, S102, a first parameter indicating a first location based on first data. In one or more example methods, method 100 may include generating, S104, first environmental data indicating a first location based on the first parameter. In one or more example methods, method 100 may include determining, S106, a second parameter indicating a second location based on second data. In one or more example methods, method 100 includes associating the second parameter with the first environmental data, S108, to provide combined environmental data. In one or more example methods, method 100 includes outputting, S110, the combined environmental data.
[0149] In one or more example methods, method 100 includes generating, S112, avatar parameters indicating a person in a second or first location based on sensor data. In one or more example methods, method 100 includes associating the avatar parameters with combined environmental data, S114.
[0150] In one or more example methods, the sensor data includes position sensor data and / or image sensor data and / or activity sensor data.
[0151] In one or more example methods, the avatar parameters include activity parameters based on sensor data.
[0152] In one or more example methods, method 100 includes determining a third parameter indicating a third location based on third data, S116. In one or more example methods, method 100 includes associating the third parameter with combined environmental data, S118.
[0153] In one or more example methods, method 100 includes generating S120 a second avatar parameter indicating a second person in a third location based on second sensor data. In one or more example methods, method 100 includes associating the second avatar parameter with combined environmental data S122.
[0154] In one or more example methods, method 100 includes determining a distance parameter S126, which indicates the distance between an avatar parameter and a second avatar parameter in the combined environment data. In one or more example methods, method 100 may include comparing the distance parameter to a threshold. In one or more example methods, method 100 may include determining whether the distance parameter is below a threshold. In one or more example methods, method 100 may include determining whether the distance parameter is not below a threshold.
[0155] In one or more example methods, method 100 includes generating an S128 proximity indicator based on a distance parameter below a threshold. In one or more example methods, method 100 includes not generating an S128 proximity indicator based on a distance parameter not below a threshold.
[0156] In one or more example methods, method 100 includes generating S130 communication parameters that indicate communication between the avatar parameter and the second avatar parameter.
[0157] In one or more example methods, method 100 includes outputting combined environment data S132 to a user device.
[0158] In one or more example methods, the first location is the office and the second location is home.
[0159] In one or more example methods, the combined environmental data includes one or more first regions indicating the areas of the first location.
[0160] In one or more example methods, the second parameter includes one or more second regions indicating the area of the second location. In one or more example methods, method 100 includes associating each of the one or more second regions with one of the one or more first regions, S134.
[0161] In one or more example methods, method 100 includes obtaining S136 first data and / or second data.
[0162] Figure 3 A block diagram of an example electronic device 400 according to this disclosure is shown. The electronic device 400 can be configured to display a composite environment. The electronic device 400 can also be configured to display a virtual composite environment.
[0163] Electronic device 400 includes memory circuit 401. Electronic device 400 includes processor circuit 402. Electronic device 400 includes interface circuit 403. Electronic device 400 includes display circuit 404.
[0164] In one or more example electronic devices, electronic device 400 includes memory circuitry 401. Electronic device 400 includes interface circuitry 403. In one or more example electronic devices, electronic device 400 includes display circuitry 404. In one or more example electronic devices, electronic device 400 includes processor circuitry 402. Electronic device 400 is configured to obtain combined environmental data. In one or more example electronic devices, the combined environmental data indicates a combination of a first location and a second location. In one or more example electronic devices, the combined environmental data may include avatar parameters indicating a person in the second location. In one or more example electronic devices, electronic device 400 may be configured to determine activity parameters associated with the avatar parameters. In one or more example electronic devices, electronic device 400 may be configured to obtain updated avatar parameters indicating a person in the second location based on the activity parameters. In one or more example electronic devices, electronic device 400 displays a first user interface object representing the updated avatar parameters. Electronic device 400 is configured to display a second user interface object representing the combined environmental data.
[0165] In one or more example electronic devices, electronic device 400 can be a user device and / or a display device. In one or more example electronic devices, electronic device 400 can be one or more of a monitor, tablet computer, mobile phone, smartphone, laptop computer, visor, projector, and computer. In one or more example electronic devices, electronic device 400 can be a monitor. In one or more example electronic devices, electronic device 400 can be a tablet computer. In one or more example electronic devices, electronic device 400 can be a mobile phone, such as a smartphone. In one or more example electronic devices, electronic device 400 can be a laptop computer. In one or more example electronic devices, electronic device 400 can be a computer. In one or more example electronic devices, electronic device 400 can be a visor. In one or more example electronic devices, electronic device 400 can be a projector. In one or more example electronic devices, electronic device 400 can be configured to provide virtual reality images.
[0166] Electronic device 400 may be located at a first location and / or a second location.
[0167] Electronic device 400 can be configured to obtain combined environmental data from another electronic device. Electronic device 400 can be configured to obtain combined environmental data from a server device, such as server device 300.
[0168] Electronic device 400 can be configured to generate sensor data. Sensor data may include audio data. Sensor data may include video data. Sensor data may include one or more of the following: audio data and video data. Sensor data may be location data, such as positioning data. Electronic device 400 can be configured to determine activity parameters and / or availability parameters.
[0169] Electronic device 400 can be configured to provide second data. For example, electronic device 400 can provide second data to server devices, such as server device 300.
[0170] Electronic device 400 can be configured to determine a second parameter indicating a second location based on second data. Electronic device 400 can be configured to provide the second parameter. For example, electronic device 400 can provide the second parameter data to a server device, such as server device 300.
[0171] Activity parameters can indicate the activities of a person indicated by avatar parameters. Activity parameters can be based on sensor data. Whenever a person indicated by avatar parameters performs an activity, electronic device 400 can be configured to obtain updated avatar parameters indicating the person in the second location. For example, if the person moves, the avatar parameters can be updated to indicate the user's new location. If the person is holding electronic device 400 (such as a mobile phone), the electronic device can be configured to determine the person's activity parameters.
[0172] Electronic device 404 can be configured to display one or more user interface objects. Display circuitry 404 can be a screen. For example, a screen can be a screen included in a mobile phone, such as a smartphone screen. Display circuitry 404 can be a touchscreen. Display circuitry 404 can be a monitor. Display circuitry 404 can be a viewing screen. Display circuitry 404 can be one or more of the following: screen, touchscreen, monitor, and viewing screen.
[0173] A user interface object here refers to a graphical representation of an object displayed on a display of electronic device 400 (such as via display circuitry 404). A user interface object can be interactive with the user or can be selected by user input. For example, images (e.g., icons), buttons, and text (e.g., hyperlinks) may each optionally constitute a user interface object. A user interface object can form part of a widget. A widget can be considered a mini-application that can be used by the user and created by the user. A user interface object may include prompts, application launch icons, and / or action menus. In one or more examples, a user interface object may represent an avatar of a person, such as representing avatar parameters.
[0174] Display circuitry 404 can be configured to display visual output to a user. Visual output may optionally include graphics, text, icons, video, and any combination thereof (collectively, "graphics"). For example, some or all of the visual output may be considered to correspond to user interface objects.
[0175] The processor circuitry 402 of the electronic device 400 can be configured to display one or more user interfaces, such as user interface screens, on a display, including a first user interface and / or a second user interface. The user interface may include one or more user interface objects, such as a plurality of user interface objects. For example, the first user interface may include the first user interface object and / or the second user interface object disclosed herein.
[0176] User interface objects, such as a first user interface object and / or a second user interface object, can represent avatar parameters and / or combined environment data.
[0177] The first user interface object may include an icon representing a person and / or an image of a person represented by the updated avatar parameters. The first user interface object may be a number indicating a person represented by the updated avatar parameters. The first user interface object may be a placeholder indicating a person represented by the updated avatar parameters. The first user interface object may be two-dimensional and / or three-dimensional.
[0178] The first user interface object can represent an electronic device 400. The first user interface object can also represent a person who has the electronic device 400.
[0179] A second user interface object can indicate combined environmental data. For example, a second user interface object can display the layout of an office, such as including different areas, rooms, or locations. The layout can include a first user interface object. The first user interface object can be within one of the different areas, rooms, or locations of the second user interface object. The second user interface object can be two-dimensional and / or three-dimensional.
[0180] The first user interface object may represent the electronic device 400 and / or the associated person and be displayed relative to the second user interface object. In one or more example electronic devices, a person may be able to view their location relative to combined environmental data.
[0181] For example, electronic device 400 could be a mobile phone, such as a smartphone held by a person. The person would be able to see a combination of a first location and a second location displayed on the display circuitry or screen of the mobile phone or smartphone. For example, the second location could be the person's home, while the first location could be the person's office. The person could then see their own avatar (such as a first user interface object) displayed on the combination of the first and second locations (such as a second user interface object displayed on the mobile phone (such as a smartphone)). The person could also see other colleagues' avatars (such as other user interface objects) displayed on the display circuitry (such as a smartphone screen).
[0182] In one or more example electronic devices, electronic device 400 is configured to receive user input associated with a first user interface object representation. In one or more example electronic devices, electronic device 400 is configured to receive user input associated with a second user interface object representation. In one or more example electronic devices, electronic device 400 is configured to receive user input associated with a first user interface object representation and / or a second user interface object representation.
[0183] For example, user input can be the selection of a user interface object. User input can be touch input, such as tapping. User input can be keyboard input. User input can be wireless input. User input such as first user input and / or second user input can include touch (e.g., tapping, firm touch, long press) and / or movement of contact (e.g., swipe gestures, such as for toggling). Movement during contact can be detected by a touch-sensitive surface, for example, on display circuitry 404 of electronic device 400. Therefore, display circuitry 404 can be a touch-sensitive display. User input such as first user input and / or second user input can include lift-off. User input such as first user input and / or second user input can include touch and movement, followed by lift-off. For example, a person can use the touchscreen of a smartphone to provide user input.
[0184] In one or more example electronic devices, user input is configured to perform one or more of the following: interaction, communication, and movement. In one or more example electronic devices, user input is configured to perform one or more of the following: interaction, communication, and movement of avatar parameters and / or updated avatar parameters. In one or more example electronic devices, user input is configured to perform activities of avatar parameters and / or updated avatar parameters.
[0185] In one or more example electronic devices, electronic device 400 is configured to display a third user interface object representing a notification.
[0186] Third-user interface objects can be images. Third-user interface objects can be both sound and images. Third-user interface objects can be two-dimensional and / or three-dimensional. Users can see the third-user interface objects displayed on the smartphone screen.
[0187] In one or more example electronic devices, electronic device 400 is configured to display a fourth user interface object representing activity parameters and / or availability parameters. In one or more example electronic devices, electronic device 400 is configured to display a fourth user interface object representing availability parameters, such as including response parameters and / or privacy status. In one or more example electronic devices, electronic device 400 is configured to display a fourth user interface object representing activity parameters.
[0188] A fourth user interface object can be an image. A fourth user interface object can be both sound and image. A fourth user interface object can be two-dimensional and / or three-dimensional. Users can see the fourth user interface object displayed on the smartphone screen.
[0189] Electronic device 400 is optionally configured to perform Figure 3Any operation disclosed in the process (such as any one or more of S202, S204, S206, S208, S210, S212). In other words, electronic device 400 can be configured to provide a combined environment. The operation of electronic device 400 can be embodied in the form of executable logic routines (e.g., lines of code, software programs, etc.) stored on a non-transitory computer-readable medium (e.g., memory circuitry 401) and executed by processor circuitry 402.
[0190] Furthermore, the operation of electronic device 400 can be considered as a method configured to be performed by electronic device 400. Additionally, while the described functions and operations can be implemented in software, such functions can also be implemented via dedicated hardware or firmware, or some combination of hardware, firmware, and / or software.
[0191] The memory circuit 401 may be one or more of a buffer, flash memory, hard disk drive, removable media, volatile memory, non-volatile memory, random access memory (RAM), or other suitable devices. In a typical arrangement, the memory circuit 401 may include non-volatile memory for long-term data storage and volatile memory used as system memory for the processor circuit 402. The memory circuit 401 may exchange data with the processor circuit 402 via a data bus. Control lines and an address bus may also exist between the memory circuit 401 and the processor circuit 402. Figure 3 (Not shown in the image). The memory circuit 401 is considered a non-transitory computer-readable medium.
[0192] Memory circuit 401 can be configured to store information such as one or more of the following in a portion of the memory: combined environment data, avatar parameters, activity parameters, updated avatar parameters, a first user interface object, a second user interface object, user input, and a third user interface object. Memory circuit 401 can be configured to store information such as combined environment data. Memory circuit 401 can be configured to store information such as avatar parameters. Memory circuit 401 can be configured to store information such as activity parameters. Memory circuit 401 can be configured to store information such as updated avatar parameters. Memory circuit 401 can be configured to store information such as a first user interface object. Memory circuit 401 can be configured to store information such as a second user interface object. Memory circuit 401 can be configured to store information such as user input. Memory circuit 401 can be configured to store information such as a third user interface object.
[0193] Figure 4 A flowchart of an example method 400 performed by an electronic device of this disclosure is shown. For example, Figure 3The electronic device 400 or any other electronic device disclosed herein may perform method 200.
[0194] In one or more example methods, method 200 may be performed by an electronic device. In one or more example methods, method 200 includes obtaining combined environmental data in step S202. In one or more example methods, the combined environmental data may indicate a combination of a first location and a second location. In one or more example methods, the combined environmental data may include avatar parameters indicating a person in the second location. In one or more example methods, method 200 may include determining activity parameters associated with the avatar parameters in step S204. In one or more example methods, method 200 may include obtaining updated avatar parameters indicating a person in the second location based on the activity parameters in step S206. In one or more example methods, method 200 includes displaying a first user interface object representing the updated avatar parameters and a second user interface object representing the combined environmental data in step S208.
[0195] In one or more example methods, method 200 includes receiving user input associated with a first user interface object representation and / or a second user interface object representation in S210.
[0196] In one or more example methods, user input is configured to perform one or more of the following: interaction, communication, and movement.
[0197] In one or more example methods, method 200 includes displaying a third user interface object representing a notification, as shown by S212.
[0198] Figure 5 A schematic diagram of an example scenario including the example server device of this disclosure is shown.
[0199] As shown in the figure, a first parameter of a first location (such as a physical office 550) is configured to be determined by the processor circuitry 302 of the server device 300 based on first data 510. A second parameter of a second location 500 (such as a physical apartment) is configured to be determined by the processor circuitry 302 of the server device 300 based on second data 512.
[0200] The processor circuitry 302 of the server device 300 is configured to generate first environmental data indicating a first location 550 based on first data 510. The processor circuitry 302 of the server device 300 is configured to associate a second parameter with the first environmental data to provide combined environmental data 310. The processor circuitry 302 of the server device 300 is configured to output the combined environmental data 310, such as via interface circuitry 303.
[0201] The first location 550 and / or the second location 500 may each include one or more sensors 504A / 504B. The sensors 504A / 504B may determine first data 510 and second data 512, respectively, and the server device 300 may be configured to obtain the first data 510 and the second data 512.
[0202] As shown in the figure, the second location 500 may include a person 502, a desk area 506, and a kitchen 508. The processor circuitry 302 of the server device 300 is configured to associate a second parameter based on second data 512 with first environmental data based on a first parameter to provide combined environmental data 310.
[0203] For example, the processor circuitry 302 of server device 300 can be configured to associate a desk area 506 of the second location 500 with a first office area 552 of the first location 550, such as a map. The processor circuitry 302 of server device 300 can also be configured to associate a kitchen 508 of the second location 500 with a coffee lounge 554 of the first location 550, such as a map.
[0204] Figure 6 A schematic diagram of an example electronic device according to this disclosure is shown. Electronic device 400 (such as a user device configured to display user interface 600) is configured to obtain combined environmental data 310. Electronic device 400 may be configured to obtain combined environmental data 310 from a server device, such as server device 300. Electronic device 400 is configured to display one or more user interface objects, such as via display circuitry 404 for providing user interface 600. Electronic device 400 may be a mobile phone, such as a smartphone, for example, having a screen for displaying user interface 600.
[0205] As shown in the figure, electronic device 400 is configured to display a first user interface object 602 (such as an avatar representing avatar parameters and / or an updated avatar parameter indicating a person 502 associated with a first location 500, such as being mapped to the first location) on user interface 600. Electronic device 400 may be located at the first location. Electronic device 400 is configured to display a second user interface object 603 representing combined environment data 310 on user interface 600. Electronic device 400 may be configured to display a third user interface object 605 representing a notification on user interface 600. Electronic device 400 may be configured to display a fourth user interface object 607 representing activity parameters and / or context parameters and / or availability parameters on user interface 600. The notification may indicate that another person represented by the user interface object requests communication. The first user interface object 602 and / or the second user interface object 603 and / or the third user interface object 605 and / or the fourth user interface object 607 may form part of user interface 600, such as a user interface screen.
[0206] As shown in the figure, the first user interface object 602 is located in region 612 of the user interface 600. Based on the combined environment data 310, the user interface object 612 represents as... Figure 5 The first location, the desk area of 500, and the area of 506 (such as...) Figure 5 The first location 550, the first office area 552), has been agreed upon with the relevant authorities. Figure 5 The first environmental data of the first office area 552 is associated. The user interface object 612 can be the second user interface object 603.
[0207] Based on the combined environment data 31, the user interface object 614 represents, for example, the environment data 31, the user interface object 614. Figure 5 The first location is the coffee lounge area at 550, which is also located at 554. Figure 5 The first location, kitchen 508, and the representation Figure 5 The first environmental data of the coffee rest area 554 is associated with it. The user interface object 614 may be part of the second user interface object 603.
[0208] If person 502 moves to kitchen 508, electronic device 400 is configured to receive instructions based on activity parameters (such as those from server device 300). Figure 5 The updated avatar parameters for Person 502. Activity parameters can be based on... Figure 5 Sensor data from sensor 504A. Electronic device 400 is configured to display a first user interface object 602 representing the updated avatar parameters in the area represented by user interface object 614.
[0209] Further locations and people may optionally be associated with the user interface 600, including multiple user interface objects 604, 606 (such as avatars). The complete workplace (such as that included in the combined environmental data 310) may be displayed on the user device 400, such as on the user interface 600, even if these people may be located in many different places.
[0210] Users may be able to see whether other user interface objects (such as avatars) are in the area represented by user interface object 614 (such as user interface object 606), which can provide an understanding that the person represented by user interface object 606 is communicable. A notification represented by user interface object 605 may be displayed to indicate the availability or desire for communication between the people represented by 606 and 602. User interface 600 can be configured to display a third user interface object 605 when both the first user interface object 602 and user interface object 606 are displayed in the area represented by user interface object 614. User interface 600 can be configured to display a fourth user interface object 607, such as when the user is busy with an activity indicated by an activity parameter, and / or context parameters and / or availability parameters, such as a telephone call.
[0211] Examples of methods and products (electronic devices and / or server devices) based on this disclosure are listed in the following items:
[0212] Item 1. A server device configured to provide a combined environment, the server device comprising:
[0213] Memory circuits;
[0214] Interface circuit; and
[0215] The processor circuit, wherein the processor circuit is configured as follows:
[0216] Based on the first data, determine the first parameter indicating the first location;
[0217] First environmental data indicating the first location is generated based on the first parameter;
[0218] Based on the second data, determine the second parameter indicating the second location;
[0219] The second parameter is correlated with the first environmental data to provide combined environmental data; and
[0220] Output combined environment data.
[0221] Project 2. The server device according to Project 1, wherein the processor circuit is configured as follows:
[0222] Generate avatar parameters indicating a person in a second or first location based on sensor data; and
[0223] Associate avatar parameters with combined environment data.
[0224] Project 3. The server device according to Project 2, wherein the sensor data includes position sensor data and / or image sensor data and / or activity sensor data.
[0225] Project 4. The server device according to Project 2 or Project 3, wherein the avatar parameters include activity parameters based on the sensor data.
[0226] Item 5. The server device according to any one of Items 1-4, wherein the processor circuitry is configured as follows:
[0227] Based on third data, a third parameter indicating a third location is determined; and
[0228] The third parameter is associated with the combined environmental data.
[0229] Project 6. The server device according to Project 5, wherein the processor circuit is configured as follows:
[0230] Based on the data from the second sensor, parameters indicating the second person's second avatar in the third location are generated; and
[0231] Associate the second avatar parameters with the combined environment data.
[0232] Project 7. The server device according to Project 6, wherein the processor circuitry is configured to determine a distance parameter indicating the distance between the avatar parameter and the second avatar parameter in the combined environmental data.
[0233] Item 8. The server device according to Item 7, wherein the processor circuitry is configured to generate a proximity indicator based on the distance parameter being below a threshold.
[0234] Item 9. The server device according to any one of Items 6-8, wherein the processor circuitry is configured to generate communication parameters indicating communication between the avatar parameter and the second avatar parameter.
[0235] Item 10. The server device according to any one of items 1-9, wherein the processor circuitry is configured to output the combined environment data to a user device.
[0236] Item 11. The server device according to any one of Items 1-10, wherein the first location is an office and the second location is a home.
[0237] Item 12. The server device according to any one of Items 1-11, wherein the combined environmental data includes one or more first areas indicating the area of the first location.
[0238] Item 13. The server device according to Item 12, wherein the second parameter includes one or more second regions indicating the area of the second location, and wherein the processor circuitry is configured to associate each of the one or more second regions with a first region among the one or more first regions.
[0239] Item 14. The server device according to any one of items 1-13, wherein the server device is configured to obtain the first data and / or the second data.
[0240] Item 15. An electronic device, the electronic device comprising:
[0241] Memory circuits;
[0242] Interface circuit;
[0243] Display circuit; and
[0244] Processor circuitry;
[0245] The electronic devices are configured as follows:
[0246] - Obtain combined environmental data, wherein the combined environmental data indicates a combination of a first location and a second location, and wherein the combined environmental data includes avatar parameters indicating a person in the second location;
[0247] - Determine the activity parameters related to the avatar parameters;
[0248] - Obtain updated avatar parameters indicating the person in the second location based on activity parameters; and
[0249] - Displays a first user interface object representing the updated avatar parameters and a second user interface object representing the combined environment data.
[0250] Item 16. The electronic device according to Item 15, wherein the electronic device is configured to receive user input associated with the first user interface object representation and / or the second user interface object representation.
[0251] Item 17. An electronic device according to any one of items 15-16, wherein the user input is configured to perform one or more of interaction, communication, and movement.
[0252] Item 18. An electronic device according to any one of items 15-17, wherein the electronic device is configured to display a third user interface object representing a notification.
[0253] Item 19. An electronic device according to any one of items 15-18, wherein the electronic device is a mobile phone.
[0254] Item 20. A method performed by a server device configured to provide a combined environment, the method comprising:
[0255] - Determine (S102) a first parameter indicating the first location based on the first data;
[0256] - Generate first environmental data indicating the first location based on the first parameter (S104);
[0257] - Determine (S106) the second parameter indicating the second location based on the second data;
[0258] - Associate the second parameter with the first environmental data (S108) to provide combined environmental data; and
[0259] - Output (S110) Combined environmental data.
[0260] Item 21. The method according to Item 20, the method comprising:
[0261] - Generate (S112) representations of avatar parameters for a person in the second or first location based on sensor data; and
[0262] - Associate the avatar parameters with the combined environment data (S114).
[0263] Item 22. The method according to Item 21, wherein the sensor data includes position sensor data and / or image sensor data and / or activity sensor data.
[0264] Item 23. The method according to Item 21 or 22, wherein the avatar parameters include activity parameters based on the sensor data.
[0265] Item 24. The method according to any one of items 20-23, said method comprising:
[0266] - Based on the third data, determine (S116) the third parameter indicating the third location; and
[0267] - Associate the third parameter with the combined environment data (S118).
[0268] Item 25. The method described in Item 24, the method comprising:
[0269] - Generate (S120) parameters indicating the second person's second avatar in the third location based on data from the second sensor; and
[0270] - Associate the second avatar parameter with the combined environment data (S122).
[0271] Item 26. The method according to Item 25, the method comprising determining (S126) a distance parameter indicating the distance between an avatar parameter and a second avatar parameter in combined environmental data.
[0272] Item 27. The method according to Item 26, wherein, based on the distance parameter being below a threshold, the method includes generating (S128) a proximity indicator.
[0273] Item 28. The method according to any one of items 25-27, the method comprising: generating (S130) communication parameters indicating communication between the avatar parameter and the second avatar parameter.
[0274] Item 29. The method according to any one of items 20-28, the method comprising: outputting the combined environment data (S132) to a user equipment.
[0275] Item 30. The method according to any one of items 20-29, wherein the first location is an office and the second location is a home.
[0276] Item 31. The method according to any one of items 20-30, wherein the combined environmental data includes one or more first areas indicating the area of the first location.
[0277] Item 32. The method according to Item 31, wherein the second parameter includes one or more second regions indicating the area of the second location, and the method includes: associating each of the one or more second regions with a first region of the one or more first regions (S134).
[0278] Item 33. The method according to any one of items 20-32, the method comprising: obtaining (S136) the first data and / or the second data.
[0279] Item 34. A method performed by an electronic device, the method comprising:
[0280] - Obtain (S202) combined environmental data, wherein the combined environmental data indicates a combination of the first location and the second location, and wherein the combined environmental data includes avatar parameters indicating the person in the second location;
[0281] - Determine (S204) the activity parameters associated with the avatar parameters;
[0282] - Based on the activity parameters, obtain (S206) the updated avatar parameters indicating the person in the second location; and
[0283] - Display (S208) a first user interface object representing the updated avatar parameters and a second user interface object representing the combined environment data.
[0284] Item 35. The method according to Item 34, the method comprising: receiving (S210) user input associated with the first user interface object representation and / or the second user interface object representation.
[0285] Item 36. The method according to any one of items 34-35, wherein the user input is configured to perform one or more of interaction, communication, and movement.
[0286] Item 37. The method according to any one of items 34-36, the method comprising: displaying (S212) a third user interface object representing a notification.
[0287] The use of terms such as "first," "second," "third," and "fourth," "primary," "secondary," and "third," etc., does not imply any specific order, but is included to identify individual elements. Furthermore, the use of terms such as "first," "second," "third," and "fourth," "primary," "secondary," and "third place," etc., does not indicate any order or importance, but is used to distinguish one element from another. Please note that the terms "first," "second," "third," and "fourth," "primary," "secondary," and "third place," etc., used here and elsewhere, are for labelling purposes only and are not intended to indicate any specific spatial or temporal order. Moreover, the labeling of a first element does not imply the existence of a second element, and vice versa.
[0288] Understandable, Figures 1 to 6 This includes some circuits or operations shown in solid lines and some circuits or operations shown in dashed lines. The circuits or operations included in solid lines are those included in the most extensive examples. The circuits or operations included in dashed lines are examples that can be included or partially included, or further circuits or operations that can be employed in addition to the circuits or operations shown in solid lines. It should be understood that these operations do not need to be performed in the order presented. Furthermore, it should be understood that not all operations need to be performed. The example operations can be performed in any order and in any combination.
[0289] It should be noted that the word "including" does not necessarily exclude the presence of other elements or steps besides those listed.
[0290] It should be noted that the word "one" or "a" preceding an element does not preclude the existence of multiple such elements.
[0291] It should also be noted that any reference numerals in the drawings do not limit the scope of the claims, examples may be implemented at least in part by hardware and software, and several “apparatus”, “units” or “devices” may be referred to as the same hardware item.
[0292] The various example methods, devices, nodes, and systems described herein are described in the general context of method steps or processes that, in one aspect, can be implemented by a computer program product embodied in a computer-readable medium, including computer-executable instructions, such as program code, that are executed by a computer in a networked environment. Computer-readable media can include removable and non-removable storage devices, including but not limited to read-only memory (ROM), random access memory (RAM), compact discs (CDs), digital versatile discs (DVDs), etc. Typically, program circuitry can include routines, programs, objects, components, data structures, etc., that perform a particular task or implement a particular abstract data type. The computer-executable instructions, associated data structures, and program circuitry represent examples of program code for performing steps of the methods disclosed herein. A particular sequence of such executable instructions or associated data structures represents examples of corresponding actions for implementing the functions described in these steps or processes.
[0293] Although features have been shown and described, it should be understood that they are not intended to limit the claimed disclosure, and it will be apparent to those skilled in the art that various changes and modifications can be made without departing from the scope of this disclosure. Therefore, the specification and drawings are to be considered illustrative rather than restrictive. The claimed disclosure is intended to cover all alternatives, modifications, and equivalents.
Claims
1. A server device configured to provide a combined environment, the server device comprising: Memory circuits; Interface circuit; as well as Processor circuitry, wherein the processor circuitry is configured to: Based on the first data, a first parameter indicating a first physical location is determined, wherein the first parameter indicates at least a plurality of areas and a plurality of objects at the first physical location; First environmental data indicating the first physical location is generated based on the first parameter; A second parameter indicating a second physical location is determined based on the second data, wherein the second parameter indicates at least multiple areas and multiple objects at the second physical location; Receive input from a user, the input from the user defining that a single area of a plurality of areas of the second physical location will be associated with a single area of a plurality of areas of the first physical location; Associating a single area of the second physical location with a single area of the first physical location; Combined environmental data is generated based on the association between a single area of the second physical location and a single area of the first physical location, such that at least a portion of multiple objects in the single area of the second physical location are merged with the single area of the first physical location to provide the combined environmental data, which indicates a combination of the first and second physical locations; and Output the combined environmental data.
2. The server device according to claim 1, wherein, The processor circuit (302) is configured as follows: Generate avatar parameters based on sensor data to indicate the person in the second physical location or the first physical location; and The avatar parameters are associated with the combined environmental data.
3. The server device according to claim 2, wherein, The sensor data includes position sensor data and / or image sensor data and / or motion sensor data.
4. The server device according to claim 2 or 3, wherein, The avatar parameters include activity parameters based on the sensor data.
5. The server device according to claim 1, wherein, The processor circuit is configured as follows: Based on the third data, a third parameter indicating the third physical location is determined; and The third parameter is associated with the combined environmental data.
6. The server device according to claim 5, wherein, The processor circuit is configured as follows: Based on the data from the second sensor, generate second avatar parameters indicating the second person in the third physical location; and The second avatar parameter is associated with the combined environmental data.
7. The server device according to claim 6, wherein, The processor circuitry is configured to determine a distance parameter that indicates the distance between the avatar parameter and the second avatar parameter in the combined environmental data.
8. The server device according to claim 7, wherein, If the distance parameter is below a threshold, the processor circuit is configured to generate a proximity indicator.
9. The server device according to any one of claims 6 to 8, wherein, The processor circuit is configured to determine a distance parameter in the combined environment that indicates the distance between a first avatar parameter and a second avatar parameter, the first avatar parameter indicating a person in a first physical location and the second avatar parameter indicating a person in a second physical location, wherein, based on the distance parameter being below a threshold, a proximity indicator indicating that the first avatar parameter and the second avatar parameter are located in the same area of the combined environment is generated.
10. The server device according to claim 1, wherein, Individual regions of the first physical location and individual regions of the second physical location were detected using density-based spatial clustering DBSCAN with a noisy application.
11. The server device according to claim 2, wherein, The first physical location is an office building, a single area of the first physical location is an employee's office, and the second physical location is the employee's home. The processor circuitry is configured to associate the employee's home office with the employee's office in the office building, such that when a user enters a single area of the second physical location, the user's avatar is visualized in the combined environmental data as being located in the single area of the first physical location.
Citation Information
Patent Citations
Extended mixed multimedia reality platform
US10721280B1
Systems and methods for generating recommendations based on a virtual environment
US20170006343A1