HK1232969B - Systems and methods for location-based control of equipment and facility resources - Google Patents

Description

Systems and methods for controlling equipment and facility resources based on location

Technical Field

The present invention relates to systems and methods for controlling equipment and facility resources based on location.

Background Art

Field workers and other mobile users rely on automation-based industrial control systems (ICS), including supervisory control and data acquisition (SCADA) systems, building management systems (BMS), building automation systems (BAS), human-machine interfaces (HMI), or manufacturing execution systems (MES), to perform their tasks while working indoors or outdoors, and cannot easily access information based on their location and job function on their mobile devices. Traditional solutions rely on remote desktop services and web browsers to provide a remote view that simulates the host ICS. Using traditional solutions, it can be difficult and time-consuming for users to navigate and filter the remote view of the host system for the desired action on their mobile device, given the wide range of data, commands, actions, and messages available on the host system.

Summary of the Invention

According to one aspect of the present invention, a method for controlling equipment and facility resources via a user's mobile device based on location is provided, the method comprising the following steps: using a location sensor to detect location information of a user within or near a facility; wirelessly transmitting the location information from the user's mobile device to a server; determining one or more actions that the user can use based on the location information, the one or more actions representing actions that can be used in an industrial control system application, i.e., an ICS application; and wirelessly transmitting to the mobile device instructions for causing the mobile device to display the one or more actions determined for the user in a user interface, the user interface enabling the user to receive messages and to interact with equipment or facility resources located near the user by interacting with one or more actions displayed in the user interface.

According to another aspect of the present invention, a system for controlling equipment and facility resources via a user's mobile device based on location is provided, the system comprising: a server; a mobile device that wirelessly communicates with the server, wherein the mobile device is configured to use a location sensor to detect location information of a user in or near a facility, and transmit the location information to the server, and the server is configured to determine one or more messages or one or more actions that the user can use based on the location information, and wirelessly transmit instructions to the mobile device to enable the mobile device to display the one or more actions determined for the user in a user interface, the one or more actions representing actions that can be used in an industrial control system application, i.e., an ICS application, and the user interface enables the user to receive messages and to interact with equipment or facility resources located near the user by interacting with one or more actions displayed in the user interface.

According to another aspect of the present invention, a non-transitory computer-readable medium is provided for storing instructions capable of being executed by a processing device, the instructions being used to implement a method for controlling equipment and facility resources via a user's mobile device based on location, the method comprising the following steps: using a location sensor to detect location information of a user within or near a facility; wirelessly transmitting the location information from the user's mobile device to a server; determining one or more actions that the user can use based on the location information, the one or more actions representing actions that can be used in an industrial control system application, i.e., an ICS application; and wirelessly transmitting to the mobile device instructions for causing the mobile device to display the one or more actions determined for the user in a user interface, the user interface enabling the user to receive messages and to interact with equipment or facility resources located near the user by interacting with one or more actions displayed in the user interface.

BRIEF DESCRIPTION OF THE DRAWINGS

Some embodiments are shown by way of example in the accompanying drawings and these embodiments should not be interpreted as limiting the present invention:

FIG1 is a block diagram illustrating a location-based control and automation system implemented in modules according to an example embodiment;

2 is a flow chart illustrating an example method for providing control of equipment and facility resources via a user's mobile device based on the user's location according to an example embodiment;

3 is a schematic diagram of an example system for providing a user with control of equipment or facility resources via a mobile device according to an example embodiment;

FIG4 is a diagram illustrating data flow in a location-based control and automation system according to an example embodiment.

5A is a schematic diagram for describing an example system architecture for a location-based automation and control system according to an example embodiment;

5B is a diagram illustrating data flow in the example system architecture of FIG. 5A according to an example implementation;

6A is a diagram illustrating a floor layout in a building for implementing a location-based automation and control system according to an example embodiment;

FIG6B is a diagram illustrating a screen of a user's mobile device on the floor depicted in FIG6A according to an example embodiment; ...

7A is a diagram illustrating a floor layout in a building for implementing a location-based automation and control system according to an example embodiment;

7B is a diagram illustrating a screen of a user's mobile device on the floor depicted in FIG. 7A according to an example embodiment;

8 is a diagram illustrating a floor layout in a building for implementing a location-based automation and control system and screens of mobile devices of two users on the floor according to an example embodiment;

FIG9 illustrates a network diagram for describing a system for implementing a location-based automation and control system according to an example embodiment.

FIG10 is a block diagram of an exemplary computing device that may be used to implement an exemplary embodiment of the location-based automation and control systems described herein; and

11 is a block diagram of an exemplary mobile device that may be used to implement exemplary embodiments of the location-based automation and control systems described herein.

DETAILED DESCRIPTION

Systems, methods, and computer-readable media for providing location-based control of equipment and building resources via a user's mobile device are described in detail herein. Typical implementations include the following steps: detecting location information of a user within the building using a location sensor installed within the building; determining one or more actions available to the user based on the location information, wherein the actions represent available actions in a SCADA application, a BMS, or a BAS; and wirelessly communicating instructions to the mobile device that cause the mobile device to display a user interface having the determined actions, wherein the user interface enables the user to interact with equipment or building resources located near the user.

An entity or organization may use a computer-based automation control system to control various equipment, machines, or facility resources. In industry, such control systems are known as industrial control systems (ICS). In general, such automation control systems are also known as supervisory control and data acquisition (SCADA), building management systems (BMS), building automation systems (BAS), human-machine interfaces (HMI), or manufacturing execution systems (MES). ICSs operate based on coded signals over communication channels to provide remote control of equipment and obtain information related to the status of equipment that can be displayed on user devices. ICSs may include human-machine interfaces (HMIs) to automatically monitor and control equipment via user interfaces. BMSs and BASs are computer-based automation and control systems installed in buildings to assist in controlling and monitoring the building's mechanical and electronic resources, such as ventilation, lighting, power systems, fire alarm systems, and security systems. MESs are computer-based automation and control systems installed in manufacturing plants to assist in the management of plant equipment and materials to ensure that products are produced according to plan and to provide manufacturing history and process genealogy information. ICS including SCADA, BMS, BAS, HMI and MES can be referred to as host systems here.

Using traditional solutions, it can be difficult and time-consuming for users to navigate and filter the remote view of the host system for desired actions on their mobile device, given the small available screen size on the host system and the wide range of available data, commands, actions, and messages. Additionally, it is desirable to leverage emerging channels for delivering data, commands, actions, and messages, such as wearable devices and augmented reality displays. Location-based automation and control systems with automatic filters for providing relevant information and controlling the user's mobile device based on the user's permissions and physical location significantly improve user efficiency.

In the increasingly connected world of the Internet of Things (IoT), or in the context of the Industrial Internet of Things (IIoT) applied to industrial automation, smart devices are constantly evolving. Geo-tagging, an IoT technology used in indoor positioning systems (IPS), is a key element of the new mobility architecture used by ICS. Geo-tagging technologies include Bluetooth Low Energy (BLE) beacons, near-field communication (NFC), QR codes (a barcode format), and other technologies such as WiFi positioning systems.

These technologies, along with the Global Positioning System (GPS) for outdoor positioning, are standard on modern mobile devices. Using IPS or GPS, a mobile device can know its current location. If an app on the device verifies and maintains the user's identity, the device can immediately tell who the user is and where they are in real time. In many distributed ICS environments, there are different servers providing information and control for each control area. A control area can refer to all equipment in a physical area, such as a floor in a modern high-rise building, or it can refer to an automated system, such as an elevator or HVAC system.

In today's world, mobile workers need to know what assets are included in each region and how to connect to a specific server in that region to access relevant information and controls. Given the many different publishers of server software, it's unlikely that regional servers will have information organized in a consistent manner or a consistent user interface. This complicates the process of mobile workers accessing the information and controls they need to perform their tasks in the use, operation, or maintenance of a building or industrial facility.

The location-based automation and control system described herein includes an application (also referred to as an "app") running on a mobile device, a centralized application server, and one or more location sensors or geotags for indoor location or GPS for outdoor location. The location-based automation and control system relies on existing standard networks to connect the various components of the system. System modules generate events linked to actions such as sending updated information messages and controls to mobile workers based on their job function and the devices in their vicinity. Inputs to the logic modules are worker identity and/or current location/position information. The location-based automation and control system described herein also addresses the problem of providing real-time location information for mobile workers, which is not readily known by ICS applications. Tracking using access control systems or RFID provides approximate location, whereas the system described herein uses location sensors installed in various parts of a building in indoor situations or GPS signals in outdoor situations to provide indoor tracking of mobile workers. The location-based automation and control system is provided as an application and can be installed on existing and commercially available mobile devices, including mobile phones, tablets, wearable devices, and augmented reality devices.

In an embodiment, a mobile device is typically held by a mobile worker and used to notify a host system (SCADA, BMS, or BAS) of the device's location, regardless of whether the mobile device is indoors or outdoors. Information along with the worker's credentials and user profile provides the host system with location- and task-based context, which is then used as input to filter data, commands, and actions available to the mobile worker. These actions include automatically presenting relevant information and controls to the worker on their mobile device. Because location sensors are continuously evaluated, the mobile device and the host system automatically maintain information about the mobile device's current location. This enables the host system to perform predetermined actions and provide mobile applications with information and controls in the context of the worker's current location as the worker moves into a facility, campus, or industrial complex.

The use of GPS or indoor positioning system (IPS) geo-tags (e.g., location sensor 940 in FIG. 9 ) enables location-based automation and control systems. These geo-tags may include, but are not limited to, GPS, Bluetooth low energy (BLE) beacons, near field communication (NFC) devices, QR codes, barcodes, any other commercially available location sensors, or any combination thereof. Here, geo-tags may be referred to as location sensors that enable the host (ICS) to determine location when associated with a physical location within the facility. In addition to specific locations, the concept of regions is incorporated into the system, which enables actions and information to be distributed based on a hierarchy of rules. The system continuously evaluates information from the location sensors to determine appropriate filtering of available measures, commands, actions, and messages within the context of the job functions of the workers using the mobile devices. As a result, the system automatically pushes relevant information and controls to the worker's device and the host (ICS) records the worker's current physical location.

As a result of continuously receiving updated location information from the mobile device, the host system can track mobile workers and mobile assets. This information enables the host system to consciously maintain the real-time location of the mobile workers. The system records and then identifies the patterns of the workers' movements. The workers' location and movements can be visualized on the host system's user interface. In some embodiments, automatic notifications based on the workers' location are sent to the workers' mobile devices or to security and emergency personnel.

The system reacts to movement by generating events, including the generation and maintenance of movement profiles, automated environmental adaptation, appropriate security or safety-related actions, messaging, or other work processes based on the proximity of qualified workers to problem areas or areas of interest.

The following description is presented to enable any person skilled in the art to construct and use a computer system structure and related manufacturing methods and provisions for providing control of equipment and facility resources via a user's mobile device based on the user's location. Various modifications of the example embodiments will be apparent to those skilled in the art, and the general principles set forth herein may be applied to other embodiments and applications without departing from the spirit and scope of the invention. In addition, in the following description, many details are presented for the purpose of explanation. However, one of ordinary skill in the art will recognize that the present invention can be practiced without using these specific details. In other examples, well-known structures and processes are shown in the form of block diagrams so as not to hinder the description of the present invention without detail. Therefore, it is not intended to limit the present invention to the embodiments shown, but the present invention is in the widest scope consistent with the principles and features disclosed herein.

In one embodiment, location sensors are deployed in areas of interest within a building or facility. Additionally or alternatively, specific locations of interest, such as entry points to the area, doors, windows, rooms, mobile assets, etc., are equipped with NFC devices and QR code-based location sensors. System configuration software includes functionality for printing unique identifiers for QR codes and storing unique identifiers for NFC devices. Location sensors are stored in a database and associated with their corresponding locations and areas. Furthermore, locations and areas are associated with actions, events, and messages. This association is achieved both by the host system and by a mobile application for location-based automation and control systems.

FIG1 is a block diagram 100 illustrating a location-based automation and control system in a modular manner, according to an example embodiment. These modules may be implemented in the devices 920 and 930 shown in FIG9 . These modules may include a location module 110, an action module 120, and a control module 130. These modules may include various circuits, circuit diagrams, and other units of one or more software components, programs, applications, apps, or code libraries, or instructions configured to be executed by one or more processors included in the devices 920 and 930. In other embodiments, one or more of the modules 110, 120, and 130 may be included in the server 950, while other modules 110, 120, and 130 may be provided in the devices 920 and 930. Although FIG1 illustrates these modules 110, 120, and 130 as distinct modules, it should be understood that these modules 110, 120, and 130 may be implemented as fewer or more modules than shown. It should be understood that any of these modules 110, 120 and 130 can communicate with one or more components included in the system 900 (Figure 9), such as a database (e.g., database 960), a server (e.g., server 950), a device (e.g., devices 910, 915), a position sensor (e.g., position sensor 940), or an apparatus (e.g., apparatuses 920, 930, 970).

The location module 110 may be configured to detect the location information of the user. The action module 120 may be configured to determine one or more actions available to the user based on the user's location. The control module 130 may be configured to enable control of devices and building resources.

FIG2 is a flowchart illustrating an example method 200 for providing control of equipment and facility resources based on the user's location via a user's mobile device according to an example embodiment. The method 200 may be performed using the modules in the location-based automation and control system 100 shown in FIG1 .

In operation 202, the location module 110 is configured to detect the location information of the user within the building using location sensors installed within the building or, if the user is outdoors, a GPS signal from the user's mobile device. In an example embodiment, the location module 110 is configured to continuously scan for location sensors in the vicinity of the user. In some embodiments, operation 202 is performed by the mobile device.

In operation 204, the location module 110 is configured to wirelessly transmit location information from the user's mobile device to the server. In an example embodiment, the server is installed with an ICS. The ICS may be a commercially available application or system.

In operation 206, the action module 120 is configured to determine one or more actions available to the user based on the location information. The one or more actions represent actions available to the user in the ICS. In another embodiment, the location module 110 is configured to transmit a user profile to a server, and the action module 120 is configured to determine the one or more actions based on the user profile. The user profile may include information related to the user's identity. The action module 120 is configured to determine the one or more actions by querying a database to determine the one or more actions available to the user, wherein the database stores information related to the location of the location sensor. The action module 120 may be further configured to store the location information in a database in a manner associated with the user. In some embodiments, the action module 120 is configured to generate one or more events based on the user's location information.

In operation 208, the action module 120 is configured to wirelessly transmit to the mobile device, causing the mobile device to display the action for the user determined in operation 206 in a user interface. The user interface allows the user to interact with equipment or building resources located near the user. The user can interact with the equipment or building resources by interacting with the action displayed in the user interface. The action can be displayed as a selectable control button.

In an example embodiment, the location module 110 is configured to detect changes in the user's location information, and the action module 120 is configured to update the action displayed on the mobile device based on the detected changes in the location information. In some embodiments, the action module 110 is configured to determine relevant information based on the user's location and cause the mobile device to display the relevant information. For example, the relevant information may be information related to devices located near the user.

The relevant actions can be provided as control buttons within the user interface displayed on the user's mobile device. In some embodiments, the user can control a device or building resource by clicking, triggering, or selecting the control button. In other embodiments, the control button can be a slider. In other embodiments, the control button can be a radio button or checkbox that can be selected by the user. The relevant information can be provided within the user interface displayed on the user's mobile device in the form of text, graphics, or any other suitable output format.

In some embodiments, a set of access permissions can be associated with a user and a mobile device via a host application. A user profile includes user credentials such as a username and password. The user profile can also include information related to the access permissions for the user. For example, a user can use a username and password to log in to an application on the user's mobile device, and a set of access permissions can be associated with the user and the mobile device based on the login information. In an example embodiment, to facilitate the configuration and maintenance of user permissions, users can be associated with user profiles. User profiles help identify a group of users who have or need to have the same user permissions.

3 is a diagram of an example system 300 for providing control of equipment or building resources to a user via a mobile device according to an example embodiment. System 300 includes a mobile device 305, a plurality of location sensors 310, a quick response (QR) code 315, a near field communication (NFC) device 320, a host system 325 (e.g., an ICS), a relational database 330, a historical database 335, and a control room device 340.

As part of a user's (worker's) job function within a building, the user may use a mobile device 305 to control or monitor equipment or building resources. Various devices within the building may be used to detect the user's location. For example, a location sensor 310 may have a predetermined sensing area and may be registered to identify a user within a specific space or area within the facility. The location sensor 310 may detect the presence of the mobile device 305. As another example, the user may use their mobile device 305 to scan a QR code 315, which may be configured on a device near the user or near the user. As another example, the user's location may be detected via an NFC device 320 via the mobile device 305. The location sensor 310, QR code 315, and NFC device 320 are registered in a database to identify a location, specific space, area, or equipment.

As described above, mobile device 305 includes an application for monitoring active location sensors in the vicinity of the mobile device and collecting passive geo-tagged data. A background service included in this application continuously scans the environment for location sensors. The application also includes a user interface for enabling the user to scan location sensors, such as NFC devices and QR codes. If one or more sensors are found, the user's environmental context is sent to the host system. If one or more events are configured for a given context, these events are triggered within the host system. If actions are configured for events triggered by a given context, notifications are sent to the mobile device along with appropriate information and controls. If one or more messages are associated with a given context, these messages are presented to the user. The messages may include text, graphics, or both, and may be displayed on the user's mobile device via the user interface. In some embodiments, the messages may be email messages or notifications provided on the user's mobile device. The messages may provide information related to the user's context (e.g., the user's location, job function, and profile).

The location information or user profile information of the user/mobile device 305 is sent from the mobile device 305 to the host system 325 via a wireless, WiFi, or mobile network connection. The host system 325 may be an ICS configured for a specific facility and its equipment and resources. The host system 325 may be implemented in conjunction with the server 950 described in FIG. 9 . The host system 325 queries the relational database 330 to determine the information and actions available to the user/mobile device 305 based on the location or user profile information received from the mobile device 305. The host system 325 includes logic modules for processing the user's location information and providing relevant actions and information to the user. The host system also maintains the relational database 330 using actions, locations, and events.

After determining the information and actions available to the user, the host system 325 sends data related to the available information and actions to the mobile device 305, so that the user can control and monitor the equipment or building resources in his or her vicinity. The mobile device 305 may include an application for implementing the location-based automation and control system described herein, wherein the application generates a user interface for displaying information and control buttons based on the available information and available actions determined by the host system 325.

The location information and user profile information are stored or archived in a historical database 335 to maintain a record of user movements within the building. The host system 325 also transmits the user's location and user profile information to the control room device 340. The control room device 340 may also display the user interface of the host system 325 to facilitate control and monitoring of any device or building resource from the control room.

FIG4 is a diagram 400 illustrating the data flow of a location-based automation and control system according to an example embodiment. The system associates actions and events with position sensors, or locations indicated by position sensors, or regions defined by multiple position sensors. These associations are configured using only simple and flexible grammatical expressions and vocabulary. Thus, the system provides a high level of scalability. While achieving a high degree of scalability, the complexity and effort of system debugging are minimized.

Data is transmitted between the user's mobile device 305 and the host system 325 as described in connection with FIG. The mobile device 305 transmits environmental context data 410 to the host system 325. The environmental context data 410 may represent the user's location and user profile within the building. In some embodiments, a location sensor may provide images or video, such as from an augmented reality camera, to determine the environmental context data 410. The host system 325 communicates with the relational database 330 to determine information and actions available to the user based on the user's location and user profile. The host system 325 transmits action data 425 to the mobile device 305. The action data 425 may include information and actions available to the user based on the user's location and user profile. In some embodiments, the action data 425 may be forwarded to an augmented reality display or other device. The host system 325 transmits event data 430 to the control room device. The event data 430 may include messages, notifications, user interface outputs, alarms, control commands for adjusting temperature set points for devices, security levels, and the like.

FIG5A is a schematic diagram illustrating an example system architecture 500 for a location-based automation and control system according to an example embodiment. FIG5B is a diagram illustrating the data flow within the example system architecture of FIG5A according to an example embodiment. As described above, the functionality of the location-based automation and control system is configured via an application on a mobile device. Application 505 sends environmental context data 510 to a host system 515. Host system 515 includes a decision maker module 520 having a predicate resolver module 525 and an action selector 535. Predicate resolver module 525 sends user location data 530 to action selector 535. Action selector 535 queries database 540 to determine available actions for the user based on the user's location and identity. Action selector 535 sends action data 545 to application 505.

The user's environmental context 510 can include two types of data: location data and user data. User data is an access token that allows authentication and authorization, and generally represents the identity of the user used to report data. Location data is data that allows the user's location to be known. The location data is obtained by sending and evaluating the GPS coordinates (outdoors) given by the mobile device on which the location-based control app 505 (if any) is running and a list of nearby geographic markers 310, 315 and 320. In addition, the location data also includes the distance to the pointer 310 showing the geographic marker type, so that the user's exact coordinates can be determined, or if the distance of each marker to the worker is outside a meaningful range, each marker is removed from the background.

Associating location data with geographic locations 566 is part of predicate resolution 564, shown in FIG5B . Geographic locations 566 are hierarchically structured and can contain any number of geographic markers 310, 315, and 320 at each level. Geographic locations can also be specified by a geometric area defined by GPS coordinates or any other custom coordinate system. Given location data, the current user context 562 can be associated with one or more geographic locations 564. Generic actions 570 are templates that can be specified as user-available actions within any number of locations. Instead of specifying an action for "control lighting" in every room of a building, a single generic action 570 can be specified for this purpose. The association between geographic locations 566 and generic actions 570 is achieved through matching criteria. These criteria include matching and filtering characteristics of locations and actions. These criteria are used to generate a query 568 against the relational database 330, resulting in a list of generic actions 570. Using the results of the database query 568, the characteristics of the resulting generic actions 570 are replaced by parameters 572 derived from the given geographic location 566. The result of the algorithm is a customized set of actions 574 that are sent back to the location-based control app 505 and presented to the user.

Upon detecting an update to the mobile device's location or environmental context, one or more new actions are made available to the user on the user's mobile device. These actions may include, but are not limited to: showing a list of measurements including details such as the quality of the data; showing trends for one or more values; showing log and historical data; displaying a message associated with the location; initiating one or more commands to the host system; defining or changing one or more monitoring control settings; showing an alarm list; defining or changing one or more alarm thresholds; notifying of receipt or hiding an alarm; displaying a symbol that includes a visual representation of an asset with environmental context (the symbol may display measurements or status information maintained as real-time values or real-time data); loading a scenario; displaying a timeline of events; navigating to a web page or other system resource; and displaying a file. As used herein, an alarm may be generated when an event is triggered by meeting specific criteria or requiring human attention.

In some cases, updates to the mobile device's location or environmental context generate new events. In an exemplary embodiment, events are automatically executed in the host system. Events may include, but are not limited to: updating and saving the user's location; initiating an alert; sending an email or SMS; updating the number of users in a particular area; and adapting environmental parameters in a particular area. In some embodiments, there may be more than one predicate resolver 564, and in an exemplary embodiment, the predicate resolvers work together to exchange information so that the entire system benefits from actions such as sending alerts to safety devices while notifying workers of danger. Adapting environmental parameters in a particular area may include actions such as: (i) turning off lights in an office when the office is unoccupied, (ii) adjusting HVAC settings based on the number of people in the room, (iii) adjusting security levels based on the identity of individuals in the area, or (iv) initiating a security alert if the number of people in the area exceeds a threshold. In general, the present invention is configured to automatically generate events based on business rules based on the user's location.

FIG6A is a diagram 600 illustrating a floor layout within a building for implementing a location-based automation and control system according to an example embodiment. FIG6B is a diagram illustrating a display 620 of a user's mobile device on the floor depicted in FIG6A according to an example embodiment. As described herein, a location-based automation and control system provides control of equipment and building resources based on the user's location within a building. As shown in FIG6A , user 615 is located near a stairwell on floor 605. A geo-tagged beacon 610 is mounted on floor 605. User 615 is not within range for detecting geo-tagged beacon 610 and has not registered the user's current location for accessing any information or control of equipment or building resources. Therefore, as shown in display 620 of user 615's mobile device, there are no actions available to the user via the user interface of the application.

Figure 7A is a diagram 700 illustrating a floor layout within a building for implementing a location-based automation and control system according to an example embodiment. Figure 7B is a diagram illustrating a display 720 of a user's mobile device on the floor depicted in Figure 7A according to an example embodiment. As shown in Figure 7A , user 715 is currently within the detection range of geo-tagged beacon 710 (compared to user 615 in Figure 6A ). Based on location information (and, in some embodiments, user profile information), as shown on display 720 of user 715's mobile device, the location-based automation and control system provides relevant actions and information to user 715. The actions available to user 715 are determined as described above in connection with Figures 1-5 . As shown in Figure 7B , based on the user's location within Building A, Floor 1, user 715 has the following actions available to them: Turn lights on and off. Based on the user's proximity to Room 105 on Building A, Floor 1, user 715 has permission to perform the following actions: Turn lights on and off and control the A/C.

FIG8 is a diagram 800 illustrating a floor layout within a building for implementing a location-based automation and control system according to an example embodiment and displays of mobile devices of two users on the floor. As shown in FIG8 , users 810 and 820 are located at different locations on floor 805. The display of user 810 carrying a mobile device is shown as display 815. The display of user 820 carrying a mobile device is shown as display 825. User 810 is not within the detection range of a geo-marking beacon, while user 820 is within the detection range of a geo-marking beacon 830. As described herein, the location-based automation and control system determines the information and actions that a user can access based on the user's location (and in some embodiments, based on a user profile). Therefore, as shown on display 815, user 810 has no accessible actions, while as shown on display 825, user 820 can access information and actions related to devices located near geo-marking beacon 830.

In this way, the systems and methods described herein are used to provide location-based control of equipment and building resources via a user's mobile device. Location information of a user within the building is detected using a location sensor installed within the building. The location information is wirelessly transmitted from the user's mobile device to a server. One or more actions are determined to be available to the user based on the location information, wherein the actions represent actions available in an ICS application. Instructions are transmitted to cause the mobile device to display the determined actions within a user interface, wherein the user interface enables the user to interact with equipment or building resources located near the user by interacting with one or more actions displayed in the user interface. The location-based automation and control system preferably provides a scalable, easy-to-use, maintainable, and integrated smart device.

Location-based automation and control systems can be used for a variety of scenarios. For example, the system can be used when maintaining an environment. Maintenance engineers can monitor assets (equipment or building resources) that are suspected of or have already failed. The asset can be uniquely identified by a location sensor installed on the asset or used to identify the location of the asset. In this example, when a mobile device user is close to the asset, the mobile device application can present the following related actions to the user: monitoring real-time data; monitoring historical data; displaying trend data; accessing the asset's user guide; the ability to put a component into maintenance mode; accessing a component's alarm list; and notification of received alarms.

As another example, location-based automation and control systems can be used in a diagnostic environment. While walking through one or more facilities, a mobile device user can be notified of fault events within the user's area of responsibility. This area of responsibility is in the context of both the physical area (nearby, region, entire facility, etc.) and the user's role, which can be configured in the host system.

As another example, location-based automation and control systems can be used in a debugging environment. Debugging equipment used by a host system can be a lengthy process. Typically, a worker at a central host system uses a radio to communicate with a mobile worker who can directly verify the status of the equipment. Using the location-based automation and control systems described herein, only one worker is required to debug equipment used by the host system. The mobile worker is provided with control and information about the equipment as they approach it.

Furthermore, as another example, location-based automation and control systems can be used for access control. Knowledge of the identity and current location of the system's workers enables the construction of an access control system. A company member or building visitor requires access to an area. Based on location sensors in the vicinity of the worker that are pre-associated with the access location, a request is provided to the host system. In the event that an individual enters or leaves an area (intersecting a virtual fence), an alarm configuration causes an alarm to be initiated. The system supports the concept of area-based user permissions. Depending on the current space or area and system status or other environmental factors, the credentials of a mobile worker are allowed to change. The system is able to verify the credentials and, if appropriate access rights are granted to the worker, change the worker credentials, thereby changing the information and controls set on the mobile device, and, for the building management system, issuing a safety or security warning notification, while invoking an action to impose interlocking measures.

As another example, location-based automation and control systems can be used in a safety environment. This system provides a platform for building components for lifecycle safety systems. Location information is evaluated and actions are generated to notify mobile workers of an emergency and distribute customized information providing optimal evacuation routes based on the worker's current location. The host system can monitor any remaining workers on site or alert workers moving in the wrong direction.

As another example, location-based automation and control systems can be used to track the location of workers. By monitoring the location of workers, traffic analysis can be visualized in real time on a 2D or 3D map. System actions as a result of tracking worker location can include: initiating a security alert; adjusting local environmental controls such as temperature, humidity, ventilation, or A/C; or providing energy balance based on an assessment of accumulated loads.

In another example, a location-based automation and control system can be used to track assets such as building equipment. Location sensors associated with the assets are registered as part of the location-based automation and control system. Compared to other location sensors associated with fixed areas and spaces, the relationship between the location of the asset location sensors enables the system to track mobile assets, even within buildings or facilities. As previously described, the host system can react to the relocation of the mobile asset through alerts, visualizations, or logging.

In another example, the simultaneous presence of two work teams in the same area can cause interference. This interference can disrupt work processes or negatively impact worker safety. Location-based automation and control systems address this interference by alerting workers to the interference and enabling the teams to communicate with each other to alternate work processes, helping workers who are unaware of their location avoid interference.

Because the system builds a link between traditional host systems (ICS) and IPS technology to provide distance-based services to mobile device users, a variety of use cases are possible. Existing IPS applications using indoor positioning, indoor navigation, and micro-geolocation products focus on marketing, retail data, and public relations applications. The limited number of IPS applications available for industrial automation (i.e., ICS) do not provide mobile workers with automatic dynamic control and environmental context.

The system described herein has the advantage over the prior art in that it facilitates commissioning of indoor positioning systems by utilizing a common approach. The system also makes innovative use of geo-fencing for indoor contexts. The system also explicitly exploits the different characteristics of location sensors in diverse settings. Bluetooth LE beacons do not require proactive action by the mobile device user. NFC devices and QR codes require user interaction and are used for asset identifiers in all basic use cases. In combining the two different approaches, the following additional benefits arise: NFC devices and QR codes can be used as authenticators for integrity/rationality checks and as identifiers for tracking mobile assets, while Bluetooth LE beacons can be given credentials to mobile workers as automation workers in cases where credentials are carried for authorization tagging purposes.

The system also includes additional features not found in traditional solutions. The use of a mobile beacon as an authenticator is innovative, and the system also includes methods for diagnosing missing, removed, faulty, or inoperative location sensors using a heuristic approach. Furthermore, the system offers hands-free operation capabilities, including the use of wearable mobile devices and augmented reality devices.

9 shows a network diagram for describing a system 900 for implementing a location-based automation and control system according to an example embodiment. System 900 may include a network 905, a plurality of devices (e.g., devices 910 and 915), a plurality of apparatuses (e.g., apparatus 920, apparatus 930, and apparatus 970), a location sensor 940, a server 950, and a database 960. Devices 910 and 915, apparatuses 920, 930, and 970, location sensor 940, server 950, and database 960 are each in communication with network 905.

In an example embodiment, one or more portions of network 905 may be an ad hoc network, an intranet, an extranet, a virtual private network (VPN), a local area network (LAN), a wireless LAN (WLAN), a wide area network (WAN), a wireless wide area network (WWAN), a metropolitan area network (MAN), a portion of the Internet, a portion of the public switched telephone network (PSTN), a cellular telephone network, a wireless network, a WiFi network, a WiMax network, and other types of networks, or a combination of two or more such networks. In such an embodiment, communications may be secured by TLS encryption or similar security measures.

Devices 910 and 915 may also include building resources, including but not limited to heating, ventilation, and air conditioning systems, electrical systems, plumbing systems, blind control systems, lighting systems, elevators and escalators, fire detection and alarm systems, access control systems, security control systems, and public address (PA) systems.

In some embodiments, devices 920 and 930 may include, but are not limited to, cellular or mobile phones, smart phones, tablet computers, ultrabooks, netbooks, laptop computers, handheld devices, wireless devices, portable devices, wearable computers, smart watches, intelligent visual systems, portable digital assistants (PDAs), multi-processor systems, microprocessor-based or programmable consumer electronics, and minicomputers. Users on-site or within a building use devices 920 and 930 to control or monitor equipment or building resources based on the user's location or proximity to the equipment and building resources.

In some embodiments, the device 970 may include, but is not limited to, a workstation, a personal computer (PC), a general-purpose computer, an internet appliance, a handheld device, a wireless device, a portable device, a wearable computer, a cellular or mobile phone, a portable digital assistant (PDA), a smartphone, a tablet computer, an ultrabook, a netbook, a laptop computer, a desktop computer, a multiprocessor system, a microprocessor-based or programmable consumer electronics product, a game console, a digital video changer box, a network PC, a mini-computer, an augmented reality headset, etc. The device 970 may be located in a control room within a facility or may be located remotely, such as as a cloud service, and may provide access to ICS applications.

Devices 920, 930, and 970 may include one or more of the components described in connection with FIG. Each of devices 920, 930, and 970 may be connected to network 905 via a wired or wireless network. Each of devices 920 and 930 may include, but is not limited to, one or more applications such as a web browser application, a GPS application, a network connection application, and a location-based automation and control application (based on the location-based automation and control systems described herein). Device 970 may include, but is not limited to, one or more applications such as a web browser, a SCADA system, a BMS application, and a BAS application. In some embodiments, device 970 does not include a location-based automation and control application (based on the location-based automation and control systems described herein).

In an example embodiment, devices 920 and 930 can perform all of the functions described herein. In other embodiments, location-based automation and control systems can be included on devices 920 and 930, and server 950 can perform the functions described herein. Furthermore, in another embodiment, devices 920 and 930 can perform some of these functions, and server 950 can perform other functions described herein.

Database 960 and server 950 are each connected to network 905 via a wired network. Alternatively, one or more of database 960 and server 950 may be connected to network 905 via a wireless network. Although not shown, server 950 may be (directly) connected to database 960. Server 950 includes one or more computers or processors configured to communicate with devices 920, 930, and 970 via network 905. Server 950 is installed with one or more applications or websites accessed by devices 920, 930, and 970, and/or facilitates access to the contents of database 960. Database 960 includes one or more storage devices for storing data and/or instructions (or code) used by server 950 and/or devices 920, 930, and 970. Database 960 and/or server 950 may be located in one or more geographically dispersed locations, or in a location different from devices 920, 930, and 970. Alternatively, database 960 may be included within server 950. Server 950 may have installed thereon one or more components of an ICS, wherein, as described above, the system facilitates control of various equipment and facility resources.

FIG10 is a block diagram of an exemplary computing device 1000 that can be used to implement exemplary embodiments of the location-based automation and control systems described herein. The computing device 1000 includes one or more non-transitory computer-readable media for storing one or more computer-executable instructions or software for implementing exemplary embodiments. The non-transitory computer-readable media may include, but are not limited to, one or more types of hardware memory and non-transitory tangible media (e.g., one or more magnetic storage disks, one or more optical disks, and one or more flash drives). For example, the memory 1006 included in the computing device 1000 may store computer-readable and computer-executable instructions or software for implementing exemplary embodiments of the location-based automation and control systems 100. The computing device 1000 also includes a configurable and/or programmable processor 1002 and an associated core 1004, and optionally, one or more additional configurable and/or programmable processors 1002′ and associated cores 1004′ (e.g., if the computer system has multiple processors/cores) for executing computer-readable and computer-executable instructions or software stored in a memory 1006 and other programs for controlling system hardware. Processors 1002 and 1002′ can each be a single-core processor or a multi-core (1004 and 1004′) processor.

Virtualization can be used in computing device 1000 to dynamically share infrastructure and resources within the computing device. Virtual machines 1014 can be configured to handle processes running on multiple processors, so that the processes appear to be using only one computing resource rather than multiple computing resources. Multiple virtual machines can also be used with a single processor.

The memory 1006 may include computer system memory or random access memory such as DRAM, SRAM, and EDORAM. The memory 1006 may also include other types of memory and combinations thereof.

A user can interact with the computing device 1000 through a visual display device 1018, such as a computer monitor, which can display one or more graphical user interfaces 1022, which can be configured in accordance with an exemplary embodiment. The computing device 1000 may include other I/O devices for receiving input from the user, such as a keyboard or any suitable multi-touch interface 1008, a pointing device 1010 (e.g., a mouse), a microphone 1028, and/or a camera 1032 (e.g., a camera or scanner). The multi-touch interface 1008 (e.g., a keyboard, keypad, scanner, touch screen, etc.) and the pointing device 1010 (e.g., a mouse, stylus, etc.) can be coupled to the visual display device 1018. The computing device 1000 may include other suitable conventional I/O peripherals.

The computing device 1000 may also include one or more storage devices 1024 for storing data and computer-readable instructions and/or software described herein for implementing exemplary embodiments of the location-based automation and control system 100, such as a hard drive, CD-ROM, or other computer-readable medium. The exemplary storage devices 1024 may also store one or more databases for storing any applicable information required to implement the exemplary embodiments. For example, the exemplary storage devices 1024 may store one or more databases 1026 for storing information such as location information from location sensors, user profiles, user access rights, user credentials, one or more actions available to the user, and/or any other information used by embodiments of the system 100. The databases may be updated manually or automatically at any suitable time to add, delete, and/or update one or more items in the database.

The computing device 1000 may include a network interface 1012 configured to connect to one or more networks via one or more network devices 1020, such as a local area network (LAN), a wide area network (WAN), or the Internet, via various connections including, but not limited to, standard telephone lines, LAN or WAN links (e.g., 802.11, T1, T3, 56kb, and X.25), broadband connections (e.g., ISDN, Frame Relay, and ATM), wireless connections, controller area networks (CAN), or specific combinations of any or all of the foregoing. In a typical embodiment, the computing device 1000 may include one or more antennas 1030 for facilitating wireless connection of the computing device 1000 to a network (e.g., via a network interface). The network interface 1012 may include a built-in network adapter, a network interface card, a PCMCIA network card, a plug-in bus network adapter, a wireless network adapter, a USB network adapter, a modem, or any other device suitable for connecting the computing device 1000 to any type of network capable of communication and performing the operations described herein. Furthermore, computing device 1000 may be any computer system, such as a workstation, desktop computer, server, laptop computer, handheld computer, tablet computer (e.g., an iPad ^™ tablet computer), mobile computing or communication device (e.g., an iPhone ^™ communication device), point-of-sale terminal, in-house device, or other form of computing and telecommunication device that is capable of communicating and has sufficient processing power and storage capacity to perform the operations described herein.

The computing device 1000 can run any operating system 1016, such as any version of an operating system, different distributions of Unix and Linux operating systems, any version of any embedded operating system for Macintosh computers, any real-time operating system, any open source operating system, any proprietary operating system, or any other operating system capable of running on a computing device and performing the operations described herein. In a typical embodiment, the operating system 1016 can be run in a local mode or an emulated mode. In a typical embodiment, the operating system 1016 can be run on one or more cloud machine instances.

FIG11 is a block diagram of a typical mobile device 1100 that can be used to implement the location-based automation and control systems described herein. Mobile device 1100 can include a processor 1110. Processor 1110 can be any of a variety of different commercially available processors suitable for mobile devices (e.g., an NVIDIA system-on-chip (SoC) multi-core processor, such as a Tegra K-1, ^an Xscale architecture microprocessor, a ^Core ™ processor, an Atom™ processor, an Intel® processor, a Snapdragon processor, an Intel® ... The processor 1110 can be coupled directly or via appropriate intermediate hardware to a display 1150 and one or more input/output (I/O) devices 1160, such as a keyboard, a touch panel sensor, a microphone, and a speaker. The processor 1110 can also be coupled to a transceiver 1170 connected to an antenna 1190. The transceiver 1170 can be configured to transmit and receive cellular network signals, wireless data signals, or other types of signals via the antenna 1190, depending on the nature of the mobile device 1100. In this way, a connection with the communication network 1005 can be established. In addition, the mobile device 1100 can also include a GPS 1180 that can also utilize the antenna 1190 to receive and transmit GPS signals. The GPS 1180 can be used to determine the user's location information when the user is outdoors.

When describing exemplary embodiments, specific terms are used for clarity. For the purpose of illustration, it is expected that each specific item at least includes all technical and functional equivalents, wherein the equivalents operate in the same manner as achieving the same purpose. In addition, in some instances, specific exemplary embodiments include multiple system elements, device components or method steps, and single elements, components or steps can be utilized to replace these elements, components or steps. Equally, single elements, components or steps can replace multiple elements, components or steps that serve the same purpose. In addition, when exemplary embodiments are shown and described with reference to specific embodiments, it will be understood by those of ordinary skill in the art that, without departing from the scope of the present invention, various replacements and changes in form and detail can be carried out therein. In addition, other embodiments, functions and advantages are also within the scope of the present invention.

The exemplary flow charts provided herein are for illustrative purposes only and are not intended to be limiting examples of methods. One of ordinary skill in the art will appreciate that exemplary methods may include more or fewer steps than those shown in the exemplary flow charts, and that the steps in the exemplary flow charts may be performed in a different order than that shown in the exemplary flow charts.

Related references

This application claims priority to U.S. Patent Application No. 62/193910, filed on July 17, 2015, which is hereby incorporated by reference in its entirety. This application is also related to U.S. Patent Application No. 62/215576, filed on September 8, 2015, which is hereby incorporated by reference in its entirety.

Claims (47)

1. A method for controlling equipment and facility resources based on location via a user's mobile device, the method comprising the steps of: Use location sensors to detect the location information of users in or near the facility; The location information is wirelessly transmitted from the user's mobile device to the server; Based on the location information, one or more actions that the user can use are determined, representing actions that can be used in an Industrial Control System (ICS) application; and Instructions for displaying one or more actions determined by the user in a user interface are wirelessly transmitted to the mobile device, the user interface enabling the user to receive messages and interact with devices or facilities located near the user by interacting with one or more actions displayed in the user interface. The location sensors include near field communication (NFC) devices and/or barcodes at the facility and Bluetooth Low Energy (BLE) pointers at the mobile device. 2. The method of claim 1, wherein, when the user is indoors, a location sensor installed in the facility is used to detect the location information. 3. The method of claim 1, wherein, when the user is outdoors, the location information is detected using GPS signals from the mobile device. 4. The method according to claim 1, further comprising: The location sensors continuously scan the area near the user. 5. The method according to claim 4, further comprising: Detect changes in the user's location information; and One or more actions displayed on the mobile device are updated based on the detected changes in the location information. 6. The method according to claim 1, further comprising: Wirelessly transmit the user profile from the user's mobile device to the server; and The one or more actions are determined based on the user profile. 7. The method of claim 6, wherein the user profile includes a user identity verified by a certificate. 8. The method of claim 1, wherein determining one or more actions that the user can use comprises querying a database to determine one or more actions that the user can use, wherein the database is used to store information related to the location of the location sensor. 9. The method of claim 1, wherein the server is equipped with an ICS application for controlling device and facility resources. 10. The method of claim 1, wherein the mobile worker carries an identifier token, such geotagging for unconscious location detection, which, in combination with a second location method, authorizes access to the device. 11. The method of claim 9, wherein the ICS application is a commercially usable application. 12. The method according to claim 1, further comprising: The location information is stored in the database in a manner associated with the user. 13. The method according to claim 1, further comprising: One or more events are generated based on the user's location information. 14. The method of claim 1, wherein the one or more actions include at least one of controlling equipment or facility resources, maintaining equipment or facility resources, and diagnosing equipment or facility resources. 15. The method according to claim 9, wherein the ICS application is one of a data acquisition and monitoring control system application, a building management system application, a building automation system application, a human-machine interface application, and a manufacturing execution system application. 16. A system for controlling equipment and facility resources based on location via a user's mobile device, the system comprising: server; The mobile device communicates wirelessly with the server. The mobile device is configured to use a location sensor to detect the location information of a user within or near the facility, and to transmit the location information to the server. The server is configured to determine one or more messages or actions available to the user based on the location information, and to wirelessly transmit instructions to the mobile device to display one or more actions determined for the user in the user interface. These actions represent actions available in an Industrial Control System (ICS) application. The user interface enables the user to receive messages and interact with nearby devices or facilities by interacting with one or more actions displayed in the user interface. The location sensors include near field communication (NFC) devices and/or barcodes at the facility and Bluetooth Low Energy (BLE) pointers at the mobile device. 17. The system of claim 16, wherein, when the user is indoors, a position sensor installed within the facility is used to detect the position information. 18. The system of claim 16, wherein, when the user is outdoors, the location information is detected using GPS signals from the mobile device. 19. The system of claim 16, wherein the mobile device is further configured to continuously scan location sensors near the user. 20. The system of claim 16, wherein the location detection combines a detection method requiring conscious action or interaction between a mobile device user and a location sensor, and a method that occurs in the form of unconscious background detection. 21. The system of claim 20, wherein the position sensor includes a near field communication (NFC) device and/or a QR code. 22. The system of claim 20, wherein the method of unconscious background detection includes GPS and/or Bluetooth Low Energy (BLE) beacons. 23. The system of claim 16, wherein the combination of positioning methods allows for dual verification of the user's location, improving accuracy and enhancing protection against tampering with or altering geotags. 24. The system of claim 19, wherein the mobile device is further configured to detect changes in the user's location information, and The server is also configured to update one or more actions displayed on the mobile device based on the detected changes in the location information. 25. The system of claim 16, wherein the mobile device is further configured to transmit a user profile to the server, and The server is configured to determine the one or more actions based on the user profile. 26. The system of claim 16, wherein the server is configured to query a database to determine one or more actions that the user can perform, wherein the database is used to store information related to the position of the position sensor. 27. The system of claim 25, wherein the user profile includes a user identity verified by a certificate. 28. The system of claim 16, wherein the server is configured to store the location information in a database in a manner associated with the user. 29. The system of claim 16, wherein the server is configured to generate one or more events based on the user's location information. 30. The system of claim 16, wherein the one or more actions include at least one of controlling equipment or facility resources, maintaining equipment or facility resources, and diagnosing equipment or facility resources. 31. The system of claim 16, wherein the server is equipped with an ICS application for controlling device and facility resources. 32. The system according to claim 31, wherein the ICS application is one of a data acquisition and monitoring control system application, a building management system application, a building automation system application, a human-machine interface application, and a manufacturing execution system application. 33. The system of claim 31, wherein the ICS application is a commercially usable application. 34. A non-transitory computer-readable medium for storing instructions executable by a processing device, the instructions for implementing a method for controlling equipment and facility resources based on location via a user's mobile device, the method comprising the steps of: Use location sensors to detect the location information of users in or near the facility; The location information is wirelessly transmitted from the user's mobile device to the server; Based on the location information, one or more actions that the user can use are determined, representing actions that can be used in an Industrial Control System (ICS) application; and Instructions for displaying one or more actions determined by the user in a user interface are wirelessly transmitted to the mobile device, the user interface enabling the user to receive messages and interact with devices or facilities near the user by interacting with one or more actions displayed in the user interface. The location sensors include near field communication (NFC) devices and/or barcodes at the facility and Bluetooth Low Energy (BLE) pointers at the mobile device. 35. The non-transitory computer-readable medium of claim 34, wherein, when the user is indoors, the location information is detected using a location sensor installed within the facility. 36. The non-transitory computer-readable medium of claim 34, wherein, when the user is outdoors, the location information is detected using GPS signals from the mobile device. 37. The non-transitory computer-readable medium of claim 34, wherein the method further comprises: Wirelessly transmit the user profile from the user's mobile device to the server; and The one or more actions are determined based on the user profile. 38. The non-transitory computer-readable medium of claim 37, wherein the user profile includes a user identity verified by a certificate. 39. The non-transitory computer-readable medium of claim 34, wherein the method further comprises storing the location information in a database in a manner associated with the user. 40. The non-transitory computer-readable medium of claim 34, wherein the method further comprises generating one or more events based on the user's location information. 41. The non-transitory computer-readable medium of claim 34, wherein the one or more actions include at least one of controlling a device or facility resource, maintaining a device or facility resource, and diagnosing a device or facility resource. 42. The non-transitory computer-readable medium of claim 34, wherein the server is installed with an ICS application for controlling device and facility resources. 43. The non-transitory computer-readable medium of claim 42, wherein the ICS application is one of a data acquisition and monitoring control system application, a building management system application, a building automation system application, a human-machine interface application, and a manufacturing execution system application. 44. The non-transitory computer-readable medium of claim 42, wherein the ICS application is a commercially usable application. 45. The non-transitory computer-readable medium of claim 34, wherein the method further comprises continuously scanning a location sensor near the user. 46. The non-transitory computer-readable medium of claim 44, wherein the method further comprises: Detect changes in the user's location information; and One or more actions displayed on the mobile device are updated based on the detected changes in the location information. 47. The non-transitory computer-readable medium of claim 34, wherein determining one or more actions that the user can use comprises querying a database to determine one or more actions that the user can use, wherein the database is used to store information relating to the position of the position sensor.