[go: up one dir, main page]

WO2008033127A1 - système informatique et procédé pour obtenir une perception situationnelle pour une structure utilisant une modélisation tridimensionnelle - Google Patents

système informatique et procédé pour obtenir une perception situationnelle pour une structure utilisant une modélisation tridimensionnelle Download PDF

Info

Publication number
WO2008033127A1
WO2008033127A1 PCT/US2006/035532 US2006035532W WO2008033127A1 WO 2008033127 A1 WO2008033127 A1 WO 2008033127A1 US 2006035532 W US2006035532 W US 2006035532W WO 2008033127 A1 WO2008033127 A1 WO 2008033127A1
Authority
WO
WIPO (PCT)
Prior art keywords
situational awareness
virtual model
module
user
information associated
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2006/035532
Other languages
English (en)
Inventor
Joseph A. Boggs
Michael C. Pachler
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Design and Construction Online Inc
Original Assignee
International Design and Construction Online Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Design and Construction Online Inc filed Critical International Design and Construction Online Inc
Priority to PCT/US2006/035532 priority Critical patent/WO2008033127A1/fr
Priority to CN2006800563236A priority patent/CN101553862B/zh
Priority to TW096132888A priority patent/TW200832279A/zh
Publication of WO2008033127A1 publication Critical patent/WO2008033127A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/29—Geographical information databases
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/44—Browsing; Visualisation therefor
    • G06F16/444—Spatial browsing, e.g. 2D maps, 3D or virtual spaces
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/16—Real estate
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/04—Architectural design, interior design

Definitions

  • the present invention relates to information systems. More particularly, the present invention relates to a computer-based system and method for providing real-time or near realtime situational awareness for a structure using three-dimensional modeling.
  • a system for providing situational awareness for a structure includes a database module.
  • the database module is configured to store structural information associated with the structure.
  • the system includes a situational awareness module.
  • the situational awareness module is configured to gather situational awareness information associated with the structure.
  • the system includes a three-dimensional (3-D) rendering module in communication with the database module and the situational awareness module.
  • the 3-D rendering module is configured to render a 3-D virtual model of the structure utilizing the structural information associated with the structure.
  • the 3-D rendering module is configured to integrate into the 3- D virtual model the situational awareness information associated with the structure.
  • the system includes a graphical user interface (GUI) module in communication with the 3-D rendering module.
  • the GUT module is configured to display to a user the 3-D virtual model of the structure integrating the situational awareness information associated with the structure.
  • the system can include a path selection module in communication with the 3-D rendering module.
  • the path selection module can be configured to determine ingress and/or egress routes through the structure using the structural information and situational awareness information associated with the structure.
  • the 3-D rendering module can be configured to render in the 3-D virtual model the ingress and/or egress routes for display to the user.
  • the egress routes through the structure can comprise evacuation routes from the structure.
  • the path selection module can be configured to determine the shortest route between points within the structure, and the 3-D rendering module can be configured to render in the 3-D virtual model the shortest route for display to the user.
  • the path selection module can be configured to maintain a list of substantially all individual paths through the structure. Each of the individual paths through the structure can be assigned a path weight in accordance with the length of the individual path and/or the level of difficulty in traversing the individual path.
  • a route between points in the structure can comprise one or more individual paths.
  • the path selection module can be configured to generate the total path weight of the route by summing the path weights of the individual paths that comprise the route.
  • the 3-D rendering module can be configured to render in the 3-D virtual model the route between the points in the structure with the lowest total path weight for display to the user.
  • the path selection module can be configured to receive modifications of path weights to alter the route between the points in the structure.
  • the path selection module can be configured to calculate distance measurements for each of the ingress and egress routes through the structure for display to the user.
  • the system can include a communication module in communication with the situational awareness module.
  • the communication module can be configured to transmit and receive the situational awareness information.
  • the communication module can be configured to transmit and receive the situational awareness information for collaborative situation assessment and response planning.
  • the communication module can be configured to communicate situational awareness information with crisis incident management systems, integrated incident management systems and the like.
  • the system can include a model translation module in communication with the 3-D rendering module and the GUI module.
  • the model translation module can be configured to convert the 3-D virtual model rendered by the 3-D rendering module into a format displayable by the GUI module.
  • the GUT module can be configured to display the 3-D virtual model of the structure integrating the situational awareness information associated with the structure on a portable display device.
  • the GUI module can be configured to display the 3-D virtual model of the structure integrating the situational awareness information associated with the structure through a Web browser.
  • the system can include a simulation module in communication with the 3-D rendering module.
  • the simulation module can be configured to generate simulations of situational awareness scenarios associated with the structure.
  • the system can include a situational awareness response module in communication with the 3-D rendering module.
  • the situational awareness response module can be configured to generate at least one proposed response to an emergency or other critical situation occurring within the structure.
  • the structural information used by the 3-D rendering module to render the 3-D virtual model can include attributes of objects associated with the structure.
  • the GUI module can be configured to display the attributes of each object to the user upon request. For example, the GUI module can be configured to display callouts for presenting the attributes of each object within the structure to the user.
  • the 3-D virtual model can comprise a parametric 3-D virtual model.
  • a modification to at least one attribute of a first object can be configured to cause the 3-D rendering module to modify attributes of at least a second object associated with the first object within the parametric 3-D virtual model.
  • the objects can comprise smart objects.
  • the 3-D rendering module can be configured to render an impact of an action directed to a smart object using the attributes of the smart object and a nature of the action for display to the user.
  • the situational awareness information can include sensor data received from sensors associated with the structure.
  • the sensors can include smoke sensors, infrared or flame sensors, video, surveillance cameras or closed-circuit television, audio sensors, motion sensors and the like.
  • the sensor data can comprise historical sensor data and real-time or substantially real-time sensor data.
  • the 3-D rendering module can be configured to render in the 3-D virtual model the sensor data for display to the user.
  • One or more sensors can be displayed within the 3-D virtual model as linking points. Accordingly, a user selection of a linking point can be configured to display to the user the sensor data received from the corresponding sensor.
  • the situational awareness information can include information associated with an emergency occurring within the structure.
  • the situational awareness information can include alert or alarm notifications associated with the structure.
  • the situational awareness information can include environmental information associated with the structure. Accordingly, the 3-D rendering module can be configured to render in the 3-D virtual model the environmental information for displaying to the user an environment in which the structure resides.
  • the 3-D rendering module can be configured to render in the 3-D virtual model locations of objects within the structure for display to the user.
  • the objects can include people.
  • the GUI module can be configured to display layers of the 3-D virtual model to the user for viewing structural elements and/or internal layouts of the structure.
  • the structural elements can include plumbing systems, electrical systems, mechanical systems, environmental systems, emergency equipment systems of the structure and the like.
  • the GUI module can be configured to receive instructions from the user for navigating the 3-D virtual model to examine the structure and the situational awareness information associated with the structure.
  • the database module can be configured to store at least one of the situational awareness information associated with the structure and the 3-D virtual model of the structure integrating the situational awareness information.
  • the GUI module can comprise a geographic information system (GIS) or the like.
  • the 3-D virtual model can comprise a photo-realistic representation of the structure.
  • the 3-D virtual model of the structure integrating the situational awareness information associated with the structure can displayed to the user over a network, such as an intranet or internet (e.g., the Internet or World Wide Web).
  • the structure can comprise a building or any other suitable type of facility.
  • an emergency response system includes a situational awareness engine.
  • the situational awareness engine is configured to gather situational awareness information associated with a facility.
  • the system includes a 3-D model generation engine in communication with the situational awareness engine.
  • the 3-D virtual model generation engine is configured to generate a 3-D virtual model of the facility utilizing structural information associated with the facility.
  • the 3-D virtual model generation engine is configured to incorporate into the 3-D virtual model the situational awareness information associated with the facility.
  • the system includes a display engine in communication with the 3-D virtual model generation engine.
  • the display engine is configured to display the 3-D virtual model of the facility incorporate the situational awareness information associated with the facility to a user for navigating the 3-D virtual model for situation assessment and emergency response planning.
  • the situational awareness engine can comprise a storage device.
  • the storage device can be configured to store at least one of the structural information associated with the facility, the situational awareness information associated with the facility, and the 3-D virtual model of the facility generated by the 3-D virtual model generation engine.
  • the situational awareness engine can comprise a transceiver.
  • the transceiver can be configured to transmit and receive the situational awareness information
  • the system can include a situational awareness response engine in communication with the 3- D virtual model generation engine.
  • the situational awareness response engine can be configured to generate at least one proposed response to an emergency situation occurring within the facility.
  • the situational awareness response engine can comprise a simulation engine.
  • the simulation engine can be configured to generate simulations of situational awareness scenarios associated with the facility.
  • the situational awareness response engine can comprise a path determination engine.
  • the path determination engine can be configured to determine ingress and/or egress routes through the facility using the structural information and situational awareness information associated with the facility.
  • the 3-D virtual model generation engine can be configured to render in the 3-D virtual model the at least one of ingress and egress routes for display to the user.
  • the path determination engine can be configured to maintain a list of substantially all individual paths through the facility.
  • a route between points in the facility can comprise at least one individual path.
  • Each of the individual paths through the facility can be assigned a path weight in accordance with the length of the individual path and/or the level of difficulty in traversing the individual path.
  • the path determination engine can be configured to generate the total path weight of the route by summing the path weights of the individual paths that comprise the route.
  • the 3-D virtual model generation engine can be configured to generate in the 3-D virtual model the route between the points in the facility with a lowest total path weight for display to the user.
  • the 3-D virtual model generation engine can comprise a model translation engine.
  • the model translation engine can be configured to convert the 3-D virtual model generated by the 3-D virtual model generation engine into a format displayable by the display engine.
  • a method of providing situational awareness for a structure includes the steps of: a.) collecting structural information associated with the structure; b.) gathering situational awareness information associated with the structure; c.) rendering a 3-D virtual model of the structure utilizing the structural information associated with the structure; d.) integrating into the 3-D virtual model the situational awareness information associated with the structure; and e.) displaying to a user the 3-D virtual model of the structure integrating the situational awareness information associated with the structure.
  • the method can include the steps of: f.) determining ingress and/or egress routes through the structure using the structural information and situational awareness information associated with the structure; and g.) rendering in the 3-D virtual model the ingress and/or egress routes for display to the user.
  • the egress routes through the structure can include evacuation routes from the structure.
  • Step (f) can include the step of: fl .) determining a shortest route between points within the structure.
  • step (g) can include the step of: gl.) rendering in the 3-D virtual model the shortest route for display to the user.
  • step (f) can include the steps of: fl.) maintaining a list of substantially all individual paths through the structure; f2.) assigning a path weight to each of the individual paths through the structure in accordance with at least one of a length of the individual path and a level of difficulty in traversing the individual path, wherein a route between points in the structure can comprise at least one individual path; and f3.) summing the path weights of the individual paths that comprise the route to generate a total path weight of the route.
  • step (g) can include the step of: gl.) rendering in the 3-D virtual model the route between the points in the structure with a lowest total path weight for display to the user.
  • Step (f) can further include the step of: f4.) modifying path weights to alter the route between the points in the structure. Additionally or alternatively, step (f) can include the step of: fl .) calculating distance measurements for each of the ingress and egress routes through the structure for display to the user.
  • the method can include the step of: h.) transmitting and receiving the situational awareness information.
  • Step (h) can include the step of: hi.) communicating the situational awareness information for collaborative situation assessment and response planning. Additionally or alternatively, step (h) can include the step of: hi .) communicating the situational awareness information with crisis incident management systems, integrated incident management systems, and the like.
  • the method can include the step of: i.) converting the 3-D virtual model into a format displayable in step (e).
  • Step (e) can include the step of: el.) displaying the 3-D virtual model of the structure integrating the situational awareness information associated with the structure on a portable display device.
  • step (e) can include the step of: el.) displaying the 3-D virtual model of the structure integrating the situational awareness information associated with the structure through a Web browser.
  • the method can include the steps of: j.) generating simulations of situational awareness scenarios associated with the structure; and/or k.) generating at least one proposed response to an emergency situation occurring within the structure.
  • the structural information used in step (c) to render the 3-D virtual model can include attributes of objects associated with the structure.
  • Step (e) can include the step of: el.) displaying the attributes of each object to the user upon request.
  • step (e) can include the step of: e2.) displaying callouts for presenting the attributes of each object within the structure to the user.
  • the 3-D virtual model can comprise a parametric 3-D virtual model.
  • step (c) can include the steps of: cl.) receiving a modification to at least one attribute of a first object; and c2.) modifying attributes of at least a second object associated with the first object within the parametric 3-D virtual model.
  • the objects can comprise smart objects.
  • step (c) can include the step of: cl.) rendering an impact of an action directed to a smart object using the attributes of the smart object and a nature of the action for display to the user.
  • the situational awareness information can include sensor data received from sensors associated with the structure.
  • the sensors can include smoke sensors, infrared sensors, video surveillance cameras, motion sensors and the like.
  • the sensor data can comprise historical sensor data and real-time or substantially real-time sensor data.
  • Step (d) can comprise the step of: dl.) rendering in the 3-D virtual model the sensor data for display to the user.
  • Step (e) can comprise the steps of: el.) displaying at least one sensor within the 3-D virtual model as a linking point; and e2.) displaying to the user the sensor data received from the sensor upon user selection of a corresponding linking point.
  • the situational awareness information can include information associated with an emergency occurring within the structure.
  • the situational awareness information can include alert notifications associated with the structure.
  • the situational awareness information can include environmental information associated with the structure.
  • step (d) can include the step of: dl.) rendering in the 3-D virtual model the environmental information for displaying to the user an environment in which the structure resides.
  • step (d) can include the step of: d2.) rendering in the 3-D virtual model locations of objects within the structure for display to the user.
  • the objects can include people.
  • Step (e) can include the step of: el.) displaying layers of the 3-D virtual model to the user for viewing at least one of structural elements and internal layouts of the structure.
  • the structural elements can include one or more of plumbing systems, electrical systems, mechanical systems, environmental systems, emergency equipment systems of the structure and the like.
  • Step (e) can include the step of: e2.) receiving instructions from the user for navigating the 3-D virtual model to examine the structure and the situational awareness information associated with the structure.
  • the method can include the step of: 1.) storing at least one of situational awareness information associated with the structure and the 3-D virtual model of the structure integrating the situational awareness information.
  • Step (e) can include the step of: e3.) displaying the 3-D virtual model of the structure integrating the situational awareness information associated with the structure using a GIS.
  • the 3-D virtual model can comprise a photo-realistic representation of the structure or the like.
  • Step (e) can include the step of: e4.) displaying the 3-D virtual model of the structure integrating the situational awareness information associated with the structure to the user over a network.
  • the network can comprise an internet or an intranet.
  • the structure can comprise a building or other suitable type of facility.
  • a method of responding to an emergency includes the steps of: a.) generating a 3-D virtual model of a facility utilizing structural information associated with the facility; b.) gathering situational awareness information associated with the facility; c.) rendering into the 3-D virtual model the situational awareness information associated with the facility; and d.) displaying the 3-D virtual model of the facility integrating the situational awareness information associated with the facility to a user for navigating the 3-D virtual model for situation assessment and emergency response planning.
  • step (b) can include the step of: bl.) storing the structural information associated with the facility, the situational awareness information associated with the facility, and/or the 3-D virtual model of the facility generated by the 3-D virtual model generation engine.
  • Step (b) can include the step of: b2.) communicating the situational awareness information.
  • the method can include the step of: e.) generating at least one proposed response to an emergency situation occurring within the facility.
  • Step (e) can include the step of: el.) generating simulations of situational awareness scenarios associated with the facility.
  • step (e) can include the step of: e2.) determining ingress and/or egress routes through the facility using the structural information and situational awareness information associated with the facility.
  • step (c) can include the step of: cl.) rendering in the 3-D virtual model the ingress and/or egress routes for display to the user.
  • Step (e2) can include the steps of: e3.) maintaining a list of substantially all individual paths through the facility, wherein a route between points in the facility can comprise at least one individual path; e4.) assigning a path weight to each of the individual paths through the facility in accordance with the length of the individual path and/or the level of difficulty in traversing the individual path; e5.) generating a total path weight of the route by summing the path weights of the individual paths that comprise the route; and wherein step (c) can include the step of: c2.) rendering in the 3-D virtual model the route between the points in the facility with a lowest total path weight for display to the user.
  • the method can include the step of: f.) converting the 3-D virtual model into a format displayable in step (d).
  • a system for providing situational awareness for a structure includes means for storing structural information associated with the structure.
  • the system includes means for gathering situational awareness information associated with the structure.
  • the system includes means for rendering a 3-D virtual model of the structure utilizing the structural information associated with the structure.
  • the rendering means is configured to integrate into the 3-D virtual model the situational awareness information associated with the structure.
  • the rendering means is in communication with the storing means and the gathering means.
  • the system includes means for displaying to a user the 3-D virtual model of the structure integrating the situational awareness information associated with the structure.
  • the displaying means is in communication with the rendering means.
  • the system can include means for selecting a path in communication with the rendering means.
  • the path selecting means can be configured to determine ingress and/or egress routes through the structure using the structural information and situational awareness information associated with the structure.
  • the rendering means can be configured to render in the 3-D virtual model the ingress and/or egress routes for display to the user.
  • the egress routes through the structure can include evacuation routes from the structure.
  • the path selecting means can be configured to determine the shortest route between points within the structure.
  • the rendering means can be configured to render in the 3-D virtual model the shortest route for display to the user.
  • the path selecting means can be configured to maintain a list of substantially all individual paths through the structure.
  • Each of the individual paths through the structure can be assigned a path weight in accordance with the length of the individual path and/or the level of difficulty in traversing the individual path.
  • a route between points in the structure can comprise at least one individual path.
  • the path selecting means can be configured to generate the total path weight of the route by summing the path weights of the individual paths that comprise the route. Accordingly, the rendering means can be configured to render in the 3-D virtual model the route between the points in the structure with the lowest total path weight for display to the user. Additionally or alternatively, the path selecting means can be configured to receive modifications of path weights to alter the route between the points in the structure.
  • the path selecting means can also be configured to calculate distance measurements for each of the ingress and egress routes through the structure for display to the user.
  • the system can include means for communicating in communication with the gathering means.
  • the communicating means can be configured to transmit and receive the situational awareness information.
  • the communicating means can be configured to transmit and receive the situational awareness information for collaborative situation assessment and response planning.
  • the communicating means can be configured to communicate situational awareness information with crisis incident management systems, integrated incident management systems and the like.
  • the system can include means for converting in communication with the rendering means and the displaying means.
  • the converting means can be configured to convert the 3-D virtual model rendered by the rendering means into a format displayable by the displaying means.
  • the displaying means can be configured to display the 3-D virtual model of the structure integrating the situational awareness information associated with the structure on a portable display device.
  • the displaying means can be configured to display the 3-D virtual model of the structure integrating the situational awareness information associated with the structure through a Web browser.
  • the system can include means for simulating in communication with the rendering means.
  • the simulating means can be configured to generate simulations of situational awareness scenarios associated with the structure.
  • the system can include means for generating situational awareness responses in communication with the rendering means.
  • the situational awareness response generating means can be configured to generate one or more proposed responses to an emergency or other critical situation occurring within the structure.
  • the structural information used by the rendering means to render the 3-D virtual model can include attributes of objects associated with the structure.
  • the displaying means can be configured to display the attributes of each object to the user upon request.
  • the displaying means can be configured to display callouts for presenting the attributes of each object within the structure to the user.
  • the 3-D virtual model can comprise a parametric 3-D virtual model. Accordingly, a modification to at least one attribute of a first object can be configured to cause the rendering means to modify attributes of at least a second object associated with the first object within the parametric 3-D virtual model.
  • the objects can comprise smart objects. Accordingly, the rendering means can be configured to render an impact of an action directed to a smart object using the attributes of the smart object and a nature of the action for display to the user.
  • the situational awareness information can include sensor data received from sensors associated with the structure.
  • the sensors can include smoke sensors, infrared sensors, video surveillance cameras, motion sensors and the like.
  • the sensor data can comprise historical sensor data and real-time or near real-time sensor data.
  • the rendering means can be configured to render in the 3-D virtual model the sensor data for display to the user. For example, at least one sensor can be displayed within the 3-D virtual model as a linking point. A user selection of a linking point can be configured to display to the user the sensor data received from the corresponding sensor.
  • the situational awareness information can include information associated with an emergency occurring within the structure.
  • the situational awareness information can include alert or alarm notifications associated with the structure.
  • the situational awareness information can include environmental information associated with the structure.
  • the rendering means can be configured to render in the 3-D virtual model the environmental information for displaying to the user an environment in which the structure resides.
  • the rendering means can be configured to render in the 3-D virtual model locations of objects within the structure for display to the user.
  • the objects can include, for example, people.
  • the displaying means can be configured to display layers of the 3-D virtual model to the user for viewing structural elements and/or internal layouts of the structure.
  • the structural elements can include one or more of plumbing systems, electrical systems, mechanical systems, environmental systems, emergency equipment systems of the structure and the like.
  • the displaying means can be configured to receive instructions from the user for navigating the 3-D virtual model to examine the structure and the situational awareness information associated with the structure.
  • the storing means can be configured to store at least one of the situational awareness information associated with the structure and the 3-D virtual model of the structure integrating the situational awareness information.
  • the displaying means can comprise a geographic information means or the like.
  • the 3-D virtual model can comprise a photo-realistic representation of the structure.
  • the 3-D virtual model of the structure integrating the situational awareness information associated with the structure can be displayed to the user over a network.
  • the network can comprise any suitable form of internet or intranet.
  • the structure can comprise a building or any other suitable type of facility.
  • an emergency response system includes means for collecting situational awareness information associated with a facility.
  • the system includes means for generating a 3-D virtual model of the facility utilizing structural information associated with the facility.
  • the 3-D virtual model generating means is configured to incorporate into the 3-D virtual model the situational awareness information associated with the facility.
  • the 3-D virtual model generating means is in communication with the collecting means.
  • the system includes means for displaying the 3-D virtual model of the facility incorporate the situational awareness information associated with the facility to a user for navigating the 3-D virtual model for situation assessment and emergency response planning.
  • the displaying means is in communication with the 3-D virtual model generating means.
  • the collecting means can comprise means for storing one or more of the structural information associated with the facility, the situational awareness information associated with the facility, and the 3-D virtual model of the facility generated by the 3-D virtual model generating means.
  • the collecting means can comprise means for transceiving.
  • the transceiving means can be configured to transmit and receive the situational awareness information.
  • the system can include means for generating situational awareness responses in communication with the 3-D virtual model generating means.
  • the situational awareness response generating means can be configured to generate at least one proposed response to an emergency situation occurring within the facility.
  • the situational awareness response generating means can comprise means for generating simulations of situational awareness scenarios associated with the facility.
  • the situational awareness response generating means can comprise means for determining paths.
  • the path determining means can be configured to determine ingress and/or egress routes through the facility using the structural information and situational awareness information associated with the facility.
  • the 3-D virtual model generating means is configured to render in the 3-D virtual model the ingress and/or egress routes for display to the user.
  • the path determining means can be configured to maintain a list of substantially all individual paths through the facility.
  • a route between points in the facility can comprise at least one individual path.
  • Each of the individual paths through the facility can be assigned a path weight in accordance with the length of the individual path and/or the level of difficulty in traversing the individual path.
  • the path determining means can be configured to generate the total path weight of the route by summing the path weights of the individual paths that comprise the route.
  • the 3-D virtual model generating means can be configured to generate in the 3-D virtual model the route between the points in the facility with the lowest total path weight for display to the user.
  • the 3-D virtual model generating means can comprise means for converting the 3-D virtual model generated by the 3-D virtual model generating means into a format displayable by the displaying means.
  • a computer-readable medium contains a computer program for providing situational awareness for a structure.
  • the computer program performs the steps of: a.) receiving structural information associated with the structure; b.) receiving situational awareness information associated with the structure; c.) rendering a 3-D virtual model of the structure utilizing the structural information associated with the structure; d.) integrating into the 3-D virtual model the situational awareness information associated with the structure; and e.) generating display information for displaying to a user the 3-D virtual model of the structure integrating the situational awareness information associated with the structure.
  • the computer program can perform the steps of: f.) determining at least one of ingress and egress routes through the structure using the structural information and situational awareness information associated with the structure; and g.) rendering in the 3-D virtual model the at least one of ingress and egress routes for display to the user.
  • the computer program can perform the step of: fl .) determining a shortest route between points within the structure; and for step (g) the computer program can perform the step of: gl.) rendering in the 3-D virtual model the shortest route for display to the user.
  • the computer program can perform the steps of: fl.) storing a list of substantially all individual paths through the structure; f2.) assigning a path weight to each of the individual paths through the structure in accordance with at least one of a length of the individual path and a level of difficulty in traversing the individual path, wherein a route between points in the structure can comprise at least one individual path; and f3.) summing the path weights of the individual paths that comprise the route to generate a total path weight of the route; and wherein for step (g) the computer program performs the step of: gl .) rendering in the 3-D virtual model the route between the points in the structure with a lowest total path weight for display to the user.
  • the computer program can further perform the step of: f4.) modifying path weights to alter the route between the points in the structure. Additionally or alternatively, for step (f) the computer program can perform the step of: fl.) calculating distance measurements for each of the ingress and egress routes through the structure for display to the user.
  • the computer program performs the steps of: h.) converting the 3-D virtual model into a format displayable in step (e); i.) generating simulations of situational awareness scenarios associated with the structure; and/or j.) generating at least one proposed response to an emergency situation occurring within the structure.
  • the computer program can perform the step of: el .) receiving instructions from the user for navigating the 3-D virtual model to examine the structure and the situational awareness information associated with the structure.
  • the computer program can perform the step of: k.) storing at least one of situational awareness information associated with the structure and the 3-D virtual model of the structure integrating the situational awareness information.
  • a computer-readable medium contains a computer program for responding to an emergency or other critical situation.
  • the computer program performs the steps of: a.) generating a 3-D virtual model of a facility utilizing structural information associated with the facility; b.) receiving situational awareness information associated with the facility; c.) rendering into the 3-D virtual model the situational awareness information associated with the facility; and d.) generating display information for displaying the 3-D virtual model of the facility integrating the situational awareness information associated with the facility to a user for navigating the 3-D virtual model for situation assessment and emergency response planning.
  • the computer program can perform the step of: e.) generating at least one proposed response to an emergency situation occurring within the facility.
  • the computer program can perform the step of: el.) generating simulations of situational awareness scenarios associated with the facility.
  • the computer program can perform the steps of: e2.) determining at least one of ingress and egress routes through the facility using the structural information and situational awareness information associated with the facility.
  • the computer program can perform the step of: cl.) rendering in the 3-D virtual model the at least one of ingress and egress routes for display to the user.
  • the computer program can perform the steps of: e3.) storing a list of substantially all individual paths through the facility, wherein a route between points in the facility can comprise at least one individual path; e4.) assigning a path weight to each of the individual paths through the facility in accordance with at least one of a length of the individual path and a level of difficulty in traversing the individual path; e5.) generating a total path weight of the route by summing the path weights of the individual paths that comprise the route.
  • the computer program can perform the step of: c2.) rendering in the 3-D virtual model the route between the points in the facility with a lowest total path weight for display to the user.
  • FIG. 1 is a block diagram illustrating a system for providing situational awareness for a structure, in accordance with an exemplary embodiment of the present invention.
  • FIG. 2 is a flowchart illustrating steps for collecting structural information associated with a structure for use in rendering the 3-D virtual model of the structure using the REVITTM Building software application, in accordance with an exemplary embodiment of the present invention.
  • FIG. 3 is a diagram illustrating the various types of information that can comprise the 3-D virtual model, in accordance with an exemplary embodiment of the present invention.
  • FIG. 4 is a block diagram illustrating an emergency response system, in accordance with an alternative exemplary embodiment of the present invention.
  • FIG. 5 is a schematic illustrating an application layer diagram for the Emergency Response System, in accordance with an exemplary embodiment of the present invention.
  • FIG. 6 is a schematic illustrating an example of a hardware/software architecture of the Emergency Response System, in accordance with an exemplary embodiment of the present invention.
  • FIG. 7 is first diagram illustrating a 3-D virtual model of a structure that was created with REVIT Building and being displayed in GOOGLE Earth, in accordance with an exemplary embodiment of the present invention.
  • FIG. 8 is a second diagram illustrating the 3-D virtual model from the west entrance of Gund Hall, in accordance with an exemplary embodiment of the present invention.
  • FIG. 9 is a third diagram illustrating the 3-D virtual model from the interior of Gund Hall, in accordance with an exemplary embodiment of the present invention.
  • FIG. 10 is a fourth diagram illustrating the 3-D virtual model with several layers of Gund Hall removed, in accordance with an exemplary embodiment of the present invention.
  • FIG. 11 is a fifth diagram illustrating the 3-D virtual model with several additional layers of Gund Hall removed, in accordance with an exemplary embodiment of the present invention.
  • FIG. 12 is a sixth diagram illustrating the 3-D virtual model integrating situational awareness information, in accordance with an exemplary embodiment of the present invention.
  • FIG. 13 is a seventh diagram illustrating the 3-D virtual model providing proposed responses based on the situational awareness information, in accordance with an exemplary embodiment of the present invention.
  • FIG. 14 is an eighth diagram illustrating the 3-D virtual model providing a route through the structure based on the situational awareness information, in accordance with an exemplary embodiment of the present invention.
  • FIG. 15 is an ninth diagram illustrating the 3-D virtual model integrating additional situational awareness information, in accordance with an exemplary embodiment of the present invention.
  • FIG. 16 is a tenth diagram illustrating the 3-D virtual model with several floors peeled away, in accordance with an exemplary embodiment of the present invention.
  • FIG. 17 is an eleventh diagram illustrating the 3-D virtual model rotated and with several floors peeled away, in accordance with an exemplary embodiment of the present invention.
  • FIG. 18 is an twelfth diagram illustrating the 3-D virtual model with several floors peeled away and indicating various features located on the displayed floor, in accordance with an exemplary embodiment of the present invention.
  • FIG. 19 is a thirteenth diagram illustrating the 3-D virtual model with several floors peeled away and indicating additional features located on the displayed floor, in accordance with an exemplary embodiment of the present invention.
  • FIG. 20 is a fourteenth diagram illustrating the 3-D virtual model with several floors peeled away and indicating additional features located on the displayed floor, in accordance with an exemplary embodiment of the present invention.
  • FIG. 21 is a diagram illustrating a 3-D virtual model as a photo-realistic representation of the structure, in accordance with an exemplary embodiment of the present invention.
  • FIG. 22 is a diagram illustrating a magnified or zoomed-in view of the 3-D virtual model, in accordance with an exemplary embodiment of the present invention.
  • FIG. 23 is a flowchart illustrating steps for providing situational awareness for a structure, in accordance with an exemplary embodiment of the present invention.
  • FIG. 24 is a flowchart illustrating steps for determining ingress and/or egress routes through the structure using the structural information and situational awareness information associated with the structure, in accordance with an exemplary embodiment of the present invention.
  • FIG. 25 is a flowchart illustrating steps for responding to an emergency, in accordance with an alternative exemplary embodiment of the present invention.
  • Exemplary embodiments of the present invention are directed to a computer-based system and method for providing real-time or near real-time situational awareness for a structure using three-dimensional modeling, referred to as the Emergency Response System or ERS.
  • the ERS provides data visualization and communications for critical infrastructure assets. By integrating real-time or substantially real-time data via sensors and monitoring systems, the Emergency Response System can convey the pertinent building, human concentration/movement, and operational details that are critical in emergency and other crisis situations.
  • the ERS includes functionality to integrate, capture and store such data for dissemination, interpretation, and communication.
  • the ERS supports methodologies for rapidly comprehensible information displays and data visualization techniques to aid in the critical presentation schemes needed to make quick and informed decisions within high pressure, often chaotic, emergency situations involving multiple jurisdictions, protocols, and human communication methods.
  • the ERS comprises a local, regional and/or national secure Web- based repository including infrastructure data, drawings and related information for all types of federal, state and local facilities.
  • the Emergency Response System can address critical needs by focusing on those areas or facilities that are considered imminent targets.
  • Such an Internet-accessible system can allow for rapid query searches and information retrieval from anywhere in the United States or abroad.
  • the ERS includes functionality that can accelerate the time taken to determine the impact and appropriate response needed to effectively contain situations and understand and minimize the effects on surrounding areas.
  • all or substantially all local and infrastructure details from an area no matter how damaged by attack or disaster, can still be substantially immediately accessible for defense, recovery, and relief efforts.
  • Such information can be protected from exploitation using suitable security and encryption, thereby substantially eliminating access to those who might seek to use the information inappropriately.
  • the Emergency Response System can provide vital static and real-time (or near real-time) infrastructure data displayed in three-dimensional (3-D) models of individual buildings, campuses, partial or entire portions of cities and the like and their immediate surroundings.
  • the ERS can provide detailed 3-D virtual models of buildings, facilities and other structures, highlighting ingress and egress routes, existing emergency assets, digital photographs, vital utility shut-off valve locations, and multi-layered decision support information to address the critical need for the most salient information when responding to emergencies.
  • Exemplary embodiments of the present invention can be used by first responders, building owners, facilities management, emergency management agency personnel, government agencies (e.g., DHS, GSA, DIA, DOD, FEMA and the like) and other like personnel and organizations.
  • the ERS includes an interactive database, graphical user interface, and communication mechanisms for rapidly disseminating critical infrastructure data to all levels of personnel involved before, during, and after an emergency.
  • the ERS can provide increased information sharing from on- and off-site personnel to provide enhanced situational awareness, improved resource allocation and deployment, and better communication and coordination during an emergency.
  • the plans or other architectural schematics are usually put or stored away and generally not referenced until after an event occurs that requires inspection of these documents.
  • the Emergency Response System can provide clear and informative views, and actionable data can be represented to emergency personnel to assist in their critical mission duties.
  • enhanced visual and building-specific situational data can be made available.
  • FIG. 1 is a diagram illustrating a system 100 for providing realtime or near real-time situational awareness for a structure, in accordance with an exemplary embodiment of the present invention.
  • a "structure" can include any suitable type of building, facility, dwelling, shelter, construction or other suitable place for human activity, and can include individual buildings, facilities or the like or collections thereof (e.g., a campus, partial or entire portions of towns or cities, and the like).
  • the system 100 includes a database module 105.
  • the database module 105 is configured to store structural information associated with the structure. As discussed below, the structural information associated with the structure is used by the system 100 to render or otherwise construct 3-D virtual models of the structure.
  • structural information includes architectural, engineering, construction, security information, emergency equipment systems and other like information related to the structure, as well as any other suitable types of planning, design, specification, and other like information that is capable of describing or otherwise providing or portraying the layout and design (both internal and external) of the structure from which a detailed 3-D virtual model of the structure can be constructed.
  • the database module 105 can be comprised of any suitable type of computer- readable or other computer storage medium. According to an exemplary embodiment, the database module 105 can be comprised of any suitable type of direct-attached storage (DAS), network-attached storage (NAS), or storage area network (SAN) system, such as those offered by EMC Software of Hopkinton, Massachusetts (e.g., the DiskXtender family of products), including any suitable type of document or content management system (e.g., the Docunientum 5 Platform offered by EMC Software).
  • DAS direct-attached storage
  • NAS network-attached storage
  • SAN storage area network
  • the structural information associated with the structure can be gathered or otherwise collected from any appropriate number of suitable sources, including architectural, engineering and construction information related to the structure.
  • structural information can be obtained from the structure's owner, i.e., the individual or organization that holds the ownership rights to the physical real estate property or physical asset.
  • the information can also be project based, i.e., any new development or renovation/remodeling of a structure that requires planning, design, documentation and/or construction activities.
  • the structural information can include survey photos or drawings, such as, for example, any photographic record or drawing, whether generated manually or by computer, that describes a physical space or property with precise measurements and that records the specific settings of the photographic or measuring device.
  • photographic or drawing information can include both on-ground surveys as well as aerial and satellite based
  • a photographic or measuring device can include traditional as well as digital cameras or video equipment.
  • Survey documentation further includes precise geo- positioning of key features of the structure to describe the structure's unique position on earth.
  • the structural information can also include architectural documents.
  • Such documents can include documents generated by a registered professional or organization engaged in the planning, design, specification, and documentation of real estate projects. For example, as part of standard practice, architects produce a variety of documentation and models to analyze and communicate design solutions. However, such documentation and models are not configured to be integrated into a full building 3-D virtual model.
  • Such documentation can include, for example, manual and CAD drawings, specifications, schedules, and renderings.
  • Structural documentation can also form part of the structural information stored or otherwise maintained in the database module 105.
  • Such structural documentation can include, for example, documentation generated by any registered professional or organization engaged in the planning, design, specification, and documentation of the structural components of a real estate project or other physical asset.
  • structural engineers produce as part of standard practice a variety of documentation and models to analyze and communicate design solutions.
  • the structural information can further include documentation related to the electrical, mechanical, and/or plumbing features of the structure.
  • documentation related to the electrical, mechanical, and/or plumbing features of the structure For example, any registered professional or organization engaged in the planning, design, specification, and documentation of the mechanical systems, e.g., heating, ventilation, and air conditioning (HVAC) systems, electrical systems, and/or plumbing systems of a structure can generate documents that can be used as described herein.
  • HVAC heating, ventilation, and air conditioning
  • electrical systems, and/or plumbing systems of a structure can generate documents that can be used as described herein.
  • such professionals can produce a variety of documentation and models that can be used, for example, to analyze and communicate design solutions.
  • Any registered professional or organization engaged in the planning, design, specification, and documentation of the interior design and/or the finishes, furniture and equipment components (including emergency equipment) of a structure can also generate documentation or information that can be stored in database module 105 and used as described herein.
  • interior designers produce a variety of documentation and models to analyze and communicate design solutions.
  • Security consultants can also produce documentation and models for security systems in a structure.
  • Emergency management personnel or consultants can also generate documentation and models for emergency equipment and systems on, in, or around the structure. All such documentation and models can be gathered or otherwise collected and stored or maintained in the database module 105.
  • Information related to the landscape can also be obtained and stored in the database module 105.
  • any registered professional or organization engaged in the planning, design, specification, and documentation of the landscape components of a structure including any topographical changes, planting plans, site furniture and lighting, and environmental graphics, can produce useful documentation or generate useful information.
  • landscape architects can produce a variety of documentation and models to analyze and communicate design solutions.
  • a variety of other consultants can participate in a real estate or other physical asset project, including, but not limited to, civil engineers, transportation and traffic engineers, conveying systems consultants or engineers, life, safety, and security analysis consultants or engineers, information technology professionals, graphics consultants, lighting, acoustics and audio/visual consultants or engineers, asbestos abatement specialists, water feature consultants and the like.
  • all such consultants can produce a variety of documentation and models to analyze and communicate design solutions that can be obtained and stored in the database module 105 and used as described herein.
  • Any registered professional or organization engaged in the oversight and construction of a physical real estate or other asset project can produce, as part of standard practice, documentation related to schedules, quantity take-offs, accounting reports, shop drawings, and construction progress reports, as well as documentation related to the installation and construction of all building component and assemblies.
  • AU such information and documentation can be obtained, collected or otherwise gathered and then stored in database module 105 for use as described herein.
  • Such information can also include information produced by various sub-contractors.
  • any registered professional or organization can be engaged as a sub-contractor to construct one portion, aspect or instance of a larger physical real estate or other asset project, based on the contract documentation provided by an aggregate team of consultants, such as those described above.
  • a sub-contractor usually reports to a primary contractor and delivers schedules, quantity take-offs, shop drawings, construction progress reports, and as-built documentation, in addition to information related to the installation and construction of building components and assemblies.
  • Manufacturers can also produce documentation or information that can be stored in database module 105 and used as described herein. For example, any qualified professional or organization engaged in the production of building materials and components can produce information based on which 3-D virtual models can be constructed.
  • a manufacturer delivers, as part of standard practice, specifications, photographs, and detailed drawings of their physical products. Manufacturers can also provide additional information about how their products could or should relate to complementary products.
  • the structural information associated with the structure can be obtained from any suitable number of different and varied sources, and all such information can be collected and gathered and then stored or otherwise maintained in the database module 105.
  • the database module 105 can be comprised of a relational database of detailed 3-D virtual structure models and suitable underlying component databases.
  • the system 100 includes a situational awareness module 110.
  • the situational awareness module 110 is configured to gather, collect or otherwise receive situational awareness information associated with the structure.
  • situational awareness information can include any suitable type of information that can be used to perceive the elements in an environment, to comprehend the meaning and relative importance of those elements, and to project the status of those elements into the near future.
  • the situational awareness information can include sensor data received from sensors located in, on and around the structure.
  • Such sensors can include, but are not limited to, smoke sensors, infrared or flame sensors, audio sensors, video sensors, video surveillance cameras and/or closed-circuit television, motion sensors, gas sensors, biotelemetry, performance data from HVAC and mechanical systems or any other suitable type of information capable of being provided by instrumentation in, on, around and/or within the structure.
  • Situational awareness information can also include information associated with an emergency or other critical situation occurring in or around the structure, such as alarm or alert notifications of fire, explosion, flood, burglary or trespass, and the like, or tactical information on the nature and extent of the emergency or other critical situation.
  • the situational awareness information can further include environmental information associated with the structure.
  • the situational awareness module 110 can interface not only to the instrumentation in, on or around the structure, but also to external or outside information sources, such as news, weather or any other suitable types of real-time or near real-time data feeds (e.g., XML-based data feeds).
  • weather information from an appropriate external weather information source can be used for assessing the weather conditions immediately around or within the vicinity of the structure.
  • Such situational awareness information can be gathered by the situational awareness module 110 in real-time or near real-time from the structure and external sources to provide up-to-date information for use in situational assessment.
  • Such information can be stored (in either the situational awareness module 110 or the database module 105) for later retrieval to provide historical situational awareness data (e.g., historical sensor data).
  • the system 100 can include a communication module 115 in communication with the situational awareness module 110.
  • the communication module 115 is configured to transmit and receive situational awareness information associated with the structure (e.g., sensor data from the building instrumentation, tactical or operational information from personnel at the scene, and the like) and suitable external or other outside sources.
  • the communication module 115 can be comprised of any suitable type of transceiver or communication element, device, circuit or system that is capable of communicating such information either wirelessly or through wired connections, or any combination thereof, using any suitable type of transmission protocol or standard.
  • the communication module 115 can provide the system 100 with the ability to share situational awareness information with other systems, such as, for example, crisis command or incident management systems, integrated incident management systems or the like, to allow for collaborative situation assessment and response planning between such systems and various personnel (e.g., personnel from different emergency response agencies).
  • systems such as, for example, crisis command or incident management systems, integrated incident management systems or the like, to allow for collaborative situation assessment and response planning between such systems and various personnel (e.g., personnel from different emergency response agencies).
  • the situational awareness module 115 can be configured to transform the situational awareness information into a normalized or uniform format used by the system 100 after receipt, and transform such information into the format recognized by the external system prior to transmission.
  • the situational awareness information can include an identification (e.g., a unique alphanumeric designation, a unique IP address or the like) of the system supplying such information.
  • An appropriate look-up table can be maintained by the situational awareness module 110 that maps the identification of the system supplying the information to the type of information format supported by such system.
  • the situational awareness module 110 can "understand" the format used by the other system and then perform the appropriate transformations on the data, if necessary, to convert the information into the format used by the system 100.
  • the situational awareness module 110 can look up the identification of the system to which the information is to be sent, and retrieve formatting or transform information for that system.
  • Such transformation can be algorithmic (e.g., transcoding of video data from one format to another) or format-specific (e.g., all numbers must have two decimal places), and such transformation or formatting information can be included in or referred to by the look-up table to allow the situational awareness module 110 to perform the required transformation or conversion.
  • the situational awareness module 110 can then transform, transcode, convert, format or re-format the data, as necessary, to accommodate the system 100 or the external system.
  • the communication module 115 can perform such look-ups and transformations on behalf of the situational awareness module 110 to abstract such data format differences away from the situational awareness module 110 and the rest of system 100.
  • the system 100 includes a 3-D rendering module 120 in communication with the database module 105, the situational awareness module 110 and the communication module 115.
  • the 3-D rendering module 120 is configured to render a 3-D virtual model or digital representation of the structure utilizing the structural information associated with the structure that is stored in the database module 105.
  • any suitable system or method can be used by the 3-D rendering module 120 to create, generate or otherwise render the 3-D virtual model of the structure.
  • the structural information for individuals features or objects of the structure e.g., walls, windows, doors, corridors, ceilings or roofing, rooms or other enclosures, furniture, and the like
  • 3-D virtual component models of walls can be created from the structural information associated with the walls of the structure using suitable 3-D rendering algorithms to create the 3-D virtual wall component models.
  • 3-D virtual wall component models can also include 3-D virtual component models of systems that reside in those walls, such as plumbing systems, electrical systems, mechanical systems, environmental systems, emergency equipment systems and the like of the structure that can be obtained from the structural information to create the corresponding 3-D virtual component models of those system.
  • 3-D virtual component models of windows can be created from the structural information associated with the windows of the structure using suitable 3-D rendering algorithms to create the 3-D virtual window component models.
  • Such individual 3-D virtual component models can be created for each feature or asset of the structure.
  • These individual 3-D virtual component models can then be combined by the 3-D rendering module 120 to create the entire 3-D virtual model of the structure and any and all 3-D views of the exterior and interior layout of the structure.
  • the separate 3-D virtual component models can be integrated by the 3-D rendering module 120 to generate a geo-positioned, three-dimensional digital representation of the structure, also referred to as the 3-D virtual structure model.
  • the 3-D virtual component models and the 3- D virtual structure model can comprise any suitable 3-D representation of the given components and/or structure, from simple wire-frame models to more complex and detailed photo-realistic representations (e.g., illustrating textures of materials and the like), depending upon the needs of the users, the intended use of the system 100, and other like factors.
  • the 3-D virtual component models and the 3-D virtual model of the structure generated by the 3-D rendering module 120 can include, for example, several software/computer generated models.
  • the systems and methods described herein do not necessarily make use of any single software application or suite of software applications in the development of the 3-D virtual component and structure models.
  • exemplary embodiments of the present invention can make use of an integrated virtual model based on several different underlying models that are integrated by the 3-D rendering module 120.
  • the 3-D virtual component models and 3-D virtual structure model can be generated using a suitable 3-D solution that is capable of describing real world geometries including a third dimension, for example, as solid models.
  • Such solutions can be capable of performing Boolean and other algorithmic operations that allow for the creation of complex solids.
  • 3-D software solutions can provide for digital documentation of the geometric properties of objects and typically position objects relative to each other using insertion points as the basis for relational positioning.
  • Photo modeling solutions that allow for the creation of solid 3-D geometries from photographs, in the absence of any CAD or manually generated documentation, can also be used to generate the 3-D virtual component models and 3-D virtual structure model.
  • Photo based modeling can, for example, be based on naval science. If a field of view is known and one dimension within the photograph is accurate, then all geometric dimensions can be related to that dimension and, therefore, the entire environment can be extrapolated.
  • the focal length setting determines the field of view. For example, a focal length of 55 mm can be considered ideal, as that is both a standard type lens as well as the closest approximation of the human eye.
  • a photo modeling solution can also be used to capture the image of materials and surfaces of real world objects.
  • graphics solutions can also be used to adjust the visual accuracy of real world materials and finishes.
  • the resulting corrected material images can form the basis of visual material maps that can then be applied to the 3-D virtual component models and/or the 3-D virtual structure model.
  • Photometric solutions can be used to apply real world lighting characteristics, as defined by the Illuminating Engineering Society, to light fixture components within the 3-D virtual component models and the 3-D virtual structure model.
  • the process of calculating the actual light distribution within a 3-D environment can be based on various techniques. For example, one technique, called ray-tracing, traces the light emitted from a source and tracks it until it bounces against another solid, at which point the ray is processed.
  • the object's material properties such as, for example, absorption/reflectivity, can then be used to further trace the ray until it bounces against another solid object.
  • Such a method can be "demand- driven,” in that the light rays are calculated after a view has been established, and, therefore, the angles of polygons defining the associated 3-D environment are known, allowing for the ray-tracing to occur.
  • Another technique is called radiosity that is a "data-computational" method of light calculation. Radiosity is based on preset intensity and material specifications of each object within the environment being modeled. With such information, the effect of light sources on each object can be calculated, as well as the light and color impact due, for example, to the proximity of two objects.
  • Another technique that can be used is global illumination. Such a technique takes into account not only the light coming directly from light sources, but also the reflection of any light off of any surface in the 3-D virtual component models or the 3-D virtual structure model.
  • laser/light scanning can be used.
  • Such a method uses lasers, or some other photographic-light-based technology, to scan real world objects to develop an integrated solution of geometric description of a 3-D object and its associated material image map.
  • Various levels of accuracy can be achieved depending on the specific technology as required by a particular implementation.
  • a Global Positioning System (GPS) solution can be used to identify a specific digital point in a 3-D virtual component model or the 3-D virtual structure model as being precisely positioned as a unique instance on Earth. Such a solution can also be used to mark the specific period of time that that 3-D virtual component model or 3-D virtual structure model is located in such position.
  • GPS Global Positioning System
  • Metadata can also be used in the creation or rendering of the 3-D virtual component models and the 3-D virtual structure model.
  • a suitable metadata editor can be used to add, edit, and manage non-geometric or tabular data that has been associated with 2-D or 3-D geometric descriptions of 3-D objects.
  • Such an editor can be used, for example, to link a 3-D virtual component model or the 3-D virtual structure model to other types of applications including databases, cost estimating, project management, scheduling software and the like.
  • a physical construction methodology can also be used in the rendering of the 3-D virtual structure model by the 3-D rendering module 120.
  • the physical construction methodology refers to the complete set of processes and resources required to physically build a specific real estate property or structure on a particular location on Earth. Such a methodology can be dependent on the material and handling specifications intrinsic to the material and as described by the manufacturer(s) of that material.
  • the tools, techniques, and solutions described above can be used to generate models or other structures or data that can then be used by the 3-D rendering module 120 to generate the 3-D virtual component models that can be integrated or otherwise assembled to render the geo-positioned 3-D virtual model of the structure.
  • the 3-D rendering module 120 can use the structural information associated with the structure to create the 3-D virtual structure model directly, without rendering or using individual 3-D virtual component models.
  • other methods for rendering the 3-D virtual model of the structure can be used, such as those described in, for example, U.S. Patent Application Publication No. 2005/0131657 to Hsaio Lai Sean Mei, entitled “Systems and Methods for 3D Modeling and Creation of a Digital Asset Library” and filed on December 16, 2003, the entire contents of which are hereby incorporated herein in their entirety.
  • the REVITTM series of products in particular, the REVITTM Building software system, distributed by Autodesk, Inc. (San Rafael, California) can be used by the 3-D rendering module 120 to create the 3-D virtual model of the structure, and any 3-D virtual component models of which the 3-D virtual structure model can be comprised.
  • REVITTM Building is a building information modeling (BIM) system that provides a conceptual modeling and design environment that takes any overall building form described by the user and maps it to real-world entities. For example, through concept modeling, the user can create a building shell and then select faces to design walls, roofs, floors and curtain systems.
  • REVITTM Building provides a fully-integrated building information model with a single project database for simplified project management.
  • Model linking is supported for connecting separate models into a single integrated project.
  • "families” e.g., a door
  • nested components e.g., various hardware sets
  • the families can be created graphically and combined with other graphical families to create the overall structure.
  • REVITTM Building also allows the user to view the individual components and overall structure in three dimensions, for example, using raytracing and radiosity for 3-D visualizations.
  • suitable software applications or techniques can be used to create the 3-D virtual model of the structure according to exemplary embodiments, such as, for example, SKETCHUPTM offered by Google, Inc.
  • FIG. 2 is a flowchart illustrating steps for collecting structural information associated with a structure for use in rendering the 3-D virtual model of the structure using REVITTM Building, in accordance with an exemplary embodiment of the present invention.
  • step 202 a determination is made as to whether or not the structural information is in the form of a REVITTM series (digital) file. If so, then in step 204, the REVITTM model is generated from or otherwise updated with the structural information contained in the REVITTM series files.
  • Ih step 206 a determination is made as to whether or not the REVITTM model is current, in other words, whether or not there is no additional structural information to collect for model at that time. If so, then in step 208, the model is archived or otherwise stored (e.g., for purposes of backup), and in step 210 the model is passed to the GUI module 125 for display to the user via display 130, as described below (a translation of the model into a different data format supported by the GUI module 130 and display 130 may need to be performed by model translation module 135, as described below). However, in step 206, if it determined that the model is not current, then the process returns to step 202.
  • step 212 a determination is made as to whether the structural information is in the form of digital CAD files. If so, then in step 214, the digital CAD files are located or otherwise collected. In step 216, the collected digital CAD files are sorted and cataloged. In step 218, the sorted/cataloged digital CAD files are stored (e.g., for purposes of backup), and then retrieved in step 220. In step 222, the digital CAD files are imported into the REVITTM model, and the newly-imported structural information is redrawn in the REVITTM model in step 224. The method continues with step 204, as described above.
  • step 226 a determination is made as to whether the structural information is in the form of paper drawings. If so, then in step 228, the paper drawings are located or otherwise collected. In step 230, the collected paper drawings are sorted and cataloged. In step 232, the sorted/cataloged paper drawings are scanned to create corresponding digital files in step 234. In step 236, the generated digital files are imported into the REVITTM model, and the newly-imported structural information is redrawn in the REVITTM model in step 224. The method continues with step 204, as described above.
  • step 230 an iterative process can be used, for example, to recreate the digital files of the structural information if necessary.
  • the paper drawings can be stored (e.g., for archival purposes), retrieved in step 240, and then scanned again in step 232 to recreate the corresponding digital files.
  • the method can return to step 238 to repeat the process as necessary.
  • step 242 field measurements of the structure can be taken to generate the structural information necessary for building the three-dimensional REVITTM model.
  • a new REVITTM model can be created from the structural information measured in step 242. The method continues with step 204, as described above.
  • the steps illustrated in FIG. 2 can be repeated any suitable number of times to collect any and all structural information associated with a structure for building the REVITTM model. Those of ordinary skill will recognize that similar steps can be undertaken for collecting structural information for use in rendering 3-D virtual models using data formats or digital models other than that supported by REVITTM Building.
  • the structural information used by the 3-D rendering module 120 to render the 3-D virtual structure model can include attributes of objects associated with the structure.
  • attributes can include characteristics of the object, such as, for example the type of object, length, width, height and weight of object, the material(s) of which the object is composed and other data or information that can be used to suitably describe and define the object.
  • an object associated with the structure can be a window
  • the attributes of window can include the type of window (e.g., interior or external, sliding or plate glass and the like), the dimensions of the window (e.g., length and width), location of the window in the wall, the type of glass used in the window, and other like attributes.
  • the attributes of the object will depend of the nature and type of object to be described by its attributes.
  • the 3-D virtual model can comprise a parametric 3-D virtual model.
  • a modification to one or more attributes of a first object can be configured to cause the 3-D rendering module 120 to modify one or more attributes of at least a second object associated with the first object within the parametric 3-D virtual model.
  • a door can comprise an object, with attributes describing the door and its position within a wall.
  • attributes describing the door and its position within a wall.
  • the 3-D rendering module 120 can automatically alter the dimensions of the wall around the door so that the door can appropriately "fit" into the wall.
  • attributes of objects can also be used to describe other objects that interact or interrelate with the original object, thereby linking objects together (e.g., the door within the wall).
  • the objects can comprise "smart" objects.
  • the 3-D rendering module 120 can be configured to render the impact or result of an action directed to a smart object using the attributes of the smart object and the nature of the action.
  • an attribute of a window can be its resistance to blasts or concussive force, such as the maximum blast force that the window can withstand.
  • the 3-D rendering module 120 can render the effect of the blast on the window.
  • smart objects can be used to determine the effects that the environment and actions occurring within that environment have on the smart objects and the structure in general. Such smart objects can be used to create an "intelligent" 3-D virtual model in which the 3-D rendering module 120 can "know” (i.e., appropriately calculate or compute) the effect of actions directed at or occurring to objects in, on or around the structure or to the structure itself to provide. The effects of those actions can then be displayed to the user as part of the overall situational awareness provided by the system 100.
  • the 3-D rendering module 120 is further configured to integrate or otherwise incorporate into the 3-D virtual model of the structure the situational awareness information associated with the structure that has been gathered or otherwise collected by the situational awareness module 110.
  • the 3-D rendering module 120 can create appropriate graphical overlays to integrate or superimpose the situational awareness information into or on the 3-D virtual model of the structure.
  • the 3-D rendering module 120 can be configured to render in the 3-D virtual model the sensor data received from the sensors or other building instrumentation situated in, on, around or within the structure.
  • each sensor or other instrumentation located in, on or around the structure can be characterized as an object and described by its concomitant attributes (e.g., type of sensor, make, model, location, and the like).
  • Situational awareness information received by the situational awareness module 110 can be passed to the 3-D rendering module 120.
  • the 3-D rendering module 120 can appropriately modify the attributes of the object based on the received situational awareness information.
  • the object can be a fire sensor in a certain room on a certain floor of the structure.
  • the situational awareness information received indicates that the fire sensor has been activated and the sensor indicates that that the temperature in the room is 225 0 F.
  • the 3-D rendering module 120 can use such information to modify or otherwise update the attributes associated with the given fire sensor.
  • the fire sensor can be rendered by the 3-D rendering module 120 using the updated attributes, for example, by changing the color, highlighting, blinking or other visual and/or audio indication of the fire sensor in the 3-D virtual model.
  • sensor data received from the fire sensor can be rendered near or adjacent the fire sensor to provide an up-to-date situational assessment of the structure and the given room in particular.
  • each, any combination or all of the sensors rendered within the 3-D virtual model of the structure can be "linking points" for allowing the user to access information associated with the sensor. For example, when a user selects the linking point (e.g., by clicking on the virtual representation of the sensor with a mouse or other computer pointing device), the sensor data received from the corresponding sensor can be displayed to the user (e.g., the temperature in the room as received from the fire sensor) in a separate window, pop-up or callout.
  • Linking points can also be used to direct the user to or provide the user with information from auxiliary or additional sources (e.g., websites, databases and the like).
  • auxiliary or additional sources e.g., websites, databases and the like.
  • any textual or graphical situation awareness information can be displayed or otherwise provided to the user in such a manner.
  • a video surveillance camera can be represented as an object within the 3-D virtual model and also serve as a linking point. Consequently, when the user selects or otherwise clicks on the virtual representation of the video surveillance camera in the 3-D virtual model (i.e., its linking point), the video data from the camera (e.g., still pictures, streaming video or the like) can be displayed to the user (e.g., in a pop-up window).
  • the 3-D rendering module 120 can be configured to render in the 3-D virtual model the environmental information to display the environment in which the structure resides. For example, if the weather data indicates that it is raining around the structure, the rain can be considered another object with which attributes (e.g., humidity, rate of falling rain and the like) can be associated. The 3-D rendering module 120 can then render a three-dimensional virtual representation of the rain around the structure using the rain object and its attributes. Other situational awareness information can be integrated into the 3-D virtual model of the structure by creating new objects and associated attributes to accommodate the information, or associating or otherwise updating existing objects and their attributes with the data.
  • environmental information e.g., weather data received from a weather feed
  • the 3-D rendering module 120 can be configured to render in the 3-D virtual model the environmental information to display the environment in which the structure resides. For example, if the weather data indicates that it is raining around the structure, the rain can be considered another object with which attributes (e.g., humidity, rate of falling rain and the like) can be associated. The
  • the 3-D rendering module 120 can be configured to render in the 3-D virtual model the locations of and information associated with any and all objects situated in, on or around the structure, including people or other personnel located at the structure. In such a way, the movements of individuals in and around the structure can be updated, tracked and monitored.
  • each person can be an object with associated attributes (e.g., name, agency association, such as fireman or policeman, GPS coordinates and other like information).
  • the 3-D rendering module 120 can update the attributes of each "object" (i.e., person) with the new coordinates to effectively track the movements of each or any person at the scene.
  • the 3-D rendering module 120 can integrate any or all real-time or near real-time situational awareness information into the 3-D virtual model for display to the user for situation assessment and response planning.
  • the 3-D virtual model of the structure can be comprised of structural information, situational awareness information, and any other suitable type of information for creating an accurate, geo-positioned 3-D virtual model of the structure that can be used for situational assessment and response planning.
  • FIG. 3 is a diagram illustrating the various types of information that can comprise the 3-D virtual model 300, in accordance with an exemplary embodiment of the present invention.
  • Geographic Information System (GIS) datasets 305 can provide appropriate GIS data 310, such as, for example, location, land usage, terrain, climate data and the like.
  • intelligent model data 315 from the REVITTM Building platform can provide appropriate building model data 320, such as, for example, ingress/egress routing, floor/zone layout, emergency valve cut-offs, facility/maintenance data, property/component data, and the like.
  • suitable data system and signaling networks 325 can provide appropriate on-site sensor data 330, such as, for example, infrared sensors, video surveillance, wireless mesh networks, biometric sensors and the like.
  • Such a layered database of information can comprise the 3-D virtual model 300 that can be displayed to a user through a suitable graphical user interface.
  • the system 100 includes a graphical user interface (GUI) module 125 in communication with the 3-D rendering module 120.
  • the GUI module 125 is configured to display to the user the 3-D virtual model of the structure integrating the situational awareness information associated with the structure.
  • the GUI module 125 can be comprised of any suitable type of user interface capable of displaying the 3-D virtual model, including the textual and/or graphical information thereof, to a user.
  • the GUI module 125 can be configured to display the 3-D virtual model through a suitable Web browser (e.g., Internet Explorer, Netscape, Firefox, Safari, Opera, or any other suitable Web browser) on a display 130.
  • a suitable Web browser e.g., Internet Explorer, Netscape, Firefox, Safari, Opera, or any other suitable Web browser
  • the 3-D virtual model of the structure that incorporates the situational awareness information associated with the structure can be displayed over a network, such as any suitable type of intranet or internet.
  • the 3-D virtual model can be remotely displayed through a suitable Web browser over the Internet or World Wide Web onto a display 130 by the GUI module 125.
  • the GUI module 125 can be configured to display the 3-D virtual model of the structure with the situational awareness information associated with the structure on any suitable type of portable display device, such as a personal digital assistant (PDA) or the like.
  • the display 130 can be comprised of any suitable type of portable or fixed display device that is capable of displaying the textual and graphical information of the 3-D virtual model to the user.
  • the system 100 can optionally include a model translation module 135 in communication with the 3-D rendering module 120 and the GUI module 125.
  • the model translation module 135 is configured to convert or otherwise transform the 3-D virtual model rendered by the 3-D rendering module 120 into a format displayable by the GUI module 125 on the display 130.
  • the model translation module 135 can use appropriate conversion algorithms or routines and/or look-up table mappings to convert the 3- D virtual structure model from the graphical and/or data format used by the system 100 into the graphical and/or data format used by the user interface on the display 130, and vice versa.
  • the system 100 can support any appropriate number of separate user interfaces and displays 130, and the model translation module 135 can be configured to convert or otherwise translate the 3-D virtual model into the data format supported by each user interface and display 130 (e.g., a one-to-many relationship).
  • each user interface and display 130 can have a separate model translation module 135 to perform the necessary conversion.
  • the GUI module 125 can comprise any suitable type of GIS.
  • a GIS is a system for creating, storing, analyzing and managing spatial data and associated attributes.
  • the GUI module 125 can comprise the GOOGLETM Earth application offered by Google, Inc. (Mountain View, California).
  • GOOGLETM Earth is a 3-D software application that combines satellite imagery, maps and GOOGLETM searching to provide users with access to the world's geographic information.
  • GOOGLETM Earth a user can point and zoom to anyplace on the planet (e.g., a specific address) that the user wants to explore. Satellite images and local facts for the given address or location are then zoomed into the view presented to the user.
  • suitable software applications or techniques can be used to display the 3-D virtual model of the structure according to exemplary embodiments.
  • the REVITTM Building software application can be used to create the 3-D virtual model of the structure
  • the GOOGLETM Earth software application can be used to display the 3-D virtual model to the user via display 130.
  • GOOGLETM Earth can be used to navigate and view the 3-D virtual model
  • the GOOGLETM searching functionality can be used to search any aspect of the 3-D virtual model.
  • the 3-D rendering module 120 can use REVITTM Building to create the 3-D virtual model of the structure, and the resulting 3-D virtual model can then be loaded or otherwise imported into the GOOGLETM Earth application that can be used by the GUI module 125.
  • the model translation module 135 can be used to convert the 3-D virtual model from the data format supported by REVITTM building into the data format supported by GOOGLETM Earth, and vice versa.
  • the model translation module 135 can using appropriate conversion, translation or transcoding algorithms and/or look-up table mappings between the different formats to convert the 3-D virtual model from one data format to another.
  • the data format of the 3-D virtual model generated by the 3-D rendering module 120 is supported by or otherwise compatible with the user interface used by the GUI module 125 and display 130, the use of model translation module 135 may not be necessary.
  • the GUI module 125 is configured to display the 3-D virtual model of the structure and any information associated with that structure through an appropriate graphical user interface via display 130.
  • the GUI module 125 can be configured to display the attributes of each object associated with the structure to the user upon request, such as by presenting information on the attributes through callouts or pop-ups via linking points, as discussed above. Additionally or alternatively, by passing a mouse cursor or other computer pointer indicator over an object, a suitable callout or pop-up can be displayed to the user with information related to the given object.
  • the GUI module 125 is further configured to receive instructions from the user for navigating the 3-D virtual model to examiner the structure and the situational awareness information associated with the structure.
  • suitable navigation buttons or controls e.g., move up/down, move left/right, zoom in/out, rotate up/down, rotate left/right and the like
  • the navigation controls can be used to alter the view of the 3-D virtual model so that the user can inspect any interior or exterior aspect of the 3-D virtual model at any suitable angle, elevation, distance, orientation or the like.
  • the navigation instructions generated by the navigation controls can be processed by the GUI module 125 to provide the desired view of the 3-D virtual model to the user.
  • the GUI module 125 can be configured to display layers of the 3-D virtual model to the user for viewing structural elements (e.g., plumbing systems, electrical systems, mechanical systems, environmental systems, emergency equipment systems and the like) and internal layouts of the structure.
  • the GUI module 125 can be configured to allow the user to "peel away" the outer layers of the 3-D virtual structure model to view successively more interior views of the structure.
  • the user could remove the outer layer (outer walls and roof) of the structure to view the immediate interior of the structure.
  • the user can them remove interior walls to view inner rooms and corridors of the structure.
  • the user can "peel away" floors of the structure to view any lower floor.
  • the user can remove the uppermost floor of the structure and then tilt and rotate the view to display the internal layout of the penultimate floor.
  • the GUI module 125 can be configured to allow the user to alter the opacity of any of the objects.
  • a navigation control in the form of a sliding lever or the like can allow the user to alter the opacity of an object (e.g., a wall) from 100% (fully opaque) to 0% (fully transparent) or any desired opacity in between.
  • Other such controls can be provided to allow the user to view any and all aspects of the 3-D virtual model for situation assessment and response planning.
  • the system 100 can include other suitable modules to assist the user in such situation assessment and response planning.
  • the system 100 can include a simulation module 140 in communication with the 3-D rendering module 120.
  • the simulation module 140 can be configured to generate simulations of situational awareness scenarios associated with the structure. Predetermined or "pre-canned" simulations can be supported by the simulation module 140.
  • certain fire alarms can be activated by the simulation module 140, e.g., by modifying or causing the 3-D rendering module 120 to modify the attributes associated with one or more fire sensors to indicate that a fire has been detected.
  • Simulated situational awareness information such as a fire temperature information, can be provided to the 3-D rendering module 120 for rendering in the 3-D virtual structure model and eventual display to the user.
  • Suitable logging or recording functionality can be used to record the response to the simulation and allow the user to playback the entire simulation at a subsequent time.
  • appropriate algorithms, Boolean or other logic functions, or even forms of artificial intelligence can be used to create random and dynamic simulations by the simulation module 140, depending on such factors as the need for simulation, the nature, types and complexity of simulation desired, the potential threats posed to the structure, and other like factors.
  • the system 100 can include a situational awareness response module 145 in communication with the 3-D rendering module 120.
  • the situational awareness response module 145 is configured to generate one or more proposed responses to an emergency situation or any other critical situation occurring in, on or around the structure.
  • the situational awareness response module 145 can be comprised of suitable algorithms, Boolean or other logic functions or rules, neural networks, and/or forms of artificial intelligence that are capable of learning information about an event and, based on that information, formulate responses to counter the event.
  • the situational awareness response module 145 can include appropriate look-up tables that can map situational awareness information to proposed responses.
  • the situation awareness response module 145 can use the fire sensor activation event to look up the corresponding response(s), e.g., activate fire alarms, evacuate the structure, and notify the fire department and local authorities.
  • suitable Boolean or other logic or rules can be used to propose responses to scenarios. For example, IF a fire sensor is activated AND the sensed temperate is above 15O 0 F, THEN activate the fire alarm AND notify the fire department.
  • the complexity of such logic or rules will depend on the nature of scenario and the number and types of responses there can be to such a scenario, as well as other like factors. More complex mechanisms, such as neural networks, can be adapted to "learn" how to respond to a particular scenarios.
  • the situational awareness module 145 can be in communication with the simulation module 140 to provide proposed responses to the simulated scenarios, for example, to allow such "learning" to take place and to refine these or other response algorithms.
  • the system 100 can be configured to provide an indication of efficient routes in, through and out of the structure.
  • the system 100 can include a path selection module 150 in communication with the 3-D rendering module 120.
  • the path selection module 150 is configured to determine ingress and/or egress routes or other paths through the structure using the structural information and situational awareness information associated with the structure.
  • the egress routes can be evacuation routes from the structure for individuals located in the building, while the ingress routes can show response personnel the shortest route into and through the structure to the location of the event, emergency or other critical situation.
  • the 3-D rendering module 120 is configured to render in the 3-D virtual model the ingress and/or egress routes for display to the user on the display 130 via the GUI module 125.
  • the path selection module 150 can be configured to determine the shortest route between points within the structure, and the 3-D rendering module 120 can be configured to render in the 3-D virtual model the shortest route for display to the user.
  • any suitable path selection algorithm can be used for determining routes in, around and through the structure between different locations or points.
  • the path selection module 150 can be configured to maintain a list of substantially all individual paths through the structure, including all individual paths along corridors, in and through rooms, up/down stairs and the like.
  • a route between two points in the structure can be comprised of one or more individual paths that are connected or otherwise joined to form the contiguous route.
  • Each of the individual paths through the structure can be assigned a path weight in accordance with, for example, the length of the individual path (e.g., shorter paths have lower or less weight than longer paths), the level of difficulty in traversing the individual path (e.g., a blocked path would have a high weight, while a clear path would have a low weight), and other like factors. Other similar factors for determining the "weight" of an individual path can be used.
  • the path selection module 150 can be configured to generate the total path weight of the route by summing the path weights of the individual paths that comprise the route.
  • the 3-D rendering module 120 can be configured to render in the 3-D virtual model the route between the points in the structure with the lowest total path weight for display to the user.
  • a predetermined number of alternative routes between the two points with the lowest path weights can be displayed to the user to provide the user with a selection of efficient routes. Modifications can be made to the path weights either automatically by the path selection module 150 or manually by the user to alter the route between the points in the structure (e.g., in response to changing situational awareness information, such as a path that suddenly becomes blocked).
  • the path selection module 150 can be configured to calculate distance measurements for each of the proposed ingress and egress routes through the structure for display to the user (e.g., by adding up the length of each individual path that comprises the route).
  • Each of modules of the system 100 can be comprised of any suitable type of electrical or electronic component or device that is capable of performing the functions associated with the respective element.
  • each component or device can be in communication with another component or device using any appropriate type of electrical connection that is capable of carrying (e.g., electrical) information.
  • each of the modules of the system 100 can be comprised of any combination of hardware, firmware and software that is capable of performing the functions associated with the respective module.
  • the system 100 can be comprised of one or more microprocessors and associated memory(ies) that store the steps of a computer program to perform the functions of any or all of the modules of the system 100.
  • the microprocessor can be any suitable type of processor, such as, for example, any type of general purpose microprocessor or microcontroller, a digital signal processing (DSP) processor, an application-specific integrated circuit (ASIC), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically-erasable programmable readonly memory (EEPROM), a computer-readable medium, or the like.
  • DSP digital signal processing
  • ASIC application-specific integrated circuit
  • PROM programmable read-only memory
  • EPROM erasable programmable read-only memory
  • EEPROM electrically-erasable programmable readonly memory
  • the memory can be any suitable type of computer memory or any other type of electronic storage medium, such as, for example, read-only memory (ROM), random access memory (RAM), cache memory, compact disc read-only memory (CDROM), electro-optical memory, magneto-optical memory, or the like.
  • ROM read-only memory
  • RAM random access memory
  • CDROM compact disc read-only memory
  • electro-optical memory magneto-optical memory, or the like.
  • the memory can be programmed using conventional techniques known to those having ordinary skill in the art of computer programming to perform the functions of any or all of the modules of the system 100.
  • the actual source code or object code of the computer program can be stored in the memory.
  • FIG. 4 is a block diagram illustrating an emergency response system 400, in accordance with an alternative exemplary embodiment of the present invention.
  • the system 400 includes a situational awareness engine 405.
  • the situational awareness engine 405 is configured to gather situational awareness information associated with a facility.
  • the system 400 includes a 3-D virtual model generation engine 410 in communication with the situational awareness engine 405.
  • the 3-D virtual model generation engine 410 is configured to generate a 3-D virtual model of the facility utilizing structural information associated with the facility.
  • the 3-D virtual model generation engine 410 is configured to incorporate into the 3-D virtual model the situational awareness information associated with the facility.
  • the system 400 also includes a display engine 415 in communication with the 3-D virtual model generation engine 410, for example, via a network connection 412 (e.g., the Internet).
  • the display engine 415 is configured to display the 3-D virtual model of the facility incorporating the situational awareness information associated with the facility to a user for navigating the 3-D virtual model for situation assessment and emergency response planning.
  • a suitable display device 417 in communication with the display engine 415 can be used to display the 3-D virtual model to the user.
  • the situational awareness engine 405 can include a storage device 420.
  • the storage device 420 can be configured to store the structural information associated with the facility, the situational awareness information associated with the facility, the 3-D virtual model of the facility generated by the 3-D virtual model generation engine 410, and/or any other suitable information.
  • the situational awareness engine 405 can also include or be in communication with a transceiver 425.
  • the transceiver 425 is configured to transmit and receive the situational awareness information.
  • the system 400 can include a situational awareness response engine 430 in communication with the 3-D virtual model generation engine 410.
  • the situational awareness response engine 430 can be configured to generate one or more proposed response to an emergency or other critical situation occurring within, on or around the facility.
  • the situational awareness response engine 430 can include a simulation engine 435.
  • the simulation engine 435 can be configured to generate simulations of situational awareness scenarios associated with the facility.
  • the situational awareness response engine 430 can also include a path determination engine 440.
  • the path determination engine can be configured to determine ingress and/or egress routes through the facility using the structural information and situational awareness information associated with the facility.
  • the 3-D virtual model generation engine 410 can be configured to render in the 3-D virtual model the ingress and/or egress routes for display to the user, hi particular, the path determination engine 440 can be configured to maintain a list of substantially all individual paths through the facility.
  • a route between points in the facility can be comprised of one or more individual paths.
  • Each of the individual paths through the facility can be assigned a path weight in accordance with, for example, the length of the individual path, the level of difficulty in traversing the individual path, and/or other similar factors.
  • the path determination engine 440 can be configured to generate the total path weight of the route by summing the path weights of the individual paths that comprise the route.
  • the 3-D virtual model generation engine 410 can be configured to generate in the 3-D virtual model the route between the points in the facility with the lowest total path weight for display to the user.
  • the 3-D virtual model generation engine 410 can include a model translation engine 445.
  • the model translation engine can be configured to convert the 3-D virtual model generated by the 3-D virtual model generation engine 410 into a format displayable by the display engine 415.
  • Other such architectures can be used to implement the functions of the systems 100 and 400 according to exemplary embodiments of the present invention.
  • each of the modules of the systems 100 and 400 can be located locally to or remotely from each other, while use of the systems 100 and 400 as a whole still occurs within a given country, such as the United States.
  • database module 105, situational awareness module 110, communication module 115, 3-D rendering module 120, model translation model 135, simulation module 140, situational awareness response module 145 and path selection module 150 can be located extraterritorially to the United States (e.g., in Canada and/or in one or more other foreign countries), while the GUI module 125 can be located within the United States, such that the control of the system 100 as a whole is exercised and beneficial use of the system 100 is obtained by the user within the United States.
  • FIG. 5 is a schematic illustrating an application layer diagram 500 for the Emergency Response System, in accordance with an exemplary embodiment of the present invention.
  • a first application layer 502 can include such application functionality as a rich content gateway application 504, a messaging/workflow/application server 506, a content management and database application 508, a storage management application 510, and a systems management application 512.
  • Such application functionality in the first application layer 502 can be used to implement some or all of the functionality of, for example, the database module 105, the situational awareness module 110 and the communication module 115 illustrated in FIG. 1.
  • the rich content gateway application 504 can be in communication with event analysis tools 514.
  • the event analysis tools 514 can be used to implement some or all of the functionality of, for example, the situational awareness response module 145 and the path selection module 145.
  • the event analysis tools 514 can be in communication with the event simulation tools 516 that can be used to implement some or all of the functionality of, for example, the simulation module 140.
  • the messaging/workflow/application server 506 can be in communication with appropriate legacy applications 518, such as legacy crisis incident management and integrated incident management systems to facilitate collaboration between those systems and the Emergency Response System. Such collaboration can be enhanced using appropriate collaborative applications 520 in communication with the content management and database application 508.
  • some or all of the applications that comprise the first application layer 502 can be implemented using, for example, the Real-time, Adaptive, Multi-Intelligence, Multimedia Platform (RAMMP) offered by International Business Machines, Inc. (White Plains, New York).
  • IBM's RAMMP provides a digital media platform for digital content management and dissemination and collaboration, and offers high-speed ingestion and analysis of video, audio and multi-sensor data in multiple formats and types.
  • the RAMMP enables users to manage and distribute video and other graphical information at variable bandwidths, resolutions and formats.
  • the RAMMP supports real-time, proactive response to dynamic situations and persistent monitoring.
  • skilled artisans will recognize that other software applications, platforms or techniques can be used to implement the first application layer 502 illustrated in FIG. 5 according to exemplary embodiments.
  • a second application layer 522 can include such application functionality as a Web-enabled GIS enterprise platform application 524, a 3-D model application 526, an event/alarm/metadata application 528, and a sensor data collection application 530 for collecting such sensor data as video, audio, text, geospatial, image and other sensor data.
  • Such application functionality in the second application layer 522 can be used to implement some or all of the functionality of, for example, situational awareness module 110, 3-D rendering module 120, model translation module 135 and GUI module 125.
  • an integration and access application layer 532 can provide the functionality (e.g., communication interfaces, data format conversion and the like) for interfacing the Emergency Response System to various mission applications 534 and any systems (e.g., legacy applications) supported by the mission applications 534.
  • the Emergency Response System can be configured to support mission applications 534 including, but not limited to, security and surveillance, situational awareness, incident management, intelligence analyst support, tactical operations support, forensic content management and any other suitable mission application.
  • the ERS can be configured to serve the public sector 536, for example, state and local EMAs, fire, police, rescue, first responders, government agencies, such as DHS, FEMA, DOD, SS, CIA, FBI and the like, embassy security and other entities in the public sector 536. Additionally or alternatively, the ERS can be configured to serve the private sector 538, such as private security firms, schools and university systems, corporations and REITs, and other entities in the private sector 538.
  • FIG. 6 is a schematic illustrating an example of a hardware/software architecture 600 of the Emergency Response System, in accordance with an exemplary embodiment of the present invention.
  • the hardware architecture 600 can include a first subsystem 602 and a second subsystem 604.
  • the first subsystem 602 can include database files 606 in communication with a suitable NAS/SAN solution 608 (e.g., such as the EMC 2 NAS/SAN Solution offered by EMC Software) that can be in communication with a suitable database server 610 (e.g., the Documentum 5 Platform for document management offered by EMC Software).
  • the database server 610 can be in communication with a content router 612.
  • Web servers 614 can also be in communication with content router 612.
  • Mandatory access controls can be provided by role-based access controls 616 that is communication with the content router 612.
  • a network manager server 618 can be in communication with the role-based access controls 616.
  • a tape backup and restore store 620 and a print-on-demand solution 622 can also be in communication with the role-based access controls 616.
  • an anti-virus application 624 e.g., offered by Symantec Corporation of Cupertino, California
  • an intrusion detection and encryption solution 626 e.g., those offered by The Windermere Group, LLC of Annapolis, Maryland
  • the first subsystem 602 can be used to implement any or all of the functionality of the database module 105, situational awareness module 110, communication module 115, 3-D rendering module 120, GUI module 125, model translation module 135, simulation module 140, situational awareness response module 145 and path selection module 150.
  • the first subsystem 602 can be located behind suitable firewalls 628 (e.g., those offered by Cisco Systems, Inc. of San Jose, California) that can include appropriate encrypted virtual private network concentrators 630 and a high- availability boundary 632.
  • the second subsystem 602 can include a database server 634 in communication with one or more Web servers 636 and a tape backup and restore solution 638.
  • the database server 634 and Web servers 636 can be located behind a suitable firewall 640, such as, for example, a Cisco Pix 515E Firewall or the like offered by Cisco Systems, Inc. (San Jose, California).
  • the firewall 640 can be in communication with an appropriate router 642, such as, for example, a Cisco 1700 Router or the like offered by Cisco Systems, Inc.
  • the second subsystem 604 can be used to implement any or all of the functionality of the database module 105, situational awareness module 110, communication module 115, 3-D rendering module 120, GUI module 125, model translation module 135, simulation module 140, situational awareness response module 145 and path selection module 150.
  • the functionality of the system 100 can be distributed across the first and second subsystems 602 and 604 to implement the features of the Emergency Response System according to exemplary embodiments.
  • the first and second subsystems 602 and 604 can be in communication via any suitable form of network, such as an intranet or an internet, for example, the Internet 644.
  • the functionality and features of the Emergency Response System that can be implemented in the first and second subsystems 602 and 604 can be accessed via a connection over the Internet 644 using suitable graphical user interfaces running on display devices 646.
  • the display devices 646 can access the first and second subsystems 602 and 604 via an encrypted virtual private network (VPN), such as, for example, using the BorderGuard Series of Secure Communication Platforms offered by Blue Ridge Networks, Inc. (Chantilly, Virginia) for encrypted VPN for session confidentiality.
  • VPN virtual private network
  • role-based access controls and authentication with user certificates, as well as other encryption and security features can be used to ensure a high level of security and encryption of data communicated through the network.
  • SSL secure socket layer
  • skilled artisans will recognize that other hardware/software architectures can be used to implement the features of the Emergency Response System according to exemplary embodiments.
  • FIG. 7 is first diagram illustrating a 3-D virtual model 700 of a structure that was created with REVITTM Building and being displayed in GOOGLETM Earth, in accordance with an exemplary embodiment of the present invention.
  • the 3-D virtual model 700 is of Gund Hall that houses the graduate School of Design at Harvard University in Cambridge, Massachusetts.
  • the 3-D virtual model 700 was created according to exemplary embodiments of the present invention using, for example, structural information associated with the structure.
  • the first diagram illustrated in FIG. 7 is an exterior view of Gund Hall from the southeast corner of the building.
  • Navigation controls 705 are presented to the user for manually changing the view aspect of the 3-D virtual model, including moving the model up/down and left/right, zooming the model in/out, rotating the model up/down and left/right, changing elevation and the other like controls.
  • view controls 710 can be used as "shortcuts" to change the view of the 3-D virtual model to a predetermined angle, rotation, elevation and the like.
  • FIG. 8 is a second diagram illustrating the 3-D virtual model 700 from the west entrance of Gund Hall, in accordance with an exemplary embodiment of the present invention. By selecting the view control 805 for "View West Entrance," GOOGLETM Earth can automatically adjust the viewing aspect to present the predetermined view of the 3-D virtual model 700 to the user.
  • FIG. 9 is a third diagram illustrating the 3-D virtual model 700 from the interior of Gund Hall, in accordance with an exemplary embodiment of the present invention.
  • FIG. 9 illustrates the interior second floor of Gund Hall, showing such features as stairs, rails, floors, ceiling beams or trusses, and the like.
  • the user can manually "enter” the interior of the 3-D virtual model 700 by using the appropriate navigation controls.
  • a view control 905 for "View Interior 2nd Floor” can cause GOOGLETM Earth to automatically adjust the view to present the predetermined interior view of the 3-D virtual model 700 to the user.
  • FIG. 10 is a fourth diagram illustrating the 3-D virtual model 700 with several layers of Gund Hall removed, in accordance with an exemplary embodiment of the present invention.
  • Appropriate layer controls 1005 can be used to remove and restore various layers or other features of the 3-D virtual model 700 to allow the user to view any interior or exterior feature, such as structural elements and the like.
  • the layer controls 1005 can allow the user to remove and restore such features as "All Walls,” “Floor Planes,” “Side Glass,” “Railings,” “Roof Trusses,” and “Roof Glass,” among other features of the 3-D virtual model 700.
  • the layer controls 1005 have been used to remove or otherwise peel away the "Roof Trusses” and the "Roof Glass” to provide an interior view of Gund Hall. Any level of interior or exterior detail of the structure can be viewed in such a manner.
  • FIG. 11 is a fifth diagram illustrating the 3-D virtual model 700 with several additional layers of Gund Hall removed, in accordance with an exemplary embodiment of the present invention.
  • FIG. 11 is a fifth diagram illustrating the 3-D virtual model 700 with several additional layers of Gund Hall removed, in accordance with an exemplary embodiment of the present invention.
  • the layer controls 1005 have been used to remove or otherwise peel away the "Floor Planes," “Side Glass,” “Railings,” “Roof Trusses,” and “Roof Glass” of the 3-D virtual model 700 to reveal only the interior and exterior walls of Gund Hall.
  • FIG. 12 is a sixth diagram illustrating the 3- D virtual model 700 integrating situational awareness information, in accordance with an exemplary embodiment of the present invention.
  • the 3-D virtual model 700 incorporates (real-time or near real-time) sensor data from a heat sensor and displays such information as a dot 1205 to indicate both that heat has been detected and the particular room in Gund Hall in which the sensor is located (e.g., Room 421, Student Office). Based on such information, appropriate situation assessment and response planning can be undertaken.
  • the Emergency Response System can provide one or more proposed responses based on the situational awareness information.
  • FIG. 13 is a seventh diagram illustrating the 3-D virtual model 700 providing proposed responses based on the situational awareness information, in accordance with an exemplary embodiment of the present invention.
  • the Emergency Response System has determined that the situational awareness information from the heat sensor indicates that a fire is occurring in the given room, and can display a flame or fire icon 1305 to illustrate the danger, hi response, the Emergency Response System can display evacuation routes 1310 from the structure and the predetermined designated meeting site 1315 for the evacuees to ensure that everyone has safely left the structure.
  • FIG. 14 is an eighth diagram illustrating the 3-D virtual model 700 providing a route 1405 through the structure based on the situational awareness information, in accordance with an exemplary embodiment of the present invention.
  • the route 1405 is indicated by a line of conjoined individual paths through the structure.
  • the contiguous route 1405 begins at a starting point 1410 located at a side entrance to Gund Hall.
  • the Emergency Response System can provide the shortest route 1405 to the center of the disturbance (i.e., the end point 1415 where the heat sensor has been activated).
  • a video 1420 of the route 1405 can be displayed to the user, visually taking the user through the entire route 1405 from starting point 1410 to end point 1415, e.g., as a streaming video or a series of still pictures of the interior of the structure along the route 1405.
  • a video 1420 can allow the user to determine if there are any additional dangers or other critical situations posed to emergency personnel traversing the route 1405, as well as for providing visual directions or cues to reach the end point 1415.
  • FIG. 15 is an ninth diagram illustrating the 3-D virtual model 700 integrating additional situational awareness information, in accordance with an exemplary embodiment of the present invention.
  • the user can "peel away” layers of the 3-D virtual model 700 to view any interior aspect of the structure.
  • a sliding bar 1505 can be used to peel away any upper floors of the structure in the 3-D virtual model 700 by moving the layer marker 1510 to the desired floor indication (e.g., "IF" for first floor, "2F” for second floor, "3F” for third floor, "4F” for fourth floor, "5F” for fifth floor, and "RF” for roof).
  • the desired floor indication e.g., "IF" for first floor, "2F” for second floor, "3F” for third floor, "4F” for fourth floor, "5F” for fifth floor, and "RF” for roof.
  • the layer marker 1510 has been moved to "IF" (i.e., the first floor), thereby peeling away the second through fifth floors and roof to reveal the first floor of Gund Hall.
  • the situational awareness information associated with the first floor is thus displayed to the user.
  • Such situational awareness information can include locations of people (indicated by small dots 1515) and emergency response personnel (indicated by large dots 1520) on the first floor, as well as the search line (indicated by line 1525) being undertaken by the emergency response personnel.
  • Any portion or all of the 3-D virtual model 700 and the integrated situational awareness information can also be displayed to the emergency response personnel in a suitable heads-up display 1530 located in their helmets.
  • Such a heads-up display 1530 can provide an arrow 1535 or other direction indicator to direct the emergency response personnel to a desired location within the structure indicated by a location marker 1540.
  • FIG. 16 is a tenth diagram illustrating the 3-D virtual model 700 with several floors peeled away, in accordance with an exemplary embodiment of the present invention.
  • the layer marker 1510 has been moved to "4F" (i.e., the fourth floor), thereby peeling away the fifth floor and roof to reveal the fourth floor of Gund Hall.
  • the view of the 3-D virtual model 700 can be altered. For example, FIG.
  • FIG. 17 is an eleventh diagram illustrating the 3-D virtual model 700 rotated and with several floors peeled away, in accordance with an exemplary embodiment of the present invention.
  • the layer marker 1510 has been moved to "IF" (i.e., the first floor), thereby peeling away the second through fifth floors and roof to reveal the first floor of Gund Hall.
  • a rotational control 1515 can be moved to rotate the 3-D virtual model 700, for example, to review the opposing side of the first floor of Gund Hall.
  • FIG. 18 is an twelfth diagram illustrating the 3-D virtual model 700 with several floors peeled away and indicating various features located on the displayed floor, in accordance with an exemplary embodiment of the present invention.
  • the layer marker 1510 still indicates "IF" (i.e., the first floor), thereby peeling away the second through fifth floors and roof to reveal the first floor of Gund Hall.
  • Feature display controls 1805 can be used to indicate the types and locations of various types of equipment and other structural elements in the given view.
  • FIG. 19 is a thirteenth diagram illustrating the 3- D virtual model 700 with several floors peeled away and indicating additional features located on the displayed floor, in accordance with an exemplary embodiment of the present invention.
  • the location of emergency exits in the structure on the first floor can be displayed to the user (e.g., as rectangles 1905).
  • FIG. 20 is a fourteenth diagram illustrating the 3-D virtual model 700 with several floors peeled away and indicating additional features located on the displayed floor, in accordance with an exemplary embodiment of the present invention.
  • the location of stairs e.g., indicated with stair icons 2005
  • hydrants e.g., indicated as hydrant icons 2010
  • occupants e.g., indicated as dots 2015
  • the user can view a complete, up-to-date perspective of the interior and exterior of the structure to allow for proper situational assessment and response planning for any emergency or other critical situation occurring in, on, within or around the structure.
  • the 3-D virtual model of the structure can be displayed to the user in any desired detail.
  • the 3-D virtual model can comprise a photo-realistic representation of the structure.
  • FIG. 21 is a diagram illustrating a 3-D virtual model 2100 as a photo-realistic representation of the structure, in accordance with an exemplary embodiment of the present invention.
  • the 3-D virtual model 2100 illustrated in FIG. 21 is a photo-realistic representation of a study hall, e.g., at a university, looking down into the study hall from above.
  • a 3-D virtual model 2100 provides much greater detail of the structure, including texture of surfaces, representation of furniture in rooms, and the like.
  • FIG. 22 is a diagram illustrating a magnified or zoomed-in view of the 3-D virtual model 2100, in accordance with an exemplary embodiment of the present invention.
  • the photo-realistic representation of the structure provides a view of furniture within the study hall, such as tables 2205 and chairs 2210, looking through the windows 2215 of the structure, as well as appropriate shading 2220 to provide simulated depth to the 3-D virtual model 2100.
  • a photo-realistic representation of the structure can be used to, for example, peer through or around walls or obstacles to provide the user with a visualization of any potential threats that may not be visible to a person actually standing in the structure.
  • emergency response personnel can be provided with an accurate tactical assessment within the structure, such as the locations of terrorists or other hostiles located in the structure that may not be easily visible to such personnel.
  • Those of ordinary skill in the art will recognize that other such uses can be made of the Emergency Response System with the 3-D virtual model of the structure integrating the situational awareness information.
  • FIG. 23 is a flowchart illustrating steps for providing situational awareness for a structure, in accordance with an exemplary embodiment of the present invention.
  • structural information associated with the structure can be collected.
  • situational awareness information associated with the structure can be gathered.
  • the situational awareness information can include, for example, sensor data received from sensors associated with the structure.
  • the sensors can include smoke sensors, infrared sensors, video surveillance cameras, motion sensors or any other suitable type of sensor that can be used to provide information on the structure.
  • the situational awareness information can include information associated with an emergency occurring within the structure.
  • the situational awareness information can also include alert or alarm notifications associated with the structure.
  • the situational awareness information can include environmental information associated with the structure, such as that obtained from external sources or data feeds, as discussed previously.
  • the sensor data can comprise real-time or near-real-time sensor data, as well as historical sensor data.
  • the situational awareness information can be transmitted and received in real-time or substantially real-time.
  • the situational awareness information can be communicated for collaborative situation assessment and response planning.
  • the situational awareness information can be communicated with crisis incident management systems, integrated incident management systems, and other like systems.
  • a 3-D virtual model of the structure can be rendered utilizing the structural information associated with the structure.
  • the structural information used to render the 3-D virtual model can include attributes of objects associated with the structure.
  • the attributes of each object can be displayed to the user upon request.
  • callouts can be displayed to the user for presenting the attributes of each object within the structure.
  • the 3-D virtual model can comprise a parametric 3-D virtual model.
  • a modification to at least one attribute of a first object can be received, and attributes of at least a second object associated with the first object can be modified within the parametric 3-D virtual model.
  • the objects can comprise smart objects. Accordingly, an impact or effect of an action directed to a smart object can be rendered using the attributes of the smart object and the nature of the action for display to the user.
  • the situational awareness information associated with the structure can be integrated or otherwise rendered into the 3-D virtual model.
  • the sensor data can be rendered into the 3-D virtual model for display to the user.
  • at least one sensor rendered within the 3-D virtual model can comprise a linking point. Consequently, the sensor data received from the sensor can be displayed to the user upon user selection of a corresponding linking point.
  • the environmental information can be rendered in the 3-D virtual model for displaying to the user the environment in which the structure resides.
  • locations of objects within the structure e.g., physical assets or components or the structure, people and other like objects
  • simulations of situational awareness scenarios associated with the structure can be generated and rendered into the 3-D virtual model for display to the user.
  • at least one proposed response to an emergency situation occurring within the structure can be generated and rendered into the 3-D virtual model for display to the user.
  • the 3-D virtual model can be converted into a format displayable to the user.
  • the 3-D virtual model of the structure integrating the situational awareness information associated with the structure can be displayed to the user.
  • layers of the 3-D virtual model can be displayed to the user for viewing structural elements and/or internal layouts of the structure.
  • the structural elements can include, but are not limited to, plumbing systems, electrical systems, mechanical systems, environmental systems, emergency equipment systems of the structure or any other suitable structural elements of the structure or any combination thereof.
  • instructions can be received from the user for navigating the 3-D virtual model to examine the structure and the situational awareness information associated with the structure.
  • the situational awareness information associated with the structure, the 3- D virtual model of the structure integrating the situational awareness information, and any other suitable information associated with the 3-D virtual model can be stored for back-up and archival purposes.
  • the 3-D virtual model of the structure integrating the situational awareness information associated with the structure can be displayed to the user through a Web browser, such as on any suitable (substantially) fixed or portable display device.
  • the 3-D virtual model of the structure and associated information can be displayed on such display devices using a suitable GIS, and can be displayed locally or remotely, such as over a network (e.g., an intranet or an internet, such as the Internet or World Wide Web).
  • FIG. 24 is a flowchart illustrating steps for determining ingress and/or egress routes through the structure using the structural information and situational awareness information associated with the structure, in accordance with an exemplary embodiment of the present invention.
  • the egress routes through the structure can include evacuation routes from the structure and the like.
  • a list of substantially all individual paths through the structure can be maintained.
  • a path weight can be assigned to each of the individual paths through the structure in accordance with, for example, the length of the individual path, the level of difficulty in traversing the individual path, and other like factors.
  • a route between points in the structure can comprise one or more individual paths connected or otherwise joined together.
  • step 2415 the path weights of the individual paths that comprise the route can be summed or accumulated to generate the total path weight of the route.
  • step 2420 the shortest route(s) between points in, around or through the structure can be determined in accordance with the route(s) having the lowest total path weight(s).
  • step 2425 path weights can be modified to alter the route between the points in the structure.
  • distance measurements can be calculated for each of the ingress and egress routes through the structure for display to the user.
  • step 2435 the ingress and/or egress routes, as well as the associated route information (e.g., distance calculations), can be rendered in the 3-D virtual model for display to the user.
  • FIG. 25 is a flowchart illustrating steps for responding to an emergency, in accordance with an alternative exemplary embodiment of the present invention.
  • a 3-D virtual model of a facility can be generated utilizing structural information associated with the facility.
  • situational awareness information associated with the facility can be gathered or otherwise collected.
  • the situational awareness information associated with the facility can be rendered into the 3-D virtual model of the facility.
  • the 3-D virtual model of the facility integrating the situational awareness information associated with the facility can be displayed to a user for navigating the 3-D virtual model for situation assessment and emergency response planning.
  • 23-25 for providing situational awareness for a structure and for responding to an emergency can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions.
  • a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
  • the computer readable medium can be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium.
  • the computer-readable medium can include the following: an electrical connection having one or more wires, a portable computer diskette, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, and a portable compact disc read-only memory (CDROM).
  • RAM random access memory
  • ROM read-only memory
  • EPROM or Flash memory erasable programmable read-only memory
  • CDROM portable compact disc read-only memory
  • Exemplary embodiments of the present invention can be used in conjunction with any device, system or process for providing crisis management, security and surveillance, situational awareness, incident management, intelligence analysis support, tactical operations support, forensic content management or the like.
  • Exemplary embodiments of the present invention can provide users with end-user cost-savings and increased operational efficiencies.
  • the system can provide savings or offset for emergency management agencies from deploying and/or allocating resources more efficiently and effectively. With specific building knowledge and real-time or near real-time data streams, significant cost savings can be achieved by simply reducing the number of false alarms that are responded to and tie up valuable resources.
  • offsets from casualty insurance discounts can be gained by minimizing damage to life, limb and property from fire, flood, accidents, earthquake, and acts of violence or terrorism by providing critical information to first responders.
  • offsets in the form of labor savings can be achieved in the on-going facilities management process. Exemplary embodiments can assist in improving operational efficiencies from the remote command and control of critical systems.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Tourism & Hospitality (AREA)
  • Economics (AREA)
  • Primary Health Care (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Remote Sensing (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Alarm Systems (AREA)

Abstract

L'invention concerne un système pour obtenir une perception situationnelle en temps réel ou quasi temps réel pour une structure, le système comprenant un module de base de données pour stocker des informations structurelles associées à la structure (voir la figure 1). Le système comprend un module de perception situationnelle pour rassembler des informations de perception situationnelle associées à la structure. Le système comprend un module de rendu tridimensionnel (3-D) en communication avec le module de base de données et le module de perception situationnelle pour générer un modèle virtuel tridimensionnel de la structure en utilisant les informations structurelles associées à la structure, et pour intégrer dans le modèle virtuel tridimensionnel les informations de perception situationnelle associées à la structure. Le système comprend un module d'interface utilisateur graphique en communication avec le module de rendu tridimensionnel pour afficher à l'attention d'un utilisateur le modèle virtuel tridimensionnel de la structure intégrant les informations de perception situationnelle associées à la structure.
PCT/US2006/035532 2006-09-13 2006-09-13 système informatique et procédé pour obtenir une perception situationnelle pour une structure utilisant une modélisation tridimensionnelle Ceased WO2008033127A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
PCT/US2006/035532 WO2008033127A1 (fr) 2006-09-13 2006-09-13 système informatique et procédé pour obtenir une perception situationnelle pour une structure utilisant une modélisation tridimensionnelle
CN2006800563236A CN101553862B (zh) 2006-09-13 2006-09-13 使用三维虚拟模型提供建筑物情境意识的以计算机为基础的系统和方法
TW096132888A TW200832279A (en) 2006-09-13 2007-09-04 Computer-based system and method for providing situational awareness for a structure using three-dimensional modeling

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2006/035532 WO2008033127A1 (fr) 2006-09-13 2006-09-13 système informatique et procédé pour obtenir une perception situationnelle pour une structure utilisant une modélisation tridimensionnelle

Publications (1)

Publication Number Publication Date
WO2008033127A1 true WO2008033127A1 (fr) 2008-03-20

Family

ID=39184066

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2006/035532 Ceased WO2008033127A1 (fr) 2006-09-13 2006-09-13 système informatique et procédé pour obtenir une perception situationnelle pour une structure utilisant une modélisation tridimensionnelle

Country Status (2)

Country Link
CN (1) CN101553862B (fr)
WO (1) WO2008033127A1 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017053127A1 (fr) * 2015-09-21 2017-03-30 The Climate Corporation Détection d'accumulation d'eau sur une imagerie satellite
CN110717000A (zh) * 2019-09-23 2020-01-21 济南轨道交通集团有限公司 一种轨道交通工程建养一体化智慧管理平台及方法
CN113905064A (zh) * 2021-09-02 2022-01-07 华迪计算机集团有限公司 一种周界安全态势感知数据集成展示方法
CN116756233A (zh) * 2023-08-23 2023-09-15 博智安全科技股份有限公司 一种态势数据处理方法、装置、电子设备及存储介质
US12412011B2 (en) 2020-01-08 2025-09-09 Control Components, Inc. Method for three-dimensional tortuous path flow element

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10786736B2 (en) 2010-05-11 2020-09-29 Sony Interactive Entertainment LLC Placement of user information in a game space
CN102446228B (zh) * 2010-09-30 2013-10-02 深圳市雅都软件股份有限公司 输电线路三维空间可视化展示方法及系统
CN102567922A (zh) * 2012-01-17 2012-07-11 南昌工程学院 基于bim网络技术的建筑工程管理系统平台及应用方法
JP5576455B2 (ja) * 2012-02-20 2014-08-20 ソリデオ システムズ カンパニー リミテッド Ｂｉｍデータファイルに含まれたデータを提供する方法、それを記録した記録媒体、およびそれを含むシステム
CN103823949B (zh) * 2014-03-18 2017-01-18 黄健华 一种应用于室内设计的智能设备控制布置系统及方法
CN105573224B (zh) * 2014-10-08 2019-11-19 深圳力维智联技术有限公司 基于抽象模型的监控方法、装置及系统
CN105551324B (zh) * 2016-01-27 2018-01-23 永城职业学院 美术教学系统
EP3285213A1 (fr) * 2016-08-16 2018-02-21 Hexagon Technology Center GmbH Emballage de travail lod
CN107807736B (zh) * 2017-11-10 2020-11-06 泰瑞数创科技(北京)有限公司 3d场景交互装置、系统和交互方法
CN115796392B (zh) * 2023-01-31 2023-06-13 中交第四航务工程勘察设计院有限公司 一种基于3d可视化的智慧楼宇展示方法及系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5138555A (en) * 1990-06-28 1992-08-11 Albrecht Robert E Helmet mounted display adaptive predictive tracking
US5458041A (en) * 1994-08-02 1995-10-17 Northrop Grumman Corporation Air defense destruction missile weapon system
US6748325B1 (en) * 2001-12-07 2004-06-08 Iwao Fujisaki Navigation system
US20060050929A1 (en) * 2004-09-09 2006-03-09 Rast Rodger H Visual vector display generation of very fast moving elements

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6912293B1 (en) * 1998-06-26 2005-06-28 Carl P. Korobkin Photogrammetry engine for model construction
US7034978B2 (en) * 2003-03-20 2006-04-25 Fujitsu Limited Optical function device using photonic crystal, variable wavelength optical filter and variable wavelength light source
US8289390B2 (en) * 2004-07-28 2012-10-16 Sri International Method and apparatus for total situational awareness and monitoring

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5138555A (en) * 1990-06-28 1992-08-11 Albrecht Robert E Helmet mounted display adaptive predictive tracking
US5458041A (en) * 1994-08-02 1995-10-17 Northrop Grumman Corporation Air defense destruction missile weapon system
US6748325B1 (en) * 2001-12-07 2004-06-08 Iwao Fujisaki Navigation system
US20060050929A1 (en) * 2004-09-09 2006-03-09 Rast Rodger H Visual vector display generation of very fast moving elements

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017053127A1 (fr) * 2015-09-21 2017-03-30 The Climate Corporation Détection d'accumulation d'eau sur une imagerie satellite
US10025983B2 (en) 2015-09-21 2018-07-17 The Climate Corporation Ponding water detection on satellite imagery
US10467472B2 (en) 2015-09-21 2019-11-05 The Climate Corporation Ponding water detection on satellite imagery
US10929663B2 (en) 2015-09-21 2021-02-23 The Climate Corporation Ponding water detection on satellite imagery
US11380092B2 (en) 2015-09-21 2022-07-05 Climate Llc Ponding water detection on satellite imagery
CN110717000A (zh) * 2019-09-23 2020-01-21 济南轨道交通集团有限公司 一种轨道交通工程建养一体化智慧管理平台及方法
US12012136B2 (en) 2019-09-23 2024-06-18 Jinan Rail Transit Group Co., Ltd. Platform and method for intelligent management of integration of construction and maintenance of rail transportation work
US12412011B2 (en) 2020-01-08 2025-09-09 Control Components, Inc. Method for three-dimensional tortuous path flow element
CN113905064A (zh) * 2021-09-02 2022-01-07 华迪计算机集团有限公司 一种周界安全态势感知数据集成展示方法
CN116756233A (zh) * 2023-08-23 2023-09-15 博智安全科技股份有限公司 一种态势数据处理方法、装置、电子设备及存储介质
CN116756233B (zh) * 2023-08-23 2023-11-07 博智安全科技股份有限公司 一种态势数据处理方法、装置、电子设备及存储介质

Also Published As

Publication number Publication date
CN101553862B (zh) 2012-11-07
CN101553862A (zh) 2009-10-07

Similar Documents

Publication Publication Date Title
US20080062167A1 (en) Computer-based system and method for providing situational awareness for a structure using three-dimensional modeling
US8050521B2 (en) System and method for simultaneously viewing, coordinating, manipulating and interpreting three-dimensional and two-dimensional digital images of structures for providing true scale measurements and permitting rapid emergency information distribution
AU2009354765B2 (en) System and method employing three-dimensional and two-dimensional digital images
US6604126B2 (en) Structural data presentation method
EP1490802B1 (fr) Systeme de cartographie de risques
National Research Council et al. Successful response starts with a map: improving geospatial support for disaster management
De Fino et al. Dissemination, assessment and management of historic buildings by thematic virtual tours and 3D models
WO2008033127A1 (fr) système informatique et procédé pour obtenir une perception situationnelle pour une structure utilisant une modélisation tridimensionnelle
EA006788B1 (ru) Способ и система для обеспечения тактической информации в случае кризисных ситуаций
Hagedorn et al. High-level web service for 3D building information visualization and analysis
Evangelou et al. Building digital twins for smart cities: A case study in Greece
Feng et al. A BIM-based coordination support system for emergency response
Jung et al. Development of an Omnidirectional‐Image‐Based Data Model through Extending the IndoorGML Concept to an Indoor Patrol Service
JP5844845B2 (ja) ３次元および２次元デジタル画像を使用するシステムおよび方法
TW200832279A (en) Computer-based system and method for providing situational awareness for a structure using three-dimensional modeling
Savini et al. Historical, architectural, and structural virtual tour for conservation and maintenance of architectural heritage
CN115396630A (zh) 一种基于高位监控视频vr现实的视觉系统
Gelernter et al. Visualization and communication tool for emergency response
US12260753B1 (en) Augmented reality interface for visualizing and coordinating disaster event response efforts
Stout et al. Technology and Technological Methods in Disaster Response
Lebas DIGITAL TWINS: TOOLS FOR CRISIS MANAGEMENT WITHIN TERRITORIES? INTRODUCTORY REPORT
Ahmad et al. Assessing the Security of Buildings: A Virtual Studio Solution.
Cejudo et al. Check for updates Emergency Management and Response Through 3D Maps and Novel Geo-Information Sources
Auchter Visualizing War through Satellite Footage: Technological Capacity, Truth, and the View from Above
KR20250046189A (ko) 실내 지도 기반의 사물인터넷 시스템

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200680056323.6

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 06803452

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 06803452

Country of ref document: EP

Kind code of ref document: A1