WO2006119790A1 - Methods and systems for electronic records management - Google Patents
Methods and systems for electronic records management Download PDFInfo
- Publication number
- WO2006119790A1 WO2006119790A1 PCT/EP2005/005140 EP2005005140W WO2006119790A1 WO 2006119790 A1 WO2006119790 A1 WO 2006119790A1 EP 2005005140 W EP2005005140 W EP 2005005140W WO 2006119790 A1 WO2006119790 A1 WO 2006119790A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- electronic record
- electronic
- node
- data
- record
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
Definitions
- the present invention relates to methods and systems for electronic records management. More particularly, the present invention relates to methods and systems for electronic records management that provide automated electronic record capture, replication, update, and/or retention control.
- computers, scanners, cameras, and facsimile machines are an essential part of day-to-day operation.
- computers are used to keep track of businesses' financial data, to generate electronic invoices, to pay invoices, to take orders, to communicate (e.g., via email, instant message devices, web chat), to create documents and brochures, to post web pages, etc.
- scanners, cameras, and facsimile machines are used to turn physical documents and objects into electronic documents and images, and to communicate the electronic documents and images to remote places.
- an electronic record may include any form of electronic information, such as documents (e.g., a MICROSOFT WORD document or an ADOBE PDF file), a spreadsheet, an electronic mail message, an instant messaging conversation, a Web page, etc.
- documents e.g., a MICROSOFT WORD document or an ADOBE PDF file
- ERMSs need to be able provide distributed architectures wherein local ERMSs can provide electronic records to local users, while maintaining the appearance of being a centralized architecture that contains all of the electronic records of the organization. Achieving these goals requires effective techniques for managing and replicating data across multiple sites, nodes, systems, etc. Thus, it would be desirable to provide more efficient mechanisms for managing and replicating data across such distributed architectures.
- the distributed architectures described above also make it difficult to ensure that record integrity is preserved when multiple users attempt to access and modify an electronic record.
- a headquarters of an organization A has decided to open sales offices B and C.
- the master electronic records will be maintained in A but B and C might need to change certain information in one or more of the master records.
- One solution would be to set up A, B and C as "peers"; that is each one having full access to add, modify or delete records on another system. Obviously, this would have an effect on data integrity as there would be no supervisory control over the master electronic records.
- Another solution - and the one common to most current ERMSs - is to designate one system as a "master” and the others as “slaves.” In this situation, all requests for changes to an electronic record are passed through a single node which can apply the requested changes to the record.
- This approach however has some significant shortcomings. First, it is time consuming and burdensome, especially on the individual or organization which must evaluate and act upon such requests.
- An Electronic Record Management System generally provides the user with capabilities such as inputting and retrieving documents, searching for documents and sharing documents across an organization.
- the ERMS disclosed herein expands these functions by allowing the capture of unstructured electronic records not typically associated with document management systems, for example, email or instant message conversations.
- the ERMS may also allow for remote update of replicated data between electronic record management systems to ensure integrity and consistency of the electronic records.
- the ERMS may further allow for structured replication of electronic records between remote and master systems.
- the ERMS may yet further provide a mechanism for rectifying multiple disposal rules that apply to the same electronic record. More particularly, in accordance with certain embodiments of the present invention, methods for capturing electronic records are provided.
- These methods include: receiving an electronic record from a process chain initiator at an electronic records management system; selecting one of the at least one process chain definition; based on the selected one of the at least one process chain definition, selecting at least one element to be processed on the electronic record; and executing the at least one element on the electronic record.
- methods for capturing electronic records in an electronic record management system include: monitoring for the occurrence of an electronic record; in response to the electronic record being detected, creating metadata for the electronic record; comparing at least one of the electronic record and the metadata to at least one rule; and if the rule is satisfied, performing a custom element operation on at least one of the electronic record and the metadata.
- methods for replicating data among a plurality of electronic records management systems include: receiving data to be replicated from a first electronic records management system through a first application program interface at a first node and storing the data in a first database at the first node; retrieving the data from the first database and sending the data through a base transport from the first node to a second node; receiving the data at the second node and storing the data in a second database at the second node; retrieving the data from the second database and sending the data through the base transport from the second node; receiving the data at an nth node and storing the data in an nth database at the nth node; and retrieving the data from the nth database and providing the data through a second application program interface to a second electronic records management system.
- methods for updating electronic records through an electronic records management system include: providing a master electronic record at a first node; providing a replica electronic record that is a replica of the master electronic record at a second node; permitting a first user to make modifications to the master electronic record; permitting a second user to make modifications to the replica electronic record; transmitting the modifications to the replica electronic record from the second node to the first node; at the first node, comparing the modifications to the master electronic record to the modifications to the replica electronic record to determine if the modifications to the replica electronic record will be entered; and at the first node, determining whether to reject the modifications to the replica electronic.
- methods for retaining electronic records in an electronic records management system include: comparing multiple disposal schedules applicable to an electronic record to determine a single disposal schedule for the electronic record; setting a disposal configuration of a storage device that is compatible with the single disposal schedule; storing the electronic record in the storage device; and taking a disposal action on the electronic record in accordance with the single disposal schedule.
- FIG. 1 is a diagram of the system architecture in accordance with certain embodiments of the present invention.
- FIG. 2 is a diagram of an electronic record capture process in accordance with certain embodiments of the present invention
- FIG. 3 is a diagram of a more particular electronic record capture process in accordance with certain embodiments of the present invention.
- FIG. 4 is a diagram of an email capture process in accordance with certain embodiments of the present invention
- FIG. 5 is a diagram of an instant messaging conversation capture process in accordance with certain embodiments of the present invention
- FIG. 6 is a diagram of a replication transport feature in accordance with certain embodiments of the present invention.
- FIG. 7 is a diagram of a transport services mechanism in a replication transport feature in accordance with certain embodiments of the present invention.
- FIG. 8 is a diagram of a replication transport process in accordance with certain embodiments of the present invention.
- FIG. 9 is a flowchart of a remote update of replicated data process in accordance with certain embodiments of the present invention.
- FIG. 10 is diagram of a disposal process in accordance with certain embodiments of the present invention.
- FIG. 1 illustrates an example of an ERMS architecture 1 in accordance with certain embodiments of the invention.
- architecture 1 includes one or more terminals 2-6, one or more servers 7-9, one or more databases 10-12, and one or more networks 13 and 14.
- Terminals 2-6 may be any suitable user access devices and may be Internet browsers running on personal computers, may be client computers running applications such as MICROSOFT WORD, or may be any other suitable devices.
- terminal 2 provides Web access
- terminal 3 provides desktop applications such as word processing
- terminal 4 provides email access
- terminal 5 provides synchronization software
- terminal 6 provides import and export functions.
- Servers 7-9 may be any suitable computer or devices.
- the servers may provide access to the ERMS via Simple Object Access Protocol (SOAP), Common Object Model (COM), Open Document Management API (ODMA), Message Application Program Interface (MAPI), or any other suitable technique.
- SOAP Simple Object Access Protocol
- COM Common Object Model
- ODMA Open Document Management API
- MAPI Message Application Program Interface
- Portal server 7 may be any suitable server for providing portals to users of the ERMS, such as MICROSOFT SH AREPOINT portal server or any other suitable device.
- Web server 8 may be any suitable server for enabling Web access to the ERMS.
- Content server 9 may be any suitable device for controlling access to databases 10-12, and may provide the core management functions of the ERMS.
- Databases 10-12 may be any suitable storage devices for storing indices, content, and metadata, respectively, and may be implemented using any suitable data storage mechanisms, such as a Structured Query Language (SQL), ORACLE, or MICROSOFT ACCESS database, a disk drive, memory, or any other suitable device(s).
- SQL Structured Query Language
- ORACLE ORACLE
- MICROSOFT ACCESS database a disk drive, memory, or any other suitable device(s).
- networks 13 and 14 may be any suitable networks for communicating among the components of FIG. 1 , such as a WAN, LAN, the Internet, or any combination of
- content server 9 may handle various processes conducted by the ERMS such as searching for records, checking records against rules and processing new records.
- a records manager who is in charge of maintaining an organization's records, may access content server 9 to modify settings and develop rules to govern the actions of the ERMS through a terminal (not shown), Web client or by any other suitable means.
- the ERMS may be integrated into applications such as Microsoft Word and PowerPoint through the Open Document Management API (ODMA), and replace the standard file management dialog boxes.
- ODMA is a standard interface for linking applications to document management systems, and is well known in the art.
- Web servers 8 may be composed of custom web applications and web extensions.
- Custom web applications may be web-based programs that allow system users to access and use data found on content server 9 as well as the data and functionality of databases 10-12.
- the custom web applications may be developed to provide specific functionalities and accessibility options to the users.
- Web extensions may allow system users to access and use the ERMS from remote locations. Web extensions may be thought of as one or more dynamic web pages that may be accessed by users on remote machines.
- the web extensions may be hosted by web server 8 and may be given a universal resource locator (URL) so system users can access the ERMS with the use of a web browser.
- Integration with Microsoft SharePoint Server at portal server 7 may allow access to databases 10-13 through a graphical user interface.
- an ERMS may also provide one or more of the features described below.
- the functions described below may be implemented in content server 9 or in any other suitable component(s) of an ERMS.
- ERMS electronic record management systems
- ERMS electronic record management systems
- each document needs to be imported into an ERMS and a profile for the document (whether wholly or partially) manually created by a Records Manager or his designate.
- Some known systems also included the capability to automatically capture certain types of documents, but for each type of document to be captured, a separate and distinct capture mechanism must be created.
- Current capture systems are not easily redeployed when there is a need to capture a different type of document or the existing capture workflow must be changed.
- an ERMS may include the capability to automatically detect, tag, and store electronic records using a customizable process.
- this process may be implemented by performing any number of configurable elements to capture, filter, augment, and store electronic records.
- FIG. 2 illustrates an example of a logical architecture 48 for implementing this feature of the present invention.
- architecture 48 may include the following mechanisms: a document transport, storage, processing mechanism 32; a process chain initiator 30; a rules element 38; a rules composer 34; custom elements 40, 42, and 43; a storage element 36; and a record retention process 58. These mechanisms may be implemented in any suitable data processing and/or data storage device, or devices, capable of performing the functions of these mechanisms as described herein.
- mechanism 32 may be implemented in email or instant messaging servers, computer network devices for extracting network traffic off a network, databases, etc., and process chain initiator 30, rules element 38, rules composer 34, custom elements 40, 42, and 43, and record retention process 58 may be implemented in one or more general purpose computers, and storage element 36 may be implemented in any suitable mechanism, whether hardware or software, for the storage of content including but not limited to a designated file system or database, a designated hardware storage device such as a disk drive or optical media or a designated area within a Redundant Array of Inexpensive Disks (RAID) or Storage Area Network (SAN).
- RAID Redundant Array of Inexpensive Disks
- SAN Storage Area Network
- architecture 48 may be used to capture and process electronic records such as instant message conversations 54, sent/received emails 50, electronic records 46, streaming video and/or audio, voice over IP, and/or any other suitable types of data present in mechanism 32. More particularly, architecture 48 may operate as follows. First, process chain initiator 30 monitors mechanism 32 for electronic records to be captured. This monitoring may be performed continuously or upon some suitable periodic basis, such as once an hour, every five minutes or any other suitable interval desired. When an appropriate electronic record is detected, process chain initiator 30 then captures the electronic record and creates an Extensible Markup Language (XML) metadata package for the record.
- XML is a data format for structured document interchange over standard Web protocols.
- This metadata may be extracted from the electronic record, such as but not limited to existing XML tags within the electronic record, or may be obtained from any other suitable data source.
- the XML metadata may indicate such information as keywords found in the electronic record, the date, time, and/or originator of the electronic record, or any other suitable information associated with the electronic record.
- Process chain initiator 30 may alternatively format the metadata in any other suitable format such as Standard Generalized Markup Language (SGML), or HyperText Markup Language (HTML).
- SGML Standard Generalized Markup Language
- HTML HyperText Markup Language
- process chain initiator 30 forwards the electronic record and/or the metadata to the next element in the chain, which in the instant example is the rules element 38.
- rules element 38 Upon receiving the electronic record and/or metadata, rules element 38 analyzes the metadata against rules to determine the correct action for the electronic record.
- the rules used to determine the correct action for the electronic record may be manually configured by a Records Manager using rules composer 34.
- the rules may be automatically configured by rules composer 34 using artificial intelligence, pattern recognition (such as Bayesian pattern recognition), or any other suitable mechanism, or may be pre-configured in advance by an ERMS vendor or a System Integrator.
- the rules may include criteria for determining whether the captured electronic record should be saved, parameters for how long the electronic record should be retained and in what way the electronic record should be stored, and any other suitable requirements.
- rules element 38 may update the metadata to reflect these requirements.
- rules element 38 may pass the electronic record and its metadata to any suitable one or more custom elements 40, 42, and 43.
- custom elements may be designed and written by a solution provider that sets up the ERJVIS, or by any other suitable party, and may perform any suitable functions on the electronic record and/or metadata.
- the custom elements may perform automatic categorization of the electronic record by examining the content of the electronic record to determine what it is, may augment the electronic record by supplementing it with or linking to data from an external data source, may use data from the electronic record to modify the metadata, or perform any other suitable function on the electronic record or metadata.
- the electronic record and metadata is passed from the custom elements to one or more storage elements 36 for storage.
- the storage elements may store the electronic record and metadata together or separately.
- the electronic record and metadata may be indexed in storage element 36 using any suitable technique.
- Record retention process 58 then monitors the metadata associated with each electronic record stored in storage element 36 and deletes the electronic record and metadata if and when appropriate.
- process chain initiator 30 places the electronic record and the metadata into a package in a given format that is preferably maintained through out processing by rules element 38 and custom elements 40, 42, and 43.
- the document capture feature includes a configurable process for determining which elements may be applied to different types of electronic records. For example, as shown in FIG. 2, one type of electronic record may be operated on by a rules element 38, custom elements 40, 42, and 43, and a storage element 36, whereas other types of electronic records may only be operated on by rules element 38, by storage element 36, by a custom element 40, or by any combination of these, and yet other electronic records may be operated on by only a storage element 36.
- a process chain initiator 30 is defined for each type of electronic record.
- This process chain initiator detects the existence of an electronic record at its source and forwards it to the next element in the process chain as defined by the configuration file.
- a series of elements to be performed is also defined in a process chain definition. These definitions may be stored in a configuration file if desired.
- the process chain initiator may then pass the electronic record to each of a series of elements in order based on a process chain definition.
- Process chain initiators and elements may be programmed in any suitable programming language. In this way, the document capture feature can be easily modified to capture different and new types of electronic records.
- FIGS 3-5 illustrate specific applications of the general process shown in FIG. 2 in accordance with certain embodiments of the present invention. As described above, each of these applications may be configured by a solution provider or the end-user to provide additional or alternative functionality using custom elements.
- FIG. 3 an example of how an ERMS may handle an electronic file in accordance with some embodiments of the invention is illustrated.
- a document transport, storage, processing mechanism 32 implemented in a device such as a file server is monitored by process chain initiator 30 to determine when an electronic record 46 is created, modified, received, etc.
- process chain initiator 30 receives the electronic record from mechanism 32, creates an XML metadata package 44 associated with electronic record 46, and forwards package 44 and electronic record 46 to rules element 38.
- the rules element Upon receiving package 44 and electronic record 46 from process chain initiator 30, the rules element then evaluates the electronic record in accordance with one or more rules 40 to determine whether and how to process the electronic record and metadata. For example, if electronic record 46 does not meet certain rules, it may not be stored in the ERMS at all. In other cases, it may be stored in encrypted format for a specified period of time. Obviously, any other suitable set of parameters for whether and how to process the electronic record and metadata could also be used.
- rules element 38 may then update XML metadata package 44 and pass package 44 and electronic record 46 to storage element 36 for storage.
- storage element 36 may query the metadata upon receipt to determine where, for how long and under what predefined conditions (restricted access, etc) the electronic record may be kept and then may store the electronic record accordingly.
- FIG. 4 illustrates an example of how an ERMS may be used to capture and store e- mail communications automatically in accordance with certain embodiments of the present invention.
- the process chain initiator may be designed in accordance with the Simple Mail Transfer Protocol (SMTP) to form a SMTP initiator 30 that is capable of capturing e-mail 46 from mechanism 32, which may be implemented in an email server.
- SMTP Simple Mail Transfer Protocol
- Initiator 30 may examine all electronic mail 46 passing through a specific e-mail server or network of e-mail servers.
- SMTP initiator 30 may create an XML metadata package 44 which identifies parameters within the e-mail such as, but not limited to, the source or destination of the message, the size of the message, the names or e-mail addresses of the recipients in the cc: or bcc: line, the presence or absence of certain keywords in the subject line, message body, header or footer, or any other suitable information.
- This XML metadata package 44 may be associated with the email 46, and then the email and metadata may be passed to rules element 38.
- rules element 38 compares the metadata to one or more rules 40 to determine whether and how the metadata and email should be processed. For example, rules element 38 may apply certain storage and retention rules to the electronic record based on the presence or absence of certain keywords, phrases or other parameters (such as length, presence or absence of attachments, priority level, read/delivered receipts, etc). As noted earlier, the exact parameters of rules element 38 may be predetermined by the Record Manager using rules composer 34.
- the record manager may write a rule which states that all e-mails from senior management within a specific organization that contain the words "financial disclosure" and an attachment in ADOBE PORTABLE DOCUMENT FORMAT may be archived on a named secure storage medium for a period of not less than 60 days following which the e-mail and its contents may be securely deleted according to a specific electronic record deletion standard.
- Rules element 38 may also contain a rule 40 to apply different retention settings or storage placement depending on the company name or names found in the electronic record.
- rules element 38 may pass the e-mail and/or the metadata to storage element 36.
- storage element 36 may apply storage criteria determined by rules element 38.
- e-mail messages from certain predefined senior management personnel containing the words "financial disclosure" and an ADOBE PORTABLE DOCUMENT FORMAT attachment may be archived on a secure storage medium, for example, optical disk or tape.
- Record retention process 58 may then periodically check the stored email 46 and its metadata 44 to determine whether to dispose of the email and metadata.
- Record retention process 58 may determine that two deletion rules conflict (e.g., one rule indicates to delete an electronic record in 60 days, while another indicates that the electronic record should not be deleted for three months), and automatically rectify this conflict (this is described further below in connection with FIG. 10). If record retention process 58 determines the electronic record should be retained, it may, in some embodiments, send the electronic record back to rules element 38 to update the retention requirements.
- FIG. 5 illustrates an example of how an ERMS may be used to capture and store instant messaging (IM) communications automatically in accordance with certain embodiments of the present invention. As shown, the process chain initiator may be designed to capture instant messaging conversations 46, and hence is referred to in FIG. 5 as an IM ⁇ initiator 30.
- IM initiator 30 may examine all instant messaging traffic passing through mechanism 32, which may be implemented in a specific messaging server or network of messaging servers.
- IM initiator 30 may be configured to query the text of an IM conversation 46 from its initiation for certain words, phrases or other parameters (such as length or duration).
- IM initiator 30 may create XML metadata package 44 which identifies parameters in real time as the conversation develops such as, but not limited to, the parties to the conversation, the duration of the conversation, and similar attributes.
- XML metadata package 44 may be associated with the IM conversation 46 and the conversation and metadata passed to rules element 38.
- rules element 38 may then apply predetermined storage retention criteria 40 to the metadata.
- a notification that a conversation meeting certain criteria has been captured may be sent to rules element 38, which may then determine whether and how to store the conversation and metadata before it is passed to the rules element.
- the rules 40 used by rules element 38 may be predetermined by a Records Manager using a rules composer 34. For example, the record manager may write a rule which states that all instant messaging conversations between an employee of a company and anyone outside the company which contains the keyword "picture" and an attachment with a .GIF, JPEG or .PNG extension may be forwarded to a password protected section of storage element 36 accessible only by members of the organization's human resources (HR) staff.
- HR human resources
- rules element 38 may pass the IM conversation and/or the metadata to storage element 36. Once storage element 36 has received the IM conversation and/or the metadata, it may apply the storage criteria that may be determined by rules element 38.
- an ERMS may also include a replication transport mechanism for conveying replication data between separated electronic record management systems, or between different components of a single ERMS.
- a replication transport mechanism for conveying replication data between separated electronic record management systems, or between different components of a single ERMS.
- current replication transport mechanisms lack a degree of flexibility and custom control.
- the replication transport mechanism preferably handles the transfer of replication data in a secure, network-efficient manner that can cope with disconnected situations such as where the sending system and the receiving system may be incapable of direct contact with one another for any number of reasons such as network problems or simply by design.
- replication transport mechanisms in accordance with the present invention preferably complete the transfer with a degree of customised control over, for example, the routing, sizing, scheduling, acknowledgement, and disaster recovery of electronic records that is not present in current replication transport mechanisms of ERMSs.
- the replication transport mechanism of the present invention may be particularly useful in configurations of electronic record management systems in which there is a master ERMS node and one or more slave ERMS nodes.
- the master ERMS system may act as the central repository of original electronic records and handle all requests for changes to an electronic record.
- the master ERMS may evaluate and act upon change requests and then, using the replication transport mechanism, communicate the accepted changes to various slave ERMS nodes.
- the transport mechanism may also convey remote update data (e.g., requests for changes to master electronic records) from slave systems to master systems.
- remote update data e.g., requests for changes to master electronic records
- Instructions from a master system to a slave system may be called master tasks, while instructions from a slave system to a master system may be called slave tasks.
- the master and slave tasks may be grouped together for the purposes of illustration into master/slave tasks.
- FIG. 6 illustrates an example of a configuration 87 for implementing the replication transportation mechanism feature of the present invention.
- configuration 87 includes three nodes 81, 83, and 85, and all three nodes include transport services mechanisms 84 and base transport mechanisms 86.
- Nodes 81 and 85 further include master/slave tasks 80 and a transport Application Programming Interface (API) 82, and, although these components are not illustrated in node 83, they may nevertheless be implemented in node 83 if suitable or desired.
- API Application Programming Interface
- any other suitable functions, including other instances of tasks 80, interface 82, and mechanisms 84 and 86 may be implemented in nodes 81, 83, and 85, and these nodes may be implemented as a single device (such as a computer or server) or any combination of devices.
- Nodes 81, 83, and 85 may be located geographically and/or logically near or remote to each other and may be in continuous or intermittent contact with one another.
- nodes 81, 83, and 85 may be part of the same network (e.g., WAN, LAN, MAN) or they may be parts of disparate networks connected via various communications protocols (e.g., TCP/IP).
- master/slave tasks 80 are instructions from a master or slave to a slave or master, respectively, that may be used to synchronize electronic records maintained on different nodes in an ERMS or alternatively between different nodes each of which is under the control of a different ERMS.
- Tasks 80 may be in any suitable format, such as
- Tasks 80 may specify any suitable information.
- tasks 80 may be instructions that specify the identity of one or more electronic records to be synchronized, the action to be taken on that electronic record (e.g., create, edit, store or delete), and the specific changes to be made on that electronic record (e.g., edits to the text or other content or the identity of an attached electronic record including those changes).
- any suitable tasks 80 may be used in accordance with the present invention.
- Transport API 82 is any suitable application program interface that may be accessed by an ERMS module (or other mechanism) to communicate with, and/or configure transport services mechanism 84.
- transport API 82 may be implemented using the MICROSOFT .NET class library.
- Transport API 82 may directly access a database or other storage mechanism (described below) in transport services mechanism 84 that acts as a repository of task information 80, acknowledgement messages (e.g., that a task was processed or rejected), and/or configuration data.
- Transport API 82 may access transport services mechanism 84 by a unique channel number (also described below) configured in the transport services mechanism.
- Transport services mechanism 84 handles the routing, scheduling, sizing, and acknowledgement of the replication messages sent by each node. This routing, scheduling, sizing and acknowledgment is broadly configurable and the actual transportation may be accomplished using any suitable protocol and independently of the underlying technology used to move data in base transport mechanism 86. For example, transport services mechanism 84 may route tasks from node 81 to node 85 via another route (not shown) rather than routing the messages through node 83 either because the other route is faster, more secure, more reliable, or for any other suitable reason.
- the Transport Services mechanism 84 may control the schedule of when tasks are transmitted between nodes so that they are transmitted every half hour (or any other desired period of time) or when a certain number of tasks are ready to be transported, or based on a combination of time of day and volume of messages, for example.
- Mechanism 84 may also control the schedule of when tasks are transmitted so that tasks with higher priority are transmitted before tasks with lower priority, for example - in such a case, priority may be based on a manually assigned priority categories (e.g., high, low, and medium), chronological order, number of files in a folder, category of a document, order changes should be made to a document, etc., or any combination of the same.
- the priority of transmission may be based first on a categorical priority setting assigned to each electronic record associated with a task, and second on a chronological order in which the tasks were generated.
- mechanism 84 may cause copies of a task being transported through a node (e.g., node 83) to be held at that node until the task reaches the next node along the path so that the task cannot be inadvertently lost.
- Transport services mechanism 84 may also perform any necessary encryption and/or compression of items to be transported.
- Transport services mechanisms 84 may communicate with one another through logical channels. Each channel may be assigned to correspond to a specific pairing of two or more transport services mechanisms. For example, a master ERMS at node 81 may communicate with a slave ERMS at node 83 via channel 1 at transport services mechanism 84 in node 81. The channel number in transport services mechanism 84 in node 83 for communication with node 81 may also be assigned to channel 1 (i.e., may be the same channel number) or may be any other suitable channel number (e.g., channel 2). In certain embodiments, each channel may be associated with an Internet Protocol address (or a network address) so that any given node in a system can communicate with another node in that system. Preferably, each channel may be used for communication in two directions, although, in certain embodiments, one-way channels may also be used. Moreover, channels may be configured as broadcast channels so that any node can communicate simultaneously with many other nodes.
- base transport mechanism 86 may be any suitable communication mechanism that may be used to deliver synchronization data from one node 81, 83, and 85 to another node 81, 83, and 85.
- base transport mechanism 86 may be a communication network, such as a LAN, WAN, or the Internet, using TCP/IP. It may be desirable to split up data transmitted over base transport mechanism into portions, such as packets, as long as those portions can reliably be delivered and reassembled.
- Base transport mechanism 86 may also include functions for storing data to be transported from one node to another, for example, when the sending or receiving node is temporarily disconnected from a computer network or when immediate replication is otherwise not possible or not desired.
- transport services mechanism 84 is illustrated in greater detail.
- the transport services mechanism may include a transport services database (TSDB) 90, a sender process 92, receiver processes 94, a load balancer 96, an administration utility 98, and a disk agent 99.
- TSDB 90 may be any suitable data storage mechanism (such as a relational database) for storing and categorizing replication requests 80, and storing acknowledgement and change acceptance/rejection messages, configuration settings, and any other suitable data for the operation and control of transport services mechanism 84.
- database 90 may be memory, a database server, a disk drive, a buffer, or any other suitable storage device.
- Sender process 92 may be any suitable process for sending data over base transport 86.
- sender process 92 may be a TCP/IP process or any other suitable process.
- Receiver processes 94 may similarly be any suitable processes for receiving data over base transport 86.
- receiver processes 94 may also be TCP/IP processes or any other suitable processes.
- Sender process 92 and two receiver processes 94 are illustrated, any suitable number of sender processes and receiver processes (including only one of each) may be used in accordance with the present invention.
- Load balancer 96 may be any suitable mechanism for balancing the traffic coming from other transport service mechanism between receiver processes 94, and for providing a single IP address for both receivers.
- load balancer 96 may receive messages directed to its IP address, then perform network address translation (NAT) on those messages, select one of receiver processes 94 based upon any suitable mechanism (e.g., such as round robin, current load, etc.), and then forward the message to the selected receiver process 94.
- Administration utility 98 may be any suitable application that enables an administrator or other user to configure the transport services mechanism. For example, utility 98 may be used to configure the IP address and any other suitable parameters of transport services mechanism 84.
- disk agent 99 may be used to transport replication data between two ERMSs without using base transport mechanism 86.
- XML replication instructions and electronic records may sent from sender process 92 via agent 99 to a disk, or any other suitable portable media such as memory, at one ERMS so that those instructions can be transferred to another ERMS and read in from its agent 99 to a receiver process 94 via load balancer 96.
- FIG. 8 illustrates an example of the flow of data in the transport replication mechanism provided in certain embodiments of the present invention.
- a user may make a request at a master or slave ERMS to update or create an electronic record, resulting in a master/slave task being generated to update another ERMS.
- This task may then be passed by an ERMS module to transport API 101 at step 102.
- the transport API may then pass the task to the transport services mechanism database in a transport services mechanism 103 at step 104.
- transport services mechanism 103 may be controlled by an administration utility at step 106 by modifying the contents of the transport services mechanism database.
- the sender process at step 108 retrieves the task from the database and transmits the task to the recipient via a computer network.
- the sender process may perform any necessary translation or reformatting of the task to facilitate transmission over the network.
- the sender process may also apply any restrictions on transmission of tasks, based on, for example, source or target node, user, account, device, content, route, time, or any other suitable factor or combination of factors.
- the network transfers the task from the sender process in transport services mechanism 103 to the receiver in transport services mechanism 105.
- the network may be any suitable base transport mechanism such as a WAN, LAN, or the Internet using the TCP/IP protocol.
- the network at step 110 may include any number of nodes between the source node and the target node. In such a case, each node may temporarily receive, store in its database, and send any of the tasks be sent over the network.
- the receiver at step 112 receives the data via a load balancer (not pictured). The receiver may strip headers or other data added by the sender and/or assemble and confirm arrival of data packets making up the data.
- the receiver next passes the data to a transport services database at step 114.
- the database in mechanism 105 may be controlled by an admin utility at step 116.
- the transport API at step 124 may next retrieve the data from the database and then pass the data to an ERMS module that performs a system update at step 122.
- an ERMS in accordance with the present invention may also provide a replication mechanism that enhances data integrity by ensuring that modified electronic records on remote systems stay synchronized with the master copies of those records on a master system.
- FIG. 9 illustrates an example of a process 210 for performing replication in accordance with certain embodiments of the present invention.
- a user makes changes to a replica of an electronic record. These changes may be made through any suitable mechanism, such as MICROSOFT WORD, MICROSOFT POWERPOINT, MICROSOFT EXCEL, or any other suitable software or hardware.
- the changed replica will be passed to a remote update client at step 226 when the user attempts to save the changes.
- the remote update client Upon receiving the changed replica of the electronic record, the remote update client will create a package of XML metadata describing the proposed changes and pass that package to a transport mechanism at step 230.
- the package is transported via the remote transport mechanism described above, however any suitable mechanism for conveying the changes to the master ERMS may be used.
- Part of the XML metadata may be a unique system id for the remote ERMS node so that the master ERMS node knows which remote system initiated the proposed changes to the master electronic record. Any other suitable information, such as a user id of the user that entered the changes to the replica of the electronic record, may also be included in the XML metadata.
- XML metadata is described herein as being used to describe the changes made to the replica and any other suitable information, any mechanism for containing this information may be used in accordance with the present invention.
- the package of changes and any accompanying information are received at the master ERMS, and a master list of changes is compiled.
- the master list may consist of changes from a single request from a single remote ERMS, or may include one or more requests from one or more systems.
- the master list of changes may include an identity of the system and/or user that proposes each change to the master electronic record.
- Process 210 may then determine at step 236 whether the remote ERMS, or the user, has permission to update the master electronic record at step 236. If the remote ERMS (or user) does not have permission, then the master ERMS may send a failure message to the remote ERMS at step 248. Otherwise, process 210 may check whether the master of the electronic record exists at the master ERMS at step 238. If it is determined at step 238 that the master does not exist, process 210 branches to step 248 and sends a failure message to the remote ERMS. Otherwise, process 210 continues to step 240 determine whether the master is current. The master might not be current for example if other changes to the master are pending.
- process 210 may hold the changes until the master becomes current, for example because the pending changes were made to the master. Otherwise, the updates are applied to the master at the master ERMS at step 244. As shown at step 246, once changes have been made to the master, process 210 may notify the remote ERMS (s) that the changes have been made to the master electronic record. This notification may be used to update the replicas at each of the remote systems with the changes to the master electronic record, may be used only to notify the remote system that requested the changes that the changes were accepted, may be used only to notify the remote systems that did not request the changes that changes to the master electronic record were made, or may be used for any other purpose.
- This notification may include any suitable information, such as an identifier of the request to update the master electronic record, an identifier of the remote system and/or user that updated the record, etc.
- the notification may be used to update the replicas at each of the remote systems by including a complete copy of the master electronic record, or by including a package of change information and any accompanying information (e.g., similarly to the XML metadata package used to convey the changes from the remote system to the master system).
- an ERMS in accordance with the present invention may also provide an improved records retention mechanism for managing the lifecycle of electronic records by resolving candidate document disposal schedules into a single schedule to be applied to the electronic record and applying that schedule to one or more storage devices with built-in document retention functions.
- the retention mechanism of the ERMS may be a software application that manages electronic records according to rules and definitions created by a record manager within an organization who is responsible for ensuring records retention and disposal. This software mechanism may also interact with electronic records retention rules maintained by other hardware elements of the system, such as those maintained by EMCs CENTERA storage management products when such products are used in the system.
- the ERMS may support a full range of disposal options through the retention mechanism such as export to an external archive, deletion, retention and review at a later date, and/or any other suitable options.
- Each disposal schedule may generally consist of a trigger event, a retention period and a disposal action.
- the trigger event may be an incident such as document creation, the declaration of the document as an electronic record by the ERMS, archiving, processing, transporting, updating or other occurrence which instructs the ERMS that a particular electronic record may need to be retained.
- the retention period may be a set period of time that runs from the trigger event to a specified end date.
- the disposal action may be a specific action to be performed on the electronic record upon the expiry of the retention period. For example, the action may to perform secure deletion of the electronic record or to archive the electronic record onto tape or other media. As another example, the action may be to take some action on the electronic record and restart the retention period.
- Certain embodiments of the present invention provide a method for resolving candidate disposal schedules into a single schedule to be applied to the electronic record.
- FIG. 9 illustrates one example of an architecture 300 for implementing a retention mechanism in accordance with certain embodiments of the invention.
- architecture 300 includes a dynamic trigger event monitor 310 that may query the system for an incident such as an electronic record creation, archiving, processing, transporting, updating or other event which may be designated by a records manager using a rules composer 320.
- Rules composer 320 may be a graphic user interface into the ERMS, a software module, or other suitable means to configure the retention mechanism. If trigger event monitor 310 identifies an event, it may pass information about the electronic record to a disposal schedule creation module 312.
- Disposal schedule creation module 312 may be a software module or other suitable mechanism that receives information about an electronic record and disposal rules, and modifies attributes of the electronic record to create a disposal schedule. This module may also contain an algorithm for resolving multiple candidate disposal schedules into a single schedule that governs the electronic record. After the disposal schedule is created, disposal schedule creation module 312 may pass the electronic record to electronic storage medium 314 for storage.
- Electronic record storage 314 may be a magnetic storage device, a solid-state storage device, an optical storage device, a physical medium used for storage, or any other suitable storage device.
- the actual physical storage device itself may create and maintain disposal schedules for electronic records stored on the device.
- the disposal schedule creation module 312 may also contain an algorithm to query such disposal schedules as part of the process of resolving candidate disposal schedules into a single schedule that governs the electronic record.
- the electronic record may reside in electronic storage 314 until the disposal condition occurs.
- Electronic record query logic 316 may check electronic record storage 314 at various times to ensure disposal schedules are being met.
- Electronic record query logic 316 may be a software module or other suitable device that may check electronic record storage 314 and evaluate disposal schedules based on rule from rules composer 320. If a record is found to meet the disposal requirements, the record may be selected by electronic record query logic 316 to be passed from electronic record storage 314 to disposal action module 318. Disposal action module 318 may evaluate the disposal schedule and may determine the appropriate action for the electronic record. The appropriate action may be disposal, archiving or other suitable actions. In some embodiments, electronic record query logic 316 may handle the disposal action. In other embodiments, electronic record storage 314 may handle the disposal action based on the instructions of electronic record query logic 316 or based on any other suitable mechanism, such as internal disposal action settings.
- the record may at regular intervals be queried to determine which of any disposal schedules may be relevant to the electronic record. As discussed above, these disposal schedules may then be processed using to determine which of the candidate disposal schedules should be applied to the record in question. For example, the priorities of different applicable disposal schedules may be compared, and the disposal schedules applied in order or priority, such that a lower-priority disposal schedule does not override a higher-priority disposal schedule. As another example, the disposal schedules may be compared and the disposal schedule that would cause an electronic record to be retained for either the longest or the shortest period of time may be selected.
- disposal hardware also supports the creation and maintenance of its own disposal schedules, such as in the case of EMCs CENTERA and CENTERA CE+ storage products, these disposal schedules may be queried as well to ensure that the requirements of such disposal schedules are taken into account in setting the disposal schedule for a record.
- the physical hardware can be programmed to automatically retain a record for a minimum period of time, or to automatically delete a record after some period of time, the hardware may be programmed in accordance with the invention to maintain control by the electronic record query logic 316.
- the disposal schedule creation module 312 may program the hardware with a minimum retention setting of "one day" (or any other suitable setting) for an electronic record so that record can be deleted by the electronic record query logic 316 on any given day. If the electronic record query logic 316 determines that a record should not yet be deleted, the logic may then reset the retention setting for the hardware for one more day and then repeat the query process on the following day.
- the scope of the present invention in its various aspects should not be limited by the examples presented above. The individual aspects of the present invention, and the entirety of the invention should be regarded so as to allow for such design modifications and future developments within the scope of the present disclosure. The present invention is limited only by the claims that follow.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Document Processing Apparatus (AREA)
Abstract
Description
Claims
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| GB0723468A GB2445229A (en) | 2005-05-10 | 2005-05-10 | Methods and systems for electronic records management |
| PCT/EP2005/005140 WO2006119790A1 (en) | 2005-05-10 | 2005-05-10 | Methods and systems for electronic records management |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/EP2005/005140 WO2006119790A1 (en) | 2005-05-10 | 2005-05-10 | Methods and systems for electronic records management |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2006119790A1 true WO2006119790A1 (en) | 2006-11-16 |
Family
ID=34968124
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/EP2005/005140 Ceased WO2006119790A1 (en) | 2005-05-10 | 2005-05-10 | Methods and systems for electronic records management |
Country Status (2)
| Country | Link |
|---|---|
| GB (1) | GB2445229A (en) |
| WO (1) | WO2006119790A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10868782B2 (en) | 2018-07-12 | 2020-12-15 | Bank Of America Corporation | System for flagging data transmissions for retention of metadata and triggering appropriate transmission placement |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2004086250A1 (en) * | 2003-03-27 | 2004-10-07 | Smart Internet Technology Crc Pty Limited | E-mail management system and method |
| WO2005010715A2 (en) * | 2003-07-21 | 2005-02-03 | Fusionone, Inc. | Device message management system |
| US20050076084A1 (en) * | 2003-10-03 | 2005-04-07 | Corvigo | Dynamic message filtering |
-
2005
- 2005-05-10 WO PCT/EP2005/005140 patent/WO2006119790A1/en not_active Ceased
- 2005-05-10 GB GB0723468A patent/GB2445229A/en not_active Withdrawn
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2004086250A1 (en) * | 2003-03-27 | 2004-10-07 | Smart Internet Technology Crc Pty Limited | E-mail management system and method |
| WO2005010715A2 (en) * | 2003-07-21 | 2005-02-03 | Fusionone, Inc. | Device message management system |
| US20050076084A1 (en) * | 2003-10-03 | 2005-04-07 | Corvigo | Dynamic message filtering |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10868782B2 (en) | 2018-07-12 | 2020-12-15 | Bank Of America Corporation | System for flagging data transmissions for retention of metadata and triggering appropriate transmission placement |
Also Published As
| Publication number | Publication date |
|---|---|
| GB2445229A (en) | 2008-07-02 |
| GB0723468D0 (en) | 2008-01-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20060259468A1 (en) | Methods for electronic records management | |
| US10956404B2 (en) | Method and apparatus for a file sharing synchronization system | |
| US8453159B2 (en) | Workspace system and method for monitoring information events | |
| US20210081367A1 (en) | Method and system for real-time collaboration and event linking to documents | |
| US9213988B2 (en) | Electronic commerce infrastructure system | |
| US20230023160A1 (en) | Rendering related content prior to an event in a group-based communication interface | |
| US8819266B2 (en) | Dynamic file transfer scheduling and server messaging | |
| US8359251B2 (en) | Distributed commerce system | |
| US8510389B1 (en) | Automated ranking of electronic communications | |
| US20080301207A1 (en) | Systems and methods for cascading destruction of electronic data in electronic evidence management | |
| KR20060108704A (en) | Sync and Merge Engine | |
| US20050160088A1 (en) | System and method for metadata-based distribution of content | |
| WO2004114120A1 (en) | Method and system for data collection for alert delivery | |
| US11722856B2 (en) | Identifying decisions and rendering decision records in a group-based communication interface | |
| US20220114142A1 (en) | Method and System for Real-Time Collaboration and Event Linking to Documents and Video Recordings | |
| US12210487B2 (en) | Method and system for real-time collaboration, task linking, and code design and maintenance in software development | |
| EP2056248A1 (en) | Electronic commerce system | |
| US20080301084A1 (en) | Systems and methods for dynamically creating metadata in electronic evidence management | |
| US20170193051A1 (en) | Systems and methods for automatic archiving, sorting, and/or indexing of secondary message content | |
| US20080028070A1 (en) | Method and system for remote management of online activities | |
| US20080301099A1 (en) | Systems and methods for using proxies in social network analysis in electronic evidence management | |
| WO2006119790A1 (en) | Methods and systems for electronic records management | |
| Wild et al. | Message Archive Management | |
| CN120849357A (en) | An enterprise intelligent data platform and its file search method and device | |
| Anerousis | Replication and notification management in a knowledge delivery network |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| WWW | Wipo information: withdrawn in national office |
Country of ref document: DE |
|
| ENP | Entry into the national phase |
Ref document number: 0723468 Country of ref document: GB Kind code of ref document: A Free format text: PCT FILING DATE = 20050510 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 0723468.5 Country of ref document: GB Ref document number: 723468 Country of ref document: GB |
|
| NENP | Non-entry into the national phase |
Ref country code: RU |
|
| WWW | Wipo information: withdrawn in national office |
Country of ref document: RU |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 05745283 Country of ref document: EP Kind code of ref document: A1 |