Data Grid Implementation

Abstract

The main objective ofthis project was the exploration ofthe 'Data Grid' and its 'Implementation'. The system has to provide services to widely varying queries from the centers spread over the entire network LAN/WAN. This implementation will remove the customized solutions for distributed databases management, data warehousing and data mining. The model is proposed ofbeing inspired by the interest of the computer industry in Grid technologies. The objective of the model is to provide cost effective solution assisted by a Data Grid with reasonable response time at the user nodes for the queries generated. The query servicing will be made efficient through data caching at intermediate nodes along with aggressive data availability model. The advantage of the Data Grid to provide cost effective solutions for scalability, fault tolerance, fail safe operations. A hierarchical structure of activities will be made where the overall consistency and security will be .. guaranteed by the Central Data Node (CDN) maintained at ROOT Level. All the participating nodes .. ... shall be governed by a global security policy. The CDN is connected hierarchically to Remote Data Nodes (RDN) which are then connected to Local Data Nodes (LDN). Every LDN has a number of users and data collector stations. The data presentation and collection or other management functions on nodes besides LDNs will be provided on auxiliary nodes (AuxDN). The model is supported by replication of data from CDN to RDN along with caching and buffering supported by hashing functions to speed up access I service. The log structured methods will be used to provide options Do/undo corrections or updates at the LON level. The database update,loading new batch backing and othe database management activities will be handled by CDN.