Loading....

GoldenGate enables us to extract and replicate data across a variety of topologies as shown the diagram below as well as the exchange and manipulation of data at the transactional level between a variety of database platforms like Oracle, DB2, SQL Server, Ingres, MySQL etc.

It can support a number of different business requirements like:

  • Business Continuity and High Availablity
  • Data migrations and upgrades
  • Decision Support Systems and Data Warehousing
  • Data integration and consolidation
  • Let us know look at the differents components and processes that make up a typical GoldenGate configuration on Oracle.


    (source: Oracle GoldenGate Administration Guide)

    Manager

    The Manager process must be running on both the source as well as target systems before the Extract or Replicat process can be started and performs a number of functions including monitoring and starting other GoldenGate processes, managing the trail files and also reporting.

    Extract

    The Extract process runs on the source system and is the data caoture mechanism of GoldenGate. It can be configured both for initial loading of the source data as well as to synchronize the changed data on the source with the target. This can be configued to also propagate any DDL changes on those databases where DDL change support is available.

    Replicat

    The Replicat process runs on the target system and reads transactional data changes as well as DDL changes and replicates then to the target database. Like the Extract process, the Replicat process can also be configured for Initial Load as well as Change Synchronization.

    Collector

    The Collector is a background process which runs on the target system and is started automatically by the Manager (Dynamic Collector) or it can be configured to stsrt manually (Static Collector). It receives extracted data changes that are sent via TCP/IP and writes then to the trail files from where they are processed by the Replicat process.

    Trails

    Trails are series of files that GoldenGate temporarily stores on disks and these files are written to and read from by the Extract and Replicat processes as the case may be. Depending on the configuration chosen, these trail files can exist on the source as well as on the target systems. If it exists on the local system, it will be known an Extract Trail or as an Remote Trail if it exists on the target system.

    Data Pumps

    Data Pumps are secondary extract mechanisms which exist in the source configuration. This is optional component and if Data Pump is not used then Extract sends data via TCP/IP to the remote trail on the target. When Data Pump is configured, the the Primary Extract process will write to the Local Trail and then this trail is read by the Data Pump and data is sent over the network to Remote Trails on the target system.

    In the absence of Data Pump, the data that the Extract process extracts resides in memory alone and there is no storage of this data anywhere on the source system. In case of network of target failures, there could be cases where the primary extract process can abort or abend. Data Pump can also be useful in those cases where we are doing complex filtering and transformation of data as well as when we are consolidating data from many sources to a central target.

    Data source

    When processing transactional data changes, the Extract process can obtain data directly from the database transaction logs (Oracle, DB2, SQL Server, MySQL etc) or from a GoldenGate Vendor Access Module (VAM) where the database vendor (for example Teradata) will provide the required components that will be used by Extract to extract the data changes.

    Groups

    To differentiate between the number of different Extract and Replicat groups which can potentially co-exist on a system, we can define processing groups. For instance, if we want to replicate different sets of data in parallel, we can create two Replicat groups.

    A processing group consisits of a process which could be either a Extract or Replicat process, a corresponding parameter file, checkpoint file or checkpoint table (for Replicat) and other files which could be associated with the process.

    Coming Next! – Oracle GoldenGate Installation demo …..

    Please follow and like us:

    Last Update: May 4, 2017  

    February 8, 2010 210 Gavin Soorma
    Total 0 Votes:
    0

    Tell us how can we improve this post?

    + = Verify Human or Spambot ?

    Add A Knowledge Base Question !

    You will receive an email when your question will be answered.

    + = Verify Human or Spambot ?

    17 thoughts on “GoldenGate Tutorial 1 – Concepts and Architecture

    1. ATP

      Hi ,

      can you please explain the trail file storage mechanism, suppose im going to create a trail file with size of 500Mb , i would like to know

      1. how much rows GG can store in the 500Mb of trail file.?

    2. Gavin Soorma

      Not sure if I can understand what your question is – why would you worry how many rows fits in one trail file – when the trail file fills up it will create another one and so on

    3. Suman Das

      Gavin Sir, Thank you for providing such interesting topics on ORACLE. Enjoyed lot reading these. Can you please provide ORACLE RAC concept, architecture and all of it’s services in very simplified version.

      Thank you.

    4. Jagan

      Hi Gavin

      Is it possible to join two source tables and the result set will be insterd in the target table as part of data extraction and delivery?

    5. pankaj

      Hi Gavin,

      1st of all thanks a lot for sharing such valuable docs. I want some clarification regarding the replicate process which i configured in my target server. Whenever I am trying to start the process it’s giving replicate is starting however when i check the status it’s showing replicate is stopped.I am not getting the updated data in the scott.emp table of my source database.

      I followed all your installation and manager configuration steps. It’s configured properly but failing at the end.

      Please suggest.

      Thanks,
      Pankaj

    6. Elven

      Golden Gate can replicate MySQL ? how GG to do it ? as I know MySql doesn’t have LOG file like a database such as Oracle, DB2 etc…Please let me know how GG works, thanks

    7. girish

      Hi Gavin,

      Nice explanation for the beginners who wants to know the concept of the Golden Gate.

      Thanks,
      Girish

    Leave a Comment

    Your email address will not be published. Required fields are marked *

    *
    *

    Social media & sharing icons powered by UltimatelySocial
    Back To Top

    Add A Knowledge Base Question !

    You will receive an email when your question will be answered.

    + = Verify Human or Spambot ?