Goldengate单向数据复制,为了图省事没有配pump,只配了source的extract和target的replicat;实际操作发现gg对大事务的支持还是比streams好一些,streams碰上大事务就只看到SPILL MESSAGES了:
/*源端配置信息*/GGSCI (rh2.oracle.com) 1> view params mgrPORT 7809GGSCI (rh2.oracle.com) 2> view params load1--extract group--extract load1--connection to database--userid ggate, password ggate--hostname and port for trail--rmthost rh3.oracle.com, mgrport 7809--path and name for trail--rmttrail /s01/ggddl include mapped objname sender.*table sender.*;GGSCI (rh2.oracle.com) 4> stats extract load1Sending STATS request to EXTRACT LOAD1 ...Start of Statistics at 2010-11-29 17:44:41.DDL replication statistics (for all trails):*** Total statistics since extract started     ***        Operations                                   1.00        Mapped operations                            1.00        Unmapped operations                          0.00        Other operations                             0.00        Excluded operations                          0.00Output to /s01/gg:Extracting from GGATE.GGS_MARKER to GGATE.GGS_MARKER:*** Total statistics since 2010-11-29 16:22:25 ***        No database operations have been performed.*** Daily statistics since 2010-11-29 16:22:25 ***        No database operations have been performed.*** Hourly statistics since 2010-11-29 17:00:00 ***        No database operations have been performed.*** Latest statistics since 2010-11-29 16:22:25 ***        No database operations have been performed.Extracting from SENDER.ABC to SENDER.ABC:*** Total statistics since 2010-11-29 16:22:25 ***        Total inserts                           2621440.00        Total updates                                0.00        Total deletes                                0.00        Total discards                               0.00        Total operations                        2621440.00*** Daily statistics since 2010-11-29 16:22:25 ***        Total inserts                           2621440.00        Total updates                                0.00        Total deletes                                0.00        Total discards                               0.00        Total operations                        2621440.00*** Hourly statistics since 2010-11-29 17:00:00 ***        No database operations have been performed.*** Latest statistics since 2010-11-29 16:22:25 ***        Total inserts                           2621440.00        Total updates                                0.00        Total deletes                                0.00        Total discards                               0.00        Total operations                        2621440.00End of Statistics.GGSCI (rh2.oracle.com) 5> info allProgram     Status      Group       Lag           Time Since ChkptMANAGER     RUNNINGEXTRACT     RUNNING     LOAD1       00:00:00      00:00:08/*目标端配置信息*/GSCI (rh3.oracle.com) 1> view params mgrPORT 7809USERID ggate, PASSWORD ggatePURGEOLDEXTRACTS /s01/ggGGSCI (rh3.oracle.com) 2> view params rep1--Replicat group --replicat rep1--source and target definitionsASSUMETARGETDEFS--target database login --userid ggate, password ggate--file for dicarded transaction --discardfile /s01/discard.txt, append, megabytes 10--ddl supportDDL--Specify table mapping ---map sender.*, target receiver.*;GGSCI (rh3.oracle.com) 3> stats replicat rep1Sending STATS request to REPLICAT REP1 ...Start of Statistics at 2010-11-30 02:44:16.DDL replication statistics:*** Total statistics since replicat started     ***        Operations                                   1.00        Mapped operations                            1.00        Unmapped operations                          0.00        Other operations                             0.00        Excluded operations                          0.00        Errors                                       0.00        Retried errors                               0.00        Discarded errors                             0.00        Ignored errors                               0.00Replicating from SENDER.ABC to RECEIVER.ABC:*** Total statistics since 2010-11-30 01:21:09 ***        Total inserts                           2621440.00        Total updates                                0.00        Total deletes                                0.00        Total discards                               0.00        Total operations                        2621440.00*** Daily statistics since 2010-11-30 01:21:09 ***        Total inserts                           2621440.00        Total updates                                0.00        Total deletes                                0.00        Total discards                               0.00        Total operations                        2621440.00*** Hourly statistics since 2010-11-30 02:00:00 ***        No database operations have been performed.*** Latest statistics since 2010-11-30 01:21:09 ***        Total inserts                           2621440.00        Total updates                                0.00        Total deletes                                0.00        Total discards                               0.00        Total operations                        2621440.00End of Statistics.GGSCI (rh3.oracle.com) 4> info allProgram     Status      Group       Lag           Time Since ChkptMANAGER     RUNNINGREPLICAT    RUNNING     REP1        00:00:00      00:00:01
接着尝试在源库端sender模式下产生一个大事务操作,观察目标段数据同步情况*/
SQL> delete sender.abc;2621440 rows deleted.SQL> commit;Commit complete./* commit操作完成前,EXTRACT进程并不会抽取日志 */Goldengate日志ggserror.log的相关记录:010-11-29 17:49:49  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000029.2010-11-29 17:49:50  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000030.2010-11-29 17:49:51  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000031.2010-11-29 17:49:53  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000032.2010-11-29 17:49:54  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000033.2010-11-29 17:49:55  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000034.2010-11-29 17:49:56  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000035.2010-11-29 17:49:57  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000036.2010-11-29 17:49:58  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000037.2010-11-29 17:49:59  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000038.2010-11-29 17:50:00  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000039.2010-11-29 17:50:01  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000040.2010-11-29 17:50:03  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000041.2010-11-29 17:50:04  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000042.2010-11-29 17:50:05  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000043.2010-11-29 17:50:06  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000044.2010-11-29 17:50:07  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000045.2010-11-29 17:50:08  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000046.2010-11-29 17:50:09  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000047.2010-11-29 17:50:10  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000048.2010-11-29 17:50:11  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000049.2010-11-29 17:50:13  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000050.2010-11-29 17:50:14  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000051.2010-11-29 17:50:15  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000052.2010-11-29 17:50:16  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000053.2010-11-29 17:50:17  INFO    OGG-01026  Oracle GoldenGate Capture for Oracle, load1.prm:  Rolling over remote file /s01/gg000054./*产生了26个trail文件*//*同时备库端开始陆续应用日志*/REP1.rpt是rep1 replicat复制进程的文本报告,出现相关内容:Switching to next trail file /s01/gg000029 at 2010-11-30 02:47:54 due to EOF, with current RBA 9999949Opened trail file /s01/gg000029 at 2010-11-30 02:47:54Switching to next trail file /s01/gg000030 at 2010-11-30 02:49:53 due to EOF, with current RBA 9999925Opened trail file /s01/gg000030 at 2010-11-30 02:49:53GGSCI (rh3.oracle.com) 6> stats replicat rep1Sending STATS request to REPLICAT REP1 ...Start of Statistics at 2010-11-30 02:52:20.DDL replication statistics:*** Total statistics since replicat started     ***        Operations                                   1.00        Mapped operations                            1.00        Unmapped operations                          0.00        Other operations                             0.00        Excluded operations                          0.00        Errors                                       0.00        Retried errors                               0.00        Discarded errors                             0.00        Ignored errors                               0.00Replicating from SENDER.ABC to RECEIVER.ABC:*** Total statistics since 2010-11-30 01:21:09 ***        Total inserts                           2621440.00        Total updates                                0.00        Total deletes                           208150.00        Total discards                               0.00        Total operations                        2829590.00*** Daily statistics since 2010-11-30 01:21:09 ***        Total inserts                           2621440.00        Total updates                                0.00        Total deletes                           208150.00        Total discards                               0.00        Total operations                        2829590.00*** Hourly statistics since 2010-11-30 02:00:00 ***        Total inserts                                0.00        Total updates                                0.00        Total deletes                           208150.00        Total discards                               0.00        Total operations                        208150.00*** Latest statistics since 2010-11-30 01:21:09 ***        Total inserts                           2621440.00        Total updates                                0.00        Total deletes                           208150.00        Total discards                               0.00        Total operations                        2829590.00End of Statistics.GGSCI (rh3.oracle.com) 7> !stats replicat rep1Sending STATS request to REPLICAT REP1 ...Start of Statistics at 2010-11-30 02:52:26.DDL replication statistics:*** Total statistics since replicat started     ***        Operations                                   1.00        Mapped operations                            1.00        Unmapped operations                          0.00        Other operations                             0.00        Excluded operations                          0.00        Errors                                       0.00        Retried errors                               0.00        Discarded errors                             0.00        Ignored errors                               0.00Replicating from SENDER.ABC to RECEIVER.ABC:*** Total statistics since 2010-11-30 01:21:09 ***        Total inserts                           2621440.00        Total updates                                0.00        Total deletes                           210767.00        Total discards                               0.00        Total operations                        2832207.00*** Daily statistics since 2010-11-30 01:21:09 ***        Total inserts                           2621440.00        Total updates                                0.00        Total deletes                           210767.00        Total discards                               0.00        Total operations                        2832207.00*** Hourly statistics since 2010-11-30 02:00:00 ***        Total inserts                                0.00        Total updates                                0.00        Total deletes                           210767.00        Total discards                               0.00        Total operations                        210767.00*** Latest statistics since 2010-11-30 01:21:09 ***        Total inserts                           2621440.00        Total updates                                0.00        Total deletes                           210767.00        Total discards                               0.00        Total operations                        2832207.00End of Statistics./*由以上对replicat进程的统计信息可知其正在应用delete操作*/Switching to next trail file /s01/gg000031 at 2010-11-30 02:53:26 due to EOF, with current RBA 9999925Opened trail file /s01/gg000031 at 2010-11-30 02:53:26Switching to next trail file /s01/gg000032 at 2010-11-30 02:58:28 due to EOF, with current RBA 9999925Opened trail file /s01/gg000032 at 2010-11-30 02:58:28[maclean@rh3 s01]$ ls -lh gg00003[1-2]-rw-rw-rw- 1 maclean oinstall 9.6M Nov 30 02:47 gg000031-rw-rw-rw- 1 maclean oinstall 9.6M Nov 30 02:47 gg000032/*由上列trace信息推断,以这样一台双核cpu主频为2.2GHZ的pc机为例,gg应用一个大小为9.6M的trail文件耗时也要将近5分钟(当然这并不准确)。/*从进程argument可以看到replicate和extract进程的本质是调用了多个配置文件的$GGATE/extract和$GGATE/replicat*/[maclean@rh3 ~]$ ps -ef|grep replmaclean   7817  7476  3 01:18 ?        00:03:29/home/maclean/gg/replicat PARAMFILE /home/maclean/gg/dirprm/rep1.prmREPORTFILE /home/maclean/gg/dirrpt/REP1.rptPROCESSID REP1 USESUBDIRS[maclean@rh2 dirrpt]$ ps -ef|grep exmaclean    544 32432  1 16:21 ?        00:01:12/home/maclean/gg/extract PARAMFILE /home/maclean/gg/dirprm/load1.prmREPORTFILE /home/maclean/gg/dirrpt/LOAD1.rptPROCESSID LOAD1 USESUBDIRS