Shulou(Shulou.com)06/01 Report--

This article is to share with you about how to use Oracle GoldenGate Marketplace to achieve rapid data synchronization ADW. The editor thinks it is very practical, so share it with you as a reference and follow the editor to have a look.

Oracle GoldenGate is a comprehensive software package for real-time data integration and replication between heterogeneous IT environments. The product set supports high availability solutions, real-time data integration, transaction change data capture, operations, and analysis of data replication, transformation, and validation between enterprise systems.

GOLDENGATE 19.1 ON MARKETPLACE function

Oracle GoldenGate for Oracle 19.1 Micro Services Edition includes capture and delivery support for the Oracle database version 11g Magi 12c Magi 18c Magi 19c Magi Cloud as well as local databases. Allows remote capture from any Oracle database platform and operating system without the need to install any media on the source-side and target-side databases.

The architecture of GoldenGate on OCI microservices is as follows:

This article will gradually introduce how to use Oracle GoldenGate Marketplace to build real-time data synchronization from the customer's existing Oracle database to the Oracle ADW business data platform.

The overall steps are as follows:

1. Deploy the goldgate microservice on ORACLE CLOUD MARKETPLACE

two。 Configure the source / destination database

3.Oracle GoldenGate micro-service configuration

4. Data synchronization testing: ORACLE12C to ADW

Deployment of GOLDENGATE micro service on ORACLE CLOUD MARKETPLACE

By using Oracle GoldenGate micro services on Oracle Cloud Marketplace, you can easily establish and manage real-time replication of data from local to cloud, local to local, and cloud to cloud.

1. From the Oracle Cloud Marketplace home page:

Https://cloudmarketplace.oracle.com/marketplace

two。 Use the search box under applications and search for the keyword GoldenGate.

3. After you find the list of Oracle GoldenGate microservices in Oracle Cloud Marketplace, you can deploy Oracle GoldenGate using the provided TerraForm Stack.

Select the version (19.1.0.0.1 default) Select the Compartment you want to deploy to, and click "Launch Stack".

4. Fill in the information required by Stack, including the name of Stack, and click next.

5. Fill in the following details. This information is required to build compute nodes using Oracle GoldenGate Microservices.

Display name-the display name used to identify all new OCI resources. Oracle GoldenGate

Host DNS name-the name of the domain name service for the new compute node.

Select the Compartment that needs to be deployed.

Select this check box if you want to create a new network resource.

We choose to use the available network resources

6. Select Compute Resources-the supported resources are VM.Standard2.4,VM.Standard2.8,VM.Standard2.16 and VM.Standard2.24. Choose VM.Standard2.4 this time

Assign Public IP-Select this check box to indicate whether the new VM should have a public IP address.

Deployment 1-name (required)-name of the first Oracle GoldenGate deployment. Source

Deployment 1-Database (required)-Oracle 12c

Deployment 2-name (optional)-name of the second Oracle GoldenGate deployment. Target

Deployment 2-Database (optional)-Oracle 18c

Paste SSH public key-allow SSH access to the public key as an opc user

7. On the confirmation page, review the information you provided, and then click create.

8. The name "OGG4ADW" Stack was created successfully

9. You can now view the Oracle GoldenGate Microservices compute node under the compute node Instances tab.

10. Get the Oracle GoldenGate administrator password

After you obtain the public IP address, you must obtain the password for the Oracle GoldenGate administrator account (oggadmin).

The Oracle GoldenGate administrator account (oggadmin) and password are saved in the ~ / ogg-credentials.json file.

Record the password.

Configure source-side database

1. Configure source or destination databases for replication-source-side databases

Source-side database configuration: open additional logs and configuration required for OGG in the source-side database.

two。 Source-side database:

Create OGG administrator c##ggadmin and test user SCOTT

3. Under test user SCOTT, create a test table EMP

SQL > show user

USER is "SCOTT"

SQL > CREATE TABLE EMP

(EMPNO NUMBER (4) NOT NULL

ENAME VARCHAR2 (10)

JOB VARCHAR2 (9)

MGR NUMBER (4)

HIREDATE DATE

SAL NUMBER (7,2)

COMM NUMBER (7,2)

DEPTNO NUMBER (2))

Table created.

SQL > ALTER TABLE EMP ADD CONSTRAINT PK_EMPNO PRIMARY KEY (EMPNO)

Table altered.

SQL > select count (1) from emp

COUNT (1)

-

0

Configure the target end-end database

1. Target database configuration (ADW):

SQL > alter user ggadmin identified by account unlock

User altered.

SQL > grant dwrole to ggadmin

Grant succeeded.

SQL > grant pdb_dba to ggadmin

Grant succeeded.

SQL > grant create session, resource, create view, create table to ggadmin

Grant succeeded.

SQL > select name,value from v$parameter where name='enable_goldengate_replication'

NAME VALUE

Enable_goldengate_replication TRUE

SQL > create user scott identified by

User created.

SQL > grant connect,resource,create table to scott

Grant succeeded.

SQL > grant pdb_dba to scott

Grant succeeded.

SQL > alter user scott quota unlimited on data

User altered.

two。 Create test user SCOTT and EMP tables on the target database:

SQL > show user

USER is "SCOTT"

SQL > CREATE TABLE EMP

2 (EMPNO NUMBER (4) NOT NULL

3 ENAME VARCHAR2 (10)

4 JOB VARCHAR2 (9)

5 MGR NUMBER (4)

6 HIREDATE DATE

7 SAL NUMBER (7, 2)

8 COMM NUMBER (7, 2)

9 DEPTNO NUMBER (2))

Table created.

SQL > desc emp

Name Null? Type

-

EMPNO NOT NULL NUMBER (4)

ENAME VARCHAR2 (10)

JOB VARCHAR2 (9)

MGR NUMBER (4)

HIREDATE DATE

SAL NUMBER (7 dint 2)

COMM NUMBER (7 dint 2)

DEPTNO NUMBER (2)

SQL > ALTER TABLE EMP ADD CONSTRAINT PK_EMPNO PRIMARY KEY (EMPNO)

Table altered.

SQL > select count (1) from emp

COUNT (1)

-

0

ORACLE GOLDENGATE MICROSERVICES changes the administrator password

1. Change the OGG default administrator OGGADMIN password

Changing the OGG default administrator password, such as oggadmin, is a top priority for protecting Oracle GoldenGate Microservices deployments. If you need to change the password for oggadmin, you must first change it in Service Manager and Administration Server.

Enter https:// in the browser to enter the OGG management page as follows:

Click "go to this page"

Enter the OGG administrative user name and the password saved in the ~ / ogg-credentials.json file

two。 After logging in to Service Manager, use the menu icon in the upper left corner to open the menu and select Administrator from the menu.

In the "oggadmin" editing options, update the password of the oggadmin user, and click submit.

3. From the Service Manager page, click "Overview" to return to the console

Select the port number of the Administration Server in the deployment box. This will navigate to the login page of the deployment.

Log in using the oggadmin user and password. You also need to update the oggadmin user's password on each deployed page.

Click on ports 9011 and 9021 of Administration Server, respectively

Update the oggadmin user's password on each deployed page in 4.9011 and 9021

Configure environment variables in the 5.Oracle GoldenGate Microservices compute node:

Click the Source below

6. The source database is 12cR2, so ORACLE_HOME is configured as / u01/app/client/oracle12

7. The target database is 18c, so ORACLE_HOME is configured as / u01/app/client/oracle18

Use ORACLE GOL

Create a database connection using ORACLE GOLDENGATE MICROSERVICES

Create a configuration source-side database connection

1. By clicking on the port number of Administration Server. 9011 this will navigate to the login page of the deployment

Open the context menu in the upper left corner of the Overview page, and from the context menu, select configure.

On the Database tab, click the plus (+) icon to add new credentials.

Since the source side is a 12c multi-tenant database, we create database credentials to connect to CDB and PDB respectively as follows:

two。 Click the test button to test the database connection as follows: CDB

Information such as Checkpoint will be displayed if the connection is successful

3. Click the test button to test the database connection as follows: PDB

Add SCHEMATRANDATA on the source side

4. After you add credentials to connect to the source database, you must enable transaction data logging on the source side.

Starting with Oracle Database version 12.1 and later, you must specify the PDB database using the schema.

That is. Pdb1.scott

Create a database connection on the configuration target side

1. By clicking on the port number of Administration Server. 9021 this will navigate to the login page of the deployment

Open the context menu in the upper left corner of the Overview page, and from the context menu, select configure.

On the Database tab, click the plus (+) icon to add new credentials.

The target end is the ADW18c database, so the credentials we created to the database are as follows:

two。 Click the test button to test the database connection as follows:

Information such as Checkpoint will be displayed if the connection is successful

Add a checkpoint table on the target side

3. Checkpoint tables are critical for monitoring checkpoints that have been applied to the target system. Regardless of the replication used, the best practice is to enable checkpoint tables for the target system.

In the Checkpoint option, click add

Configure the process using ORACLE GOLDENGATE MICROSERVICES

Currently, the Oracle autonomous data warehouse cloud only supports Replicat in non-integrated mode.

Integrated modes Replicat,parallel Replicat and coordindated Replicat are not supported.

Configure the capture process

You must set up the capture process before starting replication.

Oracle GoldenGate Microservices supports three modes of capture process.

Classic Extract-version after OGG18c is not recommended and synchronization to ADW/ATP is not supported

Integrated Extract

Initial Load Extract

Configure the EXTRACT process

1. Select the add Extract process from the source-side management console as follows:

two。 Select the Integrated Extract process and click "Next"

3. Enter information about the Extract process as follows:

Process name: ext

Database connection information: select a CDB connection (source) on the source side, and refer to the above section for creating a connection.

Trail file name: eg

4. Select the PDB1 you need to register and click "Next"

5. Next, fill in the process-related configuration information as follows: Table pdb1.scott.emp

Extract ext

Useridalias oggadmin_pdb domain sourcepdb

Exttrail eg

Table pdb1.scott.emp

Select to register the Extract process to the database on the console, and click "create and execute"

Beihai house price http://bh.goufang.com/

6. The Extract process can be seen on the console.

Configure the REPLICAT process

1. Click the management server port on the target side to enter the console and configure the Replicat process

two。 Click to add Replicat process

3. Select Nonintegrated Replicat

4. Enter the Replicat configuration information as follows: connect to target on the destination side, and select checkpoint table.

5. In the next step, enter the configuration information related to the process as follows:

MAP pdb1.scott.emp, TARGET MSHUTOQY95TFZPE_ADW.SCOTT.emp

Click "create and execute"

Replicat rep

Useridalias target domain target

MAP pdb1.scott.emp, TARGET MSHUTOQY95TFZPE_ADW.SCOTT.emp

6. The Replicat process can be seen on the console.

Data synchronization test: ORA

Data synchronization testing: ORACLE12C to ADW

Insert data on the source side

SQL > select count (1) from emp

COUNT (1)

-

0

SQL > INSERT INTO EMP VALUES (7369, 'SMITH',' CLERK', 7902

Sysdate, 800, NULL, 20)

1 row created.

SQL > INSERT INTO EMP VALUES

(7499, 'ALLEN',' SALESMAN', 7698

Sysdate, 1600, 300,30)

1 row created.

SQL > commit

Commit complete.

SQL > select count (1) from emp

COUNT (1)

-

two

Select detailed from the Extract process options

Check the synchronization information in the statistics bar. 2 pieces of data have been successfully captured.

Confirm that the data synchronization is successful on the destination side

SQL > select * from emp

EMPNO ENAME JOB MGR HIREDATE SAL COMM DEPTNO

--

7369 SMITH CLERK 7902 24-JUL-19 800 20

7499 ALLEN SALESMAN 7698 24-JUL-19 1600 300 30

By clicking on the process details on the target side, the statistics bar shows that two pieces of data have been inserted.

Test delete data from the source-side database

SQL > select count (1) from emp

COUNT (1)

-

two

SQL > delete emp

2 rows deleted.

SQL > commit

Commit complete.

By clicking on the details of the process on the source side, the statistics bar shows that the deletion has been captured

The destination side confirms that the data source has been deleted.

SQL > select * from emp

No rows selected

By clicking on the details of the process on the target side, the statistics bar shows that the deletion has been synchronized

Thank you for reading! On "how to use Oracle GoldenGate Marketplace to achieve rapid data synchronization ADW" this article is shared here, I hope the above content can be of some help to you, so that you can learn more knowledge, if you think the article is good, you can share it out for more people to see it!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.