Shulou(Shulou.com)06/01 Report--

This article shows you how to use ogg to transfer Oracle data to Flume to kafka memory settings, the content is concise and easy to understand, can definitely brighten your eyes, through the detailed introduction of this article, I hope you can get something.

The flume environment can start multiple processes and configure multiple services according to different requirements.

Memory parameters can modify the memory settings in the flume-env.sh script:

Export JAVA_OPTS= "- Xms128m-Xmx512m-Dcom.sun.management.jmxremote"

The general distribution is the same size as above.

An example of configuring memory size for the corresponding OGGpump transfer segment is as follows:

Javawriter.bootoptions=-Xmx2048m-Xms256m-XX:-UseGCOverheadLimit-Djava.class.path=/data/ogg_for_bigdata/ggjava/ggjava.jar-Dlog4j.configuration=/data/ogg_for_bigdata/cfg/log4j.properties

You can add the parameter-UseGCOverheadLimit to prevent OOM from appearing.

After setting up reasonable memory, the pump process of ogg can start normally.

After viewing by info:

File / data/ogg_for_bigdata/dirdat/ff014656

2019-03-22 14 5415 59.000996 RBA 126667880

Data is updated in real time.

View the stats process:

Hourly statistics since 2019-04-09 20:00:04 * *

Total inserts 589.00

Total updates 555.00

Total befores 555.00

Total deletes 0.00

Total discards 0.00

Total operations 1144.00

Process normal running

Memory parameter optimization is a way to adjust the process to suspend transaction commit failures, depending on the configuration environment.

The exception error is as follows:

Exception received committing transaction: com.goldengate.atg.util.GGException: Unable to commit transaction, STATUS=ABEND the above is the use of ogg to transfer Oracle data to flume to kafka memory settings, have you learned the knowledge or skills? If you want to learn more skills or enrich your knowledge reserve, you are welcome to follow the industry information channel.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.