Network Security Internet Technology Development Database Servers Mobile Phone Android Software Apple Software Computer Software News IT Information

In addition to Weibo, there is also WeChat

Please pay attention

WeChat public account

Shulou

Cloudera5.2 installation process of MySQL Database and my.cnf configuration

2025-01-19 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Servers >

Share

Shulou(Shulou.com)06/01 Report--

This article mainly explains "the process of Cloudera5.2 installation MySQL Database and my.cnf configuration", interested friends may wish to take a look. The method introduced in this paper is simple, fast and practical. Let's let the editor take you to learn "the process of Cloudera5.2 installation MySQL Database and my.cnf configuration".

[mysqld] transaction-isolation = READ-COMMITTED# Disabling symbolic-links is recommended to prevent assorted security risks;# to do so, uncomment this line:# symbolic-links = 0key_buffer = 16Mkey_buffer_size = 32Mmax_allowed_packet = 32Mthread_stack = 256Kthread_cache_size = 64query_cache_limit = 8Mquery_cache_size = 64Mquery_cache_type = 1max_connections = 550#log_bin should be on a disk with enough free space. Replace'/ var/lib/mysql/mysql_binary_log' with an appropriate path for your system.#log_bin=/var/lib/mysql/mysql_binary_log#expire_logs_days = 10#max_binlog_size = 100M# For MySQL version 5.1.8 or later. Comment out binlog_format for older versions.binlog_format = mixedread_buffer_size = 2Mread_rnd_buffer_size = 16Msort_buffer_size = 8Mjoin_buffer_size = 8M# InnoDB settingsinnodb_file_per_table = 1innodb_flush_log_at_trx_commit = 2innodb_log_buffer_size = 64Minnodb_buffer_pool_size = 4Ginnodb_thread_concurrency = 8innodb_flush_method = O_DIRECTinnodb_log_file_size = 512m [mysqld _ safe] log-error=/var/log/mysqld.logpid-file=/var/run/mysqld/mysqld.pid

Http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cm_ig_mysql.html#cmig_topic_5_5

The full text is as follows:

Move old InnoDB log files / var/lib/mysql/ib_logfile0 and / var/lib/mysql/ib_logfile1 out of / var/lib/mysql/ to a backup location.

Determine the location of the option file, my.cnf.

Update my.cnf so that it conforms to the following requirements:Here is a typical option file:

Small clusters (fewer than 50 hosts)-You can store more than one database (for example, both the Activity Monitor and Service Monitor) on the same host. If you do this, you should:

Large clusters (more than 50 hosts)-Do not store more than one database on the same host. Use a separate host for each database/host pair. The hosts need not be reserved exclusively for databases, but each database should be on a separate host.

Put each database on its own storage volume.

Allow 100 maximum connections for each database and then add 50 extra connections. For example, for two databases, set the maximum connections to 250. If you store five databases on one host (the databases for Cloudera Manager Server, Activity Monitor, Reports Manager, Cloudera Navigator, and Hive Metastore), set the maximum connections to 5505.

To prevent deadlocks, set the isolation level to read committed.

Configure the InnoDB engine. Cloudera Manager will not start if its tables are configured with the MyISAM engine. Typically, tables revert to MyISAM if the InnoDB engine is misconfigured. To check which engine your tables are using, run the following command from the MySQL shell:

Mysql > show table status

The default settings in the MySQL installations in most distributions use conservative buffer sizes and memory usage. Cloudera Management Service roles need high write throughput because they might insert many records in the database. Cloudera recommends that you set the innodb_flush_method property to O_DIRECT.

Set the max_connections property according to the size of your cluster:

Binary logging is not a requirement for Cloudera Manager installations. Binary logging provides benefits such as MySQL replication or point-in-time incremental recovery after database restore. Examples of this configuration follow. For more information, see The Binary Log.

At this point, I believe you have a deeper understanding of "the process of installing MySQL Database and my.cnf configuration in Cloudera5.2". You might as well do it in practice. Here is the website, more related content can enter the relevant channels to inquire, follow us, continue to learn!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.

Views: 0

*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.

Share To

Servers

Wechat

© 2024 shulou.com SLNews company. All rights reserved.

12
Report