Shulou(Shulou.com)06/01 Report--

You need to install npm tools first. For more information, please see:

Https://www.runoob.com/nodejs/nodejs-npm.html

Start installing elasticdump:

# npm install elasticdump-g

/ usr/bin/elasticdump-> / usr/lib/node_modules/elasticdump/bin/elasticdump

/ usr/bin/multielasticdump-> / usr/lib/node_modules/elasticdump/bin/multielasticdump

/ usr/lib

└─┬ elasticdump@3.3.19

├── async@2.6.1

├─┬ aws-sdk@2.303.0

│ ├─┬ buffer@4.9.1

│ │ ├── base64-js@1.3.0

│ │ └── isarray@1.0.0

│ ├── events@1.1.1

│ ├── ieee754@1.1.8

│ ├── jmespath@0.15.0

│ ├── querystring@0.2.0

│ ├── sax@1.2.1

│ ├─┬ url@0.10.3

│ │ └── punycode@1.3.2

│ ├── uuid@3.1.0

│ └─┬ xml2js@0.4.19

│ └── xmlbuilder@9.0.7

├── aws4@1.8.0

├── decimal.js@10.0.1

├── ini@1.3.5

├─┬ JSONStream@1.3.4

│ ├── jsonparse@1.3.1

│ └── through@2.3.8

├── lodash@4.17.10

├── lossless-json@1.0.3

├─┬ optimist@0.6.1

│ ├── minimist@0.0.10

│ └── wordwrap@0.0.3

└─┬ request@2.88.0

├── aws-sign2@0.7.0

├── caseless@0.12.0

├─┬ combined-stream@1.0.6

│ └── delayed-stream@1.0.0

├── extend@3.0.2

├── forever-agent@0.6.1

├─┬ form-data@2.3.2

│ └── asynckit@0.4.0

├─┬ har-validator@5.1.0

│ ├─┬ ajv@5.5.2

│ │ ├── co@4.6.0

│ │ ├── fast-deep-equal@1.1.0

│ │ ├── fast-json-stable-stringify@2.0.0

│ │ └── json-schema-traverse@0.3.1

│ └── har-schema@2.0.0

├─┬ http-signature@1.2.0

│ ├── assert-plus@1.0.0

│ ├─┬ jsprim@1.4.1

│ │ ├── extsprintf@1.3.0

│ │ ├── json-schema@0.2.3

│ │ └─┬ verror@1.10.0

│ │ └── core-util-is@1.0.2

│ └─┬ sshpk@1.14.2

│ ├── asn1@0.2.4

│ ├── bcrypt-pbkdf@1.0.2

│ ├── dashdash@1.14.1

│ ├── ecc-jsbn@0.1.2

│ ├── getpass@0.1.7

│ ├── jsbn@0.1.1

│ ├── safer-buffer@2.1.2

│ └── tweetnacl@0.14.5

├── is-typedarray@1.0.0

├── isstream@0.1.2

├── json-stringify-safe@5.0.1

├─┬ mime-types@2.1.20

│ └── mime-db@1.36.0

├── oauth-sign@0.9.0

├── performance-now@2.1.0

├── qs@6.5.2

├── safe-buffer@5.1.2

├─┬ tough-cookie@2.4.3

│ ├── psl@1.1.29

│ └── punycode@1.4.1

├── tunnel-agent@0.6.0

└── uuid@3.3.2

Example of a method for exporting es data:

# elasticdump-input= http://192.168.0.1:9200/test-output=/data/elas_backup/test.json-type=data

Tue, 28 Aug 2018 09:15:54 GMT | starting dump

Tue, 28 Aug 2018 09:15:55 GMT | got 2018 objects from source elasticsearch (offset: 0)

Tue, 28 Aug 2018 09:15:55 GMT | sent 2018 objects to destination file, wrote 100

Tue, 28 Aug 2018 09:15:55 GMT | got 2018 objects from source elasticsearch (offset: 100)

Tue, 28 Aug 2018 09:15:55 GMT | sent 2018 objects to destination file, wrote 100

Tue, 28 Aug 2018 09:15:55 GMT | got 2018 objects from source elasticsearch (offset: 200)

Tue, 28 Aug 2018 09:15:55 GMT | sent 2018 objects to destination file, wrote 100

. ...

. ...

. ...

. ...

. ...

. ...

. ...

Example of how to import es data:

# elasticdump-input=/data/elas_backup/test.json-output= http://192.168.0.1:9200-type=data

Tue, 28 Aug 2018 09:15:54 GMT | starting dump

Tue, 28 Aug 2018 09:15:55 GMT | got 2018 objects from source elasticsearch (offset: 0)

Tue, 28 Aug 2018 09:15:55 GMT | sent 2018 objects to destination file, wrote 100

. ...

. ...

. ...

. ...

. ...

. ...

Migrate data from one index to another:

# elasticdump-ignore-errors=true-scrollTime=120m-bulk=true-input= http://192.168.0.1:9200/test-output= http://192.168.0.1:9200/chenfeng-type=data

Remarks:

-- ignore-errors=true-- scrollTime=120m-- bulk=true is a batch import parameter

Export the table structure mapping:

# elasticdump-input= http://192.168.0.1:9200/test-output=test-mapping.json-type=mapping

Wed, 29 Aug 2018 09:01:41 GMT | starting dump

Wed, 29 Aug 2018 09:01:42 GMT | got 1 objects from source elasticsearch (offset: 0)

Wed, 29 Aug 2018 09:01:42 GMT | sent 1 objects to destination file, wrote 1

Wed, 29 Aug 2018 09:01:42 GMT | got 0 objects from source elasticsearch (offset: 1)

Wed, 29 Aug 2018 09:01:42 GMT | Total Writes: 1

Wed, 29 Aug 2018 09:01:42 GMT | dump complete

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.