We want to bulk load our elasticsearch cluster

Fixed budget:50 USD

Task: We want to bulk load our elasticsearch cluster:(ONLY DOCUMENTATION)

> SNS topic

> Kinesis Firehose

> Maybe event bridge

1.) We will need to transform the message before loaded into elasticsearch

2.) We have over 30 million records we want fast bulk load FIFO.

3.) We want to publish a bulk amound to the SNS topic, but we dont not want multiple copies of the same records sent.

4.) We want to predict how long to complete all 30 million records

5.) We also want to keep using the process for regular updating of elastic search.

the goal is really two things:

1.) How do we bulk load elastic search from 30million rows in the aurora database?

2.) After the bulk load is complete, we want to keep the same process if possible - to maintain data in elastic search to remain a MIRROR of aurora database

Taidot: Elasticsearch, Python, MySQL, Aws Lambda

Näytä lisää: fixed budget, load balenced cluster lvs, virtuemart bulk load, wordpress bulk load post, wordpress bulk load, oscommerce bulk load inventory, sql server bulk load, sql bulk load excel spreadsheet, sql wxcel bulk load, sql server bulk load excel, microsoft sql bulk load excel, bulk load asp, bulk load excel, asp excel bulk load example, sql bulk load html, sql bulk load excel, bulk load excel source

Tietoa työnantajasta:
( 0 arvostelua ) Barishal, Bangladesh

Projektin tunnus: #30220805

3 freelanceria on tarjonnut keskimäärin $147 tähän työhön


I am elasticsearch certified engineer , I have working in many projects in which I have used elasticsearch, logstash , kibana and beats . Looking forward to connect with you

$189 USD 3 päivässä
(2 arvostelua)

Hello Just to introduce my self ,We have more than 8+ years of experience in design & development. And as a policy we will provide 3 month maintenance "free of cost" for the project done by us. Now coming on this pr Lisää

$140 USD 7 päivässä
(0 arvostelua)

Hello, I have 5 years of experience with Elasticsearch and have many projects with bulk load of data from SQL databases like MySQL or PostgreSQL as regular task for mirror operation. I can help you with your project.

$111 USD 2 päivässä
(0 arvostelua)