Blog

Safe Migrations with Redshift

A year ago, many business intelligence questions at Simple could only be answered via direct access to production databases. Aside from the difficulty that presented from a security and access standpoint, the inability to aggregate information from disparate data sources tied our hands in terms of the depth of insights we could achieve.

he need for a data warehouse was clear. We chose Redshift as our warehouse for ease of use, scalability, and cost. It also integrates well with our existing platform, which runs largely on AWS.

We have built our pipelines to Redshift such that updates are pushed in real time rather than pulled nightly as in a traditional ETL (extract, transform, load) process. As such, our warehouse is never static and Redshift’s documented approaches to deep copies needed some customization. In order to retain updates while recreating tables, we had to dive deep into the documentation, do some experimentation, and finally make some compromises in terms of warehouse availability.

.

Read 1404383 times
Rate this item
(1 Vote)
Super User

Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliq Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi.

Website: www.jooomshaper.com

59260 comments

Leave a comment

Make sure you enter the (*) required information where indicated. HTML code is not allowed.

Get Social

Contact us

Top Plaza,1st Floor–Room 1-11,

Kindaruma Road – Off Ngong Rd.

P O Box 41346–00100,

Nairobi-Kenya

Email:This email address is being protected from spambots. You need JavaScript enabled to view it.,

This email address is being protected from spambots. You need JavaScript enabled to view it.

Tel:(+254) 2729326,(+254) 2716922