Any developer who has ever been tasked with consolidating data sources before performing analysis knows the challenge of silos, especially when data is sprawled out across multiple third-party services. But what about if you had to help a client pull application data from 47 different MySQL databases and then consolidate it into an operational data store (ODS) for analysis?
That’s how the partnership began between Charlie Killian (@cekillian) and Sarah Maston. As a solution architect at Bytecode IO – the company he founded – Killian encounters these data movement challenges all the time, but in this case, he reached out to Maston to draw on her career-long data warehousing experience.
In Episode 7 of The New Builders, Killian and Maston break down how they deployed a cloud-based data warehouse to solve the data silo challenge (3:14), how plug-and-play data movement tools enabled them to reduce an ODS project timeline from three months to three hours (8:03), how data warehousing differs at enterprises vs. startups (22:19), and why “learning the data” is the best step any developer can take, even if they aren’t directly involved in data warehousing (29:22).
You can find new episodes of The New Builders on iTunes, SoundCloud and developerWorks TV. Find out more about IBM Cloud Data Services at IBM.biz/forbuilders. Contact hosts Doug Flora and Jim Young on Twitter (@DSFlora, @JW_Young) or email (firstname.lastname@example.org, email@example.com).
The show’s music is provided by School for Robots. Check them out at schoolforrobots.bandcamp.com!
[Free eBook]: A Field Guide to the World of Modern Data Stores
Navigating today’s cloud databases and analytics options can be challenging. But it doesn’t have to be intimidating. Start (or level-set) your journey today with A Field Guide to the World of Modern Data Stores – read this FREE eBook to learn:
- What are the defining characteristics and strengths of today’s different cloud databases?
- How can data in NoSQL stores be analyzed to learn more about your customers?
- How are different open source databases used together to achieve polyglot persistence?
Get A Field Guide to the World of Modern Data Stores from IBM Cloud Data Services.