Lakehouse Information Stack with Raj Bains

Initially revealed on April 12, 2022.

As firms transfer to Spark and a Lakehouse structure, they’re realizing that the information instruments are lagging means behind.  You might want to be a programmer to successfully use Spark and Airflow.

There are some low-code ETL instruments, however is that sufficient?  Corporations need to deal with their information pipelines like mission-critical apps.  They need DevOps for information, with GIT, check protection, and CI/CD.  As well as, firms want end-to-end visibility of their information pipelines, together with monitoring, metadata, and column-level lineage.

The place are the information instruments for these capabilities and the way do non-programmers use these?  

In at this time’s podcast, you’ll see how Prophecy’s low-code information engineering platform, constructed on Spark and Airflow, supplies an entire resolution for creating, deploying, and monitoring information pipelines.  We’ll converse with Raj Bains, who’s the founder & CEO of Prophecy.  

Raj has spent 20 years constructing highly effective instruments – Microsoft Visible Studio, founding engineer for CUDA at NVIDIA, product supervisor for Hive at Hortonworks. He’s keen about making all organizations productive with information and making the lives of knowledge engineers higher by decreasing toil and growing the enjoyment.

Additionally, should you like what you hear, Prophecy has a particular supply for our listeners.  Go to Prophecy.IO/request-a-demo and put in “SED” for the referral code.  When you resolve to buy inside 3 months of the demo, you get 10% off.  If you buy after 3 months, you continue to get 5% off.

Sponsorship inquiries:




Transcript supplied by We Edit Podcasts. Software program Engineering Every day listeners can go to to get 15% off the primary three months of audio enhancing and transcription companies with code: SED. Due to We Edit Podcasts for partnering with SE Every day. Please click on right here to view this present’s transcript.

Latest articles

Related articles

Leave a reply

Please enter your comment!
Please enter your name here