Every year in June, the focus of the Data & AI world switches to San Francisco, where Databricks holds its yearly Data & AI Summit. A packed three days full of new product announcements, customer success stories and interesting talks. Here are our main takeaways from the keynote on the first day. This year the […]
Tag: ETL
Streamlining data warehousing: Harnessing the power of Amazon Redshift with dbt integration
Nowadays, data engineers and scientists cannot keep up with all the ETL-tools popping up like mushrooms from the ground. Imagine a tool, not strictly an ETL tool, taking center stage in data transformation? With your data already extracted and loaded (the E and L in ETL) into your data warehouse, dbt excels in transforming the […]
What orchestrator to use for your ETL jobs?
In today’s data-driven world, organizations are facing the ever-increasing complexity of data pipelines. The need to handle diverse data formats, sizes, sources and processing requirements can result in the need of different types of transformations blocks, ranging from SQL to PySpark to low/no-code solutions. When complex table dependencies also enter the picture, you get high, […]
Composite Models
Imagine having your Data Model ready and everyone loves it.Then you get this question all of a sudden. “I have made this excel file and I would like to use and combine it with the Sales Dataset in PowerBI.” The next thing you do is analyze the request and for some reason, maybe you don’t […]
