Introduction Have you ever been bothered by how long it can take for your data to deliver value to your business? Thanks to Databricks’ new product: Databricks Apps, you can create working application on top of the data that already exists on your Lakehouse platform. On top of that, no more worrying about setting up […]
Tag: aivix
Top insights from the Databricks Data + AI Summit 2026
Every year in June, the focus of the Data & AI world switches to San Francisco, where Databricks holds its yearly Data & AI Summit. A packed three days full of new product announcements, customer success stories and interesting talks. Here are our main takeaways from the keynote on the first day. This year the […]
Unlocking the power of AutoML in Databricks: simplifying machine learning workflows
In today’s data-driven world, organizations are constantly seeking ways to extract insights and value from their data. Machine learning (ML) has emerged as a powerful tool to unlock these insights and drive business decisions. However, building and deploying ML models can be a complex and time-consuming process, often requiring expertise in data science and programming. […]
Visualization of real time data using Databricks and Grafana
In today’s fast-paced digital world, the ability to monitor and analyze data in (near) real-time has become essential for businesses across industries. Whether it’s tracking user activity on a website, monitoring sensor data in IoT devices, or analyzing financial transactions, having access to timely insights can make all the difference in driving informed decision-making and […]
Top insights from the Databricks summit 2024
The annual Databricks Summit took place in San Francisco this year, spanning from June 10 to June 13. This event is the ideal place to get all the latest new releases, announcements, and exciting features about topics like Databricks, Delta Lake, Spark, and others. There were 10 different tracks, including “Data engineering and streaming”, “Data […]
Databricks as a unified platform for Generative AI Development
Databricks is a pioneer in AI innovations for over a decade now and with the rise of Generative AI, it will take a new step in AI innovation. Leveraging a variety of applications and tools inside the Data Intelligence Platform, Databricks empowers to develop and deploy AI models with speed, reliability and full governance all […]
Geospatial data: finding pubs along cycling routes
Part 1: Geospatial fundamentals “Data is everywhere”, a tagline you will often hear or read, especially when people are talking about big data. And it is definitely true, it is estimated that a mind-blowing 120 zettabytes of data has been created in 2023. A zettabytes, that is a byte with 21 zeros. However, the sentence […]
Redefining Data Lakes: Is AWS Lake Formation the Answer to Past Troubles?
Over the past years the term ‘data lake’ has dominated many conversations about data and rightfully so. Whether it is used as a buzzword or not, whether you are a data engineer, or your business handles loads of data, your way of ‘storing’ the data is probably what is called a data lake. But what […]
Streamlining data warehousing: Harnessing the power of Amazon Redshift with dbt integration
Nowadays, data engineers and scientists cannot keep up with all the ETL-tools popping up like mushrooms from the ground. Imagine a tool, not strictly an ETL tool, taking center stage in data transformation? With your data already extracted and loaded (the E and L in ETL) into your data warehouse, dbt excels in transforming the […]
What orchestrator to use for your ETL jobs?
In today’s data-driven world, organizations are facing the ever-increasing complexity of data pipelines. The need to handle diverse data formats, sizes, sources and processing requirements can result in the need of different types of transformations blocks, ranging from SQL to PySpark to low/no-code solutions. When complex table dependencies also enter the picture, you get high, […]
