Jasper Alblas
Jasper Alblas
Data Engineering • Analytics • Business Intelligence
If you’re new to data engineering, it’s tempting to jump straight into learning Python or SQL. In fact, that’s exactly what most beginners do.
The problem is that without understanding how the data world fits together, the tools quickly become confusing.
This Data Engineering for Beginners series is designed differently.
Instead of learning isolated technologies, you’ll first learn why they exist and where they fit before building a complete end-to-end data engineering project from scratch.
| Part | Topic |
|---|---|
| Part 1 | How the Data World Works (this article) |
| Part 2 | Data Careers Explained |
| Part 3 | Is Data Engineering Right for You? |
| Part 4 | Git & Version Control |
| Part 5 | Setting Up Your Development Environment |
| Part 6 | The Modern Data Stack |
| Part 7+ | Build the complete ShopFlow Analytics project |
In the previous article, we looked at how the data world works.
You learned that data usually moves through a lifecycle:
Source Systems
↓
Ingestion
↓
Storage
↓
Transformation
↓
Modeling
↓
Serving
↓
Consumption
That lifecycle explains why data platforms exist. But it also raises another important question: Who works on each part of that lifecycle? If you are new to data, the job titles can be confusing.
Sometimes the titles sound similar. Sometimes companies use them differently. Sometimes two people with the same job title do completely different work depending on the organisation.
This article cuts through that confusion.
By the end, you will understand:
This article is not about choosing one path yet. That comes in the next article. For now, the goal is simple:
Understand the landscape.
Most data work exists to move information from raw source systems to useful business decisions. Different roles focus on different parts of that journey.
A simplified version looks like this:
Source Systems
↓
Data Engineer – Builds the pipelines and platform
↓
Analytics Engineer – Transforms and models trusted data
↓
BI Developer – Builds semantic models and dashboards
↓
Data Analyst – Answers business questions
↓
Business Decision
Data Scientists may also use the same data to build models, forecasts, predictions, or experiments. They build predictive and statistical models.
Anyway, these roles overlap. In a small company, one person might do several of them. In a large company, each role may be a separate team. The important thing is not memorising titles. The important thing is understanding the type of work each role is responsible for.
In this article, we will focus on five common roles:
There are other roles too, such as Data Architect, Machine Learning Engineer, Database Administrator, and Analytics Manager.
But if you understand these five, you will understand most of the modern data career landscape.
A Data Engineer builds the systems that move, store, and prepare data.
If data is created in one system and needs to be available somewhere else, a Data Engineer is often involved. Data Engineers work on the foundation of the data platform.
They make sure data is:
A simple way to describe the role:
Data Engineers build the infrastructure that makes data usable for the other roles.
A Data Engineer might:
A typical task might be:
“We need customer, order, and payment data available every morning in the warehouse so analysts can build reports.”
The Data Engineer would design and build the process that makes that happen.
Data Engineers usually work here:
Source Systems
↓
Ingestion ← Data Engineer
↓
Storage ← Data Engineer
↓
Transformation ← Data Engineer / Analytics Engineer
↓
Modeling
↓
Serving
↓
Consumption
Their work often happens before most business users ever see the data. If the pipelines fail, dashboards break. If the data is incomplete, analysis becomes unreliable.
Data Engineering is often invisible when it works and very visible when it does not. This can sometimes be difficult, as you might not get much recognition when you are doing a great job.
Data Engineers often use:
You do not need to know all of these as a beginner. But SQL, Python, and Git are usually the best starting points.
You may enjoy Data Engineering if you like:
You may enjoy it less if you mainly want to:
Data Engineering is a technical role. It is also highly practical. The work is about making data available, trustworthy, and usable.
Analytics Engineering is a newer role that sits between Data Engineering and Data Analysis. An Analytics Engineer usually works after raw data has been loaded into a warehouse. Their job is to turn raw or semi-clean data into trusted, business-friendly models.
A simple way to describe the role:
Analytics Engineers turn raw warehouse data into clean analytical datasets.
An Analytics Engineer might:
A typical task might be:
“Different reports calculate revenue differently. We need one trusted revenue model that everyone can use.”
The Analytics Engineer would create a clean model where revenue is defined consistently.
Analytics Engineers usually work here:
Source Systems
↓
Ingestion
↓
Storage
↓
Transformation ← Analytics Engineer
↓
Modeling ← Analytics Engineer
↓
Serving ← Analytics Engineer / BI Developer
↓
Consumption
They are especially important in companies using a modern data stack. Data Engineers may focus on getting data into the warehouse. Analytics Engineers focus on making that data usable for analysis.
Analytics Engineers often use:
The role is usually more SQL-heavy than Python-heavy.
If you enjoy structured thinking, clean SQL, and business logic, Analytics Engineering can be a very good fit.
You may enjoy Analytics Engineering if you like:
You may enjoy it less if you want to focus mostly on:
Analytics Engineering is a strong option for people who enjoy both technical work and business context.
A BI Developer builds reporting and analytical solutions. BI stands for Business Intelligence. BI Developers often work close to the serving and consumption layers of the data lifecycle. Their job is to make data understandable and useful for business users.
A simple way to describe the role:
BI Developers turn data models into dashboards, semantic models, and reports.
A BI Developer might:
A typical task might be:
“The sales team needs a dashboard showing revenue, margin, customers, and product performance.”
The BI Developer would build the model and report that make those numbers accessible.
BI Developers usually work here:
Source Systems
↓
Ingestion
↓
Storage
↓
Transformation
↓
Modeling ← BI Developer / Analytics Engineer
↓
Serving ← BI Developer
↓
Consumption ← BI Developer / Analyst
In some organisations, BI Developers also do data modelling in the warehouse. In others, they mainly work inside tools like Power BI, Tableau, or Looker.
BI Developers often use:
In Microsoft-focused organisations, Power BI and DAX are especially important.
You may enjoy BI Development if you like:
You may enjoy it less if you want to focus mostly on:
BI Development is a great path if you enjoy both technical modelling and business-facing work.
A Data Analyst uses data to answer business questions. Analysts are usually closer to stakeholders than Data Engineers are. They help the business understand what happened, why it happened, and what action might be needed.
A simple way to describe the role:
Data Analysts turn data into answers.
A Data Analyst might:
A typical task might be:
“Revenue dropped last month. Can you find out why?”
The analyst would examine the data, identify possible causes, and communicate the findings.
Data Analysts usually work here:
Source Systems
↓
Ingestion
↓
Storage
↓
Transformation
↓
Modeling
↓
Serving
↓
Consumption ← Data Analyst
Analysts mostly consume prepared data.
But in many companies, analysts also clean data, write SQL transformations, build dashboards, and define metrics.
This is why Data Analyst roles can vary a lot.
Data Analysts often use:
While SQL is the most important technical skill for most analysts, communication is just as important.
An analyst who finds the right answer but cannot explain it clearly will struggle to create impact.
You may enjoy Data Analysis if you like:
You may enjoy it less if you prefer:
Data Analysis is often the most accessible entry point into data.
It is also a strong foundation for moving later into BI, Analytics Engineering, or Data Engineering.
A Data Scientist uses statistics, experimentation, and machine learning to solve problems with data. Where analysts often focus on understanding what happened, data scientists often focus on predicting what might happen next.
A simple way to describe the role:
Data Scientists use data to build models, predictions, and experiments.
A Data Scientist might:
A typical task might be:
“Can we predict which customers are likely to churn?”
The Data Scientist would explore historical customer data, build a model, evaluate accuracy, and help turn the result into a business process.
Data Scientists usually work here:
Source Systems
↓
Ingestion
↓
Storage
↓
Transformation
↓
Modeling
↓
Serving
↓
Consumption / ML Use Cases ← Data Scientist
Data Scientists depend heavily on good data engineering.
Without clean, reliable data, machine learning models are unreliable.
This is one reason Data Engineering has become even more important as AI adoption grows.
Data Scientists often use:
Data Science usually requires stronger statistics and mathematics than the other roles.
It can also be more competitive at junior level because many people are attracted to the title.
You may enjoy Data Science if you like:
You may enjoy it less if you mainly want:
Data Science can be very rewarding, but it is not always the best first role for beginners.
Many people are better served by starting in analysis, BI, analytics engineering, or data engineering first.
Let’s return to the online shop example from the previous article.
A customer buys a bicycle. That transaction creates data in the webshop database. Different roles may interact with that data at different stages.
Customer Purchase
↓
Application Database
↓
Data Engineer
Builds pipeline into warehouse
↓
Analytics Engineer
Creates clean sales model
↓
BI Developer
Builds Power BI semantic model and dashboard
↓
Data Analyst
Investigates sales trends
↓
Business Team – Makes decisions
A Data Scientist might also use the same data to build:
The same source data can support many different use cases.
That is why good data foundations matter.
Here is a simple comparison of the roles.
| Role | Main Focus | Closest To |
|---|---|---|
| Data Engineer | Pipelines, storage, infrastructure | Systems |
| Analytics Engineer | SQL models, transformations, metrics | Data models |
| BI Developer | Dashboards, semantic models, reporting | Business reporting |
| Data Analyst | Questions, insights, recommendations | Business decisions |
| Data Scientist | Models, predictions, experiments | Statistics and ML |
Another way to think about it:
Data Engineer:
Can we get the data reliably?
Analytics Engineer:
Can we make the data clean and consistent?
BI Developer:
Can we make the data easy to explore?
Data Analyst:
What does the data tell us?
Data Scientist:
Can the data help us predict or optimise something?
Vis flere linjer
Different roles require different skill combinations.
Most important skills:
Most important skills:
Most important skills:
Most important skills:
Most important skills:
If you are starting from zero, learn SQL first. SQL appears in almost every data role.
No matter which path you choose later, SQL will help. Python is also very valuable, especially for Data Engineering and Data Science. But SQL is the most universal starting point.
In real companies, job titles are messy.
This does not mean the titles are useless.
It means you should pay attention to the actual responsibilities, not only the job title.
When reading job descriptions, look for the work being described:
The responsibilities tell you more than the title.
There is no single answer. It depends on your background and interests. But here is a practical starting point:
If you enjoy business questions start with:
Data Analyst
This is often the most accessible entry point.
If you enjoy dashboards and data models Start with:
BI Developer
This is a strong path if you enjoy Power BI, reporting, and business logic.
If you enjoy SQL and clean modelling consider:
Analytics Engineer
This is a good fit if you like structured transformation work.
If you enjoy coding and systems
Consider:
Data Engineer
This is a strong technical path with good long-term demand.
If you enjoy statistics and machine learning
Consider:
Data Scientist
This path can be rewarding, but it often requires stronger mathematical preparation.
This series is focused mainly on Data Engineering and Analytics Engineering. But it will also touch BI Development, because the final output will be a Power BI dashboard.
The hands-on project later in the series will follow this flow:
Raw Data
↓
Python Ingestion
↓
Staging Area
↓
SQL Transformations
↓
Dimensional Model
↓
Power BI Dashboard
That means you will practise skills from several roles:
This is intentional. A good beginner project should show how the roles connect. Even if you later specialise, understanding the full flow makes you better at your job.
Many beginners assume Data Scientist is the most advanced or best data role. That is not true. Data Scientist is simply a different role. A senior Data Engineer, Analytics Engineer, or BI Developer can be just as valuable and well-paid.
Choose based on the type of work you enjoy, not the title that sounds most impressive.
Data Analysts need technical skills.
SQL is especially important.
Many analysts also use Power BI, Excel, statistics, and sometimes Python.
The difference is that analysts usually apply technical skills to business questions rather than infrastructure problems.
Moving data is part of the job.
But good Data Engineers also think about:
The role is not just about copying data from A to B.
It is about building trustworthy data systems.
Good BI work is much deeper than visual design.
BI Developers often work with:
A beautiful dashboard with incorrect numbers is useless.
They are not. The same title can mean different things at different companies. Always read the responsibilities. The job description matters more than the job title.
If you are new to data careers, remember these ideas:
Now that you understand the main data roles, the next article narrows the focus.
We will look specifically at Data Engineering.
You will learn:
The purpose of the next article is to help you decide whether you want to continue into the hands-on Data Engineering path that begins later in the series.
First, understand the world. Then, understand the roles. Next, decide whether Data Engineering is your path.
Next up → 1.3: Who Does What? Roles & Teams in Data — a deeper look at every data role, how teams are structured, and how to pick the right path for you.
[…] up → 1.2: How the Data World Works— the mental model that every tool, concept, and technique in this series plugs […]