How I'd Become A Data Engineer (If I had to start over as a data analyst in 2023)

What an awesome explanation! Very usefull, thanks!!

Amazing thank you Ben! How much time would it require to complete the switch in your opinion?

Does this even wortth it now in the pace of AI developing?

All good, but I am pretty bummed about how everyone exaggerates their pays or skills, I guess it is a part of marketing culture here.

So lucky to have found you. Doing my masters in data science after being a data analyst for about a year. Didn’t even start the vid I can tell this guy has real wisdom

Will it be considered a downgrade if one move from Data Engineering to Data Analytics?

What would you recommend for someone with no experience in Data Analytics

Some of the links don't work. Where can I find the Data Modeling resource? Thanks!

There is huge demand for data engineers to provide business metrics solutions to companies both large and small. If you are already working with data or databases the key is to propose, design and implement systems (whatever they may be) for your company. Technology will change so don't get overly concerned about the "perfect" application, the company cares about results. In terms of skills, I would start with SQL (become very efficient), know basic database design (including OLAP), data modeling, and very importantly become comfortable with the data itself as it pertains both to 1) company goals and 2) how that is stored in company databases. In other words, 1) pay attention to the business side in terms of what the business analysts want, so know your business; and 2) understand the data and table structure within company databases.
I'm near retirement (in October) and my company cannot find anybody with the skills to replace me. My path included first data, then coding, SQL coding, reporting, DB administration, DB development, data engineering (including streaming, pipelines, etc.) through analysis and mining. First, ensure the design (of warehouse/data lake, etc. and the intermediate steps) is as efficient as possible. Most companies have huge amounts of data to work with, a poor design will ultimately result in failure.
Finally, just do it! Unless you work in a company that has a very established data solution department, there will likely be nobody to give you a lot of guidance. If they're very good, they're likely very busy. You will make mistakes, but you will learn from them. And always try to do it faster, more efficiently, and more accurately. Provide solutions and solve the problem!

You should considered seriously to launch an online course related to the Modern Data Stack: Fivetran, DBT and Snowflake.

I have learned about SQL, Python, Spark and Azure Databricks , should I start applying for Data Engineering jobs right away ?

Have you checked out the data engineering zoomcamp and if so, is it worth the time? Seems pretty popular and results in a personal project with decent resources to pull from. Currently in a hybrid ETL and Support role where I am trying to work in the DW/DE and hoping I can get some more hands on experience.

Hi Ben,
You mentioned in the video that you linked the interview test prep? I don't think I see it in the drop down. Would be very interested in taking a look at it - if available? thanks!

So great 👍🏿

Can you please share link to interview prep?

I've just done the same thing. I've spent years being a solution designer / data analyst and I've just switched into data engineering as a senior technical specialist with no experience in actual hands on data engineering but I've got experience in designing data warehouses and ETL solutions.

Would you recommend taking a similar path, starting in Data analytics then transition to engineering?

Can you link the interview prep sheet?

How about mathematics? how much math should you know?

If this isnt proof that my phone is always listening. Last night my husband was telling me how he (manager of data analytics) is being moved under the programming department and being made data engineer. This popped up in my suggested today lol

Hey can you link the interview prep that contains SQL problems and videos

Hi where can I find the interview prep link?

amazing video man!!!

My English is not good because im learning bbut im gonna explain my situation 😅
I was hesitant to choose Data analytics or a front-end developer because before coming to the USA I worked as an accounting assistant and when I got here I dedicated working in a restaurant cooking. Three months ago I was just learning html and css on my own, it's giving a bit of difficulty js.
I heard other people that i would have chosen data analytics because it would be a good combination with my accounting degree that I did in my native country.. So now I am lost.. 😅
Any advice please 🙏

on my journey from DA to DE. Taking any opportunity to do ETL's, models, automatizations that I can find. Unfortunately, in my department our tech stack is so poor, that I realized that I'm never going to transit to DE internally and the DE work I'm doing not valued as much as of good DA or BA.

I transition from a cook to a Integration Developer 2 years ago and now I am taking a Master in Computer Science while working, hoping that 3 years from now to get into Data Engineering,

does his mean one has to start in another role before pivoting into data egineering?

Hey, I have gained some data engineering skills and have done end-to-end ELT. I am looking for some open-source projects to contribute to but to my shock I can't find any, could you suggest some maybe even well funded startups.

Which best for data engineering , Mac or Windows?

Amazing video. I’m still in my undergrad majoring in CS but I on following this exact path. It’s my dream job to be a freelance data engineer/analyst for small businesses.

I am having more skills & confidence in being a data engineer
While as a data analyst i am not confident enough
What should i do then?

Why would one want to stop being a data analyst... 🥺

😜jk

Bro what’s that tumbnail? 😂

Already onboarding to DE work at Amazon :) thanks for the inspiration!

Camera upgrade ? :D Finally ;-)

I just got hired as a Cx (Customer Experience) Quality Analyst as my first job. With this video, you helped me a lot on how to start my path toward a Data Engineer role, thanks.

Love this video! Could you make one for SE -> DE?

I'm taking the IBM Data Engineering certificate. I'm blowing through the intro courses because I already have those skills down. It's the warehousing, Spark, and so on that I'm taking that course for.

I've pivoted to a full-stack developer route which can also easily translate into a data engineer role at the 3-5 year career point.

Trying to head there at the moment