Data Engineering Road Map - How To Learn Data Engineering Quickly( By A FAANG Data Engineer)

bro I like to code , is data engineering for me ? because I have heard that DE mostly write sql when it comes to programming , and have they might some automation scripts for aws with python but that's not very often and is not a large part

Thank you for this video.
Is it important I get a laptop n which one should I get.
I'm just getting started today

Thank you very much!🙏

Would you reconmend data camp data engineer track

Great road map. What's your take on the Udacity Nanodegree program: How to Become a Data Engineer. Is worth having a look at for someone with no prior experience?

Can someone help me? I have doubts about which specialty to take in the data sector (engineer / scientist). I would appreciate any advice :)

Well detailed roadmap.
I have 10 years of experience in modeling using Ralph Kimball's techniques and ETL (Sagent, Oracle ODI), where I stopped (2012) completely and moved on to the commercial area, selling technology with spin selling techniques (ERPs, BI, low-code...). Today I want to go back to my initial area, which is now something part of Data Engineering.
Watching many of your videos, to understand how to get back to this area that I love so much (or once loved).

Thanks. I got thrown into a data engineering role because of a unfilled vacancy. I'm trying to skill up for the position. This was a real help.

Good information.... thanks a lot.

Thank you very much Ben, I learned that my ftp/tftp projects will serve for something,
Anyway, great video, keep up the good work insh'Allah

Very informative. I'm taking udacity's data engineering nanodegree and we're doing a similar roadmap. Good job!

Thank you

love this kinda videos, still relevant in 2023. i started a data science course but it wasn't really my jam and i tend to lean towards backend stuff anyways. <3

Amazing!. I am a Python software developer, so I have a background in making APIs and Unit Testing as well as some skills using Docker. But definitively I need to understand how to model Data Warehouses, and some cloud tools and play with Luigi or Airflow. I felt happy watching your video because I realized that I am on the correct path. I have a nice number of tools in my bag, but I have to keep working to get the other ones.
Thank you for this great video and excellent road map, mate.

Hello! Thank you for your invaluable video! I find it extremely useful for beginners! I would like to ask about one thing regarding this map. I learnt Pandas in terms of Data Wrangling and Transformation. Therefore, how about Pandas for Data Engineers? Is it useful tool for ETL/ELT transformations? Obviously, the next step will be PySpark, but I would like to start learninig Pandas. It seems it is a good path for the next one. What do you think about it ? I would appreciate it if you could share your views about it.

Awesome video man thanks!! Do you have a specialization in any of those skills/tools?

can you shave your face

Can you tell me more about the second project or any source where i can learn about it?

If you have a solid foundation in BASH and networking. You will feel like IT God and everything else will become ez

If you add some networking to the roadmap you'll have a roadmap to a backend software engineer :D

Hi, Thank you for this video. How much time do you think it would take to complete all the steps mentioned here ? I work in IT but have mostly worked as a consultant on the ETL tools like Informatica etc. I know about Data but Data Engineering is somewhat new to me.

Fantastically concise video, thank you.

Can a electrical engineer swift into data engineerinh

Thanks for sharing this with everyone, super helpful as I go through this career transition!

I need to know if I should pursue Software Engineer or Data Engineer. I lean more towards Data Engineer, but I hear that the fields under Data Science have a higher entry requirement. If it isn't a VERY significant difference in entry requirement than I would like to go for Data Engineer.

I know most of the "things" , but it just that nothing is in order. Let me bring it in order. THANX for detailed video.

Thanks @ Seattle. This is really explanatory and clear. Please i could'nt find the links for building the flask api or any of ther projects you listed.

Thank you

Excellent video. The hardest thing about working in IT has been that every time I make a move to further my career, I find I have to build my own road map. Problem is, it’s impossible to know what all exists because there is so much. And every person you ask will give you some different list of things you need to learn, with no real concept of how it all fits together. As the technology expands, the need for roadmaps becomes so much more important than in previous years.

I find it interesting that so many of these roadmaps focus so acutely on technical skills. Frankly, I’m not sure how valuable it is to learn AWS to ‘get into’ data engineering. You’ll learn this skill on the job when you get to it. Also this type of technology is highly dependent on what field you end up in. Lots of companies in the finance and insurance sector are nowhere near ramping up to AWS.

I think learning the concepts of data storage, ETL pipelines and data warehousing - as well as having a general ability to write code in, say, Python - ought to suffice as a starting point.

The hard part about technical roles like data engineering isn’t really writing the programs. The hard part is the softer skills involved and understanding the domain you’re working in.

What do you make of Meta’s new database engineer professional certificate? They claim you can complete the program in 130 hours and be job ready in 13 weeks.

Do you think getting a ccna is a waste of time if I'm trying to break in from help desk to data engineering?

Would you recommend the Udacity Data Engineering Nanodegree?

legend, thank you :)

I was working as a system administrator from 10 years but now learning Azure data engineer and applied few companies but all are asking relevant experience in data engineer what should I do to get experience?

Is it true that I must start w/ Front-end because companies seldom hire junior Back-end developers/ engineers.

Hello, thanks for the video. I want to get into IIOT space, Do you think I should focus more on streaming analytics or data warehousing

Great Roadmap!

hi ,Can You share the latest tech stack whenever you are a little bit free. And also if possible, please share links to all the resources. that would be of great help .
thanks.

Thanks for the roadmap! It helps me a lot. 🤧

Supposably?

Hey Ben! Thank you for the vide. It's crisp and comprehensive at the same time. You mentioned that you'll be sharing resources/links to learn/explore flask api. But, I can't find the link anywhere. Could you please pinpoint the link? Thank you again!

Excellent!

I don’t know excel that much but I know SQL quite well. Do you think I should learn excel now? Or do you think they are both meant to do the same thing and SQL is an advanced version of excel?

looks like it's extremely hard to become a data engineer. kudos to ur efforts tho ;

FAANG = Pay 2 years of training

Normal enterprises = Pay to work directly

what is store encrypted data into sftp and pull data from sftp? is not sftp just a transfer protocol? could you explain pls

Starting from near zero today!