I appreciate this video so much. This is the real "day in the life" video that I'm looking for. These other videos are mostly always showed in a glorified manner. I don't care what you had for lunch, tell me what you do at work as said profession. Thanks again!
Thank you for this video, I've been working as a data engineer intern for 6 months now and this video shows everything I'm seeing in my job
Mic so big they call it Michael
I'm in a small shop where I started doing Analyst work (i.e. writing queries, preparing reports for dashboard uploads, troubleshooting alignment between the frontend to the backend) and now I'm learning more about the data engineering aspect of how to manage the pipeline. The biggest problem for me is understanding the legacy code (which is honestly great learning). But I constantly feel like there's a better way, I just don't have the knowledge of how to do it yet. And like other creators have mentioned - there's just so many tools out there now.
Overall, very easy to understand explanation video. Good job. Currently I work as a engineering specialist and my role combines data engineering and data analyst. I feel it's best if you can have some understanding from a data engineering perspective it will help you out tremendously when it comes to analyzing said data.
Although building pipelines is more of a challenge, I am really enjoying azure synapse analytics (serverless sql) for data engineering. Essentially, there is just a data store (with documents) and a data warehouse definition. Data visualization tools just tap the data warehouse definition and an engine serves the relevant transformed data from the (virtual?) warehouse. It feels much cleaner than other approaches I have worked with. I could see this being where things are going: businesses have large object document storage, and Google/Amazon/Microsoft sell mpp engines that enable businesses to easily consume their data as if everything was a small sql database with structured data. Pipelines might still populate the data store, but a lot of the transformation can happen on end-user read.
Amazing video.. I watched your video and it helped me a lot... I'm now a data engineer. Thanks a lot
I wasn't expecting a "day in the life" video so soon. Thanks
My fav forgotten print statement.
Hey, I don't know if you will see this or not, but I have a question. I'm 14, if I wanted to become a data engineer, where do I start? What do I need to do? Because choosing a job is pretty hard and I'm leaning more towards this sort of stuff, but I have no clue where to begin!
Love the background! 🤌
Dude, 5:38 -> "Queiries" is a 8 character string.. while the correct word has only 7. Look at the English Language data to figure that out. We're engineers but that doesn't mean we can't spell (ironically, this is a word/term Data people use quite a lot :D).
Informative video, thank you!
The data janitor said that data engineers don't have many meetings, which is why he likes it over data science and machine learning. Not true? Also, can you get hired as a data engineer without a prior IT job (for example, if you did some machine learning as a biologist, and passed some SQL certification exams).
hello! Thank you for insightful content. I’d like to ask if archiving data is part of DE’S job? If yes, please make a separate video about it. Thanks.
Hey I was curious on what the workload is. Do they expect you to do x amount of data models per week. In other words, do they just give you the data say we want to find x y and z and you go out and do it. In a given week do you have to do like thousands of datasets? For example , the vouume of things they want done. I am looking for the day to day.
your way of explanation is so fast. for the beginner but explanation is good clear and clarity .
currently i am working as data engineer and i spend my days on data migration, etl dev, am and report development.
Ben, thanks for video. Do you have A-Z course how become a data engineer? Or can you recommend one ? Thank you
@SeattleDataGuy