📌 Data Engineering Zoomcamp 🚀
🗓 Day 7 | Having Fun with the Homework

✅ Q1: Understanding Docker First Run
🔹 Explored how Docker initializes a container, runs commands, and manages resources.

✅ Q2: Understanding Docker Networking & Docker-Compose
🔹 Configured a multi-container setup using docker-compose.yml to manage services efficiently.
🔹 Experimented with networking concepts, ensuring containers communicate seamlessly.

✅ Q3-6: SQL Challenges (Trip Data Analysis)
🔹 Trip Segmentation Count → Used SQL to categorize trips based on distance.
🔹 Longest Trip Per Day → Applied GROUP BY and MAX() to identify the longest trip for each day.
🔹 Top 3 Pickup Zones → Ranked pickup locations using ORDER BY and LIMIT 3.
🔹 Largest Tip Given → Used MAX(tip_amount) to find the biggest tip recorded.

✅ Q7: Terraform Workflow
🔹 Successfully automated GCP infrastructure deployment using Terraform.
🔹 Practiced modifying, updating, and destroying cloud resources using Terraform state management.

📖 Key Takeaways:
📝 Understanding Docker’s first run behavior helps in debugging and optimizing containerized applications.
📝 Docker Networking & Compose simplifies multi-container app management, crucial for microservices and data pipelines.
📝 SQL remains a key skill—querying, aggregating, and optimizing large datasets is essential for data engineering.
📝 Terraform streamlines cloud infrastructure management, making it easier to scale and reproduce environments.

👨‍💻 Hands-on Practice:
🔹 Ran multiple Docker containers and tested networking between them.
🔹 Wrote optimized SQL queries to extract insights from NYC taxi trip data.
🔹 Used Terraform commands (apply, destroy) to create and remove cloud infrastructure.

📢 Thoughts or Reflections:
💬 Wrapping up Module 1 with homework reinforced how everything connects—Docker for containerization, Terraform for infrastructure, SQL for data manipulation, and GCP for scalable cloud development. Excited to dive into Module 2: Workflow Orchestration next! 🚀

👤 About Me:
Hi, I’m Jo, a BI Engineer passionate about data, automation, and problem-solving. I’m currently on a 6-week journey to upskill in data engineering through the DE Zoomcamp 2025 by DataTalks.Club. Follow along as I share my daily learnings! 🚀

📌 Follow my journey: #dailyincremental with #dataengineeringzoomcamp2025 by #datatalksclub

⚡️ Next Up: Module 2 – Workflow Orchestration with Kestra! 🔄

#dataengineering #etl #bigdata #datapipeline #analyticsengineering #sql #cloudcomputing #docker #terraform #gcp #bigquery #dbt #apachespark #kafka #pyflink #techlearning #datascience #learndata #learntocode #techjourney #techcontent #selftaught