Best of Data Engineering2023

  1. 1
    Article
    Avatar of communityCommunity Picks·3y

    The State of Data Engineering 2023

    A lot has happened since 2022, from the rise of Generative AI to the economic slowdown and job losses impacting data practitioners in 2023. The way the trend and investment focus on GenAI will influence the data engineering space is likely to become a major topic in our 2024 State of Data Engineering review.

  2. 2
    Article
    Avatar of substackSubstack·2y

    How I quit my $600k data engineering job at Airbnb and made $600k in 7 months from content creation and teaching

    The author quit their $600k data engineering job at Airbnb and made $600k in 7 months from content creation and teaching. They were inspired by living with YouTubers and wanted to have complete ownership of their ideas. They launched a data engineering boot camp and created long-form valuable content. They also marketed their boot camp and made improvements to their product during different iterations. Despite incurring expenses, they achieved a net profit of $539,065.

  3. 3
    Article
    Avatar of kdnuggetsKDnuggets·2y

    25 Free Courses to Master Data Science, Data Engineering, Machine Learning, MLOps, and Generative AI

    Discover a collection of top free courses to master data science, data engineering, machine learning, MLOps, and generative AI. Enhance your skills and embark on a new career with flexible and accessible learning opportunities.

  4. 4
    Article
    Avatar of medium_jsMedium·3y

    Pandas 2.0 is Here (Coming Soon)

    Pandas 2.0 introduces faster and more memory-efficient operations with pyarrow backend, Copy-on-Write optimization improves performance and reduces memory usage, and the index can now hold NumPy numeric types resulting in faster operations.

  5. 5
    Article
    Avatar of freecodecampfreeCodeCamp·2y

    MLOps Course – Learn to Build Machine Learning Production Grade Projects

    Learn about MLOps and its significance in building production grade machine learning projects. This course covers fundamental concepts, practical applications, comprehensive skill development, advanced techniques, and best practices in MLOps. It also offers an interactive learning experience with a Streamlit application.

  6. 6
    Article
    Avatar of kdnuggetsKDnuggets·3y

    Learn Data Engineering From These GitHub Repositories

    Learn data engineering with curated GitHub repositories covering topics like data ingestion, data warehouse, analytics engineering, batch processing, streaming, and more. Prepare for data engineering interviews with a collection of over 2000 interview questions.

  7. 7
    Article
    Avatar of kdnuggetsKDnuggets·3y

    A Beginner’s Guide to Data Engineering

    A Beginner’s Guide to Data Engineering - KDnuggets. Start today by learning more about data engineering and the fundamental concepts. Data engineering encompasses the set of all processes that collect and integrate raw data from various resources. The responsibilities of data engineer include - Extracting and integrating data from a variety of sources.

  8. 8
    Article
    Avatar of tdsTowards Data Science·3y

    Top 10 Metrics for Engineering Teams

    This post discusses the top 10 metrics used to understand the performance of data engineering teams, including cycle time, mean time to repair (MTTR), and change failure rate.

  9. 9
    Article
    Avatar of quastorQuastor Daily·3y

    How Canva Saved Millions on Data Storage

    How Canva Saved Millions on Data Storage. An overview of AWS S3 and how Canva changed their setup.