Best of Feature Engineering — 2024

1. 1
   Article

   Medium·2y

   Linear Algebra Concepts Every Data Scientist Should Know

   Linear algebra is fundamental in transforming theoretical data science models into practical solutions. It is crucial for data representation, dimensionality reduction, optimization, feature engineering, and similarity measures. Concepts such as vectors, vector spaces, matrices, and operations like dot products and matrix multiplication are key foundational topics. Understanding the basis, rank, determinants, eigenvectors, and eigenvalues are vital for advanced applications in data science and machine learning.

   82
2. 2
   Video

   freeCodeCamp·2y

   Kaggle Data Science Competition Course – Solve Three Challenges Step-by-Step

   Enhance your data science skills by tackling Kaggle competitions, with Rohan Kumar's step-by-step course guiding you through solving three distinct Kaggle problems. This comprehensive tutorial covers project setup, data preprocessing, feature engineering, and model evaluation. It also emphasizes the importance of understanding each dataset thoroughly to create effective solutions.

   63
3. 3
   Article

   KDnuggets·2y

   5 Common Data Science Mistakes and How to Avoid Them

   Data scientists often make five common mistakes that can negatively impact their projects: rushing into projects without clear objectives, overlooking foundational steps like data cleaning and statistics, choosing the wrong visualizations, neglecting feature engineering, and focusing more on accuracy than overall model performance. Understanding these pitfalls and how to avoid them is key to improving your workflow and becoming a more effective data scientist.

   52
4. 4
   Article

   Medium·2y

   From Data Collection to Deployment: Mastering the Data Science Workflow

   Data science has evolved into a critical tool for strategic decision-making. The workflow from data collection to deployment is not linear but iterative. Key steps include defining the problem, gathering and cleaning data, conducting exploratory data analysis, feature engineering, model selection, training and tuning, evaluating performance, and finally deploying the model. Effective communication of results to stakeholders is also vital.

   49

   1
5. 5
   Article

   Daily Dose of Data Science | Avi Chawla | Substack·2y

   6 Graph Feature Engineering Techniques

   Discover essential techniques for graph feature engineering, crucial for building effective graph neural networks (GNNs). Learn how to create a dummy social networking graph dataset and derive key features like node degree and centrality measures using NetworkX. The post highlights the significance of these features in enhancing model performance and provides real-world examples of graph machine learning applications by tech giants. Gain insights into various GNN tasks, data challenges, frameworks, and advanced architectures.

   29
6. 6
   Article

   Daily Dose of Data Science | Avi Chawla | Substack·2y

   A Crash Course on Graph Neural Networks — Part 3

   Part 3 of the crash course on Graph Neural Networks covers advanced methods for graph learning and several feature engineering techniques, along with implementation details. The course aims to provide a beginner-friendly introduction to GNNs, highlighting their importance in big-tech ML applications and outlining the benefits and challenges of using graph data. Key topics include GNN tasks, data challenges, frameworks, advanced architectures, and practical demos.

   27
7. 7
   Article

   Machine Learning Mastery·2y

   Tips for Effectively Training Your Machine Learning Models

   Achieving optimal machine learning model performance involves several critical steps: efficient data preprocessing such as handling missing values and scaling features, effective feature engineering including creating interaction and binning features, addressing class imbalance through resampling and adjusting class weights, and using cross-validation and hyperparameter tuning to ensure robust model evaluation and selection. By comparing models with cross-validation scores, one can select and optimize the best model for the data.

   20
8. 8
   Article

   GoPenAI·2y

   Mastering Data Requirements for Predictive Analytics

   Understanding data requirements is crucial in predictive analytics, often requiring 70-90% of the project effort. Essential steps include gathering historical data, meeting the flat file requirement, determining the target variable, selecting relevant data, and effective data integration. Feature engineering transforms raw data into meaningful features, enhancing model accuracy. Developing these data preparation skills involves both technical and creative elements, making it a critical aspect of successful data science projects.

   16
9. 9
   Article

   Machine Learning Mastery·2y

   5 Common Mistakes in Machine Learning and How to Avoid Them

   Using machine learning optimally involves understanding the entire process, from data comprehension to model selection. Beginners often overlook key steps, leading to inefficient models. Key areas include understanding the data, proper preprocessing to handle missing values and outliers, effective feature engineering, preventing data leakage, and balancing model complexity to avoid underfitting and overfitting. Investing effort in these areas ensures more robust and helpful machine learning models.

   16
10. 10
    Article

    Towards AI·2y

    Mathematical Transformations in Feature Engineering: Log, Reciprocal, and Power Transforms Explained with Visualization

    Learn how Log, Reciprocal, and Power Transforms can normalize your dataset, making it more manageable and improving the performance of machine learning models. Discover the reasons for data transformation and how to visualize the impacts using Python libraries like QQPlot and distplot.

    15
11. 11
    Article

    KDnuggets·2y

    Feature Engineering for Beginners

    This guide introduces key techniques in feature engineering, including handling missing values, encoding categorical variables, and scaling and normalizing data. It also covers advanced techniques such as feature creation, dimensionality reduction, and time series feature engineering. The post provides practical examples in Python and offers practical tips and best practices.

    14
12. 12
    Article

    Daily Dose of Data Science | Avi Chawla | Substack·2y

    Cyclical Feature Engineering

    Cyclical feature engineering is essential for handling features with recurring patterns, like the hour-of-the-day, day-of-the-week, and month-of-the-year, which are often overlooked. Using trigonometric functions such as sine and cosine helps capture the periodic nature of these features, retaining critical information. This approach ensures features like hours or days are correctly interpreted by models, improving their accuracy.

    13