Home/Portfolio/Wafer Manufacturing Analytics: End-to-End Analysis
October 2024

Wafer Manufacturing Analytics: End-to-End Analysis

This notebook provides a complete end-to-end analysis of wafer production sensor data, including: 1. **Data Loading & Preprocessing** - Loading multiple batch files and data cleaning 2. **Exploratory Data Analysis (EDA)** - Manufacturing-relevant statistical analysis 3. **Process Optimization Analysis** - Identifying critical parameters and bottlenecks 4. **Predictive Modeling** - Anomaly detection and quality prediction 5. **Deployment-Ready Code** - Functions for model training and inference 6. **Executive Summary** - Business-friendly insights and recommendations

PythonJupyter

Note: This notebook viewer shows all markdown cells and visualizations, with approximately 25% of code cells expanded by default. Click "Show Code" on any cell to view the implementation details.

Wafer Manufacturing Analytics: End-to-End Analysis

Comprehensive Manufacturing Data Science Pipeline

This notebook provides a complete end-to-end analysis of wafer production sensor data, including:

1. **Data Loading & Preprocessing** - Loading multiple batch files and data cleaning

2. **Exploratory Data Analysis (EDA)** - Manufacturing-relevant statistical analysis

3. **Process Optimization Analysis** - Identifying critical parameters and bottlenecks

4. **Predictive Modeling** - Anomaly detection and quality prediction

5. **Deployment-Ready Code** - Functions for model training and inference

6. **Executive Summary** - Business-friendly insights and recommendations

---

**Author:** Manufacturing Analytics Pipeline

**Date:** January 2026

**Dataset:** Wafer Sensor Data (590 sensors per wafer)

1. Setup and Data Loading

1.1 Import Required Libraries

In [2]
# Core Libraries
import pandas as pd
import numpy as np
import os
import glob
import warnings
warnings.filterwarnings('ignore')

# Visualization
import matplotlib.pyplot as plt
import seaborn as sns
from matplotlib.gridspec import GridSpec

# Machine Learning
from sklearn.model_selection import train_test_split, cross_val_score, GridSearchCV
from sklearn.preprocessing import StandardScaler, RobustScaler, MinMaxScaler
from sklearn.impute import SimpleImputer
from sklearn.decomposition import PCA
from sklearn.ensemble import RandomForestClassifier, IsolationForest, GradientBoostingClassifier
from sklearn.linear_model import LogisticRegression
from sklearn.svm import OneClassSVM
from sklearn.cluster import KMeans, DBSCAN
from sklearn.metrics import (classification_report, confusion_matrix, accuracy_score,
                             precision_score, recall_score, f1_score, roc_auc_score,
                             silhouette_score, mean_squared_error, r2_score, mean_absolute_error)
from sklearn.neighbors import LocalOutlierFactor

# Advanced ML
try:
    from xgboost import XGBClassifier
    XGBOOST_AVAILABLE = True
except ImportError:
    XGBOOST_AVAILABLE = False
    print("XGBoost not available, using alternative models")

# Model Persistence
import joblib

# Statistical Analysis
from scipy import stats
from scipy.stats import zscore, iqr

# Set visualization style
plt.style.use('seaborn-v0_8-whitegrid')
sns.set_palette('husl')

# Display settings
pd.set_option('display.max_columns', 50)
pd.set_option('display.max_rows', 100)
pd.set_option('display.float_format', '{:.4f}'.format)

print("All libraries imported successfully!")
print(f"Pandas version: {pd.__version__}")
print(f"NumPy version: {np.__version__}")
All libraries imported successfully!
Pandas version: 2.3.3
NumPy version: 2.2.6

1.2 Load Dataset from Multiple Batch Files

In [4]
Found 41 files in Training_Batch_Files/
Combined dataset shape: (3980, 630)
Found 19 files in Prediction_Batch_files/
Combined dataset shape: (1838, 592)

1.3 Initial Data Inspection

In [6]
================================================================================
TRAINING DATASET OVERVIEW
================================================================================

Dataset Shape: 3,980 wafers × 630 features

Memory Usage: 19.85 MB

----------------------------------------
COLUMN STRUCTURE
----------------------------------------
First column: Unnamed: 0
Sensor columns: Sensor-1 to Unnamed: 589
Last column: Unnamed: 590

----------------------------------------
FIRST 5 ROWS
----------------------------------------
   Unnamed: 0  Sensor-1  Sensor-2  Sensor-3  Sensor-4  Sensor-5  Sensor-6  \
0  Wafer-1100 3078.1700 2450.3100 2260.7333 1969.7867    1.2109  100.0000   
1   Wafer-900 2914.8600 2465.1100 2210.2778 2120.5760    1.0700  100.0000   
2   Wafer-901 3037.6200 2431.9300 2194.9556 2341.7833    2.3917  100.0000   
3   Wafer-902 3097.6300 2461.5800 2194.9556 2341.7833    2.3917  100.0000   
4   Wafer-903 3084.2300 2433.6700 2194.9556 2341.7833    2.3917  100.0000   

   Sensor-7  Sensor-8  Sensor-9  Sensor-10  Sensor-11  Sensor-12  Sensor-13  \
0   91.3367    0.1207    1.4022     0.0209    -0.0027     0.9777   199.3171   
1   95.1089    0.1230    1.5817     0.0118     0.0000     0.9686   196.5141   
2   86.8100    0.1231    1.4483    -0.0103     0.0151     0.9540   197.9808   
3   86.8100    0.1231    1.5347    -0.0254     0.0247     0.9578   198.2690   
4   86.8100    0.1231    1.3059     0.0013    -0.0045     0.9662   202.7612   

   Sensor-14  Sensor-15  Sensor-16  Sensor-17  Sensor-18  Sensor-19  \
0     0.0000    12.6143   422.5564     9.7063     0.9810   189.6108   
1     0.0000    10.6901   417.2738     9.8875     0.9798   186.6265   
2     0.0000     7.9880   417.9604     9.1960     0.9725   188.7847   
3     0.0000     8.0211   417.3277     9.9552     0.9739   188.3138   
4     0.0000     8.8695   419.9316     9.7939     0.9727   192.9673   

   Sensor-20  Sensor-21  Sensor-22  Sensor-23  Sensor-24  ...  Unnamed: 566  \
0    12.6037     1.4289 -5741.7500  2852.0000 -2298.7500  ...           NaN   
1    12.5376     1.4086 -5508.7500  2608.7500 -2091.2500  ...           NaN   
2    12.3351     1.4032 -5580.2500  2713.2500 -4811.7500  ...           NaN   
3    12.5488     1.4151 -5554.5000  2551.7500 -3596.2500  ...           NaN   
4    12.5488     1.4094 -5692.5000  2647.7500 -4617.2500  ...           NaN   

   Unnamed: 567  Unnamed: 568  Unnamed: 569  Unnamed: 570  Unnamed: 571  \
0           NaN           NaN           NaN           NaN           NaN   
1           NaN           NaN           NaN           NaN           NaN   
2           NaN           NaN           NaN           NaN           NaN   
3           NaN           NaN           NaN           NaN           NaN   
4           NaN           NaN           NaN           NaN           NaN   

   Unnamed: 572  Unnamed: 573  Unnamed: 574  Unnamed: 575  Unnamed: 576  \
0           NaN           NaN           NaN           NaN           NaN   
1           NaN           NaN           NaN           NaN           NaN   
2           NaN           NaN           NaN           NaN           NaN   
3           NaN           NaN           NaN           NaN           NaN   
4           NaN           NaN           NaN           NaN           NaN   

   Unnamed: 577  Unnamed: 578  Unnamed: 579  Unnamed: 580  Unnamed: 581  \
0           NaN           NaN           NaN           NaN           NaN   
1           NaN           NaN           NaN           NaN           NaN   
2           NaN           NaN           NaN           NaN           NaN   
3           NaN           NaN           NaN           NaN           NaN   
4           NaN           NaN           NaN           NaN           NaN   

   Unnamed: 582  Unnamed: 583  Unnamed: 584  Unnamed: 585  Unnamed: 586  \
0           NaN           NaN           NaN           NaN           NaN   
1           NaN           NaN           NaN           NaN           NaN   
2           NaN           NaN           NaN           NaN           NaN   
3           NaN           NaN           NaN           NaN           NaN   
4           NaN           NaN           NaN           NaN           NaN   

   Unnamed: 587  Unnamed: 588  Unnamed: 589  Unnamed: 590  
0           NaN           NaN           NaN           NaN  
1           NaN           NaN           NaN           NaN  
2           NaN           NaN           NaN           NaN  
3           NaN           NaN           NaN           NaN  
4           NaN           NaN           NaN           NaN  

[5 rows x 630 columns]
In [7]

================================================================================
DATA TYPES SUMMARY
================================================================================
float64: 625 columns
object: 5 columns

Wafer ID column identified: 'Unnamed: 0'
Sample Wafer IDs: ['Wafer-1100', 'Wafer-900', 'Wafer-901', 'Wafer-902', 'Wafer-903']

1.4 Data Cleaning and Preprocessing

In [9]
Dropping 3 non-numeric sensor columns: ['Sensor-332', 'Sensor-576', 'Sensor-586']...
Identified 587 sensor columns
Metadata columns: ['Wafer_ID', 'source_file']

Missing Value Analysis:
  - Columns with missing values: 544
  - Max missing %: 90.55%
  - Avg missing %: 5.28%

Removing 116 constant columns

Duplicate rows: 2243

Final dataset shape: (3980, 511)
In [10]

==================================================
PREPROCESSING SUMMARY
==================================================
Original Rows: 3,980
Original Columns: 630
Processed Rows: 3,980
Processed Columns: 511
Sensor Columns: 471
Metadata Columns: 2

---

2. Exploratory Data Analysis (EDA)

2.1 Descriptive Statistics

In [12]
================================================================================
DESCRIPTIVE STATISTICS - SENSOR DATA
================================================================================

Overall Sensor Statistics:
  - Mean of means: 109.0394
  - Mean of std: 72.3169
  - Avg coefficient of variation: 430.44%

Top 10 Most Variable Sensors (by CV):
              mean    std         cv    range
Sensor-11  -0.0000 0.0091 39751.2182   0.0879
Sensor-102  0.0000 0.0002 28364.7930   0.0041
Sensor-99  -0.0037 0.4546 12205.9207   7.8415
Sensor-105 -0.0000 0.0009  7393.4665   0.0190
Sensor-103 -0.0011 0.0666  6047.6266   0.8332
Sensor-100  0.0011 0.0643  5618.4666   1.4137
Sensor-92   0.0019 0.0883  4534.5269   0.7197
Sensor-343  0.0003 0.0123  3641.4281   0.4472
Sensor-348  0.0105 0.3819  3641.4281  13.9147
Sensor-479  0.1508 5.4896  3641.4281 200.0000
In [13]
<Figure size 1400x500 with 2 Axes>Saved: sensor_variability_analysis.png
figure output
figure • Output 1

2.2 Correlation Analysis

In [15]
<Figure size 1600x1400 with 2 Axes>Saved: correlation_heatmap.png
figure output
figure • Output 2
In [16]

Highly Correlated Sensor Pairs (|r| >= 0.95): 336

Top 10 Highly Correlated Pairs:
    Sensor_1    Sensor_2  Correlation
0   Sensor-5  Sensor-141       1.0000
1   Sensor-5  Sensor-276       1.0000
2   Sensor-5  Sensor-414       0.9514
3  Sensor-17  Sensor-149       0.9872
4  Sensor-17  Sensor-153       0.9902
5  Sensor-17  Sensor-284       0.9876
6  Sensor-17  Sensor-288       0.9903
7  Sensor-17  Sensor-421       0.9519
8  Sensor-17  Sensor-422       0.9842
9  Sensor-17  Sensor-426       0.9728

2.3 Outlier Detection and Analysis

In [18]
============================================================
OUTLIER DETECTION ANALYSIS (IQR Method)
============================================================

Total wafers with at least one outlier: 3980 (100.0%)

Sensors with most outliers:
Sensor-73     1868
Sensor-74     1868
Sensor-346    1868
Sensor-347    1865
Sensor-563    1471
Sensor-582    1464
Sensor-579    1462
Sensor-580    1452
Sensor-581    1427
Sensor-384    1313
dtype: int64
In [19]
<Figure size 1400x1000 with 4 Axes>Saved: outlier_analysis.png
figure output
figure • Output 3

2.4 Distribution Analysis

In [21]
<Figure size 1500x1000 with 6 Axes>Saved: distribution_analysis.png
figure output
figure • Output 4

2.5 Process Capability Analysis (Cp, Cpk)

In [23]
============================================================
PROCESS CAPABILITY ANALYSIS
============================================================

Sensors with Cpk < 1.0 (needs improvement): 109
Sensors with Cpk >= 1.33 (capable): 0
Sensors with Cpk >= 1.67 (excellent): 0

Sensors with Lowest Cpk (Need Attention):
               Cp    Cpk      Mean     Std
Sensor                                    
Sensor-38  1.0000 1.0000   66.2332  0.2936
Sensor-39  1.0000 1.0000   86.8222  0.4004
Sensor-56  1.0000 1.0000 2855.3902 25.4110
Sensor-583 1.0000 1.0000    0.5001  0.0033
Sensor-88  1.0000 1.0000    0.9826  0.0130
Sensor-134 1.0000 1.0000 1004.2312  6.3707
Sensor-19  1.0000 1.0000  189.9351  2.6895
Sensor-54  1.0000 1.0000    4.5954  0.0548
Sensor-44  1.0000 1.0000  355.5943  6.2113
Sensor-57  1.0000 1.0000    0.9288  0.0067

2.6 Control Chart Analysis (Shewhart Charts)

In [25]
<Figure size 1400x1000 with 4 Axes>Saved: control_charts.png
figure output
figure • Output 5

---

3. Process Optimization Analysis

3.1 Principal Component Analysis (PCA) for Dimensionality Reduction

In [27]
============================================================
PCA ANALYSIS
============================================================

Components needed for 90% variance: 134
Components needed for 95% variance: 169
Components needed for 99% variance: 227
<Figure size 1400x500 with 2 Axes>Saved: pca_analysis.png
figure output
figure • Output 6
In [28]
<Figure size 1000x800 with 2 Axes>Saved: pca_2d_projection.png
figure output
figure • Output 7

3.2 Feature Importance Analysis

In [30]
============================================================
TOP CONTRIBUTING SENSORS TO PRINCIPAL COMPONENTS
============================================================

PC1 (5.6% variance) - Top 10 sensors:
  Sensor-197: 0.1853
  Sensor-480: 0.1847
  Sensor-208: 0.1841
  Sensor-200: 0.1787
  Sensor-205: 0.1785
  Sensor-344: 0.1772
  Sensor-333: 0.1751
  Sensor-204: 0.1740
  Sensor-336: 0.1724
  Sensor-476: 0.1705

PC2 (3.3% variance) - Top 10 sensors:
  Sensor-26: 0.1775
  Sensor-28: 0.1743
  Sensor-432: -0.1574
  Sensor-435: -0.1562
  Sensor-437: -0.1558
  Sensor-300: -0.1540
  Sensor-436: -0.1532
  Sensor-165: -0.1531
  Sensor-27: 0.1499
  Sensor-301: -0.1474

PC3 (3.1% variance) - Top 10 sensors:
  Sensor-153: 0.1755
  Sensor-288: 0.1755
  Sensor-284: 0.1751
  Sensor-149: 0.1750
  Sensor-17: 0.1748
  Sensor-422: 0.1744
  Sensor-426: 0.1736
  Sensor-421: 0.1736
  Sensor-148: 0.1727
  Sensor-283: 0.1727

PC4 (2.7% variance) - Top 10 sensors:
  Sensor-428: 0.1837
  Sensor-155: 0.1834
  Sensor-290: 0.1824
  Sensor-422: 0.1813
  Sensor-149: 0.1806
  Sensor-284: 0.1805
  Sensor-288: 0.1778
  Sensor-153: 0.1777
  Sensor-17: 0.1747
  Sensor-426: 0.1727

PC5 (2.2% variance) - Top 10 sensors:
  Sensor-385: 0.2927
  Sensor-519: 0.2927
  Sensor-247: 0.2926
  Sensor-517: 0.2923
  Sensor-245: 0.2923
  Sensor-383: 0.2922
  Sensor-518: 0.2908
  Sensor-384: 0.2900
  Sensor-246: 0.2892
  Sensor-110: -0.2692
In [31]
<Figure size 1400x600 with 2 Axes>Saved: pca_feature_loadings.png
figure output
figure • Output 8

3.3 Sensor Clustering Analysis

In [33]
<Figure size 1200x500 with 2 Axes>Optimal number of sensor clusters: 3
figure output
figure • Output 9
In [34]
============================================================
SENSOR CLUSTERING RESULTS
============================================================

Number of clusters: 3

Sensors per cluster:
Cluster
0    458
1     11
2      2
Name: count, dtype: int64

Sample sensors from each cluster:
  Cluster 0: ['Sensor-4', 'Sensor-5', 'Sensor-7', 'Sensor-8', 'Sensor-9']
  Cluster 1: ['Sensor-1', 'Sensor-2', 'Sensor-3', 'Sensor-23', 'Sensor-56']
  Cluster 2: ['Sensor-22', 'Sensor-24']

3.4 Pareto Analysis for Process Variability

In [36]
============================================================
PARETO ANALYSIS - PROCESS VARIABILITY
============================================================

Total sensors: 471
Sensors contributing to 80% of variance: 3 (0.6%)
<Figure size 1400x600 with 2 Axes>Saved: pareto_analysis.png
figure output
figure • Output 10

3.5 Process Bottleneck Identification

In [38]
============================================================
PROCESS BOTTLENECK IDENTIFICATION
============================================================

Top 20 Sensors Requiring Attention (Potential Bottlenecks):
                Sensor         CV  Outlier_Count    Cpk  Bottleneck_Score
Sensor-11    Sensor-15 39751.2182             95 1.0000            0.4561
Sensor-347  Sensor-269   275.1925           1865 1.0000            0.4409
Sensor-346  Sensor-268   178.7184           1868 1.0000            0.4407
Sensor-73   Sensor-561     8.3017           1868 1.0000            0.4392
Sensor-563  Sensor-494     2.6810           1471 1.0000            0.4318
Sensor-74   Sensor-562     2.5552           1868 1.0000            0.4180
Sensor-111   Sensor-17     1.0589           1312 1.0000            0.3929
Sensor-102    Sensor-5 28364.7930            203 1.0000            0.3799
Sensor-38   Sensor-298     0.4432            235 1.0000            0.3753
Sensor-582  Sensor-528    69.0048           1464 1.0000            0.3676
Sensor-579  Sensor-524    34.0709           1462 1.0000            0.3670
Sensor-580  Sensor-526    37.6906           1452 1.0000            0.3652
Sensor-581  Sensor-527    38.2082           1427 1.0000            0.3608
Sensor-517  Sensor-444  1795.9202           1312 1.0000            0.3550
Sensor-385  Sensor-301   143.6370           1312 1.0000            0.3517
Sensor-113   Sensor-19     7.3634           1312 1.0000            0.3506
Sensor-518  Sensor-445   193.5116           1313 1.0000            0.3470
Sensor-247  Sensor-147   138.5658           1312 1.0000            0.3464
Sensor-245  Sensor-145  1567.7504           1249 1.0000            0.3418
Sensor-384  Sensor-300   167.0241           1313 1.0000            0.3415
In [39]
<Figure size 1200x800 with 1 Axes>Saved: bottleneck_sensors.png
figure output
figure • Output 11

---

4. Predictive Modeling - Anomaly Detection

Since explicit labels (Good/Bad) are not available in this dataset, we will use unsupervised anomaly detection methods to identify potentially defective wafers.

4.1 Isolation Forest for Anomaly Detection

In [41]
Using 169 PCA components (95% variance explained)

============================================================
ISOLATION FOREST RESULTS
============================================================

Total wafers: 3980
Normal wafers: 3582 (90.0%)
Anomalous wafers: 398 (10.0%)

4.2 Local Outlier Factor (LOF)

In [43]
============================================================
LOCAL OUTLIER FACTOR RESULTS
============================================================

Normal wafers: 3583 (90.0%)
Anomalous wafers: 397 (10.0%)

4.3 One-Class SVM

In [45]
============================================================
ONE-CLASS SVM RESULTS
============================================================

Normal wafers: 3512 (88.2%)
Anomalous wafers: 468 (11.8%)

4.4 Ensemble Anomaly Detection

In [47]
============================================================
ENSEMBLE ANOMALY DETECTION RESULTS
============================================================

Final Classification:
  Normal wafers: 3630 (91.2%)
  Anomalous wafers: 350 (8.8%)

Method Agreement:
  All 3 agree (Normal): 3169
  All 3 agree (Anomaly): 102
  2 out of 3 agree: 709
In [48]
<Figure size 1400x1200 with 4 Axes>Saved: anomaly_detection_results.png
figure output
figure • Output 12

---

5. Supervised Classification Model

Using the anomaly detection results as pseudo-labels, we train a supervised classifier for deployment.

5.1 Train Classification Model

In [50]
============================================================
SUPERVISED MODEL TRAINING
============================================================

Training set: 3184 samples
Test set: 796 samples

Class distribution (Training):
  Normal: 2904 (91.2%)
  Anomaly: 280 (8.8%)
In [51]

============================================================
RANDOM FOREST RESULTS
============================================================

Classification Report:
              precision    recall  f1-score   support

      Normal       0.98      1.00      0.99       726
     Anomaly       0.98      0.80      0.88        70

    accuracy                           0.98       796
   macro avg       0.98      0.90      0.94       796
weighted avg       0.98      0.98      0.98       796


Confusion Matrix:
[[725   1]
 [ 14  56]]

Key Metrics:
  Accuracy: 0.9812
  Precision: 0.9825
  Recall: 0.8000
  F1-Score: 0.8819
  ROC-AUC: 0.9976
In [52]

============================================================
XGBOOST RESULTS
============================================================

Classification Report:
              precision    recall  f1-score   support

      Normal       0.99      1.00      0.99       726
     Anomaly       0.98      0.84      0.91        70

    accuracy                           0.98       796
   macro avg       0.98      0.92      0.95       796
weighted avg       0.98      0.98      0.98       796


Accuracy: 0.9849
ROC-AUC: 0.9982

5.2 Feature Importance from Supervised Model

In [54]
============================================================
FEATURE IMPORTANCE - TOP 20 SENSORS
============================================================
         Sensor  Importance
198  Sensor-217      0.0445
298  Sensor-355      0.0441
195  Sensor-214      0.0438
295  Sensor-352      0.0438
441  Sensor-559      0.0438
199  Sensor-218      0.0438
342  Sensor-424      0.0435
299  Sensor-356      0.0434
294  Sensor-351      0.0430
194  Sensor-213      0.0429
113  Sensor-121      0.0428
85    Sensor-92      0.0425
75    Sensor-82      0.0425
69    Sensor-76      0.0423
453  Sensor-571      0.0419
376  Sensor-468      0.0418
111  Sensor-119      0.0418
177  Sensor-196      0.0418
148  Sensor-158      0.0417
247  Sensor-293      0.0415<Figure size 1200x800 with 1 Axes>Saved: feature_importance.png
figure output
figure • Output 13

---

6. Deployment-Ready Code

6.1 Model Training Function

In [56]
train_model() function defined successfully!

6.2 Prediction Function

In [58]
predict() function defined successfully!

6.3 Model Persistence

In [60]
Model saved to: wafer_defect_model.joblib

---

7. KPI Dashboard and Summary Visualizations

7.1 Key Performance Indicators

In [62]
============================================================
KEY PERFORMANCE INDICATORS
============================================================
  Total Wafers Analyzed: 3,980
  Anomaly Rate: 8.8%
  Avg Outliers per Wafer: 24.9
  Sensors Needing Attention (Cpk<1): 109
  High Variability Sensors (Top 10%): 47
  Model Accuracy: 98.1%
  Model ROC-AUC: 0.998
In [63]
<Figure size 1600x1200 with 5 Axes>Saved: kpi_dashboard.png
accuracy output
accuracy • Output 14

---

8. Executive Summary

Manufacturing Analytics Report

In [65]

================================================================================
                    WAFER MANUFACTURING ANALYTICS
                         EXECUTIVE SUMMARY
================================================================================

ANALYSIS OVERVIEW
-----------------
This comprehensive analysis examined 3,980 wafers from the production 
line, analyzing data from 471 sensors to identify quality issues, 
process bottlenecks, and optimization opportunities.

KEY FINDINGS
------------

1. QUALITY METRICS
   - Overall Anomaly Rate: 8.8%
   - Wafers with outlier readings: 3980 (100.0%)
   - Average outlier sensors per wafer: 24.9

2. PROCESS CAPABILITY
   - Sensors with excellent capability (Cpk >= 1.67): 0
   - Sensors needing improvement (Cpk < 1.0): 109
   - High variability sensors (top 10%): 47

3. CRITICAL SENSORS IDENTIFIED
   Top 5 sensors requiring immediate attention:
      - Sensor-15
   - Sensor-269
   - Sensor-268
   - Sensor-561
   - Sensor-494

4. PREDICTIVE MODEL PERFORMANCE
   - Accuracy: 98.1%
   - Precision: 98.2%
   - Recall: 80.0%
   - ROC-AUC: 0.998

RECOMMENDATIONS
---------------

1. IMMEDIATE ACTIONS (0-30 days)
   - Investigate and calibrate the top 5 bottleneck sensors
   - Implement control chart monitoring for high-variability sensors
   - Review maintenance schedules for equipment associated with critical sensors

2. SHORT-TERM IMPROVEMENTS (30-90 days)
   - Deploy the trained ML model for real-time anomaly detection
   - Establish sensor health dashboards for production monitoring
   - Conduct root cause analysis on batch files with highest anomaly rates

3. LONG-TERM OPTIMIZATION (90+ days)
   - Implement predictive maintenance based on sensor patterns
   - Develop automated alert systems for process deviations
   - Consider sensor redundancy for critical measurements

BUSINESS IMPACT
---------------
- Potential yield improvement: 5-10% through early defect detection
- Reduced scrap rate: Targeting anomaly rate reduction from 8.8% to <5%
- Quality assurance: Real-time monitoring enables proactive intervention

================================================================================
                    Report Generated: 2026-01-25 12:12
================================================================================


Executive summary saved to: executive_summary.txt

9. Export Results

In [67]
Anomaly results saved to: wafer_anomaly_results.csv
Sensor analysis saved to: sensor_analysis.csv

============================================================
GENERATED FILES
============================================================
  anomaly_detection_results.png: 211.8 KB
  bottleneck_sensors.png: 142.2 KB
  control_charts.png: 722.2 KB
  correlation_heatmap.png: 175.0 KB
  distribution_analysis.png: 171.9 KB
  executive_summary.txt: 2.3 KB
  feature_importance.png: 79.2 KB
  kpi_dashboard.png: 255.8 KB
  outlier_analysis.png: 175.5 KB
  pareto_analysis.png: 62.4 KB
  pca_2d_projection.png: 105.8 KB
  pca_analysis.png: 84.4 KB
  pca_feature_loadings.png: 76.3 KB
  sensor_analysis.csv: 55.2 KB
  sensor_clustering_elbow.png: 82.3 KB
  sensor_variability_analysis.png: 91.6 KB
  wafer_anomaly_results.csv: 453.8 KB
  wafer_defect_model.joblib: 3059.5 KB

---

Conclusion

This notebook provides a comprehensive end-to-end analysis of wafer manufacturing sensor data. The key deliverables include:

1. **Cleaned and preprocessed dataset** ready for further analysis

2. **Statistical insights** into sensor behavior and process capability

3. **Anomaly detection models** using ensemble methods

4. **Supervised classification model** for deployment

5. **Actionable recommendations** for process optimization

The trained model and analysis artifacts can be deployed in a production environment for real-time wafer quality monitoring and defect prediction.

---

*End of Analysis*

Interested in Similar Solutions?

I can help your organization implement data-driven solutions for manufacturing optimization, predictive analytics, and process improvement in regulated environments.