Probability

Probability for AI & ML

This course includes

15 articles
1h 19m reading time
36 videos • 11 hr 55 mins

Course content

15 sections • 110 topics • Read: 1h 19m • Video: 11 hr 55 mins

Introduction to Probability 14 Topics, Read: 5 mins, 4 Videos: 31 mins
Probability
Sample Space
Event
Discrete
Continuous
Mutually Exclusive (Disjoint) Events
Independent Events
Probability for Machine Learning Watch 6 mins
Sample Space | Discrete | Continuous - Explained with Example Watch 9 mins
Mutually Exclusive & Independent Events | Probability for Machine Learning Watch 9 mins
Why Probability = 0 does not mean Impossible ? | Explained with Example Watch 6 mins
Conditional Probability 8 Topics, Read: 3 mins, 2 Videos: 33 mins
Conditional Probability
Chain Rule
Bayes' Theorem
Law of Total Probability
Generalised Bayes' Theorem
Conditional Probability | Explained with example Watch 9 mins
Bayes' theorem for Machine Learning | Law of Total Probability | Explained with Example Watch 24 mins
Independence of Events 7 Topics, Read: 3 mins, 1 Video: 22 mins
Independence of Events
Mutual Independence
Pair-Wise Independence
Conditional Independence
Independence of Events Explained | Mutual, Pairwise & Conditional Independence Made Easy! Watch 22 mins
Cumulative Distribution Function 11 Topics, Read: 5 mins, 1 Video: 31 mins
Random Variable(RV)
Discrete Random Variable
Continuous Random Variable
Cumulative Distribution Function(CDF)
Key properties of CDF
Discrete Case
Continuous Case
Cumulative Distribution Function (CDF) | Intuition + Examples Watch 31 mins
Probability Mass Function 10 Topics, Read: 4 mins, 3 Videos: 37 mins
Probability Mass Function(PMF)
Key properties of PMF
Bernoulli Distribution
Binomial Distribution
Assumptions
Poisson Distribution
PMF of Poisson Distribution
Probability Mass Function (PMF) | Explained with Examples Watch 10 mins
Bernoulli and Binomial Distribution | Explained with Examples Watch 16 mins
Poisson Distribution | Formula | Derivation | Intuition with Examples Watch 10 mins
Probability Density Function 18 Topics, Read: 9 mins, 6 Videos: 1 hr 17 mins
Probability Density Function(PDF)
Key properties of PDF
Uniform Distribution
PDF of Uniform Distribution
CDF of Uniform Distribution
Gaussian(Normal) Distribution
PDF of Gaussian Distribution
CDF of Gaussian Distribution
68-95-99 Rule
Exponential Distribution
PDF of Exponential Distribution
CDF of Exponential Distribution
Memoryless Property of Exponential Distribution
Relation of Exponential Distribution and Poisson Distribution
Probability Density Function (PDF) for Machine Learning | Simplified with Example Watch 16 mins
Uniform Distribution | Explained with Examples Watch 6 mins
Gaussian Distribution Explained | The Bell Curve of Machine Learning Watch 12 mins
Exponential Distribution | Explained with Examples Watch 12 mins
Why Exponential Distribution is Memoryless? | Intuition + Math + Example Watch 16 mins
Exponential and Poisson Distribution are 2 Faces of the Same Coin | Explained with Example Watch 14 mins
Expectation 3 Topics, Read: 5 mins, 1 Video: 37 mins
Expectation
Variance
Co-Variance
Expectation → Variance → Covariance | Step-by-Step Intuitive Guide Watch 37 mins
Moment Generating Function 2 Topics, Read: 3 mins, 2 Videos: 18 mins
Moment
Moment Generating Function
Moments of a Random Variable | Mean | Variance | Skewness | Kurtosis | Explained Watch 4 mins
Moment Generating Function (MGF) of a Random Variable | Explained with Example Watch 13 mins
Joint & Marginal 8 Topics, Read: 8 mins, 3 Videos: 1 hr 15 mins
Joint Probability Distribution
Marginal Probability Distribution
Conditional Probability
Application
Conditional Expectation
Conditional Variance
Joint Probability Distribution of Random Variable | Explained with Example Watch 25 mins
Marginal Probability Distribution of Random Variable | Explained with Example Watch 26 mins
Conditional Probability Distribution for Machine Learning | Explained with Example Watch 23 mins
Independent & Identically Distributed 6 Topics, Read: 4 mins, 1 Video: 27 mins
I.I.D
Independence of Random Variables
Identically Distributed
Independent & Identically Distributed(I.I.D)
Independent & Identically Distributed (IID) Random Variables for Machine Learning | Explained Watch 27 mins
Convergence 4 Topics, Read: 3 mins, 1 Video: 42 mins
Convergence in Probability
Almost Sure Convergence
Convergence of Random Variable | Law of Large Numbers | Explained with Example Watch 42 mins
Law of Large Numbers 5 Topics, Read: 2 mins, 1 Video: 42 mins
Weak Law of Large Numbers (WLLN)
Strong Law of Large Numbers (SLLN)
Application
Convergence of Random Variable | Law of Large Numbers | Explained with Example Watch 42 mins
Markov's Inequality 3 Topics, Read: 3 mins, 1 Video: 36 mins
Markov's Inequality
Chebyshev's Inequality
Chernoff Bound
Markov's Inequality | Chebyshev Inequality | Chernoff Bounds | Machine Learning Watch 36 mins
Cross Entropy & KL Divergence 5 Topics, Read: 6 mins, 4 Videos: 59 mins
Surprise Factor
Entropy
Cross Entropy
Kullback Leibler (KL) Divergence
Jensen-Shannon Divergence
Entropy for Machine Learning | Information Gain & Surprise Factor | Explained with Examples Watch 20 mins
Cross Entropy for Machine Learning | Intuitive Math + Real Example Watch 10 mins
Kullback Leibler (KL) Divergence for Machine Learning | Relation to Cross Entropy | Explained Watch 15 mins
Jensen–Shannon (JS) Divergence for Machine Learning | Relation with KL Divergence | Explained Watch 13 mins
Parametric Model Estimation 6 Topics, Read: 16 mins, 5 Videos: 2 hr 24 mins
Parametric Model Estimation
2 Approaches
Maximum Likelihood Estimation
Bayesian Statistics
Maximum A Posteriori (MAP) Estimator
Minimum Mean Square Error (MMSE) Estimation
Parametric Model Estimation for Machine Learning | Explained with Example Watch 11 mins
Maximum Likelihood Estimation (MLE) for Machine Learning | Intuition + Worked Example Watch 21 mins
Bayesian Statistics for Machine Learning | Prior , Likelihood & Posterior | Explained with Example Watch 45 mins
Maximum A- Posteriori (MAP) Estimation for Machine Learning | Explained with Example Watch 46 mins
Minimum Mean Square Error (MMSE) Estimation for Machine Learning | Explained with Example Watch 19 mins

Introduction to Probability

Introduction to Probability

Conditional Probability

Conditional Probability & Bayes Theorem

Independence of Events

Independence of Events

Cumulative Distribution Function

Cumulative Distribution Function of a Random Variable

Probability Mass Function

Probability Mass Function of a Discrete Random Variable

Probability Density Function

Probability Density Function of a Continuous Random Variable

Expectation

Expectation of a Random Variable

Moment Generating Function

Moment Generating Function

Joint & Marginal

Joint, Marginal & Conditional Probability

Independent & Identically Distributed

Independent & Identically Distributed (I.I.D) Random Variables

Convergence

Convergence of Random Variables

Law of Large Numbers

Law of Large Numbers

Markov's Inequality

Markov’s, Chebyshev’s Inequality & Chernoff Bound

Cross Entropy & KL Divergence

Cross Entropy & KL Divergence

Parametric Model Estimation

Parametric Model Estimation