Frequentist Inference

Statistical inference is the process of deducing properties of an underlying distribution by analysis of data.

Point Estimation


One of the main goals of statistics is to estimate unknown parameters. To approximate these parameters, we choose an estimator, which is simply any function of randomly sampled observations. To illustrate this idea, we will estimate the value of \( \pi \) by uniformly dropping samples on a square containing an inscribed circle. We define the estimator \( \hat{\pi} \) below, where \( m \) is the number of samples within our circle and \( n \) is the total number of samples dropped. It can be shown that this estimator has the desirable property of being unbiased.

\(\hat{\pi} = 4\dfrac{m}{n}\) \( m= \) 0.00
\( n= \) 0.00
\( \hat{\pi}= \)     
Drop 100 Samples
Drop 1000 Samples

Interval Estimation


In contrast to point estimators, confidence intervals estimate a parameter by specifying a range of possible values. Such an interval is associated with a confidence level, which is the probability that the procedure used to generate the interval will produce an interval containing the true parameter.

  1. Choose a probability distribution to sample from.

  2. Choose a sample size \((n)\) and confidence level \((1-\alpha)\).


  3. Start sampling to generate confidence intervals.

  4. Start Sampling

Bootstrapping


Bootstrapping is a technique that relies on uniform sampling with replacement from a random sample. It can be used...(still under construction)

  1. Choose a probability distribution to sample from.

  2. Choose a sample size \((n)\) and sample from your chosen distribution.

  3. Sample
  4. Resample to generate the emperical distribution.

  5. Resample
    Resample 100 times