Likelihood function

Definition

A likelihood function measures how well a statistical model explains observed data by calculating the probability of seeing that data under different parameter values of the model. It is constructed from the joint probability distribution of the random variable that (presumably) generated the observations. When evaluated on the actual data points, it becomes a function solely of the model parameters.

Related concepts

A. W. F. Edwards Accelerated failure time model Actuarial science Adaptive clinical trial Akaike information criterion Almost all Almost surely Analysis of covariance Analysis of variance Anders Hald Anderson–Darling test Annals of Statistics Anscombe transform Approximate Bayesian computation Arg max Arithmetic mean Arithmetic–geometric mean Asymptotic theory (statistics)Autocorrelation Autoregressive conditional heteroskedasticity Autoregressive model Autoregressive–moving-average model Average absolute deviation Bar chart Bayes' rule Bayes' theorem Bayes estimator Bayes factor Bayesian estimator Bayesian hierarchical modeling Bayesian inference Bayesian information criterion Bayesian linear regression Bayesian model averaging Bayesian probability Bayesian statistics Bayesianism Bernstein–von Mises theorem Bias of an estimator Binomial regression Bioinformatics Biometrika Biostatistics Biplot Blocking (statistics)Bootstrapping (statistics)Boundary (topology)Box plot Box–Cox transformation Box–Jenkins method Breusch–Godfrey test Cambridge University Press Canonical correlation Cartography Categorical variable Census Central limit theorem Central tendency Change of coordinates Chapman & Hall Chemometrics Chi-squared distribution Chi-squared test Christian Gouriéroux Clinical study design Clinical trial Cluster analysis Cluster sampling Cochran–Mantel–Haenszel statistics Coefficient of determination Coefficient of variation Cohen's kappa Coherence (philosophical gambling strategy)Cohort study Cointegration Compactness Completeness (statistics)Computational complexity Concave function Conditional entropy Conditional probability Conditional probability distribution Confidence interval Confidence region Confounding Conjugate prior Connected space Consistent estimator Contingency table Continuous function Continuous or discrete variable Continuous probability distribution Contour line Contraharmonic mean Control chart Converse (logic)Correlation and dependence Correlogram Count data Counting measure Coverage probability Cox's theorem Credible interval Crime statistics Cromwell's rule Cross-correlation Cross-sectional study Cross-validation (statistics)Cubic mean D. Reidel Data cleaning Data collection Data preprocessing Data transformation (statistics)David Cox (statistician)Decomposition of time series Degrees of freedom (statistics)Demographic statistics Density estimation Derivative Descriptive statistics Design matrix Design of experiments Detrending Diagnostic test Dickey–Fuller test Differencing Differential calculus Differentiation under the integral sign Dimensionality reduction Divergence (statistics)Durbin–Watson statistic Econometrics Effect size Efficiency (statistics)Elliptical distribution Empirical Bayes method Empirical distribution function Empirical likelihood Engineering statistics Environmental statistics Epidemiology Errors and residuals Estimating equations Euclidean space Event (probability theory)Evidence-based medicine Evidence lower bound Experiment Exponential families Exponential family Exponential smoothing Exponentiation Extreme value theorem F-test Factor analysis Factorial experiment Failure rate Fair coin Fan chart (statistics)Feature scaling First-hitting-time model Fisher's exact test Fisher information Fisher transformation Forest plot Foundations of statistics Fourier analysis Frequency distribution Frequency domain Frequentism Frequentist inference Frequentist probability Friedman test Frisch–Waugh–Lovell theorem Function (mathematics)Fundamental theorem of calculus G-test Gamma distribution Gary King (political scientist)General linear model Generalized linear model Generalized mean Geographic information system Geometric mean George Casella Geostatistics Goodness of fit Gradient Granger causality Graph of a function Graphical model Grouped data Harmonic mean Heatmap Heinz mean Heronian mean Hessian matrix Hirotugu Akaike Histogram History of probability History of statistics Hodges–Lehmann estimator Homoscedasticity and heteroscedasticity Hypergeometric distribution Improper prior Independence (probability theory)Independent and identically distributed random variables Index of dispersion Information content Information matrix Information theory Inner product Integrated nested Laplace approximations Interaction (statistics)Interquartile range Interval (mathematics)Interval estimation Inverse function Inverse function theorem Inverse probability Isotonic regression Jackknife resampling James G. Kalbfleisch James G. MacKinnon Jarque–Bera test Johansen test John Wiley & Sons Johns Hopkins University Press Joint probability distribution Jonckheere's trend test Journal of the American Statistical Association Journal of the Royal Statistical Society Journal of the Royal Statistical Society, Series B Jurimetrics Kaplan–Meier estimator Kendall rank correlation coefficient Kolmogorov–Smirnov test Kriging Kruskal–Wallis test Kurtosis L-moment Laplace's approximation Laplace approximation Law of likelihood Least-squares spectral analysis Lehmann–Scheffé theorem Lehmer mean Likelihood-ratio test Likelihood interval Likelihood principle Likelihood ratios in diagnostic testing Likelihoodism Likelihoodist statistics Lilliefors test Line chart Linear discriminant analysis Linear regression List of fields of application of statistics List of statistical tests List of statistics articles Ljung–Box test Location parameter Location–scale family Log-partition function Log-probability Log-rank test Log transformation Logarithmically concave function Logistic regression Loss function Lp space M-estimator Mann–Whitney U test Marginal likelihood Markov chain Monte Carlo Mathematical Proceedings of the Cambridge Philosophical Society Mathematical optimization Maximum a posteriori estimation Maximum likelihood Maximum likelihood estimate Maximum likelihood estimation McNemar's test Mean Median Median-unbiased estimator Medical statistics Method of maximum likelihood Method of moments (statistics)Methods engineering Michael D. Ward Middle English Minimum-variance unbiased estimator Minimum distance estimation Min–max normalization Missing data Mixed model Mode (statistics)Model selection Model specification Moment (mathematics)Monotone likelihood ratio Morse theory Mountain pass theorem Multiple comparisons Multivariate adaptive regression splines Multivariate analysis of variance Multivariate distribution Multivariate normal distribution Multivariate statistics Murray Aitkin National accounts Natural experiment Negative definite Nelson–Aalen estimator Nested sampling algorithm Neyman–Pearson lemma Nonlinear regression Nonparametric regression Nonparametric statistics Normalization (statistics)North-Holland Publishing Nuisance parameter Objective function Observational study Odds Official statistics One- and two-tailed tests Open neighborhood Open set Opinion poll Optimal decision Optimal design Order statistic Ordinary least squares Outcome (probability)Outlier Outline of statistics Oxford University Press Parameter space Parametric model Parametric statistics Partial autocorrelation function Partial correlation Partial derivative Partition of a set Partition of sums of squares Patrick Billingsley Pearson correlation coefficient Pearson product-moment correlation coefficient Percentile Permutation test Phylogenetics Pie chart Pivotal quantity Plug-in principle Point estimation Poisson regression Population (statistics)Population statistics Positive definite Posterior predictive distribution Posterior probability Power (statistics)Power transform Precision (statistics)Prediction interval Princeton University Press Principal component analysis Principle of indifference Principle of maximum entropy Prior probability Probabilistic design Probability density function Probability distribution Probability mass function Probability theory Product rule Projection matrix Proportional hazards model Prosecutor's fallacy Pseudo-R-squared Pseudolikelihood Psychometrics Quality control Quasi-experiment Questionnaire Q–Q plot Radar chart Radon–Nikodym theorem Random assignment Random variable Randomization test Randomized controlled trial Randomized experiment Range (statistics)Rank correlation Ranking (statistics)Rao–Blackwell theorem Realization (probability)Regression analysis Regression validation Relative likelihood Reliability engineering Replication (statistics)Resampling (statistics)Residual maximum likelihood Robust regression Robust statistics Roger Lee Berger Rolle's theorem Ronald Fisher Run chart Sample mean Sample median Sample size determination Sampling (statistics)Sampling distribution Sampling with replacement Scale parameter Scatter plot Scientific control Score (statistics)Score test Seasonal adjustment Semiparametric regression Shape of the distribution Shape parameter Shapiro–Wilk test Shorter Oxford English Dictionary Sign test Significance level Simple hypothesis Simple linear regression Simultaneous equations model Skewness Smoothness Social statistics Spatial analysis Spearman's rank correlation coefficient Spectral density estimation Springer-Verlag Stack Exchange Standard deviation Standard error Standard error (statistics)Standard score Stationary point Stationary process Statistic Statistical Science Statistical classification Statistical dispersion Statistical distance Statistical graphics Statistical hypothesis test Statistical hypothesis testing Statistical inference Statistical model Statistical parameter Statistical population Statistical power Statistical process control Statistical theory Statistics Stem-and-leaf display Stephen Fienberg Stochastic approximation Stratified sampling Strictly increasing Structural break Structural equation modeling Student's t-test Sufficient statistic Support (mathematics)Surprisal Survey methodology Survival analysis Survival function System identification Takeshi Amemiya Taylor expansion Test statistic The American Statistician Time domain Time series Tolerance interval Topographic profile Trend estimation Truncation (statistics)Tunghai University U-statistic Uniform prior Uniformly most powerful test Unit vector normalization Univariate Up-and-Down Designs V-statistic Van der Waerden test Variance Variance-stabilizing transformation Variational Bayesian methods Vector autoregression Violin plot Wald test Wavelet Well-defined Whittle likelihood Wilcoxon signed-rank test Wiley (publisher)Wilks' theorem Winsorizing Yeo–Johnson transformation Z-test

16 concepts already in your glossary