Bayesian inference

Definition

Bayesian inference is a method of statistical inference in which Bayes' theorem is used to calculate a probability of a hypothesis, given prior evidence, and update it as more information becomes available. Fundamentally, Bayesian inference uses a prior distribution to estimate posterior probabilities. Bayesian inference is an important technique in statistics, and especially in mathematical statistics. Bayesian updating is particularly important in the dynamic analysis of a sequence of data. Bayesian inference has found application in a wide range of activities, including science, engineering, philosophy, medicine, sport, psychology, and law. In the philosophy of decision theory, Bayesian inference is closely related to subjective probability, often called "Bayesian probability".

Related concepts

Abraham Wald Accelerated failure time model Actuarial science Adaptive clinical trial Admissible decision rule Adrian Smith (statistician)Akaike information criterion Almost surely Amos Tversky An Essay Towards Solving a Problem in the Doctrine of Chances Analysis of covariance Analysis of variance Anderson–Darling test Andrew Gelman Andrey Kolmogorov Anscombe transform Antecedent (logic)Approximate Bayesian computation Arithmetic mean Arithmetic–geometric mean Artificial intelligence Asymptotic theory (statistics)Aubrey Clayton Autocorrelation Autoregressive conditional heteroskedasticity Autoregressive model Autoregressive–moving-average model Average absolute deviation Bar chart Bas van Fraassen Bayes' rule Bayes' theorem Bayes estimator Bayes factor Bayesian approaches to brain function Bayesian epistemology Bayesian estimator Bayesian hierarchical modeling Bayesian inference in marketing Bayesian inference in motor learning Bayesian inference in phylogeny Bayesian information criterion Bayesian linear regression Bayesian model averaging Bayesian model comparison Bayesian model selection Bayesian probability Bayesian search theory Bayesian statistics Bayesian tool for methylation analysis Bernstein–von Mises theorem Betting odds Beyond a reasonable doubt Bias of an estimator Binomial distribution Binomial regression Bioinformatics Biostatistics Biplot Blocking (statistics)Bogofilter Bootstrapping (statistics)Box plot Box–Cox transformation Box–Jenkins method Breusch–Godfrey test CRM114 (program)Canonical correlation Cartography Categorical variable Celestial mechanics Census Central limit theorem Central tendency Chemometrics Chi-squared test Clinical study design Clinical trial Closed-form expression Cluster analysis Cluster sampling Cochran–Mantel–Haenszel statistics Coefficient of determination Coefficient of variation Cohen's kappa Coherence (philosophical gambling strategy)Cohort study Cointegration Colin Howson Completeness (statistics)Compound probability distribution Conditional expectation Conditional probability Confidence interval Confidence intervals Confounding Conjugate prior Consequence relation Contingency table Continuous Individualized Risk Index Continuous probability distribution Contraharmonic mean Control chart Correlation and dependence Correlogram Count data Cox's theorem Credence (statistics)Credibility theory Credible interval Crime statistics Cromwell's rule Cross-correlation Cross-sectional study Cross-validation (statistics)Cubic mean DSPAM Daniel Kahneman Data cleaning Data collection Data preprocessing Data transformation (statistics)David A. Freedman (statistician)David Miller (philosopher)David R. Cox Decision theory Decomposition of time series Degrees of freedom (statistics)Demographic statistics Dennis V. Lindley Density estimation Descriptive statistics Design of experiments Detrending Dickey–Fuller test Differencing Dimensionality reduction Divergence (statistics)Donald Rubin Durbin–Watson statistic Dutch book E-mail spam Econometrics Econophysics Edwin Thompson Jaynes Effect size Efficiency (statistics)Elliptical distribution Empirical Bayes method Empirical distribution function Empty set Encyclopedia of Mathematics Engineering Engineering statistics Environmental statistics Epidemiology Epistemology Erich Leo Lehmann Errors and residuals Estimating equations European Mathematical Society Evidence Evidence lower bound Evidence under Bayes' theorem Experiment Experimental data Expert system Expert witness Exponential family Exponential smoothing F-test Factor analysis Factorial experiment Failure rate Falsifiability Fan chart (statistics)Feature scaling First-hitting-time model Fisher transformation Forest plot Fourier analysis Free energy principle Frequency distribution Frequency domain Frequentist Frequentist inference Frequentist statistics Friedman test G-test Gambling and information theory Gaussian distribution General linear model Generalized linear model Generalized mean Geographic information system Geometric mean George E. P. Box George Tiao Geostatistics Gibbs sampling Goodness of fit Granger causality Graphical model Grouped data Harmonic mean Heatmap Heinz mean Heronian mean Histogram History of statistics Hodges–Lehmann estimator Homoscedasticity and heteroscedasticity Hyperparameter (Bayesian statistics)Hypothesis Hypothesis testing Ian Hacking Independent and identically distributed Independent and identically distributed random variables Index of dispersion Inductive probability Inductive reasoning Information Information field theory Information gain Integrated nested Laplace approximations Interaction (statistics)Interquartile range Interval estimation Inverse probability Isotonic regression Jack Kiefer (mathematician)Jackknife resampling James Berger (statistician)Jarque–Bera test Jeffreys prior Johansen test Jonckheere's trend test Joseph L. Doob José-Miguel Bernardo Journal of the Royal Statistical Society Judea Pearl Jurimetrics Jurisprudence Justificationism K2-18b Kaplan–Meier estimator Karl Popper Kendall rank correlation coefficient Kolmogorov–Smirnov test Kriging Kruskal–Wallis test Kurtosis L-moment Lambda-CDM model Laplace's approximation Law Least-squares spectral analysis Lehmann–Scheffé theorem Lehmer mean Likelihood-ratio test Likelihood function Likelihood interval Likelihood principle Lilliefors test Lindley's paradox Line chart Linear discriminant analysis Linear regression List of fields of application of statistics List of statistical tests List of statistics articles List of things named after Thomas Bayes Ljung–Box test Location parameter Location–scale family Log-rank test Log transformation Logical negation Logistic regression Loss function Lp space Lucien Le Cam M-estimator Machine learning Mann–Whitney U test Marginal distribution Marginal likelihood Markov chain Monte Carlo Mathematical statistics Maximum a posteriori estimation Maximum likelihood McNemar's test Mean Median Median-unbiased estimator Medical statistics Medicine Merriam-Webster Method of moments (statistics)Methods engineering Metropolis–Hastings algorithm Minimum-variance unbiased estimator Minimum distance estimation Min–max normalization Missing data Mixed model Mode (statistics)Model selection Model specification Moment (mathematics)Monotone likelihood ratio Monte Carlo method Morris H. DeGroot Mozilla Multiple comparisons Multivariate adaptive regression splines Multivariate analysis of variance Multivariate distribution Multivariate normal distribution Multivariate statistics National accounts Natural experiment Naïve Bayes classifier Nelson–Aalen estimator Nested sampling algorithm Nonlinear regression Nonparametric regression Nonparametric statistics Normal distribution Normalization (statistics)Observational study Occam's Razor Official statistics One- and two-tailed tests Open Court Publishing Company Opinion poll Optimal decision Optimal design Order statistic Ordinary least squares Outlier Outline of statistics P-value Parameter Parameter estimation Parametric statistics Partial autocorrelation function Partial correlation Partition of sums of squares Pattern recognition Paul Slovic Pearson correlation coefficient Pearson product-moment correlation coefficient Percentile Permutation test Persi Diaconis Philosophy Phylogenetics Pie chart Pierre-Simon Laplace Pivotal quantity Plug-in principle Point estimation Poisson regression Population (statistics)Population statistics Posterior distribution Posterior predictive distribution Posterior probability Power (statistics)Power transform Pranab K. Sen Prediction Prediction interval Predictive inference Principal component analysis Principle of indifference Principle of insufficient reason Principle of maximum entropy Prior distribution Prior predictive distribution Prior probability Probabilistic causation Probabilistic design Probabilistic numerics Probabilistic programming Probability distribution Probability kinematics Probability space Proportional hazards model Psychology Psychometrics Quality control Quasi-experiment Questionnaire Q–Q plot Radar chart Radon–Nikodym theorem Random assignment Random vector Randomization test Randomized controlled trial Randomized experiment Range (statistics)Rank correlation Ranking (statistics)Rao–Blackwell theorem Regina versus Denis John Adams Regression analysis Regression validation Reliability (statistics)Reliability engineering Replication (statistics)Resampling (statistics)Richard C. Jeffrey Risk Robust regression Robust statistics Run chart Sample median Sample size determination Sampling (statistics)Sampling distribution Scale parameter Scatter plot Science Scientific control Scientific method Score test Seasonal adjustment Semiparametric regression Sequential analysis Shape of the distribution Shape parameter Shapiro–Wilk test Sign test Significance (journal)Simple linear regression Simultaneous equations model Skewness Social statistics Solomonoff's theory of inductive inference SpamAssassin SpamBayes Spatial analysis Spearman's rank correlation coefficient Spectral density estimation Sport Standard deviation Standard error Standard score Stationary process Statistic Statistical classification Statistical decision theory Statistical dispersion Statistical distance Statistical graphics Statistical hypothesis test Statistical inference Statistical model Statistical parameter Statistical population Statistical power Statistical process control Statistical theory Statistics Stem-and-leaf display Stochastic approximation Stochastic scheduling Stratified sampling Structural break Structural equation modeling Student's t-distribution Student's t-test Sufficient statistic Survey methodology Survival analysis Survival function System identification Thomas Bayes Time domain Time series Tolerance interval Trend estimation Truncation (statistics)U-statistic Uniformly most powerful test Unit vector normalization Up-and-Down Designs V-statistic Van der Waerden test Variance Variance-stabilizing transformation Variational Bayesian methods Vector autoregression Vicious circle Violin plot Wald test Wavelet Whittle likelihood Wilcoxon signed-rank test Winsorizing Yeo–Johnson transformation Z-test

23 concepts already in your glossary