Algorithmic information theory

Definition

Algorithmic information theory (AIT) is a branch of theoretical computer science that concerns itself with the relationship between computation and information of computably generated objects, such as strings or any other data structure. In other words, it is shown within algorithmic information theory that computational incompressibility "mimics" the relations or inequalities found in information theory. According to Gregory Chaitin, it is "the result of putting Shannon's information theory and Turing's computability theory into a cocktail shaker and shaking vigorously."

Related concepts

Accelerated failure time model Actuarial science Adaptive clinical trial Akaike information criterion Alan Turing Algorithmic probability Algorithmically random sequence Analysis of covariance Analysis of variance Anderson–Darling test Andrey Kolmogorov Anscombe transform Arithmetic mean Arithmetic–geometric mean Asymptotic complexity Asymptotic theory (statistics)Autocorrelation Autoregressive conditional heteroskedasticity Autoregressive model Autoregressive–moving-average model Average absolute deviation Axiom Bar chart Bayes' rule Bayes estimator Bayes factor Bayesian inference Bayesian information criterion Bayesian linear regression Bayesian probability Bias of an estimator Binomial regression Bioinformatics Biostatistics Biplot Blocking (statistics)Blum axioms Bootstrapping (statistics)Box plot Box–Cox transformation Box–Jenkins method Breusch–Godfrey test Caltech Canonical correlation Cartography Categorical variable Census Central limit theorem Central tendency Chaitin's constant Chemometrics Chi-squared test Claude Shannon Clinical study design Clinical trial Cluster analysis Cluster sampling Cochran–Mantel–Haenszel statistics Coefficient of determination Coefficient of variation Cohen's kappa Cohort study Cointegration Completeness (statistics)Computability theory Computational complexity theory Computational indistinguishability Confidence interval Confounding Consistent Contingency table Continuous probability distribution Contraharmonic mean Control chart Correlation and dependence Correlogram Count data Credible interval Crime statistics Cross-correlation Cross-sectional study Cross-validation (statistics)Cubic mean Data cleaning Data collection Data compression Data preprocessing Data structure Data transformation (statistics)Decomposition of time series Degrees of freedom (statistics)Demographic statistics Density estimation Descriptive statistics Design of experiments Detrending Dickey–Fuller test Differencing Dimensionality reduction Distribution ensemble Divergence (statistics)Durbin–Watson statistic Econometrics Effect size Efficiency (statistics)Elliptical distribution Empirical distribution function Engineering statistics Entropy (information theory)Environmental statistics Epidemiology Epistemology Errors and residuals Estimating equations Experiment Exponential family Exponential smoothing F-test Factor analysis Factorial experiment Failure rate Fan chart (statistics)Feature scaling First-hitting-time model Fisher transformation Forest plot Formal system Fourier analysis Frequency distribution Frequency domain Frequentist inference Friedman test G-test General linear model Generalized linear model Generalized mean Geographic information system Geometric mean Geostatistics Goodness of fit Granger causality Graphical model Gregory Chaitin Grouped data Gödel's incompleteness theorem Halting problem Harmonic mean Heatmap Heinz mean Heronian mean Histogram Hodges–Lehmann estimator Homoscedasticity and heteroscedasticity Independent and identically distributed Index of dispersion Inductive probability Inductive reasoning Information Information theory Integer Interaction (statistics)Interquartile range Interval estimation Intuition (knowledge)Invariance theorem (disambiguation)Isotonic regression Jackknife resampling Jarque–Bera test Johansen test Jonckheere's trend test Jurimetrics Kaplan–Meier estimator Kendall rank correlation coefficient Kolmogorov complexity Kolmogorov–Smirnov test Kriging Kruskal–Wallis test Kurtosis L-moment Least-squares spectral analysis Lebesgue measure Lehmann–Scheffé theorem Lehmer mean Leonid Levin Likelihood Likelihood-ratio test Likelihood function Likelihood interval Lilliefors test Limit of a sequence Line chart Linear discriminant analysis Linear regression List of fields of application of statistics List of statistical tests List of statistics articles Ljung–Box test Location parameter Location–scale family Log-rank test Log transformation Logistic regression Loss function Lp space M-estimator Mann–Whitney U test Manuel Blum Markov chain Maximum a posteriori estimation Maximum likelihood Maxwell's daemon McNemar's test Mean Measure (mathematics)Median Median-unbiased estimator Medical statistics Metamathematics Method of moments (statistics)Methods engineering Minimum-variance unbiased estimator Minimum description length Minimum distance estimation Minimum message length Min–max normalization Missing data Mixed model Mode (statistics)Model selection Model specification Moment (mathematics)Monotone likelihood ratio Multiple comparisons Multivariate adaptive regression splines Multivariate analysis of variance Multivariate distribution Multivariate normal distribution Multivariate statistics National accounts Natural experiment Nelson–Aalen estimator Nonlinear regression Nonparametric regression Nonparametric statistics Normal number Normalization (statistics)Observational study Official statistics One- and two-tailed tests Opinion poll Optimal decision Optimal design Order statistic Ordinary least squares Outlier Outline of statistics Parametric statistics Partial autocorrelation function Partial correlation Partition of sums of squares Pearson correlation coefficient Pearson product-moment correlation coefficient Per Martin-Löf Percentile Permutation test Pie chart Pivotal quantity Plug-in principle Point estimation Poisson regression Population (statistics)Population statistics Posterior probability Power (statistics)Power transform Prediction interval Prefix code Principal component analysis Prior probability Probabilistic design Probability distribution Program (computing)Programming language Proportional hazards model Pseudorandom ensemble Pseudorandom generator Psychometrics Quality control Quasi-experiment Questionnaire Q–Q plot Radar chart Random assignment Randomization test Randomized controlled trial Randomized experiment Range (statistics)Rank correlation Ranking (statistics)Rao–Blackwell theorem Ray Solomonoff Regression analysis Regression validation Reliability engineering Replication (statistics)Resampling (statistics)Rigour Robust regression Robust statistics Run chart Sample median Sample size determination Sampling (statistics)Sampling distribution Scale parameter Scatter plot Scholarpedia Scientific control Score test Seasonal adjustment Semiparametric regression Shannon's source coding theorem Shape of the distribution Shape parameter Shapiro–Wilk test Sign test Simple linear regression Simplicity theory Simultaneous equations model Skewness Social statistics Solomonoff's theory of inductive inference Spatial analysis Spearman's rank correlation coefficient Spectral density estimation Standard deviation Standard error Standard score Stationary process Statistic Statistical classification Statistical dispersion Statistical distance Statistical graphics Statistical hypothesis test Statistical inference Statistical model Statistical parameter Statistical population Statistical power Statistical process control Statistical theory Statistics Stem-and-leaf display Stochastic approximation Stochastic process Stratified sampling String (computer science)Structural break Structural equation modeling Student's t-test Sufficient statistic Survey methodology Survival analysis Survival function System identification Theoretical computer science Theory (mathematical logic)Theory of computation Time domain Time series Tolerance interval Trend estimation Truncation (statistics)U-statistic Uniformly most powerful test Unit vector normalization Universal Turing machine Up-and-Down Designs V-statistic Van der Waerden test Variance Variance-stabilizing transformation Vector autoregression Violin plot Wald test Wavelet Whittle likelihood Wilcoxon signed-rank test Winsorizing Yeo–Johnson transformation Yongge Wang Z-test

23 concepts already in your glossary