The Unbearable Hardness of Physics

Physics 5, s43
Researchers have proved that extracting dynamical equations from data is in general a computationally hard problem.
T. S. Cubitt et al., Phys. Rev. Lett. (2012)

Physics students know from their late nights that working through the classic textbooks is hard. But can the anecdotal sense of “hardness” be given more rigorous foundation? More specifically, can the basic scientific problem of analyzing experimental data to ascertain the underlying equations be assessed for difficulty? In a paper in Physical Review Letters, Toby Cubitt at the Complutense University of Madrid, Spain, and colleagues have applied the tools used by computer science researchers to link notions of computational hardness to the difficulty of inferring dynamical equations from observational data.

Computer scientists classify computational hardness by how long it takes to solve a problem as a function of the size of the problem: cases in which the time is a polynomial function of size are in class P and are said to be “tractable” or “efficiently solvable” problems; problems for which the required time explodes exponentially with size are called NP-hard. The latter are something of a gold standard for computational complexity and can’t be solved efficiently.

Cubitt et al. prove theoretically that, regardless of experimental precision, deducing the dynamical equations that describe a system’s evolution is an NP-hard problem. The result applies to classical and quantum systems both, regardless of dynamical details. At the same time, the authors have also solved a 70-year-old puzzle in probability theory called the embedding problem, which relates to how a Markov process (i.e., one in which the system carries no memory) can be represented by transitions from state to state. Although the results may not comfort students burning the midnight oil, nor dissuade physicists from analyzing their data, the finding does have implications for generic automated inference machines that might boil data down to the underlying physics. – David Voss

Subject Areas

Interdisciplinary PhysicsComplex SystemsComputational Physics

Related Articles

Network Science Applied to Urban Transportation
Computational Physics

Network Science Applied to Urban Transportation

A simple model based on network theory can reproduce the complex structures seen in urban transportation networks. Read More »

Improving Assessments of Climate Tipping Points
Complex Systems

Improving Assessments of Climate Tipping Points

Statistical properties of fluctuations of certain parameters describing a complex system can reveal when that system is approaching a tipping point. Read More »

Drug-Resistance Mutations Find Strength in Small Numbers
Interdisciplinary Physics

Drug-Resistance Mutations Find Strength in Small Numbers

A new model, vetted by experiments on lung cancer cells, may help to explain how cancer and other diseases accumulate drug-resistance mutations that can compromise the effectiveness of treatments. Read More »

More Articles