Distilling Free-Form Natural Laws from Experimental Data
Abstract
For centuries, scientists have attempted to identify and document analytical laws that underlie physical phenomena in nature. Despite the prevalence of computing power, the process of finding natural laws and their corresponding equations has resisted automation. A key challenge to finding analytic relations automatically is defining algorithmically what makes a correlation in observed data important and insightful. We propose a principle for the identification of nontriviality. We demonstrated this approach by automatically searching motion-tracking data captured from various physical systems, ranging from simple harmonic oscillators to chaotic double-pendula. Without any prior knowledge about physics, kinematics, or geometry, the algorithm discovered Hamiltonians, Lagrangians, and other laws of geometric and momentum conservation. The discovery rate accelerated as laws found for simpler systems were used to bootstrap explanations for more complex systems, gradually uncovering the “alphabet” used to describe those systems.
Get full access to this article
View all available purchase options and get full access to this article.
Already a Subscriber?Sign In
Supplementary Material
References and Notes
1
P. W. Anderson, Science177, 393 (1972).
2
E. Noether, Nachr. d. König Gesellsch. d. Wiss. zu Göttingen, Math-Phys. Klasse235 (1918).
3
J. Hanc, S. Tuleja, M. Hancova, Am. J. Phys.72, 428 (2004).
4
D. Clery, D. Voss, Science308, 809 (2005).
5
A. Szalay, J. Gray, Nature440, 413 (2006).
6
R. E. Valdés-Pérez, Commun. Assoc. Comput. Mach.42, 37 (1999).
7
R. D. Kinget al., Nature427, 247 (2004).
8
P. Langley, Cogn. Sci.5, 31 (1981).
9
R. M. Jones, P. Langley, Comput. Intell.21, 480 (2005).
10
J. R. Koza, Genetic Programming: On the Programming of Computers by Means of Natural Selection. (MIT Press, Cambridge, MA, 1992).
11
S. Forrest, Science261, 872 (1993).
12
J. Duffy, J. Engle-Warnick, Evolutionary Computation in Economics and Finance100, 61 (2002).
13
F. Cyril, B. Alberto, in 2007 IEEE Congress on Evolutionary Computation, S. Dipti, W. Lipo, Eds. (IEEE Press, Singapore, 2007), pp. 23–30.
14
B. Elena, B. Andrei, L. Henri, in Seventh International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC '05) (IEEE Press, 2005), pp. 321–324.
15
J. Bongard, H. Lipson, Proc. Natl. Acad. Sci. U.S.A.104, 9943 (2007).
16
S. Nee, N. Colegrave, S. A. West, A. Grafen, Science309, 1236 (2005).
17
P. Jäckel, T. Mullin, Proc. R. Soc. London Ser. A454, 3257 (1998).
18
T. Shinbrot, C. Grebogi, J. Wisdom, J. A. Yorke, Am. J. Phys.60, 491 (1992).
19
Y. Liang, B. Feeny, Nonlinear Dyn.52, 181 (2008).
20
M. Mor, A. Wolf, O. Gottlieb, in Proceedings of the 21st ASME Biennial Conference on Mechanical Vibration and Noise (ASME Press, Las Vegas, NV, 2007), pp. 1–8.
21
P. Gregory, R. Denis, F. Cyril, in Evolution Artificielle, 6th International Conference, vol. 2936, L. Pierre, C. Pierre, F. Cyril, L. Evelyne, S. Marc, Eds. (Springer, Marseilles, France, 2003), pp. 267–277.
22
E. D. De Jong, J. B. Pollack, in Genetic Programming and Evolvable Machines, vol. 4 (Springer, Berlin, 2003), pp. 211–233.
23
S. H. Strogatz, Nature410, 268 (2001).
24
P. A. Marquet, Nature418, 723 (2002).
25
This research was supported in part by Integrative Graduate Education and Research Traineeship program in nonlinear systems, a U.S. NSF graduate research fellowship, and NSF Creative-IT grant 0757478 and CAREER grant 0547376. We thank M. Kurman for editorial consultation and substantive editing of the manuscript.
Information & Authors
Information
Published In

Science
Volume 324 | Issue 5923
3 April 2009
3 April 2009
Copyright
American Association for the Advancement of Science.
Submission history
Received: 15 September 2008
Accepted: 19 February 2009
Published in print: 3 April 2009
Authors
Metrics & Citations
Metrics
Article Usage
Altmetrics
Citations
Export citation
Select the format you want to export the citation of this publication.
Cited by
- Precise control of water and wastewater treatment systems with non-ideal heterogeneous mixing models and high-fidelity sensing, Chemical Engineering Journal, 430, (132819), (2022).https://doi.org/10.1016/j.cej.2021.132819
- Cluster-based network modeling—From snapshots to complex dynamical systems, Science Advances, 7, 25, (2021)./doi/10.1126/sciadv.abf5006
- Data-driven approximations to the bridge function yield improved closures for the Ornstein–Zernike equation, Soft Matter, 17, 21, (5393-5400), (2021).https://doi.org/10.1039/D1SM00402F
- Learning physically consistent differential equation models from data using group sparsity, Physical Review E, 103, 4, (2021).https://doi.org/10.1103/PhysRevE.103.042310
- Discovery of Dynamics Using Linear Multistep Methods, SIAM Journal on Numerical Analysis, 59, 1, (429-455), (2021).https://doi.org/10.1137/19M130981X
- A linked-scale coupled model of mass erosion and redistribution in plasma-exposed micro-foam surfaces, Journal of Nuclear Materials, 553, (153010), (2021).https://doi.org/10.1016/j.jnucmat.2021.153010
- IDENT: Identifying Differential Equations with Numerical Time Evolution, Journal of Scientific Computing, 87, 1, (2021).https://doi.org/10.1007/s10915-020-01404-9
- Revised learning based evolutionary assistive paradigm for surrogate selection (LEAPS2v2), Computers & Chemical Engineering, 152, (107385), (2021).https://doi.org/10.1016/j.compchemeng.2021.107385
- Comparison of Three Different Satellite-Based Approaches for Aboveground Biomass Estimation, PFG – Journal of Photogrammetry, Remote Sensing and Geoinformation Science, 89, 1, (33-47), (2021).https://doi.org/10.1007/s41064-020-00134-9
- Analysis and prediction of COVID-19 epidemic in South Africa, ISA Transactions, (2021).https://doi.org/10.1016/j.isatra.2021.01.050
- See more
Loading...
View Options
Get Access
Log in to view the full text
AAAS login provides access to Science for AAAS members, and access to other journals in the Science family to users who have purchased individual subscriptions.
- Become a AAAS Member
- Activate your Account
- Purchase Access to Other Journals in the Science Family
- Account Help
Log in via OpenAthens.
Log in via Shibboleth.
More options
Purchase digital access to this article
Download and print this article for your personal scholarly, research, and educational use.
Buy a single issue of Science for just $15 USD.
View options
PDF format
Download this article as a PDF file
Download PDF





