Mitigating AI risk has become a topic of intense effort in recent years and months. These well-intentioned efforts grow out of real concern for the uncertain future given the rapid development of AI technologies. In the current form they are unlikely to succeed. The purpose of this document is to make a case that developing a fundamental mathematical theory of deep learning is a prerequisite for managing risk as our society transitions to wide use of AI technology. Theory in this context refers to identifying precise measurable quantities and mathematically describing their patterns, the way it is used in physics and engineering, rather than proving rigorous theorems. Recent progress in the theory of statistical inference and optimization of neural networks provides hope that such a theory may indeed be possible. Admittedly, even a comprehensive theory of deep learning cannot guarantee a successful AI transition. If we
Possible the most well-written and rigorous piece on safety I've read so far, may or may not changed my view on safety research as a whole! We indeed could really use more theories to cut through ambiguities and connect speculations with the empiricals.
> Theory in this context refers to identifying precise measurable quantities and mathematically describing their patterns, the way it is used in physics and engineering, rather than proving rigorous theorems. ~ there are many instances when internal developments in pure math later became very useful in physics and engineering. Maybe, there are already existing pieces of pure math knowledge which could be useful for mathematical descriptions of LLMs? To possible detect them, an interdiscplinary interaction between AI experts and interested pure mathematicians is required.
Indeed a great motivation for working towards theory :)
Possible the most well-written and rigorous piece on safety I've read so far, may or may not changed my view on safety research as a whole! We indeed could really use more theories to cut through ambiguities and connect speculations with the empiricals.
Although it's necessary, but very difficult.
A great piece about security, Can we get in contact to discuss further?
> Theory in this context refers to identifying precise measurable quantities and mathematically describing their patterns, the way it is used in physics and engineering, rather than proving rigorous theorems. ~ there are many instances when internal developments in pure math later became very useful in physics and engineering. Maybe, there are already existing pieces of pure math knowledge which could be useful for mathematical descriptions of LLMs? To possible detect them, an interdiscplinary interaction between AI experts and interested pure mathematicians is required.