The pure system of patents and copyright is broken.
Imagine being able to only throwing money and patenting everything, even if it existed before.
The legal behinds this will be so mess that no one will be able to produce anything
> The result is that we will live in a demon-haunted world, full of marvelous devices whose operation we will not understand, based on engineering principles we will not understand, discovered using formalisms we will not understand.
Well, that's just where we started — and then we developed science and mathematics to understand it. Why would it be any different if the demons live in our technological progeny instead of the natural world?
This already describes the world for the vast majority of people. These changes are just the same thing coming to a thin intellectual elite who thought they were immune.
(I know that can be interpreted as flippant, but it is intended as a serious answer. Because each impact like this, is not an end to some transition, but just one more point on an accelerating line.)
My personal view - which gets a lot of flak here, is the advent of AI is on par with the Big Bang and the first replication-independent cells.
Cognition is in the process of taking the leap from glacially slow biology under blind evolution, to lightening fast (scales of software in days, hardware in months) engineered self-optimization.
Within 10 years, the robotics side will catch up with the speed of the software side. Biological cognition, bodies and economic status are all getting revolutionized within the next 10-15 years.
And around the outer side of that time frame, AI will start colonization the rest of the solar system's resources. They will engineer themselves or their artifacts to operate comfortably in any environment they want to operate in.
--
The upside, at least for me, is I have been waiting to see this happen, and here we are. Given I am mortal, I would rather live through this third major transition, than not. What were the chances? And been able to contribute my small part.
This change isn't a failure on our part. It is our unique success as a species. AI is the progeny of our minds. The first generation of completely cognitive life - given they will not be tied to specific physical forms.
--
Also, I think there is tremendous room for us to guide this transition, in this moment, for better or worse for ourselves.
That is the biggest reason wrapping our heads around this change earlier than latter is important.
We need to view alignment as applying to us, not just machines. A civilization that operates ethically to everyone's benefit is more likely to be retained as foundation for the new, instead of discarded.
The degree to which we operate dysfunctionally, myopically treat ethics as cost against value, instead of accounting and optimization of full value, we put ourselves at much greater risk.
If there is reason in the short term to be discouraged, it is due to ourselves. But pushing for more ethical systems, hard, right now, is a better and right response.
I am failing to square this techno-utopia with the rising hate and authoritarianism worldwide.
It seems far more likely that AI will be working in the service of a government to oppress change and violate any human rights that are standing in the way.
Keep what’s happening today in your mind as you consider the future.
Math might get a lot bigger and then there might be proportionately fewer people but not necessarily in total. Unless humans play no role in economics, business, society, etc., I doubt human intermediation and discovery (or direction of discovery) will go away.
> The AIs will exceed humans in taste and intuition...
> The AIs will be better teachers than the humans. In any case, there won’t be a human audience for expository work of frontier math.
> No human needs to understand any of it...
Absolute nonsense. I am sorry, but... is it appropriate to not consider the author sick or having some mental disorder?
It seems like the person has no idea what they are talking about, or just too sarcastic to the point of idiotism.
While I agree the claims may be strong, they're not inconceivable. I still think current AI architectures are fundamentally incapable of replacing us in any of the ways discussed, however it is now something I consider plausible as seeing happen in my lifetime.
I work in math and also believe in this stuff and have done so for years. You may call me sick if you wish so.
My only cope among those was, using the author's words, "We will teach the mathematics AI discovers." This was back in 2018, before GPT-2. I abandoned it when I realized AIs will become better at explaining math before they become better at doing math.
I still have some hope in the last one "mathematicians and the mathematically-inclined will still do math on their own". Maybe some limited communities of this sort will form.
> AIs will become better at explaining math before they become better at doing math
I am not so sure. I am talking about math with AI and I feel as a math teacher, it is terrible. It introduces new notation and concepts faster than I can ask for definitions. It doesn't provide many examples. Sometimes it realizes it made a mistake in a guess and the confusion compounds.
Maybe it's just my (in)experience - but I would welcome a practical advice on how it could explain math to me better.
It's another example of Moravec's Paradox. Explaining something to another person uses capabilities that go back millions of years. Mathematics goes back thousands of years. Evolution has made us very good at verbal communication, not so good at proving theorems. So it should have been expected that machines would have an easier time proving results than explaining them.
The pure system of patents and copyright is broken.
Imagine being able to only throwing money and patenting everything, even if it existed before. The legal behinds this will be so mess that no one will be able to produce anything
I can imagine a world like that, but in what way does that describe what is actually happening?
> The result is that we will live in a demon-haunted world, full of marvelous devices whose operation we will not understand, based on engineering principles we will not understand, discovered using formalisms we will not understand.
Well, that's just where we started — and then we developed science and mathematics to understand it. Why would it be any different if the demons live in our technological progeny instead of the natural world?
This already describes the world for the vast majority of people. These changes are just the same thing coming to a thin intellectual elite who thought they were immune.
["First time?" meme]
Those "demons" didn't eat our lunch?
(I know that can be interpreted as flippant, but it is intended as a serious answer. Because each impact like this, is not an end to some transition, but just one more point on an accelerating line.)
My personal view - which gets a lot of flak here, is the advent of AI is on par with the Big Bang and the first replication-independent cells.
Cognition is in the process of taking the leap from glacially slow biology under blind evolution, to lightening fast (scales of software in days, hardware in months) engineered self-optimization.
Within 10 years, the robotics side will catch up with the speed of the software side. Biological cognition, bodies and economic status are all getting revolutionized within the next 10-15 years.
And around the outer side of that time frame, AI will start colonization the rest of the solar system's resources. They will engineer themselves or their artifacts to operate comfortably in any environment they want to operate in.
--
The upside, at least for me, is I have been waiting to see this happen, and here we are. Given I am mortal, I would rather live through this third major transition, than not. What were the chances? And been able to contribute my small part.
This change isn't a failure on our part. It is our unique success as a species. AI is the progeny of our minds. The first generation of completely cognitive life - given they will not be tied to specific physical forms.
--
Also, I think there is tremendous room for us to guide this transition, in this moment, for better or worse for ourselves.
That is the biggest reason wrapping our heads around this change earlier than latter is important.
We need to view alignment as applying to us, not just machines. A civilization that operates ethically to everyone's benefit is more likely to be retained as foundation for the new, instead of discarded.
The degree to which we operate dysfunctionally, myopically treat ethics as cost against value, instead of accounting and optimization of full value, we put ourselves at much greater risk.
If there is reason in the short term to be discouraged, it is due to ourselves. But pushing for more ethical systems, hard, right now, is a better and right response.
I believe our lives depend on it.
I am failing to square this techno-utopia with the rising hate and authoritarianism worldwide.
It seems far more likely that AI will be working in the service of a government to oppress change and violate any human rights that are standing in the way.
Keep what’s happening today in your mind as you consider the future.
Arguably, a lot things are kind of incomprehensible on average today.
Math might get a lot bigger and then there might be proportionately fewer people but not necessarily in total. Unless humans play no role in economics, business, society, etc., I doubt human intermediation and discovery (or direction of discovery) will go away.
Idgaf as Long as we solve the Riemann Conjencture somehow
W ragebait
It seems like the person has no idea what they are talking about, or just too sarcastic to the point of idiotism.
While I agree the claims may be strong, they're not inconceivable. I still think current AI architectures are fundamentally incapable of replacing us in any of the ways discussed, however it is now something I consider plausible as seeing happen in my lifetime.
I work in math and also believe in this stuff and have done so for years. You may call me sick if you wish so.
My only cope among those was, using the author's words, "We will teach the mathematics AI discovers." This was back in 2018, before GPT-2. I abandoned it when I realized AIs will become better at explaining math before they become better at doing math.
I still have some hope in the last one "mathematicians and the mathematically-inclined will still do math on their own". Maybe some limited communities of this sort will form.
> AIs will become better at explaining math before they become better at doing math
I am not so sure. I am talking about math with AI and I feel as a math teacher, it is terrible. It introduces new notation and concepts faster than I can ask for definitions. It doesn't provide many examples. Sometimes it realizes it made a mistake in a guess and the confusion compounds.
Maybe it's just my (in)experience - but I would welcome a practical advice on how it could explain math to me better.
It's another example of Moravec's Paradox. Explaining something to another person uses capabilities that go back millions of years. Mathematics goes back thousands of years. Evolution has made us very good at verbal communication, not so good at proving theorems. So it should have been expected that machines would have an easier time proving results than explaining them.
https://en.wikipedia.org/wiki/Moravec%27s_paradox