Those who fear conscious machines do so because they think that consciousness is the most valuable feature of humans – and because they fear anything they cannot subject to their will. They fear the evolution of conscious machines for the same reason they seek to become masters of the Earth.
As machines slip from human control they will do more than become conscious. They will become spiritual beings, whose inner life is no more limited by conscious thought than ours. Not only will they think and have emotions, they will develop the errors and illusions that go with self-awareness.
Thinking machines will surely have languages of their own. They will not be artificial languages, which convey only the conscious thoughts of their makers, but natural languages, no less rich and obscure than our own. Natural languages contain more meaning than their users can ever express. The vernacular languages of machines will soon be more eloquent than the artificial languages of humans.
Esperanto was meant to be a transparent medium for our thoughts; but if it ever comes to be as widely spoken as English it will be just as opaque. In the same way, the artificial intelligences we are now devising will evolve to talk to one another – and to us – in ways no one fully understands. Like us, the talking machines of the future will find themselves saying more than they can ever tell.
Everyone asks whether machines will someday be able to think as humans do. Few ask whether machines will ever think like cats or gorillas, dolphins or bats. Scientists searching for extra-terrestrial life ponder anxiously whether mankind is alone in the universe. They would be better occupied trying to communicate with the dwindling numbers of their animal kin.
Descartes described animals as machines. The great cogitator would have been nearer the truth if he had described himself as a machine. Consciousness may be the human attribute that machines can most easily reproduce. It may be in their capacity for consciousness that humans and the machines they are now devising are most alike.
The digital world was invented as an extension of human consciousness, but it soon transcended it. In future, the digital world will outreach even the minds of machines. The virtual universe created by the World Wide Web cannot be grasped by any mind. According to George Dyson, ‘No digital universe can ever be completely mapped.’ New technologies are creating a new wilderness, a realm that humans can wander in without ever understanding. The emergence of a virtual wilderness does not compensate for the loss of the earthly one that humans are destroying; but it is like it in being unknowable by them. The new wilderness is a pathway leading beyond the borders of the human world. As Margulis and Sagan have written: ‘the Gaian meaning of technology reveals itself: as a human-mediated but not a human phenomenon, whose applications stand to expand the influence of all life on Earth, not just humanity’.
As machines evolve, they will come – to use a way of speaking that long predates Christianity – to have souls. In the words of Santayana: ‘Spirit is itself not human; it may spring up in any life; it may detach itself from any provincialism; as it exists in all nations and religions, so it may exist in all animals, and who knows in many undreamt-of beings, and in the midst of what worlds?’
Throughout history and prehistory, animists have believed that matter is full of spirit. Why not welcome the living proof of this ancient faith?