[MURG] Neuropeptide Function?

[Randal A. Koene]

Hi All,

On Wed, 4 Feb 2004, Eugen Leitl wrote:

> I'm not worried about AIs people design and implement.
> I'm worried about AI designing AI. Current-generation worms can ramp up in
> minutes; you can show that a few-s worm is feasible in principle. You can
> cover a lot of search space with a planet full of hardware three decades
> downstream.

Certainly more than a year ago, there were long threads here (and on
another mailing list) about the possible danger to MU if AI achieves
sentience first. So, I have some sense of the possible danger perspective.
(See archives for more... although the search will be tedious. :)
But, this is an interesting new question: Is AI likely to be sentient? And
if so, how does that come about?
Eugene, I don't have the same AL (artificial life) experience as you do,
all I have is some knowledge about the diversity and stages of evolution
on Earth. If we equate the kind of AI that could be dangerous to MU with
human-level intelligence and sentience (self-awareness), then the evidence
around us points to two things: (1) Most life-forms with a brain don't
meet those criteria, so perhaps it is NOT obvious that AI would become
dangerous rapidly through an evolutionary a feedback loop. Sentience may
not be the obvious development. (2) Yes, it seems there is only space for
ONE species that meets the criteria. Where are those Neanderthals again
these days? Some cause for worry if human-level AI does appear before MU.
Now, I think it is quite possible that sentient AI comes about as a result
of intentional human endeavours. Not everyone shares our prudence, and
someone is bound to purposely create sentient AI. And from there... the
feedback loop is almost guaranteed (look at the feedback loops humans are
working at... AI is one part of that). Yet, there remains the question how
rapid that feedback loop can be as long as the AI still depends on human
intervention for its resource demands (e.g. truck drivers delivering
components, just to name one simple down-to-earth factor).

Cheers,
       Randal