Grey goo horror fable

From apm
Revision as of 09:33, 21 May 2021 by Apm (Talk | contribs) (→‎Related: added link to yet unwritten page * Interplanetary atomically precise von Neumann probes)

Jump to: navigation, search
The horror fable of the grey goo.
Picture: My Little Pony - The Smooze

Knowns:

  • SciFi shocker goo-ball earth: impossible
  • accident: impossible in the development process of advanced productive nanosystems
  • "mild" forms: probable after the development of advanced productive nanosystems (See: Reproduction hexagon)

Definition

The hypothetical grey goo scenario was born from the sensational image that some nanobots that where originally intended as a productive nanosystem will fail to stop replicating and start consuming the whole surface of the earth, leaving behind only a nasty grey goo of themselves. Not so hypothetically this idea self replicated in the public mind like crazy, despite being based on superficial assumptions. A successful meme. So unfortunately we ended up with the hypothetical grey goo scenario and its molecular assemblers in much more widespread knowledge than what serious investigations actually led to. Namely chip based productive nanosystems (here called gem-gum factories). And no global doomsday grey goo. Worse so this meme seems to have contributed a notable part in some unjustified reputation damage (see: History).

Current expert knowledge:

  • An accident like this is with a probability bordering on certainty impossible in the early development stages.
  • Deliberate development will start to become possible and rise in probability once technology level III is reached and will reach near certainty on further development. It will bring limited forms of this problem.
  • If official development will not be prohibited, there will be means for easy containment in place.
    In the analogy of "My Little Ponly" (the illustrative image on the top right is taken from that show) that means that by the time the evil folks release the "Smooze" we will have our "Flutterponies" to contain and control its outbreaks in more or less reasonable manner.

Beside grey goo one must not forget that there are other dangers that are equally or more dangerous than uncontrolled replication. If APM it is so darn dangerous, then why should we pursuing it instead of fighting and banning it?

  • Because the sheer amount of opportunities and products.
  • Because APM will be so tremendously useful that it will be both impossible and highly undesirable to outright fully ban.
  • Because its massive potential for improving and restoring natures world with no need for us humans cutting back on our activities. Heck, cutting back on our human activities doesn't even work on the scales it would be required to restore major parts of the the worlds rain forests. Such attempts if (they where voluntarily possible) would just massively backfire because scarcity (if it is not on an absolutely debilitating and extinguishing level) actually boosts population growth and thus makes us even more devastative.

Factors for large scale unbounded replication

The reproduction hexagon as an analog to the combustion triangle

Requirements

There are several factors which all must be true at the same time for an accelerating chain reaction to occur. In the fire department there one has the combustion triangle. With replicators one can do a similar thing and create an replication hexagon (since there are around six requirements which must hold simultaneously.

Replicativity

In early productive nanosystems self replicapility could be avoided by building many active components in parallel onto a chips surface.
Whether it is easier to create a T.Level I Nanofactory with replicativity or parallelism remains to be seen. 

In T.Level III productive nanosystems of the classic (deprecated) assembler type need to be replicative to produce macroscopic amounts of material.
Advanced nanofactories (in form of solid bricks) will almost certainly have self replication capability (think of 3D printing a printer chip).

Medical tools (in form of dispersed nanomachines) can be nonreplicative products this is the best security measure one can get. It may be reasonable to in general prohibit dispersion of nanosystems with replicative capability in liquids or gasses, but at some arbitrary size level a line has to be drawn.

Resources

  • In technology level I it is quite hard to produce the building blocks. The simple assembler mechanisms (at this stage one can think of them as linkages) can only put those whole preproduced blocks together.
  • In technology level II It's not yet clear which resources will be used.
  • In technology level III the not natural occurring ethine (= welding gas = HCCH) among other unnatural resource materials will be used.

Disassembly of nonstiff disordered natural substances is way harder then assembly of carefully chosen synthetic ones. In fact in many cases it's as good as impossible at room temperature. The humic substances (TODO: add picture) for example are hopelessly to complex to use them as resource material. Certain minerals may be directly disassemblable with substantial effort in the not so near future. The carbon dioxide in the air constitutes a vast reservoir of easily attainable building material. This source could pose a threat.
To investigate: minimal atmosphere-floating solar replicators Warning! you are moving into more speculative areas.

Energy

Productive nanosystems will likely get their energy from the chips surface - a good security measure.

In some cases energy can be drawn from the resource molecules. Dissolved sugar would be such a case, but it is not a good resource since it has way too much hydrogen. Its low stiffness may be a problem too.
In others not (carbon dioxide)

Mobiliy

Productive nanosystems will always have their components firmly linked together in machine phase. Only macroscopic blocks will separate.
[todo: describe: policy exceptions limits] mobility prevention guideline

Exponential assembly puts an absolute insurmountable limit to spacial spread of replicated structure.

Mutations

AP systems do not evolve by themselves. A mutation of a productive nanosystem to a new ecosystem is as likely as that firefox mutates to firegodzilla and infiltrates new operating systems. Due to the very different architecture of living organisms and APM systems radiation has a completely different effect on them.

Productive nanosystems may loose efficiency or function. Logical errors (which still are functional) are extremely unlikely.
Biological systems also loose efficiency and function but have a non neglectable chance to suffer still functional logical errors aka mutation instead

A good description of part of the situation: alive-ness of computer viruses
Also: can computer viruses evolve
Or: "Nanofuture" chapter 8 self replication by J. Storr Hall

Replication data

Is likely to be stored semi locally (millimeter scale) since it's convenient and disaster proof.

Antagonistic phenomena

Radiation damage as limiting factor

Especially in the atmosphere (with plenty of solar power and carbon dioxide raw material present) UV radiation that is short enough in wavelength to split even strong chemical bonds constitutes an additional limiting factor.

In the hydrosphere radiation is quickly filtered out by water when going deeper. But light is absorbed too, so a power source is missing.

Active detections and countermeasures

  • TODO ...

Macroscale "goo"

Main article: "gem-gum goo"

Radiation shielding, efficient long range movement for the gathering of energy and processing of more diverse resources all that can be archived much easier by much bigger replicative units (easily visible by the human eye). This is exactly the strategy the evolution of biological life has followed. But this would not be gray goo in the usual sense anymore.

This would be a scenario with much more sophisticated abiotic macro-replicators. It would require an extremely high development effort. If such replicators are omnivoric and adaptive enough, they may even deserve to be called an (invasive) abiotic artificial life form.

  • Accidental ingestions of these big replicators is less likely (only from decaying broken down units).
  • Catching few big replicators is obviously easier than many very small ones (except they feature self defense)
  • A likely development path may be via artificial pets for company mimicking real ones as closely as possible (ultra advanced "Aibo" robo-dog) then maliciously altered into replicators.

Big things have a big design space. So on the long run this scenario may lead to kind of a highly diverse parallel mechanosphere ecology.

Since our biosphere ecology would be defenseless against such a mechanosphere ecology (biology never evolved to eat rock the same way it eats hydrocarbons and likely never will) there will be a need to design systems to safe guard biosphere ecology. These systems may be part of the mechanosphere ecology itself (in sake of long term stability) or may be run in a more centralized control (in sake of keeping more control). Given the possibility of high intellingence for big replicating units the lines blur.

Biological analogies in earths history

On the long term in natures history unbounded self replication never lead to ultimate destruction by mono-cultures. Instead speciation lead to beautiful complexity. In how far can this be applied to artificial self replication? See: gem gum goo

In the past

Major empty (biological) ecological niches naturally where present in the early history of earth when earth was just "empty". Cyanobacteria came upon a carbon dioxide rich atmosphere above the seas and pretty much no competitors.

This lead to "the great oxygenation event". The accumulation of their excretion product oxygen in the atmosphere

  • back then oxygen which was toxic for many lifeforms.
  • the oxygen "burned" the methane in the atmosphere to carbon dioxide a much weaker greenhouse gas inducing the longest ice age in earths history (the Huronian glaciation)

A mass extinction followed.

Later in earths history it usually took major extinction events (not induced by life itself e.g. asteroid impacts) to clear some space (side-note: indicating life already ran into a "permanent" malthusian trap). The species most successful in filling in the new gap are prone to trample over even more species in their rampant growth. Species that otherwise would have survived the extinction event itself got (and get) wiped out. (On a much smaller scales a similar effect can be observed after a fire. Especially where fires are rare.)

In the carbonifeous period scale trees (strange looking compared to todays trees) for the first time produced lignin and that in large amounts. Its accumulation may well have had a extinction effect on many species. The first species able to eat and digest lignin (ending the carbonifeous) again might have had a period of explosive growth into the new niche with detrimental effects for other organisms.

Today - humans civisiastion as bio-goo or seeding bio-goo of feeding bio-goo

With our excessive agriculture great amounts of fertilizer are swept down the rivers into the sea this has induced unnaturally massive algae blooms leading to depletion of solvated oxygen in the water and consequently the emergence of horrifying dead zones reaching over vast expanses.

With our unnatural means of transport we often bring invasive species to new habitats (e.g. rats to almost everywhere, rabbits to australia, ...).

With our burning of oil and releasing as carbon dioxide oceans become more warm and acidic. All the organisms that use calcium carbonate for their structure (shells) dissolve and get wiped out. On land the effects are not as clear but change at this rapid rate will lead to an extinction / diversity loss that is much faster than evolution can compensate with buildup of new diversity.

(Side-note: "Our" crude oil stems from the aforementioned scaletrees. It's all the stuff that got buried and sealed away before lignin eaters evolved into existence and ate up all the stuff that came later after the carbonifeous period.) The most important resource ....

Future

The things about to come are fundamentally different in the way that some parts of gemstone based machinery (nano & macro) are fundamentally incompatible with the biosphere. Some parts behaves more like undegradable rocks. Evolution, while having plenty of time to try, never succeeded in using the lithosphere to the same degree it uses the hydrocarbon centered biosphere.

general pattern

Problems explosive growth can cause can be grouped in three categories:

  • depletion of needed resources
  • accumulation of troublesome waste
  • direct attack (pandemics)

Figurative analogies with water:

  • Dam break: a deeper empty reservoir symbolizing a big ecological niche that is empty for "the water" but filled with other value that gets devastated by "the water".
  • Sand dam break: a small trifle becoming increasingly faster until its a raging stream (exponential growth up to some point)
  • Water hammer: filling an empty void is fine but when the limits are reached some kind of abstract "inertia" can lead to a destructively overshoot

Examples for replicators from deliberate malicious intent

Microscale airborne carbon dioxide utilizing replicators

A form of these has been named "aerovores" (coined by J. Storrs Hall).
They are solar powered air "eating" (vore = eating) replicators.
Note the (mis)use of biological analogy here.
Which can lead people to thing about evolving omnivores, two properties hat very much *not* apply to maliciously created replicatios.

Here is a quick list of some aspects (each deserving its own in depth and in detail discussion):

  • Motivation: What would a group of bad actors be able to gain with this approach that they couldn't gain through more conventional warfare.
  • Will there be a point in time where a single lunatic individual (that does not act according to sane logic for his/her own benefit) will be able to cause this completely alone? Certainly not in the near future (seen from 2020). While most of the tech will go to more specialized devices, it seems reasonable to think that there will be also at least some use for slow, inefficient, but highly general purpose research subsystems. From todays persective it seems very unclear how heard it will be to circumvent the then present safety measures against making something nasty from them.
  • Much additional design effort (beyond nanofactories) may be needed because:
    (1) minimal nanofactory grains will probably be too big to qualify as being microscale - more assembler like system may need to be developed
    (2) there's the restriction to atmospheric elements C, O, H, N, and some traces of others.
  • Possible argument: When they emerge countermeasures will be in place (e.g. skysweepers - J. Storrs Hall).
    In other words: Effects of malicious AP systems must not be considered in context of today's technology.
    Possible further argument: dangerous unilateral disarmament on the defensive side through suppression of official research is imaginable.
  • How much does exposure to solar (UV) radiation reduce the time they remain operational
    (TODO: read Robert A. Freitas Jr. work on this & summarize it here)
    (TODO: Find, list, and extend research about radiation effect on microscale self replicating devices)
  • Adaptability: lack of adaptability - brittleness of artificial systems - but - emulated "evolution" in macro computing systems of the malicious actor?
  • Mobility: Brownian motion (and large surface area to mass ratio) allows small particles to fall very slowly. Given they are small enough even slight lift from solar warming can make them rise.

Threat from pollution -- berating in polluted air -- ingesting food grown in polluted soil (food chain)

Statistical mobility, microscale dispersedness and non-decomposability can make a really bad combination: causing widespread (indirectly) toxic spill.
It seems reasonable to assume that diamondoid / gemstone based replicators are not decomposable by the immune system.
Worst case inhaled or ingested material could encapsulate, may migrate and accumulate in the body and cause inflammatore or other undesirable reactions, rather than being quickly excreted. It seems reasonable to assume that breathing in even low macroscopic quantities of these may pose serious health hazard. Symptoms might be similar to silicosis, given quartz is such a non-decomposable case. But particles need to be smaller or actively propelled to stay afloat.

Just like pollen airborne microscale replicators can be rained out and washed into the ground.
This may change a bit if they are highly hydrophobic, but given this is malicious work the worst case scenario should be assumed. This way spill could get into the food chain.

Threat from resource depletion

  • If this really gets out of hand big time it could eventually lead to a high depletion of atmospheric CO2 endangering virtually all of plant life on earth. The complete opposite problem we face today. This would be a self delimiting effect, but way too late.

Microscale seaborne carbon dioxide utilizing replicators

Aspects that may make this a more dangerous threat:

  • Unlike in the airborne situation there is more protection against UV radiation.
  • This is a similar environment than in the bloodstream of higher animals and humans.
  • Unlike in the atmosphere in water the dissolved carbon dioxide and or oxygen can be completely depleted which would could lead to death zones.

(TODO: Read Robert Freitas work on "grey plankton" and summarize here.)

Other

Warning! you are moving into more speculative areas.

  • Atmospheric units that use CO2 as building material and sunlight as energy source potentially endangering plant life. In the worst case those thing could silently create huge amounts of Hydrogen Cyanide or NOx and release it in one blow.
  • Some form of green goo medical tools with replicative capabilities that uses sugar and other common bio-molecules as resource. Medical tools will by definition be in form of seperated particles suspended in fluid phase and thus much more mobile. There are no known investigations to break up sugar for this process.
  • When there is a whole global network of an AP system the hole system could be infected by a computer virus creating all sorts of strange effects from useful or funny over weird to really bad stuff. (Related: techno plants)
  • Loose nanomachines (from advances in technology level III) that combine the capabilities of medical devices with very compact molecular assembler like self replication capability and can use e.g. sugar or ATP as carbon and energy resources.

Similar phenomena

Microcomponent pipeline breach

In the case of the existance of a global microcomponent redistribution system there could be something happening that amounts to a software based pipe breach. The cause could be a software bug on top of very flawed software design or some malicious computer virus. Any non mobile stuff thats expulsed may eventually sooner or later clog the outlet. Specifically programmed utility fog though could flood a wide area. As long as the foglets don't leave one connected machine phase they may be easily retractable when the software problem is resolved. Pushout force safety limits should prevent mountain high pileup of material till it crushes under it's own weight.

Disassembly to microcomponents attack

Warning! you are moving into more speculative areas.

A (not desirable) system combining the capabilities of microcomponent maintainance units with utility fog could in thin layers flow around objects that are constituted from microcomponents and start disassembling it - intended or not. To defend against this attack physically one can use hierarchical locking for the outer surface of parts which converges to just a few combination lock stones.

Related

Look at all the life on earth, the biosphere, and the green forest cover of the earths continents visible from space. This is an example where self replication ran out of control globally. The final result is usually considered beautiful. Still intermediary hiccups on the path towards a rain forrest like state can be quite huge when taking the great oxygenation event as an analogy. Of course this analogy is far from directly applicable.

With gem-gum factories capable of self-replication on the long run or successors may eventually halfway "accidentally" arrive at something similar. A richer and even more colorful world -- while keeping nature intact. See: gem gum goo and zero sum situation

More on bad analogies:
Gem-gum technology is often confused and mixed up with the diametrically opposed field of synthetic biology. This is strengthening the misleading bio-analogies and makes the life like grey-goo-bot mythology spreads and thrive even better.

Purple earth:
What possibly dominated before the great oxygenation event
PBS Eons - When The Earth Was Purple- 2017-10-09
halobacteria (belonging to the archea) using retinal instead of chlorophyll

External links

Videos

  • PBS eons: "That Time Oxygen Killed Almost Everything" [1]
  • Purple goo / Purple earth hypothesis: PBS eons: "When The Earth Was Purple" [2]
Retrieved from "http://apm.bplaced.net/w/index.php?title=Grey_goo_horror_fable&oldid=9106"