View source for Safety towards and with gem based APM

The advent of gemstone based APM (gem-gum-tec) will come with many [[dangers]] and [[opportunities]].

This page is about dangers, risks, and mitigation strategies so we can have have a reasonably safe future world. <br>
But also about (mis)perception of risks and (potentially from that following) <br>
misdirected premature regulation and/or excessive surveillance and control. <br>
Which also is also a risk which must not be underestimated.

Regarding perception first and foremost note that:
* Discussion of runaway replication accidents is massively over-represented. And risk are typically overestimated.
* Discussion of specialized weaponry is massively under-represented. And risk are typically underestimated.

== Overregulation as a safety risk ==

'''Early misdirected overregulation can increase risk rather than mitigating it.''' <br>
Government bending to public outcry from ill informed fear <br>
without a proper understanding of the matter can backfire.
* research can be driven underground (including under the cover of corporate proprietary trade secrecy)
* access to early technology can limit access to new technology and foster social spread & two class society

There has been a somewhat related incident that <br>
may have delayed the development towards gem based APM notably (without any benefits on safety). <br>
It was not exactly overregulation by government-decreed law but <br> 
it was overzealous internal governance policy of a federal research program/agency. <br>
See: [[The negative effects that public overexcitement can have]] and [[History]] <br>

== Importance of governance technology and insufficiency of mere technical measures ==

Safety in a world with AP manufacturing and technology <br> 
is a lot about about [[governance and related software technology]] rather than physical technology. <br>
There are some physical technology aspects too, yes, but these alone can't suffice. <br>

== Specialized offensive weaponry ==

There is a serious dilemma here. <br>
Discussing these things kind of overlaps with developing them or at least giving hints on how these could be developed. <br>
As such the author is hesitant to invest effort in deeper research and more in depth explanations. <br>
It would be highly speculative at this point anyway. <br>

Just to give a superficial overview. <br>
'''Especially high threat levels may be posed by the following:''' <br>
(only once the technology is there - avoid premature overregulation)
* insect to bird sized drones (bigger size makes them very fast in speed and accelerations despite viscous air or water)
* [[microcomponent maintenance microbot]]s applied maliciously (e.g. spying, sabotage, …)
* weapons employing high amplitude sound shockwaves against humans (all too trivially easy to generate)
* weapons employing EMP waves against unhardened machines 
* long range energy weapons like lasers and microwave <br>especially in space (effectiveness of a nuke, precision of a scalpel)
* complex multi unit multi scale systems

== Purely defensive weaponry == 

Shields against high velocity impacts may fall in this category. <br>
This involves environmental observation and active measures taken on impending impacts that are <br>
both smarter and more effective than existing countermeasures like conter-explosions and hypervelocity whiffle shields. <br>
Ultra high power densities of gem-gum systems may allows for directed counter of projectiles <br>
so long the heat capacity can take the waste heat. <br>

Somewhat related to defensive weaponry [[utility fog]] related systems might act <br>
in an airbag like way to safe-keep against blunt lower speed impacts. <br>
Also useful in a civil setting.

== Proliferation – nuclear and chemical – actions of rouge individuals ==

=== The popular worries ===

A worry here is that [[gemstone based on-chip factories]] will make it easy to separate isotopes <br>
concentrate fissile isotopes and allow any random rouge individual to build a nuke all by themselves in secrecy. <br>

Several things here: 
* To gain sufficient fissile material one still needs to go through quite an amount of natural ore.
* Nuclear plants and [[nuclear waste]] sites with higher per-concentrated material can be well guarded.
* Such activity will elevate local radiation levels that can be detected.
* A bad nuke will be more a dirty bomb than a nuke, bad enough, yes, but way below an actual nuke by output.

Lesser on the impact side but perhaps higher on the probability side of risk are 
* "mere" dirty bombs attacks and
* chemical poison attacks.

A small easy to conceal device could produces high quantities of toxic gas in a short amount of time. <br>
Then again gas attacks are possible even today as high pressue canisters can pack copious amounts of problematic gasses. <br>
Such attacks unfortunately and regrettably have happened in the past. 
Like the Tokyo subway sarin gas attack in 1995 by the Aum Shinrikyo cult. <br>
Supposedly the reason for why later some trash bins in subway stations were removed. <br>

With gem-gum-tec advanced trash bins could immediately seal up and transport away to safe distance any rando stuff thrown in. <br>
Doorways and existing train station pass-through checkpoints could also detect for radiation. This is difficult to hide. <br>
{{wikitodo|Compare lead shielded notable radiological material vs carrying some naturally radioactive bananas}} <br>

In summary it seems very very unlikely that every second city will be nuked every few yeas by some maniac. <br>
There are many more factors beyond the isotope separation difficulty. <br>
Organized groups may pose a bigger risk, but this is hardly new. <br>

=== Possible regulatory measures ===

The following should be the exception rather than the rule. <br>
If in any way possible a blacklist (all allowed but …) rather than a whitelist (nothing allowed but …). <br>
The following stands in contrast to open source which always should be the default and the option considered first.

Make open sharing of critical highly dangerous information (information hazard) illegal to a high fine / prison time. <br>
Yes, this can not give an absolute guarantee to prevent any and all leaks (via dark-web, lax clear-web, physical meetings).<br>
but it can make the attainment of such information much much much more difficult. <br>
Zero risk can never be attained but a very low risk can be striven for. <br>

Also make the possession of such as hazardous classified information only legal <br>
when the owner went through proper training receiving a license.

=== Misdirected efforts – Dystopial surveillance state ===

'''Making private communication that can not be surveilled illegal is not an option. Period.''' <br>
Some 🤬 people are actually trying to achieve that by making end to end encryption illegal. <br>
Worse even it could be made illegal to not carry an always turned on phone with you at all times. <br>

Such things will do way more harm that the safety they could ever provide. Fact. <br>
When problems are no longer properly communicated as negative feedback in the social control loop <br> 
because of self-censorship out of fear of livelyhood endangering backlash <br>
then it's the beginning of the end of a working healthy society. <br>

Yes there are some not removable tail risks involved when allowing for fully private communications. <br>
But these tail risks we absolutely have to accept as facts of life. No way around it. <br>

== Runaway replication accidents – And intentional malicious release ==

=== Replicators as tool for malicious actors (unsuitable) ===

When intentionally optimizing for destructiveness for a terror attack <br>
then one naturally ends up with what was discussed in the above section. <br>
Specialized weaponry systems. <br>
Much larger systems are much more effective and successful in self replication as:
* they can move way faster
* they can shield better against radiation like UV light
* they can pack more capability
* they can form disjunct multi unit collaborative systems where the units are task specialized

=== Replication runaway accidents. Can they happen? And if yes how likely? ===

'''[[Direct path]]:''' <br>
During the [[bootstrapping]] the [[proto-assembler]] concept is outdated (since well before 2000). <br>
Proposed is the development via [[early diamondoid nanosystem pixel (direct path)]]. <br>
Reaching systems capable of closed cycle self replication will likely cover significant chip area. <br>
Several sides of the [[replication pentagon]] do not hold. Especially it's 2D on a chip so … <br>
'''Risk of an runaway replication accident is not present.''' <br>
----
'''[[Incremental path]]:''' <br>
Free floating things like the [[foldamer printer]] may look like (and be confused with) [[proto-assembler]]s <br>
but they are actually just primitive subsystems like a site activation positional stage. <br>
Reaching systems capable of closed cycle self replication will be much bigger and possibly (quite likely even) not monolithic. <br>
(As of 2023 we are still far away for this capability.) <br>
Several sides of the [[replication pentagon]] do not hold. <br>
Especially there's a dependence on special feedstock and <br> 
these foldamer assemblies are rather fragile needing water at proper temperature and such <br>
'''Risk of an runaway replication accident is not present.''' <br>
----
'''[[Synthetic biology]] (NOT on the APM development path and totally different far term target):''' <br>
Direct usage of living cells or creation of cell like things (that by definition can self replicate) is not involved in this pathways. <br>
The latter would be [[synthetic biology]]. A very very different by nature strictly separate branch of technology. <br>
For that look into existing biotech risk managenment. <br>
'''Risk of an runaway replication accident is present but the scope is well known from bio-hazards.''' <br>
----
'''[[Advanced productive nanosystem]]s:''' <br>
Replicative nanobots are an outdated concept for that. <br> 
See: [[Molecular assemblers as advanced productive nanosystem (outdated)]] <br>
Still technology is advanced enough to make them by then just for the sake to show that they can be made. <br>
They may be more micro than nano but still invisibly small like pollen. <br>
'''Risk of an runaway replication accident is present but most likely well manageable by then.''' <br>
Intentional malicious use for max damage leads to weapon systems instead. <br>
----
'''[[Grey goo horror fable]]:''' <br>
Horror scenarios of the whole biosphere being converted in mere hours are all 100% pure hype & fiction. <br>
Even intentional say we wanted to convert the whole (unguarded) Venusian atmosphere <br>
into safe solid silicon carbide and bind the oxygen to iron or something, <br>
it would take centuries of highly directed effort. Alone from energetic limitations. <br>
This would be specialized high performance replicative systems rather than replicating nanobots. <br>

=== Safety measures against runaway replication ===

Generally safety measures can be applied at all of the six sides of the [[reproduction hexagon]] <br>
via a combination of technical and governance mean. <br>

'''Replication capability:''' <br>
For a large stretch of non-replicative tech development and pre-scaling there won't even be that. <br>
As of 2023 we are still well within this phase.

'''Building block availability:''' <br>
This is one of the most popular of the six but also one of the least applicable. <br>
It's pretty much a given of the technology level. [[Incremental path]] man often require reproduced parts. <br>
Intentionally trying to add a dependency in advanced systems though is pointless as it can just be stripped out and <br>
basically just amount to a software lock. <br>

'''Energy supply:''' <br>
For stuff on chip just pull the plug (not that it could escape the chip anyways see point "replicator mobility"). <br>
For foldamers systems in a vile it also should take very very difficult deliberate effort such that <br>
replicators can extract energy form a natural environment like say sugar and oxygen from human blood. <br>

'''Blueprint data mobility:''' <br>
This is all about software control. <br>
Physically storing the replicator blueprint within replicators just as <br>
biological cells do it with DNA makes no sense from an efficiency standpoint even. <br>

'''Replicator mobility:''' <br>
This is a quite easy and effective one. <br>
A system native on a chip surface just can't leave. <br>
A system without active propulsion can't spread large distances in short time. <br>

'''Sufficient adaptability:''' <br>
As none of APM systems along the development pathway are based on living cells all these systems completely lack this capability. <br>
Very advances systems may attain this capability but at larger scales. <br>
This is more like artificial life then. <br>
See [[gem-gum-goo]], [[Artificial life]], [[Zero sum situation]] <br>

----
All of these may be more or less linkable with governance via software. <br>
But better only once really needed. Avert premature lawmaking action. <br>

== Related ==

* [[dangers]] (& [[opportunities]])
----
* [[Explosives]], [[Poisons]], [[Drugs]] 
* [[Isotope sorting]], [[APM and nuclear technology]]
----
* [[Self limitation for safety]]
* [[Microcomponent scale combination locks]]
* [[Direct physical hacking attacks]]
* [[Spill avoidance guideline]]
----
* [[Grey goo horror fable]], [[Reproduction hexagon]], [[Replication pentagon]]
* [[Self limitation for safety]]