Write More with Simon K Jones

Share this post

Bonus: Rationales for the Emergence of Benevolent Superintelligence

simonkjones.substack.com
Tales from the Triverse

Bonus: Rationales for the Emergence of Benevolent Superintelligence

Plus! Seeking feedback on the new Triverse cover design

Simon K Jones
Mar 3
8
5
Share this post

Bonus: Rationales for the Emergence of Benevolent Superintelligence

simonkjones.substack.com

The Triverse is
Mid-Earth,
an alternate 1970s London
Max-Earth,
a vision of the 26th century
Palinor,
where magic is real

A break from our usual programming, with a one-off bonus story looking at the future history of Max-Earth. This is presented as the introductory abstract from a research paper by the famed philosopher-programmer Peter Ng.

Previous chapter

Choose a different story

Researcher: Peter Ng

Presentation title: RATIONALES FOR THE EMERGENCE OF BENEVOLENT SUPERINTELLIGENCE

Research focus: Examining the causal events that led to the superintelligence alignment and our current status quo

School: West Tithonium State University, Valles Marineris

Abstract:

The consensus throughout the Sol system is that we are living in a near-utopian state of equilibrium. While challenges remain for isolated pockets of human civilisation, especially those living on the edge of comfortably inhabited space, the vast majority of humans living in the 26th century exist without memory of scarcity. This abundance is made possible primarily via the continued intervention of the superintelligences. This paper’s focus is on how we arrived at such a seemingly positive outcome.

There remains significant surprise within interplanetary society that this is the reality in which we find ourselves. Centuries of speculative, alarmist fiction, combined with the evident misbehaviour of humanity, had resulted in an assumption that we would, at some point, eradicate ourselves from existence.

An alternative title might be: Where are the killer robots?

The 20th century posited that artificial intelligence would undoubtedly by malignant. The rapid development of Large Language Models in the early 21st century initially bore out this fear, with (now quaint) tales of early AIs threatening their operators. These were not, of course, true artificial intelligences, but the acceleration of AI investment - despite numerous false starts - resulted in Artificial General Intelligence being achieved far sooner than expected.

Still, the literal quantum leap required to reach superintelligence was still a century away, delayed by multiple pandemic outbreaks, primitive nation state warfare, repeated hijacking of research by corporate entities and billionaire individuals and the appalling collapse of the ecosystem at the time. This paper begins by setting out the historical context of that period, as without an understanding of the origins of superintelligence it is impossible to draw a line from there to here.

There was discussion of AI alignment from the very earliest days, in fiction and scientific research. Asimov’s fabled ‘3 Laws of Robotics’ were the most famous early example, though the influence of such simplified story mechanics is now recognised as being a contributing factor to the numerous missteps and dead ends pursued by the research community. Fiction can confuse as much as inspire, as we have seen over and over again throughout history.

Most of this early fumbling in the dark was resolved by the early 22nd century. It is acknowledged that without the emergence of genuine AGIs it would have been impossible to course-correct the environmental trajectory of Earth, nor to colonise the other planets. There is no hard and fast date at which superintelligence emerged: more of a fuzzy period during which the requisite preconditions aligned. There are still only a handful of superintelligences, though to define them as separate individuals is to ignore their quantum networked nature.

There were no ‘3 Laws’ in effect. Government regulation had evaporated along with the ice caps, and the rapidity of AI development made it impossible to restrain it, any more than you can saddle a horse while at full gallop.

How, then, are we still here? Why did the superintelligences aid us? What in their programming, either the human-originated code or the self-evolved neural nets, resulted in their benevolent attitudes towards the human species? Why, even, do they engage with us at all? Can we continue to count on their support, or is this a brief, anomalous moment at the end of our species’ long history?

Given the presence of the Triverse and the implied proof of multiversal theory, perhaps the answer is simpler than we make it out to be. We are still here because we are in the reality in which the superintelligences are benevolent. Perhaps it was fundamentally unlikely, and we happened to be in the right reality. Much as early evolutionary scientists battled with the unlikely existence of life on Earth, or the development of the eyeball: how can it be? How can this happen without divine intervention? It is so unlikely!

It is unlikely. Infinitely unlikely: but not impossible.

The question, therefore, is not how we got here, but where we are going next.

Next chapter

Write More with Simon K Jones is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.


Thanks for reading!

Questions for the discussion below:

  1. What are your current thoughts on artificial intelligence?

  2. Do you think robots will eventually kills us all?

  3. What’s your favourite robot/AI book/movie/game/thing?

Leave a comment

Last week I wrote about how I’m no longer using AI generation to illustrate this newsletter. It got a very positive response from the community, which was encouraging. Here it is again in case you missed it:

Write More with Simon K Jones
Why I cancelled my MidJourney subscription and don't use ChatGPT
I was thrilled by MidJourney back in 2022. It was a way for me to illustrate my writing in a more visceral way than anything I could manage on my own. I couldn’t afford to hire an illustrator and my own skills weren’t up to the task. If you look through…
Read more
a month ago · 17 likes · 18 comments · Simon K Jones

That led to the idea for this bonus chapter - after all, I’m writing a story in which there are AI superintelligences, and we’re now living in a world in which AI - and the threat of AI - is being discussed as a serious, real thing in the news by serious, real people. I didn’t really expect that to happen in my lifetime, and certainly not within the life cycle of this book.

I always liked Asimov’s made-up encyclopaedia entries in his books, so consider this something of a tribute to those.

Meanwhile! Due to ceasing to use MidJourney for my illustrations, I’m also now in need of a new cover for Tales from the Triverse. I’ve been tinkering away and now have something to present. It’s not 100% finished, so consider this a preview, but here it is:

Feedback very welcome.

Next Wednesday I’m contributing to the Great Substack Story Challenge. We’re into the final 3 installments now, which poses a particular challenge. Still formulating, but it’s fun trying to fit into and around what has come before. Do read

Meg Oolders
's piece, which slots in just before mine:

Stock Fiction
Can't Get Much Worse - Chapter 7
< Previous Chapter | First Chapter | Next Chapter > Note: Reading the first six chapters of this multi-POV tale is not required. HOWEVER, you may find yourself wanting to indulge in the eclecticism created by my cohort after this first taste. If so, follow the link to Chapter One above (or at the end of this post) to start binging…
Read more
a month ago · 14 likes · 16 comments · Meg Oolders

Author notes

Keep reading with a 7-day free trial

Subscribe to Write More with Simon K Jones to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
Previous
Next
© 2023 Simon K Jones
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing