We've Moved! Visit our NEW FORUM to join the latest discussions. This is an archive of our previous conversations...

You can find the login page for the old forum here.
CHATPRIVACYDONATELOGINREGISTER
DMT-Nexus
FAQWIKIHEALTH & SAFETYARTATTITUDEACTIVE TOPICS
Single neuron computational complexity Options
 
Loveall
#1 Posted : 9/3/2021 2:09:27 PM

❤️‍🔥

Chemical expertSenior Member

Posts: 3648
Joined: 11-Mar-2017
Last visit: 25-Nov-2024
Location: 🌎
AI scientist need 1000 artificial neurons to replicate the computational complexity of a single biological neuron.


https://www.quantamagazi...-single-neuron-20210902/
💚🌵💚 Mescaline CIELO TEK 💚🌵💚
💚🌳💚DMT salt e-juice HIELO TEK💚🌳💚
💚🍃💚 Salvinorin Chilled Acetone with IPA and Naphtha re-X TEK💚🍃💚
 

Live plants. Sustainable, ethically sourced, native American owned.
 
#2 Posted : 9/7/2021 1:54:52 PM
DMT-Nexus member

ModeratorSenior Member

Posts: 4612
Joined: 17-Jan-2009
Last visit: 07-Mar-2024
Thanks for sharing Loveall Smile

Quote:
To find out, David Beniaguev, Idan Segev and Michael London, all at the Hebrew University of Jerusalem, trained an artificial deep neural network to mimic the computations of a simulated biological neuron. They showed that a deep neural network requires between five and eight layers of interconnected “neurons” to represent the complexity of one single biological neuron.

Quote:
Timothy Lillicrap, who designs decision-making algorithms at the Google-owned AI company DeepMind, said the new result suggests that it might be necessary to rethink the old tradition of loosely comparing a neuron in the brain to a neuron in the context of machine learning. “This paper really helps force the issue of thinking about that more carefully and grappling with to what extent you can make those analogies,” he said.

Quote:
They continued increasing the number of layers until they achieved 99% accuracy at the millisecond level between the input and output of the simulated neuron. The deep neural network successfully predicted the behavior of the neuron’s input-output function with at least five — but no more than eight — artificial layers. In most of the networks, that equated to about 1,000 artificial neurons for just one biological neuron.

Quote:
The authors also hope that their result will change the present state-of-the-art deep network architecture in AI. “We call for the replacement of the deep network technology to make it closer to how the brain works by replacing each simple unit in the deep network today with a unit that represents a neuron, which is already — on its own — deep,” said Segev. In this replacement scenario, AI researchers and engineers could plug in a five-layer deep network as a “mini network” to replace every artificial neuron.


Glad people aren't entirely entrenched in old paradigms and are able to continually push the bounds of understanding in this/these area/s.

Good luck
 
Voidmatrix
#3 Posted : 9/8/2021 6:27:44 PM

DMT-Nexus member

Welcoming committeeModerator

Posts: 4160
Joined: 01-Oct-2016
Last visit: 15-Nov-2024
Thanks for sharing that awesome article Loveall!

I couldn't stop thinking about Hofstadter's description neural structures and "symbols" in Godel Escher Bach. Reminds me that I still need to read Fluid Concepts and Creative Analogies, also by Hofstadter.

One love
What if the "truth" is: the "truth" is indescernible/unknowable/nonexistent? Then the closest we get is through being true to and with ourselves.


Know thyself, nothing in excess, certainty brings insanity- Delphic Maxims

DMT always has something new to show you Twisted Evil

Question everything... including questioning everything... There's so much I could be wrong about and have no idea...
All posts and supposed experiences are from an imaginary interdimensional being. This being has the proclivity and compulsion for delving in depths it shouldn't. Posts should be taken with a grain of salt. 👽
 
downwardsfromzero
#4 Posted : 9/18/2021 2:12:29 PM

Boundary condition

ModeratorChemical expert

Posts: 8617
Joined: 30-Aug-2008
Last visit: 07-Nov-2024
Location: square root of minus one
Hmm, yeah. I always thought these so-called "AIs" were a bit crap in terms of efficiency. When they go head to head against a human, their power input should also be limited to that of a human brain. It's similar to how steroids and the like are banned in sport.

That's not to detract from the remarkable results that neural networks can provide, but more of what I consider to be a relevant and perhaps crucial goal in this field where ever-increasing dependence on computing needs to be balanced against its energy requirements from the perspective of climate change/chaos. Even if powered by renewables, these vast devices are dumping tons of waste heat into the atmosphere.




“There is a way of manipulating matter and energy so as to produce what modern scientists call 'a field of force'. The field acts on the observer and puts him in a privileged position vis-à-vis the universe. From this position he has access to the realities which are ordinarily hidden from us by time and space, matter and energy. This is what we call the Great Work."
― Jacques Bergier, quoting Fulcanelli
 
 
Users browsing this forum
Guest

DMT-Nexus theme created by The Traveler
This page was generated in 0.017 seconds.