Scott Douglas Jacobsen: How many parameters do you think the human brain's language model works off of? In artificial neural networks, a parameter is typically a single numeric weight. The human brain has roughly 80 to 100 billion neurons, each with thousands of synaptic connections.  Rick Rosner: Suppose you treat each connection as a parameter. …

Continue reading Ask A Genius 1262: Encoding Information and AI