Monthly archive April, 2017
Paper Review: An Integration of Deep Learning and Neuroscience, Part 2

Paper Review: An Integration of Deep Learning and Neuroscience, Part 2

One of the key sticking points in discussions comparing machine learning and the brain is how the notion of “learning” differs between computational and biological systems. In section 2 of their paper, Marblestone et al. grapple with this issue in detail. For our introduction post on this paper, go here. Deep neural networks are trained...
Quick Hit: Bad Advice from a Bad Mentor

Quick Hit: Bad Advice from a Bad Mentor

As anyone in a PhD program knows, your experience is highly dependent on your relationship with your advisor. We discussed in our earlier post, How to Choose a PhD Advisor, ways to hopefully make the “right” (best?) choice. While there are many advisors in the world, not all can be called mentors. The difference is...
Paper Review: An Integration of Deep Learning and Neuroscience, Part 1

Paper Review: An Integration of Deep Learning and Neuroscience, Part 1

Nicole: More and more I see that people are very concerned with the biological plausibility of neural networks. I think this comes from the fact that we as machine learners are finally achieving human-level performance on some tasks. It has renewed faith in the idea that the best way to “solve” intelligence is to copy...
Neural Nets 101

Neural Nets 101

A neural network is a computational model inspired by neurons, and the neuronal circuits observed in biological systems.  The history behind neural networks is long and storied and could be its own blog post (and of course it is already its own blog post), so we won’t get into that here.  Instead, let’s just cover...
Neurons 101

Neurons 101

Neurons are the building blocks of the brain. They take information they receive from upstream neurons and summarize it as a spike that is sent  to downstream neurons. (image courtesy of wikimedia commons) Let’s talk about the anatomy of neurons:   Nucleus: Like any cell in your body, each neuron has a nucleus, where its...