Deep Belief Network

What Does Deep Belief Network Mean?

A deep belief network (DBN) is a sophisticated type of generative neural network that uses an unsupervised machine learning model to produce results. This type of network illustrates some of the work that has been done recently in using relatively unlabeled data to build unsupervised models.


Techopedia Explains Deep Belief Network

Some experts describe the deep belief network as a set of restricted Boltzmann machines (RBMs) stacked on top of one another. In general, deep belief networks are composed of various smaller unsupervised neural networks. One of the common features of a deep belief network is that although layers have connections between them, the network does not include connections between units in a single layer.

Geoff Hinton, one of the pioneers of this process, characterizes stacked RBMs as providing a system that can be trained in a “greedy” manner and describes deep belief networks as models “that extract a deep hierarchical representation of training data.”

In general, this type of unsupervised machine learning model shows how engineers can pursue less structured, more rugged systems where there is not as much data labeling and the technology has to assemble results based on random inputs and iterative processes.


Related Terms

Margaret Rouse

Margaret is an award-winning technical writer and teacher known for her ability to explain complex technical subjects to a non-technical business audience. Over the past twenty years, her IT definitions have been published by Que in an encyclopedia of technology terms and cited in articles by the New York Times, Time Magazine, USA Today, ZDNet, PC Magazine, and Discovery Magazine. She joined Techopedia in 2011. Margaret's idea of a fun day is helping IT and business professionals learn to speak each other’s highly specialized languages.