Category: RNN

A Deep Learning Tutorial: From Perceptrons to Deep Networks

In recent years, there’s been a resurgence in the field of Artificial Intelligence. It’s spread beyond the academic world with major players like Google, Microsoft, and Facebook creating their own research teams and making some impressive acquisitions. Some this can

Essentials of Deep Learning : Introduction to Long Short Term Memory

Introduction Sequence prediction problems have been around for a long time. They are considered as one of the hardest problems to solve in the data science industry. These include a wide range of problems; from predicting sales to finding patterns

Fundamentals of Deep Learning – Introduction to Recurrent Neural Networks

Introduction Let me open this article with a question – “working love learning we on deep”, did this make any sense to you? Not really – read this one – “We love working on deep learning”. Made perfect sense! A

A Beginner’s Guide on Sentiment Analysis with RNN

Photo Credit: Unsplash Sentiment analysis probably is one the most common applications in Natural Language processing. I don’t have to emphasize how important customer service tool sentiment analysis has become. So here we are, we will train a classifier movie reviews

Manual Back Prop with TensorFlow

Decoupled Recurrent Neural Network, modified NN from Google Brain, Implementation with Interactive Code. Photo from Pixel Bay I love Tensorflow and it’s ability to perform auto differentiation, however that does not mean we cannot perform manual back propagation even in Tensorflow.

Back to Basics – Deriving Back Propagation on simple RNN/LSTM

By Jae Duk Seo Gif from this website Aidan Gomez did an amazing job explaining in details of how back-propagation LSTM works in general. And I did mine as well on this post. However, my friend Abe Kang had one question

Creating A Text Generator Using Recurrent Neural Network

Hello guys, it’s been another while since my last post, and I hope you’re all doing well with your own projects. I’ve been kept busy with my own stuff, too. And till this point, I got some interesting results which

Recurrent Neural Network Tutorial, Part 4 – Denny Britz

Part 4 – Implementing a GRU/LSTM RNN with Python and Theano The code for this post is on Github. This is part 4, the last part of the Recurrent Neural Network Tutorial. The previous parts are: Recurrent Neural Networks Tutorial, Part 1 – Introduction

Recurrent Neural Networks Tutorial, Part 3 – Denny Britz

Part 3 – Backpropagation Through Time and Vanishing Gradients This the third part of the Recurrent Neural Network Tutorial. In the previous part of the tutorial we implemented a RNN from scratch, but didn’t go into detail on how Backpropagation Through Time (BPTT) algorithms calculates

Recurrent Neural Networks Tutorial, Part 2 – Denny Britz

Part 2 – Implementing a RNN with Python, Numpy and Theano This the second part of the Recurrent Neural Network Tutorial. The first part is here. Code to follow along is on Github. In this part we will implement a full