Skip to main content

Posts

Showing posts with the label lstm

Google's Smart Reply : a summary of NLP techniques and insights used

One of the more recent additions to Google's plethora of services offered is Smart Reply .As of now, Smart Reply humbly seeks to provide short crisp responses for replying to emails on the go.Interestingly enough, a lot has gone into developing the system to a deployable ,efficient package, which has been found useful by a large fraction of the user base. Google's smart reply system can be understood as an amalgam of 4 key components:  1.Response Selection 2.Response Set Generation 3.Suggestion Diversity  4.Triggering Model  Response Selection: Google uses a neural network with LSTM (Long Short Term Memory cells) to generate responses. The email corpus used for training the network was extracted from Google's own mail database, after anonymization.It consists of around 238 million messages, which include 153 million messages that have no response. Given an email e ,and set of all possible responses ,the score of a response r is defined as...