> Nice! Did you find any weird/funny case while training the model? [I remember autotranlation/readers inventing stuff a few years ago.]<p>Mostly, it was me trying things the naive way, running into problems, and then solving them, usually by copying what Alex Graves did in 2013 (but not always!)<p>For example, to make things simple I first built the model to simply predict the next x, y direction of the pen. This worked for simple pen strokes, but I noticed the model had a difficult time turning corners.<p>To fix this, I changed the model to instead predict an Mixture Density Network (Same as Graves). This is explained better in his paper, but essentially, instead of predicting one x, y direction, you predict 10, and then randomly sample one of those predictions. Also instead of predicting scalar x, y values, you predict a parameters for a gaussian distribution, and then sample from that.<p>It always amazes me how much randomness is involved in intelligence.<p>> If you get someone to make a few samples and photos, it would be very nice.<p>I'm in Seoul, if you know anyone who would be interested in collaborating, please send me a note! jon@jonb.org