Letting neural networks be weird • The firs... http://aiweirdness.com/post/168051907512/the-first-line-of-a-novel-by-an-improved-neural
@aparrish
I looked at the input data (https://raw.githubusercontent.com/janelleshane/novel-first-lines-dataset/master/crowdsourced_all.txt) and indeed, there's exactly one entry that is the word "sand" repeated a few thousand times.
This makes me feel like the benefits of RNNs over markov models for text generation are even more dubious!
@enkiv2 'Unfortunately, due to a prank in the input data that I didn’t catch till after I trained the neural network, 37,000 of them are the word “sand”.'