Questions tagged [rnn]

RNN is abbreviation of Recurrent Neural Network which is a class of artificial neural net with feedback.

0
votes
0answers
8 views

How should I structure my input data to a Keras LSTM network for a very long time series?

I am trying to use multivariate time series sensor data to predict when a machine will fail. My problem is there is often millions of time units between failures and I am unsure how to structure the ...
0
votes
0answers
5 views

Does the weight between hidden and hidden layers in LSTM updated during training?

I've seen the paper 'Long Short term memory', Sepp Hochreiter. The thesis says that LSTM has an characteristic called constant error carousel(CEC), which means that the error signal along the time ...
0
votes
0answers
5 views

Truncated backpropagation in LSTM, errors in gradient value

Hochreiter in his seminal LSTM paper of 1997 postulates a backpropagation version. When calculating gradient over some network weight he truncates derivatives in the way that only derivatives from ...
1
vote
0answers
19 views

why the hidden state of rnn become almost -1 or 1 in training

I'm doing a prediction task which predict the shop people will click given the history click sequence of this customer. I use rnn to model the data and padded the sequence to the maximum length of ...
0
votes
0answers
29 views

Stacking LSTM layers of different sizes using MultiRNNcell tensor flow

This is the code I have used to stack multiple LSTM cells of sizes 64 and 32 from a list num_hidden=[64,32]stacked_cells=tf.nn.rnn_cell.MultiRNNCell([get_cell(num_hidden[_],keep_prob,z_prob_cells,...
0
votes
0answers
21 views

How to handle Variable Sequence Length within a Batch and with TBTT

How had I to handle Samples with different Sequence Length within a Batch when I want to use Truncated Backpropagation Through Time?I mean when I feed my TF session with new Timesteps and the samples ...
0
votes
0answers
10 views

visualize the GRU layer in keras

I have implemented a model for image captioning. But I don't know how to visualize the layers. When dealing with CNN, we think of the features also as images. But when dealing with text, what's the ...
0
votes
0answers
9 views

Tensorflow RNN for classification

I am trying to develop my first model by myself. I want to use a LSTM to classify a series of inputs. In detail, I have a series of 96 time steps with two inputs (2, 96) and I have labels that assign ...
0
votes
0answers
10 views

Predictions when padded sequences, Masking accuracy/cross-entropy

I know that this is not a coding question but if needed, I can provide some to prove my point. I also know that this has been asked a lot. I am just super confused.When the sequences are padded to ...
0
votes
0answers
21 views

Why my LSTM only learns when previous state is removed in backward step?

This piece of code in C++ using Armadillo is both Backward and Forward part of a seq2seq char toy LSTM neural network that I'm coding. I had successful in writing Dense and Vanilla RNN. I saw various ...
0
votes
0answers
20 views

Can we use char rnn to create embeddings for out of vocabulary words?

I have word embeddings for 10 million words which were trained on a huge corpus. Now I want to produce word embeddings for out of vocabulary words. Can I design some char RNN to use these word ...
2
votes
1answer
21 views

Error in fitting an RNN LSTM model

I am trying to create an RNN LSTM model for a binary classification using the following code alldataset=np.loadtxt("FinalKNEEALL.txt", delimiter=",")num_classes=2num_of_sam=alldataset.shape[...
0
votes
0answers
14 views

Multiple Training Set LSTM RNN

I am attempting to train an LSTM RRN however I am running into the issue that I have multiple sets of sequential data. Is there a way to prepare the data, rather than sending it all in together, so as ...
-1
votes
0answers
16 views

anomaly detection using RNN

I am working on a project :using RNN for anomaly detection.I am stuck at weight matrix initialization.How can I do that in simple python code?Can someone help me with that ?
0
votes
1answer
31 views

Seq2Seq Bidirectional Encoder Decoder in Keras

I am trying to implement a seq2seq encoder-decoder using Keras, with bidirectional lstm on the encoder as follows:from keras.layers import LSTM,Bidirectional,Input,Concatenatefrom keras.models ...

153050per page
angop.ao, elkhabar.com, noa.al, afghanpaper.com, bbc.com, time.com, cdc.gov, nih.gov, xnxx.com, github.com,