Named Entity Recognition (NER) aims at locating and classifying namedentities in text. In some use cases of NER, including cases where detectednamed entities are used in creating content recommendations, it is crucial tohave a reliable confidence level for the detected named entities. In this workwe study the problem of finding confidence levels for detected named entities.We refer to this problem as Named Entity Sequence Classification (NESC). Weframe NESC as a binary classification problem and we use NER as well asrecurrent neural networks to find the probability of candidate named entity isa real named entity. We apply this approach to Tweet texts and we show how wecould find named entities with high confidence levels from Tweets.