From: Chris Lattner <sabre@nondot.org>
Date: Wed, 14 Oct 2009 15:04:18 +0000 (+0000)
Subject: Teach Lexer::MeasureTokenLength to be able to measure the
X-Git-Url: https://granicus.if.org/sourcecode?a=commitdiff_plain;h=39de7409bffb6b725a8aa64f0ba77ab51e8c9eb3;p=clang

Teach Lexer::MeasureTokenLength to be able to measure the
length of comment tokens.  Patch by Abramo Bagnara!


git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@84100 91177308-0d34-0410-b5e6-96231b3b80d8
---

diff --git a/lib/Lex/Lexer.cpp b/lib/Lex/Lexer.cpp
index 0f01155a8f..c8b9a5d542 100644
--- a/lib/Lex/Lexer.cpp
+++ b/lib/Lex/Lexer.cpp
@@ -238,6 +238,7 @@ unsigned Lexer::MeasureTokenLength(SourceLocation Loc,
 
   // Create a lexer starting at the beginning of this token.
   Lexer TheLexer(Loc, LangOpts, Buffer.first, StrData, Buffer.second);
+  TheLexer.SetCommentRetentionState(true);
   Token TheTok;
   TheLexer.LexFromRawLexer(TheTok);
   return TheTok.getLength();