From: Chris Lattner Date: Sun, 9 Mar 2008 02:27:26 +0000 (+0000) Subject: update documentation X-Git-Url: https://granicus.if.org/sourcecode?a=commitdiff_plain;h=792812547065c45b61cce836505cdf43493e4ad8;p=clang update documentation git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@48074 91177308-0d34-0410-b5e6-96231b3b80d8 --- diff --git a/docs/InternalsManual.html b/docs/InternalsManual.html index cc4630adf7..78fb9b1d9c 100644 --- a/docs/InternalsManual.html +++ b/docs/InternalsManual.html @@ -15,7 +15,7 @@ @@ -132,7 +132,7 @@ Preprocessor::Lex method, which returns the next Token from the preprocessor stream. There are two types of token providers that the preprocessor is capable of reading from: a buffer lexer (provided by the Lexer class) and a buffered token stream (provided by the MacroExpander class). +href="#TokenLexer">TokenLexer class). @@ -263,10 +263,10 @@ code is vectorized on X86 and PowerPC hosts).

-

The MacroExpander class

+

The TokenLexer class

-

The MacroExpander class is a token provider that returns tokens from a list +

The TokenLexer class is a token provider that returns tokens from a list of tokens that came from somewhere else. It typically used for two things: 1) returning tokens from a macro definition as it is being expanded 2) returning tokens from an arbitrary buffer of tokens. The later use is used by _Pragma and