dlangide v0.7.42 (2017-08-11T16:19:30Z)
Home
Dub
Repo
Tokenizer.nextToken
ddc
lexer
tokenizer
Tokenizer
Undocumented in source. Be warned that the author may not have intended to support it.
class
Tokenizer
Token
nextToken
(
)
Meta
Source
See Implementation
ddc
lexer
tokenizer
Tokenizer
constructors
this
enums
EOF_CHAR
functions
allTokens
detectKeyword
detectOp
emitEof
formatBuildDate
formatBuildTime
formatBuildTimestamp
initialize
makeSpecialTokenString
nextChar
nextLine
nextToken
parserError
peekChar
processBinaryNumber
processCharacterLiteral
processDecFloatExponent
processDecFloatSecondPart
processDecFloatSuffix
processDecNumber
processDelimitedString
processDoubleQuotedOrWysiwygString
processHexNumber
processHexString
processIdent
processIntegerSuffix
processMultilineComment
processNestedComment
processOctNumber
processOneLineComment
processOneLineSharpComment
processSpecialToken
processWhiteSpace
processWysiwygString
properties
enableCommentText
errorTolerant
static variables
VENDOR
VERSION
variables
_commentAppender
_enableCommentText
_errorTolerant
_identAppender
_len
_line
_lineStream
_lineText
_pos
_prevLineLength
_sharedCharacterLiteralToken
_sharedCommentToken
_sharedIdentToken
_sharedIntegerToken
_sharedInvalidToken
_sharedKeywordToken
_sharedOpToken
_sharedRealToken
_sharedStringLiteralToken
_sharedWhiteSpaceToken
_startLine
_startPos
_state
_stringLiteralAppender
buildTime