Public Member Functions
boolean	atEnd ()

boolean	atEnd ()

void	consume (final String token) throws ParseException

void	consume (final String token) throws ParseException

boolean	consumeBoolean () throws ParseException

boolean	consumeBoolean () throws ParseException

ByteString	consumeByteString () throws ParseException

ByteString	consumeByteString () throws ParseException

double	consumeDouble () throws ParseException

double	consumeDouble () throws ParseException

float	consumeFloat () throws ParseException

float	consumeFloat () throws ParseException

String	consumeIdentifier () throws ParseException

String	consumeIdentifier () throws ParseException

int	consumeInt32 () throws ParseException

int	consumeInt32 () throws ParseException

long	consumeInt64 () throws ParseException

long	consumeInt64 () throws ParseException

String	consumeString () throws ParseException

String	consumeString () throws ParseException

int	consumeUInt32 () throws ParseException

int	consumeUInt32 () throws ParseException

long	consumeUInt64 () throws ParseException

long	consumeUInt64 () throws ParseException

boolean	lookingAt (String text)

boolean	lookingAt (String text)

boolean	lookingAtInteger ()

boolean	lookingAtInteger ()

void	nextToken ()

void	nextToken ()

ParseException	parseException (final String description)

ParseException	parseException (final String description)

ParseException	parseExceptionPreviousToken (final String description)

ParseException	parseExceptionPreviousToken (final String description)

boolean	tryConsume (final String token)

boolean	tryConsume (final String token)

boolean	tryConsumeDouble ()

boolean	tryConsumeDouble ()

boolean	tryConsumeFloat ()

boolean	tryConsumeFloat ()

boolean	tryConsumeIdentifier ()

boolean	tryConsumeIdentifier ()

boolean	tryConsumeInt64 ()

boolean	tryConsumeInt64 ()

boolean	tryConsumeString ()

boolean	tryConsumeString ()

boolean	tryConsumeUInt64 ()

boolean	tryConsumeUInt64 ()

UnknownFieldParseException	unknownFieldParseExceptionPreviousToken (final String unknownField, final String description)

UnknownFieldParseException	unknownFieldParseExceptionPreviousToken (final String unknownField, final String description)

Private Member Functions
void	consumeByteString (List< ByteString > list) throws ParseException

void	consumeByteString (List< ByteString > list) throws ParseException

ParseException	floatParseException (final NumberFormatException e)

ParseException	floatParseException (final NumberFormatException e)

ParseException	integerParseException (final NumberFormatException e)

ParseException	integerParseException (final NumberFormatException e)

void	skipWhitespace ()

void	skipWhitespace ()

	Tokenizer (final CharSequence text)

	Tokenizer (final CharSequence text)

Private Attributes
int	column = 0

String	currentToken

int	line = 0

final Matcher	matcher

int	pos = 0

int	previousColumn = 0

int	previousLine = 0

final CharSequence	text

Static Private Attributes
static final Pattern	DOUBLE_INFINITY

static final Pattern	FLOAT_INFINITY

static final Pattern	FLOAT_NAN = Pattern.compile("nanf?", Pattern.CASE_INSENSITIVE)

static final Pattern	TOKEN

static final Pattern	WHITESPACE = Pattern.compile("(\\s\|(#.*$))++", Pattern.MULTILINE)

Detailed Description

Represents a stream of tokens parsed from a

String

.

The Java standard library provides many classes that you might think would be useful for implementing this, but aren't. For example:

java.io.StreamTokenizer

: This almost does what we want – or, at least, something that would get us close to what we want – except for one fatal flaw: It automatically un-escapes strings using Java escape sequences, which do not include all the escape sequences we need to support (e.g. '\x').
java.util.Scanner

: This seems like a great way at least to parse regular expressions out of a stream (so we wouldn't have to load the entire input into a single string before parsing). Sadly,
Scanner

requires that tokens be delimited with some delimiter. Thus, although the text "foo:" should parse to two tokens ("foo" and ":"),
Scanner

would recognize it only as a single token. Furthermore,
Scanner

provides no way to inspect the contents of delimiters, making it impossible to keep track of line and column numbers.

Luckily, Java's regular expression support does manage to be useful to us. (Barely: We need

Matcher.usePattern()

, which is new in Java 1.5.) So, we can use that, at least. Unfortunately, this implies that we need to have the entire input in one contiguous string.

Definition at line 816 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

Constructor & Destructor Documentation

◆ Tokenizer() [1/2]

com.google.protobuf.TextFormat.Tokenizer.Tokenizer ( final CharSequence text )

inlineprivate

Construct a tokenizer that parses tokens from the given text.

Definition at line 851 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ Tokenizer() [2/2]

com.google.protobuf.TextFormat.Tokenizer.Tokenizer ( final CharSequence text )

inlineprivate

Construct a tokenizer that parses tokens from the given text.

Definition at line 936 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

Member Function Documentation

◆ atEnd() [1/2]

boolean com.google.protobuf.TextFormat.Tokenizer.atEnd ( )

inline

Are we at the end of the input?

Definition at line 875 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ atEnd() [2/2]

boolean com.google.protobuf.TextFormat.Tokenizer.atEnd ( )

inline

Are we at the end of the input?

Definition at line 960 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consume() [1/2]

void com.google.protobuf.TextFormat.Tokenizer.consume ( final String token ) throws ParseException

inline

If the next token exactly matches

token

, consume it. Otherwise, throw a {}.

Definition at line 939 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consume() [2/2]

void com.google.protobuf.TextFormat.Tokenizer.consume ( final String token ) throws ParseException

inline

If the next token exactly matches

token

, consume it. Otherwise, throw a {}.

Definition at line 1024 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consumeBoolean() [1/2]

boolean com.google.protobuf.TextFormat.Tokenizer.consumeBoolean ( ) throws ParseException

inline

If the next token is a boolean, consume it and return its value. Otherwise, throw a {}.

Definition at line 1158 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consumeBoolean() [2/2]

boolean com.google.protobuf.TextFormat.Tokenizer.consumeBoolean ( ) throws ParseException

inline

If the next token is a boolean, consume it and return its value. Otherwise, throw a {}.

Definition at line 1243 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consumeByteString() [1/4]

ByteString com.google.protobuf.TextFormat.Tokenizer.consumeByteString ( ) throws ParseException

inline

If the next token is a string, consume it, unescape it as a ByteString, and return it. Otherwise, throw a ParseException.

Definition at line 1198 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consumeByteString() [2/4]

ByteString com.google.protobuf.TextFormat.Tokenizer.consumeByteString ( ) throws ParseException

inline

If the next token is a string, consume it, unescape it as a ByteString, and return it. Otherwise, throw a ParseException.

Definition at line 1283 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consumeByteString() [3/4]

void com.google.protobuf.TextFormat.Tokenizer.consumeByteString ( List< ByteString > list ) throws ParseException

inlineprivate

Like consumeByteString() but adds each token of the string to the given list. String literals (whether bytes or text) may come in multiple adjacent tokens which are automatically concatenated, like in C or Python.

Definition at line 1212 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consumeByteString() [4/4]

void com.google.protobuf.TextFormat.Tokenizer.consumeByteString ( List< ByteString > list ) throws ParseException

inlineprivate

Like consumeByteString() but adds each token of the string to the given list. String literals (whether bytes or text) may come in multiple adjacent tokens which are automatically concatenated, like in C or Python.

Definition at line 1297 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consumeDouble() [1/2]

double com.google.protobuf.TextFormat.Tokenizer.consumeDouble ( ) throws ParseException

inline

If the next token is a double, consume it and return its value. Otherwise, throw a {}.

Definition at line 1082 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consumeDouble() [2/2]

double com.google.protobuf.TextFormat.Tokenizer.consumeDouble ( ) throws ParseException

inline

If the next token is a double, consume it and return its value. Otherwise, throw a {}.

Definition at line 1167 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consumeFloat() [1/2]

float com.google.protobuf.TextFormat.Tokenizer.consumeFloat ( ) throws ParseException

inline

If the next token is a float, consume it and return its value. Otherwise, throw a {}.

Definition at line 1120 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consumeFloat() [2/2]

float com.google.protobuf.TextFormat.Tokenizer.consumeFloat ( ) throws ParseException

inline

If the next token is a float, consume it and return its value. Otherwise, throw a {}.

Definition at line 1205 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consumeIdentifier() [1/2]

String com.google.protobuf.TextFormat.Tokenizer.consumeIdentifier ( ) throws ParseException

inline

If the next token is an identifier, consume it and return its value. Otherwise, throw a ParseException.

Definition at line 964 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consumeIdentifier() [2/2]

String com.google.protobuf.TextFormat.Tokenizer.consumeIdentifier ( ) throws ParseException

inline

If the next token is an identifier, consume it and return its value. Otherwise, throw a ParseException.

Definition at line 1049 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consumeInt32() [1/2]

int com.google.protobuf.TextFormat.Tokenizer.consumeInt32 ( ) throws ParseException

inline

If the next token is a 32-bit signed integer, consume it and return its value. Otherwise, throw a ParseException.

Definition at line 1000 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consumeInt32() [2/2]

int com.google.protobuf.TextFormat.Tokenizer.consumeInt32 ( ) throws ParseException

inline

If the next token is a 32-bit signed integer, consume it and return its value. Otherwise, throw a ParseException.

Definition at line 1085 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consumeInt64() [1/2]

long com.google.protobuf.TextFormat.Tokenizer.consumeInt64 ( ) throws ParseException

inline

If the next token is a 64-bit signed integer, consume it and return its value. Otherwise, throw a ParseException.

Definition at line 1028 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consumeInt64() [2/2]

long com.google.protobuf.TextFormat.Tokenizer.consumeInt64 ( ) throws ParseException

inline

If the next token is a 64-bit signed integer, consume it and return its value. Otherwise, throw a ParseException.

Definition at line 1113 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consumeString() [1/2]

String com.google.protobuf.TextFormat.Tokenizer.consumeString ( ) throws ParseException

inline

If the next token is a string, consume it and return its (unescaped) value. Otherwise, throw a ParseException.

Definition at line 1180 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consumeString() [2/2]

String com.google.protobuf.TextFormat.Tokenizer.consumeString ( ) throws ParseException

inline

If the next token is a string, consume it and return its (unescaped) value. Otherwise, throw a ParseException.

Definition at line 1265 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consumeUInt32() [1/2]

int com.google.protobuf.TextFormat.Tokenizer.consumeUInt32 ( ) throws ParseException

inline

If the next token is a 32-bit unsigned integer, consume it and return its value. Otherwise, throw a ParseException.

Definition at line 1014 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consumeUInt32() [2/2]

int com.google.protobuf.TextFormat.Tokenizer.consumeUInt32 ( ) throws ParseException

inline

If the next token is a 32-bit unsigned integer, consume it and return its value. Otherwise, throw a ParseException.

Definition at line 1099 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consumeUInt64() [1/2]

long com.google.protobuf.TextFormat.Tokenizer.consumeUInt64 ( ) throws ParseException

inline

If the next token is a 64-bit unsigned integer, consume it and return its value. Otherwise, throw a ParseException.

Definition at line 1055 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ consumeUInt64() [2/2]

long com.google.protobuf.TextFormat.Tokenizer.consumeUInt64 ( ) throws ParseException

inline

If the next token is a 64-bit unsigned integer, consume it and return its value. Otherwise, throw a ParseException.

Definition at line 1140 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ floatParseException() [1/2]

ParseException com.google.protobuf.TextFormat.Tokenizer.floatParseException ( final NumberFormatException e )

inlineprivate

Constructs an appropriate ParseException for the given

NumberFormatException

when trying to parse a float or double.

Definition at line 1262 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ floatParseException() [2/2]

ParseException com.google.protobuf.TextFormat.Tokenizer.floatParseException ( final NumberFormatException e )

inlineprivate

Constructs an appropriate ParseException for the given

NumberFormatException

when trying to parse a float or double.

Definition at line 1347 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ integerParseException() [1/2]

ParseException com.google.protobuf.TextFormat.Tokenizer.integerParseException ( final NumberFormatException e )

inlineprivate

Constructs an appropriate ParseException for the given

NumberFormatException

when trying to parse an integer.

Definition at line 1254 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ integerParseException() [2/2]

ParseException com.google.protobuf.TextFormat.Tokenizer.integerParseException ( final NumberFormatException e )

inlineprivate

Constructs an appropriate ParseException for the given

NumberFormatException

when trying to parse an integer.

Definition at line 1339 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ lookingAt() [1/2]

boolean com.google.protobuf.TextFormat.Tokenizer.lookingAt ( String text )

inline

Returns

true

if the current token's text is equal to that specified.

Definition at line 956 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ lookingAt() [2/2]

boolean com.google.protobuf.TextFormat.Tokenizer.lookingAt ( String text )

inline

Returns

true

if the current token's text is equal to that specified.

Definition at line 1041 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ lookingAtInteger() [1/2]

boolean com.google.protobuf.TextFormat.Tokenizer.lookingAtInteger ( )

inline

Returns

true

if the next token is an integer, but does not consume it.

Definition at line 946 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ lookingAtInteger() [2/2]

boolean com.google.protobuf.TextFormat.Tokenizer.lookingAtInteger ( )

inline

Returns

true

if the next token is an integer, but does not consume it.

Definition at line 1031 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ nextToken() [1/2]

void com.google.protobuf.TextFormat.Tokenizer.nextToken ( )

inline

Advance to the next token.

Definition at line 880 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ nextToken() [2/2]

void com.google.protobuf.TextFormat.Tokenizer.nextToken ( )

inline

Advance to the next token.

Definition at line 965 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ parseException() [1/2]

ParseException com.google.protobuf.TextFormat.Tokenizer.parseException ( final String description )

inline

Returns a ParseException with the current line and column numbers in the description, suitable for throwing.

Definition at line 1236 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ parseException() [2/2]

ParseException com.google.protobuf.TextFormat.Tokenizer.parseException ( final String description )

inline

Returns a ParseException with the current line and column numbers in the description, suitable for throwing.

Definition at line 1321 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ parseExceptionPreviousToken() [1/2]

ParseException com.google.protobuf.TextFormat.Tokenizer.parseExceptionPreviousToken ( final String description )

inline

Returns a ParseException with the line and column numbers of the previous token in the description, suitable for throwing.

Definition at line 1245 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ parseExceptionPreviousToken() [2/2]

ParseException com.google.protobuf.TextFormat.Tokenizer.parseExceptionPreviousToken ( final String description )

inline

Returns a ParseException with the line and column numbers of the previous token in the description, suitable for throwing.

Definition at line 1330 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ skipWhitespace() [1/2]

void com.google.protobuf.TextFormat.Tokenizer.skipWhitespace ( )

inlineprivate

Skip over any whitespace so that the matcher region starts at the next token.

Definition at line 915 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ skipWhitespace() [2/2]

void com.google.protobuf.TextFormat.Tokenizer.skipWhitespace ( )

inlineprivate

Skip over any whitespace so that the matcher region starts at the next token.

Definition at line 1000 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ tryConsume() [1/2]

boolean com.google.protobuf.TextFormat.Tokenizer.tryConsume ( final String token )

inline

If the next token exactly matches

token

, consume it and return

true

. Otherwise, return

false

without doing anything.

Definition at line 926 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ tryConsume() [2/2]

boolean com.google.protobuf.TextFormat.Tokenizer.tryConsume ( final String token )

inline

If the next token exactly matches

token

, consume it and return

true

. Otherwise, return

false

without doing anything.

Definition at line 1011 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ tryConsumeDouble() [1/2]

boolean com.google.protobuf.TextFormat.Tokenizer.tryConsumeDouble ( )

inline

If the next token is a double, consume it and return

true

. Otherwise, return

false

without doing anything.

Definition at line 1107 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ tryConsumeDouble() [2/2]

boolean com.google.protobuf.TextFormat.Tokenizer.tryConsumeDouble ( )

inline

If the next token is a double, consume it and return

true

. Otherwise, return

false

without doing anything.

Definition at line 1192 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ tryConsumeFloat() [1/2]

boolean com.google.protobuf.TextFormat.Tokenizer.tryConsumeFloat ( )

inline

If the next token is a float, consume it and return

true

. Otherwise, return

false

without doing anything.

Definition at line 1145 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ tryConsumeFloat() [2/2]

boolean com.google.protobuf.TextFormat.Tokenizer.tryConsumeFloat ( )

inline

If the next token is a float, consume it and return

true

. Otherwise, return

false

without doing anything.

Definition at line 1230 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ tryConsumeIdentifier() [1/2]

boolean com.google.protobuf.TextFormat.Tokenizer.tryConsumeIdentifier ( )

inline

If the next token is an identifier, consume it and return

true

. Otherwise, return

false

without doing anything.

Definition at line 987 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ tryConsumeIdentifier() [2/2]

boolean com.google.protobuf.TextFormat.Tokenizer.tryConsumeIdentifier ( )

inline

If the next token is an identifier, consume it and return

true

. Otherwise, return

false

without doing anything.

Definition at line 1072 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ tryConsumeInt64() [1/2]

boolean com.google.protobuf.TextFormat.Tokenizer.tryConsumeInt64 ( )

inline

If the next token is a 64-bit signed integer, consume it and return

true

. Otherwise, return

false

without doing anything.

Definition at line 1042 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ tryConsumeInt64() [2/2]

boolean com.google.protobuf.TextFormat.Tokenizer.tryConsumeInt64 ( )

inline

If the next token is a 64-bit signed integer, consume it and return

true

. Otherwise, return

false

without doing anything.

Definition at line 1127 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ tryConsumeString() [1/2]

boolean com.google.protobuf.TextFormat.Tokenizer.tryConsumeString ( )

inline

If the next token is a string, consume it and return true. Otherwise, return false.

Definition at line 1185 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ tryConsumeString() [2/2]

boolean com.google.protobuf.TextFormat.Tokenizer.tryConsumeString ( )

inline

If the next token is a string, consume it and return true. Otherwise, return false.

Definition at line 1270 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ tryConsumeUInt64() [1/2]

boolean com.google.protobuf.TextFormat.Tokenizer.tryConsumeUInt64 ( )

inline

If the next token is a 64-bit unsigned integer, consume it and return

true

. Otherwise, return

false

without doing anything.

Definition at line 1069 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ tryConsumeUInt64() [2/2]

boolean com.google.protobuf.TextFormat.Tokenizer.tryConsumeUInt64 ( )

inline

If the next token is a 64-bit unsigned integer, consume it and return

true

. Otherwise, return

false

without doing anything.

Definition at line 1154 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ unknownFieldParseExceptionPreviousToken() [1/2]

UnknownFieldParseException com.google.protobuf.TextFormat.Tokenizer.unknownFieldParseExceptionPreviousToken	(	final String	unknownField,
		final String	description
	)

inline

Returns a UnknownFieldParseException with the line and column numbers of the previous token in the description, and the unknown field name, suitable for throwing.

Definition at line 1270 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ unknownFieldParseExceptionPreviousToken() [2/2]

UnknownFieldParseException com.google.protobuf.TextFormat.Tokenizer.unknownFieldParseExceptionPreviousToken	(	final String	unknownField,
		final String	description
	)

inline

Returns a UnknownFieldParseException with the line and column numbers of the previous token in the description, and the unknown field name, suitable for throwing.

Definition at line 1355 of file protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

Member Data Documentation

◆ column

int com.google.protobuf.TextFormat.Tokenizer.column = 0

private

Definition at line 826 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ currentToken

String com.google.protobuf.TextFormat.Tokenizer.currentToken

private

Definition at line 819 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ DOUBLE_INFINITY

static final Pattern com.google.protobuf.TextFormat.Tokenizer.DOUBLE_INFINITY

staticprivate

Initial value:

=

Pattern.compile("-?inf(inity)?", Pattern.CASE_INSENSITIVE)

Definition at line 844 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ FLOAT_INFINITY

static final Pattern com.google.protobuf.TextFormat.Tokenizer.FLOAT_INFINITY

staticprivate

Initial value:

=

Pattern.compile("-?inf(inity)?f?", Pattern.CASE_INSENSITIVE)

Definition at line 846 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ FLOAT_NAN

static final Pattern com.google.protobuf.TextFormat.Tokenizer.FLOAT_NAN = Pattern.compile("nanf?", Pattern.CASE_INSENSITIVE)

staticprivate

Definition at line 848 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ line

int com.google.protobuf.TextFormat.Tokenizer.line = 0

private

Definition at line 825 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ matcher

final Matcher com.google.protobuf.TextFormat.Tokenizer.matcher

private

Definition at line 818 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ pos

int com.google.protobuf.TextFormat.Tokenizer.pos = 0

private

Definition at line 822 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ previousColumn

int com.google.protobuf.TextFormat.Tokenizer.previousColumn = 0

private

Definition at line 831 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ previousLine

int com.google.protobuf.TextFormat.Tokenizer.previousLine = 0

private

Definition at line 830 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ text

final CharSequence com.google.protobuf.TextFormat.Tokenizer.text

private

Definition at line 817 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ TOKEN

static final Pattern com.google.protobuf.TextFormat.Tokenizer.TOKEN

staticprivate

Initial value:

=
        Pattern.compile(
            "[a-zA-Z_][0-9a-zA-Z_+-]*+|" 
                + "[.]?[0-9+-][0-9a-zA-Z_.+-]*+|" 
                + "\"([^\"\n\\\\]|\\\\.)*+(\"|\\\\?$)|" 
                + "\'([^\'\n\\\\]|\\\\.)*+(\'|\\\\?$)", 
            Pattern.MULTILINE)

Definition at line 836 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

◆ WHITESPACE

static final Pattern com.google.protobuf.TextFormat.Tokenizer.WHITESPACE = Pattern.compile("(\\s|(#.*$))++", Pattern.MULTILINE)

staticprivate

Definition at line 835 of file bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java.

The documentation for this class was generated from the following file:

bloaty/third_party/protobuf/java/core/src/main/java/com/google/protobuf/TextFormat.java

Public Member Functions

Private Member Functions

Private Attributes

Static Private Attributes

Detailed Description

Constructor & Destructor Documentation

◆ Tokenizer() [1/2]

◆ Tokenizer() [2/2]

Member Function Documentation

◆ atEnd() [1/2]

◆ atEnd() [2/2]

◆ consume() [1/2]

◆ consume() [2/2]

◆ consumeBoolean() [1/2]

◆ consumeBoolean() [2/2]

◆ consumeByteString() [1/4]

◆ consumeByteString() [2/4]

◆ consumeByteString() [3/4]

◆ consumeByteString() [4/4]

◆ consumeDouble() [1/2]

◆ consumeDouble() [2/2]

◆ consumeFloat() [1/2]

◆ consumeFloat() [2/2]

◆ consumeIdentifier() [1/2]

◆ consumeIdentifier() [2/2]

◆ consumeInt32() [1/2]

◆ consumeInt32() [2/2]

◆ consumeInt64() [1/2]

◆ consumeInt64() [2/2]

◆ consumeString() [1/2]

◆ consumeString() [2/2]

◆ consumeUInt32() [1/2]

◆ consumeUInt32() [2/2]

◆ consumeUInt64() [1/2]

◆ consumeUInt64() [2/2]

◆ floatParseException() [1/2]

◆ floatParseException() [2/2]

◆ integerParseException() [1/2]

◆ integerParseException() [2/2]

◆ lookingAt() [1/2]

◆ lookingAt() [2/2]

◆ lookingAtInteger() [1/2]

◆ lookingAtInteger() [2/2]

◆ nextToken() [1/2]

◆ nextToken() [2/2]

◆ parseException() [1/2]

◆ parseException() [2/2]

◆ parseExceptionPreviousToken() [1/2]

◆ parseExceptionPreviousToken() [2/2]

◆ skipWhitespace() [1/2]

◆ skipWhitespace() [2/2]

◆ tryConsume() [1/2]

◆ tryConsume() [2/2]

◆ tryConsumeDouble() [1/2]

◆ tryConsumeDouble() [2/2]

◆ tryConsumeFloat() [1/2]

◆ tryConsumeFloat() [2/2]

◆ tryConsumeIdentifier() [1/2]

◆ tryConsumeIdentifier() [2/2]

◆ tryConsumeInt64() [1/2]

◆ tryConsumeInt64() [2/2]

◆ tryConsumeString() [1/2]

◆ tryConsumeString() [2/2]

◆ tryConsumeUInt64() [1/2]

◆ tryConsumeUInt64() [2/2]

◆ unknownFieldParseExceptionPreviousToken() [1/2]

◆ unknownFieldParseExceptionPreviousToken() [2/2]

Member Data Documentation

◆ column

◆ currentToken

◆ DOUBLE_INFINITY

◆ FLOAT_INFINITY

◆ FLOAT_NAN

◆ line

◆ matcher

◆ pos

◆ previousColumn

◆ previousLine

◆ text

◆ TOKEN