public final class

PythonLexer

extends DefaultJFlexLexer
java.lang.Object
   ↳ com.pnfsoftware.jeb.util.encoding.jflex.DefaultJFlexLexer
     ↳ com.pnfsoftware.jeb.util.encoding.jflex.lexers.PythonLexer

Summary

Constants
int ML_STRING
int SQML_STRING
int SQSTRING
int STRING
int YYEOF This character denotes the end of file.
int YYINITIAL
[Expand]
Inherited Fields
From class com.pnfsoftware.jeb.util.encoding.jflex.DefaultJFlexLexer
Public Constructors
PythonLexer()
Create an empty lexer, yyrset will be called later to reset and assign the reader
PythonLexer(Reader in)
Creates a new scanner
Public Methods
final boolean yyatEOF()
Returns whether the scanner has reached the end of the reader it reads from.
final void yybegin(int newState)
Enters a new lexical state.
long yychar()
Return the char number from beginning of input stream.
final char yycharat(int position)
Returns the character at the given position from the matched text.
final void yyclose()
Closes the input reader.
final int yylength()
How many characters were matched.
Token yylex()
Resumes scanning until the next regular expression is matched, the end of input is encountered or an I/O-Error occurs.
void yypushback(int number)
Pushes the specified amount of characters back into the input stream.
final void yyreset(Reader reader)
Resets the scanner to read from a new input stream.
final int yystate()
Returns the current lexical state.
final String yytext()
Returns the text matched by the current regular expression.
[Expand]
Inherited Methods
From class com.pnfsoftware.jeb.util.encoding.jflex.DefaultJFlexLexer
From class java.lang.Object

Constants

public static final int ML_STRING

Constant Value: 4 (0x00000004)

public static final int SQML_STRING

Constant Value: 8 (0x00000008)

public static final int SQSTRING

Constant Value: 6 (0x00000006)

public static final int STRING

Constant Value: 2 (0x00000002)

public static final int YYEOF

This character denotes the end of file.

Constant Value: -1 (0xffffffff)

public static final int YYINITIAL

Constant Value: 0 (0x00000000)

Public Constructors

public PythonLexer ()

Create an empty lexer, yyrset will be called later to reset and assign the reader

public PythonLexer (Reader in)

Creates a new scanner

Parameters
in the java.io.Reader to read input from.

Public Methods

public final boolean yyatEOF ()

Returns whether the scanner has reached the end of the reader it reads from.

Returns
  • whether the scanner has reached EOF.

public final void yybegin (int newState)

Enters a new lexical state.

Parameters
newState the new lexical state

public long yychar ()

Return the char number from beginning of input stream. This is NOT implemented by JFlex, so the code must be added to create this and return the private yychar field

public final char yycharat (int position)

Returns the character at the given position from the matched text.

It is equivalent to yytext().charAt(pos), but faster.

Parameters
position the position of the character to fetch. A value from 0 to yylength()-1.
Returns
  • the character at position.

public final void yyclose ()

Closes the input reader.

Throws
IOException if the reader could not be closed.

public final int yylength ()

How many characters were matched.

Returns
  • the length of the matched text region.

public Token yylex ()

Resumes scanning until the next regular expression is matched, the end of input is encountered or an I/O-Error occurs.

Returns
  • the next token.
Throws
IOException if any I/O-Error occurs.

public void yypushback (int number)

Pushes the specified amount of characters back into the input stream.

They will be read again by then next call of the scanning method.

Parameters
number the number of characters to be read again. This number must not be greater than yylength().

public final void yyreset (Reader reader)

Resets the scanner to read from a new input stream.

Does not close the old reader.

All internal variables are reset, the old input stream cannot be reused (internal buffer is discarded and lost). Lexical state is set to ZZ_INITIAL.

Internal scan buffer is resized down to its initial length, if it has grown.

Parameters
reader The new input stream.

public final int yystate ()

Returns the current lexical state.

Returns
  • the current lexical state.

public final String yytext ()

Returns the text matched by the current regular expression.

Returns
  • the matched text.