Jule Manualstd::jule:lex
Globals
static Puncts: [...]rune
Punctuations.
static Spaces: [...]rune
Space characters.
static UnaryOps: [...]TokenKind
Kind list of unary operators.
static BinOps: [...]TokenKind
Kind list of binary operators.
static WeakOps: [...]TokenKind
Kind list of weak operators.
These operators are weak, can used as part of expression.
static PostfixOps: [...]TokenKind
List of postfix operators.
static AssignOps: [...]TokenKind
List of assign operators.
Functions
fn Lex(mut f: &File, text: []byte): boolLex source code into fileset.
Returns nil if f == nil.
Returns nil slice for errors if no any error.
fn NewFileSet(path: str): &FileReturns new File points to Jule file.
fn IsUnaryOp(kind: str): boolReports whether kind is unary operator.
fn IsBinOp(kind: str): boolReports whether kind is binary operator.
fn IsWeakOp(kind: str): boolReports whether kind is weak operator.
fn IsStr(k: str): boolReports whether kind is string literal.
fn IsRawStr(k: str): boolReports whether kind is raw string literal.
fn IsRune(k: str): boolReports whether kind is rune literal. Literal value can be byte or rune.
fn IsNil(k: str): boolReports whether kind is nil literal.
fn IsBool(k: str): boolReports whether kind is boolean literal.
fn IsFloat(k: str): boolReports whether kind is float.
fn IsNum(k: str): boolReports whether kind is numeric.
fn IsLit(k: str): boolReports whether kind is literal.
fn IsIgnoreIdent(ident: str): boolReports whether identifier is ignore.
fn IsAnonIdent(ident: str): boolReports whether identifier is anonymous.
fn IsPunct(r: rune): boolReports whether rune is punctuation.
fn IsSpace(r: rune): boolReports wheter byte is whitespace.
fn IsLetter(r: rune): boolReports whether rune is letter.
fn IsIdentRune(s: str): boolReports whether firs rune of string is allowed to first rune for identifier.
fn IsDecimal(b: byte): boolReports whether byte is decimal sequence.
fn IsBinary(b: byte): boolReports whether byte is binary sequence.
fn IsOctal(b: byte): boolReports whether byte is octal sequence.
fn IsHex(b: byte): boolReports whether byte is hexadecimal sequence.
Structs
struct File {
Path: str
Data: []byte
Tokens: []&Token
}Fileset for lexing.
Methods:
fn IsOk(self): bool
Reports whether file path is exist and accessible.
fn Dir(self): str
Returns directory of file's path.
fn Name(self): str
Returns filename.
fn Addr(self): uintptr
Returns self as uintptr.
fn Fill(mut self, mut data: []byte)
Fill data.
fn GetRow(self, row: int): str
Return line (not include new-line char) by row.
Returns empty string if line is not exist in buffer.
struct Token {
File: &File
Row: int
Column: int
Kind: str
Id: TokenId
}Token is lexer token.
Methods:
fn Prec(self): byte
Returns operator precedence of token.
Returns 0 if token is not operator or
invalid operator for operator precedence.
Accepts assignment tokens (like equals [=]) as precedenced operator to handle expression assignments.
fn Path(self): str
Returns path.
fn Dir(self): str
Returns directory of file's path.
fn Name(self): str
Returns filename.
fn Addr(self): uintptr
Returns self as uintptr.
Enums
enum LexMode
Lexer mode.
Fields:
Standard: Standard mode.Comment: Standard mode + comments.
enum Idenet: str
Special identifiers.
Fields:
Ignore: IgnoreAnon: Anonymous
enum TokenId: uint
Token identities.
Fields:
NaPrimIdentRangeRetSemicolonLitOpCommaConstTypeColonForBreakContInIfElseCommentUseDotPubGotoDblColonEnumStructCoMatchSelfTraitImplCppFallFnLetUnsafeMutDeferStaticError
enum TokenKind: str
Token kinds.
Fields:
DblColonColonSemicolonCommaTripleDotDotPlusEqMinusEqStarEqSolidusEqPercentEqLshiftEqRshiftEqCaretEqAmperEqVlineEqEqsNotEqGreatEqLessEqDblAmperDblVlineLshiftRshiftDblPlusDblMinusPlusMinusStarSolidusPercentAmperVlineCaretExclLtGtEqLnCommentRangLCommentRangRCommentLParentRParentLBracketRBracketLBraceRBraceI8I16I32I64U8U16U32U64UintIntUintptrBoolStrAnyTrueFalseNilConstRetTypeForBreakContInIfElseUsePubGotoEnumStructCoMatchSelfTraitImplCppFallFnLetUnsafeMutDeferStaticHashError