Enum orzir_core::TokenKind

pub enum TokenKind {
    Char(char),
    Arrow,
    BlockLabel(String),
    ValueName(String),
    TyAlias(String),
    SymbolName(String),
    Tokenized(String),
    Eof,
    AnyBlockLabel,
    AnyValueName,
    AnyTyAlias,
    AnySymbolName,
    AnyTokenized,
}

A token kind.

Variants

Char(char)

A character

For delimiters, only :, =, ,, ;, * and - are supported. And for brackets, only (, ), {, }, [, ], <, > are supported. ^, %, !, @ will be used for block label, value name, type alias and symbol name respectively if they are not followed by an identifier, otherwise they will be treated as normal characters.

Arrow

->

BlockLabel(String)

A block label starting with ^.

ValueName(String)

A block name starting with %.

TyAlias(String)

A type alias starting with !.

This is the same with MLIR, but not used yet.

SymbolName(String)

A symbol name starting with @.

Tokenized(String)

Other tokenized string.

This represents contiguous alphanumeric or with _, . characters. And if the string is quoted, there can be escape sequences. This may also represent numbers, but the parsing process is up to the parser.

Eof

End of file.

AnyBlockLabel

The wildcard for block label

AnyValueName

The wildcard for value name

AnyTyAlias

The wildcard for type alias

AnySymbolName

The wildcard for symbol name

AnyTokenized

The wildcard for any tokenized string.

Implementations

impl TokenKind

pub fn is_compatible(&self, other: &Self) -> bool

Check if this token kind is compatible with the other.

Trait Implementations

impl Clone for TokenKind

fn clone(&self) -> TokenKind

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenKind

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for TokenKind

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for TokenKind

fn eq(&self, other: &TokenKind) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

This method tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for TokenKind

impl StructuralPartialEq for TokenKind