Blender V5.3
blender::gpu::shader::parser::ParserBase Struct Reference

#include <token_stream.hh>

Inherits blender::gpu::shader::parser::LexerBase.

Inherited by blender::gpu::shader::parser::Parser< ExpressionLexer, NullParser >, and blender::gpu::shader::parser::Parser< LexerFn, ParserFn >.

Public Member Functions

Token operator[] (int i) const
void build_scope_tree (ErrorHandler &err_handler)
void build_token_to_scope_map ()
void parse_bsl (ErrorHandler &err_handler)
ast::LocalScope root () const
void print_ast () const
Public Member Functions inherited from blender::gpu::shader::parser::LexerBase
std::string_view token_types_str () const
void identify_keywords ()
void identify_template_tokens ()
void reset_template_tokens ()
Public Member Functions inherited from lexit::TokenBuffer
 TokenBuffer ()=default
 TokenBuffer (const std::string_view str, const CharClass char_class_table[128])
void process (const std::string_view str, const CharClass char_class_table[128])
void clear ()
 Discard all currently held data. Does not reallocate.
void reserve (const uint32_t count)
 Allocate backing memory for the given number of tokens and move currently held data.
void tokenize (const CharClass char_class_table[128])
 Tokenizes the input string by grouping contiguous characters of the same class.
void merge_complex_literals (bool bsl_template_angle_bracket_lexing=false)
 Merge complex literals such as floats, strings and comments.
void atomize_words (IdentifierMap &identifiers, const KeywordTable &keywords)
 Assign keyword types and atoms for a small set of identifier.
void compute_lengths ()
 Compute small token length for speeding up certain tasks.
uint32_t size () const
 Return the amount of token inside the buffer.
std::string_view substr (const Token &start, const Token &end, const bool with_trailing_whitespaces=false) const
 Return the substring between the start and end tokens (included).
void append (TokenType type, TokenAtom atom, int32_t str_size, int32_t str_size_with_witespaces)
 Append a Token at the end of the buffer.
Token operator[] (int index) const
TokenMut operator[] (int index)
TokenIt begin ()
TokenIt end ()
Token front ()
Token back ()

Public Attributes

int include_id = 0
std::string_view scope_types_str
std::vector< ScopeType > scope_types
std::vector< IndexRange > scope_ranges
std::vector< ScopeLinks > scope_links
std::vector< int > token_scope
std::vector< ast::NodeData > ast_nodes
Public Attributes inherited from lexit::TokenBuffer
std::string_view str_
AlignedArrayPtr< TokenType > types_
AlignedArrayPtr< uint32_t > offsets_
AlignedArrayPtr< uint32_t > offsets_end_
AlignedArrayPtr< uint8_t > lengths_
AlignedArrayPtr< TokenAtom > atoms_
uint32_t size_ = 0
uint32_t allocated_size_ = 0

Additional Inherited Members

Static Public Attributes inherited from blender::gpu::shader::parser::LexerBase
static const std::array< CharClass, 128 > bsl_char_class_table
static const std::array< CharClass, 128 > default_char_class_table

Detailed Description

Create semantic scopes from token stream. Also creates mapping table from token to scope to have bi-directional mapping.

Definition at line 81 of file token_stream.hh.

Member Function Documentation

◆ build_scope_tree()

◆ build_token_to_scope_map()

void blender::gpu::shader::parser::ParserBase::build_token_to_scope_map ( )

◆ operator[]()

Token blender::gpu::shader::parser::ParserBase::operator[] ( int i) const

Definition at line 441 of file intermediate.cc.

References operator[](), and lexit::Token::Token().

Referenced by operator[]().

◆ parse_bsl()

◆ print_ast()

void blender::gpu::shader::parser::ParserBase::print_ast ( ) const

◆ root()

ast::LocalScope blender::gpu::shader::parser::ParserBase::root ( ) const

Member Data Documentation

◆ ast_nodes

std::vector<ast::NodeData> blender::gpu::shader::parser::ParserBase::ast_nodes

◆ include_id

int blender::gpu::shader::parser::ParserBase::include_id = 0

Definition at line 85 of file token_stream.hh.

◆ scope_links

std::vector<ScopeLinks> blender::gpu::shader::parser::ParserBase::scope_links

Index of adjacent scopes.

Definition at line 97 of file token_stream.hh.

Referenced by build_scope_tree().

◆ scope_ranges

std::vector<IndexRange> blender::gpu::shader::parser::ParserBase::scope_ranges

Range of token per scope.

Definition at line 95 of file token_stream.hh.

Referenced by build_scope_tree(), and build_token_to_scope_map().

◆ scope_types

std::vector<ScopeType> blender::gpu::shader::parser::ParserBase::scope_types

◆ scope_types_str

std::string_view blender::gpu::shader::parser::ParserBase::scope_types_str

◆ token_scope


The documentation for this struct was generated from the following files: