TokenizerTools.cc File Reference

Definitions for TokenizerTools. More...

#include <Common/Compat.h>
#include "TokenizerTools.h"
#include <Common/Logger.h>
#include <cctype>
#include <cerrno>
#include <climits>
#include <cstdlib>
#include <map>
#include <stack>

Include dependency graph for TokenizerTools.cc:

Go to the source code of this file.

Namespaces
	Hypertable
	Hypertable definitions
	Hypertable::ClusterDefinitionFile
	Cluster definition file translation definitions.
	Hypertable::ClusterDefinitionFile::TokenizerTools
	Tools to help cluster definition file tokenization.

Functions
bool	Hypertable::ClusterDefinitionFile::TokenizerTools::is_identifier_start_character (char c)
	Checks if character is valid bash identifier start character. More...
bool	Hypertable::ClusterDefinitionFile::TokenizerTools::is_identifier_character (char c)
	Checks if character is valid bash identifier character. More...
bool	Hypertable::ClusterDefinitionFile::TokenizerTools::is_valid_identifier (const string &name)
	Checks if name is a valid bash identifier. More...
bool	Hypertable::ClusterDefinitionFile::TokenizerTools::is_number (const string &str)
	Checks if string is an ASCII number. More...
bool	Hypertable::ClusterDefinitionFile::TokenizerTools::find_token (const string &token, const char *base, const char *end, size_t *offsetp)
	Finds a string token in a block of code. More...
bool	Hypertable::ClusterDefinitionFile::TokenizerTools::find_next_token (const char *base, size_t *offsetp, size_t *lengthp)
	Finds next bash identifier token in a block of text. More...
bool	Hypertable::ClusterDefinitionFile::TokenizerTools::find_end_char (const char *base, const char **endp, size_t *linep=nullptr)
	Skips to end of block or quoted string in code. More...
bool	Hypertable::ClusterDefinitionFile::TokenizerTools::skip_control_flow_statement (const char **basep)
	Skips over bash control flow statement. More...
size_t	Hypertable::ClusterDefinitionFile::TokenizerTools::count_newlines (const char *base, const char *end)
	Counts number of newlines in text. More...
bool	Hypertable::ClusterDefinitionFile::TokenizerTools::skip_to_newline (const char **endp)
	Skips to next newline character in text. More...
bool	Hypertable::ClusterDefinitionFile::TokenizerTools::substitute_variables (const string &input, string &output, map< string, string > &vmap)
	Does variable sustitution in a block of text. More...

Detailed Description

Definitions for TokenizerTools.

This file contains type definitions for TokenizerTools, a namespace containing utility functions to assist in cluster definition file tokenization.

Definition in file TokenizerTools.cc.