firelink package¶
Submodules¶
firelink.fire module¶
firelink.logger module¶
Logging Module. Module which setsup the basic logging infrustrcuture for the application.
- firelink.logger.get_logger(name=None, log_level=20)[source]¶
Set the basic logging features for the application. :param name: The name of the logger. Defaults to
None
:type name: str, optional :param log_level: The logging level. Defaults tologging.INFO
:type log_level: int, optional- Returns
Returns a Logger obejct which is set with the passed in paramters.
- Return type
logging.Logger
firelink.pipeline module¶
firelink.replace module¶
- class firelink.replace.ConditionalReplace(col, val, cond)[source]¶
Bases:
firelink.fire.Firstflame
conidtional statement
firelink.spark_transform module¶
- class firelink.spark_transform.ConditionalMapping(col, new_col, val, fill, result)[source]¶
Bases:
firelink.fire.Firstflame
conditional mapping
- class firelink.spark_transform.Select(col)[source]¶
Bases:
firelink.fire.Firstflame
select
- class firelink.spark_transform.WithColumn(colname, col)[source]¶
Bases:
firelink.fire.Firstflame
with column