40 #include <fst/fstlib.h> 41 #include <fst/script/print.h> 42 #include <fst/extensions/pdt/pdtlib.h> 63 #define KENLM_MAX_ORDER 6 64 #include "lm/model.hh" 70 #include <tropical-sparse-tuple-weight.h> 71 #include <tropical-sparse-tuple-weight-decls.h> Handles simple wildcard expansion for strings.
Convenience functors/functions for lexicographic<tropical,tropical> semiring.
Contains convenience functions to write and read fsts.
Stream wrapper for pipe/text/compressed files.
Relative to Stats across the pipeline.
Contains patterns to instance-patterns implementation.
Data object for hifst or related tools.
Implementation of different type of compositions (i.e. failure transitions)
Contains structures and classes for GrammarData.
Lower casing/Tokenization/Detokenization not available for open source release.
Data object for alilats to sparse weight lats binary.
Provides smarter assert methods.
Interfaces with basic methods for iteration.
To initialize boost parameter options for hifst tool.
Implementations of multiple fst unions.
Implementation of a Fst writer taking the fst from data object.
Describes class GrammarTask.
Contains structures and classes for hifst task (target lattice building)
Task that dumps statistics related specifically to the tool hifst.
Implementation of a language model task.
Contains implementation of ApplyLanguageModelOnTheFly.
Implements a class that loads the grammar sparseweight flower lattice and stores a pointer on the dat...
Contains structures and classes for GrammarData.
Utilites to extract vocabulary, pseudo-determinize lattices and build substring transducers.
Headers for standalone shared library.
Implementation of a language model data structure using kenlm.
Implemention of class DisambigTask.
Convenience functions to parse parameters from a string.
Implementation of a Fst reader to data structure.
Task that writes translation to a text file. This translation might be wordmapped and tokenized...
Wrapper around WordMapper loader.
Contains implementation for sentence-specific grammar task.
Contains definitions for cykparser data and task.
Contains definitions for cykparser data and task.
Contains cyk parser implementation.
Generalized weight mapper functor.
Contains definitions for sentence-specific grammar data and task.
Convenience functors that allow transparent handling for weights within hifst.
Handles different type of integer ranges.
Contains sentence-specific grammar data.
Describes class PreProTask, which preprocesses (tokenizes and maps to integers with WordMapper) sourc...
Files to include for the tropical sparse tuple semiring.
Describes class ReferenceFilterTask (builds unweighted substring fst for lattice alignment ) ...
General typedefs, defines...
Multiepsilon composition.
Contains wrapper class RegistryPO, which uses boost::program_options to parse parameters, and provides methods to access them.
Implementation of a Fst writer taking the fst from data object.
All included standard headers, boost headers,...
Implementation of a unigram transduction model loader task.