Package opennlp.tools.util.featuregen
Class TokenFeatureGenerator
java.lang.Object
opennlp.tools.util.featuregen.TokenFeatureGenerator
- All Implemented Interfaces:
AdaptiveFeatureGenerator
Generates a feature which contains a token itself.
- See Also:
-
Constructor Summary
ConstructorsConstructorDescriptionInitializes aTokenFeatureGenerator.TokenFeatureGenerator(boolean lowercase) Initializes aTokenFeatureGenerator. -
Method Summary
Modifier and TypeMethodDescriptionvoidcreateFeatures(List<String> features, String[] tokens, int index, String[] preds) Adds the appropriate features for the token at the specifiedindexwith the specified array ofpreviousOutcomesto the specified list of features.Methods inherited from class java.lang.Object
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitMethods inherited from interface opennlp.tools.util.featuregen.AdaptiveFeatureGenerator
clearAdaptiveData, updateAdaptiveData
-
Constructor Details
-
TokenFeatureGenerator
public TokenFeatureGenerator(boolean lowercase) Initializes aTokenFeatureGenerator.- Parameters:
lowercase- Whether or not to use lower-casing.
-
TokenFeatureGenerator
public TokenFeatureGenerator()Initializes aTokenFeatureGenerator. Lower-casing will be enabled.
-
-
Method Details
-
createFeatures
Description copied from interface:AdaptiveFeatureGeneratorAdds the appropriate features for the token at the specifiedindexwith the specified array ofpreviousOutcomesto the specified list of features.- Specified by:
createFeaturesin interfaceAdaptiveFeatureGenerator- Parameters:
features- The list of features to be added to.tokens- The tokens of the sentence or other text unit being processed.index- The index of the token which is currently being processed.preds- The outcomes for the tokens prior to the specified index.
-