Interface TokenProducer3.SequenceParser<E extends Exception>

Enclosing class:
TokenProducer3<E extends Exception>

public static interface TokenProducer3.SequenceParser<E extends Exception>
Basic access to the current sequence in this tokenizer.

It is intended to be used by objects implementing TokenProducer3.CharacterCheck.

  • Method Details

    • currentSequence

      CharSequence currentSequence()
      Give the contents of the word currently being formed.
      Returns:
      the contents of the word currently being formed.
    • isPreviousCpWCharacter

      boolean isPreviousCpWCharacter()
      Was the previous codepoint added to the current word sequence as a CharacterCheck-accepted character ?

      A CharacterCheck-accepted character is different to normal word characters, and is only added to a word if it is allowed by the CharacterCheck process.

      Returns:
      true if the previous codepoint was added to the current word sequence as an external, CharacterCheck-accepted character.
      See Also:
    • getTokenControl

      TokenControl getTokenControl()
      Get the TokenControl for this parsing.
      Returns:
      the TokenControl.
    • resetCurrentSequence

      void resetCurrentSequence()
      Empty the current sequence.