Skip to content

utils

allennlp.sanity_checks.task_checklists.utils

[SOURCE]


spacy_wrap

def spacy_wrap(
    fn: Callable,
    language: str = "en_core_web_sm",
    **kwargs
) -> Callable

Wrap the function so that it runs the input text data through a spacy model before the function call.

strip_punctuation

def strip_punctuation(data: Union[str, spacy.tokens.doc.Doc]) -> str

Removes all punctuation from data.

toggle_punctuation

def toggle_punctuation(data: str) -> List[str]

If data contains any punctuation, it is removed. Otherwise, a . is added to the string. Returns a list of strings.

Eg. data = "This was great!" Returns ["This was great", "This was great."]

data = "The movie was good" Returns ["The movie was good."]

random_string

def random_string(n: int) -> str

Returns a random alphanumeric string of length n.

random_url

def random_url(n: int = 6) -> str

Returns a random url of length n.

random_handle

def random_handle(n: int = 6) -> str

Returns a random handle of length n. Eg. "@randomstr23`

add_random_strings

def add_random_strings(data: str) -> List[str]

Adds random strings to the start and end of the string data. Returns a list of strings.